Statistical Dialogue Processing for Ambient Intelligence

1. Introduction

As social values have shifted away from attaching too much importance to convenience and efficiency, NTT Communication Science Laboratories has been working on projects related to ambient intelligence, which aims to enrich information and communications technology and improve the quality of life [1]. Towards this aim, we propose a new style of living that is achieved through technological developments in communication science, and we have made it our mission to perform interdisciplinary research around the theme of integrated intelligence.

As shown in the concept depicted in Fig. 1, the ecology of ambient intelligence can be expressed using phrases such as: there are a lot of intelligent entities, they can be discreet, they answer you, and they are hidden [2]. We are currently trying to realize a form of ambient intelligence by utilizing engineering. One of these trials is introduced below.

Fig. 1. Ecology of ambient intelligence.

In the project, we first demonstrated diverse future life styles with ambient intelligence by presenting them in the form of various scenarios. A simplified version of one of these scenarios is presented below.

Scenario: Some people are meeting in a room. A number of ambient intelligences are also scattered around the room.

• Ambient intelligence 1: Analyzes the room’s atmosphere. Is it friendly or serious? Also figures out the discussion topic from what is being said.
• Ambient intelligence 2: Presents hints relevant to the discussion by engaging in dialogues with humans such as “Could you remind me what ... is?” to collect information.

2. Interactive processing techniques

How far has this scenario actually been realized so far? To answer this question, we will talk about research on dialogues, which is currently a very active subject. A multi-party prototype dialogue system that we are working on is shown in Fig. 2. We aim to develop a system that can understand the environment of a meeting. In addition, by using the system, we are conducting research into ambient intelligence that acts as an attentive presence that works without making a nuisance of itself [3], [4]. To implement natural dialogue control, we are also researching dialogue processing technology that satisfies the desire for someone to talk with, or for someone who is willing to listen [3], [4]. Below, we focus mainly on our dialogue processing research.

Fig. 2. Multi-party dialogue system.

3. Statistical dialogue control methods

In a wide variety of environments, a huge effort is needed for the manual programming of systems that can dialogue flexibly with humans. Furthermore, complex programs of this sort are impossible to write without inconsistencies. We have therefore developed a statistical method that automatically learns dialogue control from dialogues among humans and between humans and systems, as shown in Fig. 3. This method is based on reinforcement learning: when the system performs an action in a particular situation, a reward value is set to determine the action’s degree of appropriateness. Reinforcement learning is a technique in which dialogue control for action selection to maximize the average reward obtained in the future is determined through a process of repeated trial and error. This technique is used in many different fields such as mechanisms that enable systems to learn actions, but when it is used in dialogue systems, a problem arises: how should the reward values be set to determine the system behavior? We prescribed two types of reward in order to implement better dialogue interactions [5].

Fig. 3. Statistical interactive control method based on reinforcement learning.

(1) Rewards related to satisfaction

An annotator is asked to look at dialogues between a human and another human and between a human and a system and evaluate them in terms of their degree of satisfaction. For example, the dialogues are graded according to a 7-point scale by asking questions such as “Did the system listen properly to what the user was saying?”

(2) Rewards related to naturalness

Initially, we expected that with satisfaction rewards, the system would generate actions that satisfy users. However, in actual experiments, we found that the dialogue system ignored user actions that are naturally included in dialogues between humans, such as greetings, and instead suddenly launched into dialogues that gained higher satisfaction scores. To improve upon this, we considered that dialogues that are performed frequently but are not highly rated are also essential, and we also gave high rewards for such dialogues.

By simultaneously setting these two rewards, we implemented dialogue control in a listener interactive system that achieves both high satisfaction and natural interaction.

4. Evaluation experiment

Next, we experimentally evaluated the statistical dialogue control method [6]. With current technology, it is extremely difficult for a computer to automatically generate complex sentences such as those used in dialogues between humans. Therefore, in our proposed method, we implemented dialogue control in action units such as asking questions and indicating acknowledgment. Here, we refer to these action units as dialogue actions. To check the performance of the statistical dialogue control method, we performed an evaluation experiment with systems based on rules and a hidden Markov model. The evaluation consisted of three steps.

• Step 1: We constructed a statistical dialogue control system and five comparative systems (described below) and output dialogue action sequences for evaluation from each system by performing a simulation.
• Step 2: It is difficult to perform a direct evaluation by looking at generated dialogue action sequences. Therefore, the dialogue sentences were first generated manually from the sequences to make them more natural and then evaluated. Before the sentences were generated, an ordinary everyday scenario was presented to each participant. Specifically, participants were presented with fictitious information about what they had eaten, when, and with whom (e.g., last night, meat-and-potato stew, family). The 16 participants were then asked to create dialogue sequences by imagining themselves to be in those circumstances.
• Step 3: Three additional participants (different from those in Step 2) evaluated the dialogues produced in Step 2 on a 7-point scale in response to the question “If you were the speaker, would you think that the listener is doing a good job?”.

5. Future prospects

So far, we have implemented a dialogue control that generates only dialogue actions. In the future, we intend to work at deepening our understanding of dialogues and the generation of dialogue content in order to implement a smarter dialogue system.

References

Yasuhiro Minami Senior Research Scientist, NTT Communication Science Laboratories. He received the M.Eng. degree in electrical engineering and the Ph.D. degree in electrical engineering from Keio University in 1988 and 1991, respectively. He joined NTT in 1991. He had worked in the field of robust speech recognition. He was a visiting researcher at MIT, USA, from 1999 to 2000. Since February 2000, he has been with NTT Communication Science Laboratories. He is interested in modeling for speech recognition and speech dialogue systems.

Toyomi Meguro Researcher, NTT Communication Science Laboratories. She received the B.E. and M.E. degrees in electrical engineering from Tohoku University, Miyagi, in 2006 and 2008, respectively. She joined NTT in 2008. Her research interests are building listening agents and recommendation systems.