APPARATUS AND METHOD FOR GENERATING DYNAMIC RESPONSE

• US 20120075178A1
• Filed: 09/23/2011
• Published: 03/29/2012
• Est. Priority Date: 09/27/2010
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Kwak, Byung Kwan, Park, Chi Youn, CHO, Jeong Mi, Kim, Jeong Su
• Application Number:
  US13/243,308
• Publication Number:
  US 20120075178A1
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence

Abstract

A dynamic response generating apparatus and method that may analyze an intention of a user based on user input information received from an inputting device, may analyze at least one of first response information with respect to the analyzed intention of the user, context information associated with the user input information, user motion information, and environmental information, may dynamically determine a modality with respect to the first response information, may process the first response information, and may dynamically generate second response information in a form of via the determined modality.

Claims

1. A dynamic response generating apparatus, the apparatus comprising:

a controller to control an operation of the dynamic generating apparatus;

an information receiving unit to receive user input information from an inputting device;

an analyzing unit to analyze an intention of a user based on the user input information;

a first response generating unit to generate first response information associated with the analyzed intention of the user;

a modality determining unit to dynamically determine a modality with respect to the first response information by analyzing at least one of the first response information, context information associated with the user input information, user motion information, and environmental information;

a second response generating unit to dynamically generate second response information in a form of the determined modality by processing the first response information; and

an outputting unit to output the second response information and a content in the form of the determined modality.

2. The apparatus of claim 1, wherein the inputting device includes at least one of a voice recognition device, an image recognition device, a text recognizing device, a motion recognition sensor, a temperature sensor, an illuminance sensor, and a humidity sensor.

3. The apparatus of claim 1, wherein the user input information includes at least one of a voice of the user, a motion of the user, a text, and an image inputted through the inputting device.

4. The apparatus of claim 1, further comprising:

an application execution unit to execute an application corresponding to the intention of the user.

5. The apparatus of claim 1, wherein, when a modality with respect to the user input information is directly received, the second response generating unit generates the second response information in a form of the directly received modality.

6. The apparatus of claim 1, further comprising:

a situation analyzing unit to analyze a situation of the user to determine the modality based on at least one of the first response information, the context information, the user motion information, the environmental information, or combinations thereof.

7. The apparatus of claim 6, wherein the situation analyzing unit analyzes the situation of the user based on one of a type of the content and a playtime of the content.

8. The apparatus of claim 6, wherein the modality determining unit dynamically determines the modality by analyzing the situation of the user.

9. The apparatus of claim 1, wherein the context information includes at least one of dialog context information and domain context information.

10. The apparatus of claim 1, wherein the modality determining unit determines the modality by separately analyzing one of the first response information, the context information associated with the user input information, the user motion information, and environmental information.

11. The apparatus of claim 1, wherein the modality determining unit determines the modality by analyzing together at least two of the first response information, the context information associated with the user input information, the user motion information, and environmental information.

12. The apparatus of claim 11, wherein, when multiple modalities exist, the modality determining unit determines priorities with respect to the multiple modalities.

13. A dynamic response generating method, the method comprising:

receiving user input information from an inputting device;

analyzing an intention of a user based on the user input information;

generating first response information associated with the analyzed intention of the user;

dynamically determining a modality with respect to the first response information by analyzing at least one of the first response information, context information associated with the user input information, user motion information, environmental information, or combinations thereof;

dynamically generating second response information in a form of the determined modality by processing the first response information; and

outputting the second response information and a content in the form of the determined modality.

14. The method of claim 13, wherein, when a modality with respect to the user input information is directly received, the dynamically generating of the second response information comprises generating the second response information in a form of the directly received modality.

15. The method of claim 13, further comprising:

analyzing a situation of the user to determine the modality based on at least one of the first response information, the context information, the user motion information, and the environmental information.

16. The method of claim 15, wherein the determining of the modality comprises dynamically determining of the modality by analyzing the situation of the user.

17. A non-transitory computer-readable medium comprising a program for instructing a computer to perform the method of claim 13.