Information processing apparatus, information processing method, and program

• US 8,381,238 B2
• Filed: 05/24/2011
• Issued: 02/19/2013
• Est. Priority Date: 06/02/2010
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Sano, Akane, Di Profio, Ugo, Sawada, Tsutomu, Matsuda, Kouichi
• Primary Examiner(s): Kincaid, Kristine
• Assistant Examiner(s): MONTOYA, OSCHTA I
• Application Number:
  US13/114,581
• Publication Number:
  US 20120096481A1
• Time in Patent Office: 637 Days
• Field of Search: None
• US Class Current: 725/12
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Abstract

An information processing apparatus includes an image analyzing unit performing a process of analyzing an image shot by a camera, a voice analyzing unit performing a process of analyzing voice input from a microphone, and a data processing unit receiving inputs of an analysis result of the image analyzing unit and an analysis result of the voice analyzing unit and controlling information to be output to a user. The data processing unit determines an output mode of the information to be provided to the user based on user information obtained from at least either one of the image analysis result and the voice analysis result, and system state information, and outputs the information to the user in the determined output mode.

Claims

1. An information processing apparatus comprising:

an image analyzing unit performing a process of analyzing an image shot by a camera;

a voice analyzing unit performing a process of analyzing voice input from a microphone; and

a data processing unit receiving inputs of an analysis result of the image analyzing unit and an analysis result of the voice analyzing unit and controlling information to be output to a user;

wherein;

the data processing unit determines an output mode of the information to be provided to the user based on user information obtained from the image analysis result and the voice analysis result, and system state information, and outputs the information to the user in the determined output mode;

the data processing unit determines based on the analysis result of the image analyzing unit whether the user is paying attention to the information processing apparatus and, when determining that the user is not paying attention to the information processing apparatus, performs information output with voice or sound effect;

the data processing unit controls output by changing a level of information to be output to the user based on information about errors previously caused by the user; and

the data processing unit determines a level of skill of the user for using the information processing apparatus based on operation history information indicating previous operations performed by the user on the information processing apparatus and, performs control of outputting a brief description when determining that the user is not a beginner and outputting a detailed description or a description at a normal level when determining that the user is a beginner.

2. The information processing apparatus according to claim 1, wherein the data processing unit determines based on the analysis result of the image analyzing unit whether the user is in front of the information processing apparatus and, when determining that the user is not in front of the information processing apparatus, performs information output with voice or sound effect.

3. The information processing apparatus according to claim 1, wherein the data processing unit performs information output to the display unit when determining based on the system state information that the information processing apparatus is playing content to the display unit.

4. The information processing apparatus according to claim 1, wherein the data processing unit determines based on the system state information whether the information processing apparatus is to output a warning to the user and, when determining that a warning is to be output, performs information output with voice or sound effect.

5. The information processing apparatus according to claim 1, wherein the data processing unit performs control of outputting a detailed description when the number of times of errors of a same type caused by a same user exceeds a predetermined threshold within a predetermined period.

6. The information processing apparatus according to claim 1, wherein the data processing unit performs control of outputting a detailed description when the number of times of errors of a plurality of different types successively caused by a same user exceeds a predetermined threshold within a predetermined period.

7. An information processing method to be performed in an information processing apparatus, the method comprising:

analyzing an image shot by a camera using an image analyzing unit;

analyzing voice input from a microphone using a voice analyzing unit;

receiving inputs of an analysis result of the image analyzing unit and an analysis result of the voice analyzing unit;

controlling information to be output to a user using a data processing unit;

determining an output mode of the information to be provided to the user based on user information obtained from the image analysis result and the voice analysis result, and system state information;

outputting the information to the user in the determined output mode;

determining based on the analysis result of the image analyzing unit whether the user is paying attention to the information processing apparatus and, when determining that the user is not paying attention to the information processing apparatus, performs information output with voice or sound effect;

controlling output by changing a level of information to be output to the user based on information about errors previously caused by the user;

determining a level of skill of the user for using the information processing apparatus based on operation history information indicating previous operations performed by the user on the information processing apparatus; and

performing control of outputting a brief description when determining that the user is not a beginner and outputting a detailed description or a description at a normal level when determining that the user is a beginner.

8. A non-transitory computer-readable medium storing a program which, when executed by an information processing apparatus, causes the information processing apparatus to perform an information processing method comprising:

analyzing an image shot by a camera using an image analyzing unit;

analyzing voice input from a microphone using a voice analyzing unit;

receiving inputs of an analysis result of the image analyzing unit and an analysis result of the voice analyzing unit;

controlling information to be output to a user using a data processing unit;

determining an output mode of the information to be provided to the user based on user information obtained from the image analysis result and the voice analysis result, and system state information;

outputting the information to the user in the determined output mode;

determining based on the analysis result of the image analyzing unit whether the user is paying attention to the information processing apparatus and, when determining that the user is not paying attention to the information processing apparatus, performs information output with voice or sound effect;

controlling output by changing a level of information to be output to the user based on information about errors previously caused by the user;

determining a level of skill of the user for using the information processing apparatus based on operation history information indicating previous operations performed by the user on the information processing apparatus; and

performing control of outputting a brief description when determining that the user is not a beginner and outputting a detailed description or a description at a normal level when determining that the user is a beginner.