Information processing device and method of information processing for notification of user speech received at speech recognizable volume levels

• US 10,642,575 B2
• Filed: 08/21/2015
• Issued: 05/05/2020
• Est. Priority Date: 12/02/2014
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Taki, Yuhei, Kawano, Shinichi, Sawai, Kunihito
• Primary Examiner(s): Pullias, Jesse S
• Application Number:
  US15/521,322
• Publication Number:
  US 20180150279A1
• Time in Patent Office: 1,719 Days
• Field of Search: 704231-257, 704270-275
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/1423 controlling a plurality of local displays, e.g. CRT and flat panel display
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G10L 17/00 Speaker identification or verification techniques
• CPC Class Codes: G10L 25/27 characterised by the analysis technique
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums

Abstract

To provide a technology capable of allowing a user to find whether speech is uttered with a volume at which speech recognition can be performed. Provided is an information processing device including: a determination portion configured to determine a user-uttered speech volume on the basis of input speech; and a display controller configured to control a display portion so that the display portion displays a display object. The display controller causes the display portion to display a first motion object moving toward the display object when the user-uttered speech volume exceeds a speech recognizable volume.

Claims

1. An information processing device, comprising:

a determination portion configured to;

determine a user-uttered speech volume based on input speech; and

determine a user-uttered speech source direction; and

a display controller configured to;

control a display portion to display a display object and a first motion object that moves in a direction from a side of a speech source to a side of the displayed display object, wherein

the display object and the first motion object are displayed based on;

the user-uttered speech volume that exceeds a speech recognizable volume, and

the user-uttered speech source direction, and

the direction of the movement of the first motion object toward the display object is opposite to the user-uttered speech source direction.

2. The information processing device according to claim 1, further comprising:

a speech recognition portion configured to acquire a recognition string based on speech recognition of the input speech from the user-uttered speech source direction.

3. The information processing device according to claim 2, wherein the display controller is further configured to control the display portion to display the acquired recognition string.

4. The information processing device according to claim 1, wherein

the determination portion is further configured to determine a noise volume based on the input speech, and

the display controller is further configured to control the display portion to display a second motion object different from the first motion object based on the noise volume that exceeds the speech recognizable volume.

5. The information processing device according to claim 4, wherein

the determination portion is further configured to determine a noise source direction, and

the display controller is further configured to control the display portion to display the second motion object based on the noise source direction.

6. The information processing device according to claim 5, wherein the display controller is further configured to move the second motion object so that the movement of the second motion object to the display object is blocked.

7. The information processing device according to claim 1, wherein the display controller is further configured to control a parameter related to the first motion object based on information corresponding to the input speech.

8. The information processing device according to claim 7, wherein the parameter related to the first motion object includes at least one of a size, a shape, a color, or a movement speed of the first motion object.

9. The information processing device according to claim 7, wherein the information corresponding to the input speech includes at least one of the user-uttered speech volume, a frequency of the input speech, a recognition string acquisition speed, a feature quantity extracted from the input speech, or a user identified from the input speech.

10. The information processing device according to claim 1, wherein the determination portion is further configured to determine the user-uttered speech source direction based on an arrival direction of the input speech with a volume having a magnitude that exceeds a threshold volume.

11. The information processing device according to claim 1, wherein the determination portion is further configured to determine the user-uttered speech source direction based on an arrival direction of the input speech with a maximum volume.

12. The information processing device according to claim 1, wherein the determination portion is further configured to:

determine a noise volume based on the input speech; and

set the speech recognizable volume to one of a volume corresponding to an average value of the noise volume or a volume corresponding to the noise volume,

wherein the speech recognizable volume is set based on the noise volume that exceeds a minimum limit.

13. The information processing device according to claim 1, wherein the display controller is further configured to control the display portion to display the display object based on recognition of an object associated with the display object from a captured image.

14. The information processing device according to claim 1, wherein the display controller is further configured to control the display portion to display the first motion object that moves toward the display object with a representation of a movement from a user near side to a user far side based on the user-uttered speech volume that exceeds the speech recognizable volume.

15. The information processing device according to claim 1, wherein the display controller is further configured to control the display portion to:

display a virtual object; and

display an object included in the virtual object as the display object.

16. A method, comprising:

determining a user-uttered speech volume based on input speech;

determining a user-uttered speech source direction; and

controlling a display portion to display a display object and a first motion object moving in a direction from a side of a speech source to a side of toward the displayed display object, wherein

the display object and the first motion object are displayed based on;

the user-uttered speech volume exceeding a speech recognizable volume, and

the user-uttered speech source direction, and

the direction of the movement of the first motion object toward the display object is opposite to the user-uttered speech source direction.

17. A non-transitory computer-readable medium having stored thereon computer-executable instructions that, when executed by a computer, cause the computer to execute operations, the operations comprising:

determining a user-uttered speech volume based on input speech;

determining a user-uttered speech source direction; and

controlling a display portion to display a display object and a first motion object moving in a direction from a side of a speech source to a side of the displayed display object, wherein

the display object and the first motion object are displayed based on;

the user-uttered speech volume exceeding a speech recognizable volume, and

the user-uttered speech source direction, and

the direction of the movement of the first motion object toward the display object is opposite to the user-uttered speech source direction.

18. An information processing device, comprising:

a determination portion configured to;

determine a user-uttered speech volume based on input speech; and

determine a user-uttered speech source direction,

wherein the user-uttered speech source direction is determined based on a direction from a tip to a base of a user finger; and

a display controller configured to;

control a display portion to display a display object and a first motion object that moves toward the displayed display object,

wherein the display object and the first motion object are displayed based on;

the user-uttered speech volume that exceeds a speech recognizable volume, and

the user-uttered speech source direction.

19. An information processing device, comprising:

a determination portion configured to;

determine a user-uttered speech volume based on input speech; and

determine a user-uttered speech source direction;

determine a noise volume based on the input speech; and

set a speech recognizable volume to a specific value based on the noise volume that is below a minimum limit; and

a display controller configured to;

control a display portion to display a display object and a first motion object that moves toward the displayed display object,

wherein the display object and the first motion object are displayed based on;

the user-uttered speech volume that exceeds the speech recognizable volume, and

the user-uttered speech source direction.