GESTURE INPUT DEVICE, GESTURE INPUT METHOD, AND PROGRAM

• US 20110239118A1
• Filed: 03/11/2011
• Published: 09/29/2011
• Est. Priority Date: 03/25/2010
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Zhou, Ning, Yokono, Jun, Suzuki, Hirotaka, Hasegawa, Yuichi, Yamaoka, Keisuke
• Granted Patent: US 8,726,196 B2
• Time in Patent Office: Days
• US Class Current: 715/709
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G10L 15/02 Feature extraction for speech recognition; Selection of recognition unit

Abstract

There is provided a gesture input device including an input unit to which at least one of image information and voice information representing a user'"'"'s action is input, a detection unit that detects the user'"'"'s action based on the input at least one of the image information and the voice information, a prediction unit that predicts one or more gestures that the user desires to input based on a detection result of the action, and a notification unit that notifies the user of an action to be performed next by the user in order to input the predicted one or more gestures.

Claims

1. A gesture input device, comprising:

an input unit to which at least one of image information and voice information representing a user'"'"'s action is input;

a detection unit that detects the user'"'"'s action based on the input at least one of the image information and the voice information;

a prediction unit that predicts one or more gestures that the user desires to input based on a detection result of the action; and

a notification unit that notifies the user of an action to be performed next by the user in order to input the predicted one or more gestures.

2. The gesture input device according to claim 1,

wherein the gesture includes two or more sub gestures,

the gesture input device further comprises a recognition unit that recognizes a sub gesture input by the user based on the detection result of the action,

the prediction unit predicts one or more sub gestures that the user desires to input next based on a recognition result of an immediately previously input sub gesture, and

the notification unit notifies the user of an action to be performed next by the user in order to input the predicted one or more sub gestures.

3. The gesture input device according to claim 2,

wherein a transition probability between the sub gestures is calculated, and

the notification unit notifies the user of an action to be performed next by the user so that each sub gesture can be discriminated according to a transition probability between an immediately previously input sub gesture and one or more sub gestures that the user desires to input next.

4. The gesture input device according to claim 1,

wherein an input frequency of each gesture is recorded, and

the notification unit notifies the user of an action to be performed next by the user so that each gesture can be discriminated according to an input frequency of each gesture included in the predicted one or more gestures.

5. A gesture input method, comprising the steps of:

detecting a user'"'"'s action based on at least one of image information and voice information representing the user'"'"'s action;

predicting one or more gestures that the user desires to input based on a detection result of the action; and

notifying the user of an action to be performed next by the user in order to input the predicted one or more gestures.

6. A program for causing a computer to execute a gesture input method, the method comprising:

detecting a user'"'"'s action based on at least one of image information and voice information representing the user'"'"'s action;

predicting one or more gestures that the user desires to input based on a detection result of the action; and

notifying the user of an action to be performed next by the user in order to input the predicted one or more gestures.