Gesture detecting device, gesture recognition device

• US 9,261,969 B2
• Filed: 11/14/2014
• Issued: 02/16/2016
• Est. Priority Date: 11/14/2013
• Status: Active Grant

• Current Assignee: JFE Systems Incorporated (JFE Holdings Incorporated)
• Original Assignee: JFE Systems Incorporated (JFE Holdings Incorporated)
• Inventors: Dangi, Ryoichi, Ohashi, Noriyuki, Arai, Yuko, Tsuruoka, Toshiki, Miyauchi, Atsushi
• Primary Examiner(s): Cheng, Joe H
• Application Number:
  US14/542,249
• Publication Number:
  US 20150130709A1
• Time in Patent Office: 459 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 21/31 User authentication
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0383 Signal control means within the pointing device
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G09G 5/18 Timing circuits for raster scan displays specially adapted for television H04N ; synchronisation between the display unit and other display units, videodisc player G09G5/12

Abstract

An object of the present invention is to make it possible for smart devices such as smartphones to provide new operability to users. A gesture detecting device includes a motion detecting unit and a processor. The processor calculates deviation value outputted by the motion detecting unit. At timing when the deviation value exceeds a threshold value at the time of shaking out, the processor obtains a direction determination value at the time of shaking out, whereas at timing when the deviation value falls below a threshold value at the time of shaking back the smartphone, the processor obtains a direction determination value at the time of shaking back. Further, on the basis of a combination of the direction determination value, the processor detects a gesture of the gesture detecting device.

Claims

1. A gesture detecting device comprising:

a motion detecting unit; and

a processor,

wherein the motion detecting unit outputs pieces of deviation value in three-dimensional sensor axis directions in response to a gesture made to the gesture detecting device, and

wherein the processor is configured to;

when in response to the gesture made to the gesture detecting device, first deviation value on a first sensor axis changes so as to exceed a threshold value, and then the first deviation value on the first sensor axis changes so as to fall below the threshold value, detect a tilt of the gesture detecting device to obtain a first direction determination value for the first sensor axis;

when in response to the gesture made to the gesture detecting device, second deviation value on a second sensor axis changes so as to exceed a threshold value, and then the second deviation value on the second sensor axis changes so as to fall below the threshold value, detect a tilt of the gesture detecting device to obtain a second direction determination value for the second sensor axis; and

while in response to the gesture made to the gesture detecting device, third deviation value on a third sensor axis is changing so as to exceed a threshold value, obtain neither the first direction determination value nor the second direction determination value, and thereby detects the gesture made to the gesture detecting device.

2. The gesture detecting device according to claim 1,

wherein the processor is configured to:

when in response to the gesture made to the gesture detecting device, the first deviation value on the first sensor axis changes so as to exceeds the threshold value, and then the first deviation value on the first sensor axis changes so as to exceed a second threshold value different from the threshold value, detect spin of the gesture detecting device to obtain a determination value indicating a spin gesture with respect to the first sensor axis; and

when in response to the gesture made to the gesture detecting device, the second deviation value on the second sensor axis changes so as to exceeds the threshold value, and then the second deviation value on the second sensor axis changes so as to exceed a second threshold value different from the threshold value, detect spin of the gesture detecting device to obtain a determination value indicating a spin gesture with respect to the second sensor axis.

3. The gesture detecting device according to claim 2,

wherein the processor is configured to:

when obtaining only the first direction determination value for the first sensor axis, output a gesture determination value indicating that the gesture detecting device is tilted in a direction specified by the first direction determination value;

when obtaining only the second direction determination value for the second sensor axis, output a gesture determination value indicating that the gesture detecting device is tilted in a direction specified by the second direction determination value;

when obtaining both of the first direction determination value for the first sensor axis and the second direction determination value for the second sensor axis, output a gesture determination value indicating that the gesture detecting device is tilted in a direction that is substantially intermediate between the direction specified by the first direction determination value and the direction specified by the second direction determination value;

when obtaining only the determination value indicating the spin gesture with respect to the first sensor axis, output a gesture determination value indicating that the gesture detecting device is spun in a direction specified by the determination value indicating the spin gesture with respect to the first sensor axis;

when obtaining only the determination value indicating the spin gesture with respect to the second sensor axis, output a gesture determination value indicating that the gesture detecting device is spun in a direction specified by the determination value indicating the spin gesture with respect to the second sensor axis; and

when obtaining both of the determination value indicating the spin gesture with respect to the first sensor axis and the determination value indicating the spin gesture with respect to the second sensor axis, output a gesture determination value indicating that the gesture detecting device is spun in a direction that is substantially intermediate between the direction specified by the determination value indicating the spin gesture with respect to the first sensor axis and the direction specified by the determination value indicating the spin gesture with respect to the second sensor axis.

4. The gesture detecting device according to claim 3, at timing when outputting the gesture determination value, displaying information related to the gesture determination value in a display unit.

5. The gesture detecting device according to claim 3, at timing when outputting the gesture determination value, giving an operation related to the gesture determination value to a user interface displayed in a display unit.

6. The gesture detecting device according to claim 3, at timing when outputting the gesture determination value, giving an output indicating a gesture mode of the gesture detecting device, the gesture mode being related to the gesture determination value.

7. The gesture detecting device according to claim 6,

wherein the output indicating the gesture mode of the gesture detecting device is a sound output, and

wherein the processor is configured to

at timing when outputting the gesture determination value, output the sound output indicating the gesture mode through a speaker.

8. The gesture detecting device according to claim 6,

wherein the output indicating the gesture mode of the gesture detecting device is an image output, and

wherein the processor is configured to

at timing when outputting the gesture determination value, display the image output indicating the gesture mode in a display unit.

9. The gesture detecting device according to claim 3, further comprising a storage part,

wherein the processor is configured to

store the gesture determination value in the storage part as a time series combination, and

perform an authentication process by determining whether or not the gesture determination value stored as the time series combination corresponds with predetermined information.

10. A gesture recognition device comprising:

the gesture detecting device according to claim 3, and

a neural network calculation unit,

wherein the processor of the gesture detecting device stores a first series of gesture determination values detected by the gesture detecting device in a storage part in time series combination;

the neural network calculation unit converts the first series of gesture determination values stored in the storage part into a neural network input signal, and inputs the converted neural network input signal and a tutor signal to a hierarchical neural network to thereby make the hierarchical neural network learn;

the processor of the gesture detecting device stores a second series of gesture determination values detected by the gesture detecting device in the storage device in time series combination;

the neural network calculation unit converts the second series of gesture determination values stored in the storage part into a neural network input signal, then inputs the neural network input signal to the hierarchical neural network having been made to learn the converted neural network input signal, and thereby obtains an output signal from the hierarchical neural network; and

the processor of the gesture detecting device determines a difference between the obtained output signal and the tutor signal, and when the determined difference is equal to or less than an allowable value, recognizes that the second series of gesture determination values are detected for gestures that are same as a series of gestures for which the gesture detecting device detects the first series of gesture determination values.