GESTURE DETECTION SYSTEM, GESTURE DETECTION APPARATUS, AND MOBILE COMMUNICATION TERMINAL

• US 20150123897A1
• Filed: 10/29/2014
• Published: 05/07/2015
• Est. Priority Date: 11/05/2013
• Status: Active Grant

• Current Assignee: Moff, Inc.
• Original Assignee: Moff, Inc.
• Inventors: TAKAHAGI, Akinori, YONESAKA, Motohiro
• Granted Patent: US 9,720,509 B2
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: A63H 30/04 using wireless transmission
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

Abstract

A gesture detection system having a gesture detection apparatus to detect a gesture of a user, and a mobile communication terminal that can communicate with the gesture detection apparatus, includes a storage unit to store first gesture data defining the gesture of the user, and audio or visual data associated with the first gesture data; an obtainment unit to obtain second gesture data representing the gesture of the user; a transmission unit to transmit the second gesture data to the mobile communication terminal; a determination unit to determine whether the gesture defined by the first gesture data is the same as the gesture represented by the second gesture data; a selection unit to select the audio or visual data associated with the first gesture data depending on the determination result; and an output unit to output the audio or visual data.

Claims

1. A gesture detection system including a gesture detection apparatus configured to detect a gesture of a user, and a mobile communication terminal configured to be capable of communicating with the gesture detection apparatus, the gesture detection system comprising:

a storage unit configured to store first gesture data defining the gesture of the user, and audio or visual data being associated with the first gesture data;

an obtainment unit configured to obtain second gesture data representing the gesture of the user;

a transmission unit configured to transmit the second gesture data to the mobile communication terminal;

a determination unit configured to determine whether the gesture defined by the first gesture data and the gesture represented by the second gesture data transmitted by the transmission unit are the same gesture;

a selection unit configured to select the audio or visual data being associated with the first gesture data depending on a result of the determination unit; and

an output unit configured to output the audio or visual data selected by the selection unit.

2. The gesture detection system as claimed in claim 1, further comprising:

an acceptance unit configured to receive a specification of new audio or visual data corresponding to third gesture data defining a new gesture of the user,

wherein the obtainment unit obtains the third gesture data,

the transmission unit transmits the third gesture data to the mobile communication terminal, and

the storage unit stores the third gesture data so that the third gesture data is associated with the new audio or visual data.

3. The gesture detection system as claimed in claim 1 or 2, wherein the gesture detection apparatus includes

a housing configured to include the obtainment unit and the transmission unit, and

a belt attached to the housing on two opposite side surfaces of the housing.

4. The gesture detection system as claimed in claim 3, wherein the gesture detection apparatus is attached to a toy operated by the user, or a wrist of the user, by the belt.

5. The gesture detection system as claimed in claim 1, wherein the storage unit stores the first gesture data being associated with a plurality of pieces of the audio or visual data,

the selection unit selects a piece of the audio or visual data among the pieces of the audio or visual data being associated with the first gesture data, depending on an output history about the pieces of the audio or visual data that have already been outputted by the output unit.

6. A gesture detection apparatus attached to a toy operated by a user, or a wrist the user, comprising:

a housing; and

a belt configure to be attached to the housing on two opposite side surfaces of the housing, for having the gesture detection apparatus attached to the toy operated by the user, or the wrist of the user,

wherein the housing includes

an obtainment unit configured to obtain gesture data representing a gesture of a user, and

a transmission unit configured to transmit the gesture data to a mobile communication terminal,

wherein if the mobile communication terminal determines that the gesture represented by the received gesture data, and a gesture defined by the gesture data being associated with audio or visual data are the same gesture, the mobile communication terminal outputs the audio or visual data.

7. A mobile communication terminal configured to be capable of communicating with a gesture detection apparatus configured to detect a gesture of a user, comprising:

a storage unit configured to store first gesture data defining the gesture of the user, and audio or visual data being associated with the first gesture data;

a reception unit configured to receive second gesture data representing the gesture of the user from the gesture detection apparatus;

a determination unit configured to determine whether the gesture defined by the first gesture data and the gesture received by the second gesture data transmitted by the reception unit are the same gesture;

a selection unit configured to select the audio or visual data being associated with the first gesture data depending on a result of the determination unit; and

an output unit configured to output the audio or visual data selected by the selection unit.

8. A non-transitory computer-readable recording medium having a program stored therein for causing a computer to execute a process, the computer configured to be capable of communicating with a gesture detection apparatus configured to detect a gesture of a user, the process comprising:

receiving first gesture data representing the gesture of the user from the gesture detection apparatus;

determining whether a gesture represented by the first gesture data received by the receiving, and a gesture defined by second gesture data stored in a storage unit and being associated with audio or visual data, are the same gesture;

selecting the audio or visual data depending on a result of the determining; and

outputting the audio or visual data selected by the selecting.

9. A gesture detection system including a gesture detection apparatus configured to detect a gesture of a user, and a mobile communication terminal configured to be capable of communicating with the gesture detection apparatus, the gesture detection system comprising:

a storage unit configured to store a predetermined gesture of the user and an operational direction in which the predetermined gesture is performed, and audio or visual data being associated with the predetermined gesture and the operational direction;

a calculation unit configured to calculate a relative angle with respect to a predetermined reference direction of the gesture detection apparatus based on detection data detected by the gesture detection apparatus; and

an output unit configured to output the audio or visual data stored in the storage unit, and being associated with the predetermined gesture and the operational direction, if a direction identified by the relative angle is included in the operational direction, and a gesture identified by the detection data is the predetermined gesture.

10. The gesture detection system as claimed in claim 9, wherein the storage unit stores

a gesture of beating a percussion instrument performed by the user,

a plurality of operational directions in which a plurality of percussion instruments are placed and the gesture is to be performed, and

audio data to be generated when the gesture of beating one of the percussion instruments is performed, the audio data being associated with the gesture and the plurality of operational directions.

11. The gesture detection system as claimed in claim 10, wherein the reference direction is a direction calculated based on the detection data detected by the gesture detection apparatus when the gesture of beating a predetermined one of the percussion instruments is performed.

12. A non-transitory computer-readable recording medium having a program stored therein for causing a computer included in a mobile communication terminal to execute a process, the computer being capable of communicating with a gesture detection apparatus configured to detect a gesture of a user, the computer storing a predetermined gesture of the user and an operational direction of the predetermined gesture, and audio or visual data being associated with the predetermined gesture and the operational direction, the process comprising:

calculating a relative angle with respect to a predetermined reference direction of the gesture detection apparatus based on detection data detected by the gesture detection apparatus; and

outputting the audio or visual data being stored and associated with the predetermined gesture and the operational direction, if a direction identified by the relative angle is included in the operational direction, and a gesture identified by the detection data is the predetermined gesture.