GESTURE CONTROL METHOD, APPARATUS AND SYSTEM

• US 20160266653A1
• Filed: 09/17/2013
• Published: 09/15/2016
• Est. Priority Date: 04/15/2013
• Status: Active Grant

• Current Assignee: ZTE Corporation
• Original Assignee: ZTE Corporation
• Inventors: Lin, Lidong, Liu, Haijun, Zhou, Yunjun, Huang, Zheng, Miao, Chuanyang
• Granted Patent: US 10,013,067 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G08C 2201/32 Remote control based on movements, attitude of remote control device
• CPC Class Codes: H04N 21/43615 Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals home Audio Video Interoperability [HAVI] data switching networks H04L12/2805

Abstract

Disclosed are a gesture control method, device and system, during gesture control, a gesture control center identifies a gesture for a controlled device, and transmits manipulation information corresponding to an identified gesture to the controlled device; and the controlled device performs a corresponding operation according to received manipulation information. By means of gesture control techniques according to the disclosure, it is possible to ensure that gesture manipulation of multiple devices can be implemented by only one gesture identification device such as the gesture control center, and thus a unified gesture control is implemented, thereby avoiding possible malfunctions that may be generated during gesture control of different devices and also avoiding a waste of resources; furthermore, it is possible to provide a convenient manipulation way to devices that don'"'"'t support manipulation through gesture identification and save costs for those devices to be added with a gesture identification component, and all above benefits improve effectively user satisfaction.

Claims

1. A gesture control method, comprising:

identifying, by a gesture control center, a gesture for a controlled device, and transmitting manipulation information corresponding to an identified gesture to the controlled device; and

performing, by the controlled device, a corresponding operation according to received manipulation information.

2. The method according to claim 1, further comprising:

before the identifying a gesture for a controlled device,

identifying, by the gesture control center, a controlled device within its visible range.

3. The method according to claim 2, wherein when identifying the controlled device within its visible range, the gesture control center identifies and records at least one of a device identifier, a device address and a device position of the controlled device.

4. The method according to claim 1, wherein when identifying the gesture for the controlled device, the gesture control center identifies a manipulation command corresponding to the gesture and a controlled device to which the gesture directs.

5. The method according to claim 4, wherein identifying by the gesture control center a controlled device to which the gesture directs comprises:

calculating using an angle between the gesture and a video collection module of the gesture control center;

or

after measurement of distances between the gesture, the controlled device and the gesture control center, calculating using trigonometric formulas.

6. The method according to claim 4, wherein

the transmitting by the gesture control center the manipulation information comprises transmitting a manipulation command or gesture feature data;

and/or

when the manipulation information received by the controlled device is the manipulation command, performing an operation corresponding to the manipulation instruction;

when the manipulation information received by the controlled device is the gesture feature data, analyzing the received gesture feature data to obtain a manipulation command, and performing an operation corresponding to the obtained manipulation command.

7. The method according to claim 1, further comprising:

establishing, by the controlled device, a connection with the gesture control center, and implementing, by the gesture control center based on the connection, manipulation of the controlled device through a session using a message.

8. A gesture control apparatus, comprising a video collection module, an identification module and a control module,

wherein the video collection module is configured to capture a gesture for a controlled device;

wherein the identification module is configured to identify the gesture; and

wherein the control module is configured to transmit manipulation information corresponding to an identified gesture to the controlled device.

9. The apparatus according to claim 8, further comprising a distance measuring module configured to identify, along with the video collection module, a controlled device within a visible range, and calculate a distance between the apparatus and the controlled device.

10. The apparatus according to claim 9, further comprising a data storage module configured to, upon identification of a controlled device within the visible range, record at least one of a device identifier, a device address and a device position of an identified controlled device.

11. The apparatus according to claim 8, wherein the identification module comprises an image identification module and a gesture identification module,

wherein the image identification module is configured to identify a manipulation command corresponding to a gesture;

and

wherein the gesture identification module is configured to identify a controlled device to which the gesture directs.

12. The apparatus according to claim 11, wherein the gesture identification module is configured to, when identifying the controlled device to which the gesture directs,

calculate using an angle between the gesture and the video collection module;

or

after measurement of distances between the gesture, the controlled device and the apparatus, calculate using trigonometric formulas.

13. The apparatus according to claim 11, wherein the control module is configured to, when transmitting the manipulation information, transmit a manipulation command or gesture feature data.

14. The apparatus according to claim 8, further comprising:

a network service module configured to establish a connection with the controlled device, and implement, based on the connection, manipulation of the controlled device through a session using a message.

15. A gesture control system, comprising a gesture control center and a controlled device,

wherein the gesture control center is configured to identify a gesture for the controlled device, and transmit manipulation information corresponding to an identified gesture to the controlled device;

and

wherein the controlled device is configured to perform a corresponding operation according to received manipulation information.

16. The system according to claim 15, wherein

the gesture control center is configured to, when transmitting the manipulation information, transmit a manipulation command or gesture feature data;

and/or

the controlled device is configured to, when the received manipulation information is the manipulation command, perform an operation corresponding to the manipulation instruction, and when the received manipulation information is the gesture feature data, analyze the received gesture feature data to obtain a manipulation command, and perform an operation corresponding to the obtained manipulation command.

17. The system according to claim 15, wherein the controlled device is configured to, when performing the corresponding operation according to the received manipulation information, establish a connection with the gesture control center, based on which manipulation of the controlled device is implemented through a session using a message.