Gesture control method, apparatus and system

• US 10,013,067 B2
• Filed: 09/17/2013
• Issued: 07/03/2018
• Est. Priority Date: 04/15/2013
• Status: Active Grant

• Current Assignee: ZTE Corporation
• Original Assignee: ZTE Corporation
• Inventors: Liu, Haijun, Lin, Lidong, Zhou, Yunjun, Huang, Zheng, Miao, Chuanyang
• Primary Examiner(s): Moon, Seokyun
• Application Number:
  US14/784,435
• Publication Number:
  US 20160266653A1
• Time in Patent Office: 1,750 Days
• Field of Search: None
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G08C 2201/32 Remote control based on movements, attitude of remote control device
• CPC Class Codes: H04N 21/43615 Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals home Audio Video Interoperability [HAVI] data switching networks H04L12/2805

Abstract

Disclosed are a gesture control method, device and system, during gesture control, a gesture control center identifies a gesture for a controlled device, and transmits manipulation information corresponding to an identified gesture to the controlled device; and the controlled device performs a corresponding operation according to received manipulation information. By means of gesture control techniques according to the disclosure, it is possible to ensure that gesture manipulation of multiple devices can be implemented by only one gesture identification device such as the gesture control center, and thus a unified gesture control is implemented, thereby avoiding possible malfunctions that may be generated during gesture control of different devices and also avoiding a waste of resources; furthermore, it is possible to provide a convenient manipulation way to devices that don'"'"'t support manipulation through gesture identification and save costs for those devices to be added with a gesture identification component, and all above benefits improve effectively user satisfaction.

Claims

1. A gesture control method, comprising:

identifying, by a gesture control center, a controlled device within a visible range of the gesture control center,

wherein when identifying the controlled device within the visible range of the gesture control center, the gesture control center identifies and records a device position of the controlled device;

identifying, by the gesture control center, a gesture for the controlled device after identifying the controlled device within the visible range of the gesture control center, and transmitting manipulation information corresponding to the gesture to the controlled device,

wherein when identifying the gesture for the controlled device, the gesture control center identifies a manipulation command corresponding to the gesture and a controlled device to which the gesture directs,

wherein identifying, by the gesture control center, the controlled device to which the gesture directs comprises;

calculating the direction of the gesture using an angle between the gesture and a video collection module of the gesture control center;

or

after measurement of distances between the gesture, the controlled device and the gesture control center, calculating the direction of the gesture using trigonometric formulas,

wherein after measurement of distances between the gesture, the controlled device and the gesture control center, calculating the direction of the gesture using trigonometric formulas further comprises;

calculating an angle between a line from a palm to an elbow and a line from the palm to each controlled device; and

selecting a controlled device about which the angle is smallest as the controlled device to which the gesture directs; and

performing, by the controlled device, a corresponding operation according to the manipulation information.

2. The method according to claim 1, wherein when identifying the controlled device within the visible range of the gesture control center, the gesture control center identifies and records at least one of a device identifier or a device address of the controlled device.

3. The method according to claim 1, wherein

the transmitting, by the gesture control center, the manipulation information comprises transmitting the manipulation command or gesture feature data;

and/or

when the manipulation information is the manipulation command, performing an operation corresponding to the manipulation command;

when the manipulation information is the gesture feature data, analyzing the gesture feature data to obtain the manipulation command, and performing an operation corresponding to the manipulation command.

4. The method according to claim 1, further comprising:

establishing, by the controlled device, a connection with the gesture control center, and implementing, by the gesture control center based on the connection, manipulation of the controlled device through a session using a message.

5. A gesture control apparatus, comprising a video collection module, an identification module, a control module, a distance measuring module, and a data storage module,

wherein the distance measuring module is configured to identify, along with the video collection module, a controlled device within a visible range and calculate a distance between the apparatus and the controlled device,

wherein the data storage module is configured to, upon identification of the controlled device within the visible range, record a device position of the controlled device,

wherein the video collection module is configured to capture a gesture for the controlled device,

wherein the identification module is configured to identify the gesture, and the identification module comprises an image identification module and a gesture identification module,

wherein the image identification module is configured to identify a manipulation command corresponding to the gesture, and

wherein the gesture identification module is configured to identify a controlled device to which the gesture directs,

wherein the gesture identification module is further configured to, when identifying the controlled device to which the gesture directs,

calculate the direction of the gesture using an angle between the gesture and the video collection module;

or

after measurement of distances between the gesture, the controlled device and the apparatus, calculate the direction of the gesture using trigonometric formulas,

wherein the gesture identification module is further configured to, when identifying the controlled device to which the gesture directs, after measurement of distances between the gesture, the controlled device and the apparatus,

calculate an angle between a line from a palm to an elbow and a line from the palm to each controlled device; and

select a controlled device about which the angle is smallest as the controlled device to which the gesture directs, and

wherein the control module is configured to transmit manipulation information corresponding to the gesture to the controlled device.

6. The apparatus according to claim 5, wherein the data storage module is further configured to, upon identification of the controlled device within the visible range, record at least one of a device identifier or a device address of the controlled device.

7. The apparatus according to claim 5, wherein the control module is further configured to, when transmitting the manipulation information, transmit a manipulation command or gesture feature data.

8. The apparatus according to claim 5, further comprising:

a network service module configured to establish a connection with the controlled device, and implement, based on the connection, manipulation of the controlled device through a session using a message.