Hand gesture recognition method, device, system, and computer storage medium

• US 10,198,083 B2
• Filed: 10/22/2014
• Issued: 02/05/2019
• Est. Priority Date: 02/25/2014
• Status: Active Grant

• Current Assignee: Xi'An Zhongxing New Software Co., Ltd. (ZTE Corporation)
• Original Assignee: Xi'An Zhongxing New Software Co., Ltd. (ZTE Corporation)
• Inventors: Liu, Haijun
• Primary Examiner(s): Kujundzic, Dino
• Application Number:
  US15/121,592
• Publication Number:
  US 20170277267A1
• Time in Patent Office: 1,567 Days
• CPC Class Codes: G06F 13/38 Information transfer, e.g. on bus G06F13/14 takes precedence
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113
• CPC Class Codes: H04L 12/2803 Home automation networks

Abstract

The embodiments of the present invention disclose a hand gesture recognition method, device, and system; the hand gesture recognition method disclosed in the present invention comprising: a first hand gesture recognition device determining, according to a recognized hand gesture and the position thereof, as well as said hand gesture and the position thereof as recognized by a second hand gesture recognition device, whether to accept control by said hand gesture. Another hand gesture recognition method disclosed by the present invention comprises: a first hand gesture recognition device publishing information of a hand gesture it has recognized, and receiving information of said hand gesture recognized by a second hand gesture recognition device.

Claims

1. A gesture recognition method, comprising:

determining, by a first gesture recognition device, according to information of a gesture recognized by the first gesture recognition device and information of the gesture recognized by a second gesture recognition device(s), whether to accept control by the gesture;

wherein the information of the gesture comprises at least one of the following information;

the shape of the gesture or the position of the gesture;

wherein, when the information of the gesture comprises the shape of the gesture and the position of the gesture, determining, by the first gesture recognition device, according to the information of the gesture recognized by the first gesture recognition device and the information of the gesture recognized by the second gesture recognition device(s), whether to accept the control by the gesture comprises;

determining, by the first gesture recognition device, according to the shape of the gesture recognized by the first gesture recognition device, that the gesture is supported, and determining, according to the position of the gesture recognized by the first gesture recognition device and the position of the gesture recognized by the second gesture recognition device(s), whether the gesture satisfies a preset condition;

if yes, determining to accept the control by the gesture, and otherwise, determining not to accept the control by the gesture;

wherein the preset condition comprises at least one of the following conditions;

the distance between the gesture and the first gesture recognition device is smaller than the distance between the gesture and the second gesture recognition device(s);

or

a deviation angle of the gesture from the first gesture recognition device is smaller than a deviation angle of the gesture from the second gesture recognition device(s).

2. The gesture recognition method according to claim 1, further comprising:

publishing, by the first gesture recognition device, the information of the gesture recognized by the first gesture recognition device.

3. The gesture recognition method according to claim 2, wherein publishing, by the first gesture recognition device, the information of the gesture recognized by the first gesture recognition device comprises:

publishing, in the form of a message, by the first gesture recognition device, the information of the gesture recognized by the first gesture recognition device;

or

publishing, in the form of a message, by the first gesture recognition device when receiving a query request, the information of the gesture recognized by the first gesture recognition device.

4. The gesture recognition method according to claim 1, further comprising:

when the first gesture recognition device fails to receive, within a preset period of time, a message indicating that the second gesture recognition device(s) determines to accept the control by the gesture, determining, by the first gesture recognition device, to accept the control by the gesture, and publishing a message indicating that the control by the gesture is accepted;

or

when the first gesture recognition device fails to receive, within a preset period of time, the message indicating that the second gesture recognition device(s) determines to accept the control by the gesture, republishing, by the first gesture recognition device, the information of the gesture recognized by the first gesture recognition device.

5. The gesture recognition method according to claim 1, further comprising:

when the first gesture recognition device determines to accept the control by the gesture,

publishing, by the first gesture recognition device, a message indicating that the control by the gesture is accepted.

6. The gesture recognition method according to claim 1, wherein the shape of the gesture comprises at least one of the following information:

a gesture number, gesture text description information, and or digital graphic information; and

wherein the position of the gesture comprises at least one of the following information;

space coordinate parameters of the gesture, space coordinates of the gesture, gesture image data carrying depth information, or positioning parameters of the gesture relative to an absolute origin.

7. The gesture recognition method according to claim 1, wherein the gesture comprises:

a computer vision recognition gesture and a wearable device gesture.

8. A non-transitory computer storage medium having stored therein computer executable instructions used for executing the gesture recognition method according to claim 1.

9. A gesture recognition method, comprising:

publishing, by a first gesture recognition device, information of a gesture recognized by the first gesture recognition device, and receiving information of the gesture recognized by a second gesture recognition device(s);

determining, by the first gesture recognition device, according to the information of the gesture recognized by the first gesture recognition device and the information of the gesture recognized by the second gesture recognition device(s), whether to accept control by the gesture;

wherein the information of the gesture comprises at least one of the following information;

the shape of the gesture or the position of the gesture;

wherein, when the information of the gesture comprises the shape of the gesture and the position of the gesture, determining, by the first gesture recognition device, according to the information of the gesture recognized by the first gesture recognition device and the information of the gesture recognized by the second gesture recognition device(s), whether to accept the control by the gesture comprises;

determining, by the first gesture recognition device, according to the shape of the gesture recognized by the first gesture recognition device, that the gesture is supported, and determining, according to the position of the gesture recognized by the first gesture recognition device, and the position of the gesture recognized by the second gesture recognition device(s), whether the gesture satisfies a preset condition;

if yes, determining to accept the control by the gesture, and otherwise, determining not to accept the control by the gesture;

wherein the preset condition comprises at least one of the following conditions;

the distance between the gesture and the first gesture recognition device is smaller than the distance between the gesture and the second gesture recognition device(s);

or

a deviation angle of the gesture from the first gesture recognition device is smaller than a deviation angle of the gesture from the second gesture recognition device(s).

10. The gesture recognition method according to claim 9, further comprising:

when the first gesture recognition device fails to receive, within a preset period of time, a message indicating that the second gesture recognition device(s) determines to accept the control by the gesture, determining, by the first gesture recognition device, to accept the control by the gesture, and publishing a message indicating that the control by the gesture is accepted;

or

when the first gesture recognition device fails to receive, within a preset period of time, the message indicating that the second gesture recognition device(s) determines to accept the control by the gesture, republishing, by the first gesture recognition device, the information of the gesture recognized by the first gesture recognition device.

11. The gesture recognition method according to claim 9, further comprising:

when the first gesture recognition device determines to accept the control by the gesture,

publishing, by the first gesture recognition device, a message indicating that the control by the gesture is accepted.

12. The gesture recognition method according to claim 9, wherein publishing, by the first gesture recognition device, the information of the gesture recognized by the first gesture recognition device comprises:

publishing, in the form of a message, by the first gesture recognition device, the information of the gesture recognized by the first gesture recognition device;

or

publishing, in the form of a message, by the first gesture recognition device when receiving a query request, the information of the gesture recognized by the first gesture recognition device.

13. The gesture recognition method according to claim 9, wherein the shape of the gesture comprises at least one of the following information:

a gesture number, gesture text description information, or digital graphic information; and

wherein the position of the gesture comprises at least one of the following information;

space coordinate parameters of the gesture, space coordinates of the gesture, gesture image data carrying depth information, or positioning parameters of the gesture relative to an absolute origin.

14. The gesture recognition method according to claim 9, wherein the gesture comprises:

a computer vision recognition gesture and a wearable device gesture.

15. A non-transitory computer storage medium having stored therein computer executable instructions used for executing the gesture recognition method according to claim 9.