Somatosensory recognition system and recognition method thereof

• US 9,557,810 B2
• Filed: 01/20/2015
• Issued: 01/31/2017
• Est. Priority Date: 01/05/2015
• Status: Active Grant

• Current Assignee: BOE Technology Group Co., Ltd.
• Original Assignee: BOE Technology Group Co., Ltd.
• Inventors: Mou, Xinxin, Zhao, Xingxing
• Primary Examiner(s): HALEY, JOSEPH R
• Application Number:
  US14/600,321
• Publication Number:
  US 20160195920A1
• Time in Patent Office: 742 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G09G 2370/16 Use of wireless transmission of display information
• CPC Class Codes: G09G 5/003 Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto specific for a CRT G09G1/165; for a flat panel G09G3/2092

Abstract

Disclosed is a somatosensory recognition system for recognizing a human body'"'"'s action and a recognition method thereof. The somatosensory recognition system comprises: an acquisition device configured to acquire a first motion track data of a body parts'"'"' action; a wearable device worn on the body parts and configured to acquire a second motion track data of the body parts'"'"' action; and a processing device configured to compare the first motion track data and the second motion track data and determine the body parts'"'"' action according to comparison result. The above somatosensory recognition system and the recognition method thereof can improve the accuracy of somatosensory recognition.

Claims

1. A somatosensory recognition system for recognizing human body'"'"'s action, comprising:

an acquisition device configured to acquire a first motion track data of a body parts'"'"' action;

a wearable device capable of being worn on the body parts and configured to acquire a second motion track data of the body parts'"'"' action; and

a processing device configured to compare the first motion track data and the second motion track data and determine the body parts'"'"' action according to comparison result;

wherein the processing device comprises an action recognition unit, a first wireless transmission unit and an action judgment unit, the action recognition unit is connected with the acquisition device and configured to recognize a first position information of the body parts from the first motion track data;

the first wireless transmission unit is configured to receive the second motion track data from the wearable device and send the second motion track data to the action judgment unit;

the action judgment unit is connected with the action recognition unit and configured to receive the first position information, and is further connected with the first wireless transmission unit and configured to receive the second motion track data from the first wireless transmission unit and extract a second position information of the wearable device from the second motion track data, compare the first position information and the second position information and determine a position of the body parts according to comparison result;

wherein the action judgment unit is further configured to normalize the second position information before comparing the first position information and the second position information, the normalization comprising;

storing an initial first position information recognized by the action recognition unit while the body parts are in stationary state; and

then, adding the second position information to the stored initial first position information while the body parts are moving, so that a normalized second position information is obtained.

2. The somatosensory recognition system of claim 1, wherein each of the first position information and the second position information is triaxial spatial coordinate data.

3. The somatosensory recognition system of claim 1, wherein comparing the first position information and the second position information and determining the position of the body parts according to comparison result comprises:

comparing the first position information and the normalized second position information, if a difference between the first position information and the normalized second position information is within a threshold range, taking an average of the first position information and the normalized second position information as the position of the body parts; and

if the difference between the first position information and the normalized second position information exceeds the threshold range, taking the normalized second position information as the position of the body parts.

4. The somatosensory recognition system of claim 1, wherein the wearable device comprises a data acquisition unit and a second wireless transmission unit;

the data acquisition unit is configured to acquire the second motion track data;

the second wireless transmission unit is connected with the data acquisition unit and configured to receive the second motion track data and send the second motion track data to the first wireless transmission unit.

5. The somatosensory recognition system of claim 4, wherein the wearable device further comprises a carrier in which the data acquisition unit and the second wireless transmission unit are disposed, the carrier comprises an article worn on the body, an article adorned the body, or a garniture mounted on any of the articles.

6. The somatosensory recognition system of claim 4, wherein the wearable device further comprises a second control unit which is configured to reset the data acquisition unit.

7. The somatosensory recognition system of claim 4, wherein the data acquisition unit comprises a sensor.

8. The somatosensory recognition system of claim 7, wherein the sensor is an accelerometer, a magnetic flow meter, or a gyro.

9. The somatosensory recognition system of claim 4, wherein each of the first wireless transmission unit and the second wireless transmission unit is Bluetooth, infrared or radio frequency apparatus.

10. The somatosensory recognition system of claim 1, further comprising an output device configured to output an instruction corresponding to the body parts'"'"' action.

11. The somatosensory recognition system of claim 10, wherein the processing device further comprises a first control unit connected with the action judgment unit, the first control unit is configured to look up a corresponding instruction according to a change in determined position of the body′

part and send the instruction to the output device.

12. The somatosensory recognition system of claim 1, wherein the acquisition device comprises at least one image pick-up element.

13. A somatosensory recognition method, comprising:

acquiring a first motion track data of body parts'"'"' action;

acquiring a second motion track data of the body parts'"'"' action, the second motion track data being recorded by a wearable device worn on the body parts; and

comparing the first motion track data and the second motion track data and determining the body parts'"'"' action according to comparison result, which operation comprises;

acquiring a first position information of the body parts from the first motion track data, acquiring a second position information of the wearable device from the second motion track data, and comparing the first position information and the second position information, wherein before comparing the first position information and the second position information, the method further comprises;

normalizing the second position information, wherein the normalization comprises;

storing an initial first position information while the body parts are in stationary state, and then adding the second position information to the stored initial first position information while the body parts are moving to get the normalized second position information.

14. The somatosensory recognition method of claim 13, wherein comparing the first position information and the second position information and determining the position of the body parts according to comparison result comprises:

comparing the first position information and the normalized second position information, if a difference between the first position information and the normalized second position information is within a threshold range, taking the average of the first position information and the normalized second position information as the position of the body parts; and

when the difference between the first position information and the normalized second position information exceeds the threshold range, taking the normalized second position information as the position of the body parts.

15. The somatosensory recognition method of claim 13, further comprising:

outputting an instruction corresponding to the body parts'"'"' action.

16. The somatosensory recognition method of claim 13, each of the first position information and the second position information is triaxial spatial coordinate data.