SYSTEM AND METHOD FOR GENERATING CONTROL INSTRUCTION BY USING IMAGE PICKUP DEVICE TO RECOGNIZE USERS POSTURE

• US 20110158546A1
• Filed: 03/12/2010
• Published: 06/30/2011
• Est. Priority Date: 12/25/2009
• Status: Abandoned Application

• Current Assignee: Primax Electronics Limited
• Original Assignee: Primax Electronics Limited
• Inventors: Liu, Xu-Hua, Tan, Fei, Huang, Ying-Jieh
• Application Number:
  US12/723,417
• Publication Number:
  US 20110158546A1
• Time in Patent Office: Days
• US Class Current: 382/224
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16

Abstract

A system and a method are provided for generating a control instruction by using an image pickup device to recognize a user'"'"'s posture. An electronic device is controlled according to different composite postures. Each composite posture is a combination of the hand posture, the head posture and the facial expression change of the user. Each composite posture indicates a corresponding control instruction. Since the composite posture is more complex than peoples'"'"' habitual actions, the possibility of causing erroneous control instruction from unintentional habitual actions of the user will be minimized or eliminated.

Claims

1. A system for generating a control instruction by using an image pickup device to recognize a user'"'"'s posture, said system being in communication with an electronic device, said electronic device being controlled by said system according to a composite posture including a hand posture and a head posture of a user, said system comprising:

an image pickup unit for capturing an image of said composite posture;

an image analyzing unit in communication with said image pickup unit for recognizing said image of said composite posture;

a database unit for storing plural reference image data and control instructions corresponding to said plural reference image data;

a comparing unit in communication with said image analyzing unit and said database unit for comparing said image of said composite posture with said plural reference image data stored in said database unit, thereby searching a specified reference image data complied with said image of said composite posture and acquiring a specified control instruction corresponding to said specified reference image data; and

an instruction processing unit in communication with said comparing unit and said electronic device for transmitting said specified control instruction searched by said comparing unit to said electronic device.

2. The system according to claim 1 wherein said head posture includes a facial expression or a facial expression change.

3. The system according to claim 2 wherein said facial expression change includes a left eye opening/closing motion of said user, a right eye opening/closing motion of said user, a mouth opening/closing motion of said user or a combination of any two thereof.

4. The system according to claim 2 wherein said image analyzing unit comprises:

a hand image analyzing subunit for detecting a hand'"'"'s position of said user in said image of said composite posture, thereby analyzing said hand posture of said user;

a head image analyzing subunit for detecting a head'"'"'s position of said user in said image of said composite posture, thereby analyzing said head posture of said user;

a facial image analyzing subunit for detecting relative positions of facial features in said image of said composite posture, thereby analyzing said facial expression or said facial expression change of said user; and

a composite posture image analyzing subunit for recognizing said image of said composite posture according an overall analyzing result obtained by said hand image analyzing subunit, said head image analyzing subunit and said facial image analyzing subunit.

5. The system according to claim 1 wherein said head posture includes a static head posture and a dynamic head posture.

6. The system according to claim 5 wherein said static head posture includes a head frontward posture of said user, a head rightward posture of said user, a head leftward posture of said user, a head upward posture of said user, a head leftward-tilt posture of said user or a head rightward-tilt posture of said user.

7. The system according to claim 5 wherein said dynamic head posture includes a nodding motion of said user, a head-shaking motion of said user, a head clockwise circling motion of said user or a head anti-clockwise circling motion of said user.

8. The system according to claim 1 wherein said hand posture includes a static hand gesture or a dynamic hand gesture.

9. The system according to claim 8 wherein said static hand gesture includes a static hand posture, a static arm posture, or a combination of said static hand posture and said static arm posture.

10. The system according to claim 9 wherein said static hand posture includes a static left hand posture of said user, a static right hand posture of said user, or a combination of said static left hand posture and said static right hand posture.

11. The system according to claim 10 wherein said static left hand posture includes a left palm open posture, a left hand grip posture, a left -hand single-finger extension posture, a left-hand two-finger extension posture, a left-hand three-finger extension posture or a left-hand four-finger extension posture.

12. The system according to claim 10 wherein said static right hand posture includes a right palm open posture, a right hand grip posture, a right-hand single-finger extension posture, a right-hand two-finger extension posture, a right-hand three-finger extension posture or a right-hand four-finger extension posture.

13. The system according to claim 9 wherein said static arm posture includes a static left arm posture, a static right arm posture, or a combination of said static left arm posture and said static right arm posture.

14. The system according to claim 13 wherein said static left arm posture is a posture of placing a left arm in a specified direction.

15. The system according to claim 13 wherein said static right arm posture is a posture of placing a right arm in a specified direction.

16. The system according to claim 9 wherein said dynamic hand gesture is obtained by once moving said static hand gesture in a single motion or repeatedly moving said static hand gesture in a repeated motion.

17. The system according to claim 16 wherein said single motion includes a clockwise circling motion, an anti-clockwise circling motion, a clicking motion, a crossing motion, a ticking motion, a triangle-drawing motion, an upward sweeping motion, a leftward sweeping motion, a rightward sweeping motion or a combination of any two thereof.

18. The system according to claim 16 wherein said repeated motion includes a repeated clockwise circling motion, a repeated anti-clockwise circling motion, a repeated clicking motion, a repeated crossing motion, a repeated ticking motion, a repeated triangle-drawing motion, a repeated upward sweeping motion, a repeated leftward sweeping motion, a repeated rightward sweeping motion or a combination of any two thereof.

19. A method for generating a control instruction to control an electronic device by using an image pickup device to recognize a user'"'"'s posture, said method comprising steps of:

capturing an image of a composite posture of a user, wherein said composite posture comprises a hand posture of said user and a head posture of said user;

recognizing said image of said composite posture;

comparing said recognized image of said composite posture with predetermined reference image data, thereby acquiring a control instruction corresponding to said predetermined reference image data; and

inputting said control instruction into said electronic device.

20. The method according to claim 19 wherein said hand posture includes a static hand gesture or a dynamic hand gesture, and said head posture includes a static head posture and a dynamic head posture.

21. The method according to claim 20 further comprising a step of acquiring said static head posture of said user according to a position of a face feature point of said user in said image, or discriminating said dynamic head posture of said user according to a change of said static head posture of said user in a series of continuous images.

22. The method according to claim 21 wherein said face feature point of said user includes two ends of an eyebrow, a pupil, a corner of an eye, a nose, a corner of a moth, or a combination of any two thereof.

23. The method according to claim 20 further comprising a step of acquiring said static hand gesture of said user according to a position of a hand feature point of said user in said image, and/or discriminating said dynamic hand gesture of said user according to a change of said static hand gesture of said user in a series of continuous images.

24. The method according to claim 23 wherein said hand feature point of said user includes a palm, a finger, an arm, or a combination of any two thereof.

25. The method according to claim 19 wherein said head posture includes a facial expression or a facial expression change.

26. The method according to claim 25 further comprising a step of acquiring said facial expression of said user according to relative positions of facial features of said user in said image, or discriminating said facial expression change of said user according to a relative position change of said facial features of said user in a series of continuous images.