METHOD AND APPARATUS FOR IDENTIFYING SPATIAL GESTURE OF USER

• US 20150331492A1
• Filed: 03/26/2015
• Published: 11/19/2015
• Est. Priority Date: 05/14/2014
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: SHIN, Chang Woo, WOO, Jooyeon, RYU, Eric Hyunsurk
• Application Number:
  US14/669,906
• Publication Number:
  US 20150331492A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06V 40/161 Detection; Localisation; Normalisation
• CPC Class Codes: G06V 40/168 Feature extraction; Face representation
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

Provided is a method and apparatus for identifying a spatial gesture of a user that may recognize a reference image of a user from a three-dimensional (3D) space in which a gesture of the user is performed, divide the 3D space into a plurality of partitioned spaces based on the reference image, and identifies the gesture of the user in the plurality of partitioned spaces, based on the reference image.

Claims

1. A method of identifying a spatial gesture, the method comprising:

recognizing a reference image of a user from a three-dimensional (3D) space in which a gesture of the user is performed;

dividing the 3D space into a plurality of partitioned spaces based on the reference image; and

identifying the gesture of the user in the plurality of partitioned spaces, based on the reference image.

2. The method of claim 1, wherein the dividing comprises:

disposing the reference image of the user at a reference position of the 3D space; and

dividing the 3D space into the plurality of partitioned spaces around the reference image.

3. The method of claim 1, wherein the reference image comprises a facial image or an upper body image of the user that performs the gesture.

4. The method of claim 3, wherein when the reference image comprises the facial image, the dividing comprises setting a forehead portion of the facial image as a top of the 3D space, and setting a chin portion of the facial image as a bottom of the 3D space.

5. The method of claim 1, wherein the identifying comprises identifying a size, a position, a direction, and a depth of the gesture based on the reference image of the user in the plurality of partitioned spaces.

6. The method of claim 1, wherein the identifying comprises

recognizing a size, a position, a direction, and a depth of the gesture, based on a motion and a shape of a portion of an upper body of the user in the plurality of partitioned spaces and a face of the user in the plurality of partitioned spaces, wherein the upper body and the face are recognized in the reference image;

and

identifying the gesture of the user based on the recognized size, the recognized position, the recognized direction, and the recognized depth.

7. The method of claim 6, wherein the identifying comprises identifying, as identical gestures, gestures matching each other in terms of the recognized size, the recognized position, the recognized direction, and the recognized depth.

8. The method of claim 1, wherein the identifying comprises identifying, as identical gestures, gestures starting and ending in identical spaces among the plurality of partitioned spaces.

9. The method of claim 1, wherein the identifying comprises identifying the gesture of the user by normalizing a size and a direction of the gesture based on a size and an orientation of the reference image.

10. The method of claim 1, further comprising:

configuring a spatial coordinate system with respect to the plurality of partitioned spaces,

wherein the identifying comprises identifying the gesture using the configured spatial coordinate system with respect to the plurality of partitioned spaces.

11. The method of claim 10, wherein an axial direction of the spatial coordinate system is set or modified based on a shape of a face, an orientation of the face of the user, or a direction of an upper body of the user, wherein the face and the upper body are recognized in the reference image.

12. The method of claim 1, wherein sizes of the plurality of partitioned spaces are adaptively adjusted based on a size of the reference image.

13. The method of claim 12, wherein the sizes of the plurality of partitioned spaces are relatively adjusted based on a change in the size of the reference image with respect to a distance between the user and an apparatus for identifying the gesture of the user.

14. The method of claim 1, wherein positions of the plurality of partitioned spaces are relatively adjusted based on an orientation of the reference image.

15. The method of claim 1, further comprising:

performing a preset function corresponding to the identified gesture of the user.

16. The method of claim 15, wherein the preset function comprises at least one of a function to move to a preset menu or content corresponding to the gesture of the user, a function to activate a preset gesture mode corresponding to the gesture of the user, a function to execute, terminate, lock, and unlock a preset program corresponding to the gesture of the user, and a function to authenticate the user.

17. A non-transitory computer-readable recording medium which stores a program which is executed by a computer to perform the method of claim 1.

18. An apparatus for identifying a spatial gesture, the apparatus comprising:

a detector configured to detect a reference image of a user from a three-dimensional (3D) space in which a gesture of the user is performed; and

a processor configured to divide the 3D space into a plurality of partitioned spaces based on the reference image, and to identify the gesture of the user in the plurality of partitioned spaces based on the reference image.

19. The apparatus of claim 18, wherein the processor is further configured to

recognize a size, a position, a direction, and a depth of the gesture, based on a motion and a shape of a portion of an upper body of the user in the plurality of partitioned spaces, and a face of the user in the plurality of partitioned spaces, wherein the upper body and the face are recognized in the reference image;

and

identify the gesture of the user based on the recognized size, the recognized position, the recognized direction, and the recognized depth.

20. The apparatus of claim 18, wherein the processor is further configured to form a spatial coordinate system with respect to the plurality of partitioned spaces, and identify the gesture using the spatial coordinate system with respect to the plurality of partitioned spaces.

21. The apparatus of claim 18, further comprising:

a memory configured to store a preset gesture of the user corresponding to a plurality of functions.