User-centric three-dimensional interactive control environment

• US 8,896,522 B2
• Filed: 07/04/2012
• Issued: 11/25/2014
• Est. Priority Date: 07/04/2011
• Status: Active Grant

• Current Assignee: 3divi Company
• Original Assignee: 3divi Company
• Inventors: Valik, Andrey, Zaitsev, Pavel, Morozov, Dmitry, Argutin, Alexander
• Primary Examiner(s): Dharia, Prabodh M
• Application Number:
  US13/541,681
• Publication Number:
  US 20130009865A1
• Time in Patent Office: 874 Days
• Field of Search: 345/8, 345156-184, 345/474, 345/581, 345/633, 463/29, 463/36, 382103-110, 348/36, 348/51, 348/77, 348/143, 348/222.1, 348/207.99
• US Class Current: 345/156
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042

Abstract

A computer-implemented method and system for controlling various electronic devices by recognition of gestures made by a user within a particular space defined in front of the user are provided. An example method may comprise generating a depth map of a physical scene, determining that a head of the user is directed towards a predetermined direction, establishing a virtual sensing zone defined between the user and a predetermined location, identifying a particular gesture made by the user within the virtual sensing zone, and selectively providing to the electronic device a control command associated with the particular gesture. The particular gesture may be performed by one or more characteristic forms provided by the user within the virtual sensing zone being in an active state. The characteristic forms are forms reliably distinguishable from casual forms by means of computer vision and having certain attributes, which can reliably reflect user intent.

Claims

1. A computer-implemented method for generating control commands for an electronic device, the method comprising:

generating a depth map of a physical scene;

determining that a head of the user is directed towards a predetermined direction;

establishing a predetermined virtual sensing zone defined between the user and a predetermined location, the predetermined virtual sensing zone being located in front of the user;

activating the predetermined virtual sensing zone in accordance with the determining;

identifying a particular gesture made by the user within the predetermined virtual sensing zone when the predetermined virtual sensing zone is in an active state; and

selectively providing to the electronic device a control command associated with the particular gesture.

2. The computer-implemented method of claim 1, wherein the particular gesture comprising a characteristic form.

3. The computer-implemented method of claim 1, wherein the particular gesture comprising a series of characteristic forms provided by the user in a successive manner during one or more predetermined time periods.

4. The computer-implemented method of claim 1, wherein the particular gesture is identified when the user provides the particular gesture during a predetermined time period.

5. The computer-implemented method of claim 1, wherein the predetermined virtual sensing zone is in the active state, when the head of the user is directed towards the predetermined direction.

6. The computer-implemented method of claim 1, further comprising tracking gestures and motions made by the user within the predetermined virtual sensing zone being in the active state.

7. The computer-implemented method of claim 1, wherein identifying the particular gesture made by the user within the predetermined virtual sensing zone comprising:

determining one or more attributes of the gesture, the attributes comprising one or more of the following;

a velocity, an acceleration, a trajectory, a time of exposure, and a location; and

determining that the one or more attributes refer to one or more predetermined attributes.

8. The computer-implemented method of claim 1, wherein the predetermined direction is associated with the depth sensing device or the electronic device.

9. The computer-implemented method of claim 1, wherein determining that the head of the user is directed towards the predetermined direction comprising determining one or more of the following:

a position of eyes of the user, a position of pupils or a contour of irises of the eyes, an orientation of a nose of the user, an angle of inclination of the head, a rotation of the head, and an orientation of a user skeleton.

10. The computer-implemented method of claim 1, wherein the predetermined virtual sensing zone is defined by a depth range between the user and the predetermined location.

11. The computer-implemented method of claim 1, wherein the predetermined virtual sensing zone is arranged at a predetermined distance from the user or the predetermined location.

12. The computer-implemented method of claim 1, wherein the predetermined virtual sensing zone is defined by one or more particular lengths, one or more particular widths, and one or more particular heights.

13. The computer-implemented method of claim 1, wherein the predetermined virtual sensing zone comprising a virtual cube, a parallelepiped, or a truncated parallelepiped.

14. The computer-implemented method of claim 1, further comprising:

acquiring biometric data associated with the user; and

authenticating the user, based on analysis of the biometric data, before the control command is selectively provided to the one or more electronic devices.

15. The method of claim 14, wherein the analysis of the biometric data comprises one or more of the following:

face recognition, recognition of a user body, recognition of a characteristic shape, and recognition of a user motion dynamics pattern.

16. A system for controlling an electronic device, the system comprising:

a depth sensing device configured to generate a depth map of a physical scene;

a computing unit communicatively coupled to the depth sensing device, the computing unit being configured to;

determine that a head of the user is directed towards a predetermined direction;

establish a predetermined virtual sensing zone defined between the user and a predetermined location, the predetermined virtual sensing zone being located in front of the user;

activate the predetermined virtual sensing zone in accordance with the determining;

identify a particular gesture made by the user within the predetermined virtual sensing zone when the predetermined virtual sensing zone is in an active state; and

selectively provide to the electronic device a control command associated with the particular gesture.

17. The system of claim 16, further comprising a video camera communicatively coupled to the computing unit, the video camera being configured to capture a series of successive images in real time and facilitate identifying of user head orientation and identifying one or more gestures of the user.

18. The system of claim 16, wherein the particular gesture comprising one or more characteristic forms provided by the used within the predetermined virtual sensing zone being in the active state, wherein the one or more characteristic forms are provided during one or more predetermined time periods.

19. A processor-readable medium having instructions stored thereon, which when executed by one or more processors, cause the one or more processors to:

generate a depth map of a physical scene;

determine that a head of the user is directed towards a predetermined direction;

establish a predetermined virtual sensing zone defined between the user and a predetermined location, the predetermined virtual sensing zone being located in front of the user;

activate the predetermined virtual sensing zone in accordance with the determining;

identify a particular gesture made by the user within the predetermined virtual sensing zone when the predetermined virtual sensing zone is in an active state; and

selectively provide to the electronic device a control command associated with the particular gesture.