Three dimensional user interface session control using depth sensors

• US 9,417,706 B2
• Filed: 05/17/2015
• Issued: 08/16/2016
• Est. Priority Date: 01/14/2008
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Galor, Micha, Pokrass, Jonathan, Hoffnung, Amir
• Primary Examiner(s): Pervan, Michael
• Application Number:
  US14/714,297
• Publication Number:
  US 20150248171A1
• Time in Patent Office: 457 Days
• Field of Search: 345156-158, 715700-866
• US Class Current: 1/1
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object

Abstract

A method, including receiving, by a computer executing a non-tactile three dimensional (3D) user interface, a set of multiple 3D coordinates representing a gesture by a hand positioned within a field of view of a sensing device coupled to the computer, the gesture including a first motion in a first direction along a selected axis in space, followed by a second motion in a second direction, opposite to the first direction, along the selected axis. Upon detecting completion of the gesture, the non-tactile 3D user interface is transitioned from a first state to a second state.

Claims

1. A method, comprising:

detecting, by a computer executing a non-tactile three dimensional (3D) user interface, a focus gesture made by a hand positioned within a field of view of a sensing device coupled to the computer;

upon detecting the focus gesture, conveying a prompt to unlock the user interface;

subsequently, receiving, by the computer, a set of multiple 3D coordinates representing a gesture by the hand, the gesture comprising a rising motion along a vertical axis in space; and

transitioning the non-tactile 3D user interface from a locked state to an unlocked state upon detecting completion of the gesture.

2. The method according to claim 1, and comprising conveying a first visual feedback prior to the gesture, and conveying a second visual feedback subsequent to the gesture.

3. The method according to claim 2, wherein the first and the second visual feedbacks comprise illuminating or darkening one or more visual feedback devices coupled to the computer.

4. The method according to claim 2, wherein the first and the second visual feedbacks comprise altering a feedback item presented on a display coupled to the computer.

5. The method according to claim 1, wherein the computer transitions to a tracked, locked and inactive state in response to the focus gesture.

6. An apparatus, comprising:

a sensing device; and

a computer executing a non-tactile three dimensional (3D) user interface and configured to;

detect a focus gesture made by a hand positioned within a field of view of the sensing device,

upon detecting the focus gesture, convey a prompt to unlock the user interface,

subsequently, receive, from the sensing device, a set of multiple 3D coordinates representing a gesture by the hand, the gesture comprising a rising motion along a vertical axis in space, and

transition the non-tactile 3D user interface from a locked state to an unlocked state upon detecting completion of the gesture.

7. The apparatus according to claim 6, wherein the computer is configured to convey a first visual feedback prior to the gesture, and to convey a second visual feedback subsequent to the gesture.

8. The apparatus according to claim 7, and comprising one or more visual feedback devices, wherein the computer is configured to convey the first and the second visual feedbacks by illuminating or darkening the one or more visual feedback devices.

9. The apparatus according to claim 7, and comprising a display, wherein the computer is configured to convey the first and the second visual feedbacks by altering a feedback item presented on the display.

10. The apparatus according to claim 6, wherein the computer transitions to a tracked, locked and inactive state in response to the focus gesture.

11. A computer software product comprising a non-transitory computer-readable medium, in which program instructions are stored, which instructions, when read by a computer executing a non-tactile user interface, cause the computer to:

detect a focus gesture made by a hand positioned within a field of view of a sensing device,

upon detecting the focus gesture, convey a prompt to unlock the user interface,

subsequently, receive, from the sensing device, a set of multiple 3D coordinates representing a gesture by the hand, the gesture comprising a rising motion along a vertical axis in space, and

transition the non-tactile 3D user interface from a locked state to an unlocked state upon detecting completion of the gesture.

12. The product according to claim 11, wherein the instructions cause the computer to convey a first visual feedback to the user prior to the gesture, and to convey a second visual feedback subsequent to the gesture.

13. The product according to claim 12, and comprising one or more visual feedback devices, wherein the instructions cause the computer to convey the first and the second visual feedbacks by illuminating or darkening the one or more visual feedback devices.

14. The product according to claim 12, and comprising a display, wherein the instructions cause the computer to convey the first and the second visual feedbacks by altering a feedback item presented on the display.

15. The product according to claim 11, wherein the instructions cause the computer to transition to a tracked, locked and inactive state in response to the focus gesture.