SESSIONLESS POINTING USER INTERFACE

• US 20130055120A1
• Filed: 08/23/2012
• Published: 02/28/2013
• Est. Priority Date: 08/24/2011
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: PrimeSense Ltd (Apple Inc.)
• Inventors: Galor, Micha, Pokrass, Jonathan, Hoffnung, Amir, Or, Ofir
• Granted Patent: US 9,218,063 B2
• Time in Patent Office: Days
• US Class Current: 715/764
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 7/75 involving models
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

A method, including receiving, by a computer, a sequence of three-dimensional maps containing at least a hand of a user of the computer, and identifying, in the maps, a device coupled to the computer. The maps are analyzed to detect a gesture performed by the user toward the device, and the device is actuated responsively to the gesture.

Claims

1. A method, comprising:

receiving, by a computer, a sequence of three-dimensional maps containing at least a hand of a user of the computer;

identifying, in the maps, a device coupled to the computer;

analyzing the maps to detect a gesture performed by the user toward the device; and

actuating the device responsively to the gesture.

2. The method according to claim 1, wherein the gesture is selected from a list comprising a pointing gesture, a grab gesture and a release gesture.

3. The method according to claim 1, wherein analyzing the maps comprises defining a pyramid shaped region having an apex meeting the user and a base encompassing the device, and defining an interaction region within the pyramid shaped region.

4. The method according to claim 3, wherein the gesture comprises the user positioning the hand within the interaction region and moving the hand toward the device.

5. The method according to claim 1, and comprising defining an angle threshold, and wherein the gesture comprises extending an elbow associated with the hand at an angle greater than or equal to the angle threshold.

6. The method according to claim 1, and comprising defining a minimum time period, and wherein the gesture comprises extending the hand toward the device and pausing the hand for the minimum time period.

7. The method according to claim 1, and comprising receiving a vocal command from the user, and actuating the device in response to the gesture and the vocal command.

8. The method according to claim 1, and comprising detecting, in the maps, a gaze direction of the user, and actuating the device in response to the gesture and the gaze direction.

9. The method according to claim 1, and comprising communicating between the device and a further device upon detecting, in the maps, a subsequent gesture directed toward the further device.

10. An apparatus, comprising:

a three-dimensional sensing device; and

a computer configured to receive from the three-dimensional sensing device a sequence of three-dimensional maps containing at least a hand of a user of the computer, to identify, in the maps, an entity coupled to the computer, to analyze the maps to detect a gesture performed by the user toward the entity, and to actuate the entity responsively to the gesture.

11. The apparatus according to claim 10, wherein the computer is configured to select the gesture from a list comprising a pointing gesture, a grab gesture and a release gesture.

12. The apparatus according to claim 10, wherein the computer is configured to analyze the maps by defining a pyramid shaped region having an apex that meets the user and a base encompassing the entity and defining an interaction region within the pyramid shaped region.

13. The apparatus according to claim 12, wherein the gesture comprises the user positioning the hand within the interaction region and moving the hand toward the entity.

14. The apparatus according to claim 10, wherein the computer is configured to define an angle threshold, and wherein the gesture comprises extending an elbow associated with the hand at an angle greater than or equal to the angle threshold.

15. The apparatus according to claim 10, wherein the computer is configured to define a minimum time period, and wherein the gesture comprises extending the hand toward the entity and pausing the hand for the minimum time period.

16. The apparatus according to claim 10, wherein the computer is configured to receive a vocal command from the user, and to actuate the entity in response to the gesture and the vocal command.

17. The apparatus according to claim 10, wherein the computer is configured to detect, in the maps, a gaze direction of the user, and to actuate the entity in response to the gesture and the gaze direction.

18. The apparatus according to claim 10, wherein the computer is configured to communicate between the entity and a further entity upon detecting, in the maps, a subsequent gesture directed toward the further entity.

19. A computer software product comprising a non-transitory computer-readable medium, in which program instructions are stored, which instructions, when read by a computer executing a non-tactile user interface, cause the computer to receive a sequence of three-dimensional maps containing at least a hand of a user of the computer, to identify, in the maps, a device coupled to the computer, to analyze the maps to detect a gesture performed by the user toward the device, and to actuate the device responsively to the gesture.