Gestures And Gesture Modifiers For Manipulating A User-Interface
First Claim
1. A method of operating a user-interface using mid-air motion of a human target, comprising:
- receiving a plurality of images from a capture device, the plurality of images including the human target;
tracking movement of the human target from the plurality of images using skeletal mapping of the human target;
determining from the skeletal mapping whether the movement of the human target satisfies one or more filters for a first mid-air gesture;
determining whether a modifier for the first mid-air gesture is present;
if the movement of the human target satisfies the one or more filters and the modifier is not present, performing a first user-interface action corresponding to the mid-air gesture; and
if the movement of the human target satisfies the one or more filters and the modifier is present, performing a second user-interface action corresponding to the mid-air gesture.
2 Assignments
0 Petitions
Accused Products
Abstract
Gesture modifiers are provided for modifying and enhancing the control of a user-interface such as that provided by an operating system or application of a general computing system or multimedia console. Symbolic gesture movements are performed by a user in mid-air. A capture device generates depth images and a three-dimensional representation of a capture area including a human target. The human target is tracked using skeletal mapping to capture the mid-air motion of the user. Skeletal mapping data is used to identify movements corresponding to pre-defined gestures using gesture filters. Detection of a viable gesture can trigger one or more user-interface actions or controls. Gesture modifiers are provided to modify the user-interface action triggered by detection of a gesture and/or to aid in the identification of gestures.
-
Citations
20 Claims
-
1. A method of operating a user-interface using mid-air motion of a human target, comprising:
-
receiving a plurality of images from a capture device, the plurality of images including the human target; tracking movement of the human target from the plurality of images using skeletal mapping of the human target; determining from the skeletal mapping whether the movement of the human target satisfies one or more filters for a first mid-air gesture; determining whether a modifier for the first mid-air gesture is present; if the movement of the human target satisfies the one or more filters and the modifier is not present, performing a first user-interface action corresponding to the mid-air gesture; and if the movement of the human target satisfies the one or more filters and the modifier is present, performing a second user-interface action corresponding to the mid-air gesture. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. One or more processor readable storage devices having processor readable code embodied on the one or more processor readable storage devices, the processor readable code for programming one or more processors to perform a method comprising:
-
receiving depth information of a capture area including a human target; creating a skeletal model for mapping movement of the human target over time; detecting a gesture modifier from the human target that indicates a gesture period; in response to detecting the gesture modifier, determining from the skeletal mapping whether movement of the human target during the gesture period satisfies one or more filters for a first mid-air gesture; and if the movement of the human target during the gesture period satisfies the one or more filters, performing a first user-interface action corresponding to the first mid-air gesture. - View Dependent Claims (12, 13, 14, 15, 16, 17)
-
-
18. A method of operating a user-interface using mid-air motion of a human target, comprising:
-
tracking movement of a human target from a plurality of depth images using skeletal mapping of the human target in a known three-dimensional coordinate system; determining from the skeletal mapping whether movement including a first hand of the human target satisfies one or more filters for a first mid-air gesture; determining from the skeletal mapping whether a second hand of the human target satisfies one or more filters for a modifier of the first mid-air gesture; if the movement including the first hand of the human target satisfies the one or more filters for the first mid-air gesture and the second hand of the human target satisfies the one or more filters for the modifier of the first mid-air gesture, performing a first user-interface action; if the movement including the first hand of the human target satisfies the one or more filters for the first mid-air gesture and the second hand of the human target does not satisfy the one or more filters for the modifier of the first mid-air gesture, performing a second user-interface action. - View Dependent Claims (19, 20)
-
Specification