Systems and methods of free-space gestural interaction
First Claim
Patent Images
1. A method of interpreting free-space gestures, the method including:
- providing, by a camera, a three-dimensional (3D) field of view that includes a 3D sensory space;
setting a context for gesture interpretation by detecting a virtual contact between a control object and a virtual plane computationally defined as substantially perpendicular to an orientation of a pointing direction of the control object extending along a length of the control object in the 3D sensory space that is within the 3D field of view, wherein an orientation and location of the virtual plane is dependent upon a location and a tracked orientation of the pointing direction of the control object extending along the length of a single tip of the control object without being dependent upon an orientation of a physical screen for displaying a proximate interface control, wherein the orientation and location of the virtual plane are updated in response to the single tip of the control object being at rest or moving with constant velocity;
responsive to a position of the virtual contact with the virtual plane, tentatively selecting the proximate interface control displayed on the physical screen and visually indicating, on the physical screen, the tentative selection of the proximate interface control, the tentative selection of the proximate interface control representing a selection of the proximate interface control without activating a function corresponding to the proximate interface control;
detecting a free-space confirmatory gesture of the control object (i) anywhere in the 3D field of view, (ii) without maintaining the virtual contact between the control object and the virtual plane and (iii) while the proximate interface control remains tentatively selected; and
initiating the function corresponding to the proximate interface control based on the free-space confirmatory gesture.
12 Assignments
0 Petitions
Accused Products
Abstract
During control of a user interface via free-space motions of a hand or other suitable control object, switching between control modes can be facilitated by tracking the control object'"'"'s movements relative to, and its contact with a “virtual touch plane or surface” (i.e., a plane, portion of a plane, and/or surface computationally defined in space, or corresponding to any physical surface).
261 Citations
10 Claims
-
1. A method of interpreting free-space gestures, the method including:
-
providing, by a camera, a three-dimensional (3D) field of view that includes a 3D sensory space; setting a context for gesture interpretation by detecting a virtual contact between a control object and a virtual plane computationally defined as substantially perpendicular to an orientation of a pointing direction of the control object extending along a length of the control object in the 3D sensory space that is within the 3D field of view, wherein an orientation and location of the virtual plane is dependent upon a location and a tracked orientation of the pointing direction of the control object extending along the length of a single tip of the control object without being dependent upon an orientation of a physical screen for displaying a proximate interface control, wherein the orientation and location of the virtual plane are updated in response to the single tip of the control object being at rest or moving with constant velocity; responsive to a position of the virtual contact with the virtual plane, tentatively selecting the proximate interface control displayed on the physical screen and visually indicating, on the physical screen, the tentative selection of the proximate interface control, the tentative selection of the proximate interface control representing a selection of the proximate interface control without activating a function corresponding to the proximate interface control; detecting a free-space confirmatory gesture of the control object (i) anywhere in the 3D field of view, (ii) without maintaining the virtual contact between the control object and the virtual plane and (iii) while the proximate interface control remains tentatively selected; and initiating the function corresponding to the proximate interface control based on the free-space confirmatory gesture. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
Specification