PHYSICAL INTERACTION ZONE FOR GESTURE-BASED USER INTERFACES
First Claim
1. A processor-implemented method for tracking user movement in a motion capture system, comprising the processor-implemented steps of:
- tracking a body in a field of view of the motion capture system, including determining a model of the body;
determining reference points of the model;
determining a size and position of a zone based on the reference points, the zone is a 3-D volume in the field of view and has a coordinate system which is defined relative to at least one of the reference points;
tracking movement of a hand of the body in the zone relative to the coordinate system of the zone; and
based on the tracking, translating the movement of the hand in the zone to a corresponding action on a display.
2 Assignments
0 Petitions
Accused Products
Abstract
In a motion capture system having a depth camera, a physical interaction zone of a user is defined based on a size of the user and other factors. The zone is a volume in which the user performs hand gestures to provide inputs to an application. The shape and location of the zone can be customized for the user. The zone is anchored to the user so that the gestures can be performed from any location in the field of view. Also, the zone is kept between the user and the depth camera even as the user rotates his or her body so that the user is not facing the camera. A display provides feedback based on a mapping from a coordinate system of the zone to a coordinate system of the display. The user can move a cursor on the display or control an avatar.
-
Citations
20 Claims
-
1. A processor-implemented method for tracking user movement in a motion capture system, comprising the processor-implemented steps of:
-
tracking a body in a field of view of the motion capture system, including determining a model of the body; determining reference points of the model; determining a size and position of a zone based on the reference points, the zone is a 3-D volume in the field of view and has a coordinate system which is defined relative to at least one of the reference points; tracking movement of a hand of the body in the zone relative to the coordinate system of the zone; and based on the tracking, translating the movement of the hand in the zone to a corresponding action on a display. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14)
-
-
15. A motion capture system, comprising:
-
a depth camera system having a field of view; a display; and one or more processors in communication with the depth camera system and the display, the processor executes instructions to track user movement and to provide a signal to the display to display images; wherein the depth camera system and the one or more processors; to track the body in the field of view, determine a model of the body; determine reference points of the model; determine a size and position of a zone based on the reference points, the zone is a 3-D volume in the field of view and has a coordinate system which is defined relative to at least one of the reference points and is anchored to the model of the body; track movement of a hand of the body in the zone relative to the coordinate system of the zone; translate the movement of the hand in the zone from the coordinate system of the zone to a coordinate system of the display; and update the display based on the translated movement of the hand. - View Dependent Claims (16, 17)
-
-
18. Tangible computer readable storage having computer readable software embodied thereon for programming at least one processor to perform a method in a motion capture system, the method comprising:
-
tracking a body in a field of view of the motion capture system, including determining a model of the body; determining reference points of the model; determining a size and position of a first zone based on the reference points, the first zone is a 3-D volume in the field of view and has a coordinate system which is defined relative to at least one of the reference points; determining a size and position of a second zone based on the reference points, the second zone is a 3-D volume in the field of view and has a coordinate system which is defined relative to at least one of the reference points, the second zone is smaller than the first zone and overlaps, at least in part, with the first zone; tracking movement of a hand of the body in the first zone relative to the coordinate system of the first zone; tracking movement of the hand of the body in the second zone relative to the coordinate system of the second zone; and selecting one of the tracking movement of the body in the first zone and the tracking movement of the body in the second zone, for use in updating the display. - View Dependent Claims (19, 20)
-
Specification