Physical interaction zone for gesture-based user interfaces
First Claim
1. A processor-implemented method for tracking user movement in a motion capture system, comprising the processor-implemented steps of:
- tracking a body of a user in a field of view of the motion capture system, the tracking comprises determining a model of the body;
determining reference points of the model, the reference points identify shoulders of the body and include a reference point which represents one of the shoulders;
determining a size of the body based on the reference points;
determining a natural biomechanical range of movement of a hand of the body based on the reference points;
determining a size and position of a zone encompassing the natural biomechanical range of movement of the hand based on the reference points, the zone is a 3-D volume in the field of view and has a coordinate system which is defined relative to one of the reference points, the size of the zone is based on the size of the body, and the determining the size and position of the zone comprises determining a distance from the reference point which represents the one of the shoulders to a rear surface of the zone, wherein a gap exists between the reference point which represents the one of the shoulders and the rear surface of the zone, and determining a distance between the rear surface of the zone and a front surface of the zone;
tracking movement of the hand in the zone relative to the coordinate system of the zone; and
based on the tracking of the movement of the hand, translating the movement of the hand in the zone to a corresponding movement of a cursor on a display.
2 Assignments
0 Petitions
Accused Products
Abstract
In a motion capture system having a depth camera, a physical interaction zone of a user is defined based on a size of the user and other factors. The zone is a volume in which the user performs hand gestures to provide inputs to an application. The shape and location of the zone can be customized for the user. The zone is anchored to the user so that the gestures can be performed from any location in the field of view. Also, the zone is kept between the user and the depth camera even as the user rotates his or her body so that the user is not facing the camera. A display provides feedback based on a mapping from a coordinate system of the zone to a coordinate system of the display. The user can move a cursor on the display or control an avatar.
-
Citations
20 Claims
-
1. A processor-implemented method for tracking user movement in a motion capture system, comprising the processor-implemented steps of:
-
tracking a body of a user in a field of view of the motion capture system, the tracking comprises determining a model of the body; determining reference points of the model, the reference points identify shoulders of the body and include a reference point which represents one of the shoulders; determining a size of the body based on the reference points; determining a natural biomechanical range of movement of a hand of the body based on the reference points; determining a size and position of a zone encompassing the natural biomechanical range of movement of the hand based on the reference points, the zone is a 3-D volume in the field of view and has a coordinate system which is defined relative to one of the reference points, the size of the zone is based on the size of the body, and the determining the size and position of the zone comprises determining a distance from the reference point which represents the one of the shoulders to a rear surface of the zone, wherein a gap exists between the reference point which represents the one of the shoulders and the rear surface of the zone, and determining a distance between the rear surface of the zone and a front surface of the zone; tracking movement of the hand in the zone relative to the coordinate system of the zone; and based on the tracking of the movement of the hand, translating the movement of the hand in the zone to a corresponding movement of a cursor on a display. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 14, 15, 16, 17, 18)
-
-
10. A motion capture system, comprising:
-
a depth camera system having a field of view; a display; and one or more processors in communication with the depth camera system and the display, the processor executes instructions to track user movement and to provide a signal to the display to display images; wherein the depth camera system and the one or more processors; to track a body of a user in the field of view, determine a model of the body; determine reference points of the model, the reference points comprise a reference point which identifies a shoulder of the body, a reference point which identifies an elbow of the body, a reference point which identifies a hand of the body; determine a length of an arm of the body based on a sum of a distance between the reference point which identifies the shoulder of the body and the reference point which identifies the elbow of the body and a distance between the reference point which identifies the elbow of the body and the reference point which identifies the hand; determine a position of a zone encompassing a comfortable reach of the hand based on the reference point which identifies the shoulder of the body, the zone is a 3-D volume in the field of view and has a coordinate system which is defined relative to one of the reference points and is anchored to the model of the body; determine a width of the zone based on a specified percentage of the length of the arm; track movement of the hand in the zone relative to the coordinate system of the zone; determine a portion of the zone which the hand moves across in the movement; translate the movement of the hand in the zone from the coordinate system of the zone to a coordinate system of the display; and update the display based on the translated movement of the hand. - View Dependent Claims (11, 19)
-
-
12. Tangible computer readable storage device having computer readable software embodied thereon for programming a processor to perform a method in a motion capture system, the method comprising:
-
tracking a body in a field of view of the motion capture system, the tracking comprises determining a model of the body; determining reference points of the model; determining a size and position of a first zone based on the reference points, the first zone is a 3-D volume in the field of view and has a coordinate system which is defined relative to one of the reference points, and the size of the first zone is based on a range of movement of a hand of the body when the hand pivots from an elbow; determining a size and position of a second zone based on the reference points, the second zone is a 3-D volume in the field of view and has a coordinate system which is defined relative to one of the reference points, the second zone is smaller than the first zone and overlaps, at least in part, with the first zone, and the size of the second zone is based on a range of movement of the hand when the hand pivots from a wrist; tracking movement of the hand in the first zone relative to the coordinate system of the first zone and translatin˜
the movement of the hand in the first zone to a corresponding movement of a cursor on a display based on a mapping between the first zone and the display;based on the tracking of the movement of the hand in the first zone, storing a record of a position of the hand for a period of time; based on the record, determining that hand of the body is confined to the second zone over the period of time; and based on the determining that hand of the body is confined to the second zone over the period of time, switching from tracking movement of the hand in the first zone relative to the coordinate system of the first zone and the translating the movement of the hand in the first zone to the corresponding movement of the cursor on the display based on the mapping between the first zone and the display, to tracking movement of the hand in the second zone relative to the coordinate system of the second zone and translating the movement of the hand in the second zone to a corresponding movement of the cursor on the display based on a mapping between the second zone and the display. - View Dependent Claims (13, 20)
-
Specification