Gesture-based user interface
First Claim
1. A non-transitory computer readable medium storing instructions that, when executed by a computer, cause the computer to:
- display on a display a plurality of menu items displaced axially along a display axis;
receive data from a camera system, the data including a representation of a body of a user;
determine a first reference point associated with a first location on the player'"'"'s body based on the data received from the camera system;
determine a scale vector between a second reference point associated with a second location on the player'"'"'s body and a third reference point associated with a third location on the player'"'"'s body, the first, second, and third locations on the player'"'"'s body being different locations on the user'"'"'s body, the scale vector defining a coordinate system being shiftable based on a position of the second reference point and a position of the third reference point when at least one of the second location and the third location on the player'"'"'s body shifts;
define a range of scale values in the coordinate system based on the scale vector;
determine a scale value associated with a position of the first reference point along a gesture axis, the gesture axis associated with the data received from the camera and corresponding to the display axis displayed on the display, the determined scale value being based on the range of scale values in the coordinate system; and
highlight on the display at least one of the plurality of menu items based on the determined scale value.
1 Assignment
0 Petitions
Accused Products
Abstract
The invention includes methods, systems, computer program products and means for providing an intuitive user interface for interacting with a game console that obviates the need for, or use of, a typical game controller. In one embodiment, the user interface comprises an analog-like mechanism for manipulating a menu and icon system. The menu system allows the user to highlight a menu option or icon using movement along one axis and to activate the menu option or icon via movement on a different axis. In one embodiment, highlighting is associated with a vertical motion and activation is associated with a horizontal motion. The vertical motion can be tied to the vertical movement of a particular appendage, e.g., the up and down movement of the user'"'"'s right arm, and the horizontal motion can be tied to the horizontal movement of that or another appendage, e.g., movement of the right arm or hand across the body from right to left.
-
Citations
28 Claims
-
1. A non-transitory computer readable medium storing instructions that, when executed by a computer, cause the computer to:
-
display on a display a plurality of menu items displaced axially along a display axis; receive data from a camera system, the data including a representation of a body of a user; determine a first reference point associated with a first location on the player'"'"'s body based on the data received from the camera system; determine a scale vector between a second reference point associated with a second location on the player'"'"'s body and a third reference point associated with a third location on the player'"'"'s body, the first, second, and third locations on the player'"'"'s body being different locations on the user'"'"'s body, the scale vector defining a coordinate system being shiftable based on a position of the second reference point and a position of the third reference point when at least one of the second location and the third location on the player'"'"'s body shifts; define a range of scale values in the coordinate system based on the scale vector; determine a scale value associated with a position of the first reference point along a gesture axis, the gesture axis associated with the data received from the camera and corresponding to the display axis displayed on the display, the determined scale value being based on the range of scale values in the coordinate system; and highlight on the display at least one of the plurality of menu items based on the determined scale value. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14)
-
-
15. A computerized method for execution on a game platform, the method comprising:
-
displaying on a display a plurality of menu items displaced axially along a display axis;
receiving data from a camera system, the data including a representation of a body of a user;determining a first reference point associated with a first location on the player'"'"'s body based on the data received from the camera system; determining a scale vector between a second reference point associated with a second location on the player'"'"'s body and a third reference point associated with a third location on the player'"'"'s body, the first, second, and third locations on the player'"'"'s body being different locations on the user'"'"'s body, the scale vector defining a coordinate system being shiftable based on a position of the second reference point and a position of the third reference point when at least one of the second location and the third location on the player'"'"'s body shifts; defining a range of scale values in the coordinate system based on the scale vector; determining a scale value associated with a position of the first reference point along a gesture axis that corresponds to the display axis, the gesture axis associated with the data received from the camera and corresponding to the display axis displayed on the display, the determined scale value being based on the range of scale values in the coordinate system; and highlighting on the display at least one of the plurality of menu items based on the determined scale value. - View Dependent Claims (16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28)
-
Specification