Eye tracking enabling 3D viewing on conventional 2D display
First Claim
Patent Images
1. A method for providing three-dimensional (3D) display on a display device, the method comprising:
- tracking the position and/or orientation of at least a part of a user;
using a computer processor, determining a viewpoint relative to the display device based at least in part on said tracking;
the computer processor using said determined viewpoint relative to the display device and at least one 3D virtual object modeled using real world coordinates to at least in part define the projection of the at least one 3D virtual object, including changing the viewing frustum for the projection of said at least one 3D virtual object in response to said tracking to introduce parallax for viewing the at least one 3D virtual object;
the computer processor adjusting 3D perspective transformations applied to the 3D virtual object as the determined viewpoint changes to generate new viewing perspectives; and
rendering for display, on said display device, said at least one 3D virtual object.
0 Assignments
0 Petitions
Accused Products
Abstract
The exemplary illustrative non-limiting technology herein enables 3D viewing on conventional 2D displays such as home television sets by tracking a person'"'"'s viewpoint. Detecting a player'"'"'s viewpoint movement to change the viewing of the displayed object gives the illusion that the object is physically present in three-dimensional space. Viewpoint movement detection can provide collision-related game logic benefits such as allowing a player to dodge projectiles, giving a game character an ability to “see” the player when not behind line-of-sight obstacles, and other advantages.
-
Citations
22 Claims
-
1. A method for providing three-dimensional (3D) display on a display device, the method comprising:
-
tracking the position and/or orientation of at least a part of a user; using a computer processor, determining a viewpoint relative to the display device based at least in part on said tracking; the computer processor using said determined viewpoint relative to the display device and at least one 3D virtual object modeled using real world coordinates to at least in part define the projection of the at least one 3D virtual object, including changing the viewing frustum for the projection of said at least one 3D virtual object in response to said tracking to introduce parallax for viewing the at least one 3D virtual object; the computer processor adjusting 3D perspective transformations applied to the 3D virtual object as the determined viewpoint changes to generate new viewing perspectives; and rendering for display, on said display device, said at least one 3D virtual object. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A system for providing three-dimensional (3D) display on a display device comprising:
-
a tracking device that tracks at least a portion of a user; a processor configured to determine a viewpoint relative to the display device at least in part in response to said tracking and to use said determined viewpoint to at least in part define the projection of at least one virtual object, modeled using real world coordinates, onto an image plane, the processor further configured to change the viewing frustum for the projection of the virtual object in response to said tracking to introduce parallax for viewing the at least one virtual object; the processor adjusting 3D perspective transformations applied to the 3D virtual object as the determined viewpoint changes to generate new viewing perspectives; and an image stream generator configured to generate images that cause said projected at least one virtual object to be rendered for display on said display device. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17, 18, 19)
-
-
20. A non-transitory storage device storing computer program instructions that when executed by a computer processor, cause the computer processor to provide three-dimensional (3D) viewing display device, the computer program instructions comprising:
-
first instructions that track the position or orientation or both of at least a portion of a user; second instructions that estimate the user'"'"'s viewpoint relative to the display device based at least in part on said tracking; third instructions that use said user'"'"'s estimated viewpoint and both virtual and 3D geometry to at least in part define the two-dimensional (2D) projection of a 3D virtual object, modeled using real world coordinates, including changing the viewing frustum for the projection of the 3D virtual object in response to said tracking to introduce parallax; fourth instructions that adjust 3D perspective transformations applied to the 3D virtual object as the determined viewpoint changes to generate new viewing perspectives; and fifth instructions that cause display of said projected 3D virtual object on said display device. - View Dependent Claims (21, 22)
-
Specification