Modifying Perspective of Stereoscopic Images Based on Changes in User Viewpoint

• US 20160267707A1
• Filed: 03/18/2016
• Published: 09/15/2016
• Est. Priority Date: 05/09/2005
• Status: Active Grant

• Current Assignee: zSpace Inc.
• Original Assignee: zSpace Inc.
• Inventors: Vesely, Michael A., Clemens, Nancy L., Gray, Alan S.
• Granted Patent: US 9,684,994 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06T 15/06 Ray-tracing
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 15/30 Clipping
• CPC Class Codes: G06T 2200/04 involving 3D image data
• CPC Class Codes: G06T 2215/16 Using real world measurements to influence rendering

Abstract

Modifying perspective of stereoscopic images provided by one or more displays based on changes in user viewpoint. The one or more displays may include a first display that is provided substantially horizontal for displaying 3D horizontal perspective images and/or a second display that is provided substantially vertical for displaying text or conventional images such as 2D images, or 3D vertical perspective images. The horizontal display surface may be typically positioned directly in front of the user, and at a height of about a desktop surface so that the user can have about a 45° looking angle. The vertical display surface may be positioned in front of the user and preferably behind and above the horizontal display surface.

Claims

1. A method for defining a render surface for a virtual space to present three dimensional (3D) graphic objects using a display, comprising:

defining a render surface for a virtual space, wherein the render surface corresponds to a physical display used as a plane of projection for 3D graphic objects within the virtual space;

defining a virtual viewpoint within the virtual space, wherein a relationship between the virtual viewpoint and the render surface is equivalent to a relationship of a user'"'"'s viewpoint and the physical display; and

displaying the 3D graphic objects on the physical display with a perspective based on the virtual viewpoint.

2. The method of claim 1, further comprising:

defining frustum boundaries with respect to edges of the render surface, wherein the edges of the render surface correspond to edges and dimensions of the display.

3. The method of claim 2,

wherein the frustum boundaries comprise a near clipping plane and a far clipping plane.

4. The method of claim 3, further comprising:

defining dimensions of the near and far clipping planes based on intersections of ray traces emanating from the virtual viewpoint and extending through edges of the render surface.

5. The method of claim 1, further comprising:

tracking position and orientation of a user with respect to a position and orientation of the physical display, wherein the user'"'"'s viewpoint is determined based on the position and orientation of the user; and

wherein defining the virtual viewpoint comprises defining the virtual viewpoint based on the user'"'"'s viewpoint.

6. The method of claim 5,

wherein the user'"'"'s viewpoint is a user'"'"'s first viewpoint, wherein the virtual viewpoint is a first virtual viewpoint, and wherein the method further comprises:

updating, based on determining that position and orientation of the user changed, the user'"'"'s first viewpoint to a user'"'"'s second viewpoint; and

defining a second virtual viewpoint based on the user'"'"'s second viewpoint; and

displaying the 3D graphic objects on the physical display with a perspective based on the second virtual viewpoint.

7. The method of claim 6, further comprising:

defining first frustum boundaries with respect to edges of the render surface, wherein the edges of the render surface correspond to edges and dimensions of the display, wherein the first frustum boundaries comprise a first near clipping plane and first a far clipping plane, wherein dimensions of the first near and first far clipping planes are based on intersections of ray traces emanating from the first virtual viewpoint and extending through edges of the render surface; and

defining second frustum boundaries with respect to edges of the render surface, wherein the second frustum boundaries comprise a second near clipping plane and a second far clipping plane, wherein dimensions of the second near and second far clipping planes are based on intersections of ray traces emanating from the second virtual viewpoint and extending through edges of the render surface.

8. The method of claim 1,

wherein the render surface is at a non-normal position and orientation with respect to the virtual viewpoint.

9. The method of claim 1,

wherein the display comprises a handheld display.

10. A non-transitory computer readable memory medium storing program instructions executable by a processor to:

define a render surface for a virtual space, wherein the render surface corresponds to a physical display used as a plane of projection for 3D graphic objects within the virtual space;

define a virtual viewpoint within the virtual space, wherein a relationship between the virtual viewpoint and the render surface is equivalent to a relationship of a user'"'"'s viewpoint and the physical display; and

display the 3D graphic objects on the physical display with a perspective based on the virtual viewpoint.

11. The non-transitory computer readable memory medium of claim 10,

wherein the program instructions are further executable to:

define frustum boundaries with respect to edges of the render surface, wherein the edges of the render surface correspond to edges and dimensions of the display, wherein the frustum boundaries comprise a near clipping plane and a far clipping plane.

12. The non-transitory computer readable memory medium of claim 11,

wherein the program instructions are further executable to:

define dimensions of the near and far clipping planes based on intersections of ray traces emanating from the virtual viewpoint and extending through edges of the render surface.

13. The non-transitory computer readable memory medium of claim 10,

wherein the program instructions are further executable to:

track position and orientation of a user with respect to a position and orientation of the physical display, wherein the user'"'"'s viewpoint is determined based on the position and orientation of the user; and

wherein to define the virtual viewpoint, the program instructions are further executable to define the virtual viewpoint based on the user'"'"'s viewpoint.

14. The non-transitory computer readable memory medium of claim 13,

wherein the user'"'"'s viewpoint is a user'"'"'s first viewpoint, wherein the virtual viewpoint is a first virtual viewpoint, and wherein the program instructions are further executable to:

update, based on determining that position and orientation of the user changed, the user'"'"'s first viewpoint to a user'"'"'s second viewpoint;

define a second virtual viewpoint based on the user'"'"'s second viewpoint; and

display the 3D graphic objects on the physical display with a perspective based on the second virtual viewpoint.

15. The non-transitory computer readable memory medium of claim 14,

wherein the program instructions are further executable to:

define first frustum boundaries with respect to edges of the render surface, wherein the edges of the render surface correspond to edges and dimensions of the display, wherein the first frustum boundaries comprise a first near clipping plane and first a far clipping plane, wherein dimensions of the first near and first far clipping planes are based on intersections of ray traces emanating from the first virtual viewpoint and extending through edges of the render surface; and

define second frustum boundaries with respect to edges of the render surface, wherein the second frustum boundaries comprise a second near clipping plane and a second far clipping plane, wherein dimensions of the second near and second far clipping planes are based on intersections of ray traces emanating from the second virtual viewpoint and extending through edges of the render surface.

16. The non-transitory computer readable memory medium of claim 10,

wherein the render surface is at a non-normal position and orientation with respect to the virtual viewpoint.

17. The non-transitory computer readable memory medium of claim 10,

wherein the display comprises a handheld display.

18. A system for defining a render surface for a virtual space to present three dimensional (3D) graphic objects using a display, comprising:

a memory;

a processor in communication with the memory; and

a display in communication with the processor;

wherein the processor is configured to;

define a render surface for a virtual space, wherein the render surface corresponds to a display used as a plane of projection for 3D graphic objects within the virtual space;

define a virtual viewpoint within the virtual space, wherein a relationship between the virtual viewpoint and the render surface is equivalent to a relationship of a user'"'"'s viewpoint and the display; and

display the 3D graphic objects on the display with a perspective based on the virtual viewpoint.

19. The system of claim 18,

wherein the processor is further configured to:

define frustum boundaries with respect to edges of the render surface, wherein the edges of the render surface correspond to edges and dimensions of the display, wherein the frustum boundaries comprise a near clipping plane and a far clipping plane; and

define dimensions of the near and far clipping planes based on intersections of ray traces emanating from the virtual viewpoint and extending through edges of the render surface.

20. The system of claim 18,

wherein the processor is further configured to:

track, via information received from a tracking system in communication with the system, position and orientation of a user with respect to a position and orientation of the physical display, wherein the user'"'"'s viewpoint is determined based on the position and orientation of the user; and

wherein to define the virtual viewpoint, the processor is further configured to define the virtual viewpoint based on the user'"'"'s viewpoint.