Presenting a View within a Three Dimensional Scene

• US 20110187706A1
• Filed: 06/10/2010
• Published: 08/04/2011
• Est. Priority Date: 01/29/2010
• Status: Active Grant

• Current Assignee: zSpace Inc.
• Original Assignee: zSpace Inc.
• Inventors: Vesely, Michael A., Gray, Alan S.
• Granted Patent: US 8,717,360 B2
• Time in Patent Office: Days
• US Class Current: 345/419
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06T 15/00 3D [Three Dimensional] image rendering
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G09G 2340/12 Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
• CPC Class Codes: G09G 2340/125 wherein one of the images is motion video
• CPC Class Codes: G09G 2340/14 Solving problems related to the presentation of information to be displayed
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 3/003 to produce spatial visual effects
• CPC Class Codes: H04N 13/279 the virtual viewpoint locations being selected by the viewers or determined by tracking
• CPC Class Codes: H04N 13/366 using viewer tracking
• CPC Class Codes: H04N 13/383 for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes

Abstract

Presenting a view based on a virtual viewpoint in a three dimensional (3D) scene. The 3D scene may be presented by at least one display, which includes displaying at least one stereoscopic image of the 3D scene by the display(s). The 3D scene may be presented according to a first viewpoint. A virtual viewpoint may be determined within the 3D scene that is different than the first viewpoint. The view of the 3D scene may be presented on the display(s) according to the virtual viewpoint and/or the first view point. The presentation of the view of the 3D scene is performed concurrently with presenting the 3D scene.

Claims

1. A method for presenting a view based on a virtual viewpoint in a three dimensional (3D) scene, comprising:

presenting the 3D scene by at least one display, wherein said presenting the 3D scene comprises displaying at least one stereoscopic image of the 3D scene by the at least one display, wherein the 3D scene is presented according to a first viewpoint;

determining a virtual viewpoint within the 3D scene, wherein the virtual viewpoint is different than the first viewpoint; and

presenting the view of the 3D scene by the at least one display according to the virtual viewpoint;

wherein said presenting the view of the 3D scene is performed concurrently with said presenting the 3D scene.

2. The method of claim 1,

wherein the virtual viewpoint is selected by a user.

3. The method of claim 1,

wherein the virtual viewpoint is selected by a user using a physical device in open space of the at least one display.

4. The method of claim 3,

wherein the virtual viewpoint is selected via a virtual object presented in the 3D scene, wherein movement of the physical device by the user has a one to one correspondence with corresponding movement of the virtual object.

5. The method of claim 1,

wherein said presenting the 3D scene comprises graphically indicating a frustum of the view of the 3D scene within the 3D scene.

6. The method of claim 1,

wherein said presenting the view of the 3D scene comprises displaying at least one stereoscopic image of the view of the 3D scene by the at least one display.

7. The method of claim 1, further comprising:

determining the first viewpoint, wherein the first viewpoint is corresponds to an eyepoint of a user viewing the 3D scene.

8. The method of claim 1,

wherein said presenting the view of the 3D scene is also based on the first viewpoint.

9. The method of claim 1, further comprising:

moving the virtual viewpoint in response to user input;

wherein said determining the virtual viewpoint and said presenting the view of the 3D scene are performed a plurality of times during said moving.

10. The method of claim 1,

wherein the virtual viewpoint is from the position/orientation of a virtual object displayed within the 3D scene.

11. The method of claim 10,

moving the virtual object within the 3D scene in response to user input;

wherein said determining the virtual viewpoint and said presenting the view of the 3D scene are performed a plurality of times during said moving the virtual object.

12. The method of claim 11,

wherein the 3D scene is presented at a first frame rate;

wherein said determining the virtual viewpoint and said presenting the view of the 3D scene are performed during said moving the virtual object at substantially the first frame rate.

13. The method of claim 10,

wherein the virtual object is a virtual camera object.

14. The method of claim 10,

wherein the virtual object is a virtual magnifying glass object.

15. The method of claim 1, further comprising:

determining a field of view of the virtual viewpoint;

wherein said presenting the view of the 3D scene is based on the field of view of the virtual viewpoint.

16. The method of claim 1, further comprising:

determining a magnification of the 3D scene for the virtual viewpoint;

wherein said presenting the view of the 3D scene is based on the magnification.

17. The method of claim 1,

determining a view volume for the virtual viewpoint;

wherein said presenting the view of the 3D scene is based on the view volume.

18. The method of claim 1,

wherein the view of the 3D scene is magnified compared to a corresponding portion in the 3D scene.

19. The method of claim 1, wherein the at least one display comprises a vertical display and a horizontal display, wherein said presenting the 3D scene comprises 1) displaying, according to a horizontal perspective, a first stereoscopic image on the horizontal display, and 2) displaying, according to a vertical perspective, a second stereoscopic image on the vertical display.

20. The method of claim 1, wherein the at least one display comprises a plurality of displays, wherein said displaying the 3D scene is performed on a first display and said displaying the view of the 3D scene is performed on a second display.

21. The method of claim 1, wherein the first viewpoint corresponds to an eyepoint of a user viewing the 3D scene, wherein said presenting the view of the 3D scene is also based on the first viewpoint, wherein the method further comprises:

determining a next viewpoint corresponding to the eyepoint of the user after said displaying the 3D image, wherein the next viewpoint is determined after a change of eyepoint of the user, wherein the next viewpoint is different than the first viewpoint;

updating the 3D scene on at least one display based on the next viewpoint, wherein said updating the 3D scene comprises displaying at least one updated stereoscopic image of the 3D scene on the at least one display;

updating the view of the 3D scene on the at least one display based on the next viewpoint and the virtual viewpoint, wherein said updating the view of the 3D scene comprises displaying at least one updated image of the view of the 3D scene on the at least one display.

22. The method of claim 1, wherein said presenting the view of the 3D scene is performed at a position and orientation that is different from a position and orientation of the at least one display.

23. A computer accessible memory medium storing program instructions for presenting a view based on a virtual viewpoint in a three dimensional (3D) scene, wherein the program instructions are executable by a processor to:

present the 3D scene via at least one display, wherein said presenting the 3D scene comprises the at least one display displaying at least one stereoscopic image of the 3D scene, wherein the 3D scene is presented according to a first viewpoint;

determine a virtual viewpoint within the 3D scene, wherein the virtual viewpoint is different than the first viewpoint; and

present the view of the 3D scene via the at least one display according to the virtual viewpoint;

wherein said presenting the view of the 3D scene is performed concurrently with said presenting the 3D scene.

24. The memory medium of claim 23,

wherein the virtual viewpoint is selected by a user.

25. The memory medium of claim 23,

wherein the virtual viewpoint is selected by a user using a physical device in open space of at least one display.

26. The memory medium of claim 25,

wherein the virtual viewpoint is selected via a virtual object presented in the 3D scene, wherein movement of the physical device by the user has a one to one correspondence with corresponding movement of the virtual object.

27. The memory medium of claim 23,

wherein said presenting the view of the 3D scene comprises displaying at least one stereoscopic image of the view of the 3D scene by the at least one display.

28. The memory medium of claim 23, wherein the program instructions are further executable to:

determine the first viewpoint, wherein the first viewpoint is corresponds to an eyepoint of a user viewing the 3D scene.

29. The memory medium of claim 23,

wherein said presenting the view of the 3D scene is also based on the first viewpoint.

30. The memory medium of claim 23, wherein the program instructions are further executable to:

move the virtual viewpoint in response to user input;

wherein said determining the virtual viewpoint and said presenting the view of the 3D scene are performed a plurality of times during said moving.

31. The memory medium of claim 23, wherein the at least one display comprises a vertical display and a horizontal display, wherein said presenting the 3D scene comprises 1) displaying, according to a horizontal perspective, a first stereoscopic image on the horizontal display, and 2) displaying, according to a vertical perspective, a second stereoscopic image on the vertical display.

32. The memory medium of claim 23, wherein the first viewpoint corresponds to an eyepoint of a user viewing the 3D scene, wherein said presenting the view of the 3D scene is also based on the first viewpoint, wherein the program instructions are further executable to:

determine a next viewpoint corresponding to the eyepoint of the user after said displaying the 3D image, wherein the next viewpoint is determined after a change of eyepoint of the user, wherein the next viewpoint is different than the first viewpoint;

update the 3D scene on at least one display based on the next viewpoint, wherein said updating the 3D scene comprises the at least one display displaying at least one updated stereoscopic image of the 3D scene;

update the view of the 3D scene on the at least one display based on the next viewpoint and the virtual viewpoint, wherein said updating the view of the 3D scene comprises the at least one display displaying at least one updated image of the view of the 3D scene.

33. The memory medium of claim 23, wherein the view of the 3D scene is presented at a position and orientation that is different from a position and orientation of the at least one display.

34. A system for presenting a view based on a virtual viewpoint in a three dimensional (3D) scene, comprising:

a processor;

an input device configured to provide information to the processor indicating a current viewpoint of the user;

at least one display coupled to the processor;

a memory medium coupled to the processor which stores program instructions executable to;

present the 3D scene via the at least one display, wherein said presenting the 3D scene comprises the at least one display displaying at least one stereoscopic image of the 3D scene, wherein the 3D scene is presented according to the current viewpoint of the user;

determine a virtual viewpoint within the 3D scene, wherein the virtual viewpoint is different than the current viewpoint of the user; and

present the view of the 3D scene via the at least one display according to the virtual viewpoint, wherein said presenting the view of the 3D scene is performed concurrently with said presenting the 3D scene.

35. The system of claim 34, further comprising:

an input device configured to communicate with the processor, wherein the input device is configured for use by a user to manipulate the 3D scene;

wherein the virtual viewpoint is selected by a user using the input device.

36. The system of claim 34,

wherein said presenting the view of the 3D scene comprises displaying at least one stereoscopic image of the view of the 3D scene by the at least one display.

37. The system of claim 34,

wherein said presenting the view of the 3D scene is also based on the first viewpoint.

38. The system of claim 34, wherein the at least one display comprises a vertical display and a horizontal display, wherein said presenting the 3D scene comprises 1) displaying, according to a horizontal perspective, a first stereoscopic image on the horizontal display, and 2) displaying, according to a vertical perspective, a second stereoscopic image on the vertical display.

39. A method for presenting a view from a virtual viewpoint perspective in a three dimensional (3D) scene, comprising:

presenting the 3D scene by at least one display, wherein said presenting the 3D scene comprises displaying at least one stereoscopic image of the 3D scene by the at least one display, wherein the 3D scene is presented according to at least one first viewpoint;

determining a virtual viewpoint within the 3D scene, wherein the virtual viewpoint is from the viewpoint of a virtual object displayed within the 3D scene; and

displaying the view of the 3D scene on the at least one display according to the virtual viewpoint;

moving the virtual object within the 3D scene in response to user input;

wherein said determining the virtual viewpoint and said presenting the view of the 3D scene are performed a plurality of times during said moving the virtual object;

wherein said presenting the view of the 3D scene is performed concurrently with said presenting the 3D scene.