Detection of partially obscured objects in three dimensional stereoscopic scenes

• US 9,299,183 B2
• Filed: 03/05/2014
• Issued: 03/29/2016
• Est. Priority Date: 07/02/2010
• Status: Active Grant

• Current Assignee: zSpace Inc.
• Original Assignee: zSpace Inc.
• Inventors: Vesely, Michael A.
• Primary Examiner(s): Drennan, Barry
• Assistant Examiner(s): PRINGLE-PARKER, JASON A
• Application Number:
  US14/198,252
• Publication Number:
  US 20140184589A1
• Time in Patent Office: 755 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06T 15/08 Volume rendering
• CPC Class Codes: H04N 13/383 for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes

Abstract

System and methods for user interface elements for use within a 3D scene. The 3D scene may be presented by at least one display, which includes displaying at least one stereoscopic image of the 3D scene by the display(s). The 3D scene may be presented according to a first viewpoint. One or more user interface elements may be used. The 3D scene may be updated in response to the use of the user interface elements.

Claims

1. A method comprising:

displaying a three dimensional (3D) stereoscopic scene by at least one stereoscopic display device wherein the 3D stereoscopic scene is displayed according to a first viewpoint, wherein the first viewpoint comprises a first location and orientation in physical space with respect to the at least one stereoscopic display device, and wherein the 3D stereoscopic scene comprises a rendering of two or more objects from the first viewpoint in which the rendering of a first object of the two or more objects is at least partially visible and the rendering of a second object of the two or more objects is at least partially obscured by the first object;

determining a second location and orientation in physical space of a six degree of freedom (6DOF) input device, wherein the second location and orientation in physical space maps to a corresponding position and orientation within the 3D stereoscopic scene;

displaying a depicted beam according to a first representation;

determining an intersection of the depicted beam within the 3D stereoscopic scene with an obscured portion of the second object of the two or more objects, wherein the depicted beam extends from the corresponding position and orientation within the 3D stereoscopic scene; and

displaying at least a portion of the depicted beam with a representation that indicates the intersection, comprising;

displaying a first portion of the depicted beam with the first representation; and

displaying a second portion of the depicted beam with a second representation;

wherein the first portion extends from the corresponding position and orientation within the 3D stereoscopic scene towards the intersection, wherein the second portion extends away from the intersection, and wherein the second representation is different from the first representation.

2. The method of claim 1,

wherein the first representation comprises one or more of:

a first line style;

or

a first line color; and

wherein the second representation comprises one or more of;

a second line style;

or

a second line color.

3. The method of claim 2,

wherein the first line style comprises a solid line and the second line style comprises a notched line.

4. The method of claim 1, further comprising:

rendering the first object transparent or translucent; and

displaying the partially obscured portion of the second object from the first viewpoint.

5. The method of claim 1, further comprising:

determining a region of the first object that corresponds to the partially obscured portion of the second object;

rendering the region of the first object transparent; and

displaying the partially obscured portion of the second object from the first viewpoint.

6. The method of claim 1, further comprising:

determining a region of the first object that corresponds to the partially obscured portion of the second object;

rendering the region of the first object translucent; and

displaying the partially obscured portion of the second object from the first viewpoint.

7. The method of claim 1,

wherein the depicted beam comprises a rendering of a continuous beam.

8. A non-transitory computer accessible memory medium storing program instructions for utilizing a six degree of freedom (6DOF) input device with a three-dimensional (3D) stereoscopic scene, wherein the program instructions are executable by a processor to:

display the 3D stereoscopic scene by at least one stereoscopic display device, wherein the 3D stereoscopic scene is displayed according to a first viewpoint, wherein the first viewpoint comprises a first location and orientation in physical space with respect to the at least one stereoscopic display device, and wherein the 3D stereoscopic scene comprises a rendering of two or more objects from the first viewpoint in which the rendering of a first object of the two or more objects is at least partially visible and the rendering of a second object of the two or more objects is at least partially obscured by the first object;

determine a second location and orientation in physical space of the 6DOF input device, wherein the second location and orientation in physical space maps to a corresponding position and orientation within the 3D stereoscopic scene;

display a depicted beam according to a first representation;

determine an intersection of the depicted beam within the 3D stereoscopic scene with an obscured portion of the second object of the two or more objects, wherein the depicted beam extends from the corresponding position and orientation within the 3D stereoscopic scene; and

display at least a portion of the depicted beam with a representation that indicates the intersection, wherein to display at least the portion of the depicted beam, the program instructions are further executable to;

display a first portion of the depicted beam with the first representation; and

display a second portion of the depicted beam with a second representation;

wherein the first portion extends from the corresponding position and orientation within the 3D stereoscopic scene towards the intersection, wherein the second portion extends away from the intersection, and wherein the second representation is different from the first representation.

9. The non-transitory computer accessible memory medium of claim 8, wherein the depicted beam comprises a rendering of a continuous beam.

10. The non-transitory computer accessible memory medium of claim 8, wherein the first representation comprises a first line style and the second representation comprises a second line style.

11. The non-transitory computer accessible memory medium of claim 10,

wherein the first line style comprises a solid line and the second line style comprises a notched line.

12. The non-transitory computer accessible memory medium of claim 8, wherein the first representation comprises a first line color and the second representation comprises a second line color.

13. The non-transitory computer accessible memory medium of claim 8, wherein the program instructions are further executable to:

determine a region of the first object that corresponds to the partially obscured portion of the second object;

render the region of the first object transparent; and

display the partially obscured portion of the second object from the first viewpoint.

14. The non-transitory computer accessible memory medium of claim 8, wherein the program instructions are further executable to:

determine a region of the first object that corresponds to the partially obscured portion of the second object;

render the region of the first object translucent; and

display the partially obscured portion of the second object from the first viewpoint.

15. The non-transitory computer accessible memory medium of claim 8, wherein the program instructions are further executable to:

render the first object transparent; and

display the partially obscured portion of the second object from the first viewpoint.

16. The non-transitory computer accessible memory medium of claim 8, wherein the program instructions are further executable to:

render the first object translucent; and

display the partially obscured portion of the second object from the first viewpoint.

17. A system for utilizing a six degree of freedom (6DOF) input device with a three-dimensional (3D) stereoscopic scene, the system comprising:

a processor;

an input device configured to provide information to the processor indicating a current viewpoint of the user;

at least one display coupled to the processor;

the 6DOF input device; and

a memory medium coupled to the processor which stores program instructions executable to;

display the 3D stereoscopic scene by at least one stereoscopic display device, wherein the 3D stereoscopic scene is displayed according to a first viewpoint, wherein the first viewpoint comprises a first location and orientation in physical space with respect to the at least one stereoscopic display device, and wherein the 3D stereoscopic scene comprises a rendering of two or more objects from the first viewpoint in which the rendering of a first object of the two or more objects is at least partially visible and the rendering of a second object of the two or more objects is at least partially obscured by the first object;

determine a second location and orientation in physical space of the 6DOF input device, wherein the second location and orientation in physical space maps to a corresponding position and orientation within the 3D stereoscopic scene;

display a depicted beam according to a first representation;

determine an intersection of the depicted beam within the 3D stereoscopic scene with an obscured portion of the second object of the two or more objects, wherein the depicted beam extends from the corresponding position and orientation within the 3D stereoscopic scene; and

display at least a portion of the depicted beam with a representation that indicates the intersection, wherein to display at least the portion of the depicted beam, the program instructions are further executable to;

display a first portion of the depicted beam with the first representation; and

display a second portion of the depicted beam with a second representation;

wherein the first portion extends from the corresponding position and orientation within the 3D stereoscopic scene towards the intersection, wherein the second portion extends away from the intersection, and wherein the second representation is different from the first representation.

18. The system of claim 17, wherein the depicted beam comprises a rendering of a continuous beam.

19. The system of claim 17, wherein the first representation comprises a first line style and the second representation comprises a second line style.

20. The system of claim 17, wherein the first representation comprises a first line color and the second representation comprises a second line color.

21. The system of claim 17, wherein the program instructions are further executable to:

determine a region of the first object that corresponds to the partially obscured portion of the second object;

render the region of the first object transparent; and

display the partially obscured portion of the second object from the first viewpoint.

22. The system of claim 17, wherein the program instructions are further executable to:

determine a region of the first object that corresponds to the partially obscured portion of the second object;

render the region of the first object translucent; and

display the partially obscured portion of the second object from the first viewpoint.

23. The system of claim 17, wherein the program instructions are further executable to:

render the first object transparent; and

display the partially obscured portion of the second object from the first viewpoint.

24. The system of claim 17, wherein the program instructions are further executable to:

render the first object translucent; and

display the partially obscured portion of the second object from the first viewpoint.

25. The system of claim 19,

wherein the first line style comprises a solid line and the second line style comprises a notched line.