Detection of partially obscured objects in three dimensional stereoscopic scenes

• US 9,704,285 B2
• Filed: 03/23/2016
• Issued: 07/11/2017
• Est. Priority Date: 07/02/2010
• Status: Active Grant

• Current Assignee: zSpace Inc.
• Original Assignee: zSpace Inc.
• Inventors: Vesely, Michael A.
• Primary Examiner(s): Drennan, Barry
• Assistant Examiner(s): PRINGLE-PARKER, JASON A
• Application Number:
  US15/078,326
• Publication Number:
  US 20160203634A1
• Time in Patent Office: 475 Days
• Field of Search: None
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06T 15/08 Volume rendering
• CPC Class Codes: H04N 13/383 for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes

Abstract

System and methods for user interface elements for use within a 3D scene. The 3D scene may be presented by at least one display, which includes displaying at least one stereoscopic image of the 3D scene by the display(s). The 3D scene may be presented according to a first viewpoint. One or more user interface elements may be used. The 3D scene may be updated in response to the use of the user interface elements.

Claims

1. A method comprising:

displaying a three dimensional (3D) stereoscopic scene according to a first viewpoint, wherein the 3D stereoscopic scene comprises a rendering of at least a first object and a second object from the first viewpoint, wherein the rendering of the first object at least partially obscures a portion of the rendering of the second object;

determining a location and orientation in physical space of an input device, wherein the location and orientation in physical space maps to a corresponding position and orientation within the 3D stereoscopic scene;

determining an intersection of a depicted beam within the 3D stereoscopic scene with an obscured portion of the second object, wherein the depicted beam extends from the corresponding position and orientation within the 3D stereoscopic scene; and

displaying first and second portions of the depicted beam with different representations to indicate the intersection, wherein the first portion extends from the corresponding position and orientation towards the intersection, and wherein the second portion extends away from the intersection.

2. The method of claim 1, further comprising:

displaying the depicted beam with the first representation prior to said determining the intersection.

3. The method of claim 1,

wherein the first representation comprises one or more of:

a first line style;

or

a first line color; and

wherein the second representation comprises one or more of;

a second line style;

or

a second line color.

4. The method of claim 1, further comprising:

rendering the first object transparent or translucent; and

displaying the partially obscured portion of the second object from the first viewpoint.

5. The method of claim 1, further comprising:

determining a region of the first object that corresponds to the obscured portion of the second object;

rendering the region of the first object transparent; and

displaying the obscured portion of the second object from the first viewpoint.

6. The method of claim 1, further comprising:

determining a region of the first object that corresponds to the obscured portion of the second object;

rendering the region of the first object translucent; and

displaying the obscured portion of the second object from the first viewpoint.

7. A non-transitory computer accessible memory medium storing program instructions for utilizing an input device with a three-dimensional (3D) stereoscopic scene, wherein the program instructions are executable by a processor to:

display a three dimensional (3D) stereoscopic scene according to a first viewpoint, wherein the 3D stereoscopic scene comprises a rendering of at least a first object and a second object from the first viewpoint, wherein the rendering of the first object at least partially obscures a portion of the rendering of the second object;

determine a location and orientation in physical space of an input device, wherein the location and orientation in physical space maps to a corresponding position and orientation within the 3D stereoscopic scene;

determine an intersection of a depicted beam within the 3D stereoscopic scene with an obscured portion of the second object, wherein the depicted beam extends from the corresponding position and orientation within the 3D stereoscopic scene; and

display first and second portions of the depicted beam with different representations to indicate the intersection, wherein the first portion extends from the corresponding position and orientation towards the intersection, and wherein the second portion extends away from the intersection.

8. The non-transitory computer accessible memory medium of claim 7,

wherein the program instructions are further executable to display the depicted beam with the first representation prior to said determining the intersection.

9. The non-transitory computer accessible memory medium of claim 7,

wherein the first representation comprises one or more of:

a first line style;

or

a first line color; and

wherein the second representation comprises one or more of;

a second line style;

or

a second line color.

10. The non-transitory computer accessible memory medium of claim 7,

wherein the program instructions are further executable to:

render the first object transparent or translucent; and

display the partially obscured portion of the second object from the first viewpoint.

11. The non-transitory computer accessible memory medium of claim 7,

wherein the program instructions are further executable to:

determine a region of the first object that corresponds to the obscured portion of the second object;

render the region of the first object transparent; and

display the obscured portion of the second object from the first viewpoint.

12. The non-transitory computer accessible memory medium of claim 7,

wherein the program instructions are further executable to:

determine a region of the first object that corresponds to the obscured portion of the second object;

render the region of the first object translucent; and

display the obscured portion of the second object from the first viewpoint.

13. The non-transitory computer accessible memory medium of claim 7,

wherein the depicted beam comprises a rendering of a continuous beam.

14. A system for utilizing an input device with a three-dimensional (3D) stereoscopic scene, the system comprising:

a memory; and

a processor in communication with the memory, wherein the processor is configured to;

display a three dimensional (3D) stereoscopic scene according to a first viewpoint, wherein the 3D stereoscopic scene comprises a rendering of at least a first object and a second object from the first viewpoint, wherein the rendering of the first object at least partially obscures a portion of the rendering of the second object;

determine a location and orientation in physical space of an input device, wherein the location and orientation in physical space maps to a corresponding position and orientation within the 3D stereoscopic scene;

determine an intersection of a depicted beam within the 3D stereoscopic scene with an obscured portion of the second object, wherein the depicted beam extends from the corresponding position and orientation within the 3D stereoscopic scene; and

display first and second portions of the depicted beam with different representations to indicate the intersection, wherein the first portion extends from the corresponding position and orientation towards the intersection, and wherein the second portion extends away from the intersection.

15. The system of claim 14,

wherein the processor is further configured to display the depicted beam with the first representation prior to said determining the intersection.

16. The system of claim 14,

wherein the first representation comprises one or more of:

a first line style;

or

a first line color; and

wherein the second representation comprises one or more of;

a second line style;

or

a second line color.

17. The system of claim 14,

wherein the processor is further configured to:

render the first object transparent or translucent; and

display the partially obscured portion of the second object from the first viewpoint.

18. The system of claim 14,

wherein the processor is further configured to:

determine a region of the first object that corresponds to the obscured portion of the second object;

render the region of the first object transparent; and

display the obscured portion of the second object from the first viewpoint.

19. The system of claim 14,

wherein the processor is further configured to:

determine a region of the first object that corresponds to the obscured portion of the second object;

render the region of the first object translucent; and

display the obscured portion of the second object from the first viewpoint.

20. The system of claim 14,

wherein the depicted beam comprises a rendering of a continuous beam.