Head tracking eyewear system

• US 9,106,903 B2
• Filed: 11/16/2012
• Issued: 08/11/2015
• Est. Priority Date: 11/18/2011
• Status: Active Grant

• Current Assignee: zSpace Inc.
• Original Assignee: zSpace Inc.
• Inventors: Tu, Jerome C., Chavez, David A.
• Primary Examiner(s): Moe, Aung S
• Assistant Examiner(s): Hsu, Amy
• Application Number:
  US13/679,630
• Publication Number:
  US 20130128011A1
• Time in Patent Office: 998 Days
• US Class Current: 1/1
• CPC Class Codes: H04N 13/30 Image reproducers optical systems for producing stereoscopic or other three-dimensional effects G02B30/00
• CPC Class Codes: H04N 13/349 Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking for viewing without the aid of special glasses using fly-eye lenses H04N13/307
• CPC Class Codes: H04N 13/366 using viewer tracking
• CPC Class Codes: H04N 13/398 Synchronisation thereof; Control thereof
• CPC Class Codes: H04N 2213/008 Aspects relating to glasses for viewing stereoscopic images

Abstract

In some embodiments, a system for tracking with reference to a three-dimensional display system may include a display device, an image processor, a surface including at least three emitters, at least two sensors, a processor. The display device may image, during use, a first stereo three-dimensional image. The surface may be positionable, during use, with reference to the display device. At least two of the sensors may detect, during use, light received from at least three of the emitters as light blobs. The processor may correlate, during use, the assessed referenced position of the detected light blobs such that a first position/orientation of the surface is assessed. The image processor may generate, during use, the first stereo three-dimensional image using the assessed first position/orientation of the surface with reference to the display. The image processor may generate, during use, a second stereo three-dimensional image using an assessed second position/orientation of the surface with reference to the display.

Claims

1. A system for tracking with reference to a three-dimensional display system, comprising:

a display device which images, during use, a first stereo three-dimensional image;

a surface comprising at least three emitters, wherein the surface is positionable, during use, with reference to the display device;

at least two sensors coupled to the display device in a known position and orientation referenced to the display device, wherein at least two of the sensors detect, during use, light received from at least three of the emitters as light blobs when the light blobs from the at least three emitters of the surface are detected substantially in proximity to the display device during use;

a processor coupled to at least two of the sensors, wherein the processor assesses, during use, a referenced position of the detected light blobs using a bounding function for each of at least two of the sensors, wherein the processor, correlates, during use, the assessed referenced position of the detected light blobs for each of at least two of the sensors such that a first position/orientation of the surface with reference to the display device is assessed; and

an image processor which generates, during use, the first stereo three-dimensional image using the assessed first position/orientation of the surface with reference to the display device;

wherein the first stereo three-dimensional image is from a first perspective, and wherein the first stereo three-dimensional image is distinct from a second stereo three-dimensional image which is derived from a second perspective using a second assessed position/orientation of the surface with reference to the display device.

2. The system of claim 1, wherein the surface comprises at least 6 degrees of freedom of movement proximate to the display device.

3. The system of claim 1, wherein the surface comprises at least four emitters, and wherein at least two of the sensors detect, during use, light received from at least three of the emitters as light blobs.

4. The system of claim 1, wherein the surface comprises at least five emitters, and wherein at least two of the sensors detect, during use, light received from at least three of the emitters as light blobs.

5. The system of claim 1, wherein at least a portion of the surface adjacent to at least one of the emitters absorbs light.

6. The system of claim 1, wherein the surface forms at least a portion of a device which couples to the head of a user.

7. The system of claim 1, wherein the surface forms at least a portion of a pair of glasses which couple to the head of a user.

8. The system of claim 1, wherein the emitters at least partially extend from the surface.

9. The system of claim 1, wherein at least one of the emitters comprises a substantially cylindrical, spherical, and/or hemi-spherical shape.

10. The system of claim 1, wherein at least two of the sensors detect, during use, infrared light projected from at least three of the emitters as light blobs when at least three of the emitters of the surface are directed substantially towards the display device during use.

11. The system of claim 1, wherein at least two of the sensors detect, during use, light reflected from at least three of the emitters as light blobs are detected substantially in proximity to the display device during use.

12. The system of claim 1, wherein when the processor correlates the assessed referenced position of the detected light blobs the processor:

identifies a first emitter along a perimeter determined by the bounding function by assigning a first detected light blob closest to a predetermined first portion of the perimeter;

moves in a first direction away from the first emitter along the perimeter assessing relative angles formed by adjacent detected light blobs along the perimeter such that a second emitter is identified; and

identifies an at least third emitter along the perimeter with reference to the identified first and second emitter.

13. The system of claim 1, wherein the processor verifies the assessed referenced position of the detected light blobs per sensor by comparing the assessed relative position of the detected light blobs to a database of different configurations of emitters.

14. The system of claim 1, wherein the processor assesses, during use, a first position/orientation of a head to which the surface is coupled to using the assessed first position/orientation of the surface with reference to the display device, and wherein the processor assesses, during use, a first viewpoint using the assessed first position/orientation of the head to assess a second perspective for use by the image processor to assist in generating a second stereo three-dimensional image.

15. A method for tracking with reference to a three-dimensional display system, comprising:

positioning a surface with reference to a display device, wherein the surface comprises at least three emitters;

detecting light received from at least three of the emitters as light blobs when the light blobs from the at least three emitters of the surface are detected substantially in proximity to the display device using at least two sensors coupled to the display device in a known position and orientation with reference to the display device;

assessing a referenced position of the detected light blobs using a bounding function for each of at least two of the sensors using a processor coupled to at least two of the sensors;

correlating the assessed referenced position of the detected light blobs for each of at least two of the sensors such that a first position/orientation of the surface with reference to the display device is assessed, wherein said correlating the assessed referenced position of the detected light blobs comprises;

identifying a first emitter along a perimeter determined by the bounding function by assigning a first detected light blob closest to a predetermined first portion of the perimeter;

moving in a first direction away from the first emitter along the perimeter assessing relative angles formed by adjacent detected light blobs along the perimeter such that a second emitter is identified; and

identifying an at least third emitter along the perimeter with reference to the identified first and second emitter;

generating a first stereo three-dimensional image on the display device using an image processor, wherein the image processor uses the assessed first position/orientation of the surface with reference to the display device to generate the first stereo three-dimensional image; and

generating a second stereo three-dimensional image on the display device using the image processor, wherein the image processor uses an assessed second position/orientation of the surface with reference to the display device to generate the second stereo three-dimensional image.

16. The method of claim 15, wherein the second emitter is identified as a second detected light blob of three adjacent detected light blobs forming a substantially right angle.

17. The method of claim 15, further comprising verifying the assessed referenced position of the detected light blobs by comparing the assessed referenced position of the detected light blobs to a database of different configurations of emitters.

18. The method of claim 15, further comprising absorbing light using at least a portion of the surface substantially adjacent to at least one of the emitters.

19. A system for tracking with reference to a three-dimensional display system, comprising:

a display device, configured to image, during use, a first stereo three-dimensional image;

a surface comprising at least three emitters, wherein the surface is positionable, during use, with reference to the display device;

at least two sensors coupled to the display device in a known position and orientation referenced to the display device, wherein at least two of the sensors are configured to detect, during use, light received from at least three of the emitters as light blobs when the light blobs from the at least three emitters of the surface are detected substantially in proximity to the display device during use;

a processor coupled to at least two of the sensors, wherein the processor is configured to;

assess, during use, a referenced position of the detected light blobs using a bounding function for each of at least two of the sensors;

correlate, during use, the assessed referenced position of the detected light blobs for each of at least two of the sensors such that a first position/orientation of the surface with reference to the display device is assessed, wherein to correlate the assessed referenced position of the detected light blobs the processor is configured to;

identify a first emitter along a perimeter determined by the bounding function by assigning a first detected light blob closest to a predetermined first portion of the perimeter;

move in a first direction away from the first emitter along the perimeter assessing relative angles formed by adjacent detected light blobs along the perimeter such that a second emitter is identified; and

identify an at least third emitter along the perimeter with reference to the identified first and second emitter; and

an image processor configured to generate, during use, the first stereo three-dimensional image using the assessed first position/orientation of the surface with reference to the display device.

20. A system for tracking with reference to a three-dimensional display system, comprising:

a display device, configured to image, during use, a first stereo three-dimensional image;

a surface comprising at least three emitters, wherein the surface is positionable, during use, with reference to the display device;

at least two sensors coupled to the display device in a known position and orientation referenced to the display device, wherein at least two of the sensors are configured to detect, during use, light received from at least three of the emitters as light blobs when the light blobs from the at least three emitters of the surface are detected substantially in proximity to the display device during use;

a processor coupled to at least two of the sensors, wherein the processor is configured to;

assess, during use, a referenced position of the detected light blobs using a bounding function for each of at least two of the sensors;

correlate, during use, the assessed referenced position of the detected light blobs for each of at least two of the sensors such that a first position/orientation of the surface with reference to the display device is assessed; and

verify the assessed referenced position of the detected light blobs per sensor by comparing the assessed relative position of the detected light blobs to a database of different configurations of emitters; and

an image processor which generates, during use, the first stereo three-dimensional image using the assessed first position/orientation of the surface with reference to the display device.

21. A system for tracking with reference to a three-dimensional display system, comprising:

a display device which images, during use, a first stereo three-dimensional image;

a surface comprising at least three emitters, wherein the surface is positionable, during use, with reference to the display device;

at least two sensors coupled to the display device in a known position and orientation referenced to the display device, wherein at least two of the sensors are configured to detect, during use, light received from at least three of the emitters as light blobs when the light blobs from the at least three emitters of the surface are detected substantially in proximity to the display device during use;

a processor coupled to at least two of the sensors, wherein the processor is configured to;

assesses, during use, a referenced position of the detected light blobs using a bounding function for each of at least two of the sensors;

correlate, during use, the assessed referenced position of the detected light blobs for each of at least two of the sensors such that a first position/orientation of the surface with reference to the display device is assessed;

assesses, during use, a first position/orientation of a head to which the surface is coupled to using the assessed first position/orientation of the surface with reference to the display device; and

assess, during use, a first viewpoint using the assessed first position/orientation of the head to assess a second perspective for use by the image processor to assist in generating a second stereo three-dimensional image; and

an image processor which generates, during use, the first stereo three-dimensional image using the assessed first position/orientation of the surface with reference to the display device.

22. A non-transitory computer accessible memory medium that stores program instructions executable by a processor to implement:

receiving, in response to a surface positioned with reference to a display device, wherein the surface comprises at least three emitters, an indication of detecting light from the at least three emitters as light blobs when the light blobs from the at least three emitters of the surface are detected substantially in proximity to the display device using at least two sensors coupled to the display device in a known position and orientation with reference to the display device;

assessing a referenced position of the detected light blobs using a bounding function for each of at least two of the sensors using a processor coupled to at least two of the sensors;

correlating the assessed referenced position of the detected light blobs for each of at least two of the sensors such that a first position/orientation of the surface with reference to the display device is assessed, wherein said correlating the assessed referenced position of the detected light blobs comprises;

identifying a first emitter along a perimeter determined by the bounding function by assigning a first detected light blob closest to a predetermined first portion of the perimeter;

moving in a first direction away from the first emitter along the perimeter assessing relative angles formed by adjacent detected light blobs along the perimeter such that a second emitter is identified; and

identifying an at least third emitter along the perimeter with reference to the identified first and second emitter;

generating a first stereo three-dimensional image on the display device using an image processor, wherein the image processor uses the assessed first position/orientation of the surface with reference to the display device to generate the first stereo three-dimensional image; and

generating a second stereo three-dimensional image on the display device using the image processor, wherein the image processor uses an assessed second position/orientation of the surface with reference to the display device to generate the second stereo three-dimensional image.