System and Method for 3-Dimensional Display of Image Data

• US 20090256904A1
• Filed: 08/26/2008
• Published: 10/15/2009
• Est. Priority Date: 11/09/2005
• Status: Active Grant

• Current Assignee: Johns Hopkins University
• Original Assignee: Johns Hopkins University
• Inventors: Roth, Michael W., Beser, Nicholas D., Blodgett, David W., Krill, Jerry A.
• Granted Patent: US 8,130,260 B2
• Time in Patent Office: Days
• US Class Current: 348/47
• CPC Class Codes: G02B 2027/0134 of stereoscopic type
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 30/34 Stereoscopes providing a stereoscopic pair of separated images corresponding to parallactically displaced views of the same object, e.g. 3D slide viewers
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: H04N 13/344 with head-mounted left-right displays
• CPC Class Codes: H04N 13/383 for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes

Abstract

Disclosed is a system for a 3-dimensional display that includes at least one eyepiece having first and second eyepiece sockets, having a first display contained in said first eyepiece socket associated with a first eye, two eye cameras mounted such that a first eye camera tracks eye reference points of said first eye and a second eye camera tracks reference points of a second eye, a processor for providing overall control of said at least one eyepiece; a second display; and a main processor; signals are transmitted between said main processor and said at least one eyepiece, wherein said two eye cameras track said reference points, said eyepiece transceiver transmits said reference points to said main processor via said main transceiver, said main processor generates image data based on said reference points and transmits said image data to said displays to produce a 3-dimensional image.

Claims

1. A system for a 3-dimensional display, comprising:

at least one eyepiece having first and second eyepiece sockets, comprising;

a first display contained in said first eyepiece socket associated with a first eye for displaying first image data;

two eye cameras mounted such that a first eye camera tracks eye reference points of said first eye and a second eye camera tracks eye reference points of a second eye;

a processor for providing overall control of said at least one eyepiece; and

an eyepiece transceiver for transmitting and receiving signals;

a second display for displaying second image data;

a main processor; and

a main transceiver connected to said main processor for transmitting signals between said main processor and said at least one eyepiece,

wherein said two eye cameras track said reference points of said first and second eyes, said eyepiece transceiver transmits said reference points to said main processor via said main transceiver, said main processor calculates a focal point based on said eye reference points and generates said first and second image data based on said focal point, said first and second image data transmitted to and output from said first and second displays, and wherein said first and second image data output from said first and second displays produces a 3-dimensional image.

2. The system for a 3-dimensional display of claim 1, wherein said second display is located in said second eyepiece socket.

3. The system for a 3-dimensional display of claim 1, wherein said second display is viewed by said second eye through said second eyepiece socket.

4. The system for a 3-dimensional display of claim 1, wherein said first and second image data is generated by said main processor to produce on said at least one display a fine focus area of fine resolution and a course focus area of course resolution.

5. The system for a 3-dimensional display of claim 4, wherein said fine focus area is located about said focal point, and said course focus area is located about said fine focus area.

6. The system for a 3-dimensional display of claim 1, wherein said eye reference points are utilized in pupil tracking calculations.

7. The system for a 3-dimensional display of claim 1, wherein said eye reference points are utilized in eye elongation tracking calculations.

8. A method for 3-dimensional displaying of image data, comprising the steps of:

tracking eye reference points of a first eye;

tracking eye reference points of a second eye;

calculating a focal point based on the eye reference points;

generating 3-dimensional image data from base data based on said focal point; and

displaying said 3-dimensional image data on at least one display.

9. The method for 3-dimensional displaying of image data of claim 8, wherein the step of generating 3-dimensional image data based on said focal point, further comprising the steps of:

generating first and second image data for display on a first and a second display, such that when said first and second displays are viewed simultaneously said first and second image data produces a 3-dimensional image.

10. The method for 3-dimensional displaying of image data of claim 9, wherein said first display is contained in a first eyepiece socket of an eyepiece and said second display is viewed through a second eyepiece socket of said eyepiece.

11. The method for 3-dimensional displaying of image data of claim 9, wherein said first display is contained in a first eyepiece socket of an eyepiece and said second display is contained in a second eyepiece socket of said eyepiece.

12. The method for 3-dimensional displaying of image data of claim 8, wherein said 3-dimensional image data is generated to produce a fine focus area of fine resolution and at least one course focus area of course resolution.

13. The method for 3-dimensional displaying of image data of claim 12, wherein said fine focus area is located about said focal point, and said at least one course focus area is located about said fine focus area.

14. The method for 3-dimensional displaying of image data of claim 8, further comprising the steps of:

(a) dividing said base data into at least two pieces such that each piece can be rendered as a primitive;

(b) generating a representation of said at least two pieces;

(c) representing said at least two pieces as a data node on a tree;

(d) dividing each of said at least two pieces into at least two sub-pieces; and

(e) repeating steps (a) through (d) until smallest primitives are reached

15. The method for 3-dimensional displaying of image data of claim 14, wherein the 3-dimensional image data is generated by traversing the tree, and wherein when the traversal reaches the size of a pixel the rendering stops.

16. The method for 3-dimensional displaying of image data of claim 15, wherein base data outside of a viewing frustum is discarded at high speed as the tree is traversed.

24. The system for a 3-dimensional display of claim 14, wherein said processor (a) divides the base data into at least two pieces such that each piece can be rendered as a primitive, (b) generates a representation of said at least two pieces, (c) represents said at least two pieces as a data node on a tree, (d) divides each of said at least two pieces into at least two sub-pieces, and repeats steps (a) through (d) until smallest primitives are reached

25. The system for 3-dimensional display of claim 24, wherein the 3-dimensional image data is generated by traversing the tree, and wherein when the traversal reaches the size of a pixel the rendering stops.

26. The system for 3-dimensional display of claim 25, wherein base data outside of a viewing frustum is discarded at high speed as the tree is traversed.

17. A system for a 3-dimensional display, comprising:

at least one eye camera to track eye reference points of a first eye and a second eye;

a processor for calculating a focal point based on said eye reference points and generating 3-dimensional image data from base data based on said focal point; and

at least one display for displaying said 3-dimensional image data.

18. The system for a 3-dimensional display of claim 17, wherein said processor generates first and second image data for display on a first and a second display, such that when first and second displays are viewed simultaneously said first and second image data produces a 3-dimensional image.

19. The system for a 3-dimensional display of claim 18, wherein said first display is contained in a first eyepiece socket of an eyepiece and said second display is viewed through a second eyepiece socket of said eyepiece.

20. The system for a 3-dimensional display of claim 18, wherein said first display is contained in a first eyepiece socket of an eyepiece and said second display is contained in a second eyepiece socket of said eyepiece.

21. The system for a 3-dimensional display of claim 17 wherein said image data is generated by said processor to produce on said at least one display a fine focus area of fine resolution and a course focus area of course resolution.

22. The system for a 3-dimensional display of claim 17 wherein said at least one course focus area decrease in resolution as a distance from said focal point increases.

23. The system for a 3-dimensional display of claim 21, wherein said fine focus area is located about said focal point, and said course focus area is located about said fine focus area.