Interactive data view and command system

• US 7,245,273 B2
• Filed: 01/30/2002
• Issued: 07/17/2007
• Est. Priority Date: 01/30/2001
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: David Parker Dickerson
• Inventors: Jochheim, Edgar, Eberl, Roland H. C., Dickerson, David P., Konigstein, Karsten, Eberl, Heinrich A.
• Primary Examiner(s): LEWIS, DAVID LEE
• Application Number:
  US10/066,292
• Publication Number:
  US 20020101568A1
• Time in Patent Office: 1,994 Days
• Field of Search: 345/2.3, 345 7- 9, 351/210, 351/211, 382/128
• US Class Current: 345/7
• CPC Class Codes: G02B 2027/0132 comprising binocular systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G05D 1/0016 characterised by the operator's input device input arrangements for computing systems in general G06F3/00
• CPC Class Codes: G05D 1/0038 by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation images analyzed by a computer and used for automatic navigation G05D1/0246

Abstract

A method and information system for capturing signals, for processing signals, and for providing signals at least partially based on, or bearing correlation to, the captured signals is disclosed. The information system includes a signal input unit, a wireless communication unit, and an output unit. The signal input unit (preferably an optical signal unit) is constructed and is positionable to capture signals associated with an eye. The output unit is constructed to provide information based on the captured signals or to provide information as a function of the captured signals or in correlation with the captured signals.

Claims

1. An information system, comprising

a optical signal unit constructed and positioned to capture signals reflected back from at least one eye comprising a retina, said optical signal unit comprising a scanning detection unit constructed to at least partially capture a retinal reflex image of a natural scene ambient to said eye;

an information unit;

a wireless communication unit; and

an output unit constructed and arranged to provide information, at least partially obtained via said communication unit, in cooperation with said information unit as a function of said captured signals, wherein

said information system does not project electromagnetic radiation onto said eye in the course of said provision of information.

3. The information system of claim 1, wherein said information system does not project electromagnetic radiation onto said retina.

2. An information system, comprising

an optical signal unit constructed and positioned to capture signals reflected back from an eye comprising a retina, said optical signal unit comprising a scanning detection unit constructed to at least partially capture a retinal reflex image from said retina during a scanning operation and carrying out a less comprehensive capture of said retinal reflex image during another scanning operation;

an information unit;

a wireless communication unit; and

an output unit constructed and arranged to provide information, at least partially obtained via said communication unit, in cooperation with said information unit as a function of said captured signals, said output unit comprising a scanning projection device constructed to project at least part of said information onto said retina.

4. The information system of claim 2, wherein

said retinal reflex image is a reflex image of a natural scene ambient to said eye, and

said information system is configured and adapted to extract image information pertaining to said natural scene from said retinal reflex image.

5. The information system of claim 2, wherein said scanning projection device is constructed and arranged to project light onto said retina and said retinal reflex image comprises a portion of said projected light that has been reflected from said retina.

6. An information system, comprising:

an optical signal unit constructed and positioned to capture signals associated with an eye;

a wireless communication unit;

a camera constructed and arranged to capture optical signals from a natural scene ambient to said eye; and

an output unit, interfaced with said wireless communication unit, constructed and arranged to provide information using a correlation unit constructed to find suitable relationship between said captured signals and additional data, wherein

said optical signal unit is configured and adapted to at least partially capture a retinal reflex of a said natural scene ambient to said eye,

said captured signals comprise said at least partially captured retinal reflex,

said information system is configured and adapted to extract image information pertaining to said natural scene from said retinal reflex image, and

said correlation unit is configured and adapted to determine a correlation between said captured optical signals and said extracted image information in said finding of said suitable relationship.

7. The information system of claim 6, comprising an eye-tracking unit constructed and arranged to project light onto said eye, to capture a portion of said projected light that has been reflected from said eye and to determine, on the basis of said captured portion of light, an orientation of said eye, wherein said correlation unit is constructed and arranged to employ said determined orientation of said eye in finding said suitable relationship.

11. The information system of claim 6, wherein said information system is configured and adapted to extract information representative of physical retinal structures of said retina from said retinal reflex image.

8. An information system, comprising:

an optical signal unit constructed and positioned to capture signals associated with an eye;

a wireless communication unit;

a camera constructed and arranged to capture optical signals from a natural scene ambient to said eye; and

an output unit, interfaced with said wireless communication unit, constructed and arranged to provide information using a correlation unit constructed to find suitable relationship between said captured signals and additional data, wherein

said optical signal unit is constructed and arranged to project light onto said eye and to capture a portion of said projected light that has been reflected from a retina of said eye and that is indicative of physical retinal structures of said retina,

said information system is configured and adapted to extract information representative of said physical retinal structures from said captured portion of light,

said captured signals comprise said captured portion of light, and

said finding suitable relationship between said captured signals and additional data comprises determining, on the basis of said extracted information, an orientation of said eye.

9. The information system of claim 8, wherein

said optical signal unit is constructed and arranged to capture, from said eye, an ocular reflex of said natural scene ambient to said eye,

said information system is configured and adapted to extract image information pertaining to said natural scene from said captured ocular reflex, and

said correlation unit is constructed and arranged to determine a correlation between said extracted image information and said captured signals in said finding of said suitable relationship.

10. An information system, comprising:

a signal input unit constructed and positioned to capture at least two types of signals from an eye chosen from the group of signal types consisting of signals emanating from said eye and signals that have been reflected back from said eye;

an information unit;

a wireless communication unit; and

an output unit constructed and arranged to providing information, at least partially obtained and/or provided via said communication unit, in cooperation with said information unit as a function of said captured signals, said output unit comprising a projection device constructed to project at least part of said information onto the retina of said eye, wherein

at least one of said signals is an acoustic signal.

12. An information system, comprising

an optical signal unit constructed and arranged to capture light that has been reflected from a retina of an eye and that is indicative of physical retinal structures of said retina;

an optical signal capturing unit constructed and arranged to capture light from a natural scene ambient to said eye without capturing light reflected from said eye; and

means configured and adapted for extracting information representative of said physical retinal structures from said light captured by said optical signal unit and for determining an orientation of said eye on the basis of said extracted information.

13. The information system of claim 12, comprising:

a wireless communication unit, wherein

said information is at least partially obtained via said wireless communication unit.

14. The information system of claim 12, comprising:

means configured and adapted for extracting image information pertaining to said natural ambient scene from said captured light; and

an output unit configured and adapted for providing information as a function of said extracted image information and said determined orientation of said eye.

15. The information system of claim 14, comprising:

means configured and adapted for determining a true orientation of said eye relative to said ambient scene based on said determined orientation of said eye and said extracted image information.

16. The information system of claim 14, wherein said output unit comprises a projection unit configured and adapted to project visible images into said eye.

17. The information system of claim 12, wherein said optical signal unit and said optical signal capturing unit are provided in a predetermined spatial relationship to one another.

18. The information system of claim 12, wherein said information system is configured and adapted to project no visible light onto said eye.

19. The information system of claim 12, wherein said information system is configured and adapted to project no light onto said eye.

20. The information system of claim 12, wherein said optical signal unit is constructed and arranged to project light onto said eye and to capture a portion of said projected light that has been reflected from a retina of said eye and that is indicative of physical retinal structures of said retina.

21. The information system of claim 12, wherein said optical signal unit captures said light reflected from said retina via a scanning optical detection unit.

22. An information system, comprising:

an optical signal capturing unit constructed and arranged to capture light from a natural scene ambient to and establishing a frame of reference for an eye without capturing light reflected from said eye;

a projection unit, provided in a predetermined spatial relationship to said optical signal capturing unit, configured and adapted to project visible images into said eye; and

means configured and adapted for extracting image information pertaining to said natural ambient scene from said captured light, for determining an orientation of said projection unit relative to said natural ambient scene on the basis of said extracted image information and for controlling said projection unit such that said visible images are projected onto said eye in a manner perceived as being in registration with said natural ambient scene.

23. The information system of claim 22, wherein said visible images comprise image information obtained from said captured light.