Interactive data view and command system

• US 7,969,383 B2
• Filed: 04/09/2007
• Issued: 06/28/2011
• Est. Priority Date: 01/30/2001
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Metaio GmbH (Apple Inc.)
• Inventors: Jochheim, Edgar, Eberl, Roland H. C., Koenigstein, Karsten, Dickerson, David P., Eberl, Heinrich A.
• Primary Examiner(s): Patel; Nitin
• Application Number:
  US11/783,408
• Publication Number:
  US 20080157946A1
• Time in Patent Office: 1,541 Days
• Field of Search: 345 7- 9, 340435-438, 382/107, 351/210, 362/105, 455/90.1, 455/344, 701/301
• US Class Current: 345/7
• CPC Class Codes: G02B 2027/0132 comprising binocular systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G05D 1/0016 characterised by the operator's input device input arrangements for computing systems in general G06F3/00
• CPC Class Codes: G05D 1/0038 by providing the operator with simple or augmented images from one or more cameras located onboard the vehicle, e.g. tele-operation images analyzed by a computer and used for automatic navigation G05D1/0246

Abstract

A method and information system for capturing signals, for processing signals, and for providing signals at least partially based on, or bearing correlation to, the captured signals is disclosed. The information system includes a signal input unit, a wireless communication unit, and an output unit. The signal input unit (preferably an optical signal unit) is constructed and is positionable to capture signals associated with an eye. The output unit is constructed to provide information based on the captured signals or to provide information as a function of the captured signals or in correlation with the captured signals.

Claims

1. An information system, comprising:

a signal input unit configured and adapted for use in a vehicle to determine a distance between said signal input unit and an object in front of said vehicle and outputting an output signal indicative of said distance;

an information unit configured and adapted to receive said output signal and to output an image signal representative of an image based on said output signal;

a scanning projection unit configured and adapted to receive said image signal and to visibly project said image to a vehicle driver;

an optical signal capturing unit configured and adapted to capture optical signals from a field of view of said vehicle driver without capturing a retinal reflex image; and

a gaze direction determining subsystem that determines a line of sight of said vehicle driver and provides corresponding line of sight information to said vehicle;

wherein said information unit is configured and adapted to alter said image signal such that a brightness of said image projected by said scanning projection unit is adjusted based on a brightness of said captured optical signals.

2. The information system of claim 1, further comprising a wireless communication unit.

3. The information system of claim 1, further comprising an acceleration measurement apparatus.

4. The information system of claim 1, wherein said image comprises at least one of distance, speed and direction information.

5. The information system of claim 1, wherein said scanning projection unit comprises a deflection mirror.

6. The information system of claim 5, wherein said deflection mirror deflects light traveling along an optical path from a light source to an eye of said vehicle driver.

7. The information system of claim 1, wherein said information system is configured and adapted to display a warning symbol such that said warning symbol is perceived by said vehicle driver at a location where said eye is looking.

8. An information system, comprising:

at least one helmet;

a projection unit that is mounted in or on said helmet and is constructed and arranged to project visible images into an eye of a wearer of said helmet;

an optical signal capturing unit that is mounted in or on said helmet, and is constructed and arranged to capture visible light from a natural scene ambient to said helmet;

a command console having at least one monitor; and

a communication link that permits a communication of information at least in a direction from said at least one helmet to said command console;

wherein,

said command console receives, via said communication link, signals derived from said captured visible light; and

said at least one monitor displays information based on said signals.

9. An information system, comprising:

a first helmet having a projection unit mounted in or on said first helmet, said projection unit being constructed and arranged to project visible images into an eye of a wearer of said first helmet;

a second helmet having a projection unit mounted in or on said second helmet, said projection unit being constructed and arranged to project visible images into an eye of a wearer of said second helmet;

a communication link that permits communication of information at least in a direction from said first helmet to said second helmet;

wherein,

said first helmet comprises a position sensor;

said second helmet receives, via said communication link, signals derived from measurements made by said position sensor; and

said projection unit of said second helmet presents, based on said received signals, image information indicative of a position of said first helmet.

10. An information system for aiding a driver of a vehicle, comprising:

a distance sensor that determines a distance between said vehicle and at least one object located in front of said vehicle in a field of view of said driver;

an evaluation apparatus that determines whether said vehicle is on a collision course with said at least one object;

a gaze direction determining subsystem that determines a line of saight of said driver; and

a scanning projection subsystem configured and adapted to display, if said evaluation apparatus determines a collision course with said at least one object, a warning symbol to said driver along said determined line of sight.

11. The information system of claim 10, further comprising an optical signal capturing subsystem configured and adapted to capture optical signals from said field of view, without capturing a retinal reflex image;

wherein said scanning projection subsystem is configured and adapted to alter a brightness of said displayed warning symbol based on a brightness of said captured optical signals.

12. The information system of claim 11, wherein said scanning projection subsystem is configured and adapted to alter a brightness of said displaced warning symbol based on a brightness of said captured optical signals, such that said warning symbol appears translucent.

13. The information system of claim 10, wherein said scanning projection unit comprises a deflection mirror.

14. The information system of claim 13, wherein said deflection mirror deflects light traveling along an optical path from a light source to an eye of said vehicle driver.

15. An information system for aiding a driver of a vehicle, comprising:

an optical signal unit configured and adapted to capture light reflected back from an eye of said driver;

an information unit configured and adapted to determine at least one of a position and an orientation of said eye based on said captured light; and

a scanning projection subsystem configured and adapted to display a visible image to said driver;

wherein, said visible image is indicative of at least one of navigational information and driving aid information; and

a display position of said visible image is altered based on said at least one of a determined position and a determined orientation, such that said image is perceived as essentially standing still despite movement of said eye.

16. The information system of claim 15, wherein said scanning projection unit comprises a deflection mirror.

17. The information system of claim 16, wherein said deflection mirror deflects light traveling along an optical path from a light source to an eye of said vehicle driver.