Methods and Apparatus for Integrated Forward Display of Rear-View Image and Navigation Information to Provide Enhanced Situational Awareness

• US 20160110615A1
• Filed: 11/12/2015
• Published: 04/21/2016
• Est. Priority Date: 10/20/2014
• Status: Abandoned Application

• Current Assignee: New Skully, Inc.
• Original Assignee: Skully Inc.
• Inventors: Weller, Marcus Daniel, Weller, Mitchell Ryan
• Application Number:
  US14/940,006
• Publication Number:
  US 20160110615A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: A42B 3/0426 Rear view devices or the like
• CPC Class Codes: B60R 1/001 integrated in the windows, e.g. Fresnel lenses
• CPC Class Codes: B60R 1/26 to the rear of the vehicle
• CPC Class Codes: B60R 2300/10 characterised by the type of camera system used
• CPC Class Codes: B60R 2300/205 using a head-up display
• CPC Class Codes: B60R 2300/207 using multi-purpose displays, e.g. camera image and navigation or video on same display
• CPC Class Codes: B60R 2300/302 combining image information with GPS information or vehicle data, e.g. vehicle speed, gyro, steering angle data
• CPC Class Codes: B60R 2300/802 for monitoring and displaying vehicle exterior blind spot views
• CPC Class Codes: G02B 2027/011 comprising device for correcting geometrical aberrations, distortion
• CPC Class Codes: G02B 2027/0118 comprising devices for improving the contrast of the display / brillance control visibility
• CPC Class Codes: G02B 2027/0127 comprising devices increasing the depth of field
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0141 characterised by the informative content of the display
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G02B 27/0103 comprising holographic elements
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06V 20/56 : exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: H04N 23/698 : for achieving an enlarged field of view, e.g. panoramic image capture

Abstract

A situational awareness system is disclosed herein for providing heads-up display to a user on a moving vehicle. The display is focused at an ocular infinity in order to prevent accommodation lag in the user'"'"'s comprehension. A super wide-angle (e.g., 170 degree to 210 degree) rear-view camera provides rearward looking video imagery to the user, which may be digitally processed and enhanced. Additional information is optionally provided in the display, including maps, turn by turn directions, and visual indicators guiding the user for forward travel. Additional information is optionally provided by audio. One embodiment comprises a full-face motorcycle helmet with a see-through micro-display that projects a virtual image in-line with the helmet-wearer'"'"'s field of view. A second embodiment comprises a unit that projects a virtual image on a windshield in the operator'"'"'s field of view.

Claims

1. A method of displaying information to a user facing a forward direction, the method comprising:

capturing image data from a rear-pointing camera, the image data associated with a rear-view direction, wherein the rear-view direction is approximately opposite the forward direction;

generating, using one or more processors, a video signal based on the image data associated with the rear-view direction;

communicating, using the one or more processors, the video signal to a display device contained in a helmet; and

displaying, on the display device, the video signal such that the user can view the video signal while facing the forward direction.

2. The method of claim 1, further comprising:

accessing navigation information from a navigation system; and

displaying at least a portion of the navigation information on the display device.

3. The method of claim 2, wherein the navigation information includes turn-by-turn directions for forward travel.

4. The method of claim 3, wherein the turn-by-turn directions include an iconic turn indicator and associated words describing an upcoming turn.

5. The method of claim 1, further comprising:

accessing vehicle status information from a vehicle; and

displaying at least a portion of the vehicle status information on the display device.

6. The method of claim 1, further comprising:

accessing vehicle telemetry information associated with a vehicle; and

displaying at least a portion of the vehicle telemetry information on the display device.

7. The method of claim 1, further comprising:

accessing navigation information from a navigation system;

generating a blended video stream that includes the video signal based on the image data associated with the rear-view direction and at least a portion of the navigation information; and

displaying the blended video stream on the display device.

8. The method of claim 7, wherein generating the blended video stream further includes adding iconic turn indicator instructions to the video signal.

9. The method of claim 7, wherein generating the blended video stream further includes adding words describing an upcoming turn to the video signal.

10. The method of claim 1, wherein the display device is a heads-up display mounted to the helmet.

11. The method of claim 1, further comprising dewarping the image data captured from the rear-pointing camera.

12. The method of claim 11, wherein dewarping the image data captured from the rear-pointing camera transforms the image data to provide equal angles of view mapped into equal linear distances in the display.

13. The method of claim 1, further comprising enhancing the image data from the rear-pointing camera to compensate for fog or low light conditions.

14. The method of claim 1, further comprising enhancing the image data from the rear-pointing camera to increase the saliency of certain image components.

15. The method of claim 1, wherein generating the video signal further comprises focusing the video signal at an ocular infinity.