Vehicle navigation methods, systems and computer program products

• US 10,336,462 B2
• Filed: 01/12/2016
• Issued: 07/02/2019
• Est. Priority Date: 03/12/2015
• Status: Active Grant

• Current Assignee: Vu Systems, LLC
• Original Assignee: Vu Systems, LLC
• Inventors: Connor, Sidney A., Stevens, J. Stedman
• Primary Examiner(s): Brown, Jr., Howard D
• Application Number:
  US14/993,536
• Publication Number:
  US 20160264255A1
• Time in Patent Office: 1,267 Days
• CPC Class Codes: B64D 43/00 Arrangements or adaptations of instruments arrangements of cameras B64D47/08; aeronautical measuring instruments per se G01C
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0147 comprising a device modifying the resolution of the displayed image
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 5/77 between a recording apparatus and a television camera

Abstract

Vehicle navigation methods, systems and computer program products are provided that create a composite video image of a scene from video images of the scene generated by a plurality of video image sensors. The video image from each image sensor includes a respective array of pixels. The composite video image is created by selecting for a composite image pixel at a given position in an array of composite image pixels a pixel at the given position from one of the respective pixel arrays having the highest signal level or highest signal-to-noise ratio. The selecting is repeatedly performed for a plurality of given positions in the array of composite image pixels. The composite video image can be displayed via a display, such as a head-up display utilized in a vehicle.

Claims

1. A method for creating a video image, comprising:

receiving a video image from each of a plurality of video image sensors, wherein at least one of the plurality of video image sensors is mounted to a vehicle;

combining the plurality of video images according to an algorithm to produce an output video image; and

adjusting the algorithm based on at least one of;

a height of the vehicle above ground or water;

a depth of the vehicle below water;

a geographic location of the vehicle;

an absolute or relative quality or characteristic of at least one of the plurality of video sensors;

an absolute or relative quality or characteristic or at least one of the video images; and

a speed, heading, or attitude of the vehicle.

4. The method of claim 1, wherein the algorithm is further adjusted responsive to user input and/or responsive to user preference.

5. The method of claim 1, wherein each pixel of the output video image is selected from a video image of the plurality of video images having a pixel with a best signal level or signal-to-noise ratio (SNR) compared to a corresponding pixel of other video images of the plurality of video images.

6. The method of claim 1, wherein the vehicle is an aircraft.

2. A method for creating a video image, comprising:

receiving a video image from each of a plurality of video image sensors, wherein at least one of the plurality of video image sensors is mounted to a vehicle;

combining the plurality of video images according to an algorithm to produce an output video image; and

adjusting the algorithm based on a state or condition of the vehicle via at least one of the following;

modifying a coefficient of the algorithm;

adding, subtracting, or modifying a term of the algorithm;

changing the algorithm;

performing a plurality of different algorithms and either;

selecting the output of one the plurality of algorithms;

or

combining the outputs of at least two of the plurality of algorithms.

7. The method of claim 2, wherein the algorithm is further adjusted responsive to user input and/or responsive to user preference.

8. The method of claim 2, wherein each pixel of the output video image is selected from a video image of the plurality of video images having a pixel with a best signal level or signal-to-noise ratio (SNR) compared to a corresponding pixel of other video images of the plurality of video images.

9. The method of claim 2, wherein the vehicle is an aircraft.

3. A method for creating a video image, comprising:

receiving a video image from each of a plurality of video image sensors, wherein at least one of the plurality of video image sensors is mounted to a vehicle;

pre-enhancing at least one of the plurality of video images comprising applying a super-resolution technique to the at least one of the plurality of video images to increase a resolution thereof; and

combining the plurality of video images to produce an output video image.