BIRDS EYE VIEW VIRTUAL IMAGING FOR REAL TIME COMPOSITED WIDE FIELD OF VIEW

• US 20140285516A1
• Filed: 06/10/2014
• Published: 09/25/2014
• Est. Priority Date: 08/09/2003
• Status: Abandoned Application

• Current Assignee: Doubleshot, Inc.
• Original Assignee: Doubleshot, Inc.
• Inventors: SHULMAN, Alan, SNYDER, Donald R. III
• Application Number:
  US14/300,741
• Publication Number:
  US 20140285516A1
• Time in Patent Office: Days
• US Class Current: 345/629
• CPC Class Codes: G01C 21/3647 Guidance involving output of stored or live camera images or video streams
• CPC Class Codes: G06F 16/51 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 3/40 Scaling of whole images or parts thereof, e.g. expanding or contracting

Abstract

A live image and a previously acquired or generated image are superimposed or composited to represented a virtual vantage point for flying, driving or navigating a plane, vehicle or vessel.

Claims

1-2. -2. (canceled)

3. A method for displaying a composite image by combining a live image and a previously acquired image, the method comprising the steps of:

acquiring a first image from an image acquisition device;

retrieving a second image from an image database;

generating a first vantage point image by compressing the bottom row of the first image and compressing each higher row of the first image to an equal or progressively lesser extent;

generating a second vantage point image by compressing the bottom row of the second image and compressing each higher row of the second image to an equal or progressively lesser extent;

scaling at least one of the first vantage point image or the second vantage point image; and

creating a composite image by combining the first vantage point image and the second vantage point image.

4. The method of claim 0, wherein the image acquisition device is a first image acquisition device, and the image database contains images acquired from a second image acquisition device.

5. The method of claim 0, wherein the composite image represents a view of an intended driving path of a vehicle.

6. The method of claim 5, wherein the composite image comprises a projection of the intended driving path.

7. The method of claim 5, wherein the composite image comprises a simulated image of the vehicle.

8. The method of claim 0, wherein:

the first image is acquired from a first point of view,

the second image is acquired from a second point of view,

a scaling factor corresponds to a y axis displacement between the first point of view and a second point of view, and

the scaling of the at least one of the first vantage point image or the second vantage point image is performed according to the scaling factor.

9. The method of claim 8, wherein the y axis displacement is determined using GPS coordinates.

10. A system for displaying a composite image by combining a live image and a previously acquired image, comprising the steps of:

an image acquisition device for acquiring a first image;

an image database;

one or more processors configured to;

receive the first image from the image acquisition device;

retrieve a second image from the image database;

generate a first vantage point image by compressing the bottom row of the first image and compressing each higher row of the first image to an equal or progressively lesser extent;

generate a second vantage point image by compressing the bottom row of the second image and compressing each higher row of the second image to an equal or progressively lesser extent;

scale at least one of the first vantage point image or the second vantage point image; and

create a composite image by combining the first vantage point image and the second vantage point image; and

one or more displays for displaying the composite image.

11. The system of claim 10, wherein the image acquisition device is a first image acquisition device, and the image database contains images acquired from a second image acquisition device.

12. The system of claim 10, wherein the composite image represents a view of an intended driving path of a vehicle.

13. The system of claim 12, wherein displaying the composite image comprises displaying a projection of the intended driving path.

14. The system of claim 12, wherein displaying the composite image comprises displaying a simulated image of the vehicle.

15. The system of claim 10, wherein:

the first image is acquired from a first point of view,

the second image is acquired from a second point of view,

a scaling factor corresponds to a y axis displacement between the first point of view and a second point of view, and

the scaling of the at least one of the first vantage point image or the second vantage point image is performed according to the scaling factor.

16. The system of claim 15, wherein the y axis displacement is determined using GPS coordinates.

17. A non-transitory computer-readable medium containing instructions for performing a method of displaying a composite image by combining a live image and a previously acquired image, the method comprising the steps of:

acquiring a first image from an image acquisition device;

retrieving a second image from an image database;

generating a first vantage point image by transforming the first image, wherein transforming the first image comprises compressing the bottom row and compressing each higher row to an equal or progressively lesser extent;

generating a second vantage point image by transforming the second image, wherein transforming the second image comprises compressing the bottom row and compressing each higher row to an equal or progressively lesser extent;

scaling at least one of the first vantage point image or the second vantage point image; and

creating a composite image by combining the first vantage point image and the second vantage point image.

18. The medium of claim 17, wherein the image acquisition device is a first image acquisition device, and the image database contains images acquired from a second image acquisition device.

19. The medium of claim 17, wherein the composite image represents a view of an intended driving path of a vehicle.

20. The medium of claim 19, wherein the composite image comprises a projection of the intended driving path.

21. The medium of claim 19, wherein the composite image comprises a simulated image of the vehicle.

22. The medium of claim 17, wherein:

the first image is acquired from a first point of view,

the second image is acquired from a second point of view,

a scaling factor corresponds to a y axis displacement between the first point of view and a second point of view, and

the scaling of the at least one of the first vantage point image or the second vantage point image is performed according to the scaling factor.