Video With Map Overlay

• US 20090040305A1
• Filed: 10/13/2008
• Published: 02/12/2009
• Est. Priority Date: 08/12/2004
• Status: Active Grant

• Current Assignee: Russell Steven Krajec
• Original Assignee: Russell Steven Krajec
• Inventors: Krajec, Russell Steven
• Granted Patent: US 8,334,879 B2
• Time in Patent Office: Days
• US Class Current: 348/144
• CPC Class Codes: G06T 17/05 Geographic models
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30236 Traffic on road, railway or crossing
• CPC Class Codes: G06T 2207/30244 Camera pose
• CPC Class Codes: G06T 2207/30252 Vehicle exterior; Vicinity of vehicle
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06V 20/13 Satellite images
• CPC Class Codes: G06V 20/54 of traffic, e.g. cars on the road, trains or boats
• CPC Class Codes: H04N 5/265 Mixing

Abstract

A system and method for placing reference locators on a streaming video image taken from a camera mounted on a vehicle. Sensors monitoring the camera field of view and direction of the optical axis along with sensors monitoring the vehicle'"'"'s position are use(l to generate a video overlay having various indicia. The calculated positions of the indicia may be compared to the position of landmarks taken from the video image to compensate for any inaccuracies in the calculated position taken from the various sensors.

Claims

1. A system comprising:

a vehicle having vehicle position sensors;

a first video camera mounted to said vehicle and having camera position sensors and producing a first video feed in a first camera field of view;

a field of view calculator adapted to;

use said vehicle position sensors and said camera position sensors to produce a first calculated field of view;

determine that a first landmark is approximately located within said first camera field of view;

determine a calculated position of said first landmark within said first camera field of view;

find the actual position of said landmark within said first video feed;

compare said calculated position and said actual position of said landmark to determine a set of correction factors; and

use said correction factors to change said first calculated field of view;

an indicia generator adapted to use said first calculated field of view to produce at least one indicator within said first camera field of view;

a video display adapted to display said first video feed and said indicator.

2. The system of claim 1 wherein said landmark comprises a stationary object.

3. The system of claim 1 wherein said landmark comprises a movable object.

4. The system of claim 3 wherein said landmark comprises a second vehicle having a set of second vehicle sensors in communication with said field of view calculator.

5. The system of claim 1 wherein said vehicle is one of a group comprising an air-craft, a land vehicle, and a watercraft.

6. The system of claim 1 wherein said vehicle position sensors comprises at least one from a group comprising a global positioning system receiver, an altimeter, a compass, and a gyroscope.

7. The system of claim 1 wherein said camera position sensors comprises at least one from a group comprising a roll sensor, a pitch sensor, a yaw sensor, and a zoom sensor.

8. The system of claim 1 wherein said indicia comprises at least one from a group comprising latitude and longitude coordinates, a street name, a building address, a building name, and a vehicle.

9. A method comprising:

generating a first video stream from a vehicle;

determining the position of said vehicle;

determining the optical axis of said first video stream and a first field of view;

determining a first calculated field of view from said position of said vehicle and said first field of view;

calculating the position of an indicator using said first calculated field of view;

generating an image of said indicator;

displaying said image of said indicator with said first video stream;

determining that a first landmark is approximately located within the first field of view;

determining a calculated position of said first landmark within said first field of view;

finding the actual position of said landmark within said first video feed;

comparing said calculated position and said actual position of said landmark to determine a set of correction factors; and

using said correction factors to change said first calculated field of view.

10. The method of claim 9 wherein said landmark comprises a stationary object.

11. The method of claim 9 wherein said landmark comprises a movable object.

12. The method of claim 11 wherein said landmark comprises a second vehicle having a set of second vehicle sensors in communication with said field of view calculator.

13. The method of claim 9 wherein said vehicle is one from a group comprising an air-craft, a land vehicle, and a watercraft.

14. The method of claim 9 wherein said determining the position of said vehicle comprises at least one output from a group comprising a global positioning system receiver, an altimeter, a compass, and a gyroscope.

15. The method of claim 9 wherein said determining the optical axis of said first video stream and the first field of view comprises at least one output from a group comprising a roll sensor, a pitch sensor, a yaw sensor, and a zoom sensor.

16. The method of claim 9 wherein said indicator comprises at least one from a group comprising latitude and longitude coordinates, a street name, a building address, a building name, and a vehicle.