Street level video simulation display system and method

• US 9,240,029 B2
• Filed: 04/30/2007
• Issued: 01/19/2016
• Est. Priority Date: 04/30/2007
• Status: Active Grant

• Current Assignee: HERE Global B.V. (HERE Holding Corporation)
• Original Assignee: HERE Global B.V. (HERE Holding Corporation)
• Inventors: Lynch, James, Gale, William, Kohlmeyer, Bradley
• Primary Examiner(s): Shaawat, Mussa A
• Assistant Examiner(s): KIM, KYUNG J
• Application Number:
  US11/796,899
• Publication Number:
  US 20080266324A1
• Time in Patent Office: 3,186 Days
• Field of Search: 345/634, 342/451, 701/211
• US Class Current: 1/1
• CPC Class Codes: G01C 21/20 Instruments for performing navigational calculations G01C21/24, G01C21/26 take precedence
• CPC Class Codes: G01C 21/3647 Guidance involving output of stored or live camera images or video streams
• CPC Class Codes: G06T 1/0007 Image acquisition

Abstract

A system and method are disclosed for displaying video on a computing device for navigation and other purposes. Video data is collected by traveling along roads in a geographic area and storing the video data along with data indicating the positions at which the video data had been captured. This captured video data is then used in navigation systems and other devices that provide navigation, routing, or other features. A video is presented to a user on the display of a navigation system (or other device). An application associated with the navigation system uses the previously captured video data to create the video shown to the user. The application selects that video data that shows the end user'"'"'s position from a vantage point. The application further superimposes an indication on the video at a location that corresponds to the position of the end user.

Claims

1. A method for displaying information on a computing device comprising:

determining a current position of the computing device in a vehicle being driven along a road;

selecting a video frame based on the current position of the computing device;

presenting a video including the video frame on a display of the computing device,

wherein the video presented on the display of the computing device shows the road and is entirely derived from video data that had been previously obtained from a video camera mounted to a data collection vehicle being driven along the road,

wherein no video other than video previously obtained via the data collection vehicle is presented on the display when the video is presented, the data collection vehicle different than the vehicle having the display,

wherein the video being presented on the display of the computing device has a vantage point above and behind the current position of the computing device;

superimposing an indication on the video being presented on the display of the computing device, and

wherein the indication is superimposed on the video at a location corresponding to the current position of the computing device along the road,

indicating a maneuver by associating the maneuver with the indication superimposed on the video.

2. The method of claim 1 wherein the vantage point is above and behind the current position of the computing device based on a direction of travel of the computing device along the road.

3. The method of claim 1 further comprising:

determining a direction of travel of the computing device.

4. The method of claim 1 wherein the computing device is located in a vehicle.

5. The method of claim 4 wherein the indication is in the shape of a vehicle.

6. The method of claim 4 wherein the indication is in the shape of a vehicle that matches the make, model and color of the vehicle in which the computing device is located.

7. The method of claim 1 further comprising:

prior to presenting the video on the display, transforming the video so that the vantage point appears higher than the vantage point at which the video had been obtained from a video camera mounted to the data collection vehicle.

8. The method of claim 1 wherein the computing device is carried by a pedestrian.

9. The method of claim 8 wherein the indication is in the shape of a person.

10. The method of claim 8 wherein the indication is in the shape of a person that matches the appearance of the pedestrian carrying the computing device.

11. The method of claim 1 wherein the maneuver is indicated by causing the indication superimposed on the video to perform the maneuver.

12. The method of claim 1 wherein the maneuver is indicated by causing a marking to extend from the indication superimposed on the video through the maneuver.

13. A computer-based system for displaying information for traveling comprising:

a display in a user'"'"'s vehicle;

a positioning unit configured to determine a position of the user'"'"'s vehicle and generate data indicating the position of the user'"'"'s vehicle;

video data that shows travel along a road, wherein the video data had been previously captured from a video camera on a collection vehicle being driven along the road that is different than the user'"'"'s vehicle; and

an application that selects a portion of the video data according to the data indicating the position of the user'"'"'s vehicle and uses the video data to show a video on the display and superimposes on the video an indication of the position of the user'"'"'s vehicle relative to surroundings being displayed on the video, the video shown on the display being recorded video entirely derived from the video data previously captured,

wherein no video other than video previously captured from the collection vehicle is presented on the display when the video is shown, and the video being presented on the display of the computing device has a vantage point above and behind the current position of the computing device; and

the application superimposes routing maneuverers on the video using an image corresponding to the user'"'"'s vehicle.

14. The computer-based system of claim 13 wherein the indication shows the user'"'"'s vehicle.

15. The computer-based system of claim 13 wherein the indication shows a vehicle.

16. The computer-based system of claim 13 wherein the application further indicates an upcoming maneuver by associating the maneuver with the indication.

17. The computer-based system of claim 13 wherein the application further indicates an upcoming maneuver by causing the indication to perform the maneuver on the video.

18. The computer-based system of claim 13 wherein the application further indicates an upcoming maneuver by causing markings to extend from the indication.

19. A computer-based system for displaying information for traveling comprising:

a display carried by a pedestrian user;

a positioning unit configured to determine a position of the pedestrian user;

video data that shows travel along a road, wherein the video data had been previously captured from a video camera on a vehicle being driven along the road; and

an application that uses the video data to show a video on the display and superimposes on the video an indication, in the shape of a person, of the pedestrian user'"'"'s position relative to the surrounding being displayed on the video,

wherein the video being shown is based solely on the video data previously captured, wherein no video other than video previously captured from the vehicle is presented on the display when the video is shown.

20. The computer-based system of claim 19 wherein the indication shows a pedestrian.

21. A method for displaying information on a computing device comprising:

determining a current position of the computing device in a vehicle being driven along a road;

selecting a video frame based on the current position of the computing device;

presenting a video including the video frame on a display of the computing device,

wherein the video presented on the display of the computing device shows the road and is entirely derived from video data that had been previously obtained from a video camera mounted to a data collection vehicle being driven along the road,

wherein no video other than video previously obtained via the data collection vehicle is presented on the display when the video is presented, the data collection vehicle different than the vehicle having the display,

wherein the video being presented on the display of the computing device has a vantage point above and behind the current position of the computing device; and

superimposing an indication on the video being presented on the display of the computing device,

wherein the indication is superimposed on the video at a location corresponding to the current position of the computing device along the road,

wherein the computing device is carried by a pedestrian and the indication is in the shape of a person.