METHODS AND SYSTEMS FOR GENERATING ROUTE DATA

• US 20170122762A1
• Filed: 06/12/2015
• Published: 05/04/2017
• Est. Priority Date: 06/13/2014
• Status: Active Grant

• Current Assignee: Tomtom Global Content B.V (TomTom NV)
• Original Assignee: TomTom International BV (TomTom NV)
• Inventors: van der Molen, Henk, Trum, Jeroen, van den Brand, Jan Willem
• Granted Patent: US 10,768,006 B2
• Time in Patent Office: Days
• CPC Class Codes: G01C 21/3602 Input other than that of destination using image analysis, e.g. detection of road signs, lanes, buildings, real preceding vehicles using a camera
• CPC Class Codes: G01C 21/3676 Overview of the route on the road map
• CPC Class Codes: G01S 19/01 Satellite radio beacon positioning systems transmitting time-stamped messages, e.g. GPS [Global Positioning System], GLONASS [Global Orbiting Navigation Satellite System] or GALILEO
• CPC Class Codes: G06F 16/29 Geographical information databases
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 20/588 Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
• CPC Class Codes: G09B 29/106 using electronic means

Abstract

A device is provided to extract scan lines data from images of a route, said scan line data comprising only a portion of the an image that extends along a scan line, and to store this data in memory together with respective positional data pertaining to the position of the device traveling along the route in a navigable network. This scan line and positional data can be obtained from a plurality of devices in a network and transmitted to computing apparatus, for example, for use in a production of a realistic view of a digital map.

Claims

1. A method of continuously generating route data, comprising:

receiving a position data feed pertaining to a position of an image capturing device travelling along a route in a navigable network;

receiving images of the route captured using the image capturing device as it progresses along the route so as to obtain a view of the route;

extracting scan line data from said images, said scan line data for an image comprising a linear portion of the image of a predetermined width that extends along a scan line of a predetermined shape; and

storing said scan line data in memory together with respective positional data for the scan line, wherein said positional data is based on the position data feed.

3. The method according to claim 1, comprising monitoring the position of a vanishing point in the view of the route, and arranging the scan line at a predetermined position with respect to the vanishing point.

4. The method according to claim 1, wherein the image capturing device is positioned within a vehicle, and wherein the method comprises:

monitoring a hood line corresponding to the outline of a vehicle hood in the view of the route;

monitoring the position of a vanishing point in the view of the route; and

arranging the scan line at a predetermined position with respect to the hood line and the vanishing point, such that the scan line is between the vanishing point and the hood line and does not substantially intersect the hood line.

5. The method according to claim 4, wherein monitoring a hood line comprises:

tracking one or more features shown in images of the route that move downwards between successive images of the route as the camera moves towards said features;

monitoring the lowest positions of said moving features shown in the field of view of the camera; and

determining a hood line based on said monitored lowest positions.

6. The method according to claim 3, wherein said monitoring the position of a vanishing point comprises:

monitoring first and second bearings in the direction of travel at first and second positions respectively based on the position data feed;

calculating if the device was travelling in a substantially straight line between the first and second positions in accordance with said monitored first and second bearings;

monitoring two or more straight road lines in the view of the route in the direction of travel;

calculating the intersection position for said road lines; and

,

if the device was calculated to be travelling in a substantially straight line between the first and second positions, outputting said intersection position as the vanishing point in the view of the route.

7. The method according to claim 3, wherein said predetermined position of the scan line is dynamically determined.

9. The method according to claim 1, wherein said scan line, or at least a portion thereof, is one of:

a rectangle;

a substantially horizontal straight line that extends substantially across the field of view;

an arc; and

an ellipse.

10. The method according to claim 1, wherein the images of the route are captured at a constant frame rate from a video feed obtained from the image capturing device.

12. The method according to claim 1, wherein said image capture is triggered in accordance with predetermined image capture distances along the route based on the position data feed.

13. The method according to claim 12, wherein said predetermined image capture distances are equidistant.

15. The method according to claim 1, comprising monitoring the velocity of the image capturing device in accordance with the position data feed and, if at said velocity the frame rate required to capture images of the route at said predetermined image capture distances exceeds a maximum frame rate of the camera, to obtain scan line data from one or more additional scan lines from said images, wherein the position of each additional scan line is determined so as to cover a view of the route at a predetermined image capture distance.

16. The method according to claim 1, wherein the respective positional data for the scan line data which is stored in memory accounts for the distal separation between the device itself, which is obtained from the position data feed, and the position of the route shown by the scan line.

17. The method according to claim 1, wherein said position data feed is obtained from a navigation satellite system receiver.

18. The method according to claim 1, comprising uploading said scan line data with respective positional data to one or more servers.

19. The method according to claim 1, comprising aggregating said scan lines into an overview image of the route.

20. The method according to claim 19, comprising identifying route features in the overview image, wherein said route features include one or more of:

the number of road lanes, lane guidance indicators, road works, road signs, colors, trees, tunnels, bridges and weather.

31. A non-transitory computer readable medium comprising instructions which, when executed by one or more processors of a device, cause the device to perform the method of claim 1.

2. (canceled)

8. (canceled)

11. (canceled)

14. (canceled)

21. (canceled)

22. A device for continuously generating route data, comprising at least one processor and a memory coupled to the at least one processor, wherein the at least one processor is arranged to:

receive a position data feed pertaining to a position of an image capturing device travelling along a route in a navigable network;

receive images of the route captured using the image capturing device as it progresses along the route so as to obtain a view of the route;

extract scan line data from said images, said scan line data comprising a linear portion of the image of a predetermined width that extends along a scan line of a predetermined shape; and

store said scan line data in the memory together with respective positional data for the scan line, wherein said positional data is based on the position data feed.

23. The device according to claim 22, further comprising at least one accelerometer configured to monitor a tilt of the image capturing device, and wherein the device is configured to adjust the position of the scan line in accordance with said monitored tilt.

24. The device according to claim 22, further comprising at least one accelerometer configured to detect vibrations of the camera, and wherein the device is configured to correct for artefacts in the images that result from said vibrations.

25-30. -30. (canceled)