CROWDSOURCING THE COLLECTION OF ROAD SURFACE INFORMATION

• US 20180025235A1
• Filed: 07/21/2017
• Published: 01/25/2018
• Est. Priority Date: 07/21/2016
• Status: Active Grant

• Current Assignee: MobilEye Vision Technologies Ltd. (Intel Corporation)
• Original Assignee: MobilEye Vision Technologies Ltd. (Intel Corporation)
• Inventors: Fridman, Ofer
• Granted Patent: US 10,962,982 B2
• Time in Patent Office: Days
• CPC Class Codes: B60W 2420/403 Image sensing, e.g. optical camera
• CPC Class Codes: B60W 2552/10 Number of lanes
• CPC Class Codes: B60W 2552/25 Road altitude
• CPC Class Codes: B60W 2552/30 Road curve radius
• CPC Class Codes: B60W 2552/35 Road bumpiness, e.g. potholes
• CPC Class Codes: B60W 2552/50 Barriers
• CPC Class Codes: B60W 2552/53 Road markings, e.g. lane marker or crosswalk
• CPC Class Codes: B60W 2554/20 Static objects
• CPC Class Codes: B60W 2554/4026 Cycles
• CPC Class Codes: B60W 2554/4029 Pedestrians
• CPC Class Codes: B60W 2554/4041 Position
• CPC Class Codes: B60W 2554/60 Traversable objects, e.g. speed bumps or curbs
• CPC Class Codes: B60W 2554/802 Longitudinal distance
• CPC Class Codes: B60W 2554/804 Relative longitudinal speed
• CPC Class Codes: B60W 60/0016 of the vehicle or its occupants
• CPC Class Codes: G01C 21/28 with correlation of data from several navigational instruments
• CPC Class Codes: G01C 21/3822 Road feature data, e.g. slope data
• CPC Class Codes: G01C 21/3848 Data obtained from both position sensors and additional sensors
• CPC Class Codes: G01C 21/3852 Data derived from aerial or satellite images
• CPC Class Codes: G05D 1/0231 using optical position detecting means position-fixing by using electromagnetic waves other than radio waves, e.g. optical position detecting means G01S5/16
• CPC Class Codes: G05D 1/0246 : using a video camera in combination with image processing means
• CPC Class Codes: G05D 1/0251 : extracting 3D information from a plurality of images taken from different locations, e.g. stereo vision stereoscopic image analysis H04N13/00; depth recovery from images G06T7/593
• CPC Class Codes: G05D 1/0274 : using mapping information stored in a memory device navigation using map-matching G01C21/30
• CPC Class Codes: G05D 1/0278 : using satellite positioning signals, e.g. GPS
• CPC Class Codes: G06T 11/60 : Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 2207/10024 : Color image
• CPC Class Codes: G06T 2207/10032 : Satellite or aerial image; Remote sensing
• CPC Class Codes: G06T 2207/30256 : Lane; Road marking
• CPC Class Codes: G06T 7/11 : Region-based segmentation
• CPC Class Codes: G06T 7/12 : Edge-based segmentation
• CPC Class Codes: G06T 7/337 : involving reference images or patches
• CPC Class Codes: G06T 7/37 : using transform domain methods
• CPC Class Codes: G06T 7/70 : Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06T 7/74 : involving reference images or patches
• CPC Class Codes: G06V 20/56 : exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: G06V 20/588 : Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
• CPC Class Codes: G08G 1/096708 : where the received information might be used to generate an automatic action on the vehicle control
• CPC Class Codes: G08G 1/096725 : where the received information generates an automatic action on the vehicle control
• CPC Class Codes: H04N 13/239 : using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 2013/0081 : Depth or disparity estimation from stereoscopic image signals
• CPC Class Codes: H04N 23/90 : Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 7/18 : Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

Systems and methods are provided for crowdsourcing road surface information collection. In one implementation, a method of collecting road surface information for a road segment may include receiving at least one image representative of a portion of the road segment, identifying in the at least one image at least one road surface feature along the portion of the road segment, determining a plurality of locations associated with the road surface feature according to a local coordinate system of the vehicle, and transmitting the determined plurality of locations from the vehicle to a server. The determined locations may be configured to enable determination by the server of a line representation of the road surface feature extending along the road segment.

Claims

1. A system for collecting road surface information for a road segment, the system comprising:

at least one processing device configured to;

receive, from a camera, at least one image representative of a portion of the road segment;

identify in the at least one image at least one road surface feature along the portion of the road segment;

determine a plurality of locations associated with the road surface feature according to a local coordinate system of the vehicle; and

transmit the determined plurality of locations from the vehicle to a server, wherein the determined locations are configured to enable determination by the server of a line representation of the road surface feature extending along the road segment, the line representation representing a path along the road segment substantially corresponding with the road surface feature.

2. The system of claim 1, wherein the at least one road surface feature includes a road edge.

3. The system of claim 1, wherein the at least one road surface feature includes a lane marking.

4. The system of claim 1, wherein the at least one processing device is further configured to receive, from the server, the line representation.

5. The system of claim 4, wherein the at least one processing device is further configured to overlay the line representation of the road surface feature on at least one geographical image.

6. The system of claim 5, wherein the geographical image is a satellite image.

7. A method of collecting road surface information for a road segment, the method comprising:

receiving, from a camera, at least one image representative of a portion of the road segment;

identifying in the at least one image at least one road surface feature along the portion of the road segment;

determining a plurality of locations associated with the road surface feature according to a local coordinate system of the vehicle; and

transmitting the determined plurality of locations from the vehicle to a server, wherein the determined locations are configured to enable determination by the server of a line representation of the road surface feature extending along the road segment, the line representation representing a path along the road segment substantially corresponding with the road surface feature.

8. The method of claim 7, wherein the at least one road surface feature includes a road edge.

9. The method of claim 7, wherein the at least one road surface feature includes a lane marking.

10. The method of claim 7, further comprising receiving, from the server, the line representation.

11. The method of claim 10, further comprising overlaying the line representation of the road surface feature on at least one geographical image.

12. The method of claim 12, wherein the geographical image is a satellite image.

13. A non-transitory, computer-readable medium storing instructions that, when executed by at least one processing device, cause the device to:

receive, from a camera, at least one image representative of a portion of the road segment;

identify in the at least one image at least one road surface feature along the portion of the road segment;

determine a plurality of locations associated with the road surface feature according to a local coordinate system of the vehicle; and

transmit the determined plurality of locations from the vehicle to a server, wherein the determined locations are configured to enable determination by the server of a line representation of the road surface feature extending along the road segment, the line representation representing a path along the road segment substantially corresponding with the road surface feature.

14. The non-transitory, computer-readable medium of claim 13, wherein the at least one road surface feature includes a road edge.

15. The non-transitory, computer-readable medium of claim 13, wherein the at least one road surface feature includes a lane marking.

16. The non-transitory, computer-readable medium of claim 13, wherein the at least one processing device is further programmed to receive, from the server, the line representation.

17. The non-transitory, computer-readable medium of claim 16, wherein the at least one processing device is further programmed to overlay the line representation of the road surface feature on at least one geographical image.

18. The non-transitory, computer-readable medium of claim 17, wherein the geographical image is a satellite image.