ESTIMATING DISTANCE TO AN OBJECT USING A SEQUENCE OF IMAGES RECORDED BY A MONOCULAR CAMERA

• US 20120200707A1
• Filed: 04/23/2012
• Published: 08/09/2012
• Est. Priority Date: 01/04/2006
• Status: Active Grant

• Current Assignee: MobilEye Vision Technologies Ltd. (Intel Corporation)
• Original Assignee: Mobileye Technologies Limited (Intel Corporation)
• Inventors: Avni, Ofer, Stein, Gideon P., Ferencz, Andras D.
• Granted Patent: US 9,223,013 B2
• Time in Patent Office: Days
• US Class Current: 348/148
• CPC Class Codes: B60R 11/04 Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
• CPC Class Codes: B60R 2001/1253 with cameras, video cameras or video screens
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/802 for monitoring and displaying vehicle exterior blind spot views
• CPC Class Codes: B60R 2300/8093 for obstacle warning
• CPC Class Codes: G01B 11/026 by measuring distance between sensor and object G01B11/0608 takes precedence
• CPC Class Codes: G01B 11/14 for measuring distance or clearance between spaced objects or spaced apertures G01B11/26 takes precedence; rangefinders G01C3/00
• CPC Class Codes: G01C 22/00 Measuring distance traversed on the ground by vehicles, persons, animals or other moving solid bodies, e.g. using odometers, using pedometers
• CPC Class Codes: G01C 3/00 Measuring distances in line of sight; Optical rangefinders tapes, chains or wheels for measuring length G01B3/00; active triangulation systems, i.e. using the transmission and reflection of electromagnetic waves other than radio waves, G01S17/48
• CPC Class Codes: G01C 3/22 using a parallactic triangle with variable angles and a base of fixed length at, near, or formed by the object
• CPC Class Codes: G01S 11/12 using electromagnetic waves other than radio waves
• CPC Class Codes: G01S 17/93 for anti-collision purposes
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/20024 Filtering details
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 2207/30252 Vehicle exterior; Vicinity of vehicle
• CPC Class Codes: G06T 2207/30256 Lane; Road marking
• CPC Class Codes: G06T 2207/30261 Obstacle
• CPC Class Codes: G06T 7/55 from multiple images
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads

Abstract

A method for monitoring headway to an object performable in a computerized system including a camera mounted in a moving vehicle. The camera acquires in real time multiple image frames including respectively multiple images of the object within a field of view of the camera. An edge is detected in the images of the object. A smoothed measurement is performed of a dimension the edge. Range to the object is calculated in real time, based on the smoothed measurement.

Claims

1. A method for monitoring headway to an object, the method performable in a computerized system including a camera mounted in a moving vehicle, wherein A processor acquires in real time a plurality of image frames including respectively a plurality of images of the object within a field of view of the camera, the method comprising the steps of:

detecting in at least two image frames at least one edge in the respective images of the object;

based on said detecting, performing a smoothed measurement of a dimension of said at least one edge; and

calculating range of the object in real time, based on said smoothed measurement.

2. The method, according to claim 1, wherein said detecting is performed at sub-pixel accuracy.

3. The method, according to claim 1, wherein the range is determined solely from information derived from the images.

4. The method, according to claim 1, wherein said dimension is a real dimension of said object.

5. The method, according to claim 1, wherein said calculating includes calculating recursively said dimension using a Kalman filter.

6. The method, according to claim 1, wherein the object is a second vehicle and wherein said dimension is a width as measured in images of said second vehicle.

7. The method, according to claim 1, wherein the object is a pedestrian and wherein said dimension is a height of said pedestrian.

8. The method, according to claim 1, further comprising:

detecting at least one horizontal edge in each of said images;

detecting two vertical edges based on end points of said at least one horizontal edge; and

detecting a lower edge, by detecting respective lower ends of said two vertical edges, wherein said dimension is a width measured between said lower ends.

9. The method, according to claim 8, wherein said (i) detecting at least one horizontal edge is performed by mapping grayscale levels of a plurality of pixels in at least one of said image frames, thereby classifying each of said picture elements as imaging a portion of a road surface or not imaging a portion of a road surface.

10. The method, according to claim 8, wherein said lower edge coincides with a portion of an image of a road surface, whereby said lower edge is a bottom edge.

11. The method, according to claim 8, wherein a height of said lower edge is determined based on at least one imaged feature selected from the group consisting of:

an image of a shadow on a road surface and an image of self-illumination of the object on a road surface.

12. The method, according to claim 1, whereby said calculating the range is dependent on an imaged height of the horizon, further comprising the step of:

locating said imaged height of the horizon.

13. The method, according to claim 12, wherein said locating is refined by at least one technique selected from the group consisting of:

(i) measuring the shape of the imaged road,

(ii) detecting the vanishing point from at least one road marking selected from the group consisting of;

lane structure, lane marking, and horizontal line marking;

(iii) detecting relative motion of imaged points and velocity of the moving vehicle,

(iv) compensating for pitch angle variations of the camera, and

(v) detecting ego motion of the camera.

14. A computerized system including a camera mountable in a moving vehicle, wherein the camera acquires in real time a plurality of image frames including respectively a plurality of images of an object within a field of view of the camera, wherein the computerized system performs the method steps of claim 1.

15. A computerized system including a camera mountable in a moving vehicle, wherein the camera acquires in real time a plurality of image frames including respectively a plurality of images of an object within a field of view of the camera, wherein the system is configured to monitor headway in real time to the object, the system comprising:

a detection mechanism adapted for detection of at least one edge in respective images of the object in at least two of the image frames; and

a processor adapted to perform a smoothed measurement of a dimension of said at least one edge based on said detection, wherein said processor is adapted to calculate range to the object based on said smoothed measurement.

16. The computerized system, according to claim 15, wherein said object is selected from the group consisting of:

pedestrian, motorcycle, automotive vehicle, animal and bicycle.

17. The computerized system, according to claim 15, wherein said measurement mechanism is adapted to perform sub-pixel measurements on said image frames.

18. A method for monitoring headway to an object, the method performable in a computerized system including a camera mounted in a moving vehicle, wherein the camera acquires an image frame including an image of the object within a field of view of the camera, the method comprising

detecting a horizontal edge of the image of the object to sub-pixel accuracy by classifying the picture elements in the image frame as either imaging a portion of a road surface or not imaging a portion of a road surface;

locating in the image frame an imaged height of the horizon; and

determining said headway from the vertical position of said horizontal edge relative to the imaged height of the horizon.