Apparatus and method for measuring distances

• US 20020134151A1
• Filed: 02/05/2001
• Published: 09/26/2002
• Est. Priority Date: 02/05/2001
• Status: Abandoned Application

• Current Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation)
• Original Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation)
• Inventors: Yamaoka, Megumi, Nagao, Kenji, Naruoka, Tomonobu, Shimano, Mihoko
• Application Number:
  US09/775,567
• Publication Number:
  US 20020134151A1
• Time in Patent Office: Days
• US Class Current: 73/291
• CPC Class Codes: G01S 11/12 using electromagnetic waves other than radio waves
• CPC Class Codes: G06T 7/50 Depth or shape recovery
• CPC Class Codes: G06T 7/74 involving reference images or patches
• CPC Class Codes: G08G 1/166 for active traffic, e.g. moving vehicles, pedestrians, bikes
• CPC Class Codes: G08G 1/167 Driving aids for lane monitoring, lane changing, e.g. blind spot detection

Abstract

The present invention detects distances between cars through image processing. A car ahead is detected from an image taken by one camera and a relative positional relation between the detected vehicle and road edges is detected. On the other hand, a three-dimensional road structure is reconstructed from the image taken by one camera. Then, taking into account the relative positional relation in the image between the vehicle and road edges, the position of the vehicle on the reconstructed three-dimensional road structure is determined. Then, the distance from the camera to the vehicle in the real space is measured through arithmetic operations. By focusing the range of performing image processing in one image, it is possible to reduce the amount of data handled.

Claims

1. A distance measuring method comprising:

a first step of detecting an object that exists at the edges of a road or on the road from an image input from one camera, detecting the detected position of said object in said image and detecting a relative positional relation between said object and said edges of the road;

a second step of detecting a three-dimensional road structure from said image;

a third step of determining the position of said object on said three-dimensional road structure based on a relative positional relation between the object in said image and the road edges; and

a fourth step of calculating the distance from said one camera to said object in the real space.

2. The distance measuring method according to claim 1, wherein said first step comprising the steps of:

detecting a target object from images taken by one camera;

designating a representative point of the detected object as a coordinate point indicating the position of the object;

detecting a shortest line segment from among the line segments that pass said coordinate point of the object and connect the right and left edges of the road in said image;

detecting edge points at which said detected line segment crosses the right and left edges of the road; and

determining the position of said coordinate point of the object on said detected line segment, and

said third step comprising the steps of;

detecting two points corresponding to said edge points on the reconstructed road structure; and

determining a coordinate point corresponding to said coordinate point of the object on said detected line segment connecting the two points, that is, the coordinate point of the object in the real space.

3. The distance measuring method according to claim 1, wherein the processing in said first step of detecting an object that exists on said road comprising the steps of:

extracting the amount of features of the object from said image; and

comparing said extracted amount of features and the amount of features of a plurality of learning images registered beforehand, determining the learning image most resembling said features of the object and thereby detecting that an object identical to the learning image exists on said road.

4. The distance measuring method according to claim 3, wherein said amount of features of the object is expressed by at least one of the length of each of a plurality of straight lines extracted from a differential binary image of the object, symmetry of each straight line and positional relation of each straight line.

5. The distance measuring method according to claim 1, wherein the processing in said first step of detecting the detected position of said object in the image comprises a step of comparing said image and a plurality of learning images registered beforehand, determining the area most resembling at least one of said plurality of learning images and determining the determined area as the area in which an object identical to the object of the learning image exists.

6. The distance measuring method according to claim 5, wherein said plurality of learning images includes a plurality of images obtained by taking pictures of one object at different distances.

7. The distance measuring method according to claim 1, wherein said second step of detecting a three-dimensional road structure from said image comprising the steps of:

detecting the positions of the corresponding right and left road edge points in said image; and

determining the positions of the road edge points in the real space corresponding to said right and left road edge points in said image and detecting the three-dimensional structure of the road from the loci of the road edge points in the real space.

8. A distance measuring method comprising:

a first step of detecting an object that exists at the edges of a road or on the road from images input from one camera that consecutively takes pictures in the direction opposite to the direction in which the car is headed, detecting the position of said detected object in said image and detecting a relative positional relation between said object and said edges of the road;

a second step of detecting a three-dimensional road structure from said image;

a third step of determining the position of said object on said three-dimensional road structure based on a relative positional relation between the object in said image taken by said one camera and the road edges; and

a fourth step of calculating the distance from said one camera to said object in the real space,

wherein said second step comprising the steps of;

assuming that the road is horizontal at locations sufficiently close to said one camera, measuring the distance from said one camera to road edges located within the range sufficiently close to the camera and thereby detecting the positions of the road edge points in the image, determining the positions of the road edge points in the real space corresponding to the detected road edge points and continuing such processing, and

on the other hand, acquiring information on the amount of movement of the own car in the real space from a past reference time point to the present moment from a sensor mounted on the own car, connecting the road edge points in the real space corresponding to said past reference time point and the road edge points in the real space corresponding to said present moment based on said information of the amount of movement acquired from said sensor, repeating such connection processing and thereby reconstructing a three-dimensional road structure.

9. A distance measuring apparatus comprising:

an object position detection section that detects an object that exists at the edges of a road or on the road from an image input from one camera, detects the position of the detected position of said object in said image and detects a relative positional relation between said object and said edges of the road;

a road structure detection section that detects a three-dimensional road structure from said image; and

a distance calculation section that determines the position of said object on said three-dimensional road structure based on a relative positional relation between the object in said image and the road edges and calculates the distance from said one camera to said object in the real space.

10. A distance measuring method comprising the steps of:

focusing the range of searching an object based on an image input from a car-mounted camera on an area in which said object is likely to exist;

detecting the position of said object in said image within said search range; and

calculating the distance to said vehicle in the real space based on the detected position of said object.

11. A distance measuring method comprising the steps of:

detecting the right and left edges of a road on which an object exists based on an image input from a car-mounted camera and focusing the range of searching the object taking into account the detected positions of the road edges and height of said object;

detecting the position of said object in said image within said focused search range; and

calculating the distance to said vehicle in the real space based on the detected position of said object.

12. The distance measuring method according to claim 11, wherein the area of a rectangle is determined taking into account the positions of said right and left road edges and the height of said object and the coordinates of the vertices in the rectangular area are used as the information to determine the search range.

13. The distance measuring method according to claim 11, wherein when the search range is focused, the degree of focusing of the search range can be regulated by specifying parameters.

14. The distance measuring method according to claim 11, wherein the area on the road in which an object exists is determined using an optical flow method and the area is used as the search range.

15. The distance measuring method according to claim 11, wherein the area on the road plane in which a vehicle exists is determined using stereoscopic images and this area is used as the search range.

16. The distance measuring method according to claim 11, wherein a combination of the area on the road in which a mobile object exists determined using an optical flow method and the area on the road in which the object exists determined using stereoscopic images is used as the search range.

17. The distance measuring method according to claim 11, wherein the processing of detecting the position of the object in the image includes a step of comparing said image and a plurality of learning images registered beforehand, determining the area most resembling said at least one of said plurality of learning images in said image and thereby determining the determined area as the area in which an object identical to the object of the learning image exists.

18. The distance measuring method according to claim 11, wherein the distance to the vehicle in the real space is determined using stereoscopic images based on the position of the detected object.

19. The distance measuring method according to claim 11, wherein the distance to the vehicle in the real space is determined using the detected position of the vehicle in the image and the one-dimensional shape of the road.

20. The distance measuring method according to claim 11, wherein the distance to the vehicle in the real space is determined using laser radar based on the detected position of the vehicle in the image.

21. A distance measuring apparatus comprising:

a search range extraction section that focuses the search range on the area on a road in which an object exists from an image input from a car-mounted camera;

a vehicle position detection section that detects the position of the object in the image within said search range; and

an inter-vehicle distance calculation section that calculates the distance to the vehicle in the real space based on said detected position.

22. The distance measuring apparatus according to claim 21, wherein said search range extraction section comprises a regulation section to regulate the degree of focusing of the search range according to parameter specification.

23. The distance measuring apparatus according to claim 21, wherein said inter-vehicle distance calculation section compares said image and a plurality of learning images registered beforehand, determines the area most resembling at least one of said plurality of learning images and determines the determined area as the area in which an object identical to the object of the learning image exists.