Vehicle mounted image processor and method of use

• US 20060256198A1
• Filed: 05/12/2006
• Published: 11/16/2006
• Est. Priority Date: 05/13/2005
• Status: Active Grant

• Current Assignee: Nissan Motor Co., Ltd.
• Original Assignee: Nissan Motor Co., Ltd.
• Inventors: Nishiuchi, Hidekazu
• Granted Patent: US 7,512,494 B2
• Time in Patent Office: Days
• US Class Current: 348/148
• CPC Class Codes: G06T 7/536 from perspective effects, e.g. by using vanishing points
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads

Abstract

A vehicle-mounted detecting device and corresponding method for detecting a distance between the vehicle and an object outside the vehicle. The detecting device extracts edge intersection points from images of individual frames photographed by a camera. A set of edge intersection points for which the relative position in images does not change between frames is then specified as an observation point group; the movement of the specified observation point group in images is observed; and pitching by the vehicle is detected. Any two points with differing heights on an object present in an image are extracted as feature points, and after the effect of pitching is eliminated from the feature points, the position of a vanishing line in the image is calculated based on the ratio of the velocities of the feature points in images after the length between the two feature points and the effects of pitching are eliminated.

Claims

1. An image processor mounted to a vehicle for determining a distance between the vehicle and an object located outside the vehicle, the image processor comprising:

an imaging means for capturing images from in front of the vehicle;

a velocity information calculation means for calculating velocity information from images photographed by the imaging means;

an observation point group specification means operable for specifying, from the velocity information calculated by the velocity information calculation means, a set of observation points at which the relative positions of velocity information does not change;

a pitching detection means configured to detect pitching of the vehicle based on the velocity information set specified by the observation point group specification means; and

a vanishing line calculation means configured to extract any two points of differing height of an object present in an image as feature points and eliminates the pitching detected by the pitching detection means from the feature points, then calculates the position of a vanishing line based on the velocity ratio of the feature points after the length between the two feature points and pitching are eliminated.

2. The image processor of claim 1, wherein the vanishing line calculation means is further configured to eliminate the effect of pitching by subtracting the velocity of the pitching detected by the pitching detection means from the vertically oriented velocity of the feature points in the image.

3. The image processor of claim 2, wherein the velocity information calculation means is configured to perform edge extraction for images in individual frames photographed by the imaging means and extracts the point at which the extracted edge in the vertical orientation and the edge in the horizontal orientation intersect, and the edge intersection point that is extracted serves as the velocity information.

4. The image processor of claim 2, wherein the observation point specification means is configured to detect a velocity information set in which the change of vertical position in an image accompanying vehicle travel is less than 1 pixel from the velocity information set in which the relative positions of velocity information in an image do not change between the images to specify the set as the observation point group.

5. The image processor of claim 4, wherein the velocity information calculation means is configured to perform edge extraction for images in individual frames photographed by the imaging means and extracts the point at which the extracted edge in the vertical orientation and the edge in the horizontal orientation intersect, and the edge intersection point that is extracted serves as the velocity information.

6. The image processor of claim 4, wherein the observation point group specification means is configured to detect the velocity information set in which the change in vertical position orientation in an image accompanying vehicle travel is less than 1 pixel while the frame rate of the imaging means is speeded up.

7. The image processor of claim 6, wherein the velocity information calculation means is configured to perform edge extraction for images in individual frames photographed by the imaging means and extracts the point at which the extracted edge in the vertical orientation and the edge in the horizontal orientation intersect, and the edge intersection point that is extracted serves as the velocity information.

8. The image processor of claim 1, wherein the velocity information calculation means is configured to perform edge extraction for images in individual frames photographed by the imaging means and extracts the point at which the extracted edge in the vertical orientation and the edge in the horizontal orientation intersect, and the edge intersection point that is extracted serves as the velocity information.

9. The image processor of claim 1, wherein the observation point specification means detects a velocity information set in which the change of vertical position in an image accompanying vehicle travel is less than 1 pixel from the velocity information set in which the relative positions of velocity information in an image do not change between the images to specify the set as the observation point group.

10. A method for determining a position of a vanishing line within an image captured by an image processor in a vehicle having an imaging means, the method comprising:

calculating velocity information for images captured by the imaging means;

selecting a set in which the relative positions of velocity information do not change from the calculated velocity information;

detecting pitching by the vehicle based on the specified velocity information set;

extracting as feature points, any two points of differing height on an object present in the image;

eliminating from the feature points the pitching detected by the pitching detection means; and

calculating the position of a vanishing line based on the velocity ratio of the feature points after the length between the two feature points and pitching are eliminated.

11. A vehicle comprising:

an imaging device for capturing an image;

a memory device operably connected to the imaging device for receiving and storing the image; and

a controller operably connected to the memory device, the controller adapted to calculate velocity information for images stored in the memory;

generate, from the velocity information a set of observation points in which the relative positions of velocity information do not change; and

detect pitching by the vehicle based on the velocity information corresponding to the observation points.

12. The vehicle of claim 14, wherein the controller is further configured to extract two points of differing height of an object present in the image as feature points and eliminate the detected pitching from the feature points;

and calculate the position of a vanishing line based on the velocity ratio of the feature points.

13. The vehicle of claim 15, wherein the controller is further configured to eliminate the effect of pitching by subtracting the velocity of the detected pitching from the vertically oriented velocity of the feature points.