Behavior detector and behavior detection method for a vehicle

• US 20060276964A1
• Filed: 05/31/2006
• Published: 12/07/2006
• Est. Priority Date: 06/01/2005
• Status: Abandoned Application

• Current Assignee: Nissan Motor Co., Ltd.
• Original Assignee: Nissan Motor Co., Ltd.
• Inventors: Sano, Yasuhito
• Application Number:
  US11/443,675
• Publication Number:
  US 20060276964A1
• Time in Patent Office: Days
• US Class Current: 701/300
• CPC Class Codes: B60W 40/11 Pitch movement
• CPC Class Codes: B60W 40/112 Roll movement
• CPC Class Codes: B60W 40/114 Yaw movement
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30252 Vehicle exterior; Vicinity of vehicle
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments

Abstract

A behavior detector and a behavior detection method for a vehicle. A controller extracts multiple characteristic points out of an image captured using a camera and computes the velocities and the directions that the respective extracted characteristic points move in the image. Then, the controller computes the times (TTC) until vehicle collision with the respective characteristic points based on the computed velocities and the directions that the respective extracted characteristic points move in the image. Distant characteristic points are designated based on the computed TTCs, and movements of the distant characteristic points are monitored in order to detect pitching and yawing of the vehicle.

Claims

1. A behavior detector for a vehicle, comprising:

an image pickup device for sequentially capturing a plurality of images outside the vehicle; and

a controller operable to extract characteristic points from each of the plurality of images, to compute movement information for the characteristic points moving through the plurality of images, to compute a time until collision of the vehicle with each of the characteristic points based on the movement information, and to designate certain of the characteristic points at distant positions from the vehicle as distant characteristic points using the respective times until collision; and

wherein movements of the distant characteristic points indicate behavior of the vehicle.

2. The behavior detector according to claim 1 wherein the controller is further operable to separate characteristic points with identical times until collision into groups, to designate characteristic points having a time until collision equal to or greater than a prescribed value out of the groups as candidates for the distant characteristic points;

and to delete nearby characteristic points for objects present near the vehicle from the candidates; and

wherein remaining ones of the candidates are the distant characteristic points.

3. The behavior detector according to claim 2 wherein the nearby characteristic points comprise characteristic points present within a prescribed range from a bottom end of the image that are candidates.

4. The behavior detector according to claim 3 wherein the nearby characteristic points further comprise other candidates having the same movement information as the characteristic points present within the prescribed range from the bottom of the image that are candidates.

5. The behavior detection method according to claim 2 wherein the controller is further operable to determine movement information for characteristic points present within a prescribed range from a bottom end of an image and to determine movement information for characteristic points in an upper end of an image;

and wherein the nearby characteristic points deleted include characteristic points present within the prescribed range from the bottom end of the image when the movement information for the characteristic points is not equal to the movement information for the characteristic points in the upper end of the image and wherein the nearby characteristic points deleted include the characteristic points present within the prescribed range from the bottom end of the image and the characteristic points in the upper end of the image when the movement information for the characteristic points present within the prescribed range from the bottom end of the image is equal to the movement information for the characteristic points in the upper end of the image.

6. The behavior detector according to claim 1 wherein the behavior comprises at least one of a pitch and a yaw of the vehicle.

7. The behavior detector according to claim 1 wherein the movement information comprises at least one of a velocity and a direction for each of the characteristic points.

8. A behavior detector for a vehicle, comprising:

pickup means for capturing images external of the vehicle;

characteristic point extraction means for extracting characteristic points out of images captured by the pickup means;

velocity information computation means for computing pieces of velocity information regarding each of the characteristic points extracted by the characteristic point extraction means;

time-until-collision computation means for computing respective times until vehicle collision with each of the characteristic points based on the pieces of velocity information computed by the velocity information computation means; and

designation means for designating characteristic points present at distant positions from the vehicle based on the respective times computed by the times-until-collision computation means wherein vehicular behavior is based on movements of the distant characteristic points designated by the designation means.

9. The behavior detector according to claim 8 wherein the designation means further comprises means for separating characteristic points with identical time-until-collision into groups, means for designating characteristic points showing times-until-collision equal to or greater than a prescribed value out of the groups as candidates for the distant characteristic points;

and means for deleting nearby characteristic points for objects present near the vehicle from the candidates wherein remaining ones of the candidates are the distant characteristic points.

10. The behavior detector according to claim 9 wherein the means for deleting nearby characteristic points further comprises designating characteristic points present within a prescribed range from the bottom end of the image that are candidates as the nearby characteristic points.

11. The behavior detector according to claim 10 wherein the designation means further comprises means for designating other candidates having the same pieces of velocity information as the nearby characteristic points as nearby characteristic points.

12. The behavior detector according to claim 8 wherein the vehicular behavior comprises at least one of a pitch and a yaw of the vehicle.

13. The behavior detector according to claim 8 wherein the pieces of velocity information comprise at least one of a velocity and a direction for each of the characteristic points.

14. A behavior detection method for a vehicle, comprising:

sequentially capturing a plurality of images outside the vehicle;

extracting characteristic points from each of the plurality of images;

computing movement information for the characteristic points moving through the plurality of images;

computing a time until collision of the vehicle with each of the characteristic points based on the movement information; and

designating certain of the characteristic points at distant positions from the vehicle as distant characteristic points using the respective times until collision; and

wherein movements of the distant characteristic points indicate behavior of the vehicle.

15. The behavior detection method according to claim 14 wherein designating certain of the characteristic points as distant characteristic points further comprises separating the characteristic points having a same time until collision into respective groups, selecting at least one of the respective groups as a distant candidate group wherein the at least one of the respective groups has a time until collision equal to or greater than a prescribed value, and deleting characteristic points for objects present near the vehicle from the distant candidate group;

and wherein the remaining characteristic points of the distant candidate group are the distant characteristic points.

16. The behavior detection method according to claim 15 wherein deleting characteristic points for objects present near the vehicle from the distant candidate group further comprises deleting characteristic points present within a prescribed range from a bottom end of an image from the distant candidate group.

17. The behavior detection method according to claim 16, further comprising:

deleting characteristic points having a same movement information as the characteristic points present within the prescribed range from the bottom end of the image from the distant candidate group.

18. The behavior detection method according to claim 15, further comprising:

determining movement information for nearby characteristic points present within a prescribed range from a bottom end of an image; and

determining movement information for characteristic points in an upper end of an image; and

wherein deleting characteristic points for objects present near the vehicle from the distant candidate group further comprises deleting the nearby characteristic points when the movement information for the nearby characteristic points is not equal to the movement information for the characteristic points in the upper end of the image and deleting the nearby characteristic points and the characteristic points in the upper end of the image when the movement information for the nearby characteristic points is equal to the movement information for the characteristic points in the upper end of the image.

19. The behavior detection method according to claim 14 wherein the behavior of the vehicle comprises at least one of a pitch and a yaw of the vehicle.

20. The behavior detection method according to claim 14 wherein the movement information for the characteristic points comprises at least one of a velocity and a direction of each of the characteristic points.