Time-to-contact estimation device and method for estimating time to contact

• US 20080046181A1
• Filed: 07/28/2006
• Published: 02/21/2008
• Est. Priority Date: 07/28/2006
• Status: Active Grant

• Current Assignee: Massachusetts Institute of Technology, Veoneer Sweden AB (SSW Partners LP)
• Original Assignee: Honda Motor Co., Ltd. (Honda Motor Company), Massachusetts Institute of Technology
• Inventors: Horn, Berthold K.P., Ogawa, Shingo, Koike, Hiroyuki, Masaki, Ichiro, Fang, Yajun
• Granted Patent: US 7,711,147 B2
• Time in Patent Office: Days
• US Class Current: 701/301
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30261 Obstacle
• CPC Class Codes: G06T 7/269 using gradient-based methods
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G08G 1/16 Anti-collision systems road vehicle drive control systems for predicting or avoiding probable or impending collision otherwise than by control of a particular sub-unit B60W30/08
• CPC Class Codes: G08G 1/165 for passive traffic, e.g. including static obstacles, trees
• CPC Class Codes: G08G 1/166 for active traffic, e.g. moving vehicles, pedestrians, bikes

Abstract

A time-to-contact estimation device for estimating a time to contact of a moving body to an object in surroundings of the moving body, includes: an image sensor provided on the moving body, and continuously capturing time-varying images of the surroundings of the moving body; a brightness change calculation unit calculating brightness changes in pixels between the time-varying images captured one after another; and a time-to-contact calculation unit calculating optimized brightness gradients based on the brightness changes calculated by the brightness change calculation unit, and calculating the time to contact of the moving body to the object based on the optimized brightness gradients.

Claims

1. A time-to-contact estimation device for estimating a time to contact of a moving body to an object in surroundings of the moving body, comprising:

an image sensor provided on the moving body, and continuously capturing time-varying images of the surroundings of the moving body;

a brightness change calculation unit calculating brightness changes in pixels between the time-varying images captured one after another; and

a time-to-contact calculation unit calculating optimized brightness gradients based on the brightness changes calculated by the brightness change calculation unit, and calculating the time to contact of the moving body to the object based on the optimized brightness gradients.

2. The time-to-contact estimation device according to claim 1, wherein the time-to-contact calculation unit calculates the optimized brightness gradients by obtaining a solution that minimizes a sum of the brightness changes in the pixels of at least a portion of the time-varying images.

3. The time-to-contact estimation device according to claim 1, wherein the time-to-contact calculation unit calculates the time to contact of the moving body to the object in different ways depending on whether at least either one of degree of freedom of the object and degree of freedom of the moving body is constrained or none of them are constrained.

4. The time-to-contact estimation device according to claim 1, wherein, when none of degrees of freedom of the object and the moving body are constrained, the time-to-contact calculation unit calculates the time to contact of the moving body to the object by executing an iteration process including plural calculations in which either one of an orientation of the object and a translation path of the moving body is assumed to be fixed in each of the calculations.

5. The time-to-contact estimation device according to claim 3, wherein the time-to-contact calculation unit determines whether at least either one of degree of freedom of the object and degree of freedom of the moving body is constrained or none of them are constrained depending on whether the object is a stationary object or a moving object.

6. The time-to-contact estimation device according to claim 1, wherein the time-to-contact calculation unit calculates the time to contact of the moving body to the object in different ways by classifying cases, depending on an orientation of a planar surface of the object and a translation path along which the moving body approaches the planar surface, into four cases including:

a first case in which the planar surface is oriented perpendicular to an optical axis of the image sensor and the moving body approaches the planar surface along the optical axis;

a second case in which the planar surface is oriented perpendicular to the optical axis and the moving body approaches the planar surface in an arbitrary direction;

a third case in which the planar surface is arbitrarily oriented and the moving body approaches the planar surface along the optical axis; and

a fourth case in which the planar surface is arbitrarily oriented and the moving body approaches the planar surface in an arbitrary direction.

7. A method for estimating a time to contact of a moving body to an object in surroundings of the moving body, comprising:

an image capturing step of continuously capturing, from the moving body, time-varying images of the surroundings of the moving body;

a brightness change calculating step of calculating brightness changes in pixels between the time-varying images captured one after another; and

a time-to-contact calculating step of calculating optimized brightness gradients based on the brightness changes calculated in the brightness change calculating step, and calculating the time to contact of the moving body to the object based on the optimized brightness gradients.

8. The method according to claim 7, wherein the time-to-contact calculating step includes, for calculating the optimized brightness gradients, obtaining a solution that minimizes a sum of the brightness changes in the pixels of at least a portion of the time-varying images.

9. The method according to claim 7, wherein, in the time-to-contact calculating step, the time to contact of the moving body to the object is calculated in different ways depending on whether at least either one of degree of freedom of the object and degree of freedom of the moving body is constrained or none of them are constrained.

10. The method according to claim 7, wherein the time-to-contact calculating step includes, when none of degrees of freedom of the object and the moving body are constrained, executing an iteration process including plural calculations in which either one of an orientation of the object and a translation path of the moving body is assumed to be fixed in each of the calculations.

11. The method according to claim 9, wherein, in the time-to-contact calculating step, whether at least either one of degree of freedom of the object and degree of freedom of the moving body is constrained or none of them are constrained is determined depending on whether the object is a stationary object or a moving object.

12. The method according to claim 7, wherein, in the time-to-contact calculating step, the time to contact of the moving body to the object is calculated in different ways by classifying cases, depending on an orientation of a planar surface of the object and a translation path along which the moving body approaches the planar surface, into four cases including:

a first case in which the planar surface is oriented perpendicular to an optical axis of the image sensor and the moving body approaches the planar surface along the optical axis;

a second case in which the planar surface is oriented perpendicular to the optical axis and the moving body approaches the planar surface in an arbitrary direction;

a third case in which the planar surface is arbitrarily oriented and the moving body approaches the planar surface along the optical axis; and

a fourth case in which the planar surface is arbitrarily oriented and the moving body approaches the planar surface in an arbitrary direction.