IMPACT TIME FROM IMAGE SENSING

• US 20150035990A1
• Filed: 01/20/2012
• Published: 02/05/2015
• Est. Priority Date: 01/20/2012
• Status: Active Grant

• Current Assignee: Sick IVP AB (Sick)
• Original Assignee: Anders Astrom
• Inventors: Forchheimer, Robert, Astrm, Anders
• Granted Patent: US 10,078,904 B2
• Time in Patent Office: Days
• US Class Current: 348/169
• CPC Class Codes: G06T 2200/28 involving image processing hardware
• CPC Class Codes: G06T 2207/30261 Obstacle
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: G06T 7/579 from motion

Abstract

Impact time between an image sensing circuitry and an object relatively moving at least partially towards, or away from, the image sensing circuitry can be computed. Image data associated with a respective image frame of a sequence (1 . . . N) of image frames sensed by said image sensing circuitry and which image frames are imaging said object can be received. For each one (i) of multiple pixel positions, a respective duration value (f(i)) indicative of a largest duration of consecutively occurring local extreme points in said sequence (1 . . . N) of image frames can be computed. A local extreme point is present in a pixel position (i) when an image data value of the pixel position (i) is a maxima or minima in relation to image data values of those pixel positions that are closest neighbours to said pixel position (i).

Claims

1. A method to compute impact time between an image sensing circuitry and an object relatively moving at least partially towards, or away from, the image sensing circuitry, wherein the method comprises:

receiving image data associated with a respective image frame of a sequence (1 . . . N) of image frames sensed by said image sensing circuitry and which image frames are imaging said object, and

computing, for each one (i) of multiple pixel positions, a respective duration value (f(i)) indicative of a largest duration of consecutively occurring local extreme points in said sequence (1 . . . N) of image frames, wherein a local extreme point is present in a pixel position (i) when an image data value of the pixel position (i) is a maxima or minima in relation to image data values of those pixel positions that are closest neighbours to said pixel position (i).

2. The method as claimed in claim 1, wherein the duration value is a largest number of consecutively occurring local extreme points in said sequence.

3. The method as claimed in any one of claims 1-2, further comprising:

computing a sum (Σ

f(i)) of the duration values (f(i)),

or

computing a slope value (k) by fitting a line of the duration values (f(i)) as a function of the multiple pixel positions, whereby the slope value (k) corresponds to the slope of this line.

4. The method as claimed in claim 3, further comprising:

computing a slope value (k) based on an inverse (1/Σ

f(i)) of the sum multiplied with a scale factor (c), wherein said slope value (k) corresponds to;

5. The method as claimed in claim 4, wherein the scale factor (c) corresponds to:

6. The method as claimed in claim 4, further comprising:

computing an offset value (δ

) indicative of an offset of a pixel position (i_max) of a maximum duration value amongst the computed largest duration values (f(i)) in relation to a centre image position (i_centre) of said multiple pixel positions,

wherein the scale factor (c) corresponds to;

7. The method as claimed in claim 4, further comprising:

computing the impact time using the computed slope value (k), wherein the impact time (T_I) corresponds to;

8. The method as claimed in claim 1, wherein the multiple pixel positions corresponds to a subset of all pixel positions.

9. The method as claimed in claim 1, wherein the multiple pixel positions are uniformly distributed amongst all pixels positions, or at least all pixel positions in an area of interest.

10. The method as claimed in claim 1, wherein each one of said multiple pixel positions is associated with a respective pixel position.

11. (canceled)

12. A computer readable medium having a program recorded thereon that, when executed by a computer, causes the computer to perform operations to compute impact time between an image sensing circuitry and an object relatively moving at least partially towards, or away from, the image sensing circuitry, wherein the operations comprise:

receiving image data associated with a respective image frame of a sequence (1 . . . N) of image frames sensed by said image sensing circuitry and which image frames are imaging said object, and

computing, for each one (i) of multiple pixel positions, a respective duration value (f(i)) indicative of a largest duration of consecutively occurring local extreme points in said sequence (1 . . . N) of image frames, wherein a local extreme point is present in a pixel position (i) when an image data value of the pixel position (i) is a maxima or minima in relation to image data values of those pixel positions that are closest neighbours to said pixel position (i).

13. A computer configured to perform operations to compute impact time between an image sensing circuitry and an object relatively moving at least partially towards, or away from, the image sensing circuitry, wherein the operations comprise:

receiving image data associated with a respective image frame of a sequence (1 . . . N) of image frames sensed by said image sensing circuitry and which image frames are imaging said object, and

computing, for each one (i) of multiple pixel positions, a respective duration value (f(i)) indicative of a largest duration of consecutively occurring local extreme points in said sequence (1 . . . N) of image frames, wherein a local extreme point is present in a pixel position (i) when an image data value of the pixel position (i) is a maxima or minima in relation to image data values of those pixel positions that are closest neighbours to said pixel position (i).

14. An apparatus to compute impact time between an image sensing circuitry and an object relatively moving at least partially towards, or away from, the image sensing circuitry, wherein the apparatus comprises:

a receiving port, configured to image data associated with a respective image frame of a sequence (1 . . . N) of image frames sensed by said image sensing circuitry and which image frames are imaging said object, and,

a first computing circuitry, configured to compute, for each one (i) of multiple pixel positions, a respective largest duration value (f(i)) indicative of a largest duration of consecutively occurring local extreme points in said sequence (1 . . . N) of image frames, wherein a local extreme point is present in a pixel position (i) when an image data value of the pixel position (i) is a maxima or minima in relation to image data values of those pixel positions that are closest neighbours to said pixel position (i).

15. The apparatus as claimed in claim 14, wherein the duration value is a largest number of consecutively occurring local extreme points in said sequence.

16. The apparatus as claimed in any one of claims 14-15, further comprising:

a second computing circuitry, configured to compute a sum (Σ

f(i)) of the duration values (f(i)) or to compute a slope value (k) by fitting a line of the duration values (f(i)) as a function of said multiple pixel positions (i), whereby the slope value (k) corresponds to the slope of this line.

17. The apparatus as claimed in claim 16, further comprising:

a third computing circuitry, configured to compute a slope value (k) based on an inverse (1/Σ

f(i)) of the sum multiplied with a scale factor (c), wherein said slope value (k) corresponds to;

18. The apparatus as claimed in claim 17, wherein the scale factor (c) corresponds to:

19. The apparatus as claimed in claim 17, further comprising:

a fourth computing circuitry configured to compute an offset value (δ

) indicative of an offset of a pixel position (i_max) of a maximum duration value amongst the computed largest duration values (f(i)) in relation to a centre image position (i_centre) of said multiple pixel positions,

wherein the scale factor (c) corresponds to;

20. The apparatus as claimed in claim 17, further comprising:

a fifth computing circuitry, configured to compute the impact time using the computed slope value (k), wherein the impact time (T_I) corresponds to;

21. The apparatus as claimed in claim 17, wherein the multiple pixel positions corresponds to a subset of all pixel positions.

22. The apparatus as claimed in claim 14, wherein the multiple pixel positions are uniformly distributed amongst all pixels positions, or at least all pixel positions in an area of interest.

23. The apparatus as claimed in claim 14, wherein each one of said multiple pixel positions is associated with a respective pixel position.

24. The apparatus as claimed in claim 14, further comprising:

the image sensing circuitry configured to sense the image frames of the sequence.

25. The apparatus as claimed in claim 24, wherein

the image sensing circuitry comprises sensing elements, each one being associated with a pixel position and configured to capture light, wherein each sensing element is further configured to, in response to captured light, provide local image data corresponding to a pixel, and wherein

the first computing circuitry comprises computing elements, each computing element being associated with one of or a group of the sensing elements and thereby also corresponding pixel position/s, wherein a computing element that is associated with a pixel position/s that corresponds to one of the multiple pixel positions, is configured to compute the respective duration value (f(i)) based on local image data from the associated sensing element/s.

26-58. -58. (canceled)