KINEMATIC QUANTITY MEASUREMENT FROM AN IMAGE

• US 20170069103A1
• Filed: 09/08/2015
• Published: 03/09/2017
• Est. Priority Date: 09/08/2015
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Gren, Juuso, Sokeila, Tomi
• Application Number:
  US14/847,358
• Publication Number:
  US 20170069103A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06T 2207/20021 Dividing image into blocks, subimages or windows
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: H04N 23/6812 based on additional sensors, e.g. acceleration sensors
• CPC Class Codes: H04N 23/689 Motion occurring during a rolling shutter mode
• CPC Class Codes: H04N 25/531 by controlling rolling shutters in CMOS SSIS
• CPC Class Codes: H04N 25/533 by using differing integration times for different sensor regions
• CPC Class Codes: H04N 25/61 the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4"

Abstract

A camera has known parameters that affect image distortions. Different shutters or different image sensor scanning procedures lead to the image having parts that are recorded at different moments. An object in motion may be recorded in different positions, which is usually seen as a distortion effect in the image. Detecting the object in the partial images in different positions enables the calculation of the position difference between two moments. As the time difference is known from the camera parameters, several kinematic quantities relating to the object may be calculated. Examples of the kinematic quantities are speed, velocity, angular velocity, acceleration and angular acceleration.

Claims

1. A device comprising:

an image sensor configured to capture an image;

at least one processor and a memory storing instructions that, when executed;

cause the image sensor to capture a first portion of the image at a first moment and to capture a second portion of the image at a second moment,

detect a time difference between the first moment and the second moment,

detect a position difference of an object in the first portion of the image and in the second portion of the image; and

calculate from the time difference and the position difference a kinematic quantity of the object.

2. A device according to claim 1, comprising a shutter configured to cause the time difference between the first portion of the image and the second portion of the image.

3. A device according to claim 1, wherein the at least one processor and a memory storing instructions cause the device, when executed, to:

detect a shape of the moving object;

search from the memory information about a shape of a similar stationary object;

compare the shape of the moving object in the captured image to the shape of the stationary object received from the memory;

calculate, based on the comparison, at least one of speed, velocity, angular velocity, acceleration and angular acceleration of the object.

4. A device according to claim 1, comprising a camera, wherein the at least one processor and a memory storing instructions cause the device, when executed, to:

detect a shape of the object;

search from the memory information about a shape of a similar stationary object;

compare the shape of the object in the captured image to the shape of the stationary object received from the memory using a transfer function and at least one camera lens distortion parameter; and

calculate, based on the comparison, the distance between the object and the camera.

5. A device according to claim 1, comprising a camera having a lens, wherein the at least one processor and a memory storing instructions cause the device, when executed, to:

detect a shape of the object;

search from the memory information about a shape of a similar stationary object;

compare the shape of the object in the captured image to the shape of the stationary object received from the memory using a transfer function and at least one camera lens distortion parameter; and

calculate, based on the comparison, a motion path of the object.

6. A device according to claim 1, wherein the device comprises the at least one processor and a memory storing instructions that, when executed:

detect at least two traces of a marker on the object and calculate the rotating speed of the object as a response to the number of markers.

7. A system comprising:

a camera configured to capture an image;

at least one processor and a memory storing instructions that, when executed;

cause the camera to capture a first portion of the image at a first moment and to capture a second portion of the image at a second moment,

cause the camera to send a time difference between the first moment and the second moment to the at least one processor,

cause the at least one processor to detect a position difference of an object in the first portion of the image and in the second portion of the image; and

cause the at least one processor to calculate from the time difference and the position difference a kinematic quantity of the object.

8. A system according to claim 7, the camera comprising a shutter configured to cause the time difference between the first portion of the image and the second portion of the image.

9. A system according to claim 7, wherein the at least one processor and a memory storing instructions cause the system, when executed, to:

detect a shape of the moving object;

search from the memory information about a shape of a similar stationary object;

compare the shape of the moving object in the captured image to the shape of the stationary object received from the memory;

calculate, based on the comparison, at least one of speed, velocity, angular velocity, acceleration and angular acceleration of the object.

10. A system according to claim 7, wherein the at least one processor and a memory storing instructions cause the system, when executed, to:

detect a shape of the object;

search from the memory information about a shape of a similar stationary object;

compare the shape of the object in the captured image to the shape of the stationary object received from the memory using a transfer function and at least one camera lens distortion parameter; and

calculate, based on the comparison, the distance between the object and the camera.

11. A system according to claim 7, wherein the at least one processor and a memory storing instructions cause the system, when executed, to:

detect a shape of the object;

search from the memory information about a shape of a similar stationary object;

compare the shape of the object in the captured image to the shape of the stationary object received from the memory using a transfer function and at least one camera lens distortion parameter; and

calculate, based on the comparison, a motion path of the object.

12. A system according to claim 7, wherein, in the camera comprising an image sensor configured to capture an image, the image sensor comprises at least two areas configured to cause the first area to capture the first portion of the image at the first moment and the second area to capture the second portion of the image at the second moment.

13. A system according to claim 7, wherein the system comprises the at least one processor and a memory storing instructions that, when executed, cause the system to detect at least two traces of a marker on the object and calculate the rotating speed of the object as a response to the number of markers.

14. A method, comprising:

an image comprising at least one item of camera parameter data;

the image comprising a first portion of the image captured at a first moment and a second portion of the image captured at a second moment,

the camera parameter comprising a time difference between the first moment and the second moment,

detecting a position difference of an object in the first portion of the image and in the second portion of the image; and

calculating from the time difference and the position difference a kinematic quantity of the object.

15. A method according to claim 14, comprising a shutter causing the time difference between the first portion of the image and the second portion of the image.

16. A method according to claim 14, comprising at least one processor and a memory storing instructions for:

detecting a shape of the moving object;

searching from the memory information about a shape of a similar stationary object;

comparing the shape of the moving object in the image to the shape of the stationary object received from the memory;

calculating, based on the comparison, at least one of speed, velocity, angular velocity, acceleration and angular acceleration of the object.

17. A method according to claim 14, comprising at least one processor and a memory storing instructions for:

detecting a shape of the object;

searching from the memory information about a shape of a similar stationary object;

the at least one camera parameter comprising a camera lens distortion parameter;

comparing the shape of the object in the image to the shape of the stationary object received from the memory using a transfer function and the at least one camera lens distortion parameter; and

calculating, based on the comparison, the distance between the object and the camera.

18. A method according to claim 14, comprising at least one processor and a memory storing instructions for:

detecting a shape of the object;

searching from the memory information about a shape of a similar stationary object;

comparing the shape of the object in the captured image to the shape of the stationary object received from the memory using a transfer function and the at least one camera lens distortion parameter; and

calculating, based on the comparison, a motion path of the object.

19. A method according to claim 14, comprising an image sensor configured to capture the image, the image sensor having a first area and a second area;

and causing the first area to capture the first portion of the image at the first moment and the second area to capture the second portion of the image at the second moment.

20. A method according to claim 14, comprising detecting at least two traces of a marker on the object and calculating the rotating speed of the object as a response to the number of markers.