IMAGING DEVICE FOR MOTION DETECTION OF OBJECTS IN A SCENE, AND METHOD FOR MOTION DETECTION OF OBJECTS IN A SCENE

• US 20140168424A1
• Filed: 07/20/2012
• Published: 06/19/2014
• Est. Priority Date: 07/21/2011
• Status: Abandoned Application

• Current Assignee: LinX Computational Imaging Ltd. (Apple Inc.)
• Original Assignee: LinX Computational Imaging Ltd. (Apple Inc.)
• Inventors: Attar, Ziv, Shulepova, Yelena Vladimirovna, Wolterink, Edwin Maria, Demeyer, Koen Gerard
• Application Number:
  US14/234,083
• Publication Number:
  US 20140168424A1
• Time in Patent Office: Days
• US Class Current: 348/140
• CPC Class Codes: G01C 3/10 using a parallactic triangle with variable angles and a base of fixed length in the observation station, e.g. in the instrument
• CPC Class Codes: G01P 3/38 using photographic means
• CPC Class Codes: H04N 2013/0081 Depth or disparity estimation from stereoscopic image signals
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 25/531 by controlling rolling shutters in CMOS SSIS
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

The present invention relates to an imaging device for motion detection of objects in a scene, and method for motion detection of objects in a scene. Generally the present invention relates to a system and method for creating a three dimensional image or image sequence (hereinafter “video”), and more particularly to a system and method for measuring the distance and actual 3D velocity and acceleration of objects in a scene.

Claims

1. An imaging device for motion detection of objects in a scene comprising:

plural optical lenses for collecting light from an object so as to form plural single-eye images seen from different viewpoints;

a solid-state imaging element for capturing the plural single-eye images formed through the plural optical lenses;

a rolling shutter for reading out the plural single-eye images from the solid-state imaging element along a read-out direction; and

a motion detection means for detecting movement of the object by comparing the plural single-eye images read out from the solid-state imaging element by the rolling shutter,

a depth detection means for detecting the 3D position of the object wherein the plural optical lenses are arranged so that the positions of the plural single-eye images formed on the solid-state imaging element by the plural optical lenses are displaced from each other by a predetermined distance in the read-out direction and wherein the angular velocity generated by the detection means are converted into a 3D-velocity by application of depth mapping selected from the group consisting of time of flight (TOF), structured light, triangulation and acoustic detection.

2. An imaging device for motion detection of objects in a scene according to claim 1, wherein the respective single-eye images formed on the solid-state imaging element partially overlap each other in the read-out direction.

3. An imaging device for motion detection of objects in a scene according to claim 1, wherein at least two solid-state imaging elements are present, wherein one of said elements is rotated by 90 degrees.

4. An imaging device for motion detection of objects in a scene according to claim 1, wherein different color filters are assigned to said plural optical lenses.

5. An imaging device for motion detection of objects in a scene according to claim 1, wherein at least one light source illuminates the object.

6. An imaging device for motion detection of objects in a scene according to claim 5, wherein said light source is selected from the group of LED'"'"'s, VCSELS or laser diodes.

7. An imaging device for motion detection of objects in a scene according to claim 5, wherein the light source operates in different modes of the group of continuous, time modulated and scanning mode.

8. An imaging device for motion detection of objects in a scene according to claim 1, wherein at least at least one of the solid-state imaging elements records time differences of reflected time modulated light from a light source

9. An imaging device for motion detection of objects in a scene according to claim 1, wherein any combination of solid state based elements for image capturing, illumination and acoustic image capturing share the same substrate.

10. An imaging device for motion detection of objects in a scene according to claim 1, wherein the obtained images are played in video sequence.

11. An imaging device for motion detection of objects in a scene according to claim 1, wherein 3D position means are obtained.

12. A method of forming an image of a moving object, comprising:

receiving a first image information from an image processor

receiving a second image information from an image processor

clipping the first and second image information

comparing the first and second image information

receiving 3D features coordinates from a depth detection means for detecting the 3D position, generating a 3D map from the 3D features coordinates

generating velocity vectors from position displacement between the first and second image information

processing said 3D feature coordinates and velocity vectors to 3D velocity vectors

processing 3D velocity vectors to application notification protocols, user interface and related display unit.