OBJECT DETECTION AND TRACKING

• US 20140028861A1
• Filed: 07/26/2013
• Published: 01/30/2014
• Est. Priority Date: 07/26/2012
• Status: Abandoned Application

• Current Assignee: Lmi Liquidating Co., LLC
• Original Assignee: Lmi Liquidating Co., LLC
• Inventors: Holz, David
• Application Number:
  US13/952,226
• Publication Number:
  US 20140028861A1
• Time in Patent Office: Days
• US Class Current: 348/208.4
• CPC Class Codes: G06V 10/143 Sensing or illuminating at different wavelengths
• CPC Class Codes: G06V 10/145 Illumination specially adapted for pattern recognition, e.g. using gratings
• CPC Class Codes: H04N 23/6845 by combination of a plurality of images sequentially taken
• CPC Class Codes: H04N 25/60 Noise processing, e.g. detecting, correcting, reducing or removing noise
• CPC Class Codes: H04N 5/144 Movement detection for video coding H04N19/503; analysis of motion in general G06T7/20

Abstract

Imaging systems and methods improve object recognition by more strongly enhancing contrast between the object and non-object (e.g., background) surfaces than would be possible with a simple optical filter tuned to the wavelength(s) of the source light(s). In some embodiments, the overall scene illuminated by ambient light is preserved (or may be reconstructed) for presentation purposes—e.g., combined with a graphical overlay of the sensed object(s) in motion.

Claims

1. A method of improving an image of an object for machine control, comprising:

illuminating the object with electromagnetic radiation having a first optical characteristic;

selectively sensitizing a first subset of optically sensitive picture elements of a sensor to the first optical characteristic and selectively sensitizing a second subset of optically sensitive picture elements of the sensor to a second optical characteristic;

capturing an image of the object, the image including a first image information subset derived from the first subset of optically sensitive picture elements and a second image information subset derived from the second subset of optically sensitive picture elements; and

removing noise from the image to form an improved image by determining a difference between the first image information subset and the second image information subset.

2. The method of claim 1, further comprising:

analyzing the improved image to determine gesture information for controlling a machine.

3. The method of claim 1, wherein removing noise from the image includes:

comparing amplitude ratios between corresponding pixels of the first image information subset and the second image information subset captured by different sets of sensor picture elements.

4. The method of claim 1, wherein the optical characteristic includes:

at least one of a wavelength, frequency, polarization.

5. The method of claim 1, wherein selectively sensitizing a first subset of optically sensitive picture elements of a sensor to the first optical characteristic and selectively sensitizing a second subset of optically sensitive picture elements of the sensor to a second optical characteristic includes:

applying a first filter to the first subset of optically sensitive picture elements of the sensor, the filter permitting detection of electromagnetic radiation having a wavelength proximate to the first optical characteristic.

6. The method of claim 5, wherein applying a first filter to the first subset of optically sensitive picture elements of the sensor, includes:

applying the first filter to a first set of alternating pixel rows and/or columns in an interlaced fashion or in a mixed axis pattern.

7. The method of claim 5, wherein illuminating the object with electromagnetic radiation having a first optical characteristic includes:

illuminating with a light source having a dominant wavelength; and

wherein the first filter permits detection of electromagnetic radiation having a wavelength proximate to the dominant wavelength; and

applying a second filter that does not permit detection of the dominant wavelength to the second subset of optically sensitive picture elements of the sensor.

8. The method of claim 1, wherein selectively sensitizing a first subset of optically sensitive picture elements of a sensor to the first optical characteristic and selectively sensitizing a second subset of optically sensitive picture elements of the sensor to a second optical characteristic includes:

controlling a subset of optically sensitive picture elements of the sensor to respond electrically to electromagnetic radiation having a wavelength including at least the first optical characteristic.

9. The method of claim 1, wherein selectively sensitizing a first subset of optically sensitive picture elements of a sensor to the first optical characteristic and selectively sensitizing a second subset of optically sensitive picture elements of the sensor to a second optical characteristic includes:

dynamically tuning a subset of optically sensitive picture elements of the sensor to respond electrically to electromagnetic radiation having a wavelength including at least the first optical characteristic.

10. An image capture and analysis system comprising:

a camera oriented toward a field of view, the camera comprising an image sensor comprising light-sensing pixels;

a first type of filter applicable to a first plurality of the pixels;

a second type of filter applicable to a second plurality of pixels, different from the first plurality of pixels, to provide an image optically different from an image taken with the first type of filter; and

an image analyzer coupled to the camera and configured to;

capture using the camera a plurality of images including a first image corresponding to the first plurality of pixels and a second image corresponding to the second plurality of pixels; and

determine based at least in part upon the first image and the second image, pixels corresponding to an object of interest in the field of view.

11. The system of claim 10, further comprising a light source having a dominant wavelength;

and

wherein the first filter type allows transmission of the dominant wavelength whereas the second filter type does not allow transmission of the dominant wavelength.

12. The system of claim 10, further comprising a light source having a dominant wavelength;

and

wherein the first filter type allows transmission of wavelengths greater than a threshold wavelength no longer than the dominant wavelength, whereas the second filter type passes wavelengths more than a threshold amount below the dominant wavelength.

13. The system of claim 12, wherein the threshold wavelength is shorter than the dominant wavelength.

14. The system of claim 13, wherein the threshold amount is at least equal to a difference between the dominant wavelength and the threshold wavelength.

15. The system of claim 10, further comprising a light source having a dominant wavelength;

and

wherein the first filter type allows transmission of wavelengths greater than a threshold wavelength no longer than the dominant wavelength, whereas the second filter type passes wavelengths more than a threshold amount above the dominant wavelength.

16. The system of claim 15, wherein the threshold wavelength is shorter than the dominant wavelength.

17. The system of claim 16, wherein the threshold amount is at least equal to a difference between the dominant wavelength and the threshold wavelength.

18. The system of claim 10, further comprising a light source having a dominant wavelength;

and

wherein the first filter type allows transmission of wavelengths less than a threshold wavelength no shorter than the dominant wavelength, whereas the second filter type passes wavelengths more than a threshold amount above the dominant wavelength.

19. The system of claim 18, wherein the threshold wavelength is longer than the dominant wavelength.

20. The system of claim 19, wherein the threshold amount is at least equal to a difference between the dominant wavelength and the threshold wavelength.

21. The system of claim 20, wherein the first filter type passes wavelengths centered around the dominant wavelength with increasing attenuation above and below the dominant wavelength, and the second filter type passes wavelengths centered around a filter wavelength different from the dominant wavelength and with increasing attenuation above and below the filter wavelength.

22. The system of claim 21, wherein the filter wavelength is at least 50 nm above or below the dominant wavelength.

23. The system of claim 10, wherein the first and second filter types are applicable in an interlaced fashion to at least one of alternating pixel rows or alternating pixel columns.

24. The system of claim 10, wherein the first and second filter types apply to different pixels in a mixed-axis pattern.

25. The system of claim 10, wherein the first and second filter types apply to different numbers of pixels.

26. The system of claim 25, wherein images corresponding to the first and second filter types have an enhanced bit-depth.

27. The system of claim 10, further comprising a plurality of light sources emitting at least two optically distinct forms of light, the light sources having a predetermined geometry relative to the camera, the image analyzer detecting motion based at least in part on the known geometry and angular information embedded in the first and second images.

28. The system of claim 10, wherein the first and second images are captured substantially simultaneously.

29. The system of claim 10, wherein the first type of filter and second type of filter are arranged to pass light having different polarizations.

30. A non-transitory machine readable medium, storing one or more instructions which when executed by one or more processors cause the one or more processors to perform the following:

illuminating the object with electromagnetic radiation having a first optical characteristic;

capturing an image of the object, the image including a first image information subset derived from selectively sensitizing a first subset of optically sensitive picture elements of a sensor to the first optical characteristic and a second image information subset derived from selectively sensitizing a second subset of optically sensitive picture elements of the sensor to a second optical characteristic; and

removing noise from the image to form an improved image by determining a difference between the first image information subset and the second image information subset.