Detection and classification of light sources using a diffraction grating

• US 10,830,642 B2
• Filed: 10/05/2015
• Issued: 11/10/2020
• Est. Priority Date: 01/15/2008
• Status: Active Grant

• Current Assignee: MobilEye Vision Technologies Ltd. (Intel Corporation)
• Original Assignee: MobilEye Vision Technologies Ltd. (Intel Corporation)
• Inventors: Stein, Gideon
• Primary Examiner(s): Ahmad, Khaja
• Application Number:
  US14/875,062
• Publication Number:
  US 20160025568A1
• Time in Patent Office: 1,863 Days
• Field of Search: None
• CPC Class Codes: G01J 1/04 Optical or mechanical part supplementary adjustable parts
• CPC Class Codes: G01J 1/0407 Optical elements not provided otherwise, e.g. manifolds, windows, holograms, gratings
• CPC Class Codes: G01J 1/4228 arrangements with two or more detectors, e.g. for sensitivity compensation
• CPC Class Codes: G01J 2001/4247 for testing lamps or other light sources
• CPC Class Codes: G01J 2003/2836 Programming unit, i.e. source and date processing
• CPC Class Codes: G01J 3/02 Details
• CPC Class Codes: G01J 3/0205 Optical elements not provided otherwise, e.g. optical manifolds, diffusers, windows
• CPC Class Codes: G01J 3/0208 using focussing or collimating elements, e.g. lenses or mirrors; performing aberration correction
• CPC Class Codes: G01J 3/18 using diffraction elements, e.g. grating gratings per se G02B
• CPC Class Codes: G01J 3/28 Investigating the spectrum using colour filters G01J3/51
• CPC Class Codes: G01J 3/2803 using photoelectric array detector
• CPC Class Codes: G01J 3/2823 Imaging spectrometer
• CPC Class Codes: G01J 3/46 Measurement of colour; Colour measuring devices, e.g. colorimeters measuring colour temperature G01J5/60
• CPC Class Codes: G02B 5/04 Prisms
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: G06N 20/10 using kernel methods, e.g. support vector machines [SVM]

Abstract

A system mounted in a vehicle for classifying light sources. The system includes a lens and a spatial image sensor. The lens is adapted to provide an image of a light source on the spatial image sensor. A diffraction grating is disposed between the lens and the light source. The diffraction grating is adapted for providing a spectrum. A processor is configured for classifying the light source as belonging to a class selected from a plurality of classes of light sources expected to be found in the vicinity of the vehicle, wherein the spectrum is used for the classifying of the light source. Both the image and the spectrum may be used for classifying the light source or the spectrum is used for classifying the light source and the image is used for another driver assistance application.

Claims

1. A system mountable in a vehicle, the system for classifying a light source, the system comprising:

a spatial image sensor;

a lens disposed between the light source and the spatial image sensor, and configured to provide an image of the light source on the spatial image sensor;

a diffraction grating or prism disposed between the lens and the light source, wherein the diffraction grating or prism is configured to direct a first spectrum of a light of the light source and a second spectrum of the light of the light source onto the spatial image sensor, the first spectrum being different from the second spectrum; and

a processor configured to;

identify a first location of the first spectrum and a second location of the second spectrum projected in a plane defined by the spatial image sensor; and

classify the light source as belonging to a class selected from a plurality of classes of light sources based on a distance between the first and second locations.

2. The system of claim 1, wherein at least one of the first or second spectrum is sensed by the spatial image sensor.

3. The system of claim 1, wherein the light source is selected from the group consisting of streetlights, headlights, taillights and traffic signs.

4. The system of claim 1, further comprising a hood enclosure configured to reduce a field of view of the lens to a predetermined degree so that light from another light source located outside of the reduced field of view does not superimpose at least one of the first or second spectrum.

5. The system of claim 1, wherein the processor uses the image of the light source and at least one of the first or second spectrum to classify the light source.

6. The system of claim 1, wherein the lens and the diffraction grating or prism are formed at different optical surfaces of a single optical element.

7. A method of classifying light sources using a system including a camera equipped with a lens and a spatial image sensor, the method comprising:

providing, by the lens disposed between the light source and the spatial image sensor, an image of a light source on the spatial image sensor;

directing, by a diffraction grating or prism disposed between the lens and the light source, a first spectrum of a light of the light source and a second spectrum of the light of the light source onto the spatial image sensor, the first spectrum being different from the second spectrum;

identifying, by a processor, a first location of the first spectrum and a second location of the second spectrum projected in a plane defined by the spatial image sensor; and

classifying, by the processor, based on a distance between the first and second locations, the light source as belonging to a class selected from a plurality of classes of light sources.

8. The method of claim 7, further comprising reducing a field of view of the lens to a predetermined degree using a hood enclosure so that light from another light source located outside of the reduced field of view does not superimpose at least one of the first or second spectrum.

9. The method of claim 7, wherein classifying is also based on the image of the light source.

10. A system mounted in a vehicle for classifying a light source, comprising:

an image sensor;

a lens configured to form an image of the light source on the image sensor;

a dispersive optical element disposed between the lens and the light source and configured to form a first spectrum of a light of the light source and a second spectrum of the light of the light source on the image sensor, the first spectrum being different from the second spectrum;

a processor configured to classify the light source as belonging to a class selected from a plurality of classes of light sources based on a distance between a first location of the first spectrum and a second location of the second spectrum projected in a plane defined by the spatial image sensor; and

a hood enclosure including a portion disposed within a field of view of the lens to reduce the field of view to a predetermined degree such that light from another light source located outside of the reduced field of view does not superimpose at least one of the first or second spectrum.

11. The system of claim 10, wherein at least one of the first or second spectrum is sensed by the spatial image sensor.

12. The system of claim 10, wherein the light source is selected from the group consisting of streetlights, headlights, taillights and traffic signs.

13. The system of claim 10, wherein the processor uses the image of the light source and at least one of the first or second spectrum to classify the light source.

14. The system of claim 10, wherein the lens and the dispersive optical element are formed at different optical surfaces of a single optical element.

15. A method of classifying a light source, comprising:

forming, by a lens, an image of the light source on an image sensor;

forming, by a dispersive optical element disposed between the lens and the light source, a first spectrum of a light of the light source and a second spectrum of the light of the light source on the image sensor, the first spectrum being different from the second spectrum;

reducing, by a hood enclosure including a portion disposed within a field of view of the lens, the field of view to a predetermined degree such that light from another light source located outside of the reduced field of view does not superimpose at least one of the first spectrum or the second spectrum; and

classifying, by a processor, the light source as belonging to a class selected from a plurality of classes of light sources based on a distance between a first location of the first spectrum and a second location of the second spectrum projected in a plane defined by the spatial image sensor.

16. A system mounted in a vehicle for classifying a light source, comprising:

an image sensor;

a lens configured to form an image of the light source on the image sensor;

a dispersive optical element disposed between the lens and the light source and configured to form a first spectrum of a light of the light source and a second spectrum of the light of the light source on the image sensor, the first spectrum being different from the second spectrum; and

a processor configured to;

identify a first location of the first spectrum projected in a plane defined by the spatial image sensor using a first fixed distance between the image and the first spectrum respectively formed on the image sensor;

identify a second location of the second spectrum projected in the plane defined by the spatial image sensor using a second fixed distance between the image and the second spectrum respectively formed on the image sensor; and

classify the light source as belonging to a class selected from a plurality of classes of light sources based on a distance between the first location and the second location.

17. The system of claim 16, further comprising:

a hood enclosure including a portion disposed within a field of view of the lens to reduce the field of view to a predetermined degree such that light from another light source located outside of the reduced field of view does not superimpose at least one of the first or second spectrum.

18. The system of claim 16, wherein the processor uses the image of the light source and at least one of the first or second spectrum to classify the light source.

19. The system of claim 16, wherein the lens and the dispersive optical element are formed at different optical surfaces of a single optical element.

20. A method of classifying a light source, comprising:

forming, by a lens, an image of the light source on an image sensor;

forming, by a dispersive optical element disposed between the lens and the light source, a first spectrum of a light of the light source and a second spectrum of the light of the light source on the image sensor, the first spectrum being different from the second spectrum;

identifying, by a processor, a first location of the first spectrum in a plane defined by the spatial image sensor using a first fixed distance between the image and the first spectrum respectively formed on the image sensor;

identifying, by a processor, a second location of the second spectrum in a plane defined by the spatial image sensor using a second fixed distance between the image and the second spectrum respectively formed on the image sensor; and

classifying, by the processor, the light source as belonging to a class selected from a plurality of classes of light sources based on a distance between the first location and the second location.