Method and apparatus for providing adaptive illumination

• US 6,993,255 B2
• Filed: 07/09/2001
• Issued: 01/31/2006
• Est. Priority Date: 02/16/1999
• Status: Expired due to Fees

• Current Assignee: Microsoft International Holdings BV (Microsoft Corporation)
• Original Assignee: 3DV Systems Ltd. (Microsoft Corporation)
• Inventors: Yahav, Giora, Braun, Ori J.
• Primary Examiner(s): PERKEY, WILLIAM B
• Application Number:
  US10/332,646
• Publication Number:
  US 20040114921A1
• Time in Patent Office: 1,667 Days
• Field of Search: 396/61, 396/106, 396/109, 396/159, 396/164, 396/182, 396/100, 348/61, 348/135, 348/169, 348/370, 348/371, 348/136, 348/143, 348/152, 362/11, 362/276, 362464-466, 362/4, 362 16- 18, 382/103, 315/149
• US Class Current: 396/61
• CPC Class Codes: B60Q 2400/50 Projected symbol or information, e.g. onto the road or car body
• CPC Class Codes: B60Q 9/008 for anti-collision purposes
• CPC Class Codes: F21S 41/141 Light emitting diodes [LED]
• CPC Class Codes: F21S 41/147 the main emission direction of the LED being angled to the optical axis of the illuminating device
• CPC Class Codes: F21S 41/663 by switching light sources by switching incandescent light sources F21S41/162
• CPC Class Codes: G01C 11/025 by scanning the object
• CPC Class Codes: G01S 17/08 for measuring distance only indirect measurement G01S17/46; active triangulation systems G01S17/48
• CPC Class Codes: G01S 17/18 wherein range gates are used
• CPC Class Codes: G01S 17/88 Lidar systems specially adapted for specific applications
• CPC Class Codes: G01S 17/89 for mapping or imaging
• CPC Class Codes: G01S 7/4812 transmitted and received beams following a coaxial path
• CPC Class Codes: G01S 7/51 Display arrangements
• CPC Class Codes: G02B 7/32 using active means, e.g. light emitter including both an active and a passive focus detecting device G02B7/285; using ultrasound G02B7/40
• CPC Class Codes: H04N 23/56 provided with illuminating means
• CPC Class Codes: H04N 23/74 by influencing the scene brightness using illuminating means

Abstract

An illumination system (20, 72, 110, 142) for illuminating a scene comprising: an illuminator (24, 74, 116) having a plurality of substantially contiguous independently controllable light (26, 76) providing regions each of which provides light that illuminates a different region of the scene; optics (30) that directs light from the illuminator to the scene; a range finder (22, 64, 112) that determines distances to regions of the scene; and a controller (28, 29, 118) that controls the plurality of light providing regions to provide light for illuminating the scene responsive to distances determined by the range finder (22, 64, 112).

Claims

1. An illumination system for illuminating a scene, comprising:

an illuminator having a plurality of substantially contiguous independently controllable light providing regions each of which provides light that illuminates a different region of the scene;

optics that directs light from the illuminator to the scene;

a photosurface having pixels that is boresighted with the optics and the illuminator; and

a controller;

wherein the controller controls the photosurface to acquire an image the scene using light from the illuminator reflected by the scene and controls the light providing regions of the illuminator responsive to the image.

2. An illumination system according to claim 1 wherein the controller is programmable to control the light providing regions to provide desired illumination effects.

3. An illumination system according to claim 1 wherein the photosurface is comprised in a 3D camera and the controller controls the 3D camera to determine distances to regions of the scene responsive to the image of the scene and controls the plurality of light providing regions to provide light for illuminating the scene responsive to the distances.

4. A light bulb comprising an illumination system according to claim 1.

5. A light bulb according to claim 4 adapted to be installed in a conventional light bulb socket.

6. An illumination system according to claim 3 wherein the photosurface is a gated photosurface

7. An illumination system according to claim 1 wherein the controller comprises a pattern recognition application which the controller uses to identity features and/or objects in images of the scene formed on the photosurface.

8. An automotive light for use in a vehicle for illuminating a roadway scene comprising a portion of a road on which the vehicle is located and neighboring regions thereof, the automotive light comprising an illumination system according to claim 1.

9. An illumination system according to claim 3 wherein the controller comprises a pattern recognition application which the controller uses to identify features and/or objects in images of the scene formed on the photosurface.

10. An illumination system according to claim 9 wherein the controller controls the light providing regions to provide light that illuminates the scene responsive to one or both of features and objects that it identifies in the image.

11. An illumination system according to claim 9 wherein the controller controls the 3D range-camera to acquire a first image of the scene at a first time and a second image of the scene at a second time and identifies a feature of the scene that has a location in the second image different from its location in the first image.

12. An illumination system according to claim 11 wherein the controller uses the difference in location of the feature a difference between the first and second times, and distance of the feature from the illumination system to determine a transverse component of velocity of the feature in a direction substantially perpendicular to a direction along which the illumination system illuminates the feature.

13. An illumination system according to claim 12 wherein the controller controls the light providing regions to provide light that illuminates the scene responsive to the transverse component of velocity.

14. An illumination system according to claim 3 wherein the controller controls the 3D camera to determine distances to a region of the scene at a first time and a second time and uses a difference in the distances and a difference between the first and second times to determine a radial component of velocity of the region along a direction substantially parallel to a direction along which the illumination system illuminates the region.

15. An illumination system according to claim 14 wherein the controller controls the light providing regions to provide light that illuminates the scene responsive to the radial component of velocity.

16. An illumination system according to claim 3 wherein the controller controls the light providing regions to illuminate only regions of the scene that are located within a desired range of distances from the illumination system.

17. An illumination system according to claim 3 wherein the controller controls intensity of light provided by light providing regions responsive to distances determined by the 3D camera.

18. An illumination system according to claim 3 wherein the controller controls the light providing regions so that relative intensity of light provided by the illuminator that illuminates two different regions of the scene is substantially proportional to a ratio of the squares of their respective distances from the illumination system.

19. An illumination system according to claim 3 wherein the controller controls the 3D range-camera to repeatedly acquire an image of the scene and determine distances to regions of the scene at a frequency equal to or greater than 25 Hz.

20. An illumination system according claim 19 wherein following the acquisition of each image, the controller adjusts light provided by the light providing regions to match changes in the positions of one or both of features and objects in the scene relative to their positions in an immediately preceding image of the scene.

21. An illumination system according to claim 20 wherein a time lapse between acquisition of the image and a time at which the illuminator provides light adjusted responsive to the image is sufficiently short so that during the time lapse the positions of features and/or objects of the scene do not change sufficiently to generate a substantial mismatch between the illumination and the scene.

22. An illumination system according to claim 21 wherein the time lapse is less than about 50 milliseconds.

23. An illumination system according to claim 21 wherein the time lapse is less than about 25 milliseconds.

24. An automotive light for use in a vehicle for illuminating a roadway scene comprising a portion of a road on which the vehicle is located and neighboring regions thereof, the automotive light comprising an illumination system according to claim 3.

25. An automotive light according to claim 24 wherein the controller controls the illumination system to determine distances to objects in the roadway scene at different times and uses a change in distance of an object as a function of time to determine if the vehicle and object are closing at a dangerous speed.

26. An automotive light according to claim 25 wherein if the controller determines that the vehicle and object are closing at a dangerous speed the controller controls the illumination system to generate an optical cue that alerts the driver to the danger.

27. An automotive light according to claim 26 wherein the optical cue comprises a spatial light pattern that the illumination system projects on the object.

28. An automotive light according to claim 26 wherein the optical cue comprises a spatial light pattern that the illumination system projects on the road.

29. An automotive light according to claim 26 wherein the light providing regions are controllable to provide different color light and wherein the optical cue is formed with colored light.

30. An automotive light according to claim 26 wherein the optical cue is time dependent.

31. An automotive light according to claim 24 wherein the controller processes images of the roadway scene provided by the photosurface to identify road signs in the roadway scene.

32. An automotive light according to claim 31 wherein when a roadway sign is identified, the controller controls the light providing regions to direct a beam of light that illuminates the roadway sign.

33. An automotive light according to claim 32 wherein the controller controls the light providing regions so that intensity of light they provide to illuminate signs farther from the vehicle is greater than intensity of light they provide to illuminate signs closer to the vehicle.

34. An automotive light acording to claim 33 wherein intensity of light provided by the light providing regions to illuminate a road sign is substantially proportional to the square of a distance of the sign from the vehicle.

35. An automotive light according to claim 24 wherein the photosensor is sensitive to color and the light providing regions are controllable to provide different color light and wherein the controller processes an image of the sign to determine its color components and controls hue and saturation of light that illuminates the sign to enhance its readability.

36. An automotive light according to claim 6 wherein the controller controls the light providing regions to radiate a train of light pulses and following each light pulse the controller gates on the photosurface for a short gate timed with respect to a time at which the light pulse is radiated and having a gate width so that light received by the photosurface during the gate is substantially only light reflected from matter in the air in a small volume of space located a short distance immediately in front of the illumination system and wherein the controller uses an amount of light received by the photosurface during the gates to determine visibility of the atmosphere.

37. An automotive light according to claim 36 wherein the controller adjusts illumination provided by the illumination system responsive to the determined visibility.

38. An automotive light according to claim 36 wherein light providing regions of the illuminator are controllable to provide visible light at different wavelengths and the controller determines visibility as a function of wavelength.

39. An automotive light according to claim 38 wherein the controller adjusts wavelength of visible light provided by the light providing regions to maximize visibility.

40. An automotive light according to claim 24 wherein the controller controls the 3D range-camera to repeatedly acquire an image of the roadway scene and determine distances to regions of the roadway scene at a frequency equal to or greater than 25 Hz.

41. An automotive light according to claim 40 wherein the frequency at which images are taken is a function of speed at which the vehicle is traveling.

42. An automotive light according to claim 40 wherein following the acquisition of each image, the controller adjusts light provided by the light providing regions to match changes in the positions of one or both of features and objects in the roadway scene relative to their positions in an immediately preceding image of the roadway scene.

43. An automotive light according to claim 24 wherein following the acquisition of each image, the controller adjusts light provided by the light providing regions to match changes in the positions of one or both of features and objects in the scene relative to their positions in an immediately preceding image of the scene.

44. An automotive light according to claim 43 wherein a time lapse between acquisition of the image and a time at which the illuminator provides light adjusted responsive to the image is sufficiently short so that during the time lapse the positions of features and/or objects of the roadway scene do not change sufficiently to generate a substantial mismatch between the illumination and the scene.

45. An automotive light according to claim 44 wherein the time lapse is less than about 50 milliseconds.

46. An automotive light according to claim 44 wherein the time lapse is less than about 25 milliseconds.

47. An automotive light according to claim 24 wherein the automotive light is a headlight.

48. An automotive light according to claim 47 wherein the controller process images provided by the photosurface to identify oncoming vehicles and when an oncoming vehicle is identified, the controller controls the light providing regions to prevent blinding the driver of the oncoming vehicle.

49. An automotive light according to claim 24 wherein the automotive light is a tail light.

50. A visual surveillance system comprising an illumination system according to claim 3 that illuminates a zone intended for visual surveillance by a watchman.

51. A visual surveillance system according to claim 50 wherein the controller controls the 3D camera to repeatedly image the surveillance zone and processes the images to determine presence of a person in the surveillance zone.

52. A visual surveillance system according to claim 51 wherein if the controller determines that a person is present in the surveillance zone the controller controls the light providing regions to generate an optical cue to alert the watchman to the person'"'"'s presence.