Enhanced perception lighting

• US 7,315,241 B1
• Filed: 12/01/2004
• Issued: 01/01/2008
• Est. Priority Date: 12/01/2004
• Status: Expired due to Fees

• Current Assignee: HRL Laboratories LLC (The Boeing Co.)
• Original Assignee: HRL Laboratories LLC (The Boeing Co.)
• Inventors: Furmanaki, Chris, Azuma, Ron, Daily, Mike
• Primary Examiner(s): Pope; Daryl C
• Application Number:
  US11/002,877
• Time in Patent Office: 1,126 Days
• Field of Search: 340/525, 340/524, 340/901, 340/903, 340/933, 340/942, 340/554, 340/555, 340/556, 340/557, 340/552
• US Class Current: 340/525
• CPC Class Codes: G02B 2027/0118 comprising devices for improving the contrast of the display / brillance control visibility
• CPC Class Codes: G02B 2027/0134 of stereoscopic type
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features

Abstract

The present invention relates to an enhanced perception lighting (EPL) system for providing enhanced perception of a user'"'"'s physical environment. The EPL system comprises a sensor module for detecting and sampling a physical aspect from at least one point in a physical environment and for generating an observation signal based on the physical aspect; a processor module coupled with the sensor module for receiving the observation signal, processing the observation signal, and generating an output signal based on the observation signal; and a projection display module located proximate the sensor module and communicatively connected with the processor module for projecting a display onto the at least one point in the physical environment based upon the output signal. The system allows a user to gather information from the physical environment and project that information onto the physical environment to provide the user with an enhanced perception of the physical environment.

Claims

1. An enhanced perception lighting system for providing enhanced perception of a user'"'"'s physical environment, comprising a processor module configured to receive an observation signal from a sensor module that detects and samples a physical aspect from at least one point in a physical environment, the processor module operative to gather information about the physical aspect at the at least one point and generate an output signal based on the physical aspect, the processor module being further configured to be communicatively connected with a projection display module for projecting a display onto the at least one point in the physical environment based upon the output signal, whereby the system allows a user to gather information from the physical environment and project that information back onto the physical environment in order to provide the user with an enhanced perception of the physical environment.

2. An enhanced perception lighting system as set forth in claim 1, further comprising a sensor module communicatively connected with the processor module for detecting and sampling a physical aspect from at least one point in a physical environment and for generating an observation signal based on the physical aspect.

3. An enhanced perception lighting system as set forth in claim 2, further comprising a projection display module communicatively connected with the processor module for projecting a display onto the at least one point in the physical environment based upon the output signal.

4. An enhanced perception lighting system as set forth in claim 2, further comprising a projection display module located proximate the sensor module and communicatively connected with the processor module for projecting a display onto the at least one point in the physical environment based upon the output signal.

5. An enhanced perception lighting system as set forth in claim 4, wherein the sensor module further includes a digitizer for receiving analog data from a sensor and digitizing it into an image as the observation signal, which is thereafter fed into the processor module.

6. An enhanced perception lighting system as set forth in claim 5, wherein the sensor module is an item selected from a group consisting of a radiation sensor, an image sensor, a motion and ranging sensor, a Ultra wide-band radar, an X-ray sensor, an infrared sensor, a Magnetometer sensor, a chemical sensor, an Olfactory sensor, a low-light charge-coupled device (LLCCD) sensor, a image intensifier sensor, a charge-coupled device (CCD) sensor, an Ultra Violet sensor, an Audio sensor, a Sonar, a Radar, a Global Positioning Satellite, and a temperature sensor.

7. An enhanced perception lighting system as set forth in claim 6, wherein the processor module further includes a memory module for storing an observation signal received from the sensor module.

8. An enhanced perception lighting system as set forth in claim 7, wherein the processor module further includes a feature extraction module for extracting salient features from the observation signal, whereby extracting the salient features enhances qualities of the observation signal, such as contrast, brightness and transparency.

9. An enhanced perception lighting system as set forth in claim 8, wherein the feature extraction module is configured to perform at least one image processing function.

10. An enhanced perception lighting system as set forth in claim 9, wherein the at least one image processing function is a function selected from a group consisting of edge detection, high pass filtering in the Fourier domain, histogram equalization, homomorphic filtering, physics-based quantitative models, and figure ground segmentation.

11. An enhanced perception lighting system as set forth in claim 10, wherein the figure ground segmentation is a technique selected from a group consisting of threshold, edges, regions, and connectivity preserving relaxation.

12. An enhanced perception lighting system as set forth in claim 11, wherein the processor module further includes an object recognition module for classifying an object present in the observation signal.

13. An enhanced perception lighting system as set forth in claim 12, wherein the object recognition module is configured to employ a technique selected from a group consisting of a model-based matching approach, learning vector-quantization, support vector machines, and fusion classifiers.

14. An enhanced perception lighting system as set forth in claim 13, wherein the processor module further includes a database module for storing information related to the observation signal in order to enhance functionality of the system.

15. An enhanced perception lighting system as set forth in claim 14, wherein the processor module further includes a user interface module communicatively connected with the system for allowing a user to control the system.

16. An enhanced perception lighting system as set forth in claim 15, wherein the processor module further includes a renderer module for preparing information related to the observation signal as an output signal for projection by the projection display module.

17. An enhanced perception lighting system as set forth in claim 16, wherein the renderer module is configured to prepare at least one perceptual feature from a list consisting of dark adaptation, contract enhancement, stereoscopic depth, projected feature size at distances, motion compensation, and occluded information visualization.

18. An enhanced perception lighting system as set forth in claim 17, wherein the processor module further includes a Field of View matching module for calibrating the system to enable accurate projection of information onto the environment to maximize registration of input and output fields of view.

19. An enhanced perception lighting system as set forth in claim 18, wherein the display projected by the projection display module is a display selected from a group consisting of vector and raster.

20. An enhanced perception lighting system as set forth in claim 19, further comprising a network interface communicatively attached with the processor module, allowing the system to be communicatively connected with other devices.

21. An enhanced perception lighting system as set forth in claim 1, wherein the processor module is configured to receive an observation signal from an X-ray sensor, the processor module operative to detect an object within a container and to generate an output signal based upon a location of the object within the container, whereby the system is configured to allow a user to point a device incorporating the system at a container, sense an object within the container and project onto an exterior surface of the container an image portraying the object within the container.

22. An enhanced perception lighting system as set forth in claim 21, further comprising an X-ray sensor communicatively connected with the processor module for detecting and sampling the object within the container, and for generating an observation signal based on the object.

23. An enhanced perception lighting system as set forth in claim 22, further comprising a projection display module located proximate the X-ray sensor and communicatively connected with the processor module for receiving the output signal and projecting a display onto the exterior surface of the container.

24. An enhanced perception lighting system as set forth in claim 1, wherein the processor module is configured to receive an observation signal from a thermal sensor and function as a surface temperature imager, the processor module operative to receive a user'"'"'s preferred temperature limit, detect a surface temperature, and generate an output signal that is reflective of the surface temperature when the surface temperature exceeds a user'"'"'s preset temperature limit, whereby the system is configured to allow a user to project a surface'"'"'s temperature upon the surface.

25. An enhanced perception lighting system as set forth in claim 24, further comprising a thermal sensor communicatively connected with the processor module for detecting and sampling a surface temperature from at least one point on the surface, and for generating an observation signal based on the surface temperature.

26. An enhanced perception lighting system as set forth in claim 25, further comprising a projection display module located proximate the thermal sensor and communicatively connected with the processor module for receiving the output signal and projecting a display onto the at least one point on the surface based upon the output signal.

27. An enhanced perception lighting system as set forth in claim 26, wherein the projection display module includes a plurality of display colors and is configured so that the display is projected in a plurality of colors, each color indicative of a particular temperature.

28. An enhanced perception lighting system as set forth in claim 1, wherein the processor module is configured to receive an observation signal from a magnetometer and function as an in-wall wire detector, the processor module operative to detect a location of a wire behind a wall surface and generate an output signal that is reflective of the location of the wire, whereby a user may point the device at a wall surface and project upon the wall surface an image at a location of a wire detected behind the surface.

29. An enhanced perception lighting system as set forth in claim 28, further comprising a magnetometer communicatively connected with the processor module for detecting and sampling the location of a wire, and for generating an observation signal based on the location.

30. An enhanced perception lighting system as set forth in claim 29, further comprising a projection display module located proximate the magnetometer and communicatively connected with the processor module for projecting a display onto the wall surface at the location of the wire.

31. An enhanced perception lighting system as set forth in claim 1, wherein the processor module is configured to receive an observation signal from a chemical sensor and function as a chemical localizer, the processor module operative to detect a source of a chemical and generate an output signal reflective of the source, allowing a user to locate a chemical and project an image on the source of the chemical.

32. An enhanced perception lighting system as set forth in claim 31, further comprising a chemical sensor communicatively connected with the processor module for detecting and sampling a chemical, and for generating an observation signal based on the chemical.

33. An enhanced perception lighting system as set forth in claim 32, further comprising a projection display module located proximate the chemical sensor and communicatively connected with the processor module for projecting an image onto the source of the chemical.

34. An enhanced perception lighting system as set forth in claim 1, wherein the processor module is configured to receive an observation signal from a sensor selected from a group consisting of an infrared sensor, a low-light charge-coupled device sensor, a motion sensor, a ultra-violet sensor, a charge-coupled device sensor, a global positioning satellite, a sonar, a radar, and a image intensifier sensor, the processor module operative to detect a feature in a local environment and generate an output signal based upon a location of the feature, whereby the system allows a user to locate and illuminate a feature in a local environment.

35. An enhanced perception lighting system as set forth in claim 34, further comprising a sensor selected from a group consisting of an infrared sensor, a low-light charge-coupled device sensor, a motion sensor, a ultra-violet sensor, a charge-coupled device sensor, a global positioning satellite, a sonar, a radar, and a image intensifier sensor, the sensor communicatively connected with the processor module for detecting and sampling a feature in the local environment, and for generating an observation signal based on the feature.

36. An enhanced perception lighting system as set forth in claim 35, further comprising a projection display module located proximate the sensor and communicatively connected with the processor module for receiving the output signal and for projecting an image onto the feature.

37. An enhanced perception lighting system as set forth in claim 36, wherein the system is configured to function as a street lamp, the system being operative to illuminate a feature proximate a pedestrian.

38. An enhanced perception lighting system as set forth in claim 36, wherein the system is configured to function as indoor lighting, the system being operative to illuminate indoor, pre-designated features.

39. An enhanced perception lighting system as set forth in claim 36, wherein the system is configured to function as an outdoor security light, the system being operative to pinpoint and illuminate moving objects within a range of view of the security light.

40. An enhanced perception lighting system as set forth in claim 36, wherein the system is configured to function as predictive lighting, the system being operative to allow a user to select a desired look of a particular environment, process features from the particular environment corresponding with the desired look, and project an image onto the local environment corresponding to the desired look, whereby through use of the system, a user can alter the particular environment to look like a selected model.

41. An enhanced perception lighting system as set forth in claim 36, wherein the system is configured to function as a sun burn detector, the system being operative to detect areas of a user'"'"'s skin that reflect ultra-violet light and project an image onto the area reflecting ultra-violet light, allowing a user to detect a presence of a sunburn.

42. An enhanced perception lighting system as set forth in claim 36, wherein the system is configured to function as an underwater terrain visualizer, the system being operative to detect a feature of an underwater terrain and project an image onto the feature.

43. An enhanced perception lighting system as set forth in claim 36, wherein the system is configured to function as a handheld flashlight, allowing a user to point the handheld flashlight and illuminate the feature.

44. An enhanced perception lighting system as set forth in claim 36, wherein system is incorporated into a vehicle and is configured to function as a car'"'"'s headlight.

45. An enhanced perception lighting system as set forth in claim 1, wherein the processor module is operative to receive an observation signal from an audio tracker, detect a sound in a observation signal, convert the sound to text, and generate an output signal based on the text, whereby the system detects and converts words and sounds into a text to be projected upon a surface.

46. An enhanced perception lighting system as set forth in claim 45, further comprising an audio tracker communicatively connected with the processor module for detecting and sampling an audio signal in the local environment, and for generating an observation signal based on the audio signal.

47. An enhanced perception lighting system as set forth in claim 46, further comprising a projection display module located proximate the audio tracker and communicatively connected with the processor module for receiving the output signal and for projecting an image onto a surface.

48. An enhanced perception lighting system as set forth in claim 1, wherein the sensor module is an item selected from a group consisting of a radiation sensor, an image sensor, a motion and ranging sensor, a Ultra wide-band radar, an X-ray sensor, an infrared sensor, a Magnetometer sensor, a chemical sensor, an Olfactory sensor, a low-light charge-coupled device (LLCCD) sensor, a image intensifier sensor, a charge-coupled device (CCD) sensor, an Ultra Violet sensor, an Audio sensor, a Sonar, a Radar, a Global Positioning Satellite, and a temperature sensor.

49. An enhanced perception lighting system as set forth in claim 1, wherein the processor module further includes a memory module for storing an observation signal received from the sensor module.

50. An enhanced perception lighting system as set forth in claim 1, wherein the processor module further includes a feature extraction module for extracting salient features from the observation signal, whereby extracting the salient features enhances qualities of the observation signal, such as contrast, brightness and transparency.

51. An enhanced perception lighting system as set forth in claim 50, wherein the feature extraction module includes at least one image processing function.

52. An enhanced perception lighting system as set forth in claim 51, wherein the at least one image processing function is a function selected from a group consisting of edge detection, high pass filtering in the Fourier domain, histogram equalization, homomorphic filtering, physics-based quantitative models, and figure ground segmentation.

53. An enhanced perception lighting system as set forth in claim 52, wherein the figure ground segmentation is a technique selected from a group consisting of threshold, edges, regions, and connectivity preserving relaxation.

54. An enhanced perception lighting system as set forth in claim 1, wherein the processor module further includes an object recognition module for classifying an object present in the observation signal.

55. An enhanced perception lighting system as set forth in claim 54, wherein the object recognition module employs a technique selected from a group consisting of a model-based matching approach, learning vector-quantization, support vector machines, and fusion classifiers.

56. An enhanced perception lighting system as set forth in claim 1, wherein the processor module further includes a database module for storing information related to the observation signal in order to enhance functionality of the system.

57. An enhanced perception lighting system as set forth in claim 1, wherein the processor module further includes a user interface module communicatively connected with the system for allowing a user to control the system.

58. An enhanced perception lighting system as set forth in claim 1, wherein the processor module further includes a renderer module for preparing information related to the observation signal as an output signal for projection by the projection display module.

59. An enhanced perception lighting system as set forth in claim 58, wherein the renderer module prepares at least one perceptual feature from a list consisting of dark adaptation, contract enhancement, stereoscopic depth, projected feature size at distances, motion compensation, and occluded information visualization.

60. An enhanced perception lighting system as set forth in claim 1, wherein the processor module further includes a Field of View matching module for calibrating the system to enable accurate projection of information onto the environment to maximize registration of input and output fields of view.

61. An enhanced perception lighting system as set forth in claim 1, wherein the display projected by the projection display module is a display selected from a group consisting of vector and raster.

62. An enhanced perception lighting system as set forth in claim 1, further comprising a network interface allowing the system to be communicatively connected with other devices.