Enhanced vision system sensitive to infrared radiation

• US 6,806,469 B2
• Filed: 04/15/2002
• Issued: 10/19/2004
• Est. Priority Date: 03/05/1999
• Status: Expired due to Term

• Current Assignee: Teledyne FLIR LLC (Teledyne Technologies Incorporated)
• Original Assignee: FLIR Systems, Inc. (Teledyne Technologies Incorporated)
• Inventors: Kerr, Jones Richard
• Primary Examiner(s): Evans, F. L.
• Application Number:
  US10/123,539
• Publication Number:
  US 20020185600A1
• Time in Patent Office: 918 Days
• Field of Search: 250/330, 348/33, 348/113, 348/115, 348/116, 348/164
• US Class Current: 250/330
• CPC Class Codes: B64D 2045/0075 Adaptations for use of electronic flight bags in aircraft; Supports therefor in the cockpit
• CPC Class Codes: B64D 43/00 Arrangements or adaptations of instruments arrangements of cameras B64D47/08; aeronautical measuring instruments per se G01C
• CPC Class Codes: B64D 45/08 optical
• CPC Class Codes: G01C 21/20 Instruments for performing navigational calculations G01C21/24, G01C21/26 take precedence
• CPC Class Codes: G06T 1/20 Processor architectures; Processor configuration, e.g. pipelining
• CPC Class Codes: G08G 5/0021 located in the aircraft
• CPC Class Codes: G08G 5/025 Navigation or guidance aids radar or analogous systems specially adapted for landing purposes G01S13/913
• CPC Class Codes: H01L 27/14649 Infrared imagers
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

An enhanced vision system and method for use with vision systems with an imager sensitive to infrared radiation of less than 2-microns in wavelength, to produce a first image signal. Another imager sensitive to infrared radiation at least 3-microns in wavelength may be used to produce a second image signal. Preferably, the first image signal represents sensed electric light sources, and the second image signal represents sensed background such as terrain, runways, structures, and obstacles. A signal processor combines an image signal representing locally maximum values of the first image signal with the second image signal to create a displayed image.

Claims

1. A vision system, comprising:

a detection system configured to detect electromagnetic radiation; and

a signal processor operatively associated with the detection system and adapted to produce a modified image signal representing a portion of a detected image signal;

wherein the detection system is further adapted to produce first and second detected image signals corresponding to radiation detected over first and second ranges of wavelengths, respectively, the first and second ranges being at least partially nonoverlapping; and

wherein the signal processor is further adapted to combine the modified image signal representing at least one feature identified within the first image signal with the second image signal to create an output image signal.

2. The vision system of claim 1, wherein the second image signal is a background image signal.

3. The vision system of claim 1, wherein the signal processor is further adapted to compare at least one of the detected image signals to predefined data representative of expected sensed objects, and to modify the at least one of the detected image signals based on the comparison of the at least one of the detected image signals to the predefined data.

4. The vision system of claim 3, wherein the signal processor is further adapted to modify the at least one of the detected image signals to match the predefined data when sufficient similarity is found between the at least one of the detected image signals and the predefined data.

5. The vision system of claim 3, wherein the signal processor is further adapted to modify the at least one of the detected image signals by replacing a portion of the at least one of the detected image signals with a symbol.

6. The vision system of claim 3, wherein the signal processor is further adapted to modify the at least one of the detected image signals by replacing a portion of the at least one of the detected image signals with a reduced representation of the portion of the at least one of the detected image signals.

7. The vision system of claim 1, wherein the first image signal corresponds to radiation substantially emitted by electric lights, and the second image signal corresponds to radiation substantially emitted by background objects.

8. The vision system of claim 1, wherein the second image signal further corresponds to radiation not substantially emitted by electric lights.

9. The vision system of claim 7, wherein the signal processor is further adapted to compare the first image signal to a database of electric light patterns to identify a recognizable pattern, and to create the modified image signal to be representative of the recognizable pattern.

10. The vision system of claim 1, wherein the first range of wavelengths lies above about 0.4 microns and below about 2.4 microns.

11. The vision system of claim 1, wherein the second range of wavelengths lies above about 0.4 microns and below about 14 microns.

12. The vision system of claim 1, wherein the portion of the detected image signal includes at least one feature selected from the detected image signal.

13. The vision system of claim 12, wherein the at least one feature includes a detected radiation source.

14. The vision system of claim 13, wherein the detected radiation source includes the center of the detected radiation source.

15. The vision system of claim 13, wherein the detected radiation source includes a locally maximum value of the detected image signal.

16. The vision system of claim 1, wherein the first range of wavelengths corresponds to radiation substantially emitted by electric lights.

17. The vision system of claim 1, further comprising a display operatively associated with the signal processor and configured to present the displayed image.

18. A vision system, comprising:

a detection system configured to detect electromagnetic radiation, and to produce a first detected image signal corresponding to radiation detected over a first range of wavelengths; and

a signal processor operatively associated with the detection system and adapted to produce a modified image signal representing a portion of the detected image signal, wherein the signal processor is adapted to modify the detected image signal by replacing a portion of the detected image signal with a symbol.

19. The vision system of claim 18, wherein the detection system is further adapted to produce a second detected image signal corresponding to radiation detected over a second range of wavelengths, the first and second ranges being at least partially nonoverlapping, and wherein the signal processor is further adapted to combine the modified image signal representing at least one feature identified within the first image signal with the second image signal to create an output image signal.

20. The vision system of claim 19, wherein the second image signal is a background image signal.

21. The vision system of claim 19, wherein the signal processor is further adapted to compare at least one of the detected image signals to predefined data representative of expected sensed objects, and to modify the at least one of the detected image signals based on the comparison of the at least one of the detected image signals to the predefined data.

22. The vision system of claim 21, wherein the signal processor is further adapted to modify the at least one of the detected image signals to match the predefined data when sufficient similarity is found between the at least one of the detected image signals and the predefined data.

23. The vision system of claim 21, wherein the signal processor is further adapted to modify the at least one of the detected image signals by replacing a portion of the at least one of the detected image signals with a symbol.

24. The vision system of claim 21, wherein the signal processor is further adapted to modify the at least one of the detected image signals by replacing a portion of the at least one of the detected image signals with a reduced representation of the portion of the at least one of the detected image signals.

25. The vision system of claim 19, wherein the first image signal corresponds to radiation substantially emitted by electric lights, and the second image signal corresponds to radiation substantially emitted by background objects.

26. The vision system of claim 25, wherein the second image signal further corresponds to radiation not substantially emitted by electric lights.

27. The vision system of claim 25, wherein the signal processor is further adapted to compare the first image signal to a database of electric light patterns to identify a recognizable pattern, and to create the modified image signal to be representative of the recognizable pattern.

28. The vision system of claim 19, wherein the first range of wavelengths lies above about 0.4 microns and below about 2.4 microns.

29. The vision system of claim 19, wherein the second range of wavelengths lies above about 0.4 microns and below about 14 microns.

30. The vision system of claim 18, wherein the first range of wavelengths lies above about 0.4 microns and below about 2.4 microns.

31. The vision system of claim 18, wherein the signal processor is further adapted to modify the detected image signal by replacing a portion of the detected image signal with a reduced representation of the portion of the detected image signal.

32. The vision system of claim 18, wherein the portion of the detected image signal includes at least one feature selected from the detected image signal.

33. The vision system of claim 32, wherein the at least one feature includes a detected radiation source.

34. The vision system of claim 32, wherein the detected radiation source includes the center of the detected radiation source.

35. The vision system of claim 32, wherein the detected radiation source includes a locally maximum value of the detected image signal.

36. The vision system of claim 18, wherein the first range of wavelengths corresponds to radiation substantially emitted by electric lights.

37. The vision system of claim 18, further comprising a display operatively associated with the signal processor and configured to present the displayed image.

38. A vision system, comprising:

a detection system configured to detect electromagnetic radiation, and to produce a first detected image signal corresponding to radiation detected over a first range of wavelengths; and

a signal processor operatively associated with the detection system and adapted to produce a modified image signal representing a portion of the detected image signal, wherein the signal processor is adapted to modify the detected image signal by replacing a portion of the detected image signal with a reduced representation of the portion of the detected image signal.

39. The vision system of claim 38, wherein the detection system is further adapted to produce a second detected image signal corresponding to radiation detected over a second range of wavelengths, the first and second ranges being at least partially nonoverlapping, and wherein the signal processor is further adapted to combine the modified image signal representing at least one feature identified within the first image signal with the second image signal to create an output image signal.

40. The vision system of claim 39, wherein the second image signal is a background image signal.

41. The vision system of claim 39, wherein the signal processor is further adapted to compare at least one of the detected image signals to predefined data representative of expected sensed objects, and to modify the at least one of the detected image signals based on the comparison of the at least one of the detected image signals to the predefined data.

42. The vision system of claim 41, wherein the signal processor is further adapted to modify the at least one of the detected image signals to match the predefined data when sufficient similarity is found between the at least one of the detected image signals and the predefined data.

43. The vision system of claim 41, wherein the signal processor is further adapted to modify the at least one of the detected image signals by replacing a portion of the at least one of the detected image signals with a symbol.

44. The vision system of claim 41, wherein the signal processor is further adapted to modify the at least one of the detected image signals by replacing a portion of the at least one of the detected image signals with a reduced representation of the portion of the at least one of the detected image signals.

45. The vision system of claim 39, wherein the first image signal corresponds to radiation substantially emitted by electric lights, and the second image signal corresponds to radiation substantially emitted by background objects.

46. The vision system of claim 45, wherein the second image signal further corresponds to radiation not substantially emitted by electric lights.

47. The vision system of claim 45, wherein the signal processor is further adapted to compare the first image signal to a database of electric light patterns to identify a recognizable pattern, and to create the modified image signal to be representative of the recognizable pattern.

48. The vision system of claim 39, wherein the first range of wavelengths lies above about 0.4 microns and below about 2.4 microns.

49. The vision system of claim 39, wherein the second range of wavelengths lies above about 0.4 microns and below about 14 microns.

50. The vision system of claim 38, wherein the first range of wavelengths lies above about 0.4 microns and below about 2.4 microns.

51. The vision system of claim 38, wherein the portion of the detected image signal includes at least one feature selected from the detected image signal.

52. The vision system of claim 51, wherein the at least one feature includes a detected radiation source.

53. The vision system of claim 52, wherein the detected radiation source includes the center of the detected radiation source.

54. The vision system of claim 52, wherein the detected radiation source includes a locally maximum value of the detected image signal.

55. The vision system of claim 38, wherein the first range of wavelengths corresponds to radiation substantially emitted by electric lights.

56. The vision system of claim 38, further comprising a display operatively associated with the signal processor and configured to present the displayed image.

57. A vision system, comprising:

means for detecting electromagnetic radiation; and

means for producing a modified image signal representing a portion of a detected image signal;

wherein the means for detecting are further for producing first and second image signals corresponding to radiation detected over first and second ranges of wavelengths, respectively, the first and second ranges being at least partially nonoverlapping; and

wherein the means for producing is further for combining the modified image signal representing at least one feature identified within the first image signal with the second image signal to create an output image signal.

58. The vision system of claim 57, further comprising means for presenting the modified image.