Device attachment with infrared imaging sensor

• US 9,986,175 B2
• Filed: 06/23/2015
• Issued: 05/29/2018
• Est. Priority Date: 03/02/2009
• Status: Active Grant

• Current Assignee: Teledyne FLIR LLC (Teledyne Technologies Incorporated)
• Original Assignee: FLIR Systems, Inc. (Teledyne Technologies Incorporated)
• Inventors: Frank, Jeffrey D., Hgasten, Nicholas, Hoelter, Theodore R., Strandemar, Katrin, Boulanger, Pierre, Sharp, Barbara, Teich, Andrew C., Dumpert, Dwight, Nussmeier, Mark, Kurth, Eric A.
• Primary Examiner(s): Jagan, Mirellys
• Application Number:
  US14/747,202
• Publication Number:
  US 20150288892A1
• Time in Patent Office: 1,071 Days
• Field of Search: 374121, 374208
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/51 Housings
• CPC Class Codes: H04N 23/55 Optical parts specially adapted for electronic image sensors; Mounting thereof
• CPC Class Codes: H04N 23/57 Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 25/671 for non-uniformity detection or correction
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

Various techniques are disclosed for providing a device attachment configured to releasably attach to and provide infrared imaging functionality to mobile phones or other portable electronic devices. For example, a device attachment may include a housing with a tub on a rear surface thereof shaped to at least partially receive a user device, an infrared sensor assembly disposed within the housing and configured to capture thermal infrared image data, and a processing module communicatively coupled to the infrared sensor assembly and configured to transmit the thermal infrared image data to the user device. Thermal infrared image data may be captured by the infrared sensor assembly and transmitted to the user device by the processing module in response to a request transmitted by an application program or other software/hardware routines running on the user device.

Claims

1. A device attachment comprising:

a housing configured to releasably attach to a mobile user device to support mobile operation of the device attachment in conjunction with the mobile user device;

an infrared sensor assembly within the housing, the infrared sensor assembly configured to capture thermal infrared image data;

a processing module communicatively coupled to the infrared sensor assembly and configured to provide information associated with the thermal infrared image data to the mobile user device for display by the mobile user device; and

a device connector configured to pass the thermal infrared image data from the processing module to the mobile user device,

wherein the device attachment is configured to capture the thermal infrared image data using the infrared sensor assembly in response to a request received from the mobile user device.

2. The device attachment of claim 1, further comprising:

a lens configured to pass infrared radiation through to the infrared sensor assembly,

wherein the device connector is further configured to pass electrical power from the mobile user device to the device attachment for use by the device attachment.

3. The device attachment of claim 1, wherein the device connector is further configured to pass electrical power to the mobile user device for use by the mobile user device, wherein the mobile user device is a mobile personal electronic device, and wherein the request is based on user input received at the mobile user device.

4. The device attachment of claim 1, wherein the housing comprises at least a partial enclosure having a rear wall and at least one sidewall that form a recess configured to receive the mobile user device, wherein the mobile user device is a mobile personal electronic device.

5. The device attachment of claim 1, wherein the processing module is configured to provide the information associated with the thermal infrared image data to the mobile user device for display by the mobile user device in response to the request from the mobile user device.

6. The device attachment of claim 1, wherein:

the thermal infrared image data comprises an intentionally blurred image frame and an unblurred image frame; and

the processing module is configured to determine a plurality of non-uniformity correction (NUC) terms based on the intentionally blurred image frame and apply the NUC terms to the unblurred image frame to remove noise from the unblurred image frame.

7. The device attachment of claim 1, wherein:

the infrared sensor assembly comprises a focal plane array (FPA) configured to capture the thermal infrared image data; and

the FPA comprises an array of microbolometers adapted to receive a bias voltage selected from a range of approximately 0.2 volts to approximately 0.7 volts.

8. The device attachment of claim 1, further comprising an opening configured to receive non-thermal light and pass the non-thermal light to be captured as non-thermal image data by a non-thermal camera module.

9. The device attachment of claim 8, wherein:

the non-thermal camera module is configured to capture the non-thermal image data from a scene at a first time;

the infrared sensor assembly is configured to capture the thermal infrared image data from the scene at a second time, wherein the thermal infrared image data comprises a radiometric component; and

the processing module is configured to process the thermal infrared image data and the non-thermal image data to generate a combined image comprising visible spectrum characteristics of the scene derived from the non-thermal image data and infrared characteristics of the scene derived from the radiometric component of the thermal infrared image data.

10. The device attachment of claim 8, further comprising a shutter configured to selectively block or unblock the infrared sensor assembly and/or the non-thermal camera module, wherein the non-thermal camera module comprises a visible-light camera module within the housing.

11. The device attachment of claim 10, wherein the device attachment is configured to power down when the infrared sensor assembly and the non-thermal camera module are blocked by the shutter.

12. A method of providing infrared imaging functionality for a mobile user device, the method comprising:

releasably attaching to the mobile user device a device attachment to support mobile operation of the device attachment in conjunction with the mobile user device, the device attachment comprising an infrared sensor assembly and a processing module;

receiving from the mobile user device a request for capturing and transmitting thermal infrared image data;

capturing the thermal infrared image data at the infrared sensor assembly in response to the request; and

transmitting, in response to the request, the thermal infrared image data to the mobile user device using the processing module for display by the mobile user device.

13. The method of claim 12, wherein the device attachment comprises a housing comprising at least a partial enclosure having a rear wall and at least one sidewall that form a recess configured to receive the mobile user device, wherein the mobile user device is a mobile personal electronic device.

14. The method of claim 12, wherein the device attachment comprises a device connector, the method further comprising:

passing the thermal infrared image data from the processing module to the mobile user device through the device connector.

15. The method of claim 12, further comprising:

generating, using the mobile user device, the request for capturing and transmitting the thermal infrared image data; and

transmitting the request to the device attachment.

16. The method of claim 12, further comprising:

detecting a depression of a button provided on the device attachment; and

transmitting a signal to the mobile user device in response to the detected depression of the button.

17. The method of claim 12, wherein:

the infrared sensor assembly comprises a focal plane array (FPA) configured to capture the thermal infrared image data; and

the FPA comprises an array of microbolometers; and

the method further comprises providing a bias voltage to the microbolometers selected from a range of approximately 0.2 volts to approximately 0.7 volts.

18. The method of claim 12, wherein the thermal infrared image data comprises an unblurred image frame, the method further comprising:

capturing an intentionally blurred image frame;

determining a plurality of non-uniform correction (NUC) terms based on the intentionally blurred image frame; and

applying the NUC terms to the unblurred image frame to remove noise from the unblurred image frame.

19. The method of claim 18, wherein the determining and the applying is by a processor of the mobile user device.

20. The method of claim 12, further comprising:

capturing non-thermal image data using a non-thermal camera module.

21. The method of claim 20, further comprising:

combining the thermal infrared image data and the non-thermal image data,

wherein the non-thermal camera module is in the device attachment or the mobile user device.

22. The method of claim 20, wherein:

the non-thermal camera module is configured to capture the non-thermal image data from a scene at a first time;

the infrared sensor assembly is configured to capture the thermal infrared image data from the scene at a second time, wherein the thermal infrared image data comprises a radiometric component; and

the method further comprises processing the thermal infrared image data and the non-thermal image data to generate a combined image comprising visible spectrum characteristics of the scene derived from the non-thermal image data and infrared characteristics of the scene derived from the radiometric component of the thermal infrared image data.

23. A method of providing infrared imaging functionality for a mobile user device, the method comprising:

releasably attaching to the mobile user device a device attachment to support mobile operation of the device attachment in conjunction with the mobile user device, the device attachment comprising an infrared sensor assembly and a processing module;

capturing thermal infrared image data at the infrared sensor assembly;

capturing non-thermal image data using a non-thermal camera module; and

providing information associated with the thermal infrared image data to the mobile user device using the processing module for display by the mobile user device.

24. The method of claim 23, further comprising:

combining the thermal infrared image data and the non-thermal image data, wherein;

the non-thermal camera module is in the device attachment or the mobile user device, and

the providing is in response to a request from the mobile user device.