Method and system for projecting a visible representation of infrared radiation

• US 9,835,445 B2
• Filed: 08/29/2014
• Issued: 12/05/2017
• Est. Priority Date: 02/29/2012
• Status: Active Grant

• Current Assignee: Flir Systems AB (Teledyne Technologies Incorporated)
• Original Assignee: Flir Systems AB (Teledyne Technologies Incorporated)
• Inventors: Strandemar, Katrin, Jnsson, Henrik
• Primary Examiner(s): Vo, Tung
• Application Number:
  US14/473,976
• Publication Number:
  US 20140368641A1
• Time in Patent Office: 1,194 Days
• Field of Search: 348136
• CPC Class Codes: G01B 11/254 Projection of a pattern, viewing through a pattern, e.g. moiré
• CPC Class Codes: G03B 17/54 with projector
• CPC Class Codes: G03B 42/00 Obtaining records using waves other than optical waves; Visualisation of such records by using optical means
• CPC Class Codes: G06T 3/00 Geometric image transformations in the plane of the image
• CPC Class Codes: H04N 5/265 Mixing
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20
• CPC Class Codes: H04N 5/74 Projection arrangements for image reproduction, e.g. using eidophor
• CPC Class Codes: H04N 9/3185 Geometric adjustment, e.g. keystone or convergence optical or mechanical adjustment of convergence H04N9/317; using scanning means H04N3/22; optical or mechanical adjustments of projectors not peculiar to the presence of an electronic spatial light modulator G03B21/14
• CPC Class Codes: H04N 9/3194 including sensor feedback

Abstract

A method for enabling easier interpretation and analysis of an observed real world scene by presenting a visible representation of infrared (IR) radiation information, based on IR radiation emitted from said real world scene, and additional information onto said observed real world scene, using thermography arrangement comprising an IR imaging system, a visible light imaging system and a visible light projecting system.

Claims

1. A method of enabling easier interpretation and analysis of an observed real world scene by presenting a visible representation of infrared (IR) radiation information, based on IR radiation emitted from said observed real world scene, onto said observed real world scene, using a thermography arrangement comprising an IR imaging system and a visible light projecting system, the method comprising:

capturing, by said IR imaging system, IR radiation information based on detected IR radiation emitted from said observed real world scene;

creating a visible representation of said captured IR radiation information;

detecting distance information associated with said observed real world scene in relation to said thermography arrangement;

adjusting said visible representation of said captured IR radiation information based on said detected distance information such that said adjusted visible representation of said captured IR radiation information, when projected onto said observed real world scene, is aligned with said detected IR radiation emitted from said observed real world scene; and

projecting, by said visible light projecting system, said adjusted visible representation of said captured IR radiation information onto said observed real world scene in alignment with said detected IR radiation emitted from said observed real world scene.

2. The method of claim 1, further comprising:

creating a visible representation of additional information dependent on a signal received from a predetermined source comprising at least one of;

user input;

a processor;

a memory;

a sensor; and

/or a measuring device; and

creating a combined IR image comprising said adjusted visible representation of said captured IR radiation information and said visible representation of additional information, wherein said projecting comprises projecting said combined IR image onto said observed real world scene.

3. The method of claim 1, wherein detecting said distance information comprises:

retrieving at least one distance from said thermography arrangement to said observed real world scene; and

calculating at least one length and/or a size of an area in said observed real world scene based on said retrieved distance.

4. The method of claim 2, wherein said additional information comprises length measurement information, a guiding help grid, grid lines, orientation information, temperature-related information, writing/text, a sketch, and/or a drawing, wherein said length measurement information enables projection to scale of the length measurement information onto said observed real world scene, and wherein said orientation information enables a user to interpret an orientation of parts of the observed real world scene.

5. The method of claim 4, wherein said length measurement information as additional information is is rendered in the form of a ruler to scale when projected onto the observed real world scene.

6. The method of claim 4, wherein said orientation information as additional information is rendered in the form of a level or a bubble level when projected onto the observed real world scene.

7. The method of claim 1, wherein said visible light projecting system comprises a laser projector.

8. The method of claim 2, wherein said additional information comprises graphical elements presented in a graphical user interface (GUI) on a display of said thermography arrangement, wherein said additional information is input through touch functionality, and wherein the method further comprises enabling a user to control what is being presented in said GUI on said display of said thermography arrangement, by means of control devices integrated in or coupled to said thermography arrangement.

9. The method of claim 8, wherein said graphical elements represent a selection of:

measurement values presented as temperature, humidity, emissivity, or effect (W or W/m²);

one or more point and/or area markers for selecting one or more points and/or areas of interest;

one or more input fields for user input; and

one or more selectable menu items.

10. The method of claim 1, wherein said projecting of said visible representation of said captured IR radiation information onto said real world scene is performed in real time, live, or near real time.

11. The method of claim 1, further comprising controlling the visible light projecting system to provide an alarm if one or more of the following alarm criteria are fulfilled:

one or more parts of the observed real world scene has a measurement value above a preset threshold limit;

one or more parts of the observed real world scene has a measurement value below a preset threshold limit;

one or more parts of the observed real world scene has a measurement value within a preset interval;

or

one or more parts of the observed real world scene has a measurement value outside a preset interval.

12. The method of claim 11, further comprising adjusting brightness levels and/or color values of said visible light projected based on brightness levels and/or color values of said one or more parts of the observed real world scene onto which the visible light is projected, wherein said visible light projecting system is controlled to provide an alarm by:

if said visible light projecting system was already projecting;

flashing, increasing brightness and/or adjusting color values of said projected combined IR image; and

/or projecting visible light only onto said one or more parts of the observed real world scene wherein said one or more criteria are fulfilled;

or

if said visible light projecting system was not projecting;

projecting visible light onto said one or more parts of said real world scene where said one or more criteria are fulfilled or onto said entire observed real world scene, thereby alerting the user.

13. The method of claim 1, wherein the projecting comprises projecting in accordance with a user selected projection mode selected from different projection modes comprising:

projecting the adjusted visible light-representation of the captured IR radiation information onto the entire observed real world scene;

projecting a portion of the adjusted visible representation of the captured IR radiation information onto corresponding one or more objects comprised in the observed real world scene;

projecting a corresponding portion of the adjusted visible representation of the captured IR radiation information onto selected parts of one or more objects comprised in the observed real world scene;

projecting a visible representation of a marker onto the observed real world scene;

projecting a visible representation of a marker on hot spots or objects;

or

projecting a visible representation of a marker on cold spots or objects.

14. The method of claim 3, wherein more than one distance is retrieved and said more than one distance are used to create a distance map or distance image, wherein the distances of said distance map or distance image are used to adjust the visible representation of the captured IR radiation information such that the visible representation of the captured IR radiation information, when projected, is aligned with the observed real world scene at different depths dependent on the distance map, and wherein the method further comprises projecting pixels of the visible representation with varying density, dependent on the distances of the distance map, or distance image, and preset conditions.

15. The method of claim 1, wherein said thermography arrangement further comprises a visible light imaging system, and wherein said adjusting is further based on information captured by said visible light imaging system.

19. A non-transitory computer-readable medium on which is stored machine-readable instructions executable to control a processor to perform the method of claim 1.

16. A thermography arrangement to enable easier interpretation and analysis of an observed real world scene by presenting a visible representation of infrared (IR) radiation information based on IR radiation emitted from said real world scene, onto said observed real world scene based on IR radiation emitted from said observed real world scene, wherein said visible representation of IR radiation information is projected in alignment with said IR radiation emitted from said observed real world scene, the arrangement comprising:

an IR imaging system configured to capture IR radiation information based on detected IR radiation emitted from said observed real world scene according to a first field of view;

a visible light projecting system configured to project visible light onto said observed real world scene according to a second field of view, at least partially overlapping said first field of view; and

a processor configured to execute instructions to cause said thermography arrangement to perform operations comprising;

creating a visible representation of said captured IR radiation information,

detecting distance information associated with said observed real world scene in relation to the thermography arrangement, and

adjusting said visible representation of said captured IR radiation information based on said detected distance information such that said adjusted visible representation of said captured IR radiation information, when projected onto said observed real world scene, is aligned with said detected IR radiation emitted from said observed real world scene,

wherein said visible light projecting system is further configured to project said adjusted visible representation of said captured IR radiation information onto said observed real world scene in alignment with said detected IR radiation emitted from said observed real world scene.

17. The arrangement of claim 16, further comprising a visible light imaging system configured to capture a visible light image of said observed real world scene, according to a third field of view, said third field of view at least partially overlapping said first and/or second field of view;

and said processor further configured to adjust the combined IR image using the visible light image captured by said visible light imaging system.

18. The arrangement of claim 16, wherein the processor is a field programmable gate array (FPGA) or another processing device configurable using a hardware description language (HDL).

20. The arrangement of claim 16, wherein the operations further comprise:

creating a visible representation of additional information dependent on a signal received from a predetermined source comprising at least one of;

user input;

a processor;

a memory;

a sensor; and

/or a measuring device; and

creating a combined IR image comprising said adjusted visible representation of said captured IR radiation information and said visible representation of additional information, wherein said projecting comprises projecting said combined IR image onto said observed real world scene.

21. The arrangement of claim 16, wherein detecting said distance information comprises:

retrieving at least one distance from-said thermography arrangement to said observed real world scene; and

calculating at least one length and/or a size of an area in said observed real world scene based on said retrieved distance.

22. The arrangement of claim 21, wherein more than one distance is retrieved and the more than one distance are used to create a distance map or distance image, wherein the distances of the distance map or distance image are used to adjust the visible representation of the captured IR radiation information such that the visible representation of the captured IR radiation information, when projected, is aligned with the observed real world scene at different depths dependent on the distance map, and wherein the operations further comprise projecting pixels of the visible representation with varying density, dependent on the distances of the distance map, or distance image, and preset conditions.