Apparatus for measuring interior temperature of vehicle using 3D thermal image

• US 10,132,666 B2
• Filed: 06/26/2013
• Issued: 11/20/2018
• Est. Priority Date: 06/26/2012
• Status: Expired due to Fees

• Current Assignee: Hanon Systems (Hahn & Co. Auto Holdings Co. Ltd.)
• Original Assignee: Hanon Systems (Hahn & Co. Auto Holdings Co. Ltd.)
• Inventors: Lee, Jeong Hoon, Kim, Yeong Kil, Song, Seung Cheol, Baek, Chang Hyun, Kim, Young Min
• Primary Examiner(s): Luo, Kate H
• Application Number:
  US14/391,738
• Publication Number:
  US 20150103141A1
• Time in Patent Office: 1,973 Days
• Field of Search: None
• CPC Class Codes: G01F 1/68 by using thermal effects
• CPC Class Codes: G01J 2005/0077 Imaging
• CPC Class Codes: G01J 5/0025 Living bodies ear thermometers G01J5/0011; detecting, measuring or recording for diagnostic purposes A61B5/00
• CPC Class Codes: G01J 5/041 Mountings in enclosures or in a particular environment
• CPC Class Codes: G01J 5/07 Arrangements for adjusting the solid angle of collected radiation, e.g. adjusting or orienting field of view, tracking position or encoding angular position optical collimating elements G01J5/0806
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/271 wherein the generated image signals comprise depth maps or disparity maps
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

An apparatus for measuring interior temperature of a vehicle using a 3D thermal image may include: a pair of stereo infrared (IR) sensors arranged at the front of the vehicle interior so as to be spaced from each other, and configured to measure 2D thermal images for the vehicle interior including a passenger; a calculator configured to convert the 2D thermal images measured through the pair of stereo IR sensors into a 3D thermal image; and a controller configured to calibrate the 3D thermal image information acquired through the calculator, according to variables having an influence on the temperature of the vehicle interior.

Claims

1. A method for measuring interior temperature of a vehicle using a three-dimensional thermal image, comprising the steps of:

providing a pair of stereo infrared sensors spaced apart from each other and disposed in a front of an interior of the vehicle;

measuring two-dimensional thermal images of the interior of the vehicle with the pair of stereo infrared sensors;

providing a controller and a calculator in communication with the pair of stereo infrared sensors;

converting the two-dimensional thermal images measured by the pair of stereo infrared sensors into a three-dimensional thermal image by the calculator;

calibrating a temperature value of the three-dimensional thermal image converted by the calculator according to a plurality of temperature variables by the controller; and

calibrating a first temperature value measured by the pair of stereo infrared sensors at a specific coordinate of the interior of the vehicle to a second temperature value by the controller if a distance from the pair of stereo infrared sensors to the specific coordinate of the interior of the vehicle is one of equal to and greater than a predetermined distance, and wherein the second temperature value is greater than the first temperature value.

2. The method according to claim 1, wherein the step of calibrating the temperature value of the three-dimensional thermal image converted by the calculator according to the plurality of temperature variables by the controller includes the steps of:

calibrating the pair of stereo infrared sensors to correct distortion;

measuring a thermal image formed in the interior of the vehicle through each of the pair of stereo infrared sensors to form a two-dimensional thermal image;

comparing the thermal image measured by a first one of the pair of stereo infrared sensors with the thermal image measured by a second one of the pair of stereo infrared sensors;

obtaining a coordinate disparity between corresponding points of the thermal image measured by the first one of the pair of stereo infrared sensors and the thermal image measured by the second one of the pair of stereo infrared sensors; and

acquiring a three-dimensional thermal image by imaging and mapping the coordinate disparity.

3. The method according to claim 2, further comprising the steps of removing an afterimage, a vibration, and a noise from each of the thermal images measured by the pair of stereo infrared sensors, and rectifying each of the thermal images measured by the pair of stereo infrared sensors with a calibration characteristic value of each of the stereo infrared sensors.

4. A method for measuring interior temperature of a vehicle using a three-dimensional thermal image, comprising the steps of:

providing a pair of stereo infrared sensors spaced apart from each other and disposed in a front of an interior of the vehicle;

measuring two-dimensional thermal images of the interior of the vehicle with the pair of stereo infrared sensors;

providing a controller and a calculator in communication with the pair of stereo infrared sensors;

converting the two-dimensional thermal images measured by the pair of stereo infrared sensors into a three-dimensional thermal image by the calculator;

calibrating a temperature value of the three-dimensional thermal image converted by the calculator according to a plurality of temperature variables by the controller;

comparing a temperature value measured by a first one of the pair of stereo infrared sensors at a specific coordinate of the interior of the vehicle with a temperature value measured by a second one of the pair of stereo infrared sensors at the specific coordinate of the interior of the vehicle by the controller; and

determining a failure in one of the pair of stereo infrared sensors if a difference between the temperature value measured by the first one of the pair of stereo infrared sensors and the temperature value measured by the second one of the pair of stereo infrared sensors is one of equal to and greater than a tolerance.

5. The method according to claim 4, further comprising the steps of:

considering the specific coordinate of the interior of the vehicle as an error point by the controller if the temperature difference between the temperature value measured by the first one of the pair of stereo infrared sensors and the temperature value measured by the second one of the pair of stereo infrared sensors deviates from the tolerance;

counting a frequency of an occurrence of the error point;

offsetting the temperature value measured by the one of the pair of infrared sensors determined the failure by the controller if the frequency of the occurrence of the error point is one of equal to and greater than 50%; and

calibrating a pixel of the thermal images measured by the pair of stereo infrared sensors by the controller if the frequency of the occurrence of the error point is less than 50%, wherein the pixel corresponds to the error point.

6. The method according to claim 4, further comprising the step of calibrating the temperature value of the thermal image measured through the one of the pair of infrared sensors determined the failure by the controller by using a preset temperature value, the preset temperature value corresponds to a member positioned in the interior of the vehicle.

7. A method for measuring interior temperature of a vehicle using a three-dimensional thermal image, comprising the steps of:

providing a pair of stereo infrared sensors spaced apart from each other and disposed in a front of an interior of the vehicle;

measuring two-dimensional thermal images of the interior of the vehicle with the pair of stereo infrared sensors;

providing a controller and a calculator in communication with the pair of stereo infrared sensors;

converting the two-dimensional thermal images measured by the pair of stereo infrared sensors into a three-dimensional thermal image by the calculator; and

calibrating a temperature value of the three-dimensional thermal image converted by the calculator according to a plurality of temperature variables by the controller, wherein the step of calibrating a temperature value of the three-dimensional thermal image converted by the calculator according to a plurality of temperature variables by the controller includes the steps of using a preset emissivity of a member positioned in the interior of the vehicle and applying a radiant energy weight to the member by the controller, and wherein a magnitude of the radiant energy weight corresponds to a magnitude of a weight of one of a human body, a ceiling of the vehicle, a door trim of the vehicle, a clothing of the member, a seat of the vehicle, and a glass of the vehicle.