APPARATUS FOR MEASURING INTERIOR TEMPERATURE OF VEHICLE USING 3D THERMAL IMAGE

• US 20150103141A1
• Filed: 06/26/2013
• Published: 04/16/2015
• Est. Priority Date: 06/26/2012
• Status: Active Grant

• Current Assignee: Hanon Systems (Hahn & Co. Auto Holdings Co. Ltd.)
• Original Assignee: Halla Visteon Climate Control Corp (Hahn & Co. Auto Holdings Co. Ltd.)
• Inventors: Lee, Jeong Hoon, Kim, Young Min, Kim, Yeong Kil, Song, Seung Cheol, Baek, Chang Hyun
• Granted Patent: US 10,132,666 B2
• Time in Patent Office: Days
• US Class Current: 348/43
• CPC Class Codes: G01F 1/68 by using thermal effects
• CPC Class Codes: G01J 2005/0077 Imaging
• CPC Class Codes: G01J 5/0025 Living bodies ear thermometers G01J5/0011; detecting, measuring or recording for diagnostic purposes A61B5/00
• CPC Class Codes: G01J 5/041 Mountings in enclosures or in a particular environment
• CPC Class Codes: G01J 5/07 Arrangements for adjusting the solid angle of collected radiation, e.g. adjusting or orienting field of view, tracking position or encoding angular position optical collimating elements G01J5/0806
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/271 wherein the generated image signals comprise depth maps or disparity maps
• CPC Class Codes: H04N 23/23 from thermal infrared radiation
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

An apparatus for measuring interior temperature of a vehicle using a 3D thermal image may include: a pair of stereo infrared (IR) sensors arranged at the front of the vehicle interior so as to be spaced from each other, and configured to measure 2D thermal images for the vehicle interior including a passenger; a calculator configured to convert the 2D thermal images measured through the pair of stereo IR sensors into a 3D thermal image; and a controller configured to calibrate the 3D thermal image information acquired through the calculator, according to variables having an influence on the temperature of the vehicle interior.

Claims

1-20. -20. (canceled)

21. An apparatus for measuring interior temperature of a vehicle using a three-dimensional thermal image, comprising:

a pair of stereo infrared sensors spaced apart from each other and disposed in a front of an interior of the vehicle, the pair of stereo infrared sensors configured to measure two-dimensional thermal images of the interior of the vehicle;

a calculator in communication with the pair of stereo infrared sensors configured to convert the two-dimensional thermal images measured by the pair of stereo infrared sensors into a three-dimensional thermal image; and

a controller in communication with the calculator and the pair of stereo infrared sensors, the controller configured to calibrate the three-dimensional thermal image converted by the calculator.

22. The apparatus according to claim 21, wherein each of the pair of stereo infrared sensors is disposed in the front of the interior of the vehicle at a position configured to measure a temperature of at least one of a first front seat, a second front seat, a first rear seat, and a second rear seat.

23. The apparatus according to claim 22, wherein the pair of stereo infrared sensors is disposed adjacent a rear of a room mirror of the vehicle.

24. The apparatus according to claim 22, wherein each of the pair of stereo infrared sensors includes a plurality of infrared lenses, at least one of the infrared lenses is a narrow-angle lens.

25. The apparatus according to claim 24, wherein each of the infrared lenses of each of the stereo infrared sensors has an angle of view in a range of about 55 degrees to about 75 degrees.

26. The apparatus according to claim 22, wherein a first one of the pair of stereo infrared sensors is disposed adjacent a left end of a room mirror of the vehicle and a second one of the pair of stereo infrared sensors is disposed adjacent a right end of the room mirror.

27. The apparatus according to claim 21, wherein each of the stereo infrared sensors is disposed in the front of the interior of the vehicle at a position configured to measure a temperature of a first front seat, a second front seat, a first rear seat, and a second rear seat.

28. The apparatus according to claim 21, wherein a first one of the pair of stereo infrared sensors is disposed on a left A-pillar of the vehicle and a second one of the pair of stereo infrared sensors is disposed on a right A-pillar of the vehicle.

29. The apparatus according to claim 28, wherein each of the pair of stereo infrared sensors includes a plurality of infrared lenses, at least one of the infrared lenses is a narrow-angle lens.

30. The apparatus according to claim 29, wherein each of the infrared lenses of each of the stereo infrared sensors has an angle of view in a range of about 55 degrees to about 75 degrees.

31. The apparatus according to claim 27, wherein a first one of the pair of stereo infrared sensors is disposed on a bottom of a left A-pillar of the vehicle and a second one of the pair of stereo infrared sensors is disposed on a bottom of a right A-pillar of the vehicle.

32. A method for measuring interior temperature of a vehicle using a three-dimensional thermal image, comprising the steps of:

providing a pair of stereo infrared sensors spaced apart from each other and disposed in a front of an interior of the vehicle;

measuring two-dimensional thermal images of the interior of the vehicle with the pair of stereo infrared sensors;

providing a controller and a calculator in communication with the pair of stereo infrared sensors;

converting the two-dimensional thermal images measured by the pair of stereo infrared sensors into a three-dimensional thermal image by the calculator; and

calibrating a temperature value of the three-dimensional thermal image converted by the calculator according to a plurality of temperature variables by the controller.

33. The method according to claim 32, wherein the step of calibrating the temperature value of the three-dimensional thermal image converted by the calculator according to the plurality of temperature variables by the controller includes the steps of:

calibrating the pair of stereo infrared sensors to correct distortion;

measuring a thermal image formed in the interior of the vehicle through each of the pair of stereo infrared sensors to four a two-dimensional thermal image;

comparing the thermal image measured by a first one of the pair of stereo infrared sensors with the thermal image measured by a second one of the pair of stereo infrared sensors;

obtaining a coordinate disparity between corresponding points of the thermal image measured by the first one of the pair of stereo infrared sensors and the thermal image measured by the second one of the pair of stereo infrared sensors; and

acquiring a three-dimensional thermal image by imaging and mapping the coordinate disparity.

34. The method according to claim 33, further comprising the steps of removing an afterimage, a vibration, and a noise from each of the thermal images measured by the pair of stereo infrared sensors, and rectifying each of the thermal images measured by the pair of stereo infrared sensors with a calibration characteristic value of each of the stereo infrared sensors.

35. The method according to claim 32, further comprising the step of calibrating a first temperature value measured by the pair of stereo infrared sensors at a specific coordinate of the interior of the vehicle to a second temperature value by the controller if a distance from the pair of stereo infrared sensors to the specific coordinate of the interior of the vehicle is one of equal to and greater than a predetermined distance, and wherein the second temperature value is greater than the first temperature value.

36. The method according to claim 32, further comprising the steps of:

comparing a temperature value measured by a first one of the pair of stereo infrared sensors at a specific coordinate of the interior of the vehicle with a temperature value measured by a second one of the pair of stereo infrared sensors at the specific coordinate of the interior of the vehicle by the controller; and

determining a failure in one of the pair of stereo infrared sensors if a difference between the temperature value measured by the first one of the pair of stereo infrared sensors and the temperature value measured by the second one of the pair of stereo infrared sensors is one of equal to and greater than a tolerance.

37. The method according to claim 36, further comprising the steps of:

considering the specific coordinate of the interior of the vehicle as an error point by the controller if the temperature difference between the temperature value measured by the first one of the pair of stereo infrared sensors and the temperature value measured by the second one of the pair of stereo infrared sensors deviates from the tolerance;

counting a frequency of an occurrence of the error point;

offsetting the temperature value measured by the one of the pair of infrared sensors determined the failure by the controller if the frequency of the occurrence of the error point is one of equal to and greater than 50%; and

calibrating a pixel of the thermal images measured by the pair of stereo infrared sensors by the controller if the frequency of the occurrence of the error point is less than 50%, wherein the pixel corresponds to the error point.

38. The method according to claim 36, further comprising the step of calibrating the temperature value of the thermal image measured through the one of the pair of infrared sensors determined the failure by the controller by using a preset temperature value, the preset temperature value corresponds to a member positioned in the interior of the vehicle.

39. The method according to claim 32, wherein the step of calibrating a temperature value of the three-dimensional thermal image converted by the calculator according to a plurality of temperature variables by the controller includes the step of using a preset emissivity of a member positioned in the interior of the vehicle.

40. The method according to claim 39, wherein the step of calibrating a temperature value of the three-dimensional thermal image converted by the calculator according to a plurality of temperature variables by the controller includes the step of applying a radiant energy weight to the member by the controller, wherein a magnitude of the radiant energy weight corresponds to a magnitude of a weight of one of a human body, a ceiling of the vehicle, a door trim of the vehicle, a clothing of the member, a seat of the vehicle, and a glass of the vehicle.