ELECTRONIC DEVICE FOR PROVIDING THERMAL IMAGE AND METHOD THEREOF

• US 20170201662A1
• Filed: 01/09/2017
• Published: 07/13/2017
• Est. Priority Date: 01/07/2016
• Status: Abandoned Application

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Kang, Hwayong, Jang, Donghoon, KIM, Dongsoo, Jeong, Jaeoh, Won, Jonghoon, Lee, Kihuk
• Application Number:
  US15/401,837
• Publication Number:
  US 20170201662A1
• Time in Patent Office: Days
• CPC Class Codes: H04N 23/10 for generating image signals from different wavelengths
• CPC Class Codes: H04N 23/11 for generating image signals from visible and infrared light wavelengths
• CPC Class Codes: H04N 23/13 with multiple sensors
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/54 Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
• CPC Class Codes: H04N 23/6812 based on additional sensors, e.g. acceleration sensors
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

An electronic device is provided. The electronic device includes a display, an image sensor including a color pixel sensor, a thermal image sensor, and a processor configured to acquire a first image of a subject using the color pixel sensor, acquire a second image of the subject using the thermal image sensor, and replace a part of an area of the first image with the second image thereby creating an modified first image that is output through the display.

Claims

1. An electronic device comprising:

a display;

an image sensor comprising a color pixel sensor;

a thermal image sensor; and

a processor configured to acquire a first image of a subject using the color pixel sensor, acquire a second image of the subject using the thermal image sensor, and replace a part of an area of the first image with the second image thereby creating an modified first image that is output through the display.

2. The electronic device of claim 1, wherein the image sensor further comprises the thermal image sensor.

3. The electronic device of claim 1, wherein the color pixel sensor is provided on a first substrate and the thermal image sensor is provided on a second substrate.

4. The electronic device of claim 1, wherein the processor is further configured to acquire color information corresponding to the color pixel sensor and thermal image information corresponding to the thermal image sensor at the same time.

5. The electronic device of claim 1, wherein the processor is further configured to change the part of the area of the first image using at least a part of the second image, at least based on a motion of the electronic device.

6. The electronic device of claim 3, wherein the image sensor further comprises a control unit provided on a third substrate, wherein the control unit is configured to control the color pixel sensor and the thermal image sensor at the same time.

7. The electronic device of claim 6, wherein the image sensor further comprises an output unit provided on the third substrate, wherein the color pixel sensor and the thermal image sensor are configured to output a signal to the output unit.

8. The electronic device of claim 7, wherein the third substrate is oriented vertically with respect to the first substrate and the second substrate.

9. The electronic device of claim 8, wherein the third substrate is electrically connected with the first substrate and the second substrate through a through silicon via (TSV).

10. The electronic device of claim 6, further comprising:

a first via formed on the first substrate and the third substrate; and

a second via formed on the first substrate, wherein the control unit is further configured to transmit a signal to one of the color pixel sensor and the thermal image sensor through the first via and the second via.

11. The electronic device of claim 10, further comprising:

a third via formed on the first substrate and the third substrate; and

a fourth via formed on the first substrate, wherein one of the color pixel sensor and the thermal image sensor are configured to output a signal to the output unit through the third via and the fourth via.

12. The electronic device of claim 1, wherein the image sensor is operably connected to a camera module comprising a lens, and the color pixel sensor and the thermal image sensor are disposed in an identical area in an optical format that is an area on which the lens focuses.

13. The electronic device of claim 1, wherein the part replaced with the second image of the modified first image is extended according to the moving direction of the electronic device.

14. A method of an electronic device that comprises a display, a color pixel sensor, a thermal image sensor, and a processor, the method comprising:

acquiring a first image of a subject using the color pixel sensor;

acquiring a second image of the subject using the thermal image sensor; and

replacing a part of an area of the first image with the second image thereby creating a modified first image and outputting the same through the display.

15. The method of claim 14, wherein acquiring the second image comprises acquiring color information corresponding to the color pixel sensor and thermal image information corresponding to the thermal image sensor at the same time.

16. The method of claim 14, wherein outputting the modified first image comprises changing the part of the area of the first image using at least a part of the second image, at least based on a motion of the electronic device.

17. The method of claim 14, wherein outputting the modified first image comprises the part replaced with the second imaged is extended according to the moving direction of the electronic device.

18. The method of claim 14, wherein outputting the modified first image comprises displaying the first image, the second image, and a scan direction of the subject.

19. The method of claim 14, wherein acquiring the second image comprises acquiring a thermal image of the subject using the thermal image sensor.

20. The method of claim 14, wherein outputting the modified first image comprises acquiring motion information of scanning the subject, wherein the first image and the second image are matched and displayed using the motion information.