Image processing device, image processing method, and image processing program, for detecting an image from a visible light image and a temperature distribution image

• US 9,552,646 B2
• Filed: 01/30/2014
• Issued: 01/24/2017
• Est. Priority Date: 02/15/2013
• Status: Active Grant

• Current Assignee: Omron Corporation
• Original Assignee: Omron Corporation
• Inventors: Tanaka, Bunzo, Togo, Koji, Kogure, Masamichi, Serikawa, Masataka
• Primary Examiner(s): SHAH, UTPAL D
• Application Number:
  US14/168,060
• Publication Number:
  US 20140233796A1
• Time in Patent Office: 1,090 Days
• US Class Current: 1/1
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/10048 Infrared image
• CPC Class Codes: G06T 2207/20021 Dividing image into blocks, subimages or windows
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 7/194 involving foreground-background segmentation
• CPC Class Codes: G06T 7/248 involving reference images or patches
• CPC Class Codes: G06V 40/10 Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands

Abstract

An image processing device has a first image input unit that inputs a visible light image of a target area imaged by a first camera, a second image input unit that inputs a temperature distribution image of the target area imaged by a second camera, a first image processing section that processes the visible light image input to the first image input unit, and detects an object imaged in the visible light image, a second image processing section that processes the temperature distribution image input to the second image input unit and detects an object imaged in the temperature distribution image, and an image region extracting unit that extracts an image region not suited for the detection of the object in the first image processing section for the visible light image of the target area input to the first image input unit.

Claims

1. An image processing device comprising:

a first image input unit that inputs a visible light image of a target area imaged by a first camera;

a second image input unit that inputs a temperature distribution image of the target area imaged by a second camera;

a first image processing section that processes the visible light image input to the first image input unit, and detects an object imaged in the visible light image;

a second image processing section that processes the temperature distribution image input to the second image input unit and detects an object imaged in the temperature distribution image; and

an image region extracting unit that extracts an image region not suited for a detection of the object in the first image processing section for the visible light image of the target area input to the first image input unit,

wherein the second image processing section processes an image region of the temperature distribution image input to the second image input unit corresponding to the image region of the visible light image extracted as not suited for the detection of the object in the first image processing section by the image region extracting unit, and detects an imaged object, and

wherein the image region extracting unit determines whether an image region not suited for the detection of the object in the first image processing section for every block obtained by dividing into plurals the visible light image of the target area input to the first image input unit.

2. The image processing device according to claim 1, wherein the image region extracting unit determines whether the image region not suited for the detection of the object in the first image processing section based on a total number of pixels outside a range of a pixel value defined in advance for every block obtained by dividing into plurals the visible light image of the target area input to the first image input unit.

3. The image processing device according to claim 2, wherein the image region extracting unit determines whether the image region not suited for the detection of the object in the first image processing section based on a ratio of a total number of pixels outside a range of a pixel value defined in advance and a total number of pixels of the block for every block obtained by dividing into plurals the visible light image of the target area input to the first image input unit.

4. The image processing device according to claim 1, wherein the second image processing section does not perform detection of the object with respect to the image region of the temperature distribution image input to the second image input unit corresponding to the image region of the visible light image for the image region not extracted as not suited for the detection of the object in the first image processing section by the image region extracting unit.

5. The image processing device according to claim 2, wherein the second image processing section does not perform detection of the object with respect to the image region of the temperature distribution image input to the second image input unit corresponding to the image region of the visible light image for the image region not extracted as not suited for the detection of the object in the first image processing section by the image region extracting unit.

6. The image processing device according to claim 3, wherein the second image processing section does not perform detection of the object with respect to the image region of the temperature distribution image input to the second image input unit corresponding to the image region of the visible light image for the image region not extracted as not suited for the detection of the object in the first image processing section by the image region extracting unit.

7. The image processing device according to claim 1, further comprising:

an output unit that integrates and outputs the detection results of the object by the first image processing section and the second image processing section.

8. The image processing device according to claim 2, further comprising:

an output unit that integrates and outputs the detection results of the object by the first image processing section and the second image processing section.

9. The image processing device according to claim 3, further comprising:

an output unit that integrates and outputs the detection results of the object by the first image processing section and the second image processing section.

10. The image processing device according to claim 4, further comprising:

an output unit that integrates and outputs the detection results of the object by the first image processing section and the second image processing section.

11. An image processing method, comprising:

a first image processing step of processing a visible light image of a target area input to a first image input unit and detecting an object imaged in the visible light image;

a second image processing step of processing a temperature distribution image input to a second image input unit and detecting an object imaged in the temperature distribution image; and

an image region extracting step of extracting an image region not suited for a detection of the object in the first image processing step for the visible light image of the target area input to the first image input unit,

wherein the second image processing step is a step of processing an image region of the temperature distribution image input to the second image input unit corresponding to the image region of the visible light image extracted as not suited for the detection of the object in the first image processing step in the image region extracting step, and detecting an imaged object, and

wherein the image region extracting step comprises determining whether an image region not suited for the detection of the object in the first image processing step for every block obtained by dividing into plurals the visable light image of the target area input to the first image input unit.

12. An image processing program stored on a non-transitory computer readable medium that causes a computer to perform:

a first image processing step of processing a visible light image of a target area input to a first image input unit and detecting an object imaged in the visible light image;

a second image processing step of processing a temperature distribution image input to a second image input unit and detecting an object imaged in the temperature distribution image; and

an image region extracting step of extracting an image region not suited for a detection of the object in the first image processing step for the visible light image of the target area input to the first image input unit,

wherein the second image processing step is a step of processing an image region of the temperature distribution image input to the second image input unit corresponding to the image region of the visible light image extracted as not suited for the detection of the object in the first image processing step in the image region extracting step, and detecting an imaged object and

wherein the image region extracting step comprises determining whether an image region not suited for the detection of the object in the first image processing step for every block obtained by diving into plurals the visable light image of the target area input to the first image input unit.