Image processing device, image processing method, program, and electronic device

• US 8,477,235 B2
• Filed: 01/31/2011
• Issued: 07/02/2013
• Est. Priority Date: 02/04/2010
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Mitani, Satoshi, Saijo, Nobuhiro
• Primary Examiner(s): Velez, Roberto
• Assistant Examiner(s): PHAM, QUAN L
• Application Number:
  US13/017,577
• Publication Number:
  US 20110187899A1
• Time in Patent Office: 883 Days
• Field of Search: 348/370
• US Class Current: 348/370
• CPC Class Codes: A61B 5/0077 Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: G06V 10/143 Sensing or illuminating at different wavelengths
• CPC Class Codes: G06V 40/10 Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: H04N 23/40 Circuit details for pick-up tubes
• CPC Class Codes: H04N 9/68 for controlling the amplitude of colour signals, e.g. automatic chroma control circuits H04N9/71, H04N9/73 take precedence; camera processing pipelines for controlling the colour saturation of colour signals H04N23/86

Abstract

An image processing device for detecting a skin region representing a skin of a subject from a pickup image obtained by imaging said subject, the image processing device includes: a first irradiating section; a second irradiating section; an image pickup section; an adjusting section; and a skin detecting section.

Claims

1. An image processing device for detecting a skin region representing a skin of a subject from a pickup image obtained by imaging said subject, the image processing device comprising:

first irradiating means for irradiating said subject with light of a first wavelength;

second irradiating means for irradiating said subject with light of a second wavelength different from said first wavelength;

image pickup means for imaging said subject;

adjusting means for adjusting a parameter of said image pickup means within a range in which a skin detectable condition for detecting said skin region is satisfied on a basis of an outside light image obtained by imaging said subject by said image pickup means in a state of said subject not being irradiated with light of said first wavelength or light of said second wavelength; and

skin detecting means for detecting said skin region on a basis of a first pickup image obtained by imaging said subject when said subject is irradiated with light of said first wavelength by said image pickup means having the parameter adjusted by said adjusting means and a second pickup image obtained by imaging said subject when said subject is irradiated with light of said second wavelength by said image pickup means having the parameter adjusted by said adjusting means

wherein said adjusting means adjusts the parameter of said image pickup means within a range in which said skin detectable condition that a luminance value of a pixel forming said outside light image be equal to or lower than half of a maximum luminance value that can be obtained by imaging of said image pickup means is satisfied.

2. The image processing device according to claim 1,

wherein said adjusting means adjusts the parameter of said image pickup means within a range in which said skin detectable condition that the luminance value of the pixel forming said outside light image be half of the maximum luminance value that can be obtained by imaging of said image pickup means is satisfied.

3. The image processing device according to claim 1,

wherein said adjusting means adjusts the parameter of said image pickup means on a basis of an average value of luminance values of pixels forming said outside light image.

4. The image processing device according to claim 1,

wherein said adjusting means adjusts the parameter of said image pickup means on a basis of a luminance value of a maximum number of pixels among luminance values of pixels forming said outside light image.

5. The image processing device according to claim 1,

wherein said adjusting means adjusts the parameter of said image pickup means on a basis of a luminance value of a pixel when a luminance integration count obtained by performing integration starting with a pixel having a low luminance value becomes a predetermined value among luminance values of pixels forming said outside light image.

6. The image processing device according to claim 1,

wherein said adjusting means adjusts at least one of a gain of said image pickup means, receiving sensitivity, and light reception time as the parameter of said image pickup means.

7. The image processing device according to claim 1,

wherein said first irradiating means and said second irradiating means apply infrared rays of respective different wavelengths.

8. The image processing device according to claim 7,

wherein one of said first irradiating means and said second irradiating means applies light of a wavelength equal to or more than 930 nm, and the other applies light of less than 930 nm.

9. An image processing method of an image processing device for detecting a skin region representing a skin of a subject from a pickup image obtained by imaging said subject, the image processing device including first irradiating means, second irradiating means, image pickup means, adjusting means, and skin detecting means, the image processing method comprising:

said first irradiating means irradiating said subject with light of a first wavelength;

said second irradiating means irradiating said subject with light of a second wavelength different from said first wavelength;

said image pickup means imaging said subject;

said adjusting means adjusting a parameter of said image pickup means within a range in which a skin detectable condition for detecting said skin region is satisfied on a basis of an outside light image obtained by imaging said subject by said image pickup means in a state of said subject not being irradiated with light of said first wavelength or light of said second wavelength; and

said skin detecting means detecting said skin region on a basis of a first pickup image obtained by imaging said subject when said subject is irradiated with light of said first wavelength by said image pickup means having the parameter adjusted by said adjusting means and a second pickup image obtained by imaging said subject when said subject is irradiated with light of said second wavelength by said image pickup means having the parameter adjusted by said adjusting means,

said adjusting means adjusting the parameter of said image pickup means within a range in which said skin detectable condition that a luminance value of a pixel forming said outside light image be equal to or lower than half of a maximum luminance value that can be obtained by imaging of said image pickup means is satisfied.

10. A non-transitory computer readable medium including a program for making a computer function as:

adjusting means for adjusting a parameter of image pickup means within a range in which a skin detectable condition for detecting a skin region representing a skin of a subject is satisfied on a basis of an outside light image obtained by imaging said subject by said image pickup means in a state of said subject not being irradiated with light of a first wavelength or light of a second wavelength different from said first wavelength; and

skin detecting means for detecting said skin region on a basis of a first pickup image obtained by imaging said subject when said subject is irradiated with light of said first wavelength by said image pickup means having the parameter adjusted by said adjusting means and a second pickup image obtained by imaging said subject when said subject is irradiated with light of said second wavelength by said image pickup means having the parameter adjusted by said adjusting means

wherein said adjusting means adjusts the parameter of said image pickup means within a range in which said skin detectable condition that a luminance value of a pixel forming said outside light image be equal to or lower than half of a maximum luminance value that can be obtained by imaging of said image pickup means is satisfied.

11. An electronic device including an image processing device for detecting a skin region representing a skin of a subject from a pickup image obtained by imaging said subject,

wherein said image processing device includes:

first irradiating means for irradiating said subject with light of a first wavelength;

second irradiating means for irradiating said subject with light of a second wavelength different from said first wavelength;

image pickup means for imaging said subject;

adjusting means for adjusting a parameter of said image pickup means within a range in which a skin detectable condition for detecting said skin region is satisfied on a basis of an outside light image obtained by imaging said subject by said image pickup means in a state of said subject not being irradiated with light of said first wavelength or light of said second wavelength; and

skin detecting means for detecting said skin region on a basis of a first pickup image obtained by imaging said subject when said subject is irradiated with light of said first wavelength by said image pickup means having the parameter adjusted by said adjusting means and a second pickup image obtained by imaging said subject when said subject is irradiated with light of said second wavelength by said image pickup means having the parameter adjusted by said adjusting means,

wherein said adjusting means adjusts the parameter of said image pickup means within a range in which said skin detectable condition that a luminance value of a pixel forming said outside light image be equal to or lower than half of a maximum luminance value that can be obtained by imaging of said image pickup means is satisfied.

12. An image processing device for detecting a skin region representing a skin of a subject from a pickup image obtained by imaging said subject, the image processing device comprising:

a first irradiating section configured to irradiate said subject with light of a first wavelength;

a second irradiating section configured to irradiate said subject with light of a second wavelength different from said first wavelength;

an image pickup section configured to image said subject;

an adjusting section configured to adjust a parameter of said image pickup section within a range in which a skin detectable condition for detecting said skin region is satisfied on a basis of an outside light image obtained by imaging said subject by said image pickup section in a state of said subject not being irradiated with light of said first wavelength or light of said second wavelength; and

a skin detecting section configured to detect said skin region on a basis of a first pickup image obtained by imaging said subject when said subject is irradiated with light of said first wavelength by said image pickup section having the parameter adjusted by said adjusting section and a second pickup image obtained by imaging said subject when said subject is irradiated with light of said second wavelength by said image pickup section having the parameter adjusted by said adjusting section,

wherein said adjusting section adjusts the parameter of said image pickup means within a range in which said skin detectable condition that a luminance value of a pixel forming said outside light image be equal to or lower than half of a maximum luminance value that can be obtained by imaging of said image pickup means is satisfied.

13. An image processing device for detecting a skin region representing a skin of a subject from a pickup image obtained by imaging said subject, the image processing device comprising:

first irradiating means for irradiating said subject with light of a first wavelength;

second irradiating means for irradiating said subject with light of a second wavelength different from said first wavelength;

image pickup means for imaging said subject;

adjusting means for adjusting a parameter of said image pickup means within a range in which a skin detectable condition for detecting said skin region is satisfied on a basis of an outside light image obtained by imaging said subject by said image pickup means in a state of said subject not being irradiated with light of said first wavelength or light of said second wavelength; and

skin detecting means for detecting said skin region on a basis of a first pickup image obtained by imaging said subject when said subject is irradiated with light of said first wavelength by said image pickup means having the parameter adjusted by said adjusting means and a second pickup image obtained by imaging said subject when said subject is irradiated with light of said second wavelength by said image pickup means having the parameter adjusted by said adjusting means,

wherein said adjusting means adjusts the parameter of said image pickup means on a basis of a luminance value of a pixel when a luminance integration count obtained by performing integration starting with a pixel having a low luminance value becomes a predetermined value among luminance values of pixels forming said outside light image.