Photographing apparatus, method and program

• US 8,306,285 B2
• Filed: 06/27/2011
• Issued: 11/06/2012
• Est. Priority Date: 01/21/2004
• Status: Active Grant

• Current Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Original Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Inventors: Ito, Wataru
• Primary Examiner(s): Le, Brian
• Application Number:
  US13/169,282
• Publication Number:
  US 20110254981A1
• Time in Patent Office: 498 Days
• Field of Search: 382/115, 382/117, 382/118, 382/270, 382/271, 382/272, 382/273
• US Class Current: 382/118
• CPC Class Codes: G06T 2207/10004 Still image; Photographic image
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 2207/30216 Redeye defect
• CPC Class Codes: G06T 5/77 Retouching; Inpainting; Scratch removal
• CPC Class Codes: G06T 7/74 involving reference images or patches
• CPC Class Codes: G06V 40/165 using facial parts and geometric relationships
• CPC Class Codes: G06V 40/167 using comparisons between temporally consecutive images
• CPC Class Codes: G06V 40/171 Local features and components; Facial parts eye characteristics G06V40/18; Occluding parts, e.g. glasses; Geometrical relationships
• CPC Class Codes: G06V 40/193 Preprocessing; Feature extraction
• CPC Class Codes: H04N 1/2112 using still video cameras
• CPC Class Codes: H04N 2201/0084 Digital still camera
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image

Abstract

Processing for judging whether a face is included in a frame is performed, in a predetermined interval, on each of frames included in a moving image of a subject, displayed on a monitor, until the judgment becomes positive. If it is judged that a face is included in a frame, the facial position is detected in the frame, and stored. Then, judgment is made as to whether a face is included in the next frame after predetermined time. If the judgment is positive, the facial position is detected. The previously stored facial position is replaced by the newly detected facial position, and the newly detected facial position is stored. These processes are repeated until photographing operation is performed by operating a release unit.

Claims

1. A photographing apparatus comprising:

a photographing device for obtaining image data of a subject;

a display for displaying the image data;

a release device for performing a photographing operation;

a memory for storing facial position data;

a storage for storing the image data;

a photographing control device for obtaining a moving image of the subject by continuously obtaining image data with the photographing device and displaying the moving image on the display;

a face judgment device for performing processing, at predetermined or varying time intervals, for judging whether a human face is included in a frame of the moving image;

a face detection device for detecting a facial position in the frame, in the case that the frame has been judged to include a face by the face judgment device; and

a control device for controlling the photographing device, the face judgment device, the face detection device, the memory, and the storage so that a judgment is made as to whether the face is included in a first frame of the moving image, and if the judgment is positive, a first facial position is detected, the first facial position is stored in the memory, and judgment is made as to whether the face is included in a second frame of the moving image after the predetermined or varying time interval, and if it is judged that the face is included in the second frame, a second facial position is detected, and the second facial position is either stored in the memory or replaces the first facial position stored in the memory,

wherein a frame obtained when the release device performs the photographing operation is stored in a recording medium as an image.

2. A photographing apparatus as defined in claim 1, wherein the control device controls the face judgment device and the face detection device so that when a human face is detected in the first frame, the face judgment device performs processing for judging whether a human face is included in the second frame within a region of the second frame.

3. A photographing apparatus as defined in claim 1, further comprising:

a smile judgment device that judges whether there is a smile in or near the facial position detected by the face detection device.

4. A photographing apparatus as defined in claim 1, further comprising:

an eye judgment device that judges whether at least one of a red eye or a closed eye is found in or near the facial position detected by the face detection device.

5. A photographing apparatus as defined in claim 1, further comprising:

an image processing device that performs image quality processing including at least one of a noise suppression processing and a density correction processing of the human face detected by the face detection device.

6. A photographing apparatus as defined in claim 1, wherein the storage stores at least one of a plurality of temporally precedent frames and temporally subsequent frames of the moving image as image data.

7. A photographing method for use with an apparatus comprising a photographing device for obtaining image data of a subject, a display for displaying the image data, a release device for performing a photographing operation, a memory for storing a facial position data, a storage for storing the image data, and a photographing control device for obtaining a moving image of the subject by continuously obtaining image data with the photographing device and displaying the moving image on the display, the method comprising the steps of:

performing processing, at predetermined or varying time intervals, for judging whether a human face is included in a first frame of the moving image;

detecting a first facial position in the frame, in the case that the frame has been judged to include a face;

storing the first facial position in the memory; and

judging whether a human face is included in a second frame of the moving image after the predetermined or varying time interval, and if the judgment is positive, detecting a second facial position, storing the second facial position in the memory or replacing the first facial position in the memory with the second facial position, and storing an image in a recording medium when the release device performs the photographing operation.

8. A photographing method as defined in claim 7, further comprising the step of:

performing processing for controlling the face judgment device and the face detection device so that when a human face is detected in the first frame, the face judgment device performs processing for judging whether a human face is included in the second frame within a region of the second frame.

9. A photographing method as defined in claim 7, further comprising the step of:

performing processing for judging whether a smile exists in or near the facial position detected by the face detection device.

10. A photographing method as defined in claim 7, further comprising the step of:

performing processing for judging whether at least one of a red eye and a closed eye exists in or near the facial position detected by the face detection device.

11. A photographing method as defined in claim 7, further comprising the step of:

performing image quality processing including at least one of a noise suppression processing and a density correction processing of the human face detected by the face detection device.

12. A photographing method as defined in claim 7, further comprising the step of:

photographing and storing at least one of a plurality of temporally precedent frames and temporally subsequent frames of the moving image as image data.

13. A photographing apparatus comprising:

a photographing device for obtaining image data of a subject;

a display for displaying the image data;

a release device for performing a photographing operation;

a memory for storing facial position data and image data;

a photographing control device for obtaining a moving image of the subject by continuously obtaining image data with the photographing device and displaying the moving image on the display;

a face judgment device for performing processing, at predetermined or varying time intervals, for judging whether a human face is included in a frame of the moving image;

a face detection device for detecting a facial position in the frame, in the case that the frame has been judged to include a face by the face judgment device; and

a control device for controlling the photographing device, the face judgment device, the face detection device, and the memory, so that a judgment is made as to whether the face is included in a first frame of the moving image, and if the judgment is positive, a first facial position is detected, the first facial position is stored in the memory, and judgment is made as to whether the face is included in a second frame of the moving image after the predetermined or varying time interval, and if it is judged that the face is included in the second frame, a second facial position is detected, and the second facial position is either stored in the memory or replaces the first facial position stored in the memory,

wherein a frame obtained when the release device performs the photographing operation is stored in a recording medium as an image.

14. A photographing apparatus as defined in claim 13, wherein the control device controls the face judgment device and the face detection device so that when a human face is detected in the first frame, the face judgment device performs processing for judging whether a human face is included in the second frame within a region of the second frame.

15. A photographing apparatus as defined in claim 13, further comprising:

a smile judgment device that judges whether there is a smile in or near the facial position detected by the face detection device.

16. A photographing apparatus as defined in claim 13, further comprising:

an eye judgment device that judges whether at least one of a red eye and a closed eye is found in or near the facial position detected by the face detection device.

17. A photographing apparatus as defined in claim 13, further comprising:

an image processing device that performs image quality processing including at least one of a noise suppression processing and a density correction processing of the human face detected by the face detection device.

18. A photographing apparatus as defined in claim 13, wherein the memory stores at least one of a plurality of temporally precedent frames and temporally subsequent frames of the moving image as image data.