Image processing apparatus, image processing method and imaging apparatus

• US 8,488,909 B2
• Filed: 07/19/2012
• Issued: 07/16/2013
• Est. Priority Date: 02/14/2008
• Status: Active Grant

• Current Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Original Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Inventors: Endo, Hisashi
• Primary Examiner(s): Kassa, Yosef
• Application Number:
  US13/553,089
• Publication Number:
  US 20120281118A1
• Time in Patent Office: 362 Days
• Field of Search: 382/278, 382/282, 382/284, 382/294, 358/538, 358/540, 358/450
• US Class Current: 382/284
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 23/95 Computational photography systems, e.g. light-field imaging systems
• CPC Class Codes: H04N 23/951 by using two or more images to influence resolution, frame rate or aspect ratio
• CPC Class Codes: H04N 5/2621 Cameras specially adapted for the electronic generation of special effects during image pickup, e.g. digital cameras, camcorders, video cameras having integrated special effects capability
• CPC Class Codes: H04N 5/265 Mixing

Abstract

A composite image is generated by a method including: detecting at least one in a captured image; judging arrangement of the at least one subject by an arithmetic operation; selecting at least one composition-purpose image at random in accordance with the arrangement of the at least one subject; determining arrangement of the selected at least one composition-purpose image at random so that the at least one composition-purpose image does not overlap with one another and does not overlap with the detected at least one subject; and generating a composite image by combining the captured image with the at least one composition-purpose image.

Claims

1. An image processing apparatus comprising:

a subject detection unit that detects at least one subject in a captured image;

a subject position analysis unit that judges arrangement of the at least one subject in the captured image by an arithmetic operation;

an image selection unit that selects at least one composition-purpose image in accordance with the arrangement of the at least one subject;

an image arrangement unit that determines arrangement of the selected at least one composition-purpose image so that the at least one composition-purpose image does not overlap with one another and does not overlap with the detected at least one subject; and

an image composition unit that generates a composite image by combining the captured image with the at least one composition-purpose image,

wherein when the number of detected subject is two or more, the image arrangement unit selects the at least one composition-purpose image based on an arrangement relation between the detected subjects.

2. The image processing apparatus according to claim 1,

wherein the image arrangement unit selects a size for each of the at least one composition-purpose image to be arranged, at random from an image size range that is set in advance.

3. The image processing apparatus according to claim 1,

wherein the image arrangement unit selects an inclination for each of the at least one composition-purpose images to be arranged, at random from an image inclination range that is set in advance.

4. The image processing apparatus according to claim 1,

wherein the image selection unit selects the at least one composition-purpose image based on each distance between the subjects.

5. The image processing apparatus according to claim 1,

wherein in a case that (i) the image composition unit generates the composition-purpose images for each captured image which is continuously captured, (ii) first and second captured images are captured in order, (iii) the at least one subject in the first captured image includes a first subject and the at least one subject in the second captured image includes a second subject and (iv) the arrangement of the second subject is the same arrangement of the first subject,

at least a first composition-purpose image is generated by combined with the first captured image,

at least one composition-purpose image being the same image of the first composition-purpose image is arranged so as to have a same position relationship with the second subject, the position relationship being between the first subject and said first composition-purpose image.

6. The image processing apparatus according to claim 1,

wherein in a case that (i) the image composition unit generates the composition-purpose images for each captured image which is continuously captured, (ii) first and second captured images are captured in order, and (iii) the at least one subject in the first captured image includes a first subject and the at least one subject in the second captured image includes a second subject, at least a first composition-purpose image is generated by combined with the first captured image, and

(iv) until a predetermined time is elapsed since a first captured image is captured or (v) until a predetermined number of the captured images is processed, at least one composition-purpose image being the same image of the first composition-purpose image is arranged so as to have a same position relationship with the second subject, the position relationship being between the first subject and said first composition-purpose image.

7. The image processing apparatus according to claim 1,

wherein each subject is a human face.

8. The image processing apparatus according to claim 1,

wherein the image selection unit selects at least one composition-purpose image without a random selecting, and

the image arrangement unit determines the arrangement of the selected at least one composition-purpose image without a random selecting.

9. An imaging apparatus comprising:

the image processing apparatus according to claim 1.

10. An image processing method comprising:

detecting at least one subject in a captured image;

judging arrangement of the at least one subject in the captured image by an arithmetic operation;

selecting at least one composition-purpose image in accordance with the arrangement of the at least one subject;

determining arrangement of the selected at least one composition-purpose image so that the at least one composition-purpose image does not overlap with one another and does not overlap with the detected at least one subject; and

generating a composite image by combining the captured image with the at least one composition-purpose image

wherein when the number of detected subject is two or more, the at least one composition-purpose image is selected based on an arrangement relation between the detected subjects.