Image display device, image display method and storage medium storing image display program

• US 8,290,276 B2
• Filed: 09/05/2008
• Issued: 10/16/2012
• Est. Priority Date: 09/27/2007
• Status: Active Grant

• Current Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Original Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Inventors: Suehiro, Masako, Nishijima, Masakazu
• Primary Examiner(s): Seth, Manav
• Application Number:
  US12/205,494
• Publication Number:
  US 20090087097A1
• Time in Patent Office: 1,502 Days
• Field of Search: None
• US Class Current: 382/190
• CPC Class Codes: G06T 2207/20132 Image cropping
• CPC Class Codes: G06T 2207/30041 Eye; Retina; Ophthalmic
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 3/02 Affine transformations for image registration G06T3/147; for image mosaicing G06T3/4038
• CPC Class Codes: G06T 7/74 involving reference images or patches
• CPC Class Codes: G06V 40/171 Local features and components; Facial parts eye characteristics G06V40/18; Occluding parts, e.g. glasses; Geometrical relationships
• CPC Class Codes: G06V 40/18 Eye characteristics, e.g. of the iris
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof

Abstract

An image display device that includes an extraction component, a calculation component, an image processing component and a display component is provided. The extraction component extracts from photographic images a photographic image in which a face has been photographed. The calculation component calculates a position of an eye in the photographic image extracted by the extraction component. The image processing component performs image processing on the photographic image such that the position of the eye calculated by the calculation component will be at a predetermined position. The display component displays the photographic image which has been processed by the image processing component.

Claims

1. An image display device comprising:

an extraction component that extracts from photographic images a photographic image in which a face has been photographed;

a calculation component that calculates a position of an eye in the photographic image extracted by the extraction component;

an image processing component that performs image processing on the photographic image such that the position of the eye calculated by the calculation component will be arranged at a predetermined position in the photographic image displayed by a display component; and

a display component that displays the photographic image which has been processed by the image processing component.

2. The image display device of claim 1, further comprising a selection component that selects a photographic image to be displayed at the display component.

3. The image display device of claim 1, wherein the display component displays photographic images in a predetermined sequence.

4. The image display device of claim 1, wherein

the extraction component extracts a photographic image in which a face including left and right eyes has been photographed, and

the calculation component calculates positions of the left and right eyes.

5. The image display device of claim 1, wherein the calculation component calculates a central position of a rectangular region including the eye.

6. The image display device of claim 1, wherein

the calculation component includes a pupil detection component that detects a pupil, and

the calculation component calculates a position of the pupil detected by the pupil detection component to serve as the position of the eye.

7. The image display device of claim 6, wherein if the pupil detection component cannot detect a pupil, the calculation component calculates a central position of a rectangular region including the eye to serve as the position of the eye.

8. The image display device of claim 1, wherein

from a photographic image group including a plurality of photographic images, the extraction component extracts photographic images in which a face has been photographed, to serve as a face photographic image group,

the calculation component calculates a position of an eye in each photographic image of the face photographic image group,

the image processing component performs image processing on each photographic image of the face photographic image group, and

the display component displays each photographic image of the face photographic image group.

9. The image display device of claim 1, wherein the display component displays the photographic image which has been processed by the image processing component when a pre-specified display mode is set.

10. The image display device of claim 1, wherein the extraction component further extracts a photographic image that includes a particular person.

11. The image display device of claim 1, wherein the extraction component further extracts a photographic image that includes a face with a particular angle.

12. The image display device of claim 1, wherein the image processing component estimates a rotation of the face about a vertical direction rotation axis in the photographic image, estimates, from an estimated distance of a pair of eyes, a distance of the pair of eyes if the face were facing directly forward, and performs image processing such that the distance of the pair of eyes will be a pre-specified target distance.

13. The image display device of claim 1, wherein the image processing component performs image processing including at least one of magnification, reduction, translation and rotation of the photographic image.

14. An image display method comprising:

(a) extracting from photographic images a photographic image in which a face has been photographed;

(b) calculating a position of an eye in the photographic image extracted in (a);

(c) performing image processing on the photographic image such that the position of the eye calculated in (b) will be arranged at a predetermined position in the photographic image displayed by a display component; and

(d) displaying the photographic image which has been processed in (c).

15. The image display method of claim 14, further comprising

(e) selecting a photographic image to be displayed in (d).

16. The image display method of claim 14, wherein (d) includes displaying photographic images in a predetermined sequence.

17. The image display method of claim 14, wherein

(a) includes extracting a photographic image in which a face including left and right eyes has been photographed, and

(b) includes calculating positions of the left and right eyes.

18. The image display method of claim 14, wherein (b) includes calculating a central position of a rectangular region including the eye.

19. The image display method of claim 14, wherein (b) includes detecting a pupil, and calculating a position of the pupil to serve as the position of the eye.

20. The image display method of claim 19, wherein (b) includes, if a pupil cannot be detected, calculating a central position of a rectangular region including the eye to serve as the position of the eye.

21. The image display method of claim 14, wherein

(a) includes extracting, from a photographic image group including a plurality of photographic images, photographic images in which a face has been photographed, to serve as a face photographic image group,

(b) includes calculating the position of an eye in each photographic image of the face photographic image group,

(c) includes performing image processing on each photographic image of the face photographic image group, and

(d) includes displaying each photographic image of the face photographic image group which has been processed in (c).

22. The image display method of claim 14, wherein (d) includes displaying the photographic image which has been processed in (c) when a pre-specified display mode is set.

23. The image display method of claim 14, wherein (a) includes further extracting a photographic image that includes a particular person.

24. The image display method of claim 14, wherein (a) includes further extracting a photographic image that includes a face with a particular angle.

25. The image display method of claim 14, wherein (c) includes estimating a rotation of the face about a vertical direction rotation axis in the photographic image, estimating, from an estimated distance of a pair of eyes, a distance of the pair of eyes if the face were facing directly forward, and performing image processing such that the distance of the pair of eyes will be a pre-specified target distance.

26. The image display method of claim 14, wherein (c) includes performing image processing including at least one of magnification, reduction, translation and rotation of the photographic image.

27. A non-transitory storage medium readable by a computer, the storage medium storing a program of instructions executable by the computer to perform a function for image display, the function comprising the steps of:

(a) extracting from photographic images a photographic image in which a face has been photographed;

(b) calculating a position of an eye in the photographic image extracted in (a);

(c) performing image processing on the photographic image such that the position of the eye calculated in (b) will be arranged at a predetermined position in the photographic image displayed by a display component; and

(d) displaying the photographic image which has been processed in (c).