Image selection support system for supporting selection of well-photographed image from plural images

• US 7,433,518 B2
• Filed: 05/30/2002
• Issued: 10/07/2008
• Est. Priority Date: 05/31/2001
• Status: Expired due to Fees

• Current Assignee: Olympus Corporation, The Reinforced Earth Company (VINCI SA)
• Original Assignee: Olympus Corporation
• Inventors: Shiratani, Fumiyuki
• Primary Examiner(s): KIM, CHONG R
• Application Number:
  US10/158,686
• Publication Number:
  US 20020181784A1
• Time in Patent Office: 2,322 Days
• Field of Search: None
• US Class Current: 382/190
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text

Abstract

A feature area extracting section extracts an area having a unique feature in an image input to an image selection support apparatus. A specific area feature collating and determining section determines whether or not the area having a feature and extracted by the feature area extracting section is a specific area. A specific area image reading section decides a rectangular area including the specific area, and reads image information of the rectangular area. The specific area image reading section has at least one of an enlargement displaying section which enlarges and displays the image information read by the specific area image reading section, a thumbnail display section which reduces and displays the input image, and an original image displaying section which enlarges and displays the input image.

Claims

1. An image selection support apparatus comprising:

an image inputting section which inputs a plurality of images;

a specific area inclusion area deciding section which decides an area including a specific area in each of the plurality of images input by the image inputting section using a Kohonen-type learning vector quantization neural net or a Kohonen self-organizing neural net

an image displaying section which enlarges and displays a plurality of areas, arranged in an array in one screen, that include a specific area in each of the plurality of images determined by the specific area inclusion area deciding section;

an image selecting section, which allows a user to select a desired image from the plurality of areas that are enlarged and arranged in an array in one screen, and that include the specific area and are displayed by the image displaying section; and

a selected image storing section, which stores the image selected by the image selecting section, after the image is selected by the image selecting section.

2. An image selection support apparatus according to claim 1, further comprising:

an area dividing section which divides an image into units having meaning;

a feature amount extracting section which extracts a physical feature amount of each of the areas divided by the area dividing section;

a similarity determining section which determines similarities of the feature amounts extracted by the feature amount extracting section and feature amounts of other images with respect to the plurality of images; and

an image display order deciding and storing section which decides a display order such that the images determined as being similar to each other by the similarity determining section are displayed close to one another, and stores the display order in a memory,

wherein the image displaying section further comprises an image display order reading section which reads the display order of the images stored in the memory by the display order determining and storing section, and enlarges and displays a plurality of areas, arranged in an array in one screen, that include the specific area in the display order of the images.

3. An image selection support apparatus according to claim 1, further comprising:

an area dividing section which divides an image into units having meaning;

a feature amount extracting section which extracts a physical feature amount of each of the areas divided by the area dividing section;

an image photographed state evaluating section which determines the goodness/poorness of the photography of each of the areas divided by the area dividing section, on the basis of the feature amounts extracted by the feature amount extracting section; and

an image display order deciding and storing section which decides a display order such that the images are displayed in accordance with the goodness/poorness of the photography of the respective areas evaluated by the image photographed state evaluating section, and stores the display order in a memory,

wherein the image displaying section further comprises an image display order reading section which reads the display order of the images stored in the memory by the display order determining and storing section, and enlarges and displays a plurality of areas, arranged in an array in one screen, that include the specific area in the display order of the images.

4. An image selection support apparatus according to claim 1, further comprising an orientation determining section which determines top/bottom orientation of an image, wherein the image displaying section comprises an image rotating converting section which rotates an image by 90°

to the right or the left, on the basis of the output of the orientation determining section.

5. An image selection support apparatus according to claim 1, further comprising:

a feature area extracting section which extracts an area having a unique feature in the image input by the image inputting section; and

a specific area feature collating and determining section which determines whether the area having the feature extracted by the feature area extracting section is a specific area,

wherein the specific area inclusion area deciding section decides an area including the specific area determined by the specific area feature collating and determining section.

6. An image selection support apparatus according to claim 5, wherein the feature area extracting section extracts a skin color area as the area having a unique feature, and the specific area feature collating and determining section determines whether the skin color area extracted by the feature area extracting section is the specific area or not by determining whether the skin color area is a face area or not.

7. An image selection support apparatus according to claim 1, wherein the image displaying section enlarges and displays the plurality of areas including the specific area, and reduces and displays an image corresponding to the area including the specific area of the image input by the image inputting section.

8. The image selection support apparatus of claim 1 wherein the specific area inclusion area deciding section decides the area including the specific area in each of the plurality of images input by the image inputting section automatically, without user intervention.

9. The image selection support apparatus of claim 1 wherein the selected image storing section stores the image selected by the image selecting section in a selection folder, after the image is selected by the image selecting section.

10. An image selection support method comprising:

inputting a plurality of images;

deciding an area including a specific area within each of the input plurality of images using a Kohonen-type learning vector quantization neural net or a Kohonen self-organizing neural net;

enlarging and displaying a plurality of areas, arranged in an array in one screen, that include a specific area in each of the plurality of images decided by the act of deciding;

user-selecting a desired image from the plurality of areas that are enlarged and arranged in an array in one screen, and that include the specific area and are displayed by the act of displaying; and

storing the image selected by the act of user selecting, after the image is selected by the act of user-selecting.

11. An image selection support method according to claim 10, further comprising:

dividing an image into units having meaning;

extracting a physical feature amount of each of the divided areas;

determining similarities of the extracted feature amounts and feature amounts of other images with respect to the plurality of images;

deciding a display order such that images determined as being similar to each other are displayed close to one another, and storing the display order in the first memory area; and

enlarging and displaying a plurality of areas, arranged in an array in one screen, that include the specific area in the display order of the images.

12. An image selection method according to claim 10, further comprising:

dividing an image into units having meaning;

determining and evaluating the goodness/poorness of the photography of each of the divided areas; and

deciding a display order such that the images are displayed in accordance with the goodness/poorness of the photography of the respective determined and evaluated areas, and storing the display order in the first memory area, and

displaying the original image comprises reading the display order of the images stored in the first memory area, wherein the act of displaying enlarges and displays a plurality of areas, arranged in an array in one screen, that include the specific area in the display order of the images.

13. An image selection support method according to claim 10, further comprising:

determining top/bottom orientation of an image, and

displaying the original image comprises;

rotating an image by 90°

to the right or the left, on the basis of the output of the orientation determination.

14. An image selection support method according to claim 10, further comprising:

extracting an area having a unique feature in the image input by the act of inputting; and

determining whether the area having the feature extracted by the act of extracting is a specific area,

wherein the deciding decides an area including the specific area determined by the act of determining.

15. An image selection support method according to claim 14, wherein the act of extracting extracts a skin color area as the area having a unique feature, and the act of determining determines whether the skin color area extracted by the act of extracting is the specific area or not by determining whether the skin color area is a face area or not.

16. An image selection support method according to claim 10, wherein the act of displaying enlarges and displays the plurality of areas including the specific area, and reduces and displays an area corresponding to the area including the specific area of the image input by the act of inputting.

17. An image selection support method according to claim 10, further comprising storing the image selected by the act of selecting in a memory.

18. A computer readable medium having stored thereon computer readable programs to support image selection by a computer, the computer readable programs comprising:

a first computer readable program which makes the computer execute an image inputting step of inputting a plurality of images;

a second computer readable program which makes the computer execute a specific area inclusion area deciding step of deciding an area including the specific area within each of the plurality of images input in the image inputting step using a Kohonen-type learning vector quantization neural net or a Kohonen self-organizing neural net;

a third computer readable program which makes the computer execute a displaying step of enlarging and displaying a plurality of areas, arranged in an array in one screen, that include a specific area in each of the plurality of images determined by the specific area inclusion area deciding step;

a fourth computer readable program which makes the computer execute an image selecting step of allowing a user to select a desired image from the plurality of areas that are enlarged and arranged in an array in one screen, and that include the specific area and are displayed by the displaying step; and

a fifth computer readable program which makes the computer execute a selected image storing step of storing the image selected by the image selecting step, after the image is selected by the image selecting step.

19. A computer readable medium having stored thereon computer readable programs according to claim 18,

the computer readable programs further comprising:

a sixth computer readable program which makes the computer execute an area dividing step of dividing an image into units having meaning;

a seventh computer readable program which makes the computer execute a feature amount extracting step of extracting a physical feature amount of each of the areas divided by the area dividing step;

an eighth computer readable program which makes the computer execute a similarity determining step of determining similarities of the feature amounts extracted by the feature amount extracting step and feature amounts of other images with respect to the plurality of images;

a ninth computer readable program which makes the computer execute an image display order deciding and storing step of deciding a display order such that the images determined as being similar to each other by the similarity determining step are displayed close to one another, and storing the display order in a memory; and

the third computer readable program which makes the computer execute the displaying step comprising;

a tenth computer readable program which makes the computer execute an image display order reading step of reading the display order of the images stored in the memory by the display order deciding and storing step, and enlarges and displays a plurality of areas, arranged in an array in one screen, that include the specific area in the display order of the images.

20. A computer readable medium having stored thereon computer readable programs according to claim 18, the computer readable programs further comprising:

a sixth computer readable program which makes the computer execute an area dividing step of dividing an image into units having meaning;

a seventh computer readable program which makes the computer execute an image photographed state evaluating step of determining the goodness/poorness of the photography of each of the areas divided by the area dividing step; and

an eighth computer readable program which makes the computer execute an image display order deciding and storing step of deciding a display order such that the images are displayed in accordance with the goodness/poorness of the photography of the respective areas evaluated by the image photographed state evaluating step, and storing the display order in a memory, and

the third computer readable program which makes the computer execute the image displaying step comprises;

a ninth computer readable program which makes the computer execute an image display order reading step of reading the display order of the images stored in the memory by the display order deciding and storing step, and enlarges and displays a plurality of areas, arranged in an array in one screen, that include the specific area in the display order of the images.

21. A computer readable medium having stored thereon computer readable programs according to claim 18,

the computer readable programs further comprising:

a sixth computer readable program which makes the computer execute an orientation determining step of determining top/bottom orientation of an image, and

the third computer readable program which makes the computer execute the image displaying step comprises;

a seventh computer readable program which makes the computer execute an image rotating converting step of rotating an image by 90°

to the right or the left, on the basis of the output of the orientation.

22. A computer readable medium having stored thereon computer readable programs according to claim 18, the computer readable programs further comprising:

a sixth computer readable program which makes the computer execute a feature area extracting step which extracts an area having a unique feature in the image input by the image inputting section; and

a seventh computer readable program which makes the computer execute a specific area feature collating and determining step which determines whether the area having the feature extracted by the feature area extracting step is a specific area,

wherein the specific area inclusion area deciding section decides an area including the specific area determined by the specific area feature collating and determining step.

23. A computer readable medium having stored thereon computer readable programs according to claim 22, wherein the feature area extracting step extracts a skin color area as the area having a unique feature, and the specific area feature collating and determining step determines whether the skin color area extracted by the feature area extracting section is the specific area or not by determining whether the skin color area is a face area or not.

24. A computer readable medium having stored thereon computer readable programs according to claim 18, wherein the image displaying step enlarges and displays the plurality of areas including the specific area, and reduces and displays an area corresponding to the area including the specific area of the image input by the image inputting step.

25. A computer readable medium having stored thereon computer readable programs according to claim 18, the computer readable programs further comprising a sixth computer readable program which makes the computer execute a selected image storing step which stores the image selected by the image selecting step in a memory.

26. An image selection support apparatus comprising:

an image inputting section which inputs a plurality of images;

a specific area inclusion area deciding section which decides an area including a specific area in each of the plurality of images input by the image inputting section

an image displaying section which enlarges and displays a plurality of areas, arranged in an array in one screen, that include a specific area in each of the plurality of images determined by the specific area inclusion area deciding section;

an image selecting section, which allows a user to select a desired image from the plurality of areas that are enlarged and arranged in an array in one screen, and that include the specific area and are displayed by the image displaying section;

an area dividing section which divides an image into units having meaning;

a feature amount extracting section which extracts a physical feature amount of each of the areas divided by the area dividing section;

a similarity determining section which determines similarities of the feature amounts extracted by the feature amount extracting section and feature amounts of other images with respect to the plurality of images; and

an image display order deciding and storing section which decides a display order such that the images determined as being similar to each other by the similarity determining section are displayed close to one another, and stores the display order in a memory,

wherein the image displaying section further comprises an image display order reading section which reads the display order of the images stored in the memory by the display order determining and storing section, and enlarges and displays a plurality of areas, arranged in an array in one screen, that include the specific area in the display order of the images.

27. An image selection support method comprising:

inputting a plurality of images;

deciding an area including a specific area within each of the input plurality of images;

enlarging and displaying a plurality of areas, arranged in an array in one screen, that include a specific area in each of the plurality of images decided by the act of deciding;

user-selecting a desired image from the plurality of areas that are enlarged and arranged in an array in one screen, and that include the specific area and are displayed by the act of displaying;

dividing an image into units having meaning;

extracting a physical feature amount of each of the divided areas;

determining similarities of the extracted feature amounts and feature amounts of other images with respect to the plurality of images;

deciding a display order such that images determined as being similar to each other are displayed close to one another, and storing the display order in the first memory area; and

enlarging and displaying a plurality of areas, arranged in an array in one screen, that include the specific area in the display order of the images.

28. A computer readable medium having stored thereon computer readable programs to support image selection by a computer, the computer readable programs further comprising:

a first computer readable program which makes the computer execute an image inputting step of inputting a plurality, of images;

a second computer readable program which makes the computer execute a specific area inclusion area deciding step of deciding an area including the specific area within each of the plurality of images input in the image inputting step;

a third computer readable program which makes the computer execute a displaying step of enlarging and displaying a plurality of areas, arranged in an array in one screen, that include a specific area in each of the plurality of images determined by the specific area inclusion area deciding step;

a fourth computer readable program which makes the computer execute an image selecting step of allowing a user to select a desired image from the plurality of areas that are enlarged and arranged in an array in one screen, that include the specific area and are displayed by the displaying step;

a fifth computer readable program which makes the computer execute an area dividing step of dividing an image into units having meaning;

a sixth computer readable program which makes the computer execute a feature amount extracting step of extracting a physical feature amount of each of the areas divided by the area dividing step;

a seventh computer readable program which makes the computer execute a similarity determining step of determining similarities of the feature amounts extracted by the feature amount extracting step and feature amounts of other images with respect to the plurality of images;

an eighth computer readable program which makes the computer execute an image display order deciding and storing step of deciding a display order such that the images determined as being similar to each other by the similarity determining step are displayed close to one another, and storing the display order in a memory; and

the third computer readable program which makes the computer execute the displaying step comprising;

a ninth computer readable program which makes the computer execute an image display order reading step of reading the display order of the images stored in the memory by the display order deciding and storing step, and enlarges and displays a plurality of areas, arranged in an array in one screen, that include the specific area in the display order of the images.