Image retrieval system, image retrieval program and storage medium and image retrieval method

• US 7,409,110 B2
• Filed: 06/28/2005
• Issued: 08/05/2008
• Est. Priority Date: 06/29/2004
• Status: Expired due to Fees

• Current Assignee: Seiko Epson Corporation (Seiko Group)
• Original Assignee: Seiko Epson Corporation (Seiko Group)
• Inventors: Kayahara, Naoki
• Primary Examiner(s): Mehta; Bhavesh
• Assistant Examiner(s): Schaffer; Jonathan C
• Application Number:
  US11/168,056
• Publication Number:
  US 20050286806A1
• Time in Patent Office: 1,134 Days
• Field of Search: 382/305
• US Class Current: 382/305
• CPC Class Codes: G06F 16/583 using metadata automatically derived from the content
• CPC Class Codes: G06F 40/106 Display of layout of documents; Previewing

Abstract

An image retrieval system including: a retrieval subject image storing unit storing images corresponding to first and second characteristic information among semantic characteristic information, physical characteristic information and prominence characteristic information; a retrieval key inputting unit inputting the first and second characteristic information as the retrieval key; a characteristic information converting unit obtaining remaining characteristic information, the physical characteristic information and the prominence characteristic information based on the two semantic characteristics, the physical characteristic and the prominence characteristic information; and an image retrieval unit retrieving an image matching or being approximate to third characteristic information other than the first and second characteristic information among the semantic characteristic, the physical characteristic and the prominence characteristic information, from the retrieval subject image storing unit by the characteristic information converting unit based on the first and second characteristic information, which are inputted by the retrieval key inputting unit.

Claims

1. An image retrieval system for retrieving an image corresponding to a retrieval key among plural images subject to retrieval based on the retrieval key, the image retrieval system comprising:

a retrieval subject image storing unit that stores the images subject to retrieval so that respective images correspond to first characteristic information and second characteristic information among semantic characteristic information corresponding to a categorical attribute given in accordance with contents of an image, physical characteristic information relating to at least one of a size of an image and an arrangement of colors in an image and prominence characteristic information showing prominence of an image;

a retrieval key inputting unit that inputs the first characteristic information and the second characteristic information as the retrieval key;

a characteristic information converting dictionary storing unit that stores a characteristic information converting dictionary defining a corresponding relation between the semantic characteristic information, the physical characteristic information and the prominence characteristic information;

a characteristic information converting unit that obtains a remainder of the characteristic information other than any two of the semantic characteristic information, the physical characteristic information and the prominence characteristic information based on the two of the semantic characteristic information, the physical characteristic information and the prominence characteristic information, and that retrieves the remainder of the characteristic information from the characteristic information converting dictionary based on the given two pieces of characteristic information; and

an image retrieval unit that retrieves an image subject to retrieval, the image at least being approximate to third characteristic information other than the first characteristic information and the second characteristic information among the semantic characteristic information, the physical characteristic information and the prominence characteristic information, from the retrieval subject image storing unit by the characteristic information converting unit based on the first characteristic information and the second characteristic information, which are inputted by the retrieval key inputting unit.

2. The image retrieval system according to claim 1, comprising:

a second retrieval key inputting unit that inputs at least one of the first characteristic information and the second characteristic information as the second characteristic information of the retrieval key, wherein

the image retrieval unit is arranged so that;

the third characteristic information is obtained by the characteristic information converting unit based on the first characteristic information and the second characteristic information, which are inputted by the retrieval key inputting unit;

at least one of the first characteristic information and the second characteristic information is obtained by the characteristic information converting unit based on the obtained third characteristic information and the first characteristic information and the second characteristic information, which are inputted by the second retrieval key inputting unit; and

an image subject to retrieval, the image at least being approximate to at least one of the obtained second characteristic information and first characteristic information and the first characteristic information and the second characteristic information, which is inputted by the second retrieval key inputting unit, is retrieved from the retrieval subject image storing unit.

3. The image retrieval system according to claim 1, wherein

the first characteristic information and the second characteristic information are the semantic characteristic information and the physical characteristic information;

and

the third characteristic information comprises the prominence characteristic information.

4. A computer-readable medium storing an image retrieval program for retrieving an image corresponding to a retrieval key among plural images subject to retrieval based on the retrieval key, the image retrieval program being a program causing a computer to execute a process comprising:

a retrieval key inputting step for inputting as the retrieval key first characteristic information and second characteristic information among semantic characteristic information corresponding to a categorical attribute given in accordance with contents of an image, physical characteristic information relating to at least one of a size of an image and an arrangement of colors in an image, and prominence characteristic information showing prominence of an image;

a characteristic information converting step for obtaining a remainder of the characteristic information other than any two of the semantic characteristic information, the physical characteristic information and the prominence characteristic information based on the two of the semantic characteristic information, the physical characteristic information and the prominence characteristic information, by retrieving the remainder of the characteristic information from a characteristic information converting dictionary based on the given two pieces of characteristic information, the characteristic information converting dictionary defining a corresponding relation between the semantic characteristic information, the physical characteristic information and the prominence characteristic information; and

an image retrieval step for carrying out the characteristic information converting step based on the first characteristic information and the second characteristic information, which are inputted in the retrieval key inputting step, to retrieve an image subject to retrieval, the image at least being approximate to third characteristic information other than the first characteristic information and the second characteristic information among the semantic characteristic information, the physical characteristic information and the prominence characteristic information, from a retrieval subject image storing unit stored with respective images subject to retrieval, the images corresponding to the first characteristic information and the second characteristic information.

5. An image retrieval method for retrieving an image corresponding to a retrieval key among plural images subject to retrieval based on the retrieval key, comprising:

a retrieval key inputting step for inputting as the retrieval key first characteristic information and second characteristic information among semantic characteristic information corresponding to a categorical attribute given in accordance with contents of an image, physical characteristic information relating to at least one of a size of an image and an arrangement of colors in an image, and prominence characteristic information showing prominence of an image;

a characteristic information converting step for obtaining a remainder of the characteristic information other than any two of the semantic characteristic information, the physical characteristic information and the prominence characteristic information based on the two of the semantic characteristic information, the physical characteristic information and the prominence characteristic information, by retrieving the remainder of the characteristic information from a characteristic information converting dictionary based on the given two pieces of characteristic information, the characteristic information converting dictionary defining a corresponding relation between the semantic characteristic information, the physical characteristic information and the prominence characteristic information; and

an image retrieval step for carrying out the characteristic information converting step based on the first characteristic information and the second characteristic information, which are inputted in the retrieval key inputting step, to retrieve an image subject to retrieval, the image at least being approximate to third characteristic information other than the first characteristic information and the second characteristic information among the semantic characteristic information, the physical characteristic information and the prominence characteristic information, from a retrieval subject image storing unit stored with respective images subject to retrieval, the images corresponding to the first characteristic information and the second characteristic information.

6. An image retrieval method for retrieving an image corresponding to a retrieval key among plural images subject to retrieval based on the retrieval key, comprising:

a retrieval key inputting step in which an inputting unit inputs as the retrieval key first characteristic information and second characteristic information among semantic characteristic information corresponding to a categorical attribute given in accordance with contents of an image, physical characteristic information relating to at least one of a size of an image and the arrangement of colors in an image, and prominence characteristic information showing prominence of an image;

a characteristic information converting step in which an arithmetic unit obtains a remainder of the characteristic information other than any two of the semantic characteristic information, the physical characteristic information and the prominence characteristic information based on the two of the semantic characteristic information, the physical characteristic information and the prominence characteristic information, by retrieving the remainder of the characteristic information from a characteristic information converting dictionary based on the given two pieces of characteristic information, the characteristic information converting dictionary defining a corresponding relation between the semantic characteristic information, the physical characteristic information and the prominence characteristic information; and

an image retrieval step in which the arithmetic unit carries out the characteristic information converting step based on the first characteristic information and the second characteristic information, which are inputted in the retrieval key inputting step, to retrieve an image subject to retrieval at least being approximate to third characteristic information other than the first characteristic information and the second characteristic information among the semantic characteristic information, the physical characteristic information and the prominence characteristic information, from a retrieval subject image storing unit stored with respective images subject to retrieval, the images corresponding to the first characteristic information and the second characteristic information.