Image search method and apparatus

• US 20020168117A1
• Filed: 03/25/2002
• Published: 11/14/2002
• Est. Priority Date: 03/26/2001
• Status: Abandoned Application

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Lee, Jin Soo, Kim, Hyeon Jun
• Application Number:
  US10/103,820
• Publication Number:
  US 20020168117A1
• Time in Patent Office: Days
• US Class Current: 382/305
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G06F 16/5862 using texture

Abstract

An image search method comprising the step of searching for a desired image to be found, on the basis of an image created by a user as a query image, the step of allowing the user to select one or more images similar to the desired image from among search results for the desired image, and the step of designating the selected similar images as query images and re-searching for the desired image on the basis of the designated query images.

Claims

1. An image search method comprising the steps of:

a) searching for a desired image to be found, on the basis of an image created by a user as a query image;

b) allowing the user to select one or more images similar to said desired image from among search results for said desired image; and

c) designating the selected similar images as query images and re-searching for said desired image on the basis of the designated query images.

2. The image search method as set forth in claim 1, wherein said step c) includes the step of designating any ones of said similar images selected by the user as said query images for the re-search on the basis of similarities between said similar images and a query image used for a previous search.

3. The image search method as set forth in claim 1, wherein said step c) includes the step of calculating feature information weights on the basis of said similar images selected by the user and performing the re-search on the basis of the calculated feature information weights.

4. The image search method as set forth in claim 1, wherein said step c) includes the step of designating one or more of said similar images selected by the user as said query images for the re-search in the order of user selection or on the basis of similarities between said similar images and said query image created by the user.

5. The image search method as set forth in claim 1, wherein said step c) includes the step d) of performing the re-search on the basis of selection of any one or combination of text information commonly included in said similar images selected by the user and low-level feature information, a sequential combination of said text information and low-level feature information, and an availability of said text information.

6. The image search method as set forth in claim 5, wherein said step d) includes the step of obtaining said text information availability by calculating an occurrence rate of a commonly included specific keyword in said similar images selected by the user.

7. The image search method as set forth in claim 5, wherein said step d) includes the step of performing the re-search on the basis of said text information commonly included in said similar images selected by the user if said text information availability is greater than a predetermined threshold value, and on the basis of said low-level feature information if said text information availability is not greater than said predetermined threshold value.

8. The image search method as set forth in claim 5, wherein said step d) includes the step of, if said text information availability is greater than a predetermined threshold value, performing a search operation on the basis of said text information, designating images having matching points greater than a predetermined threshold value among search results as result candidates, and then outputting search results for the designated result candidates in the order of descending similarities on the basis of said low-level feature information.

9. The image search method as set forth in claim 5, wherein said step d) includes the step of, if said text information availability is not greater than a predetermined threshold value, designating images whose similarities are greater than a predetermined threshold value, as result candidates on the basis of said low-level feature information, performing a search operation for the designated result candidates on the basis of said text information and outputting search results in the order of descending matching points.

10. The image search method as set forth in claim 5, wherein said step d) includes, in order to perform the re-search on the basis of the sequential combination of said text information and low-level feature information, the steps of:

calculating said text information availability;

calculating weights of said feature information;

calculating a weight of said text information in proportion to said text information availability;

obtaining a final similarity of each object image by summing up a similarity of each object image based on said feature information reflecting the calculated feature information weights and text information weight, and a text matching point of each object image; and

outputting search results in the order of descending values of the calculated final similarities.

11. An image search method comprising the steps of:

a) outputting similar image candidates in response to a user'"'"'s query;

b) allowing the user to select images considered to be similar to a desired image to be found, from among said similar image candidates; and

c) calculating an availability of text information included in the selected similar images, determining a next query element as a result of the calculation and performing a re-search operation on the basis of the determined query element.

12. The image search method as set forth in claim 11, wherein said next query element determined according to said text information availability is any one or combination of said text information and low-level feature information, or a sequential combination of said text information and low-level feature information.

13. The image search method as set forth in claim 11, wherein said step c) includes the step of obtaining said text information availability by calculating an occurrence rate of a commonly included specific keyword in said similar images selected by the user.

15. The image search method as set forth in claim 14, wherein said step c) includes the step of designating any ones of said similar images as said query images for the re-search on the basis of similarities between said similar images and a query image used for a previous search.

16. The image search method as set forth in claim 14, wherein said step c) includes the step of calculating feature information weights on the basis of similar images selected by a user and performing the re-search on the basis of the calculated feature information weights.

17. The image search method as set forth in claim 14, wherein said step c) includes the step of designating one or more of said similar images as said query images for the re-search in the order of user selection or on the basis of similarities between similar images selected by a user and a query image created by the user.

19. The image search method as set forth in claim 18, wherein said step b) includes the steps of:

performing a search operation based on said keyword entered by the user; and

performing a search operation for search results based on said keyword entered by the user on the basis of said query image created by the user to output the rough search results.

20. The image search method as set forth in claim 18, wherein said step b) includes the steps of:

performing a search operation based on said query image created by the user; and

performing a search operation for search results based on said query image created by the user on the basis of said keyword entered by the user to output the rough search results.

21. The image search method as set forth in claim 18, wherein said step b) includes the steps of:

performing a search operation based on said query image created by the user and a search operation based on said keyword entered by the user together; and

combining similarities based on said created query image and keyword information matching points to output the rough search results.

22. The image search method as set forth in claim 18, wherein said step d) includes the step of designating any ones of said similar images as said query images for the re-search on the basis of similarities between said similar images and a query image used for a previous search.

23. The image search method as set forth in claim 18, wherein said step d) includes the step of calculating feature information weights on the basis of similar images selected by the user and performing the re-search on the basis of the calculated feature information weights.

24. The image search method as set forth in claim 18, wherein said step d) includes the step of designating one or more of said similar images as said query images for the re-search in the order of user selection or on the basis of similarities between similar images selected by the user and said query image created by the user.

26. The image search apparatus as set forth in claim 25, wherein said query elements are two of a query image created by a user, a query image from the user and an image description text.

27. The image search apparatus as set forth in claim 26, wherein said user interface means selectively includes a query image creator, a query image selector and a keyword query unit according to said query elements.

28. The image search apparatus as set forth in claim 26, further comprising:

weight extraction means for calculating feature information weights on the basis of a plurality of similar images selected by said user interface means; and

weight application search means for performing a search operation based on application of said feature information weights calculated by said weight extraction means.

29. The image search apparatus as set forth in claim 26, further comprising search information determination means for determining on the basis of a plurality of similar images selected by said user interface means which one of text information and low-level feature information will be used as a query element for a next search.

30. The image search apparatus as set forth in claim 29, wherein said search information determination means is adapted to determine a specific keyword commonly included in said similar images selected by said user interface means as said query element for the next search if an occurrence rate of said commonly included specific keyword is greater than a predetermined threshold value, and to determine said low-level feature information as said query element for the next search if the occurrence rate of said commonly included specific keyword is not greater than the predetermined threshold value.

14. An image search method comprising the steps of:

a) searching for a desired image to be found, on the basis of a keyword;

b) selecting images similar to said desired image from among search results for said desired image; and

c) designating the selected similar images as query images and re-searching for said desired image on the basis of the designated query images.

18. An image search method comprising the steps of:

a) allowing a user to create a query image and enter a keyword;

b) performing a rough search on the basis of the created query image and the entered keyword;

c) selecting images similar to a desired image to be found, from among results of the rough search; and

d) designating one or more of the selected similar images as query images and performing a re-search on the basis of the designated query images.

25. An image search apparatus comprising:

user interface means for sequentially and hierarchically combining and inputting different types of query elements for an image search based on said query elements; and

search means for performing the image search based on said query elements inputted by said user interface means to output search results corresponding to the sequential and hierarchical combination of said query elements.

31. An image search method comprising the steps of:

a) inputting a query for a rough search;

b) performing the rough search on the basis of the inputted query; and

c) selecting images similar to a desired image to be found, from among results of said rough search; and

d) designating one or more of the selected similar images as query images and performing a re-search on the basis of the designated query images.

32. The image search method as set forth in claim 31, wherein said query for said rough search is based on a keyword entered by a user or a query image created by the user.

33. The image search method as set forth in claim 31, wherein said step d) includes the step of performing the re-search on the basis of feature information weights extracted from similar images selected by a user, or an availability of text information commonly included in the similar images selected by the user.