SYSTEM AND METHODS FOR SEARCHING IMAGES IN PRESENTATIONS

• US 20090112830A1
• Filed: 10/25/2007
• Published: 04/30/2009
• Est. Priority Date: 10/25/2007
• Status: Abandoned Application

• Current Assignee: Fuji Xerox Company Limited (Fujifilm Holdings Corporation)
• Original Assignee: Fuji Xerox Company Limited (Fujifilm Holdings Corporation)
• Inventors: Denoue, Laurent, Adcock, John
• Application Number:
  US11/924,518
• Publication Number:
  US 20090112830A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/58 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually

Abstract

Image search and retrieval system is provided. System identifies pictures embedded in presentation slides. System represents each set of identical (or nearly identical) images with unique token. For example, if specific picture is reused in multiple presentations, it will be represented by system using same token. System may compute and store various meta attributes associated with presentation slide and image(s) therein. After the token and meta attribute information are generated for images and/or slides, generated data is provided to text-based search engine. A searched image is subsequently located and retrieved by user using search query issued by user to text-based search engine, which locates images based on generated token and meta attribute information. At query time, user enters search keywords describing target image that user desires to locate. Pursuant to user'"'"'s query, system retrieves all matching presentation slides. Found images may be ranked using, for example, tf*idf score.

Claims

1. A method comprising:

a. Extracting at least one image embedded in at least one presentation slide;

b. Generating a token representation of the identified at least one image;

c. Computing meta attributes of the identified at least one image and the at least one presentation slide;

d. Making the generated token representation and the computed meta attributes available to a search engine; and

e. Performing image search using the generated token representation and the computed meta attributes.

2. The method of claim 1, further comprising ranking found images using at least one measure.

3. The method of claim 2, wherein the at least one measure is a tf*idf measure.

4. The method of claim 1, wherein generating the token presentation further comprises:

i. Scaling the image to a predetermined size;

ii. Performing transformation of the scaled image into a frequency domain to create a frequency representation of the image; and

iii. Finding duplicate images, wherein finding duplicate images comprises generating the token representation of the image using the frequency representation of the image and comparing frequency representation coefficients of the image to second frequency representation coefficients of a second image and, if the frequency representation coefficients are close to the second frequency representation coefficients, using second token representation of the second image as the token representation.

5. The method of claim 1, further comprising extracting textual information from the at least one presentation slide and making the extracted textual information available to the search engine.

6. The method of claim 5, wherein the textual information is extracted using an optical character recognition.

7. The method of claim 1, wherein similar images have identical token representations.

8. The method of claim 1, wherein computing meta attributes comprises:

determining position of the one or more images on the at least one presentation slide, determining width and height of the one or more images, determining a size of the one or more images relative to a size of the at least one presentation slide or determining a number of images in the at least one presentation slide.

9. The method of claim 1, further comprising displaying found images and removing duplicate images.

10. The method of claim 9, further comprising displaying information on previous uses of the found images.

11. The method of claim 9, further comprising enabling a user to select at least one found image and use the selected at least one found image to form a new search query or augment an existing search query.

12. The method of claim 1, wherein extracting at least one image comprises eliminating background of the at least one presentation slide.

13. A system comprising:

a. Image extraction module operable to extract at least one image embedded in at least one presentation slide;

b. Token generation module operable to generate a token representation of the identified at least one image;

c. Meta attributes computing module operable to compute meta attributes of the identified at least one image and the at least one presentation slide;

d. A search engine operable to access the generated token representation and the computed meta attributes and perform image search using the generated token representation and the computed meta attributes.

14. The system of claim 13, wherein the search engine is further operable to rank found images using at least one measure.

15. The system of claim 14, wherein the at least one measure is a tf*idf measure.

16. The system of claim 13, wherein the token generation module is further operable to:

i. Scale the image to a predetermined size;

ii. Perform transformation of the scaled image into a frequency domain to create a frequency representation of the image; and

iii. Find duplicate images, wherein finding duplicate images comprises generating the token representation of the image using the frequency representation of the image and comparing frequency representation coefficients of the image to second frequency representation coefficients of a second image and, if the frequency representation coefficients are close to the second frequency representation coefficients, using second token representation of the second image as the token representation.

17. The system of claim 13, further comprising a textual information extraction module operable to extract textual information from the at least one presentation slide and make the extracted textual information available to the search engine.

18. The system of claim 17, wherein the textual information is extracted using an optical character recognition.

19. The system of claim 13, wherein similar images have identical token representations.

20. The system of claim 13, wherein meta attributes computing module is further operable to:

determine position of the one or more images on the at least one presentation slide, determine width and height of the one or more images, determine a size of the one or more images relative to a size of the at least one presentation slide or determine a number of images in the at least one presentation slide.

21. The system of claim 13, further comprising a used interface operable to display found images and remove duplicate images.

22. The system of claim 21, wherein the user interface is further operable to display information on previous uses of the found images.

23. The system of claim 21, wherein the user interface is further operable to enable a user to select at least one found image and use the selected at least one found image to form a new search query or augment an existing search query.

24. The system of claim 13, wherein the image extraction module is further operable to eliminate background of the at least one presentation slide.

25. A computer-readable medium embodying a set of computer instructions implementing a method comprising:

a. Extracting at least one image embedded in at least one presentation slide;

b. Generating a token representation of the identified at least one image;

c. Computing meta attributes of the identified at least one image and the at least one presentation slide;

d. Making the generated token representation and the computed meta attributes available to a search engine; and

e. Performing image search using the generated token representation and the computed meta attributes.