Chromatic matching game

• US 8,369,616 B2
• Filed: 10/20/2010
• Issued: 02/05/2013
• Est. Priority Date: 10/20/2010
• Status: Active Grant

• Current Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Original Assignee: Xerox Corporation (Xerox Holdings Corp.)
• Inventors: Marchesotti, Luca, Fucs, Ana
• Primary Examiner(s): Koziol, Stephen R
• Assistant Examiner(s): SAINI, AMANDEEP SINGH
• Application Number:
  US12/908,410
• Publication Number:
  US 20120099784A1
• Time in Patent Office: 839 Days
• Field of Search: None
• US Class Current: 382/162
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G06V 10/56 relating to colour

Abstract

A system and method for image retrieval formulated as a game are disclosed. The method includes receiving a user'"'"'s image category selection, retrieving an image responsive to the user'"'"'s image category selection from an associated image database, and displaying the retrieved image and a set of candidate color palettes to the user. The set of candidate color palettes includes a correct palette and at least one incorrect palette. The method further includes providing for a user to attempt to identify the correct palette by selecting at least one of the displayed candidate color palettes and, with a computer processor, generating a score based on the user'"'"'s at least one selection and outputting the score.

Claims

1. A method for image retrieval formulated as a game comprising:

a) receiving a user'"'"'s image category selection;

b) retrieving an image responsive to the user'"'"'s image category selection from an associated image database;

c) providing for displaying the retrieved image and a set of candidate color palettes to the user, the set of candidate color palettes including a correct palette and at least one incorrect palette;

d) providing for a user to attempt to identify the correct palette by selecting at least one of the displayed candidate color palettes;

e) providing for a user to bookmark at least one of;

the displayed image; and

at least one of the displayed candidate color palettes, and

when the user bookmarks the displayed image, retrieving a next image similar to the bookmarked displayed image, including comparing an image signature of the displayed image with image signatures of images in the database and retrieving an image having an image signature which is similar to the signature of the displayed image, and

when the user bookmarks a displayed color palette, retrieving a next image having a color palette which is similar to the bookmarked displayed color palette;

f) with a computer processor, generating a score based on the user'"'"'s at least one selection and outputting the score; and

g) repeating c), and d) wherein the retrieved image is the next image.

6. The method of claim 1, wherein the retrieving of the image responsive to the user'"'"'s image category selection comprises receiving an image which is tagged with a tag which matches a user'"'"'s selected category.

7. The method of claim 1, wherein each of the candidate color palettes in the set includes a plurality of color swatches.

8. The method of claim 1, wherein each of the candidate color palettes in the set includes at least three color swatches.

12. The method of claim 1, wherein the set of candidate color palettes includes at least one color palette retrieved from a database of predefined color palettes.

13. The method of claim 1, wherein the set of candidate color palettes includes at least one color palette extracted from the image, the extracted palette being the correct palette.

14. The method of claim 13, wherein the extracted color palette comprises no more than ten colors.

15. The method of claim 1, wherein for each of the set of candidate color palettes, each color in the color palette is displayed as a swatch.

16. The method of claim 1, wherein the user is allowed a fixed time to identify the correct palette.

17. The method of claim 1, wherein the generating of the score is based on at least one of a number of incorrect palettes selected by the user before the correct palette is selected and a time taken to select the correct palette.

18. The method of claim 1, wherein the score is cumulated over a plurality of retrieved images and corresponding sets of candidate color palettes.

19. The method of claim 18, further comprising, providing for the user to redeem points based on the accumulated score for an item or service of value.

20. The method of claim 1, further comprising providing for the user to select from a plurality of games, including:

a first game in which the correct palette is a color palette which is computed to be a most similar one of the candidate color palettes, based on the color palette extracted from the displayed image, or which is the color palette extracted from the displayed image; and

a second game in which the correct palette is a color palette which is computed to be a most harmonious one of the candidate palettes, based on the color palette extracted from the displayed image.

21. A computer program product comprising a non-transitory recording medium encoding instructions, which when executed on a computer, causes the computer to perform the method of claim 1.

22. A system for performing the method of claim 1 comprising memory which stores instructions for performing the method and a processor in communication with the memory, for executing the instructions.

2. A system for image retrieval formulated as a game comprising:

an image retrieval component for retrieving an image from an associated image database;

a palette extractor which extracts a color palette from the retrieved image;

a candidate palette retrieval component for retrieving predefined color palettes from an associated color palette database based on a comparison with the extracted color palette;

a visualization component for visualizing a set of candidate color palettes for display on a user'"'"'s graphical user interface in association with the retrieved image, the set of candidate color palettes including the extracted color palette and at least one of the retrieved predefined color palettes;

a scoring component for scoring a user'"'"'s selection of at least one of the displayed set of candidate color palettes, whereby a score is displayable on the user'"'"'s graphical user interface; and

a processor which implements the image retrieval component, the palette extractor, the candidate palette retrieval component, the visualization component, and the scoring component.

3. The system of claim 2, wherein the system is a web-based system.

4. A method comprising:

retrieving an image from an associated image database;

extracting a color palette from the retrieved image;

with a computer processor, retrieving predefined color palettes from an associated color palette database based on a comparison with the extracted color palette;

visualizing a set of candidate color palettes for display on a user'"'"'s graphical user interface in association with the retrieved image, the set of candidate color palettes including the extracted color palette and at least one of the retrieved predefined color palettes;

scoring a user'"'"'s selection of at least one of the displayed set of candidate color palettes, whereby a score is displayable on the user'"'"'s graphical user interface;

providing for the user to bookmark at least one of the displayed image and one of the candidate color palettes in the set of color palettes; and

wherein the retrieval of the image is retrieved based on at least one of;

an image category selected by the user;

a different image bookmarked in a prior round in which the different image and an associated set of candidate color palettes was displayed to the user; and

a color palette bookmarked in the prior round.

5. A method for image retrieval formulated as a game comprising:

a) receiving a user'"'"'s image category selection;

b) retrieving an image responsive to the user'"'"'s image category selection from an associated image database;

c) providing for displaying the retrieved image and a set of candidate color palettes to the user, the set of candidate color palettes including a correct palette and at least one incorrect palette;

d) providing for a user to attempt to identify the correct palette by selecting at least one of the displayed candidate color palettes;

e) providing for a user to bookmark at least one of;

the displayed image; and

at least one of the displayed candidate color palettes, and

when the user bookmarks the displayed image, retrieving a next image similar to the bookmarked displayed image, and

when the user bookmarks a displayed color palette, retrieving a next image having a color palette which is similar to the bookmarked displayed color palette, including comparing the color palette with color palettes extracted from the images in the database and retrieving an image having an extracted color palette which is similar to the bookmarked color palette;

f) with a computer processor, generating a score based on the user'"'"'s at least one selection and outputting the score; and

g) repeating c), and d) wherein the retrieved image is the next image.

9. A method for image retrieval formulated as a game comprising:

receiving a user'"'"'s image category selection;

retrieving an image responsive to the user'"'"'s image category selection from an associated image database;

extracting a color palette from the retrieved image;

comparing the extracted color palette with a set of stored predefined color palettes;

retrieving a subset of the stored predefined color palettes based on the comparison;

providing for displaying the retrieved image and a set of candidate color palettes to the user, the set of candidate color palettes comprising the extracted color palette as a correct color palette and at least some of the color palettes in the subset as incorrect color palettes;

providing for a user to attempt to identify the correct palette by selecting at least one of the displayed candidate color palettes; and

with a computer processor, generating a score based on the user'"'"'s at least one selection and outputting the score.

10. The method of claim 9, wherein the comparing comprises computing a distance metric which takes into account each of the colors in the extracted color palette.

11. The method of claim 10, wherein the computing of the distance metric comprises computing an earth mover'"'"'s distance.

23. The method of claim 9, further comprising:

providing for a user to bookmark at least one of;

the displayed image; and

at least one of the displayed candidate color palettes.

24. The method of claim 23, further comprising:

when the user bookmarks the displayed image, retrieving a next image similar to the bookmarked displayed image and when the user bookmarks a displayed color palette, retrieving a next image having a color palette which is similar to the bookmarked displayed color palette

repeating the displaying and providing for the user to attempt to identify the correct palette, wherein the retrieved image is the next image.

25. The method of claim 24, wherein when the user bookmarks the displayed image, the retrieving a next image includes comparing an image signature of the displayed image with image signatures of images in the database and retrieving an image having an image signature which is similar to the signature of the displayed image.

26. The method of claim 9, wherein the generating of the score is based on at least one of a number of incorrect palettes selected by the user before the correct palette is selected and a time taken to select the correct palette.