Automatic image-based recommendations using a color palette

• US 9,679,532 B2
• Filed: 06/26/2014
• Issued: 06/13/2017
• Est. Priority Date: 06/26/2014
• Status: Expired due to Fees

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Dorner, Charles Shearer, Galore, Janet Ellen, Haitani, Robert Yuji, Hazlewood, William R., Blackburn, Jenny Ann, Ong, Timothy Andrew, Ramos, Gonzalo Alberto, Pham, Dominick, Sayre, III, Paul Barnhart
• Primary Examiner(s): Richer, Aaron M
• Application Number:
  US14/316,268
• Publication Number:
  US 20150379959A1
• Time in Patent Office: 1,083 Days
• Field of Search: None
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G06Q 30/0627 using item specifications
• CPC Class Codes: G06Q 30/0631 Item recommendations
• CPC Class Codes: G09G 5/06 using colour palettes, e.g. look-up tables

Abstract

Systems and methods are described that recommend images, items, and/or metadata based at least in part on a reference color palette or reference color name. A color name can be converted into a representation of the color name in a color space. The reference color can be used to identify images that contain the reference color. The identified images and associated metadata can be analyzed, sorted and provided as an ordered list of items. Systems and methods are also described that identify items that contain colors affiliated with the reference color. Systems and methods are also described that validate color identifier information in metadata associated with an image. Systems and methods are also described that identify non-color specific keywords associated with the reference color.

Claims

1. A computer-implemented method for generating a grouping of recommended items, the computer-implemented method comprising:

under control of a hardware computing device configured with specific computer executable instructions,

obtaining, from a plurality of predetermined color palettes, a first predetermined color palette and a second predetermined color palette, the first predetermined color palette comprising a first color, the second predetermined color palette comprising a second color, wherein at least one color palette of the plurality of predetermined color palettes comprises a third color, and wherein each color palette from the plurality of predetermined color palettes is associated with a respective color palette weight;

determining, from the plurality of predetermined color palettes, a first subset of color palettes, wherein each color palette from the first subset of color palettes comprises the first color;

determining, from the plurality of predetermined color palettes, a second subset of color palettes, wherein each color palette from the second subset of color palettes comprises the second color;

determining a first cumulative weight for the first color based at least on respective color palette weights associated with the first subset of color palettes, and a second cumulative weight for the second color based at least on respective color palette weights associated with the second subset of color palettes;

selecting the first color based at least in part on the first cumulative weight relative to a third cumulative weight associated with the third color;

selecting the second color based at least in part on the second cumulative weight relative to the third cumulative weight;

obtaining one or more color images;

identifying one or more matching images from the one or more color images, each matching image containing at least a first image color that corresponds to at least the first color, and a second image color that corresponds to at least the second color;

obtaining metadata associated with each matching image of the one or more matching images;

generating a grouping of recommended items based at least in part on an analysis of the metadata associated with each matching image of the one or more matching images;

generating a ranking of the grouping of recommended items based at least in part on at least one of a first closeness of the first image color to the first color or a second closeness of the second image color to the second color; and

causing presentation, in a user interface, of at least two items from the grouping of recommended items based at least in part on the ranking.

2. The computer-implemented method of claim 1, wherein identifying the one or more matching images further comprises:

determining a search color range for the first color, the search color range for the first color based at least in part on a color distance from the first color in a color space; and

determining that the first image color is within the search color range.

3. The computer-implemented method of claim 1, wherein the first closeness comprises a first distance between the first image color and the first color in a color space.

4. The computer-implemented method of claim 1 further comprising:

receiving user input data corresponding to a selection of the first predetermined color palette.

5. The computer-implemented method of claim 1 further comprising:

selecting, from the plurality of predetermined color palettes, the first predetermined color palette, based at least in part on an input image.

6. A computer-implemented method comprising:

under control of a hardware computing device configured with specific computer-executable instructions,

obtaining, from a plurality of predetermined color palettes, a first predetermined color palette comprising a first color, wherein at least one color palette of the plurality of predetermined color palettes comprises a second color, and wherein each color palette from the plurality of predetermined color palettes is associated with a respective color palette weight;

determining, from the plurality of predetermined color palettes, a first subset of color palettes, wherein each color palette from the first subset of color palettes comprises the first color;

determining a first cumulative weight for the first color based at least on respective color palette weights associated with the first subset of color palettes;

selecting the first color based at least in part on the first cumulative weight relative to a second cumulative weight associated with the second color;

identifying one or more corresponding images from a plurality of color images, each corresponding image containing at least one image color that corresponds to at least the first color;

generating a grouping of items based at least in part on metadata associated with each corresponding image of the one or more corresponding images;

generating a ranking of the grouping of items based at least in part on a closeness of a corresponding image color to the first color; and

causing presentation of at least two items from the grouping of items based at least in part on the ranking.

7. The computer-implemented method of claim 6 further comprising:

obtaining a color name; and

parsing the color name to select the first predetermined color palette from the plurality of predetermined color palettes.

8. The computer-implemented method of claim 6, wherein identifying the one or more corresponding images further comprises:

determining a search color range for the first color, the search color range for the first color based at least in part on a color distance from the first color in a color space; and

determining that the at least one image color is within the search color range.

9. The computer-implemented method of claim 8, wherein the search color range for the first color is based at least in part on a color distance formula.

10. The computer-implemented method of claim 6 further comprising:

obtaining a text query;

parsing the text query to identify one or more item identifiers;

generating a subset of the grouping of items to include items associated with at least one of the one or more item identifiers; and

causing presentation of the subset of the grouping of items.

11. The computer-implemented method of claim 6, wherein the ranking is further based at least in part on a quantity of at least one of the first color or one or more additional search colors contained in an associated image.

12. A system comprising:

a data store configured to at least store computer-executable instructions; and

a hardware processor in communication with the data store, the hardware processor configured to execute the computer-executable instructions to at least;

obtain, from a plurality of predetermined color palettes, a first predetermined color palette comprising a first color, wherein at least one color palette of the plurality of predetermined color palettes comprises a second color, and wherein each color palette from the plurality of predetermined color palettes is associated with a respective color palette weight;

determine, from the plurality of predetermined color palettes, a first subset of color palettes, wherein each color palette from the first subset of color palettes comprises the first color;

determine a first cumulative weight for the first color based at least on respective color palette weights associated with the first subset of color palettes;

select the first color based at least in part on the first cumulative weight relative to a second cumulative weight associated with the second color;

identify one or more corresponding images from a plurality of color images, each corresponding image containing at least one image color that corresponds to at least the first color;

generate a grouping of items based at least in part on metadata associated with each corresponding image of the one or more corresponding images;

generate a ranking of the grouping of items based at least in part on a dominance, in an associated image, of a corresponding image color that corresponds to the first color; and

causing presentation of at least two items from the grouping of items based at least in part on the ranking.

13. The system of claim 12 further comprising an item data store in communication with the hardware processor and configured to at least store the plurality of color images, wherein at least one color image of the plurality of color images is associated with an item and metadata.

14. The system of claim 12, wherein the first predetermined color palette is associated with a user-specified color palette name.

15. The system of claim 12, wherein identifying the one or more corresponding images further comprises:

determining a search color range for the first color, the search color range for the first color based at least in part on a color distance from the first color in a color space; and

determining that the at least one image color is within the search color range.

16. The system of claim 12, wherein the hardware processor is further configured to execute computer-executable instructions to:

receive an input color, the first predetermined color palette further comprising the input color;

identify, from the plurality of predetermined color palettes, a second predetermined color palette comprising the input color and a third color;

determine, from the plurality of predetermined color palettes, a second subset of color palettes, wherein each color palette from the second subset of color palettes comprises the third color;

determine a third cumulative weight for the third color based at least on respective color palette weights associated with the second subset of color palettes; and

select the third color based at least in part on the third cumulative weight relative to the second cumulative weight, wherein each matching image further contains at least another image color that corresponds to at least the third color.

17. A non-transitory computer readable storage medium storing computer executable instructions that when executed by a processor perform operations comprising:

obtaining, from a plurality of predetermined color palettes, a first predetermined color palette comprising a first color, wherein at least one color palette of the plurality of predetermined color palettes comprises a second color, and wherein each color palette from the plurality of predetermined color palettes is associated with a respective color palette weight;

determining, from the plurality of predetermined color palettes, a first subset of color palettes, wherein each color palette from the first subset of color palettes comprises the first color;

determining a first cumulative weight for the first color based at least on respective color palette weights associated with the first subset of color palettes;

selecting the first color based at least in part on the first cumulative weight relative to a second cumulative weight associated with the second color;

identifying one or more matching images from a plurality of color images, each matching image containing at least one image color that corresponds to at least the first color;

generating a grouping of items based at least in part on metadata associated with each matching image of the one or more matching images;

generating a ranking of the grouping of items based at least in part on a quantity of at least one of the first color or one or more additional search colors in an associated image; and

causing presentation of at least two items from the grouping of items based at least in part on the ranking.

18. The non-transitory computer readable storage medium of claim 17, the operations further comprising:

determining a search color range for the first color, the search color range for the first color based at least in part on a color distance from the first color in a color space; and

determining that the at least one image color is within the search color range.

19. The non-transitory computer readable storage medium of claim 18, the operations further comprising:

receive a input color, the first predetermined color palette further comprising the input color;

identify, from the plurality of predetermined color palettes, a second predetermined color palette comprising the input color and a third color;

determine, from the plurality of predetermined color palettes, a second subset of color palettes, wherein each color palette from the second subset of color palettes comprises the third color;

determine a third cumulative weight for the third color based at least on respective color palette weights associated with the second subset of color palettes; and

select the third color based at least in part on the third cumulative weight relative to the second cumulative weight, wherein each matching image further contains at least another image color that corresponds to at least the third color.

20. The non-transitory computer readable storage medium of claim 18, wherein the search color range for the first color is based at least in part on a color distance formula.