Automatic image-based recommendations using a color palette

• US 10,186,054 B2
• Filed: 12/19/2016
• Issued: 01/22/2019
• Est. Priority Date: 06/26/2014
• Status: Expired due to Fees

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Sayre, III, Paul Barnhart, Dorner, Charles Shearer, Ramos, Gonzalo Alberto
• Primary Examiner(s): Motsinger, Sean T
• Application Number:
  US15/384,156
• Publication Number:
  US 20170098314A1
• Time in Patent Office: 764 Days
• CPC Class Codes: G06Q 30/0623 Item investigation
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 2207/10024 Color image

Abstract

Systems and methods are described that recommend images, items, and/or metadata based at least in part on a reference color palette or reference color name. A color name can be converted into a representation of the color name in a color space. The reference color can be used to identify images that contain the reference color. The identified images and associated metadata can be analyzed, sorted and provided as an ordered list of items. Systems and methods are also described that identify items that contain colors affiliated with the reference color. Systems and methods are also described that validate color identifier information in metadata associated with an image. Systems and methods are also described that identify non-color specific keywords associated with the reference color.

Claims

1. A computer-implemented method for generating a custom color palette, the computer-implemented method comprising:

under control of a hardware computing device configured with specific computer-executable instructions,

receiving, via a user interface, user input;

deriving a first color from one or more color images based at least in part on the user input, the first color associated with a color name;

obtaining a plurality of affiliated palettes, wherein each affiliated palette of the plurality of affiliated palettes includes the first color, wherein each affiliated palette of the plurality of affiliated palettes is user generated, and wherein each affiliated palette of the plurality of affiliated palettes is associated with a respective user assigned weight;

identifying at least one second color based at least in part on the plurality of affiliated palettes, wherein at least a first subset of the plurality of affiliated palettes includes a respective color corresponding to the at least one second color, and wherein identifying the at least one second color further comprises;

identifying the first subset of the plurality of affiliated palettes;

determining a first cumulative weight for the at least one second color based at least on respective weights associated with each palette of the first subset; and

determining that the first cumulative weight has a higher rank than a second weight;

identifying at least one third color based at least in part on the plurality of affiliated palettes, wherein at least a second subset of the plurality of affiliated palettes includes a respective color corresponding to the at least one second color and the at least one third color, and wherein identifying the at least one third color further comprises;

identifying the second subset of the plurality of affiliated palettes;

determining a third cumulative weight for the at least one third color based at least on respective weights associated with each palette of the second subset; and

determining that the third cumulative weight has a higher rank than a fourth weight;

generating a custom palette to include at least the first color, the second color, and the third color; and

causing presentation, in the user interface, of the custom palette.

2. The computer-implemented method of claim 1, wherein obtaining the plurality of affiliated palettes further comprises:

determining that each affiliated palette, of the plurality of affiliated palettes, includes the first color by including a color that is within a threshold distance from the first color in a color space.

3. The computer-implemented method of claim 1, wherein receiving the user input further comprises receiving a reference color name different from the color name, further comprising:

determining, from the reference color name, the color name based at least in part on natural language processing.

4. The computer-implemented method of claim 1, further comprising:

receiving the color name; and

identifying the one or more color images associated with the color name.

5. A non-transitory computer-readable storage medium storing computer-executable instructions that when executed by a processor perform operations comprising:

receiving, via a user interface, a reference color name;

determining, from the reference color name, a color name based at least in part on natural language processing, the color name different from the reference color name;

deriving a first color from one or more color images, the color name associated with at least one of the first color or the one or more color images;

obtaining a first plurality of affiliated palettes, wherein each affiliated palette of the first plurality of affiliated palettes includes the first color;

identifying at least one second color based at least in part on the first plurality of affiliated palettes, wherein at least a first subset of the first plurality of affiliated palettes includes a color corresponding to the at least one second color;

obtaining a second plurality of affiliated palettes, wherein each affiliated palette of the second plurality of affiliated palettes includes the first color and the second color, and wherein each affiliated palette of the first plurality of affiliated palettes and the first plurality of affiliated palettes is user generated;

identifying at least one third color based at least in part on the second plurality of affiliated palettes, wherein at least a second subset of the second plurality of affiliated palettes includes a color corresponding to the at least third second color;

generating a custom palette to include at least the first color, the second color, and the third color; and

causing presentation, in the user interface, of the custom palette.

6. The non-transitory computer-readable storage medium of claim 5, wherein each affiliated palette of the first plurality of affiliated palettes is associated with a respective weight, and wherein identifying the at least one second color further comprises:

identifying the first subset of the first plurality of affiliated palettes;

determining a first cumulative weight for the at least one second color based at least on respective weights associated with each palette of the first subset; and

determining that the first cumulative weight has a higher rank than a second weight.

7. The non-transitory computer-readable storage medium of claim 5, wherein obtaining the first plurality of affiliated palettes further comprises:

determining that each affiliated palette, of the first plurality of affiliated palettes, includes the first color by including a color that is within a threshold distance from the first color in a color space.

8. The non-transitory computer-readable storage medium of claim 5, wherein the operations further comprise:

identifying the one or more color images associated with the color name.

9. The non-transitory computer-readable storage medium of claim 8, wherein each image of the one or more color images is associated with metadata, and wherein identifying the one or more color images further comprises:

determining, from a plurality of color images, that respective metadata of the one or more color images corresponds to the color name.

10. The non-transitory computer-readable storage medium of claim 5, wherein the operations further comprise:

identifying first item data associated with the first color;

identifying second item data associated with the second color; and

providing the first item data and the second item data to a computing device.

11. A system comprising:

a non-transitory computer-readable storage medium configured to at least store computer-executable instructions; and

a hardware processor in communication with the non-transitory computer-readable storage medium, the hardware processor configured to execute the computer-executable instructions to at least;

receive, via a user interface, user input;

determine a first color based at least in part on the user input;

obtain a first plurality of affiliated palettes, wherein each affiliated palette of the first plurality of affiliated palettes includes the first color, and wherein each affiliated palette of the first plurality of affiliated palettes is associated with a respective weight;

identify at least one second color based at least in part on the first plurality of affiliated palettes, wherein at least a first subset of the first plurality of affiliated palettes includes a respective color corresponding to the at least one second color, and wherein identifying the at least one second color further comprises;

identifying the first subset of the first plurality of affiliated palettes;

determining a first cumulative weight for the at least one second color based at least on respective weights associated with each palette of the first subset; and

determining that the first cumulative weight has a higher rank than a second weight;

identify at least one third color based at least in part on a second plurality of affiliated palettes, wherein at least a second subset of the second plurality of affiliated palettes includes a respective color corresponding to the first color, the at least one second color, and the at least one third color, wherein each affiliated palette of the first plurality of affiliated palettes and the first plurality of affiliated palettes is user generated, and wherein identifying the at least one third color further comprises;

identifying the second subset of the second plurality of affiliated palettes;

determining a third cumulative weight for the at least one third color based at least on respective weights associated with each palette of the second subset; and

determining that the third cumulative weight has a higher rank than a fourth weight;

generate a custom palette to include at least the first color, the second color, and the third color; and

cause presentation, in the user interface, of the custom palette.

12. The system of claim 11, wherein obtaining the first plurality of affiliated palettes further comprises:

determining that each affiliated palette, of the first plurality of affiliated palettes, includes the first color by including a color that is within a threshold distance from the first color in a color space.

13. The system of claim 11, wherein receiving the user input further comprises receiving the color name, and wherein the hardware processor is further configured to execute the computer-executable instructions to at least:

determine the first color based at least in part on the color name.

14. The system of claim 13, wherein the hardware processor is further configured to execute the computer-executable instructions to at least:

determine, from the color name, a secondary color name based at least in part on natural language processing, wherein the first color corresponds to the secondary color name.

15. The system of claim 11, wherein the hardware processor is further configured to execute the computer-executable instructions to at least:

identify a first image that includes the first color; and

identify a second image that includes the second color.

16. The system of claim 15, wherein the hardware processor is further configured to execute the computer-executable instructions to at least:

identify first item data associated with the first image;

identify second item data associated with the second image; and

provide the first item data and the second item data to a computing device.

17. The system of claim 15, wherein identifying that the first image includes the first color further comprises:

determining that the first image includes the first color by including a color that is within a threshold distance from the first color in a color space.