Display of suggested color palettes with images responsive to search queries

• US 10,394,833 B1
• Filed: 01/04/2018
• Issued: 08/27/2019
• Est. Priority Date: 05/06/2014
• Status: Active Grant

• Current Assignee: Shutterstock Incorporated
• Original Assignee: Shutterstock Incorporated
• Inventors: Becker, Chris, Kroner, David, Blaurock, Steve
• Primary Examiner(s): Syed, Farhan M
• Application Number:
  US15/862,303
• Time in Patent Office: 600 Days
• CPC Class Codes: G06F 16/24578 using ranking
• CPC Class Codes: G06F 16/248 Presentation of query results
• CPC Class Codes: G06F 16/313 Selection or weighting of terms for indexing
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G06F 16/5866 using information manually generated, e.g. tags, keywords, comments, manually generated location and time information

Abstract

A method and system for conducting image search comprising: searching a first database to locate a set of pertinent images, iteratively performing the following operations for each image in the set of pertinent images: (a) extracting the histogram of red green and blue colors (RGB colors) from a given image; (b) distilling the extracted RGB colors down to create a reduced color palette for the given image; (c) segmenting the extracted RGB colors into a set of segments representing distinct parts of the color spectrum; (d) selecting a subset of segments to assemble a color palette for the given image; and (e) updating the assembled color palette and the customer behavior score for the given image in the first database; and generating a display of suggested color palettes for the search query.

Claims

1. A method for providing a display of color palettes in response to a user search query, the method comprising:

receiving from a user a search query on a user interface of a computing device;

searching a database to locate images responsive to the search query, wherein for each image, the database comprises an image representation and a set of keywords associated with the image;

extracting red, green, and blue (RGB) colors for each responsive image to provide extracted RGB colors from the responsive image;

creating a reduced color palette comprising a plurality of colors for each responsive image based on a proximity of the extracted RGB colors in a RGB color space;

assigning, to each of the plurality of colors for a responsive image, a color volume score and a color weight score, wherein the color volume score indicates a percentage of the responsive image covered by the respective color, and the color weight score indicates the percentage of the respective color in the responsive image;

ascertaining a percentage of a set of proximate colors in the responsive image, wherein each color in the set of proximate colors is located within a predefined distance from the respective color in the RGB color space;

indexing the percentage of the set of proximate colors for the respective color, the color volume score, and the color weight score, in a search engine for a subsequent image search;

dividing the extracted RGB colors for each responsive image into a set of segments representing visually distinct parts of a color spectrum;

assembling a color palette for each responsive image based on the extracted RGB colors; and

providing for display of suggested color palettes for the search query based on the assembled color palettes for the responsive images.

2. The method of claim 1, further comprising:

identifying a measure of the distance between the respective color and the set of proximate colors in the RGB color space.

3. The method of claim 1, wherein the color weight score for a respective color is weighted based on the percentage for every color other than the respective color in the responsive image and the color distance in the RGB color space between the respective color and every color other than the respective color in the responsive image.

4. The method of claim 3, further comprising:

assigning, for each segment in the set of segments, a color score to each color in a respective segment to ascertain a color that represents the respective segment; and

assigning a segment score to the respective segment by aggregating the color volume scores of each color in the respective segment.

5. The method of claim 3, further comprising:

assigning a color score to each color in a respective segment to ascertain a color that represents the respective segment; and

assigning a segment score for each segment in the set of segments, wherein the segment score for a respective segment is computed by aggregating color volume scores of each color in the respective segment.

6. The method of claim 5, wherein the segment score is determined by a product of the color volume score, a color lightness measure, and a color chroma measure, and

wherein the color having the highest segment score in a respective segment is designated to represent the respective segment.

7. The method of claim 1, wherein assembling the color palette comprises selecting a subset of segments, from the set of segments, satisfying a predetermined criterion for the color palette.

8. The method of claim 1, further comprising designating at least one segment in the set of segments having the highest color score to represent the responsive image.

9. The method of claim 1, further comprising selecting a predefined number of segments having the highest segment scores for assembling a color palette representation for a responsive image.

10. The method of claim 1, wherein the database further comprises a customer behavior score for each keyword in the set of keywords indicating user interest in the image, the customer behavior score based on previous searches indicating the user interest in the responsive image.

11. The method of claim 10, wherein the user interest is indicated by at least one of the following:

the user purchasing the responsive image, the user hovering a cursor over a thumbnail version of the responsive image to view an enlarged version of the responsive image, and the user adding the responsive image to a favorites list.

12. The method of claim 10, further comprising:

aggregating customer behavior scores associated with each search query; and

identifying most relevant keywords or categories for a responsive image using the aggregated customer behavior scores.

13. The method of claim 10, further comprising:

aggregating customer behavior scores associated with each search query over a period of time; and

representing a customer activity for a specific period of interest using the aggregated customer behavior scores.

14. A system for providing a display of color palettes in response to a user search query, the system comprising:

a processor configured to execute operations to;

receive from a user a search query on a user interface of a computing device;

search a database to locate images responsive to the search query, wherein for each image, the database comprises an image representation and a set of keywords associated;

extract red, green, and blue (RGB) colors for each responsive image to provide extracted RGB colors from the responsive image;

create a reduced color palette comprising a plurality of colors for each responsive image based on a proximity of the extracted RGB colors in a RGB color space;

assign, to each of the plurality of colors for a responsive image, a color volume score and a color weight score, wherein the color volume score indicates a percentage of the responsive image covered by the respective color, and the color weight score indicates the percentage of the respective color in the responsive image;

ascertain a percentage of a set of proximate colors in the responsive image, wherein each color in the set of proximate colors is located within a predefined distance from the respective color in the RGB color space;

index the percentage of the set of proximate colors for the respective color, the color volume score, and the color weight score, in a search engine for a subsequent image search;

divide the extracted RGB colors for each responsive image into a set of segments representing visually distinct parts of a color spectrum;

assemble a color palette for each responsive image based on the extracted RGB colors; and

provide for display of suggested color palettes for the search query based on the assembled color palettes for the responsive images.

15. The system of claim 14, wherein the processor is further configured to:

identify a measure of the distance between the respective color and the set of proximate colors in the RGB color space.

16. The system of claim 14, wherein the color weight score for a respective color is weighted based on the percentage for every color other than the respective color in the responsive image and the color distance in the RGB color space between the respective color and every color other than the respective color in the responsive image.

17. The system of claim 14, wherein assembling the color palette comprises selecting a subset of segments, from the set of segments, satisfying a predetermined criterion for the color palette.

18. A non-transitory machine-readable storage medium comprising machine-readable instructions for causing a processor to execute a method for providing a display of color palettes in response to a user search query, the method comprising:

receiving from a user a search query on a user interface of a computing device;

searching a database to locate images responsive to the search query, wherein for each image, the database comprises an image representation and a set of keywords associated with the image;

extracting red, green, and blue (RGB) colors for each responsive image to provide extracted RGB colors from the responsive image;

creating a reduced color palette comprising a plurality of colors for each responsive image based on a proximity of the extracted RGB colors in a RGB color space;

assigning, to each of the plurality of colors for a responsive image, a color volume score and a color weight score, wherein the color volume score indicates a percentage of the responsive image covered by the respective color, and the color weight score indicates the percentage of the respective color in the responsive image;

ascertaining a percentage of a set of proximate colors in the responsive image, wherein each color in the set of proximate colors is located within a predefined distance from the respective color in the RGB color space;

indexing the percentage of the set of proximate colors for the respective color, the color volume score, and the color weight score, in a search engine for a subsequent image search;

dividing the extracted RGB colors for each responsive image into a set of segments representing visually distinct parts of a color spectrum;

assembling a color palette for each responsive image based on the extracted RGB colors; and

providing for display of suggested color palettes for the search query based on the assembled color palettes for the responsive images.