Color sampling for displaying content items

• US 10,559,098 B1
• Filed: 03/12/2019
• Issued: 02/11/2020
• Est. Priority Date: 10/18/2017
• Status: Active Grant

• Current Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Original Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Inventors: Belkin, Michael Oren, Welch, Christopher Joseph
• Primary Examiner(s): Mushambo, Martin
• Application Number:
  US16/299,958
• Time in Patent Office: 336 Days
• Field of Search: None
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/20072 Graph-based image processing
• CPC Class Codes: G06T 2207/30176 Document
• CPC Class Codes: G06T 7/90 Determination of colour characteristics

Abstract

An online system is configured to provide content items to users. The content item includes an image, and is displayed with a color block or colored border as an accent to the image. The color of the color block or colored bordered is dynamically selected based upon the image included in the content item, and is selected using a waterfall selection method comprising a sequence of different selection methods, each selection method configured to select a color based upon a most common color of the image that satisfies a respective set of selection criteria or determine that no color meets the respective set of selection criteria. The selection methods may comprise a dominant color selection method wherein the selected color corresponds to a most dominant color of the image, and a complementary color selection method wherein the select color is a complement of a dominant color of the image.

Claims

1. A method comprising:

receiving, at an online system, a content item to be provided to a user of the online system, the content item associated with an image;

selecting an accent color to be displayed with the image, based upon the image, by;

identifying a set of one or more color selection methods, each corresponding to a respective set of criteria, and wherein each color selection method is configured to select a color from a set of colors associated with the image that satisfies the respective set of criteria, or to determine that no color of the set of colors satisfies the respective set of criteria;

executing at least one color selection method of the one or more color selection methods to select a color from the set of colors associated with the image to be used as the accent color; and

providing the content item for display to the user of the online system, wherein the content item is displayed using the image and the selected accent color.

2. The method of claim 1, wherein executing the at least one color selection method comprises:

executing a first color selection method of the one or more color selection methods corresponding to a first set of criteria to select a color from the set of colors to be used as the accent color; and

in response to a determination that no color of the set of colors satisfied the first set of criteria corresponding to the first color selection method, executing a subsequent color selection method of the one or more color selection methods.

3. The method of claim 2, further comprising, in response to a determination that no color of the set of colors satisfies the respective sets of criteria corresponding to the one or more color selection methods, designating a predetermined default color as the accent color.

4. The method of claim 1, wherein the content item is displayed using the image and a visual element colored using the selected accent color.

5. The method of claim 4, wherein the visual element comprises a rectangular block of solid color displayed adjacent to an edge of the image, or a color border surrounding at least a portion of the image.

6. The method of claim 1, further comprising quantizing the colors of the image, and wherein the set of colors is based upon the quantized colors of the image.

7. The method of claim 1, wherein a color selection method of the one or more color selection methods comprises identifying a first color corresponding to a color of the image that satisfies the respective set of criteria corresponding to the color selection method having a greatest amount of coverage within the image relative to other colors in the image, or that no color of the image satisfies the respective set of criteria.

8. The method of claim 1, wherein the respective set of criteria corresponding to a color selection method of the one or more color selection methods comprises a prominence threshold indicating a minimum amount of the image represented by a selected color.

9. The method of claim 1, wherein the respective set of criteria corresponding to a color selection method of the one or more color selection methods comprises a colorfulness threshold for a selected color.

10. The method of claim 1, wherein a color selection method of the one or more color selection methods identifying a first color based upon a complement of a second color that is present in the image, based upon the respective set of criteria corresponding to the color selection method, or that no color satisfies the respective set of criteria.

11. A non-transitory computer readable storage medium storing computer program instructions, the computer program instructions when executed by a computer processor causes the processor to perform the steps of:

receiving, at an online system, a content item to be provided to a user of the online system, the content item associated with an image;

selecting an accent color to be displayed with the image, based upon the image, by;

identifying a set of one or more color selection methods, each corresponding to a respective set of criteria, and wherein each color selection method is configured to select a color from a set of colors associated with the image that satisfies the respective set of criteria, or to determine that no color of the set of colors satisfies the respective set of criteria;

executing at least one color selection method of the one or more color selection methods to select a color from the set of colors associated with the image to be used as the accent color; and

providing the content item for display to the user of the online system, wherein the content item is displayed using the image and the selected accent color.

12. The non-transitory computer readable storage medium of claim 11, wherein the instructions further cause the processor to execute the at least one color selection method by:

executing a first color selection method of the one or more color selection methods corresponding to a first set of criteria to select a color from the set of colors to be used as the accent color; and

in response to a determination that no color of the set of colors satisfied the first set of criteria corresponding to the first color selection method, executing a subsequent color selection method of the one or more color selection methods.

13. The non-transitory computer readable storage medium of claim 11, wherein the content item is displayed using the image and a visual element colored using the selected accent color.

14. The non-transitory computer readable storage medium of claim 11, wherein the instructions further cause the processor to quantize the colors of the image, and wherein the set of colors is based upon the quantized colors of the image.

15. The non-transitory computer readable storage medium of claim 11, wherein a color selection method of the one or more color selection methods comprises identifying a first color corresponding to a color of the image that satisfies the respective set of criteria corresponding to the color selection method having a greatest amount of coverage within the image relative to other colors in the image, or that no color of the image satisfies the respective set of criteria.

16. The non-transitory computer readable storage medium of claim 11, wherein the respective set of criteria corresponding to a color selection method of the one or more color selection methods comprises a prominence threshold indicating a minimum amount of the image represented by a selected color.

17. The non-transitory computer readable storage medium of claim 11, wherein the respective set of criteria corresponding to a color selection method of the one or more color selection methods comprises a colorfulness threshold for a selected color.

18. The non-transitory computer readable storage medium of claim 11, wherein a color selection method of the one or more color selection methods identifying a first color based upon a complement of a second color that is present in the image, based upon the respective set of criteria corresponding to the color selection method, or that no color satisfies the respective set of criteria.

19. An online system, comprising:

a receiver configured to receive a content item to be provided to a user of the online system, the content item associated with an image;

at least one processor configured to;

select an accent color to be displayed with the image, based upon the image, by;

identifying a set of one or more color selection methods, each corresponding to a respective set of criteria, and wherein each color selection method is configured to select a color from a set of colors associated with the image that satisfies the respective set of criteria, or to determine that no color of the set of colors satisfies the respective set of criteria;

executing at least one color selection method of the one or more color selection methods to select a color from the set of colors associated with the image to be used as the accent color; and

provide the content item for display to the user of the online system, wherein the content item is displayed using the image and the selected accent color.

20. The online system of claim 19, wherein the at least one processor configured to execute the at least one color selection method by:

executing a first color selection method of the one or more color selection methods corresponding to a first set of criteria to select a color from the set of colors to be used as the accent color; and

in response to a determination that no color of the set of colors satisfied the first set of criteria corresponding to the first color selection method, executing a subsequent color selection method of the one or more color selection methods.