Color sampling for displaying content items

• US 10,269,145 B1
• Filed: 10/18/2017
• Issued: 04/23/2019
• Est. Priority Date: 10/18/2017
• Status: Active Grant

• Current Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Original Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Inventors: Belkin, Michael Oren, Welch, Christopher Joseph
• Primary Examiner(s): Mushambo, Martin
• Application Number:
  US15/787,537
• Publication Number:
  US 20190114813A1
• Time in Patent Office: 552 Days
• Field of Search: None
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/20072 Graph-based image processing
• CPC Class Codes: G06T 2207/30176 Document
• CPC Class Codes: G06T 7/90 Determination of colour characteristics

Abstract

An online system is configured to provide content items to users. The content item includes an image, and is displayed with a color block or colored border as an accent to the image. The color of the color block or colored bordered is dynamically selected based upon the image included in the content item, and is selected using a waterfall selection method comprising a sequence of different selection methods, each selection method configured to select a color based upon a most common color of the image that satisfies a respective set of selection criteria or determine that no color meets the respective set of selection criteria. The selection methods may comprise a dominant color selection method wherein the selected color corresponds to a most dominant color of the image, and a complementary color selection method wherein the select color is a complement of a dominant color of the image.

Claims

1. A method comprising:

receiving, at an online system, a content item to be provided to a user of the online system, the content item including an image;

determining that the content item is to be displayed with a color block as an accent to the image;

selecting a color to use in displaying the color block using a waterfall selection method by;

executing a first selection method corresponding to a first set of criteria to determine a color to use in displaying the color block, or to determine that no color satisfies the first selection method, wherein the color for the color block is selected based upon a color of the image satisfying the first set of selection criteria that has a greatest amount of coverage within the image relative to other colors in the image, and

in response to a determination that no color satisfies the first selection method, executing one or more additional selection methods corresponding to respective sets of criteria to determine a color to use in displaying the color block, wherein the color determined using each of the one or more additional selection methods is based upon a color of the image satisfying the respective set of selection criteria that has a greatest amount of coverage within the image; and

providing the content item for display to the user of the online system, wherein the displayed content item includes at least the image associated with the content item and the color block as an accent to the displayed image, the color block displayed with the selected color determined in the waterfall selection method.

2. The method of claim 1, wherein the color block comprises a rectangular block of solid color displayed directly adjacent to an edge of the image and overlaid with one or more lines of text.

3. The method of claim 1, wherein the color block comprises a color border surrounding at least a portion of the image.

4. The method of claim 1, wherein the first selection method comprises identifying a first color corresponding to a color of the image that satisfies the first set of selection criteria having a greatest amount of coverage within the image relative to other colors in the image, or that no color of the image satisfies the first set of selection criteria.

5. The method of claim 4, wherein the first set of selection criteria comprises a prominence threshold indicating a minimum amount of the image represented by the first color.

6. The method of claim 4, wherein the first set of selection criteria comprises a contrast threshold indicating a contrast between the first color and a predetermined color.

7. The method of claim 4, wherein the first set of selection criteria comprises a colorfulness threshold for the first color.

8. The method of claim 1, wherein the one or more additional selection methods comprises a second method configured to identify a first color that is a complement of a second color that is present in the image, based upon a second set of selection criteria, or that no color satisfies the second set of selection criteria.

9. The method of claim 8, wherein the second set of selection criteria comprises a prominence threshold indicating a minimum amount of the image represented by the second color.

10. The method of claim 8, wherein the second selection method selects the first color from a predetermined color palette, wherein the first color corresponds to the color of the color palette closest to a third color that is present in the image, the third color corresponding to a color present in the image that is closest to the complement of the second color.

11. A non-transitory computer readable storage medium storing computer program instructions, the computer program instructions when executed by a computer processor causes the processor to perform the steps of:

receiving, at an online system, a content item to be provided to a user of the online system, the content item including an image;

determining that the content item is to be displayed with a color block as an accent to the image;

selecting a color to use in displaying the color block using a waterfall selection method by;

executing a first selection method corresponding to a first set of criteria to determine a color to use in displaying the color block, or to determine that no color satisfies the first selection method, wherein the color for the color block is selected based upon a color of the image satisfying the first set of selection criteria that has a greatest amount of coverage within the image relative to other colors in the image, and

in response to a determination that no color satisfies the first selection method, executing one or more additional selection methods corresponding to respective sets of criteria to determine a color to use in displaying the color block, wherein the color determined using each of the one or more additional selection methods is based upon a color of the image satisfying the respective set of selection criteria that has a greatest amount of coverage within the image; and

providing the content item for display to the user of the online system, wherein the displayed content item includes at least the image associated with the content item and the color block as an accent to the displayed image, the color block displayed with the selected color determined in the waterfall selection method.

12. The computer readable storage medium of claim 11, wherein the first selection method comprises identifying a first color corresponding to a color of the image that satisfies the first set of selection criteria having a greatest amount of coverage within the image relative to other colors in the image, or that no color of the image satisfies the first set of selection criteria.

13. The computer readable storage medium of claim 12, wherein the first set of selection criteria comprises at least one of:

a prominence threshold indicating a minimum amount of the image represented by the first color, a contrast threshold indicating a contrast between the first color and a predetermined color, and a colorfulness threshold for the first color.

14. The computer readable storage medium of claim 11, wherein the one or more additional selection methods comprises a second method configured to identify a first color that is a complement of a second color that is present in the image, based upon a second set of selection criteria, or that no color satisfies the second set of selection criteria.

15. The computer readable storage medium of claim 14, wherein the second set of selection criteria comprises a prominence threshold indicating a minimum amount of the image represented by the second color.

16. The computer readable storage medium of claim 14, wherein the second selection method selects the first color from a predetermined color palette, wherein the first color corresponds to the color of the color palette closest to a third color that is present in the image, the third color corresponding to a color present in the image that is closest to the complement of the second color.

17. An online system, comprising:

a receiver configured to receive a content item to be provided to a user of the online system, the content item including an image;

at least one processor configured to;

determine that the content item is to be displayed with a color block as an accent to the image;

select a color to use in displaying the color block using a waterfall selection method by;

executing a first selection method corresponding to a first set of criteria to determine a color to use in displaying the color block, or to determine that no color satisfies the first selection method, wherein the color for the color block is selected based upon a color of the image satisfying the first set of selection criteria that has a greatest amount of coverage within the image relative to other colors in the image, and

in response to a determination that no color satisfies the first selection method, executing one or more additional selection methods corresponding to respective sets of criteria to determine a color to use in displaying the color block, wherein the color determined using each of the one or more additional selection methods is based upon a color of the image satisfying the respective set of selection criteria that has a greatest amount of coverage within the image; and

provide the content item for display to the user of the online system, wherein the displayed content item includes at least the image associated with the content item and the color block as an accent to the displayed image, the color block displayed with the selected color determined in the waterfall selection method.

18. The online system of claim 17, wherein the first selection method comprises identifying a first color corresponding to a color of the image that satisfies the first set of selection criteria having a greatest amount of coverage within the image relative to other colors in the image, or that no color of the image satisfies the first set of selection criteria.

19. The online system of claim 18, wherein the first set of selection criteria comprises at least one of:

a prominence threshold indicating a minimum amount of the image represented by the first color, a contrast threshold indicating a contrast between the first color and a predetermined color, and a colorfulness threshold for the first color.

20. The online system of claim 17, wherein the one or more additional selection methods comprises a second method configured to identify a first color that is a complement of a second color that is present in the image, based upon a second set of selection criteria, or that no color satisfies the second set of selection criteria.