Supplying content aware photo filters

• US 10,602,057 B1
• Filed: 11/01/2018
• Issued: 03/24/2020
• Est. Priority Date: 07/07/2014
• Status: Active Grant

• Current Assignee: Snap, Inc.
• Original Assignee: Snap, Inc.
• Inventors: Sehn, Timothy
• Primary Examiner(s): Osinski, Michael S
• Application Number:
  US16/178,288
• Time in Patent Office: 509 Days
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 5/10 using non-spatial domain filtering
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G09G 2340/12 Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
• CPC Class Codes: H04N 1/00244 with a server, e.g. an internet server fax-servers or the like for store and forward H04N1/324
• CPC Class Codes: H04N 1/32144 embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
• CPC Class Codes: H04N 2201/0084 Digital still camera
• CPC Class Codes: H04N 2201/3245 of image modifying data, e.g. handwritten addenda, highlights or augmented reality information
• CPC Class Codes: H04N 2201/3253 Position information, e.g. geographical position at time of capture, GPS data
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/631 Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04W 4/021 Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences

Abstract

A server includes a photo filter module with instructions executed by a processor to identify when a client device captures a photograph. Photograph filters are selected based upon attributes of the client device and attributes of the photograph. The photograph filters are supplied to the client device.

Claims

1. A server, comprising:

a processor configured to execute instructions for performing operations comprising;

selecting a plurality of photograph filters based upon a geolocation of a client device on which an image is presented and an object depicted in the image;

supplying, to the client device, the plurality of photograph filters that were selected based upon the geolocation of the client device and the object depicted in the image, wherein the plurality of photograph filters are configured to be independently alternatively selectable by a user to overlay the image, wherein each of the plurality of photograph filters is configured to overlay the image to augment the image, wherein a first filter of the plurality of photograph filters that is configured to modify an entirety of the image is selected in response to a first user input, and wherein a second filter of the plurality of photograph filters that is configured to modify only a first particular feature of an object depicted in the image is selected in response to a second user input received after the first user input; and

routing a selected one of the plurality of photograph filters and a photograph corresponding to the image to another client device.

2. The server of claim 1, wherein the plurality of photograph filters include an object specific filter, and wherein the second filter includes textual content that is excluded from the first filter.

3. The server of claim 1, wherein the operations further comprise identifying when the client device presents the image on a display, and wherein the second filter causes a variety of filters with different visual attributes of the first particular feature of the object to be supplied to the client device.

4. The server of claim 1, wherein the plurality of photograph filters include brand indicia.

5. The server of claim 1, wherein the operations further comprise receiving a selection of the selected one of the plurality of photograph filters, wherein the first of the plurality of photograph filters that overlays the image is replaced by the second of the plurality of photograph filters in response to user input to cause the second photograph filter to overlay the image, wherein a third filter of the plurality of photograph filters that is configured to modify a second particular feature of the object depicted in the image is selected in response to a third user input received after the second user input, wherein the third filter includes textual content that is excluded from the first and second filters.

6. The server of claim 1, wherein the plurality of photograph filters are configured to be independently selectable in response to a gesture applied to the image as presented on the client device, wherein the plurality of photograph filters are selected based on popularity.

7. The server of claim 6, wherein each of the plurality of photograph filters is not presented on the client device until it overlays the image in response to the gesture applied to the image, wherein bids from vendors on the photograph filters are supplied.

8. The server of claim 1, wherein the plurality of photograph filters include at least one of a date indicia, a temperature indicia, or a time indicia.

9. The server of claim 1, wherein the plurality of photograph filters include a brand associated with an establishment proximate to the geolocation of the client device.

10. The server of claim 1, wherein the operations further comprise identifying an attribute of the client device based on established preferences of the client device, and wherein the plurality of photograph filters are selected based upon one or more attributes of the client device and one or more attributes of the image.

11. The server of claim 10, wherein the established preferences are derived from prior use patterns.

12. The server of claim 10, wherein the one or more attributes of the image include a physical environment captured in the image.

13. The server of claim 1, wherein the operations further comprise appending a message to the photograph.

14. A method comprising:

selecting, by one or more processors, a plurality of photograph filters based upon a geolocation of a client device on which an image is presented and an object depicted in the image;

supplying, by the one or more processors, to the client device, the plurality of photograph filters that were selected based upon the geolocation of the client device and the object depicted in the image, wherein the plurality of photograph filters are configured to be independently alternatively selectable by a user to overlay the image, wherein each of the plurality of photograph filters is configured to overlay the image to augment the image, wherein a first filter of the plurality of photograph filters that is configured to modify an entirety of the image is selected in response to a first user input, and wherein a second filter of the plurality of photograph filters that is configured to modify only a first particular feature of an object depicted in the image is selected in response to a second user input received after the first user input; and

routing, by the one or more processors, a selected one of the plurality of photograph filters and a photograph corresponding to the image to another client device.

15. The method of claim 14 further comprising identifying when the client device presents the image on a display, wherein the second filter causes a variety of filters with different visual attributes of the first particular feature of the object to be supplied to the client device.

16. The method of claim 14, wherein the plurality of photograph filters are configured to be independently selectable in response to a gesture applied to the image as presented on the client device, and wherein the first of the plurality of photograph filters that overlays the image is replaced by the second of the plurality of photograph filters in response to user input to cause the second photograph filter to overlay the image, wherein a third filter of the plurality of photograph filters that is configured to modify a second particular feature of the object depicted in the image is selected in response to a third user input received after the second user input, wherein the third filter includes textual content that is excluded from the first and second filters.

17. The method of claim 16, wherein each of the plurality of photograph filters is not presented on the client device until it overlays the image in response to the gesture applied to the image, wherein the plurality of photograph filters are selected based on popularity.

18. The method of claim 14 further comprising identifying an attribute of the client device based on established preferences of the client device, wherein the plurality of photograph filters are selected based upon one or more attributes of the client device and one or more attributes of the image.

19. The method of claim 14 further comprising appending a message to the photograph.

20. A non-transitory machine-readable storage medium that includes instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

selecting a plurality of photograph filters based upon a geolocation of a client device on which an image is presented and an object depicted in the image;

supplying, to the client device, the plurality of photograph filters that were selected based upon the geolocation of the client device and the object depicted in the image, wherein the plurality of photograph filters are configured to be independently alternatively selectable by a user to overlay the image, wherein each of the plurality of photograph filters is configured to overlay the image to augment the image, wherein a first filter of the plurality of photograph filters that is configured to modify an entirety of the image is selected in response to a first user input, and wherein a second filter of the plurality of photograph filters that is configured to modify only a first particular feature of an object depicted in the image is selected in response to a second user input received after the first user input; and

routing a selected one of the plurality of photograph filters and a photograph corresponding to the image to another client device.