Apparatus and method for supplying content aware photo filters

• US 10,701,262 B1
• Filed: 05/22/2019
• Issued: 06/30/2020
• Est. Priority Date: 07/07/2014
• Status: Active Grant

• Current Assignee: Snap, Inc.
• Original Assignee: Snap, Inc.
• Inventors: Sehn, Timothy
• Primary Examiner(s): Osinski, Michael S
• Application Number:
  US16/419,556
• Time in Patent Office: 405 Days
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 5/10 using non-spatial domain filtering
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G09G 2340/12 Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
• CPC Class Codes: H04N 1/00244 with a server, e.g. an internet server fax-servers or the like for store and forward H04N1/324
• CPC Class Codes: H04N 1/32144 embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
• CPC Class Codes: H04N 2201/0084 Digital still camera
• CPC Class Codes: H04N 2201/3245 of image modifying data, e.g. handwritten addenda, highlights or augmented reality information
• CPC Class Codes: H04N 2201/3253 Position information, e.g. geographical position at time of capture, GPS data
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/63 by using electronic viewfinders
• CPC Class Codes: H04N 23/631 Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04W 4/021 Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences

Abstract

A server includes a photo filter module with instructions executed by a processor to identify when a client device captures a photograph. Photograph filters are selected based upon attributes of the photograph. The photograph filters are supplied to the client device.

Claims

1. A system comprising:

a server having a photo filter module with instructions executed by one or more processors that configure the one or more processors to;

identify when a client device captures a photograph;

select photograph filters based on attributes of the photograph identified by the server as captured by the client device;

supply the selected photograph filters to the client device, wherein the photograph filters are configured to be independently selectable by a user in response to a gesture on the photograph as presented by a display of the client device and wherein each of the photograph filters is an overlay for presentation on top of the photograph to augment the photograph and are not presented on the display of the client device until they are overlaid on the photograph in response to the gesture on the photograph presented on the display of the client device;

receive a selection of one or more of the photograph filters; and

route the one or more photograph filters and the photograph identified by the server as captured by the client device to another client device.

2. The system of claim 1, wherein the selection of photograph filters comprises the instructions configuring the one or more processors to:

select the photograph filters based on the attributes of the photograph and on geolocation information of the client device.

3. The system of claim 1, wherein the receiving of the selection of the at least one photograph filter comprises receiving an indication that the user has applied the gesture to the photograph while the photograph is presented on the display of the client device.

4. The system of claim 1, wherein the photograph attributes include one or more of a physical environment captured in the photograph or an object depicted in the photograph and wherein the photograph filters selected based on attributes of the photograph include indicia associated with the photograph attributes.

5. The system of claim 4, wherein the selection of the photograph filters comprises the instructions configuring the one or more processors to:

evaluate the photograph to identify a setting, at least one of the settings selected from a group consisting of an urban setting, a rural setting, a sunset, or a seascape.

6. The system of claim 4, wherein the selection of the photograph filters comprises the instructions configuring the one or more processors to:

evaluate the photograph to identify an object, at least one of the objects selected from a group comprising a building, a door, a roof, a flower, and individual, or an animal.

7. The system of claim 6, wherein the identification of the object results in the instructions configuring the one or more processors to select the photograph filters based on the identified object.

8. The system of claim 7, wherein the indicia of the selected photographs filters comprise indicia configured to overlay the identified object when applied to the photograph.

9. The system of claim 1, wherein the selection is further based on explicitly stated preferences supplied by the user.

10. The server of claim 9, wherein the selection is further based on prior use patterns of the user.

11. A method comprising:

identifying, by a server, when a client device captures a photograph;

selecting, by a server, photograph filters based on attributes of the photograph identified by the server as captured by the client device;

supplying the selected photograph filters to the client device, wherein the photograph filters are configured to be independently selectable by a user in response to a gesture on the photograph as presented by a display of the client device and wherein each of the photograph filters is an overlay for presentation on top of the photograph to augment the photograph and are not presented on the display of the client device until they are overlaid on the photograph in response to the gesture on the photograph presented on the display of the client device;

receiving, by the server, a selection of one or more of the photograph filters; and

routing the one or more photograph filters and the photograph identified by the server as captured by the client device to another client device.

12. The method of claim 11, wherein the selecting comprises:

selecting the photograph filters based on the attributes of the photograph and on geolocation information of the client device.

13. The method of claim 11, wherein the receiving of the selection of the at least one photograph filter comprises receiving an indication that the user has applied the gesture to the photograph while the photograph is presented on the display of the client device.

14. The method of claim 11, wherein the photograph attributes include one or more of a physical environment captured in the photograph or an object depicted in the photograph and wherein the photograph filters selected based on attributes of the photograph include indicia associated with the photograph attributes.

15. The method of claim 14, wherein the selecting of the photograph filters comprises:

evaluating the photograph to identify a setting, at least one of the settings selected from a group consisting of an urban setting, a rural setting, a sunset, or a seascape.

16. The method of claim 14, wherein the selecting of the photograph filters comprises:

evaluating the photograph to identify an object, at least one of the objects selected from a group comprising a building, a door, a roof, a flower, and individual, or an animal.

17. The method of claim 16, wherein the identification of the object results in the selecting of the photograph filters based on the identified object.

18. The method of claim 17, wherein the indicia of the selected photograph filters comprise indicia configured to overlay the identified object when applied to the photograph.

19. A non-transitory machine-readable storage medium storing processor executable instructions that, when executed by a processor of a machine, cause the machine to perform operations comprising:

identifying, by a server, when a client device captures a photograph;

selecting, by the server, photograph filters based on attributes of the photograph;

supplying the selected photograph filters to the client device, wherein the photograph filters are configured to be independently selectable by a user in response to a gesture on the photograph as presented by a display of the client device and wherein each of the photograph filters is an overlay for presentation on top of the photograph to augment the photograph and are not presented on the display of the client device until they are overlaid on the photograph in response to the gesture on the photograph presented on the display of the client device;

receiving, by the server, a selection of one or more of the photograph filters; and

routing the one or more photograph filters and the photograph identified by the server as captured by the client device to another client device.

20. The non-transitory machine-readable storage medium of claim 19, wherein the photograph attributes include one or more of a physical environment captured in the photograph or an object depicted in the photograph and wherein the photograph filters selected based on attributes of the photograph include indicia associated with the photograph attributes.