METHOD AND SYSTEM FOR PROVIDING CONTEXT RELEVANT MEDIA AUGMENTATION

• US 20170263029A1
• Filed: 12/18/2015
• Published: 09/14/2017
• Est. Priority Date: 12/18/2015
• Status: Active Grant

• Current Assignee: Snap, Inc.
• Original Assignee: Snap, Inc.
• Inventors: Yan, Rong, Sellis, Peter, Cooper, Andrew G., Zheng, Yantao
• Granted Patent: US 10,354,425 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 2200/32 involving image mosaicing
• CPC Class Codes: H04L 67/52 specially adapted for the location of the user terminal
• CPC Class Codes: H04N 21/4312 involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/4524 involving the geographical location of the client retrieval from the Internet by querying based on geographical locations G06F16/9537; systems specially adapted for using geographical information in broadcast systems H04H60/70; protocols in which the network application is adapted for the location of the user terminal in communication control or processing H04L67/52; services making use of the location of users or terminals in wireless networks H04W4/02; locating users or terminals in wireless networks H04W64/00
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859

Abstract

Systems and methods are presented that provide for receiving, at a server computer, a content item from a client device, determining, by the server computer, that a characteristic of the content item matches a trigger for a media overlay, generating, by the server computer, a media overlay associated with the characteristic of the content item, and providing, by the server computer, the media overlay to the client device wherein the media overlay is displayed on a user interface of the client device.

Claims

1. A server comprising:

one or more hardware processors comprising a media overlay publication module and a media overlay engine,

the media overlay publication module configured to;

receive a content item from a client device;

determine that a characteristic of the content item matches a trigger for a media overlay; and

generate a media overlay associated with the characteristic of the content item; and

the media overlay engine configured to provide the media overlay to the client device causing a display of the media overlay on a user interface of the client device.

2. The server of claim 1, wherein the characteristic of the content item includes at least one of a group comprising:

geolocation, audio, speed, timestamp, data associated with a machine-readable code, a particular object in the content item, and a recipient for the content item.

3. The server of claim 1, wherein client device is a first client device, and wherein the media overlay engine is further configured to:

receive the content item including the media overlay from the first client device; and

send the content item including the media overlay to a second client device.

4. The server of claim 1, wherein the client device is a first client device, the media overlay is a first media overlay, and the media overlay engine is further configured to:

receive the content item including the first media overlay from the first client device;

generate a second media overlay; and

send the content item including the first media overlay and the second media overlay to a second client device.

5. The server of claim 1, wherein the characteristic of the content item includes audio content, and wherein generating the media overlay associated with the characteristic of the content item further comprises:

identifying an audio track based on the audio content; and

generating the media overlay including at least one of a title associated with the audio track, an artist name associated with the audio track, an album name associated with the audio track, and album artwork associated with the audio track.

6. The server of claim 1, wherein the media overlay publication module comprises:

a user-based content upload module configured to receive the content item;

a user-based geolocation selection module configured to receive a selected geolocation; and

a user-based media overlay publication engine configured to generate a user-based media overlay based on the content item and the selected geolocation,

wherein the media overlay engine is configured to supply the client device with the user-based media overlay in response to a geolocation of the client device being within the selected geolocation.

7. The server of claim 6, wherein the media overlay publication module further comprises:

a user-based duration selection module configured to receive an identification of a period of time associated with the content item and the selected geolocation,

wherein the media overlay engine is configured to supply the client device with the user-based media overlay within the selected geolocation during the period of time.

8. The server of claim 1, wherein the media overlay publication module comprises:

a merchant-based content upload module configured to receive a first content item from a first merchant and a second content item from a second merchant;

a merchant-based geolocation selection module configured to receive a first geolocation information from the first merchant, and a second geolocation information from the second merchant, and to identify a common geolocation based on the first geolocation information and the second geolocation information;

a merchant-based bidding module configured to receive a first bid amount from the first merchant and a second bid amount from the second merchant, and to identify a highest bid amount; and

a merchant-based publication engine configured to generate a merchant-based media overlay based on the content item of the merchant with the highest bid amount and the common geolocation,

wherein the media overlay engine is configured to supply the merchant-based media overlay to the client device in response to a geolocation of the client device being within the common geolocation.

9. The server of claim 8, wherein the media overlay publication module further comprises:

a merchant-based duration selection module configured to disable the merchant-based media overlay after a predetermined duration has elapsed.

10. The server of claim 8, wherein the common geolocation includes a common region formed between a first geolocation from the first merchant and a second geolocation from the second merchant.

11. The server of claim 1, wherein the media overlay engine further comprises:

a live event module configured to;

identify a live event associated with a geolocation of the client device;

access live event data related to the live event; and

generate a live event media overlay based on the live event data and the geolocation of the client device.

12. The server of claim 1, wherein the media overlay engine further comprises:

a social network module configured to;

access social network data based on social network information from the client device; and

generate a social network media overlay based on the social network data and the social network information from the client device.

13. The server of claim 1, wherein the media overlay engine further comprises:

a promotion module configured to;

generate a set of media overlays including the media overlay for a merchant for a predefined geolocation of the merchant;

randomly select one media overlay from the set of media overlays; and

provide the randomly selected media overlay to the client device in response to a geolocation of the client device corresponding to the predefined geolocation of the merchant.

14. The server of claim 1, wherein the media overlay engine further comprises:

a collection module configured to;

store previously provided media overlays in a media overlay collection associated with the client device; and

present media overlays from the media overlay collection associated with the client device in response to receiving a geolocation associated with the media overlays.

15. The server of claim 1, wherein the media overlay engine further comprises:

a progressive module configured to;

generate a progressive use media overlay for a predefined geolocation; and

adjust a content item of the progressive use media overlay in response to a number of prior uses of the progressive use media overlay.

16. The server of claim 15, wherein the progressive module is further configured to:

disable the progressive use media overlay after the number of prior uses of the progressive use media overlay reaches a predefined progressive use limit.

17. The server of claim 1, wherein the media overlay engine further comprises:

a viral use module configured to;

generate a viral use media overlay for a predefined geolocation;

provide the viral use media overlay to a first client device located at the predefined geolocation;

receive a request from the first client device located at the predefined geolocation to provide the viral use media overlay to a second client device located outside the predefined geolocation; and

provide the viral use media overlay to the second client device located outside the predefined geolocation.

18. The server of claim 1, wherein the media overlay engine further comprises:

an actionable module configured to;

execute a programmable function associated with an actionable area in response to detecting a selection of the actionable area from a user of the client device.

19. A method comprising:

receiving, at a server computer, a content item from a client device;

determining, by the server computer, that a characteristic of the content item matches a trigger for a media overlay;

generating, by the server computer, a media overlay associated with the characteristic of the content item; and

providing, by the server computer, the media overlay to the client device, wherein the media overlay is displayed on a user interface of the client device.

20. A non-transitory computer-readable storage medium storing a set of instructions that, when executed by a processor of a machine, cause the machine to perform operations comprising:

receiving a content item from a client device;

determining that a characteristic of the content item matches a trigger for a media overlay;

generating a media overlay associated with the characteristic of the content item; and

providing the media overlay to the client device, wherein the media overlay is displayed on a user interface of the client device.