Ephemeral content management

• US 10,540,575 B1
• Filed: 06/30/2017
• Issued: 01/21/2020
• Est. Priority Date: 09/15/2015
• Status: Active Grant

• Current Assignee: Snap, Inc.
• Original Assignee: Snap, Inc.
• Inventors: Brody, Jonathan
• Primary Examiner(s): Roz, Mark
• Application Number:
  US15/640,106
• Time in Patent Office: 935 Days
• Field of Search: None
• CPC Class Codes: G06F 16/5866 using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
• CPC Class Codes: G06F 16/9038 Presentation of query results
• CPC Class Codes: G06F 18/24 Classification techniques
• CPC Class Codes: G06N 3/04 Architecture, e.g. interconnection topology
• CPC Class Codes: G06N 3/045 Combinations of networks
• CPC Class Codes: G06N 3/08 Learning methods
• CPC Class Codes: G06N 5/022 Knowledge engineering; Knowledge acquisition
• CPC Class Codes: G06T 1/0007 Image acquisition
• CPC Class Codes: G06V 10/751 Comparing pixel values or logical combinations thereof, or feature values having positional relevance, e.g. template matching
• CPC Class Codes: G06V 10/764 using classification, e.g. of video objects
• CPC Class Codes: G06V 10/82 using neural networks
• CPC Class Codes: G06V 2201/09 Recognition of logos
• CPC Class Codes: H04N 23/63 by using electronic viewfinders

Abstract

Systems, methods, devices, media, and computer-readable instructions are described for local image tagging and processing in a resource-constrained environment such as a mobile device. In some embodiments, characteristics associated with images are used to determine whether to store content (e.g., images and video clips) as ephemeral content or non-ephemeral content. Based on the determination, the image is stored in a non-ephemeral camera roll storage of the mobile device, or an ephemeral local application storage. Additional storage operations such as encryption or backup copying may additionally be determined and performed based on the analysis of the content. In some embodiments, such images may be indexed, sorted, and searched based on the image tagging operations used to characterize the content.

Claims

1. A method of image tagging on a mobile device, comprising:

accessing, by one or more processors of the mobile device, image data for a first image;

processing, by the one or more processors, the image data to determine one or more characteristics of the image data;

processing the one or more characteristics to assign an ephemeral status indicator for the image data; and

selecting a storage status for the image data based on the ephemeral status indicator for the image data;

accessing a content database comprising messaging history data associated with the one or more characteristics of the image data, wherein the one or more characteristics are further processed with the messaging history data to assign the ephemeral status indicator for the image data, and wherein the storage status is selected between a non-ephemeral camera roll storage and an ephemeral local application storage;

storing, based on the ephemeral status indicator, the image data for the first image within the non-ephemeral camera roll storage;

receiving, at the mobile device, a first user input selecting the first image from within an ephemeral messaging client application;

in response to the first user input, importing the first image from the non-ephemeral camera roll storage into the ephemeral local application storage of the ephemeral messaging client application, wherein the first user input selects the first image for inclusion in a first content collection comprising a plurality of content elements; and

publishing, by the mobile device, the first content collection via an ephemeral messaging server system, wherein the first image is presented within the first content collection based on a time of generation of the first image compared with a time of publication associated with publication of the first content collection.

2. The method of claim 1, further comprising:

capturing, by an image sensor of the mobile device, the image data, wherein the processing the one or more characteristics with the messaging history data to assign an ephemeral status indicator for the image data is performed automatically in response to capture of the image data and prior to selecting the storage status for the image data.

3. The method of claim 1, wherein the first image is presented within the first content collection based on a time of capture of the first image if the first content collection is published within a threshold time period of the time of generation of the first image, and wherein the first image is presented within the first content collection based on the time of publication with a frame indicating the time of generation if the first content collection is published later than the threshold time period after the time of generation of the first image.

4. The method of claim 3, wherein the threshold time period is 24 hours.

5. The method of claim 4, wherein the first image is a frame of a video clip, and

wherein the video clip has a duration less than an ephemeral content limit associated with the ephemeral messaging communication system.

6. The method of claim 5, wherein each content element of the first content collection is associated with a display duration less than or equal to the ephemeral content limit, and wherein the ephemeral content limit is 10 seconds.

7. The method of claim 6, wherein the storage status is further selected between a private and a non-private storage status,

wherein non-private content is synchronized with the ephemeral messaging server system, and

wherein private content is encrypted by the mobile device and stored at the mobile device with a personal identification number (PIN) security interface and without back-up on the ephemeral messaging server system.

8. A mobile device, comprising:

a memory comprising image data for a first image; and

one or more processors coupled to the memory and configured to;

access the image data for the first image;

process the image data to determine one or more characteristics of the image data;

process the one or more characteristics to assign an ephemeral status indicator for the image data;

select a storage status for the image data based on the ephemeral status indicator for the image data;

access a content database comprising messaging history data associated with the one or more characteristics of the image data, wherein the one or more characteristics are further processed with the messaging history data to assign the ephemeral status indicator for the image data, and wherein the storage status is selected between a non-ephemeral camera roll storage and an ephemeral local application storage;

store, based on the ephemeral status indicator, the image data for the first image within the non-ephemeral camera roll storage;

receive, at the mobile device, a first user input selecting the first image from within an ephemeral messaging client application;

in response to the first user input, import the first image from the non-ephemeral camera roll storage into the ephemeral local application storage of the ephemeral messaging client application, wherein the first user input selects the first image for inclusion in a first content collection comprising a plurality of content elements; and

publish, by the mobile device, the first content collection via an ephemeral messaging server system, wherein the first image is presented within the first content collection based on a time of generation of the first image compared with a time of publication associated with publication of the first content collection.

9. The mobile device of claim 8, wherein the one or more processors are further configured to:

capture, by an image sensor of the mobile device, the image data,

wherein the processing the one or more characteristics with the messaging history data to assign an ephemeral status indicator for the image data is performed automatically in response to capture of the image data and prior to selecting the storage status for the image data.

10. The mobile device of claim 8, wherein the first image is presented within the first content collection based on a time of capture of the first image if the first content collection is published within a threshold time period of the time of generation of the first image, and wherein the first image is presented within the first content collection based on the time of publication with a frame indicating the time of generation if the first content collection is published later than the threshold time period after the time of generation of the first image.

11. The mobile device of claim 10, wherein the first image is a frame of a video clip, and

wherein the video clip has a duration less than an ephemeral content limit associated with the ephemeral messaging communication system.

12. The mobile device of claim 11, wherein each content element of the first content collection is associated with a display duration less than or equal to the ephemeral content limit, and wherein the ephemeral content limit is 10 seconds.

13. The mobile device of claim 12, wherein the storage status is further selected between a private and a non-private storage status,

wherein non-private content is synchronized with the ephemeral messaging server system, and

wherein private content is encrypted by the mobile device and stored at the mobile device with a personal identification number (PIN) security interface and without back-up on the ephemeral messaging server system.

14. A non-transitory storage medium comprising instructions that, when executed by one or more processors of a mobile device, cause the mobile device to perform operations comprising:

accessing, by one or more processors of the mobile device, image data for a first image;

processing, by the one or more processors, the image data to determine one or more characteristics of the image data;

processing the one or more characteristics to assign an ephemeral status indicator for the image data; and

selecting a storage status for the image data based on the ephemeral status indicator for the image data;

accessing a content database comprising messaging history data associated with the one or more characteristics of the image data, wherein the one or more characteristics are further processed with the messaging history data to assign the ephemeral status indicator for the image data, and wherein the storage status is selected between a non-ephemeral camera roll storage and an ephemeral local application storage;

storing, based on the ephemeral status indicator, the image data for the first image within the non-ephemeral camera roll storage;

receiving, at the mobile device, a first user input selecting the first image from within an ephemeral messaging client application;

in response to the first user input, importing the first image from the non-ephemeral camera roll storage into the ephemeral local application storage of the ephemeral messaging client application, wherein the first user input selects the first image for inclusion in a first content collection comprising a plurality of content elements; and

publishing, by the mobile device, the first content collection via an ephemeral messaging server system, wherein the first image is presented within the first content collection based on a time of generation of the first image compared with a time of publication associated with publication of the first content collection.

15. The non-transitory storage medium of claim 14, wherein the instructions further cause the mobile device to perform operations comprising:

capturing, by an image sensor of the mobile device, the image data,

wherein the processing the one or more characteristics with the messaging history data to assign an ephemeral status indicator for the image data is performed automatically in response to capture of the image data and prior to selecting the storage status for the image data.

16. The non-transitory storage medium of claim 14 wherein the first image is presented within the first content collection based on a time of capture of the first image if the first content collection is published within a threshold time period of the time of generation of the first image, and wherein the first image is presented within the first content collection based on the time of publication with a frame indicating the time of generation if the first content collection is published later than the threshold time period after the time of generation of the first image.

17. The non-transitory storage medium of claim 16, wherein the threshold time period is 24 hours.

18. The non-transitory storage medium of claim 17, wherein the first image is a frame of a video clip, and

wherein the video clip has a duration less than an ephemeral content limit associated with the ephemeral messaging communication system.

19. The non-transitory storage medium of claim 18, wherein each content element of the first content collection is associated with a display duration less than or equal to the ephemeral content limit, and wherein the ephemeral content limit is 10 seconds.

20. The non-transitory storage medium of claim 19, wherein the storage status is further selected between a private and a non-private storage status,

wherein non-private content is synchronized with the ephemeral messaging server system, and

wherein private content is encrypted by the mobile device and stored at the mobile device with a personal identification number (PIN) security interface and without back-up on the ephemeral messaging server system.