Image selection from captured video sequence based on social components

• US 8,442,265 B1
• Filed: 10/19/2011
• Issued: 05/14/2013
• Est. Priority Date: 10/19/2011
• Status: Active Grant

• Current Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Original Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Inventors: Bosworth, Andrew Garrod, Garcia, David Harry, Cuervo, Soleio
• Primary Examiner(s): Seth, Manav
• Application Number:
  US13/276,389
• Publication Number:
  US 20130101219A1
• Time in Patent Office: 573 Days
• Field of Search: None
• US Class Current: 382/100
• CPC Class Codes: G06F 16/74 Browsing; Visualisation therefor end-user interfaces for requesting or interacting with video content, e.g. video on demand interfaces or electronic program guides, H04N21/472
• CPC Class Codes: G06F 16/743 a collection of video files or sequences
• CPC Class Codes: G06F 16/7837 using objects detected or recognised in the video content
• CPC Class Codes: G06V 20/30 in albums, collections or shared content, e.g. social network photos or video
• CPC Class Codes: G06V 20/40 in video content extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44
• CPC Class Codes: H04N 1/2145 of a sequence of images for selection of a single frame before final recording, e.g. from a continuous sequence captured before and after shutter-release
• CPC Class Codes: H04N 21/44 Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 2201/212 Selecting different recording or reproducing modes, e.g. high or low resolution, field or frame

Abstract

In one embodiment, a mobile device analyzes frames before and after a particular frame of a real-time video to identify one or more social network objects, and selects one or more frames before and after the particular frame based on social network information for further storage in the mobile device.

Claims

1. A method, by a computing device, comprising:

accessing a sequence of video frames stored in a buffer;

receiving an indication for persistent storage of a particular frame of the sequence of video frames;

analyzing frames before or after the particular frame of the sequence of video frames stored in the buffer to identify one or more social network objects;

determining a value of the frames before or after the particular frame of the sequence of video frames based on the one or more identified social network objects; and

selecting one or more of the frames before or after the particular frame of the sequence of video frames for persistent storage based on respective values of the frames.

2. The method of claim 1, wherein the determining a value of the frames before or after the particular frame of the sequence of video frames based on the one or more identified social network objects, further comprises:

for each frame of the frames before or after the particular frame, assigning a value based on a number of social network objects identified in the each frame.

3. The method of claim 1, wherein the determining a value of the frames before or after the particular frame of the sequence of video frames based on the one or more identified social network objects is further based on an affinity associated with each of the one or more identified social network objects.

4. A system comprising:

a memory;

one or more processors; and

a non-transitory storage medium storing computer-readable instructions operative, when executed, to cause the one or more processors to;

access sequence of video frames stored in a buffer;

receive an indication for persistent storage of a particular frame of the sequence of video frames;

analyze frames before or after the particular frame of the sequence of video frames stored in the buffer to identify one or more social network objects;

determine a value of the frames before or after the particular frame of the sequence of video frames based on the one or more identified social network objects;

and

select one or more of the frames before or after the particular frame of the sequence of video frames for persistent storage based on respective values of the frames.

5. The system of claim 4, wherein to determine a value of the frames before or after the particular frame of the sequence of video frames based on the one or more identified social network objects, further comprises instructions operable to cause the one or more processors to:

for each frame of the frames before or after the particular frame, assign a value based on a number of social network objects identified in the each frame.

6. The system of claim 4, wherein to determine a value of the frames before or after the particular frame of the sequence of video frames based on the one or more identified social network objects is further based on an affinity associated with each of the one or more identified social network objects.

7. One or more computer-readable tangible storage media embodying software operable when executed by one or more computing devices to:

access a sequence of video frames stored in a buffer;

receive an indication for persistent storage of a particular frame of the sequence of video frames;

analyze frames before or after the particular frame of the sequence of video frames stored in the buffer to identify one or more social network objects;

determine a value of the frames before or after the particular frame of the sequence of video frames based on the one or more identified social network objects;

and

select one or more of the frames before or after the particular frame of the sequence of video frames for persistent storage based on respective values of the frames.

8. The media of claim 7, wherein to determine a value of the frames before or after the particular frame of the sequence of video frames based on the one or more identified social network objects, further comprises software operable when executed by the one or more computing devices to:

for each frame of the frames before or after the particular frame, assign a value based on a number of social network objects identified in the each frame.

9. The media of claim 7, wherein to determine a value of the frames before or after the particular frame of the sequence of video frames based on the one or more identified social network objects is further based on an affinity associated with each of the one or more identified social network objects.