Image Selection from Captured Video Sequence Based on Social Components

• US 20130227603A1
• Filed: 04/04/2013
• Published: 08/29/2013
• Est. Priority Date: 10/19/2011
• Status: Active Grant

• Current Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Original Assignee: Meta Platforms, Inc. (f/k/a Facebook, Inc.)
• Inventors: Bosworth, Andrew Garrod, Garcia, David Harry, Cuervo, Soleio
• Granted Patent: US 9,762,956 B2
• Time in Patent Office: Days
• US Class Current: 725/19
• CPC Class Codes: G06F 16/74 Browsing; Visualisation therefor end-user interfaces for requesting or interacting with video content, e.g. video on demand interfaces or electronic program guides, H04N21/472
• CPC Class Codes: G06F 16/743 a collection of video files or sequences
• CPC Class Codes: G06F 16/7837 using objects detected or recognised in the video content
• CPC Class Codes: G06V 20/30 in albums, collections or shared content, e.g. social network photos or video
• CPC Class Codes: G06V 20/40 in video content extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44
• CPC Class Codes: H04N 1/2145 of a sequence of images for selection of a single frame before final recording, e.g. from a continuous sequence captured before and after shutter-release
• CPC Class Codes: H04N 21/44 Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 2201/212 Selecting different recording or reproducing modes, e.g. high or low resolution, field or frame

Abstract

In one embodiment, a mobile device analyzes frames before and after a particular frame of a real-time video to identify one or more social network objects, and selects one or more frames before and after the particular frame based on social network information for further storage in the mobile device.

Claims

1. A method comprising:

by a computing device, accessing a video comprising a sequence of video frames;

by the computing device, analyzing a portion of the video to identify one or more social network objects;

by the computing device, determining a value of frames of the portion of the video based on the identified social network objects; and

by the computing device, selecting one or more of the frames of the portion of the video based on respective values of the frames.

2. The method of claim 1, wherein, by the computing device, determining a value of frames of the portion of the video based on the identified social network objects further comprises:

by the computing device, for each frame of the portion of the video, assigning a value based on a number of social network objects identified in the each frame.

3. The method of claim 1, wherein, by the computing device, determining a value of frames of the portion of the video is further based on an affinity associated with each of the identified social network objects.

4. The method of claim 1, wherein the video is a real-time video.

5. The method of claim 1, wherein at least part of the video is stored in a buffer.

6. The method of claim 1, wherein the portion of the video comprises a particular frame corresponding to an indication for persistent storage received by the computing device.

7. One or more computer-readable non-transitory storage media embodying software that is operable when executed to:

access a video comprising a sequence of video frames;

analyze a portion of the video to identify one or more social network objects;

determine a value of frames of the portion of the video based on the identified social network objects; and

select one or more of the frames of the portion of the video based on respective values of the frames.

8. The media of claim 7, wherein to determine a value of frames of the portion of the video based on the identified social network objects, the software is further operable when executed to:

for each frame of the portion of the video, assign a value based on a number of social network objects identified in the each frame.

9. The media of claim 7, wherein determining a value of frames of the portion of the video is further based on an affinity associated with each of the identified social network objects.

10. The media of claim 7, wherein the video is a real-time video.

11. The media of claim 7, wherein at least part of the video is stored in a buffer.

12. The media of claim 7, wherein the portion of the video comprises a particular frame corresponding to an indication for persistent storage received by the computing device.

13. A system comprising:

one or more processors; and

a memory coupled to the processors comprising instructions executable by the processors, the processors being operable when executing the instructions to;

access a video comprising a sequence of video frames;

analyze a portion of the video to identify one or more social network objects;

determine a value of frames of the portion of the video based on the identified social network objects; and

select one or more of the frames of the portion of the video based on respective values of the frames.

14. The system of claim 13, wherein to determine a value of frames of the portion of the video based on the identified social network objects, the processors are further operable when executing the instructions to:

for each frame of the portion of the video, assign a value based on a number of social network objects identified in the each frame.

15. The system of claim 13, wherein determining a value of frames of the portion of the video is further based on an affinity associated with each of the identified social network objects.

16. The system of claim 13, wherein the video is a real-time video.

17. The system of claim 13, wherein at least part of the video is stored in a buffer.

18. The system of claim 13, wherein the portion of the video comprises a particular frame corresponding to an indication for persistent storage received by the computing device.