Scene and activity identification in video summary generation based on motion detected in a video
First Claim
1. A method for identifying video clips for inclusion in a video summary, the method comprising:
- accessing a video, the video including video frames;
dividing individual video frames into tiles;
determining motion values of individual tiles of the individual video frames, the motion values characterizing movement of visual content within a corresponding tile between proximate video frames;
identifying tiles in the video frames having motion values that satisfy one or more motion criteria, wherein the one or more motion criteria includes a first motion criterion defining a first threshold velocity value, the individual tiles satisfying the first motion criterion based on the motion values of the individual tiles being greater than the first threshold velocity value;
generating a motion profile for the video based on the motion values determined for the individual tiles of the individual video frames, the motion profile characterizing, on a per video frame basis, an amount of the tiles within the individual video frames that satisfy the one or more motion criteria;
identifying one or more of the video frames based on the motion profile; and
generating the video summary, the video summary including the identified video frames.
3 Assignments
0 Petitions
Accused Products
Abstract
Video and corresponding metadata is accessed. Events of interest within the video are identified based on the corresponding metadata, and best scenes are identified based on the identified events of interest. In one example, best scenes are identified based on the motion values associated with frames or portions of a frame of a video. Motion values are determined for each frame and portions of the video including frames with the most motion are identified as best scenes. Best scenes may also be identified based on the motion profile of a video. The motion profile of a video is a measure of global or local motion within frames throughout the video. For example, best scenes are identified from portion of the video including steady global motion. A video summary can be generated including one or more of the identified best scenes.
261 Citations
20 Claims
-
1. A method for identifying video clips for inclusion in a video summary, the method comprising:
-
accessing a video, the video including video frames; dividing individual video frames into tiles; determining motion values of individual tiles of the individual video frames, the motion values characterizing movement of visual content within a corresponding tile between proximate video frames; identifying tiles in the video frames having motion values that satisfy one or more motion criteria, wherein the one or more motion criteria includes a first motion criterion defining a first threshold velocity value, the individual tiles satisfying the first motion criterion based on the motion values of the individual tiles being greater than the first threshold velocity value; generating a motion profile for the video based on the motion values determined for the individual tiles of the individual video frames, the motion profile characterizing, on a per video frame basis, an amount of the tiles within the individual video frames that satisfy the one or more motion criteria; identifying one or more of the video frames based on the motion profile; and generating the video summary, the video summary including the identified video frames. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A method for identifying video clips for inclusion in a video summary, the method comprising:
-
accessing a video, the video including video frames; dividing individual video frames into tiles; determining motion values of individual tiles of the individual video frames, the motion values characterizing movement of visual content within a corresponding tile between proximate video frames; identifying tiles in the video frames having motion values that satisfy one or more motion criteria, wherein the one or more motion criteria includes a band motion criterion defining a range of threshold velocity values or a range of threshold acceleration values, the individual tiles satisfying the band motion criterion based on the motion values of the individual tiles falling within the range of threshold velocity values or the range of threshold acceleration values; generating a motion profile for the video based on the motion values determined for the individual tiles of the individual video frames, the motion profile characterizing, on a per video frame basis, an amount of the tiles within the individual video frames that satisfy the one or more motion criteria; identifying one or more of the video frames based on the motion profile; and generating the video summary, the video summary including the identified video frames. - View Dependent Claims (9, 10)
-
-
11. A system for identifying video clips for inclusion in a video summary, the system comprising:
one or more physical processors configured by machine readable instructions to; access a video, the video including video frames; divide individual video frames into tiles; determine motion values of individual tiles of the individual video frames, the motion values characterizing movement of visual content within a corresponding tile between proximate video frames; identify tiles in the video frames having motion values that satisfy one or more motion criteria, wherein the one or more motion criteria includes a first motion criterion defining a first threshold velocity value, the individual tiles satisfying the first motion criterion based on the motion values of the individual tiles being greater than the first threshold velocity value; generate a motion profile for the video based on the motion values determined for the individual tiles of the individual video frames, the motion profile characterizing, on a per video frame basis, an amount of the tiles within the individual video frames that satisfy the one or more motion criteria; identify one or more of the video frames based on the motion profile; and generate the video summary, the video summary including the identified video frames. - View Dependent Claims (12, 13, 14, 15, 16, 17)
-
18. A system for identifying video clips for inclusion in a video summary, the system comprising:
one or more physical processors configured by machine readable instructions to; access a video, the video including video frames; divide individual video frames into tiles; determine motion values of individual tiles of the individual video frames, the motion values characterizing movement of visual content within a corresponding tile between proximate video frames; identify tiles in the video frames having motion values that satisfy one or more motion criteria, wherein the one or more motion criteria includes a band motion criterion defining a range of threshold velocity values or a range of threshold acceleration values, the individual tiles satisfying the band motion criterion based on the motion values of the individual tiles falling within the range of threshold velocity values or the range of threshold acceleration values; generate a motion profile for the video based on the motion values determined for the individual tiles of the individual video frames, the motion profile characterizing, on a per video frame basis, an amount of the tiles within the individual video frames that satisfy the one or more motion criteria; identify one or more of the video frames based on the motion profile; and generate the video summary, the video summary including the identified video frames. - View Dependent Claims (19, 20)
Specification