Juxtaposing still and dynamic imagery for cliplet creation
First Claim
1. A method of juxtaposing still and dynamic imagery to generate a cliplet, the method executed by a processor of a computing device, the method comprising:
- setting a first subset of a spatiotemporal volume of pixels in an input video as a static input segment;
mapping the static input segment to a background of the cliplet, wherein the background is repeated across output frames of the cliplet;
setting a second subset of the spatiotemporal volume of pixels in the input video as a dynamic input segment based on a selection of a spatial region within the input video, a start time within the input video, and an end time within the input video;
refining the dynamic input segment, the refining further comprises at least one of;
spatially refining the dynamic input segment based upon;
a first region within the spatial region over a time interval from the start time to the end time, the first region being along a spatial boundary of the spatial region; and
a second region within the static in input segment that abuts the spatial region;
ortemporally refining the dynamic input segment based upon;
the spatial region in frames within a first temporal region of the dynamic input segment that includes the start time; and
the spatial region in frames within a second temporal region of the dynamic input segment that includes the end time;
mapping, based on a predefined temporal mapping function, the dynamic input segment as refined to an output segment of the cliplet defined within at least a portion of the output frames of the cliplet, wherein the predefined temporal mapping function is one of a play temporal mapping function, a loop temporal mapping function, or a mirror temporal mapping function; and
compositing the output segment over the background for the output frames of the cliplet.
2 Assignments
0 Petitions
Accused Products
Abstract
Various technologies described herein pertain to juxtaposing still and dynamic imagery to create a cliplet. A first subset of a spatiotemporal volume of pixels in an input video can be set as a static input segment, and the static input segment can be mapped to a background of the cliplet. Further, a second subset of the spatiotemporal volume of pixels in the input video can be set as a dynamic input segment based on a selection of a spatial region, a start time, and an end time within the input video. Moreover, the dynamic input segment can be refined spatially and/or temporally and mapped to an output segment of the cliplet within at least a portion of output frames of the cliplet based on a predefined temporal mapping function, and the output segment can be composited over the background for the output frames of the cliplet.
-
Citations
20 Claims
-
1. A method of juxtaposing still and dynamic imagery to generate a cliplet, the method executed by a processor of a computing device, the method comprising:
-
setting a first subset of a spatiotemporal volume of pixels in an input video as a static input segment; mapping the static input segment to a background of the cliplet, wherein the background is repeated across output frames of the cliplet; setting a second subset of the spatiotemporal volume of pixels in the input video as a dynamic input segment based on a selection of a spatial region within the input video, a start time within the input video, and an end time within the input video; refining the dynamic input segment, the refining further comprises at least one of; spatially refining the dynamic input segment based upon; a first region within the spatial region over a time interval from the start time to the end time, the first region being along a spatial boundary of the spatial region; and a second region within the static in input segment that abuts the spatial region;
ortemporally refining the dynamic input segment based upon; the spatial region in frames within a first temporal region of the dynamic input segment that includes the start time; and the spatial region in frames within a second temporal region of the dynamic input segment that includes the end time; mapping, based on a predefined temporal mapping function, the dynamic input segment as refined to an output segment of the cliplet defined within at least a portion of the output frames of the cliplet, wherein the predefined temporal mapping function is one of a play temporal mapping function, a loop temporal mapping function, or a mirror temporal mapping function; and compositing the output segment over the background for the output frames of the cliplet. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14)
-
-
15. A system that generates a cliplet from an input video, comprising:
-
a processor; and a memory that comprises components that are executable by the processor, the components comprising; a segmentation component that sets respective subsets of a spatiotemporal volume of pixels in the input video as input segments based on selections of spatial regions within the input video, start times within the input video, and end times within the input video; a spatial refinement component that spatially refines a first input segment, the first input segment having a first spatial region and a time interval from a start time to an end time, the spatial refinement component deforms the first spatial region over the time interval to minimize optical flow of pixels in a portion of the first spatial region along a spatial boundary over the time interval and align with a portion of a second spatial region within a second input segment, the portion of the second spatial region abuts the portion of the first spatial region; a map component that maps the input segments as refined to output segments using a set of predefined temporal mapping functions, wherein each input segment is mapped using a corresponding predefined temporal mapping function selected for the input segment from the set of predefined temporal mapping functions, wherein the set of predefined temporal mapping functions comprises at least three of a still temporal mapping function, a play temporal mapping function, a loop temporal mapping function, or a mirror temporal mapping function; and a composite component that composites the cliplet from the output segments. - View Dependent Claims (16, 17, 18)
-
-
19. A computer-readable storage medium including computer-executable instructions that, when executed by a processor, cause the processor to perform acts including:
-
setting a first subset of a spatiotemporal volume of pixels in an input video as a static input segment based on a selection of a time within the input video; mapping the static input segment to a background of a cliplet, wherein the background is repeated across output frames of the cliplet; setting a second subset of the spatiotemporal volume of pixels in the input video as a dynamic input segment based on a selection of a spatial region within the input video, a start time within the input video, and an end time within the input video; identifying a selection of a predefined temporal mapping function for the dynamic input segment, wherein the predefined temporal mapping function is selected from a set that comprises a play temporal mapping function, a loop temporal mapping function, and a mirror temporal mapping function; temporally refining the dynamic input segment based upon; the spatial region in frames within a first temporal region of the dynamic input segment that includes the start time; and the spatial region in frames within a second temporal region of the dynamic input segment that includes the end time; mapping, based on the selected predefined temporal mapping function, the dynamic input segment as refined to an output segment of the cliplet defined within at least a portion of the output frames of the cliplet; and compositing the output segment over the background for the output frames of the cliplet. - View Dependent Claims (20)
-
Specification