AUTOMATIC GENERATION OF VIDEO FROM SPHERICAL CONTENT USING AUDIO/VISUAL ANALYSIS
First Claim
1. A method for generating an output video from spherical video content, the method comprising:
- storing, by a video server, a first spherical video comprising a sequence of spherical video frames, each having a spherical field of view and one or more audio tracks;
processing, by the video server, the first spherical video to identify a target feature of interest meeting one or more audio or visual criteria;
determining, by the video server, a first range of frames of the first spherical video having the target feature of interest;
determining, by the video server, a first sequence of sub-frames from each of the first range of frames, each of the first sequence of sub-frames having a non-spherical field of view, and each of the first sequence of sub-frames including a spatial region around the target feature of interest;
generating, by the video server, a first portion of an output video including the sequence of sub-frames; and
outputting the output video.
3 Assignments
0 Petitions
Accused Products
Abstract
A spherical content capture system captures spherical video content. A spherical video sharing platform enables users to share the captured spherical content and enables users to access spherical content shared by other users. In one embodiment, captured metadata or video/audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include anon-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video o generate an output video that tracks a particular individual or object of interest.
-
Citations
20 Claims
-
1. A method for generating an output video from spherical video content, the method comprising:
-
storing, by a video server, a first spherical video comprising a sequence of spherical video frames, each having a spherical field of view and one or more audio tracks; processing, by the video server, the first spherical video to identify a target feature of interest meeting one or more audio or visual criteria; determining, by the video server, a first range of frames of the first spherical video having the target feature of interest; determining, by the video server, a first sequence of sub-frames from each of the first range of frames, each of the first sequence of sub-frames having a non-spherical field of view, and each of the first sequence of sub-frames including a spatial region around the target feature of interest; generating, by the video server, a first portion of an output video including the sequence of sub-frames; and outputting the output video. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A non-transitory computer-readable storage medium storing instructions for generating an output video from spherical video content, the instructions when executed by one or more processors causing the one or more processors to perform steps including:
-
storing a first spherical video comprising a sequence of spherical video frames each having a spherical field of view and one or more audio tracks; processing the first spherical video to identify a target feature of interest meeting one or more audio or visual criteria; determining a first range of frames of the first spherical video having the target feature of interest; determining a first sequence of sub-frames from each of the first range of frames, each of the first sequence of sub-frames having a non-spherical field of view, and each of the first sequence of sub-frames including a spatial region around the target feature of interest; generating a first portion of an output video including the sequence of sub-frames; and outputting the output video. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16)
-
-
17. A video server for generating an output video from spherical video content, the video server comprising:
-
one or more processors; and a non-transitory computer-readable storage medium storing instructions that when executed by the one or more processors causing the one or more processors to perform steps including; storing a first spherical video comprising a sequence of spherical video frames each having a spherical field of view and one or more audio tracks; processing the first spherical video to identify a target feature of interest meeting one or more audio or visual criteria; determining a first range of frames of the first spherical video having the target feature of interest; determining a first sequence of sub-frames from each of the first range of frames, each of the first sequence of sub-frames having a non-spherical field of view, and each of the first sequence of sub-frames including a spatial region around the target feature of interest; generating a first portion of an output video including the sequence of sub-frames; and outputting the output video. - View Dependent Claims (18, 19, 20)
-
Specification