×

Automatic generation of video and directional audio from spherical content

  • US 9,570,113 B2
  • Filed: 07/01/2015
  • Issued: 02/14/2017
  • Est. Priority Date: 07/03/2014
  • Status: Active Grant
First Claim
Patent Images

1. A method for generating a video with corresponding audio, comprising:

  • receiving a spherical video;

    receiving a plurality of audio channels representing audio captured concurrently with the spherical video, each of the plurality of audio channels comprising directional audio corresponding to respective different directions;

    defining respective spatial sub-regions to subdivide the frame of the spherical video;

    mapping each of the plurality of audio channels to different spatial sub-regions of the spherical video such that each sub-region is associated with at least one audio channel;

    for each of a plurality of frames of the spherical video, extracting a sub-frame having a reduced field of view relative to a field of view of the spherical video;

    for each of the sub-frames, by a processor,determining one or more of the spatial sub-regions overlapping the sub-frame;

    determining a composite audio channel, the composite audio channel being a combination of the audio channels mapped to the one or more of the spatial sub-regions overlapping the sub-frame;

    generating a portion of an audio stream from the composite audio channel; and

    outputting the generated video and the audio stream.

View all claims
  • 3 Assignments
Timeline View
Assignment View
    ×
    ×