×

Apparatus and method for panoramic video hosting with directional audio

  • US 9,723,223 B1
  • Filed: 09/27/2013
  • Issued: 08/01/2017
  • Est. Priority Date: 12/02/2011
  • Status: Expired due to Fees
First Claim
Patent Images

1. A server, programmed to:

  • receive first video data comprising a first frame captured by a first camera;

    receive second video data comprising a second frame captured by a second camera;

    receive a first audio track including audio data captured by a first microphone sensitive to sound received from a first microphone direction;

    receive a second audio track including audio data captured by a second microphone sensitive to sound received from a second microphone direction different than the first microphone direction;

    generate a first panoramic frame based at least in part on the first frame and the second frame;

    receive first view direction data describing a first view direction offset from the first microphone direction and offset from the second microphone direction;

    form a first stereo audio track based at least in part upon the first view direction, wherein the first stereo audio track comprises;

    a first left channel track comprising a first weighted combination of the first audio track and the second audio track, wherein the first weighted combination is generated by applying a first weight to the first audio track based at least in part on the offset of the first view direction from the first microphone direction and applying a second weight to the second audio track based at least in part on the offset of the first view direction from the second microphone direction; and

    a first right channel track comprising a second weighted combination of the first audio track and the second audio track, wherein the second weighted combination is generated by applying a third weight to the first audio track based at least in part on the offset of the first view direction from the first microphone direction and applying a fourth weight to the second audio track based at least in part on the offset of the first view direction from the second microphone direction;

    send the first stereo audio track to a client device;

    receive second view direction data describing a second view direction different than the first view direction;

    form a second stereo audio track based at least in part upon the second view direction, wherein the second stereo audio track comprises;

    a second left channel track comprising the second weighted combination of the first audio track and the second audio track; and

    a second right channel track comprising the first weighted combination of the first audio track and the second audio track; and

    send the second stereo audio track to the client device.

View all claims
  • 3 Assignments
Timeline View
Assignment View
    ×
    ×