Panoramic streaming of video with user selected audio

• US 10,349,009 B1
• Filed: 10/18/2013
• Issued: 07/09/2019
• Est. Priority Date: 10/18/2012
• Status: Active Grant

• Current Assignee: Gn Audio A/S (GN Store Nord A/S)
• Original Assignee: Altia Systems Inc. (GN Store Nord A/S)
• Inventors: Natarajan, Ram, Alam, Naveed, Gupta, Yashket, Herlitz, Lars, Khan, Aurangzeb
• Primary Examiner(s): Nguyen, Phung-Hoang J
• Application Number:
  US14/058,192
• Time in Patent Office: 2,090 Days
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

A method for processing video is disclosed. The method comprises associating a plurality of audio zones with the video; associating a region of interest (ROI) for each of a plurality of client devices to which the video is currently being streamed; for each client device generating custom video comprising a modified video channel associated with the video being streamed to that client, wherein the modified audio channel comprises an enhanced audio for at least one audio zone indicated by the region of interest (ROI) for said client device.

Claims

1. A method for processing a panoramic-video, comprising:

associating a plurality of audio zones with the panoramic video;

associating a particular region of interest (ROI) for each one of a plurality of client devices to which the panoramic-video is currently being streamed based on zoom information inputted by at least one of the plurality of client devices for the panoramic-video being viewed on the each of the plurality of client devices;

generating, for each of the plurality of client devices, a custom panoramic-video comprising a modified audio channel associated with the panoramic-video being streamed to at least one of the plurality of client devices, wherein

the modified audio channel is adjusted to coincide with directionality of an audio corresponding to the associated region of interest (ROI) inputted by the at least one of said client device, and wherein

the modified audio channel is adjusted to mute audio corresponding to the audio zones other than the audio zone associated with the ROI.

2. The method of claim 1, further comprising determining the region of interest (ROI) for each client device.

3. The method of claim 2, wherein determining the region of interest (ROI) for each client device is based on panning information for video being viewed by the client device.

4. The method of claim 1, wherein the modified audio channel comprises at least two audio zones with enhanced audio.

5. A system, comprising:

a processor; and

a memory coupled to the processor, the memory storing instructions which when executed by the processor causes the system to perform a method, comprising;

associating a plurality of audio zones with a panoramic video;

associating a particular region of interest (ROI) for each one of a plurality of client devices to which the panoramic-video is currently being streamed based on zoom information inputted by at least one of the plurality of client devices for the panoramic-video being viewed on the each of the plurality of client devices;

generating, for each of the plurality of client devices, a custom panoramic-video comprising a modified audio channel associated with the panoramic-video being streamed to at least one of the plurality of client devices, wherein

the modified audio channel is adjusted to coincide with directionality of an audio corresponding to the associated region of interest (ROI) inputted by the at least one of said client device, and wherein

the modified audio channel is adjusted to mute audio corresponding to the audio zones other than the audio zone associated with the ROI.

6. The system of claim 5, wherein the method further comprises determining the region of interest (ROI) for each client device.

7. The system of claim 5, wherein determining the region of interest (ROI) for each client device is based on panning information for video being viewed by the client device.

8. The system of claim 5, wherein the modified audio channel comprises at least two audio zones with enhanced audio.

9. A non-transitory computer-readable medium comprising instructions which when executed by a processor causes a system to perform a method comprising:

associating a plurality of audio zones with a panoramic video;

associating a particular region of interest (ROI) for each one of a plurality of client devices to which the panoramic-video is currently being streamed based on zoom information inputted by at least one of the plurality of client devices for the panoramic-video being viewed on the each of the plurality of client devices;

generating, for each of the plurality of client devices, a custom panoramic-video comprising a modified audio channel associated with the panoramic-video being streamed to at least one of the plurality of client devices, wherein

the modified audio channel is adjusted to coincide with directionality of an audio corresponding to the associated region of interest (ROI) inputted by the at least one of said client device, and wherein

the modified audio channel is adjusted to mute audio corresponding to the audio zones other than the audio zone associated with the ROI.

10. The computer-readable medium of claim 9, wherein the method further comprises determining the region of interest (ROI) for each client device.

11. The computer-readable medium of claim 10, wherein determining the region of interest (ROI) for each client device is based on panning information for video being viewed by the client device.

12. The computer-readable medium of claim 9, wherein the modified audio channel comprises at least two audio zones with enhanced audio.