PANORAMIC VIDEO WITH VIRTUAL PANNING CAPABILITY

• US 20120098925A1
• Filed: 10/21/2010
• Published: 04/26/2012
• Est. Priority Date: 10/21/2010
• Status: Abandoned Application

• Current Assignee: Ericsson Television Incorporated (Telefonaktiebolaget LM Ericsson)
• Original Assignee: Ericsson Television Incorporated (Telefonaktiebolaget LM Ericsson)
• Inventors: Dasher, Charles, Forsman, Bob, Toxen, Bob
• Application Number:
  US12/909,189
• Publication Number:
  US 20120098925A1
• Time in Patent Office: Days
• US Class Current: 348/36
• CPC Class Codes: G06T 3/40 Scaling of whole images or parts thereof, e.g. expanding or contracting
• CPC Class Codes: H04N 21/21805 enabling multiple viewpoints, e.g. using a plurality of cameras
• CPC Class Codes: H04N 21/2187 Live feed
• CPC Class Codes: H04N 21/234 Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
• CPC Class Codes: H04N 21/23805 Controlling the feeding rate to the network, e.g. by controlling the video pump
• CPC Class Codes: H04N 21/2393 involving handling client requests scheduling or organising the servicing of application requests H04L67/60
• CPC Class Codes: H04N 21/47202 for requesting content on demand, e.g. video on demand
• CPC Class Codes: H04N 21/6587 Control parameters, e.g. trick play commands, viewpoint selection
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums

Abstract

A plurality of cameras may be strategically placed around a venue for generating broadcast video streams which are processed by a broadcaster so as to produce a panning effect. A first video from one camera is streamed to one or more viewers. To create a panning effect, video from an adjacent, second, camera stream is used to interpolate video frames. The panning effect can be accomplished by interpolating frames for a certain number of time periods from a frame of the first camera and video frame of the second camera. The video from the first camera, the interpolated frames, and the video from the second camera is then selected and streamed to a viewer as a video stream, providing the panning effect. Multiple interpolation streams can be generated to handle panning from any camera to another camera. Panning requests may originate from the viewer or from the broadcaster.

Claims

1. A system for processing a first plurality of digital video frames and a second plurality of digital video frames for a video service provider to stream to a viewer, comprising:

a composition module comprising;

a first buffer storing said first plurality of digital video frames associated with a first camera;

a second buffer storing said second plurality of digital video frames associated with a second camera; and

a processor configured to;

retrieve a first video frame from said first plurality of digital video frames, where said first video frame is associated with a first time period,

retrieve a second video frame from said second plurality of digital video frames, wherein said second video frame is associated with a second time period, wherein said second time period is subsequent to said first time period, wherein there are at least one or more intervening time periods between said first video frame and said second video frame,

process said first video frame and said second video frame so as to produce one or more interpolated video frames,

store said one or more interpolated video frames into a panning video buffer, and

cause said first video frame, said one or more interpolated video frames, and said second video frame to be streamed the sequence to said viewer of said video service provider.

2. The system of claim 1 further comprising:

a first camera generating a first digital video data from which said first plurality of digital video frames are generated from; and

a second camera generating a second digital video data from which said second plurality of digital video frames are generated from.

3. The system of claim 2 wherein a portion of the subject matter captured by the first camera is also captured by the second camera.

4. The system of claim 2 further comprising:

a video encoder module receiving said digital video data from said first camera and providing said first plurality of digital, video frames in MPEG based video frames.

5. The system of claim 1 wherein said one or more interpolated video frames correspond to N number of video frames associated with N number of said intervening time periods, and wherein said second video frame is associated with a N+1 time period.

6. The system of claim 2 further comprising a video switch receiving said first plurality of digital video frames, said second plurality of digital video frames, and said one or more interpolated video frames from said composition module, said video switch configured to switch from said first plurality of digital frames to said one or more interpolated video frames, and to subsequently switch from said one or more interpolated video frames to said second plurality of digital video frames.

7. The system of claim 2 further comprising a third camera, wherein said first camera, said second camera, and said third camera are positioned along a line.

8. The system of claim 7 wherein said first camera, said second camera, and said third camera are located in a sporting venue.

9. The system of claim 6 wherein said video switch is responsive to a command causing said video switch to switch from said first plurality of digital frames to said one or more interpolated video frames, and to switch from said one or more interpolated video frames to said second plurality of digital video frames.

10. The system of claim 7 further comprising a multiplexer for transmitting said first plurality of digital frames, said interpolated video frames, and to second plurality of digital video frames over a cable service provider'"'"'s cable distribution network.

11. The system of claim 5 wherein said one or more interpolated video frames each incorporate a portion of the digital data from said first video frame and said second video frame.

12. A method for processing a first plurality of digital video frames and a second plurality of digital video frames comprising the steps of:

receiving said first plurality of digital video frames at a composition module associated with a first camera;

receiving said second plurality of digital video frames at the composition module associated with a second camera;

selecting a first video frame from said first plurality of digital video frames wherein said first video frame is associated with a first time period;

selecting a second frame from said second plurality of digital video frames, wherein said second frame is associated with a second time period, wherein said second time period is subsequent to said first time period;

processing said first frame and said second frame by a processor in said composition module to generate one or more interpolated video frames

storing said interpolated video frames into a panning video buffer; and

causing streaming in sequence of said first video frame, said one or more interpolated video frames, and said second video frame to be streamed over a cable distribution network.

13. The method according to claim 12 wherein a first camera generates a first digital video data from which said first plurality of digital video frames are generated, and wherein a second camera generates a second digital video data from which said second plurality of digital video frames are generated.

14. The method according to claim 13 wherein a portion of the subject matter captured by the first camera is captured by the second camera.

15. The method according to claim 14 wherein a video encoder receiving the first digital video data generates said first plurality of digital video frames comprising a first set of MPEG video frames, and said video encoder receiving the second digital video data generates said second plurality of digital video frames comprising a second set of MPEG video frames.

16. The method of claim 12 wherein there are Y number of time periods between the first video frame and said second video frame, and there are Y number of interpolated video frames.

17. The method of claim 16 wherein each of the Y number of interpolated video frames comprises a first subset of data from the first video frame and a second subset of data from the second video frame.

18. The method of claim 17 wherein a video switch performs the steps of:

switching said first plurality of digital video frames to a viewer;

switching said Y number of interpolated video frames to said viewer, and

switching at least a portion of said second plurality of digital video frames to said viewer.

20. The system of claim 18 further comprising a plurality of cameras, wherein a first camera provides digital video data used in said originating video frame and a second camera provider digital video data used in said target video frame, and wherein at least portion of data in said originating video frame and said target video frame is in said Z−

1 number of interpolated video frames.

19. A system for providing panning video frames to a viewer comprising:

a first memory buffer storing first MPEG video frames from a first camera, said first MPEG frames comprising a first plurality of first video frames wherein each one of said first video frames is associated with a respective time period;

a second memory buffer storing MPEG video frames from a second camera, said second MPEG frames comprising a second plurality of second video frames wherein each one of said second video frames is associated with said respective time period;

a processor configured to;

retrieve one of the first plurality of first video frames from said first memory buffer as an originating video frame,

retrieve one of the second plurality of second video frames from said second memory buffer as a target video frame, wherein said originating video frame is associated with a time period X and said target video frame is associated with a time period Y, wherein time period Y occurs Z number of time periods after time period X, and

generate Z−

1 number of interpolated video frames based on said originating video frame and said target video frame;

and

a video pump configured to stream said originating video frame, said Z−

1 number of interpolated video frames, and said target video frame to a viewer.