Providing and Displaying Video at Multiple Resolution and Quality Levels

• US 20090320081A1
• Filed: 07/15/2008
• Published: 12/24/2009
• Est. Priority Date: 06/24/2008
• Status: Abandoned Application

• Current Assignee: Precoad Incorporated
• Original Assignee: Precoad Incorporated
• Inventors: Wang, Haishan, Chui, Charles K., Shi, Dongfang
• Application Number:
  US12/173,768
• Publication Number:
  US 20090320081A1
• Time in Patent Office: Days
• US Class Current: 725/93
• CPC Class Codes: H04N 21/23439 for generating different versions
• CPC Class Codes: H04N 21/4728 for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
• CPC Class Codes: H04N 21/6377 directed to server one-way streaming services wherein the source is controlled by the destination H04L65/613
• CPC Class Codes: H04N 21/658 Transmission by the client directed to the server
• CPC Class Codes: H04N 21/6587 Control parameters, e.g. trick play commands, viewpoint selection
• CPC Class Codes: H04N 21/845 Structuring of content, e.g. decomposing content into time segments
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests

Abstract

A method provides video from a video data source comprising a sequence of multi-level frames. Each multi-level frame comprises multiple copies of a respective frame. Each copy has an associated video resolution or quality level that is a member of a predefined range of levels that range from a highest level to a lowest level. First video data corresponding to a first portion of a first copy of a respective frame and second video data corresponding to a second portion of a second copy of the respective frame are extracted from the video data source. The video resolution or quality level of the second copy is distinct from that of the first copy. The first and second video data are transmitted to a client device for display. The extracting and transmitting are repeated with respect to successive multi-level frames of the video data source.

Claims

1. A method of displaying video at a client device separate from a server, comprising:

transmitting to the server a request specifying a window region to display over a background region in a video;

receiving first and second video data from the server, the first video data corresponding to a first portion of a first copy of a first frame in a sequence of frames, the second video data corresponding to a second portion of a second copy of the first frame, wherein the first copy and the second copy have distinct video resolution levels;

decoding the first and second video data;

displaying the decoded first video data in the background region and the decoded second video data in the window region; and

repeating the receiving, decoding, and displaying with respect to a plurality of successive frames in the sequence.

2. The method of claim 1, wherein the first and second video data are received in a single video bitstream.

3. The method of claim 2, wherein the single video bitstream has syntax compatible with M-JPEG, MPEG-2, MPEG-4, H.263, or H.264 video decoders.

4. The method of claim 1, wherein the first video data are received from a first source at the server and the second video data are received from a second source at the server.

5. The method of claim 1, wherein the first and second video data are received from a single multiple-resolution video source at the server.

6. The method of claim 1, wherein a single decoder decodes the first and second video data.

7. The method of claim 1, wherein a first decoder decodes the first video data and a second decoder decodes the second video data.

8. The method of claim 1, wherein the request specifies a scale factor for the window region.

9. The method of claim 8, wherein the video resolution level of the second copy corresponds to the scale factor.

10. The method of claim 1, further comprising:

transmitting a request to pan the window region; and

continuing to receive, decode, and display the first and second video data with respect to additional successive frames, wherein the second portion of the additional successive frames is translated with respect to the second portion of the first frame.

11. The method of claim 10, further comprising:

receiving user input to pan the window region; and

in response to the user input, generating the request to pan the window region.

12. The method of claim 10, further comprising:

automatically generating the request based on motion vectors in the second portion or a subset thereof.

13. The method of claim 12, wherein the request specifies a shift in location of the window region corresponding to an average of motion vectors within the second portion or subset thereof.

14. The method of claim 13, wherein the average of motion vectors is a weighted average.

15. The method of claim 1, further comprising:

transmitting a request to pan the background region; and

continuing to receive, decode, and display the first and second video data with respect to additional successive frames, wherein the first portion of the additional successive frames is translated with respect to the first portion of the first frame.

16. The method of claim 1, wherein the first video data include data extracted from an inter-coded bitstream of a first macro-block in the first frame and an intra-coded bitstream of a second macro-block in the first frame.

17. The method of claim 1, wherein the first and second video data comprise a plurality of tiles in the first frame, wherein at least one of the tiles comprises a plurality of intra-coded macro-blocks and at least one of the tiles comprises a plurality of inter-coded macro-blocks.

18. A client device for displaying video, separate from a server, the client device comprising:

memory;

one or more processors;

one or more programs stored in the memory and configured for execution by the one or more processors, the one or more programs including;

instructions to transmit to the server a request specifying a window region to display over a background region in a video;

instructions to receive first and second video data from the server, the first video data corresponding to a first portion of a first copy of a first frame in a sequence of frames, the second video data corresponding to a second portion of a second copy of the first frame, wherein the first copy and the second copy have distinct video resolution levels;

instructions to decode the first and second video data;

instructions to display the decoded first video data in the background region and the decoded second video data in the window region; and

instructions to repeat the receiving, decoding, and displaying with respect to a plurality of successive frames in the sequence.

19. The client device of claim 18, wherein the client device is a set-top box, personal computer, or portable electronic device.

20. A computer readable storage medium storing one or more programs for use in displaying video at a client device separate from a server, the one or more programs configured to be executed by a computer system and comprising:

instructions to transmit to the server a request specifying a window region to display over a background region in a video;

instructions to receive first and second video data from the server, the first video data corresponding to a first portion of a first copy of a first frame in a sequence of frames, the second video data corresponding to a second portion of a second copy of the first frame, wherein the first copy and the second copy have distinct video resolution levels;

instructions to decode the first and second video data;

instructions to display the decoded first video data in the background region and the decoded second video data in the window region; and

instructions to repeat the receiving, decoding, and displaying with respect to a plurality of successive frames in the sequence.

21. A client device for displaying video, separate from a server, the client device comprising:

means for transmitting to the server a request specifying a window region to display over a background region in a video;

means for receiving first and second video data from the server, the first video data corresponding to a first portion of a first copy of a first frame in a sequence of frames, the second video data corresponding to a second portion of a second copy of the first frame, wherein the first copy and the second copy have distinct video resolution levels;

means for decoding the first and second video data; and

means for displaying the decoded first video data in the background region and the decoded second video data in the window region;

wherein the means for receiving, decoding, and displaying are configured to repeat the receiving, decoding, and displaying with respect to a plurality of successive frames in the sequence.

22. A method of displaying video at a client device separate from a server, comprising:

transmitting to the server a request specifying a window region to display over a background region in a video;

receiving first and second video data from the server, the first video data corresponding to a first portion of a first copy of a first frame in a sequence of frames, the second video data corresponding to a second portion of a second copy of the first frame, wherein the first copy and the second copy have distinct video quality levels;

decoding the first and second video data;

displaying the decoded first video data in the background region and the decoded second video data in the window region; and

repeating the receiving, decoding, and displaying with respect to a plurality of successive frames in the sequence.

23. A method of providing video from a video data source, the video data source comprising a sequence of multi-level frames, wherein each multi-level frame comprises a plurality of copies of a respective frame, each copy having an associated video resolution level, the video resolution level of each copy being a member of a predefined range of video resolution levels that range from a highest video resolution level to a lowest video resolution level, the method comprising:

extracting, from the video data source, first video data corresponding to a first portion of a first copy of a respective frame;

extracting, from the video data source, second video data corresponding to a second portion of a second copy of the respective frame, wherein the video resolution level of the second copy is distinct from the video resolution level of the first copy;

transmitting the first and second video data to a client device for display; and

repeating the extracting and transmitting with respect to a plurality of successive multi-level frames of the video data source.