Multiple multicasting of multimedia streams

• US 6,728,775 B1
• Filed: 05/13/1997
• Issued: 04/27/2004
• Est. Priority Date: 03/17/1997
• Status: Expired due to Term

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Chaddha, Navin
• Primary Examiner(s): Najjar, Saleh
• Application Number:
  US08/855,246
• Time in Patent Office: 2,541 Days
• Field of Search: 395/200.61, 395/200.59, 395/200.62, 709/231, 709/232, 709/229
• US Class Current: 709/231
• CPC Class Codes: G06T 9/40 Tree coding, e.g. quadtree, octree
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/51 Motion estimation or motion compensation
• CPC Class Codes: H04N 19/527 Global motion vector estimation

Abstract

A method of interactively providing a number of client computers with a dynamically selectable and scalable range of multimedia data over a diverse computer network including local area networks (LANs) wide area networks (WANs) such as the internet. Multimedia data is provided by a server to the client computers includes a base layer and one or more enhancement layers. Enhancement layers can be spatial and/or temporal in nature. Depending on the implementation, the server may also provide information about the multimedia data to the client computers. The server splits the multimedia data for streaming via multiple multicast group (MMG) addresses. Information about the portion of the multimedia data carried by each MMG is broadcasted to the client computers. Armed with the information about the multimedia data, client computers can intelligently join and leave MMGs as needed. In some embodiments, the client computers provide feedback about the usage and/or need for the multimedia data, enabling the server to right-size, e.g., grow and/or prune, the multimedia data for network efficiency. With right sizing, the content of the base layer may be increased or decreased with the corresponding growing and pruning of the enhancement layers. Enhancement layers may also be grown and/or pruned independently of the base layer, i.e., without a corresponding change in the base layer.

Claims

1. In a server coupled to at least one client computer via a network, a method for streaming data to a first multicast group and a second multicast group, said method comprising:

streaming a first base layer and a first at least one enhancement layer of said data to said first multicast group, said first at least one enhancement layer additive to said first base layer; and

streaming a second base layer and a second at least one enhancement layer of said data to said second multicast group, said second at least one enhancement layer additive to said second base layer.

2. The method of claim 1 wherein said first base layer is different from said second base layer, and said first at least one enhancement layer is different from said second at least one enhancement layer.

3. The method of claim 1 wherein said first base layer is similar to said second base layer, and said first at least one enhancement layer is different from said second at least one enhancement layer.

4. The method of claim 3 wherein said first at least one enhancement layer has a larger number of enhancement layers than said second at least one enhancement layer.

5. The method of claim 1 further comprising right-sizing said data in response to feedback from said at least one client computer.

6. The method of claim 5 wherein said right-sizing includes pruning said first at least one enhancement layer by eliminating a redundant enhancement layer of said first at least one enhancement layer.

7. The method of claim 5 wherein said right-sizing includes growing said first at least one enhancement layer by adding an additional enhancement layer to said first at least one enhancement layer.

8. The method of claim 5 wherein said right-sizing includes:

increasing the content of said first base layer; and

eliminating a redundant enhancement layer of said first at least one enhancement layer.

9. The method of claim 5 wherein said right-sizing includes:

decreasing the content of said first base layer; and

adding an additional enhancement layer to said first at least one enhancement layer.

10. The method of claim 5 further comprising sending information about the content of said data to said at least one client computer via said first multicast group and said second multicast group.

11. The method of claim 1 wherein said first at least one enhancement layer are temporal enhancement layers.

12. The method of claim 1 wherein said first at least one enhancement layer are spatial enhancement layers.

13. The method of claim 12 wherein said spatial enhancement layers are generated using a Laplacian pyramid algorithm.

14. The method of claim 1 wherein the at least one client computer can receive and combine both the first base layer of the streaming data for the first multicast group and the second base layer of the streaming data for the second multicast group.

15. A server useful in association with at least one client computer, said server coupled to said at least one client computer via a network, said server comprising:

a networking unit configured to stream data, including a first base layer of said data, a first at least one enhancement layer of said data, a second base layer of said data and a second at least one enhancement layer of said data, to said at least one client computer, wherein said first at least one enhancement layer additive to said first base layer, said second at least one enhancement layer additive to said second base layer, and wherein said first base layer and said first at least one enhancement layer is streamed to said at least one client computer via a first multicast group, and said second base layer and a second at least one enhancement layer is streamed to said at least one client computer via a second multicast group.

16. The server of claim 15 wherein said first base layer is different from said second base layer, and said first at least one enhancement layer is different from said second at least one enhancement layer.

17. The server of claim 15 wherein said first base layer is similar to said second base layer, and said first at least one enhancement layer is different from said second at least one enhancement layer.

18. The server of claim 17 wherein said first at least one enhancement layer has a larger number of enhancement layers than said second at least one enhancement layer.

19. The server of claim 15 further comprising a receiver configured to receive feedback from said at least one client computer, said networking unit right-sizing said multimedia data in response to said feedback.

20. The server of claim 19 wherein said networking unit right-sizes said multimedia data by pruning said first at least one enhancement layer thereby eliminating a redundant enhancement layer of said first at least one enhancement layer.

21. The server of claim 19 wherein said networking unit right-sizes said multimedia data by growing said first at least one enhancement layer thereby adding an additional enhancement layer to said first at least one enhancement layer.

22. The server of claim 19 wherein said networking unit right-sizes said multimedia data by increasing the content of said first base layer and by eliminating a redundant enhancement layer of said first at least one enhancement layer.

23. The server of claim 19 wherein said networking unit right-sizes said multimedia data by decreasing the content of said first base layer and by adding an additional enhancement layer to said first at least one enhancement layer.

24. The server of claim 19 wherein said networking unit sending information about the content of said multimedia data to said at least one client computer via said first multicast group and said second multicast group.

25. The server of claim 15 wherein said first at least one enhancement layer are temporal enhancement layers.

26. The server of claim 15 wherein said first at least one enhancement layer are spatial enhancement layers.

27. The server of claim 26 wherein said spatial enhancement layers are generated using a Laplacian pyramid algorithm.

28. The server of claim 15 further comprising:

a packetizer configured to package said data into a number of embedded video stream packets; and

an encoder for producing said first base layer, said first at least one enhancement layer, said second base layer and said second at least one enhancement layer.

29. In a client computer coupled to a server via a network, a method for receiving data from said server, said data streamed via at least two multicast groups, said method comprising:

receiving said data from said server via said at least two multicast groups;

selecting a first suitable multicast group from said at least two multicast groups, said selected first multicast group associated with a first base layer and a first at least one enhancement layer of said data which best matches a target bandwidth of said client computer; and

joining said selected first multicast group.

30. In a client computer coupled to a server via a network, a method for receiving data from said server, said data streamed via at least two multicast groups, said method comprising:

receiving said data from said server via said at least two multicast groups;

selecting a first suitable multicast group from said at least two multicast groups, said selected first multicast group associated with a first base layer and a first at least one enhancement layer of said data which best matches a target bandwidth of said client computer; and

joining said selected first multicast group;

detecting a change in a desired bandwidth of said client computer;

selecting a second suitable multicast group from said at least two multicast groups, said selected second multicast group associated with a second base layer and a second at least one enhancement layer of said data which best matches the changed target bandwidth of said client computer; and

joining said selected second multicast group.

31. In a server coupled to at least one client computer via a network, a computer readable medium having computer executable instructions comprising:

streaming a first base layer and a first at least one enhancement layer of said data to said first multicast group, said first at least one enhancement layer additive to said first base layer; and

streaming a second base layer and a second at least one enhancement layer of said data to said second multicast group, said second at least one enhancement layer additive to said second base layer.

32. The computer readable medium of claim 31 wherein said first base layer is different from said second base layer, and said first at least one enhancement layer is different from said second at least one enhancement layer.

33. The computer readable medium of claim 31 wherein said first base layer is similar to said second base layer, and said first at least one enhancement layer is different from said second at least one enhancement layer.

34. The computer readable medium of claim 33 wherein said first at least one enhancement layer has a larger number of enhancement layers than said second at least one enhancement layer.

35. The computer readable medium of claim 31 further comprising right-sizing said data in response to feedback from said at least one client computer.

36. The computer readable medium of claim 35 wherein said right-sizing includes pruning said first at least one enhancement layer by eliminating a redundant enhancement layer of said first at least one enhancement layer.

37. The computer readable medium of claim 35 wherein said right-sizing includes growing said first at least one enhancement layer by adding an additional enhancement layer to said first at least one enhancement layer.

38. The computer readable medium of claim 35 wherein said right-sizing includes:

increasing the content of said first base layer; and

eliminating a redundant enhancement layer of said first at least one enhancement layer.

39. The computer readable medium of claim 35 wherein said right-sizing includes:

decreasing the content of said first base layer; and

adding an additional enhancement layer to said first at least one enhancement layer.

40. The computer readable medium of claim 35 further comprising sending information about the content of said data to said at least one client computer via said first multicast group and said second multicast group.

41. The computer readable medium of claim 31 wherein said first at least one enhancement layer are temporal enhancement layers.

42. The computer readable medium of claim 31 wherein said first at least one enhancement layer are spatial enhancement layers.

43. The computer readable medium of claim 42 wherein said spatial enhancement layers are generated using a Laplacian pyramid algorithm.

44. In a client computer coupled to a server via a network, a computer readable medium having computer executable instructions for receiving data from said server, said data streamed via at least two multicast groups, said computer executable instructions comprising:

receiving said data from said server via said at least two multicast groups;

selecting a first suitable multicast group from said at least two multicast groups, said selected first multicast group associated with a first base layer and a first at least one enhancement layer of said data which best matches a target bandwidth of said client computer; and

joining said selected first multicast group.

45. In a client computer coupled to a server via a network, a computer readable medium having computer executable instructions for receiving data from said server, said data streamed via at least two multicast groups, said computer executable instructions comprising:

receiving said data from said server via said at least two multicast groups;

selecting a first suitable multicast group from said at least two multicast groups, said selected first multicast group associated with a first base layer and a first at least one enhancement layer of said data which best matches a target bandwidth of said client computer; and

joining said selected first multicast group;

detecting a change in a desired bandwidth of said client computer;

selecting a second suitable multicast group from said at least two multicast groups, said selected second multicast group associated with a second base layer and a second at least one enhancement layer of said data which best matches the changed target bandwidth of said client computer; and

joining said selected second multicast group.