Real-time media content synchronization and transmission in packet network apparatus and method

• US 6,778,493 B1
• Filed: 02/07/2000
• Issued: 08/17/2004
• Est. Priority Date: 02/07/2000
• Status: Expired due to Term

• Current Assignee: Sharp Laboratories of America Incorporated (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Sharp Laboratories of America Incorporated (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Ishii, Atsushi
• Primary Examiner(s): Pezzlo, John
• Assistant Examiner(s): Tsegaye, Saba
• Application Number:
  US09/499,701
• Time in Patent Office: 1,653 Days
• Field of Search: 370/400, 370/401, 370/412, 370/413, 370/428, 370/229, 370/230, 370/230.1, 370/231, 370/232, 370/235
• US Class Current: 370/229
• CPC Class Codes: H04L 65/1026 at the edge
• CPC Class Codes: H04L 65/1036 at the edge
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/611 for multicast or broadcast systems for broadcast or conference H04L12/18; arrangements for broadcast or distribution combined with broadcast H04H20/00; arrangements for broadcast applications with a direct linkage to broadcast information or to broadcast space-time H04H60/00; selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS], H04W4/06
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 69/28 Timers or timing mechanisms used in protocols

Abstract

A system for transmitting and synchronizing real-time multimedia content includes a multimedia server for generating a multimedia packet; a packet-based communication network connected to the multimedia server for receiving multimedia packets therefrom; the network having multiple routers therein to route the multimedia packets to plural destinations; a mechanism for inserting total delay information (TDI) into the multimedia packets, wherein the TDI includes total end-to-end delay (TED) and cumulative network delay (CND); and plural multimedia receivers for receiving the multimedia packets having TDI therein, wherein each multimedia receiver includes a buffer, a sequencing mechanism, and a playing mechanism for playing retrieved, sequenced multimedia packets at time TED after the multimedia packet has been transmitted by the multimedia server. A method of transmitting and synchronizing real-time multimedia content includes loading multimedia audio/visual into plural multimedia packets; inserting total delay information (TDI) into at least one of the multimedia packets, wherein TDI includes total end-to-end delay (TED) and cumulative network delay (CND); transmitting the multimedia packets to plural multimedia receivers over a packet-based network in a play sequence; and playing the multimedia packets at each receiver at time TED.

Claims

1. A system for transmitting and synchronizing real-time multimedia content to plural, multimedia receivers, comprising:

a multimedia server for generating a multimedia packet having multimedia audio/visual information therein in a play sequence, and for transmitting said multimedia packet;

a packet-based communication network connected to said multimedia server for receiving said multimedia packets therefrom;

said network having multiple routers therein to route said multimedia packets to plural destinations;

means for inserting total delay information (TDI) into said multimedia packets, wherein said TDI includes total end-to-end delay (TED) and cumulative network delay (CND), wherein TED is the total time from when a multimedia packet is transmitted from the multimedia server to when the multimedia packet is to be played at a receiver and wherein CND is the actual delay caused as a multimedia packet transits the communications network; and

plural multimedia receivers for receiving said multimedia packets having TDI therein, wherein each multimedia receiver includes a buffer for storing-received multimedia packets, a sequencing means for retrieving stored multimedia packets from said buffer and sequencing said multimedia packets in said play sequence for providing a real-time synchronization of the multimedia packets at plural, multimedia receivers, and a playing mechanism for playing the retrieved, sequenced multimedia packets at time TED after said multimedia packet has been transmitted by said multimedia server.

2. The system of claim 1 wherein said means for inserting is located in said multimedia server.

3. The system of claim 1 wherein said means for inserting is located in a router.

4. The system of claim 1 which further includes a local area network (LAN) located between said packet-based network and at least some of said multimedia receivers, wherein said LAN includes a gateway.

5. The system of claim 4 wherein said means for inserting is located in said gateway.

6. The system of claim 1 wherein at least one of said routers includes duplication means for duplicating multimedia packets, wherein said means for inserting is located in said router, and wherein said router inserts TDI into each duplicated multimedia packet.

7. The system of claim 1 which further includes means to determine whether a multimedia packet is a viable packet or whether a multimedia packet is a non-viable packet, and wherein said non-viable packets are discarded.

8. The system of claim 1 wherein said multimedia receivers includes means to request a larger TDI from said means for inserting.

9. A method of transmitting and synchronizing real-time multimedia content to plural, multimedia receivers, comprising:

loading multimedia audio/visual into plural multimedia packets;

inserting total delay information (TDI) into at least one of the multimedia packets, wherein TDI includes total end-to-end delay (TED) and cumulative network delay (CND), wherein TED is the total time from when a multimedia packet is transmitted from a multimedia server to when the multimedia packet is to be played at a receiver and wherein CND is the actual delay caused as a multimedia packet transits a packet-based network;

transmitting the multimedia packets to plural multimedia receivers over a packet-based network in a play sequence;

synchronizing, in real-time, the multimedia packets;

buffering the multimedia packets in each multimedia receiver;

recalling the multimedia packets in play sequence;

increasing the value of TED if CND>

TED; and

playing the multimedia packets at each receiver at time TED.

10. The method of claim 9 wherein said inserting includes inserting TDI in a multimedia server.

11. The method of claim 9 wherein said inserting includes inserting TDI in a router located in the packer-based network.

12. The method of claim 9 wherein said inserting includes inserting TDI in a gateway located in a local area network (LAN) which is located between the packet-based network and a multimedia receiver.

13. The method of claim 9 which includes duplicating a multimedia packet for multicasting to plural multimedia receivers, and wherein said duplicating includes inserting TDI into at some of the duplicated multimedia packets.

14. The method of claim 9 which includes determining whether a multimedia packet is a viable packet or a non-viable packet, and which further include discarding any non-viable packets where CND>

TED, and the value of TED cannot be increased to render the packet viable.

15. A method of transmitting and synchronizing real-time multimedia content to plural, multimedia receivers, comprising:

determining whether a multimedia packet is a viable packet or a non-viable packet;

inserting total delay information (TDI) into at least one of the multimedia packets, wherein TDI includes total end-to-end delay (TED) and cumulative network delay (CND) for synchronizing, in real-time, the multimedia packets, wherein TED is the total time from when a multimedia packet is transmitted from the multimedia server to when the multimedia packet is to be played at a receiver and wherein CND is the actual delay caused as a multimedia packet transits the communications network;

increasing the value of TED if CND>

TED; and

discarding any non-viable packets.

16. The method of claim 15 which further includes:

loading multimedia audio/visual into plural multimedia packets;

transmitting the multimedia packets to plural multimedia receivers over a packet-based network in a play sequence;

discarding a multimedia packet if at any time during said transmitting CND>

TED

buffering the multimedia packets in each multimedia receiver;

recalling the multimedia packets in play sequence; and

playing the multimedia packets at each receiver at time TED.

17. The method of claim 16 wherein said inserting includes inserting TDI in a multimedia server.

18. The method of claim 16 wherein said inserting includes inserting TDI in a router located in the packet-based network.

19. The method of claim 16 wherein said inserting includes inserting TDI in a gateway located in a local area network (LAN) which is located between the packet-based network and a multimedia receiver.

20. The method of claim 16 which includes duplicating a multimedia packet for multicasting to plural multimedia receivers, and wherein said duplicating includes inserting TDI into at some of the duplicated multimedia packets.