Method and appartus for controlling multimedia information communication

• US 5,477,542 A
• Filed: 03/24/1994
• Issued: 12/19/1995
• Est. Priority Date: 03/30/1993
• Status: Expired due to Term

• Current Assignee: Hitachi, Ltd.
• Original Assignee: Hitachi, Ltd.
• Inventors: Takahara, Keiko, Matsui, Susumu, Iwami, Naoko
• Primary Examiner(s): Kizou, Hassan
• Application Number:
  US08/216,942
• Time in Patent Office: 635 Days
• Field of Search: 370/60, 370/60.1, 370/94.1, 370/94.2, 370/94.3, 370/79, 370/84, 370/110.1, 370/112, 348/10, 348/14, 348/423, 348/462
• US Class Current: 370/389
• CPC Class Codes: H04J 3/177 Freeze-out systems, e.g. taking away active sources from transmission
• CPC Class Codes: H04L 12/6418 Hybrid transport
• CPC Class Codes: H04L 2012/5616 Terminal equipment, e.g. codecs, synch.
• CPC Class Codes: H04L 2012/5635 Backpressure, e.g. for ABR
• CPC Class Codes: H04L 2012/5649 Cell delay or jitter
• CPC Class Codes: H04L 2012/5664 Support of Video, e.g. MPEG
• CPC Class Codes: H04L 2012/5671 Support of voice
• CPC Class Codes: H04L 2012/6481 Speech, voice
• CPC Class Codes: H04L 2012/6483 Video, e.g. MPEG
• CPC Class Codes: H04L 2012/6497 Feedback to the source
• CPC Class Codes: H04N 21/23614 Multiplexing of additional data and video streams arrangements for simultaneous broadcast of plural pieces of information H04H20/28
• CPC Class Codes: H04N 21/2368 Multiplexing of audio and video streams
• CPC Class Codes: H04N 21/2402 Monitoring of the downstream path of the transmission network, e.g. bandwidth available traffic monitoring in data switching networks H04L43/00; monitoring data switching networks utilization H04L43/0876
• CPC Class Codes: H04N 21/2662 Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
• CPC Class Codes: H04N 21/4341 Demultiplexing of audio and video streams
• CPC Class Codes: H04N 21/4348 Demultiplexing of additional data and video streams
• CPC Class Codes: H04N 21/44209 Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896
• CPC Class Codes: H04N 21/6373 for rate control , e.g. request to the server to modify its transmission rate flow control in packet networks H04L47/10
• CPC Class Codes: H04N 21/6377 directed to server one-way streaming services wherein the source is controlled by the destination H04L65/613
• CPC Class Codes: H04N 21/6379 directed to encoder , e.g. for requesting a lower encoding rate
• CPC Class Codes: H04Q 11/0478 : Provisions for broadband connections

Abstract

A system in which multimedia information communication is performed between two terminal stations connected to each other through a packet switching network, each of the terminal stations having a control device for performing send control for sending a video packet including coded video data and a voice packet including coded voice data to the packet switching network and supply control for supplying the video packet and voice packet received from the packe switching network to a video codec and a voice codec respectively. One of the two terminal stations operating as a receive side issues a video data transmission mode change request to the other terminal station located at a multimedia information transmission side in accordance with a status of delay of video packets and/or voice packets received from the packet switching network, and the other of said terminal stations changes the video data transmission mode in response to the transmission mode change request, so that when the delay generated in the voice packet arrival interval exceeds a predetermined threshold value, video transmission is stopped and the operation mode is made to be a communication mode of only voice data.

Claims

1. A transmission control method in multimedia information communication performed between two terminal stations connected to each other through a packet switching network, each of said terminal stations having control means for performing transmission control for transmitting a video packet including coded video data and a voice packet including coded voice data to said packet switching network and for performing supply control for supplying said video packet and voice packet received from said packet switching network to a video codec and a voice codec respectively, said control method comprising the steps of:

one of said two terminal stations operating as a receiving side terminal station transmitting a video data transmission mode change request to the other terminal station operating as a multimedia information transmission side in accordance with a status of delay of video packets and/or voice packets received from said packet switching network; and

said transmission side terminal station changing the video data transmission mode in response to said transmission mode change request.

2. A transmission control method according to claim 1, wherein

said receiving side terminal station observes delay of video packets in said packet switching network so that said receiving side terminal station issues, as said transmission mode change request, a rate command for instructing changing of a video packet transmission interval in accordance with a quantity of the observed delay when delay of video packets exceeds a first threshold value and issues, as said transmission mode change request, a stop command for instructing stopping of video packet transmission when the delay of video packets exceeds a predetermined limit which is larger than said first threshold value, and

said transmission side terminal station changes its communication mode from a first communication mode to transmit both video data and voice data into a second communication mode to transmit only voice data, in response to reception of said stop command.

3. A transmission control method according to claim 2, wherein

said transmission side terminal station transmits each video packet with its transmission time added thereto to said packet switching network, and

said receiving side terminal station calculates the quantity of delay of video packets on the basis of an arrival interval of video packets from said packet switching network and a transmission interval of video packets calculated from transmission time added to each video packet.

4. A transmission control method according to claim 1 wherein

said receiving side terminal station observes delay of voice packets in said packet switching network so that said receiving side terminal station issues, as said transmission mode change request, a stop command for instructing stopping of video packet transmission when delay of voice packets becomes greater than or equal to a predetermined upper limit value and issues, as said transmission mode change request, a restart command for instructing restart of video packet transmission when delay of voice packets become less than or equal to a predetermined lower limit value, and

said transmission side terminal station changes the communication mode from a first communication mode to transmit both video data and voice data to a second communication mode to transmit only voice data, in response to reception of said stop command, and changes from said second communication mode to said first communication mode in response to reception of said restart command.

5. A transmission control method according to claim 4, wherein

said receive side terminal station observes delay of video packets in said packet switching network so that said receiving side terminal station issues, as said transmission mode change request, a rate command for instructing changing of a video packet transmission interval in accordance with a quantity of the observed delay when delay of video packets exceeds a predetermined threshold value, and

said transmission side terminal station controls the video packet transmission interval in response to reception of said rate command.

6. A transmission control method according to claim 4, wherein

said transmission side terminal station transmits each video packet with its transmission time added thereto and each voice packet with its transmission time added thereto, and

said receive side terminal station calculates the quantity of delay of voice packets on the basis of an arrival interval of voice packets from said packet switching network and a transmission interval of voice packets calculated from transmission time added to each voice packet.

7. A transmission control method according to claim 6, wherein

said receiving side terminal station calculates the quantity of delay of voice packets on the basis of a difference between an average arrival interval of voice packets and an average transmission interval of voice packets for every group of a predetermined number of voice packets received from said packet switching network.

8. A multimedia communication terminal station for performing multimedia communication with another terminal station through a packet switching network, comprising:

video data transmission control means for controlling transmission of a video packet including coded video data to said packet switching network;

video data reception control means for controlling supply of a video packet received from said packet switching network to a video decoding circuit;

voice data transmission control means for controlling transmission of a voice packet including coded voice data to said packet switching network; and

voice data reception control means for controlling supply of a voice packet received from said packet switching network to a voice decoding circuit;

wherein said video reception control means includes;

first means for observing video packet delay time generated in said packet switching network, and

second means for issuing a video data transmission mode change request to another terminal station in accordance with the delay time of video packets observed by said first means; and

wherein said video data transmission control means controls a video packet transmission interval in response to a video data transmission mode change request received from another terminal station.

9. A multimedia communication terminal station according to claim 8, wherein

said second means issues, as said transmission mode change request, a rate command for instructing changing of a video packet transmission interval in accordance with a quantity of the observed delay when delay of video packets exceeds a first threshold value and issues, as said transmission mode change request, a stop command for instructing stopping of video packet transmission when the delay of video packets exceeds a predetermined limit which is larger than said first threshold value, and

said video data transmission control means controls the video packet transmission interval in response to a rate command received from another terminal station, and stops video packet transmission in response to a stop command received from another terminal station.

10. A multimedia communication terminal station according to claim 8, wherein

said video data transmission control means sends each video packet with its transmission time added thereto to said packet switching network, and

said first means calculates the delay time of video packets on the basis of an arrival interval of video packets from said packet switching network and a transmission interval of video packets calculated from transmission time added to each video packet.

11. A multimedia communication terminal station according to claim 8, wherein

said voice data transmission control means includes third means for observing delay time of voice packets in said packet switching network, and fourth means for issuing, as said transmission mode change request, a stop command for instructing stopping of video packet transmission when the delay time of voice packets observed by said third means becomes greater than or equal to a predetermined upper limit value and issues, as said transmission mode change request, a restart command for instructing restarting of video packet transmission when the delay time of voice packets becomes less than or equal to a predetermined lower limit value;

and

said video data transmission control means stops video packet transmission in response to reception of a stop command received from another terminal station, and restarts video packet transmission in response to reception of a restart command received from another terminal station.

12. A multimedia communication terminal station according to claim 11, wherein

said video data transmission control means observes delay time of video packets in said packet switching network to issue a rate command for instructing changing of a video packet transmission interval in accordance with a quantity of the observed delay when delay of video packets exceeds a predetermined threshold value,

wherein further another terminal station controls the video packet send interval in response to reception of said rate command.

13. A multimedia communication terminal station according to claim 11, wherein

said voice data transmission control means includes means for adding transmission time to each voice packet to be transmitted, and

said voice data reception control means calculates the quantity of delay of voice packets on the basis of an arrival interval of voice packets from said packet switching network and a transmission interval of voice packets calculated from transmission time added to each voice packet.

14. A multimedia communication terminal station according to claim 13, wherein

said voice data reception control means calculates the quantity of delay of voice packets on the basis of a difference between an average arrival interval of voice packets and an average transmission interval of voice packets for every group of a predetermined number of voice packets received from said packet switching network.