Video communication method having refresh function of coding sequence and terminal devices thereof

• US 5,528,284 A
• Filed: 02/10/1994
• Issued: 06/18/1996
• Est. Priority Date: 02/10/1993
• Status: Expired due to Fees

• Current Assignee: Hitachi, Ltd.
• Original Assignee: Hitachi, Ltd.
• Inventors: Takahara, Keiko, Matsui, Susumu, Iwami, Naoko
• Primary Examiner(s): Metjahic, Safet
• Assistant Examiner(s): Murrell, Jeffrey S.
• Application Number:
  US08/194,268
• Time in Patent Office: 859 Days
• Field of Search: 348/12, 348/13, 348/15, 348/19, 348/7, 348/16, 348/17, 348/466, 348/412, 348/415, 371/32, 370/94.1, 358/405
• US Class Current: 348/14.15
• CPC Class Codes: H04N 19/107 between spatial and temporal predictive coding, e.g. picture refresh
• CPC Class Codes: H04N 19/166 concerning the amount of transmission errors, e.g. bit error rate [BER]
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/89 involving methods or arrangements for detection of transmission errors at the decoder
• CPC Class Codes: H04N 21/236 Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream multiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00
• CPC Class Codes: H04N 21/434 Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream demultiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00
• CPC Class Codes: H04N 21/6377 directed to server one-way streaming services wherein the source is controlled by the destination H04L65/613
• CPC Class Codes: H04N 21/658 Transmission by the client directed to the server
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q

Abstract

In a video communication system including a sending terminal and a receiving terminal connected via a packet switching network, a receiving terminal which has detected loss of a video packet sets a video output into a freeze status and transmits a refresh request command to the sending terminal. Upon receiving the refresh request command, the sending terminal requests a video coder unit to execute refreshing and transmits a series of video packets beginning from an INTRA frame. Upon receiving a packet of the INTRA frame, the receiving terminal releases the freeze status and restarts video information decoding.

Claims

1. A video communication method for performing communication of coded video information between a sending terminal and a receiving terminal connected to each other via a network, the video communication method comprising the steps of:

converting, in the sending terminal, successive video frames into respective coded video frames according to a coding sequence, the coding sequence being periodically repeated and including a first coding mode wherein an initial video frame of the successive video frames is converted into an INTRA frame representative of only the initial video frame, and a second coding mode wherein remaining video frames of the successive video frames are converted into respective INTER frames each representative of a difference between a respective one of the successive video frames and a preceding one of the successive video frames;

transmitting, in the sending terminal, the coded video frames to the receiving terminal via the network;

detecting, in the receiving terminal, whether any portion of the transmitted coded video frames has been lost in transmission;

transmitting, in the receiving terminal, to the sending terminal via the network, a refresh request requesting the sending terminal to refresh a current coding sequence when it is detected that a portion of the transmitted coded video frames has been lost in transmission; and

refreshing, in the sending terminal, in response to the transmitted refresh request, a current coding sequence by interrupting the current coding sequence and beginning a new coding sequence, thereby causing a next coded video frame transmitted to the receiving terminal via the network to be an INTRA frame.

2. A video communication method according to claim 1, wherein the INTER frames are each representative of a difference between a respective one of the successive video frames and an immediately preceding one of the successive video frames.

3. A video communication method according to claim 2, wherein the step of transmitting the coded video frames includes the steps of:

forming video packets each having a predetermined format from the coded video frames; and

transmitting the video packets to the receiving terminal via the network.

4. A video communication method according to claim 3, wherein the step of forming video packets includes the steps of:

dividing the coded video frames into a plurality of blocks each having a predetermined length; and

forming video packets each having a predetermined format from the blocks, each of the video packets being formed from a respective one of the blocks.

5. A video communication method according to claim 4, wherein the step of detecting whether any portion of the transmitted coded video frames has been lost in transmission is performed based on a time interval which has elapsed since one of the transmitted video packets was last received in the receiving terminal.

6. A video communication method according to claim 4, wherein the video packets include respective sequence information assigned to the video packets;

and

wherein the step of detecting whether any portion of the transmitted coded video frames has been lost in transmission is performed based on the sequence information of ones of the transmitted video packets which have been received in the receiving terminal.

7. A video communication method according to claim 4, wherein the refresh request includes information identifying the portion of the transmitted coded video frames which has been lost in transmission;

and

wherein the step of refreshing a current coding sequence includes the steps of;

determining, based on the information identifying the portion of the transmitted coded video frames which has been lost in transmission, a sequence relation between the portion of the transmitted coded video frames which has been lost in transmission and an INTRA frame which was last transmitted to the receiving terminal via the network;

deciding, based on the sequence relation, whether a current coding sequence should be refreshed; and

refreshing, if it is decided that the current coding sequence should be refreshed, the current coding sequence by interrupting the current coding sequence and beginning a new coding sequence, thereby causing a next coded video frame transmitted to the receiving terminal via the network to be an INTRA frame.

8. A video communication method according to claim 3, wherein the step of detecting whether any portion of the transmitted coded video frames has been lost in transmission is performed based on a time interval which has elapsed since one of the transmitted video packets was last received in the receiving terminal.

9. A video communication method according to claim 3, wherein the video packets include respective sequence information assigned to the video packets;

and

wherein the step of detecting whether any portion of the transmitted coded video frames has been lost in transmission is performed based on the sequence information of ones of the transmitted video packets which have been received in the receiving terminal.

10. A video communication method according to claim 3, wherein the refresh request includes information identifying the portion of the transmitted coded video frames which has been lost in transmission;

and

wherein the step of refreshing a current coding sequence includes the steps of;

determining, based on the information identifying the portion of the transmitted coded video frames which has been lost in transmission, a sequence relation between the portion of the transmitted coded video frames which has been lost in transmission and an INTRA frame which was last transmitted to the receiving terminal via the network;

deciding, based on the sequence relation, whether a current coding sequence should be refreshed; and

refreshing, if it is decided that the current coding sequence should be refreshed, the current coding sequence by interrupting the current coding sequence and beginning a new coding sequence, thereby causing a next coded video frame transmitted to the receiving terminal via the network to be an INTRA frame.

11. A video communication method according to claim 2, wherein the refresh request includes information identifying the portion of the transmitted coded video frames which has been lost in transmission;

and

wherein the step of refreshing a current coding sequence includes the steps of;

determining, based on the information identifying the portion of the transmitted coded video frames which has been lost in transmission, a sequence relation between the portion of the transmitted coded video frames which has been lost in transmission and an INTRA frame which was last transmitted to the receiving terminal via the network;

deciding, based on the sequence relation, whether a current coding sequence should be refreshed; and

refreshing, if it is decided that the current coding sequence should be refreshed, the current coding sequence by interrupting the current coding sequence and beginning a new coding sequence, thereby causing a next coded video frame transmitted to the receiving terminal via the network to be an INTRA frame.

12. A video communication method according to claim 1, wherein the refresh request includes information identifying the portion of the transmitted coded video frames which has been lost in transmission;

and

wherein the step of refreshing a current coding sequence includes the steps of;

determining, based on the information identifying the portion of the transmitted coded video frames which has been lost in transmission, a sequence relation between the portion of the transmitted coded video frames which has been lost in transmission and an INTRA frame which was last transmitted to the receiving terminal via the network;

deciding, based on the sequence relation, whether a current coding sequence should be refreshed; and

refreshing, if it is decided that the current coding sequence should be refreshed, the current coding sequence by interrupting the current coding sequence and beginning a new coding sequence, thereby causing a next coded video frame transmitted to the receiving terminal via the network to be an INTRA frame.

13. A video communication method for performing communication of coded video information between a sending terminal and a plurality of receiving terminals connected to each other via a network, the video communication method comprising the steps of:

converting, in the sending terminal, successive video frames into respective coded video frames according to a coding sequence, the coding sequence being periodically repeated and including a first coding mode wherein an initial video frame of the successive video frames is converted into an INTRA frame representative of only the initial video frame, and a second coding mode wherein remaining video frames of the successive video frames are converted into respective INTER frames each representative of a difference between a respective one of the successive video frames and a preceding one of the successive video frames;

transmitting, in the sending terminal, the coded video frames to the receiving terminals via the network;

detecting, in each of the receiving terminals, whether any portion of the transmitted coded video frames has been lost in transmission;

transmitting, in each of the receiving terminals, to the sending terminal via the network, a refresh request requesting the sending terminal to refresh a current coding sequence when it is detected that a portion of the transmitted coded video frames has been lost in transmission;

monitoring, in the sending terminal, a time interval which has elapsed since a refresh request was last received in the sending terminal;

disregarding, in the sending terminal, a refresh request which has just been received in the sending terminal, if the time interval which has elapsed since a refresh request was last received in the sending terminal is less than a predetermined time interval; and

refreshing, in the sending terminal, in response to the refresh request which has just been received in the sending terminal, a current coding sequence by interrupting the current coding sequence and beginning a new coding sequence, thereby causing a next coded video frame transmitted to the receiving terminals via the network to be an INTRA frame, if the time interval which has elapsed since a refresh request was last received in the sending terminal is not less than the predetermined time interval.

14. A video communication method according to claim 13, wherein the INTER frames are each representative of a difference between a respective one of the successive video frames and an immediately preceding one of the successive video frames.

15. A video communication method according to claim 13, wherein the step of transmitting the coded video frames includes the steps of:

forming video packets each having a predetermined format from the coded video frames; and

transmitting the video packets to the receiving terminals via the network.

16. A video communication method according to claim 15, wherein the step of forming video packets includes the steps of:

dividing the coded video frames into a plurality of blocks each having a predetermined length; and

forming video packets each having a predetermined format from the blocks, each of the video packets being formed from a respective one of the blocks.

17. A video communication method according to claim 15, wherein the step of detecting whether any portion of the transmitted coded video frames has been lost in transmission is performed based on a time interval which has elapsed since one of the transmitted video packets was last received in a respective one of the receiving terminals.

18. A video communication method according to claim 15, wherein the video packets include respective sequence information assigned to the video packets;

and

wherein the step of detecting whether any portion of the transmitted coded video frames has been lost in transmission is performed based on the sequence information of ones of the transmitted video packets which have been received in a respective one of the receiving terminals.

19. A video communication method according to claim 13, wherein the refresh request includes information identifying the portion of the transmitted coded video frames which has been lost in transmission;

and

wherein the step of refreshing a current coding sequence includes the steps of;

determining, based on the information identifying the portion of the transmitted coded video frames which has been lost in transmission, a sequence relation between the portion of the transmitted coded video frames which has been lost in transmission and an INTRA frame which was last transmitted to the receiving terminals via the network;

deciding, based on the sequence relation, whether a current coding sequence should be refreshed; and

refreshing, if it is decided that the current coding sequence should be refreshed, the current coding sequence by interrupting the current coding sequence and beginning a new coding sequence, thereby causing a next coded video frame transmitted to the receiving terminals via the network to be an INTRA frame.

20. A receiving terminal for receiving coded video information from a sending terminal via a network, the receiving terminal comprising:

receiving means for receiving, from the network, coded video frames transmitted to the network by the sending terminal, the sending terminal having generated the coded video frames by converting successive video frames into respective ones of the coded video frames according to a coding sequence, the coding sequence being periodically repeated and including a first coding mode wherein an initial video frame of the successive video frames is converted into an INTRA frame representative of only the initial video frame, and a second coding mode wherein remaining video frames of the successive video frames are converted into respective INTER frames each representative of a difference between a respective one of the successive video frames and a preceding one of the successive video frames;

decoding means for decoding the received coded video frames;

detecting means for detecting, based on the received coded video frames, whether any portion of the transmitted coded video frames has been lost in transmission; and

transmitting means for transmitting, to the network, a refresh request requesting the sending terminal to refresh a current coding sequence when the detecting means detects that a portion of the transmitted coded video frames has been lost in transmission, the refresh request causing the sending terminal to refresh a current coding sequence by interrupting the current coding sequence and beginning a new coding sequence, thereby causing a next coded video frame transmitted to the network to be an INTRA frame.

21. A receiving terminal according to claim 20, wherein the refresh request includes information identifying the portion of the transmitted coded video frames which has been lost in transmission.