Video teleconferencing for networked workstations

• US 6,195,683 B1
• Filed: 02/12/1997
• Issued: 02/27/2001
• Est. Priority Date: 06/03/1992
• Status: Expired due to Fees

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Compaq Computer Corporation (HP Inc.)
• Inventors: Palmer, Larry G., Palmer, Ricky S.
• Primary Examiner(s): Peeso, Thomas R.
• Application Number:
  US08/799,782
• Time in Patent Office: 1,476 Days
• Field of Search: 395/200.34, 395/300.38, 395/200.41, 395/200.57, 395/200.61, 395/200.68, 345/330, 345/327, 709/204, 709/218, 709/219, 709/223, 709/227
• US Class Current: 709/204
• CPC Class Codes: H04N 21/4135 external recorder interface circuits between an apparatus for recording television signals and a television receiver H04N5/775
• CPC Class Codes: H04N 21/4143 embedded in a Personal Computer [PC]
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/43072 of multiple content streams on the same device
• CPC Class Codes: H04N 21/4621 Controlling the complexity of the content stream or additional data, e.g. lowering the resolution or bit-rate of the video stream for a mobile client with a small screen arrangements for using the results of monitoring on user's side in broadcast systems H04H60/65; flow control in packet networks H04L47/10
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/485 End-user interface for client configuration
• CPC Class Codes: H04N 21/6118 involving cable transmission, e.g. using a cable modem
• CPC Class Codes: H04N 21/6168 involving cable transmission, e.g. using a cable modem
• CPC Class Codes: H04N 21/643 Communication protocols network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP], H04L65/65
• CPC Class Codes: H04N 21/64322 IP
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

A video teleconferencing method and apparatus for computer workstations connected by a digital data network includes a transmission source means for a local workstation to send audio and video teleconference data across the network to one or more remote workstations, and, a receiver for the local workstation to receive audio and video teleconference data back from the remote workstations. The local workstation sends teleconference data to each of the remote workstations over a variable bandwidth digital data connection, and each of the remote workstations returns teleconference data back to the local workstation over another variable bandwidth digital data connection. The transmission source means includes a master software process executing on the local workstation, and the receiver includes a slave software process executing the remote workstation. The master process of a local workstation causes execution of a slave process on a remote workstation for receiving video teleconference data from the local workstation. An audio data transmitter for sends an audio data stream to the remote workstation such that the audio data can be reconstructed into a continuous audio signal. A video transmitter sends video data so that each frame of video data to be sent is inserted into the audio data stream without affecting the continuity of the reconstructed audio signal at the remote workstation.

Claims

1. Video teleconferencing apparatus for a distributed data processing system having a plurality of computer workstations connected by a digital data network, the computer workstations comprising:

a) source means for a local workstation to send audio and video data across the digital data network as digital data packets to a remote workstation;

b) receiver means for the local workstation to receive audio and video data from across the digital data network as digital data packets sent from source means of the remote workstation;

wherein the source means of the local workstation sends audio and video data to the receiver means of the remote workstation over one variable bandwidth digital data connection, and the source means of the remote workstation sends audio and video data to the receiver means of the local workstation over another variable bandwidth digital data connection.

2. A method for transmitting audio and video teleconferencing data between computers over a computer network, the method comprising:

transmitting audio data and frames of video data to remote computers via the computer network;

detecting acknowledgment signals from the remote computers indicating that the remote computers received the frames of video data; and

transmitting new frames of video data to the remote computers in response to the receipt of the acknowledgement signals.

3. The method described in claim 2, further comprising precluding transmission of the new frames of video data to the remote computers in response to a system overload condition.

4. The method described in claim 3, further comprising sending a portion of the audio data corresponding in time to the precluded frame of video data to the remote computer to prevent loss of continuity of an audio signal reconstructed by the remote computer during the system overload condition.

5. The method described in claim 3, further comprising determining an existence of a system overload condition in response to an elapsed time between sending a frame of video data to the remote computer and receiving an acknowledgement signal for that frame of video data from the remote computer.

6. The method described in claim 3, further comprising:

sending any audio data accumulated since the last video frame was sent to the remote computer upon receipt of the acknowledgement signal from the remote computer for the last video frame; and

sending the most recently available frame of video data to the remote computer and dropping any other intervening frames of video data which became available during the overload condition.

7. The method described in claim 2, further comprising:

sending to the remote computer any audio data accumulated since the last video frame was sent to the remote workstation, when another video frame becomes available if no overload condition exists; and

sending the most recently available frame of video data from the local workstation to the remote workstation if no overload condition exists.

8. The method described in claim 2, further comprising attaching timing information to each frame of video data sent to the remote computer to indicate a point in the continuous audio data stream which corresponds in time to the frame of video data.

9. The method described in claim 8, further comprising displaying a received frame of video when the point in the audio stream corresponding to the timing information of the received video frame is audibly reproduced at the remote computer.

10. The method described in claim 9, further comprising:

generating timing information by counting the amount of audio data received; and

comparing the generated timing information with the timing information sent along with the most recently received video frame to determine when to display the most recently received frame of video data.

11. A method for maintaining an audio and video teleconference between computers over a computer network, the method comprising:

generating audio data representative of an audio input to the computer;

packetizing the audio data according to a protocol of the computer network and transmitting the packets to another computer over the network;

generating frames of video data representative of a video input to the computer;

packetizing the video data according to the protocol of the computer network and transmitting the packets to the other computer over the network; and

transmitting timing information to the other computer that correlates the frames of video data to the audio data in time enabling the other computer to display the frames of video data when the corresponding portion of the audio data is reproduced.

12. The method described in claim 11, further comprising precluding transmission of the new frames of video data to the remote computer in response to a failure of the remote computer to acknowledge receipt of previously sent frames of video data.

13. The method described in claim 11, further comprising attaching the timing information to the frames of video data sent to the other computer.

14. The method described in claim 11, further comprising the other computer displaying a received frame of video when the point in the audio stream corresponding to the timing information of the received frame of video data is audibly reproduced.

15. The method described in claim 11, further comprising:

generating timing information by counting the amount of audio data received; and

comparing the generated timing information with the timing information sent along with the most recently received video frame to determine when to display the most recently received frame of video data.