Video data scaling for video teleconferencing workstations communicating by digital data network

• US 5,594,495 A
• Filed: 05/22/1995
• Issued: 01/14/1997
• Est. Priority Date: 06/03/1992
• Status: Expired due to Term

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Digital Equipment Corporation (HP Inc.)
• Inventors: Palmer, Larry G., Palmer, Ricky S.
• Primary Examiner(s): Harvey, David E.
• Application Number:
  US08/445,896
• Time in Patent Office: 603 Days
• Field of Search: 345/2, 348/13-19, 348/424, 348/425, 348/427, 348/581, 348/582, 364/514, 370/60, 370/118, 370/62, 370/60.1, 370/94.1, 358/133, 358/135, 358/138, 358/140, 358/141, 358/142, 358/11, 358/12, 358/13, 358/134
• US Class Current: 348/14.12
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: H04N 21/4135 external recorder interface circuits between an apparatus for recording television signals and a television receiver H04N5/775
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/43076 of the same content streams on multiple devices, e.g. when family members are watching the same movie on different devices
• CPC Class Codes: H04N 21/4621 Controlling the complexity of the content stream or additional data, e.g. lowering the resolution or bit-rate of the video stream for a mobile client with a small screen arrangements for using the results of monitoring on user's side in broadcast systems H04H60/65; flow control in packet networks H04L47/10
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/485 End-user interface for client configuration
• CPC Class Codes: H04N 21/6118 involving cable transmission, e.g. using a cable modem
• CPC Class Codes: H04N 21/6168 involving cable transmission, e.g. using a cable modem
• CPC Class Codes: H04N 21/632 using a connection between clients on a wide area network, e.g. setting up a peer-to-peer communication via Internet for retrieving video segments from the hard-disk of other client devices broadcast-related systems characterised by transmission among terminal devices H04H60/80; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/643 Communication protocols network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP], H04L65/65
• CPC Class Codes: H04N 21/64322 IP
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/15 Conference systems

Abstract

A video scaling apparatus and technique for compressing and reconstructing video data sent between multimedia workstations during a video teleconference includes a video data scaling device which scale unscaled video data, having V horizontal lines of H pixels each, to reduce the quantity of horizontal lines and the quantity of pixels along each line. A pixel replication device replicates the received scaled pixels to increase the quantity of horizontal lines to V and the quantity of pixels along each of the horizontal lines to H. The scaling device reduces the quantity of horizontal lines to about V/2, and the quantity of pixels along each horizontal line to about H/2. A received pixel is replicated to replace an adjacent pixel along a line to reconstruct the line. The reconstructed line is replicated to replace an adjacent line. The replicated line is shifted by one pixel relative to the adjacent line from which it was replicated to reduce sharp edges and blockiness.

Claims

1. Video teleconferencing apparatus for a distributed data processing system having a plurality of computer workstations connected by a digital data network, the computer workstations comprising:

a) source means for a local workstation to send frames of scaled video data across the digital data network to a remote workstation, frames of the unscaled video data having V horizontal lines of H pixels each, the source means comprising video data scaling means for scaling the frames of unscaled video data to reduce the quantity of horizontal lines and the quantity of pixels along each of the horizontal lines;

b) packeting means for dividing the scaled video data of each of the frames among plural packets for transmission across the digital data network, the packets containing header information indicating a height and width of the frames contained in the packets and timing information indicating when the frames should be displayed; and

c) receiver means for the local workstation to receive the packets and extract the frames of scaled video data from across the digital data network sent from source means of the remote workstation and display the frames in accordance with the timing information, the receiver means comprising pixel replication means for replicating the pixels of the received scaled video data to increase the quantity of horizontal lines to V and the quantity of pixels along each of the horizontal lines to H.

2. The video teleconferencing apparatus of claim 1, wherein the scaling means reduces the quantity of horizontal lines to about V/2, and the quantity of pixels along each horizontal line to about H/2.

3. The video teleconferencing apparatus of claim 2, wherein the scaling means eliminates every other pixel horizontally and vertically.

4. The video teleconferencing apparatus of claim 2 wherein the scaling means provides a scaled pixel to replace a plurality of pixels of the unscaled video data, wherein each scaled pixel is determined as a function of the plurality of pixels it replaces.

5. The video teleconferencing apparatus of claim 2, wherein a received pixel is replicated horizontally and vertically to reconstruct the horizontal line and an adjacent horizontal line.

6. The video teleconferencing apparatus of claim 5, wherein the replicated pixels are shifted relative to adjacent pixels from which they were replicated.

7. The video teleconferencing apparatus of claim 6, wherein the replicated pixels are shifted by one pixel relative to the adjacent pixels from which they were replicated.

8. A method for compressing and transmitting video teleconferencing data in a distributed data processing system having a plurality of computer workstations connected by a digital data network, comprising the steps of:

a) the source workstation scaling a frame of video data to reduce the quantity of horizontal lines and the quantity of pixels along each of the horizontal lines in the frame;

b) the source workstation dividing the frame of video data among several packets;

c) the source workstation including header information in the packets indicating a height and width of the frame contained in the packets;

d) the source workstation including timing information indicating when the frames should be displayed;

e) the source workstation sending the packets across the digital data network to a remote workstation;

f) the remote workstation receiving the packets of scaled video data from across the digital data network;

g) the remote workstation replicating the pixels of the received scaled video data to increase the quantity of horizontal lines and the quantity of pixels along each of the horizontal lines; and

h) the remote workstation displaying the unscaled frame of video data in response to the timing information.

9. The method of claim 8, wherein the scaling step comprises reducing the quantity of horizontal lines the quantity of pixels along each horizontal line.

10. The method of claim 9, wherein the reducing step comprises eliminating every other pixel along a horizontal line, and eliminating every other horizontal line.

11. The method of claim 9, wherein the reducing step comprises replacing a plurality of pixels of the unscaled video data with a scaled pixel determined as a function of the plurality of pixels it replaces.

12. The method of claim 9, wherein the replicating step comprises replicating a received pixel to replace adjacent pixels horizontally and vertically.

13. The method of claim 12, wherein the replicating step further comprises shifting replicated pixels relative to adjacent pixels.

14. The method of claim 13, wherein replicated horizontal lines are shifted by one pixel relative to the adjacent horizontal lines.

15. A video teleconferencing apparatus, comprising:

a digital data network; and

at least two computer workstations linked via the digital data network, each workstation comprising;

a local video source for generating a video signal;

a frame grabber for generating digitized frames of video data from the video signals and compressing the frames of video data by reducing a number of pixels horizontally and vertically in the frames;

a local audio source for generating digitized audio signals;

a video buffer for storing frames of video data for display; and

a network controller for sending the digitized and compressed frames of video data and the digitized audio signals across the digital data network to other workstations in packets containing header information indicating a height and width of the frames of video data and timing information, and for receiving digitized frames of video data and digitized audio data from other workstations.

16. A video teleconferencing apparatus as described in claim 15, wherein the compression reduces the quantity of horizontal lines by approximately one-half and the quantity of pixels along each of the remaining horizontal lines by approximately one-half.

17. A video teleconferencing apparatus as described in claim 15, wherein the frames of video data are compressed by eliminating pixels horizontally and vertically in the frames of video data.

18. A video teleconferencing apparatus as described in claim 15, wherein pixels contained in the compressed frames of video data are scaled pixels, a value of which are determined in response to adjacent pixels that were decimated in the compression.

19. A video teleconferencing apparatus as described in claim 15, wherein each workstation decompresses frames of video data received across the digital data network by replicating received pixels horizontally and vertically in the frames of video data.

20. A video teleconferencing apparatus as described in claim 19, wherein the horizontal or vertical lines of the decompressed frames of video data are shifted relative to adjacent lines relative to each other.

21. A video teleconferencing apparatus as described in claim 20, wherein the lines are shifted by one pixel.