Video mixing technique using JPEG compressed data

• US 5,257,113 A
• Filed: 09/20/1991
• Issued: 10/26/1993
• Est. Priority Date: 09/20/1991
• Status: Expired due to Term

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Shae, Zon-Yin, Chen, Mon-Song
• Primary Examiner(s): Coles, Sr., Edward L.
• Assistant Examiner(s): Grant, II, Jerome
• Application Number:
  US07/763,103
• Time in Patent Office: 767 Days
• Field of Search: 358/426, 358/427, 358/261.1, 358/261.2, 358/261.3, 358/261, 358/262, 358/428, 358/432, 358/433, 340/721 B, 340/721 C1, 340/721 C2, 340/721 C3
• US Class Current: 382/235
• CPC Class Codes: G09G 2340/02 Handling of images in compressed format, e.g. JPEG, MPEG
• CPC Class Codes: G09G 2340/125 wherein one of the images is motion video
• CPC Class Codes: G09G 5/14 Display of multiple viewports
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/126 Details of normalisation or weighting functions, e.g. normalisation matrices or variable uniform quantisers
• CPC Class Codes: H04N 19/48 using compressed domain processing techniques other than decoding, e.g. modification of transform coefficients, variable length coding [VLC] data or run-length data motion estimation in a transform domain H04N19/547; processing of decoded motion vectors H04N19/513
• CPC Class Codes: H04N 19/60 using transform coding
• CPC Class Codes: H04N 19/90 using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals

Abstract

An apparatus and method for displaying a plurality of windows on a display screen. With this invention, a stream of image data for each window is divided into coding intervals, and each coding intervals is then compressed and mixed. The mixed compressed data is then decompressed for ultimate display on a display screen.

Claims

1. A method of displaying a plurality of video windows, on a display screen, with each video window being generated from a corresponding stream of image data from a unique data source, said method comprising:

(a) dividing each said stream of image data into coding intervals, each of said coding intervals having image data for a corresponding portion of a corresponding one of said windows, with each window being generated from a unique source;

(b) compressing each of said coding intervals of image data so as to produce a first set of compressed data for each of said coding intervals;

(c) mixing each said first set of compressed data generated from multiple sources to generate at least one second set of compressed data for each said corresponding portion to be displayed on said display screen; and

(d) decompressing each second set of data to generate pixel data for each said corresponding portion to be displayed on said display screen.

2. A method as recited in claim 1, wherein in each of said streams, coding intervals are separated from each other by delimiters.

3. A method as recited in claim 1, wherein compressing each of said coding intervals of image data comprises transforming each of said coding intervals of image data with a discrete cosine transform so as to produce a set of coefficients for each of said coding intervals.

4. A method as recited in claim 1, further comprising:

filtering each said first set of compressed data prior to mixing each said first set of compressed data, each said first set being filtered by using a filtering table for each of said windows, each said filtering table having an entry for each said portion of one of said windows, each said entry indicating from which said stream of image data a corresponding said first set of compressed data is to be decompressed for display on said display screen.

5. A method as recited in claim 1, wherein each said first set of compressed data is mixed by using a overlay table having an entry for each screen position displayed on said screen, with each said entry indicating which coding interval of said coding intervals and which stream of said streams is to be decompressed for a corresponding screen position.

6. An apparatus for displaying a plurality of video windows on a display screen, with each video window being generated from a corresponding stream of image data from a unique data source, said apparatus comprising:

(a) means for dividing each said stream of image data into coding intervals, each of said coding intervals having image data for a corresponding portion of a corresponding one of said windows, with each window being generated from a unique source;

(b) means for corresponding each of said coding intervals of image data so as to produce a first set of compressed data for each of said coding intervals;

(c) means for mixing each said first set of compressed data to generated at least one second set of compressed data generated from multiple sources for each said corresponding portion to be displayed on said display screen; and

(d) means for decompressing each second set of data to generate pixel data for each said corresponding portion to be displayed on said display screen.

7. A method of displaying a plurality of video windows, on a display screen, with each video window being generated from a corresponding stream of image data from a unique data source, said method comprising:

(a) dividing each said stream of image data into coding intervals, each of said coding intervals having image data for a corresponding portion of a corresponding one of said windows, with each window being generated from a unique source;

(b) compressing each of said coding intervals of image data so as to produce a first set of compressed data for each of said coding intervals;

(c) filtering each said first set of compressed data prior to mixing each said first set of compressed data, each said first set being filtered by using a filtering table for each of said portion of one of said windows, each said entry indicating from which said stream of image data a corresponding said first set of compressed data is to be decompressed for display on said display screen;

(d) mixing each said first set of compressed data generated from multiple sources to generated at least one second set of compressed data for each said corresponding portion to be displayed on said display screen; and

(e) decompressing each second set of data to generated pixel data for each said corresponding portion to be displayed on said display screen.

8. A method as recited in claim 7, wherein each said first set of compressed data is mixed by using a overlay table having an entry for each screen position displayed on said screen, with each said entry indicating which coding interval of said coding intervals and which stream of said streams is to be decompressed for a corresponding screen position.