System and method for generation and interfacing of bitstreams representing MPEG-coded audiovisual objects

• US 6,044,397 A
• Filed: 04/07/1998
• Issued: 03/28/2000
• Est. Priority Date: 04/07/1997
• Status: Expired due to Term

• Current Assignee: AT&T Corporation (AT&T, Inc.), Columbia University
• Original Assignee: AT&T Corporation (AT&T, Inc.), Columbia University
• Inventors: Eleftheriadis, Alexandros, Puri, Atul, Schmidt, Robert Lewis, Fang, Yihan
• Primary Examiner(s): Miller, John W.
• Application Number:
  US09/055,929
• Time in Patent Office: 721 Days
• Field of Search: 709/217-219, 345/327, 348/6, 348/7, 348/10, 348/12, 348/13, 348/725-728, 455/3.1-6.3, 370/536, 370/542
• US Class Current: 725/139
• CPC Class Codes: H04N 19/25 with scene description coding, e.g. binary format for scenes [BIFS] compression
• CPC Class Codes: H04N 19/27 involving both synthetic and natural picture components, e.g. synthetic natural hybrid coding [SNHC]
• CPC Class Codes: H04N 21/23412 for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects
• CPC Class Codes: H04N 21/44012 involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
• CPC Class Codes: H04N 21/4431 characterized by the use of Application Program Interface [API] libraries
• CPC Class Codes: H04N 21/47205 for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
• CPC Class Codes: H04N 7/52 Systems for transmission of a pulse code modulated video signal with one or more other pulse code modulated signals, e.g. an audio signal or a synchronizing signal assembling of a multiplex stream by combining a video stream with other content or additional data, remultiplexing of multiplex streams, insertion of stuffing bits into the multiplex stream, assembling of a packetised elementary stream at server side H04N21/236; disassembling of a multiplex stream, remultiplexing of multiplex streams, extraction or processing of Service Information, disassembling of packetised elementary stream at client side H04N21/434

Abstract

The invention provides a standardized interface facility for MPEG-4 authoring, bitstream manipulation, editing and interpretation, with associated tools and interfaces to, resulting in coded bitstreams which are easier to test, check and debug while conforming to the MPEG-4 standard. The specified interfaces can also facilitate graceful degradation in the face of decreased resources by allowing editing of bitstreams. The specified interfaces can also allow creation of decodable bitstreams in response to the user requests either directly or indirectly embedded in audiovisual applications, as well as future services. The invention specifies a bitstream input/output package in the Java programming language to facilitates bitstream encoding and decoding of audio-visual media objects, especially when coding uses the MPEG-4 standard. The invention separates fixed length and variable length coding, and allows flexible parsing which offers the potential of optimized implementation as needed to aid real-time or near real-time operation.

Claims

1. A system for processing streaming audiovisual objects coded according to the MPEG-4 standard, comprising:

a streaming interface library containing a predetermined set of streaming control functions processing audiovisual objects, each of the control functions having predefined function calls; and

a processor, configured to access the streaming interface library, and to decode and process streamed audiovisual objects according to the function calls.

2. The system of claim 1, wherein the processor unit executes a client application invoking the function calls.

3. The system of claim 1, further comprising a user input unit, the user input unit communicating with the processor unit and invoking selected function calls.

4. The system of claim 1, wherein the interface library comprises a visual decoding interface to decode visual objects in audiovisual bitstreams.

5. The system of claim 1, wherein the streaming interface library comprises a generation function for generating and outputting audiovisual data streams.

6. The system of claim 1, wherein the streaming interface library comprises an editing function for editing and manipulating audiovisual bitstreams.

7. The system of claim 1, wherein the streaming interface library comprises an interpreting function for interpreting audiovisual bitstreams.

8. The system of claim 1, wherein the processor unit adapts the execution of the bitstream interface library according to varying system resources.

9. The system of claim 1, further comprising a client application interface, the client application interface invoking additional bitstream functions presented by cooperating client applications.

10. The system of claim 1, further comprising a multimedia browser module employing the bitstream interface library for user viewing.

11. A method for processing streaming audiovisual objects coded according to the MPEG-4 standard, comprising:

presenting a streaming interface library containing a predetermined set of streaming control functions processing audiovisual objects, each of the control functions having predefined function calls; and

processing calls to the streaming interface library to decode and process streamed audiovisual objects according to the function calls.

12. The method of claim 11, wherein the step of processing comprises the step of executing a client application invoking the function calls.

13. The method of claim 11, further comprising the step of receiving user input, the user input invoking selected function calls.

14. The method of claim 11, wherein the streaming interface library comprises a visual decoding interface to decode visual objects contained in audiovisual bitstreams.

15. The method of claim 11, wherein the streaming interface library comprises a generation function for generating and outputting audiovisual data streams.

16. The method of claim 11, wherein the streaming interface library comprises an editing function for editing and manipulating audiovisual bitstreams.

17. The method of claim 11, wherein the streaming interface library comprises an interpreting function for interpreting audiovisual bitstreams.

18. The method of claim 11, wherein the step of processing comprises the step of adapting the execution of the bitstream interface library according to varying system resources.

19. The method of claim 11, further comprising the step of providing a client application interface, the client application interface invoking additional bitstream functions presented by cooperating client applications.

20. The method of claim 11, further comprising the step of providing a multimedia browser module employing the bitstream interface library for user viewing.