System for abstracting audio-video codecs

• US 7,634,727 B2
• Filed: 04/26/2005
• Issued: 12/15/2009
• Est. Priority Date: 04/26/2005
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Pickford, David, Steinglass, Barry, Maciesowicz, Maciej, Smith, Derek
• Primary Examiner(s): Hong; Stephen S
• Assistant Examiner(s): Vaughn; Gregory J
• Application Number:
  US11/114,510
• Publication Number:
  US 20060242551A1
• Time in Patent Office: 1,694 Days
• Field of Search: 715/500, 715/500.1, 715/511, 715/515, 715/517, 715/523, 715/526, 715/200, 715/201, 715/229, 715/209, 715/243, 715/249, 715/273
• US Class Current: 715/249
• CPC Class Codes: H04N 19/12 Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
• CPC Class Codes: H04N 19/42 characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation H04N19/635 takes precedence

Abstract

A game system utilizes a codecs abstraction laver (CAL) to allow the game system to accommodate new and/or modified codecs without requiring the game application code to be modified. The CAL, functioning as an application programming interface (API), operates between media sources and the game application. The game application interacts with the CAL and not the codec. Differences between codecs are transparent to the game application. New codecs can be introduced and used by existing applications without modifying the existing application code. The CAL processes media from a variety of sources such as memory, files, http sources, queues, custom sources, external drives, or game media sources (e.g., XMedia). The CAL determines the source of the media, the type of media being received (e.g., audio, video, image, animation, or game), and the codec used to compress the media. The CAL provides the decoded media to the game application.

Claims

1. A method for providing media to a media player, said method comprising:

receiving encoded media from at least one of a plurality of media sources; and

decoding said encoded media using an applications programming interface (API) comprising a plurality of codec libraries wherein each codec library corresponds to each of the plurality of media sources, the API structured to have a class hierarchy comprising a Renderer base class corresponding to a rendering functionality that is common to a plurality of renderer objects derived from said Renderer base class to render disparate media types.

2. A method in accordance with claim 1, further comprising:

formatting said received encoded media in accordance with a predetermined format; and

providing said formatted encoded media for decoding.

3. A method in accordance with claim 1, wherein the Renderer base class comprises a) an audio renderer subclass, b) a video renderer subclass, c) an image renderer subclass and d) a sub renderer subclass, wherein the sub renderer subclass is used for rendering a secondary video stream contained in the encoded media.

4. A method in accordance with claim 1, wherein said encoded media comprises at least one of encoded audio media, encoded video media, encoded image media, encoded animation media, and encoded game media.

5. A method in accordance with claim 1, wherein said media is formatted in accordance with at least one of WAV, MP3, AAC, MP4, WMA, PAC, DPCM, ADPCM, JPEG, TIFF, and BMP.

6. A computer-readable storage medium having stored thereon, an application programming interface (API) for providing media to a media player, said API comprising:

a plurality of decoder objects for receiving formatted media and for respectively decoding said formatted media using at least one of a plurality of codec libraries, wherein each of the plurality of codec libraries corresponds to each of a plurality of media sources;

a plurality of renderer objects for receiving decoded media from respective ones of the plurality of decoder objects and rendering said decoded media for execution in at least one of a plurality of media players; and

a media player control object configured to provide a plurality of control signals for controlling each of the plurality of decoder objects and each of the renderer objects.

7. A computer-readable storage medium in accordance with claim 6, wherein the API is structured to have a class hierarchy comprising a base class that corresponds to a functionality that is common to the plurality of decoder objects.

8. A computer-readable storage medium in accordance with claim 7, wherein the base class comprises at least one subclass.

9. A computer-readable storage medium in accordance with claim 6, wherein said formatted media is provided by a media source comprising at least one of a file, memory, an http source, a queue, a custom source, a network, and a game media source.

10. A computer-readable storage medium in accordance with claim 6, wherein said formatted media comprises at least one of encoded audio media, encoded video media, encoded image media, encoded animation media, and encoded game media.

11. A computer-readable storage medium in accordance with claim 6, wherein said formatted media is formatted in accordance with at least one of WAV, MP3, AAC, MP4, WMA, PAC, DPCM, ADPCM, JPEG, TIFF, and BMP.

12. A computer-readable storage medium in accordance with claim 6, wherein said rendered media comprises at least one of audio media, video media, image media, movie media, and game media.

13. A system for abstracting audio-video codecs, the system comprising:

a media source comprising a codec configured to generate an encoded media signal; and

a computing device coupled to the media source, the computing device containing a computer-readable storage medium having stored thereon at least one application programming interface (API), wherein the at least one API is a codecs abstraction layer (CAL) program that is executed for generating a decoded media signal from the encoded media signal, the CAL program structured to have a class hierarchy comprising a Renderer base class corresponding to a rendering functionality that is common to a plurality of renderer objects, and wherein the Renderer base class comprises a) an audio renderer subclass, b) a video renderer subclass, c) an image renderer subclass and d) a sub renderer subclass, wherein the sub renderer subclass is used for rendering a secondary video stream contained in the encoded media.

14. The system of claim 13, wherein the media source comprises at least one of a file, memory, an http source, a queue, a custom source, a network, and a game media source.

15. The system of claim 13, further comprising a media player coupled to the computing device, the media player configured to receive the decoded media signal from the computing device and generate therefrom, a media player output.

16. The system of claim 13, wherein the CAL further comprises a plurality of codec libraries wherein each of the codec libraries corresponds to each of a plurality of media sources.

17. The system of claim 13, wherein the class hierarchy further comprises a) a Media Info base class, b) a Movie Decoder base class, c) a Movie Player base class, d) a Stream base class, e) a Player base class, and f) a decoder base class.

18. The system of claim 13, wherein the secondary video stream is used for providing closed captioning in a media player coupled to the computing device.