Object-oriented audio record/playback system

• US 5,544,297 A
• Filed: 12/13/1995
• Issued: 08/06/1996
• Est. Priority Date: 09/13/1993
• Status: Expired due to Term

• Current Assignee: Apple Inc.
• Original Assignee: Taligent, Inc. (HP Inc.)
• Inventors: Edelman, Bradley A., Tobias, John C. II, Milne, Steven H., Dilts, Michael R., Tindell, James M.
• Primary Examiner(s): Zimmerman, Mark K.
• Assistant Examiner(s): BUCHEL JR, RUDOLPH JOHN
• Application Number:
  US08/572,351
• Time in Patent Office: 237 Days
• Field of Search: 395/155.6, 395/161.2
• US Class Current: 715/201
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 8/24 Object-oriented

Abstract

A technique for providing routing of various multimedia events throughout the course of a multimedia presentation using a computer with a storage and a display. A processor with an attached display, storage and multimedia device builds a component object in the storage of the processor for managing the multimedia device including at least one port for exchanging multimedia information. The processor includes a connection object for connecting the at least one port to the multimedia device to facilitate the exchange of multimedia information and the processor routes information between the multimedia device and the component object port. A list of component objects are stored in the storage and current status for each of the components in the list is also stored. Then, when a multimedia player is invoked, a test is performed on each of the components in the list, and their associated multimedia devices, to determine what aspects of the multimedia presentation can be run.

Claims

1. In a memory of a computer system, a multimedia application framework for creating a multimedia application which processes multimedia data in response to a request, the application framework comprising:

a subclassable media component base class for deriving media component classes used to instantiate media component objects wherein the subclassable media component base class includes data defining an input port and data defining an output port;

means responsive to the media component base class for instantiating a plurality of media component objects;

means for connecting the plurality of media component objects into a topology of media component objects wherein the connecting means connects the input ports and the output ports of the plurality of media component objects;

means, responsive to the multimedia data, for iterating through the topology to identify media component objects which am ready for execution and for placing the media component objects that are ready for execution on a run list wherein the means for iterating through the topology includes means for simulating data flow through the topology to identify media component objects which are ready for execution without requiring any of the plurality of media component objects to process media data; and

means responsive to the request for executing the media component objects on the run list.

2. The framework of claim 1 wherein the connecting means includes a subclass of a media component class, the subclass being used to instantiate a surrogate input port object and a surrogate output port object from an input port and an output port of a media component object, and wherein each of the plurality of media component objects includes means for instantiating a surrogate input port object and a surrogate output port object.

3. The framework of claim 2 wherein the connecting means further comprises:

means for causing a first media component object to create a surrogate output port object of an output port of the first media component object;

means for causing a second media component object to create a surrogate input port object of an input port of the second media component object;

means for providing the surrogate input port object to the first media component object;

and wherein the first media component object includes means for receiving the surrogate input port object to form a connection between the first and second media component objects.

4. The framework of claim 1 further comprising:

a client subclass of the media component class;

a processor subclass of the media component class; and

means for instantiating the processor subclass to create processor objects that reside within the executing means.

5. The framework of claim 4 wherein the executing means is implemented as a single task to centralize the processing of the processor objects.

6. The framework of claim 1 wherein the means for simulating data flow includes:

means for activating a first media component object that has media data at an input port and has an output port connected to a second media component object;

means for firing the output port of the activated first media component object to simulate data flow on the output port;

means responsive to simulated data flow on the output port for identifying the second media component object;

means responsive to an identification of the second media component object for recording that the first media component object is ready for execution; and

means for repeatedly invoking the means for activating and the means for firing to iterate through the topology to identify media component objects in the topology which are ready for execution.

7. The framework of claim 6 further including means for deactivating a media component object that is not ready for execution.

8. The framework of claim 1 further comprising a set of standard media component classes to facilitate application development.

9. The framework of claim 8 wherein the set of standard media component classes includes at least one of the following:

an audio player class to allow instantiation of objects to play and record media data;

a speaker class to allow instantiation of objects to allow playback of media data;

a microphone class to allow instantiation of objects to allow input of media data;

a mixer class to allow instantiation of objects to sum media data from at least two media component objects;

a splitter class to allow instantiation of objects to split one media data input into at least two media data outputs;

a gain class to allow instantiation of objects to modify the amplitude of a signal associated with the media data;

an echo class to allow instantiation of objects to add an echo to a signal associated with the media data;

a fuzz class to allow instantiation of objects to add distortion to a signal associated with the media data; and

an audio type converter class to allow instantiation of objects to convert media data of a first type to media data of a second type.

10. A method of creating a multimedia application from a multimedia framework in a memory of a computer system, the framework having a media component class, the method comprising the steps of:

(a) instantiating a plurality of media component objects from the media component class, including creating input port and an output port in each of the plurality of media component objects for connecting media component objects together;

(b) connecting the media component objects into a topology of media component objects; and

(c) connecting the topology to a server for iterating through the topology to identify media component objects which are ready for execution, in response to multimedia data during subsequent execution of the multimedia application including simulating data flow through the topology to identify media component objects which are in a state ready for execution without requiring any of the plurality of media component objects to process media data.

11. The method of claim 10 wherein step (b) includes

(b1) deriving a subclass from the media component class;

(b2) instantiating surrogate objects of the input port and the output port of each of the plurality of media component objects from the subclass derived in step (b1).

12. The method of claim 10 wherein each of the plurality of media component objects includes a client object and a processor object and wherein step (a) comprises the steps of:

(a2) instantiating client objects; and

(a3) instantiating processor objects to reside in a common area with the executing mechanism.

13. The method of claim 12 wherein step (c) comprises the steps of:

(c1) connecting the topology to the server to execute the plurality of media component objects as a single task to centralize processing of processor objects.

14. The method of claim 10 wherein step (c) comprises the steps of:

(c2.1) activating a first media component object that has media data at its input port and has its output port connected to a second media component object;

(c2.2) firing the output port of the first media component object to simulate data flow on the output port;

(c2.3) identifying the second media component object;

(c2.4) recording that the first media component object is in a state ready for execution; and

(c2.5) invoking steps (c2.1) through (c2.4), inclusive, for each of the plurality of media component objects to iterate through the topology to determine media component objects in the topology which are in a state ready for execution.

15. The method of claim 14 further including the step of:

(d) deactivating one of the plurality of media component objects that is not in a state ready for execution.