Scripting solution for interactive audio generation

• US 20020161462A1
• Filed: 03/05/2002
• Published: 10/31/2002
• Est. Priority Date: 03/05/2001
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Schmidt, Brian L., Fay, Todor J., Trepte, Forrest P., Yackley, David G.
• Granted Patent: US 7,162,314 B2
• Time in Patent Office: Days
• US Class Current: 700/94
• CPC Class Codes: A63F 13/10 Control of the course of the game, e.g. start, progess, end
• CPC Class Codes: A63F 13/45 Controlling the progress of the video game
• CPC Class Codes: A63F 13/54 involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
• CPC Class Codes: A63F 2300/6018 where the game content is authored by the player, e.g. level editor or by game device at runtime, e.g. level is created from music data on CD
• CPC Class Codes: A63F 2300/6063 for sound processing
• CPC Class Codes: A63F 2300/632 by branching, e.g. choosing one of several possible story developments at a given point in time
• CPC Class Codes: G09B 23/28 for medicine
• CPC Class Codes: G09B 23/30 Anatomical models G09B23/281 - G09B23/288 take precedence
• CPC Class Codes: G09B 23/34 with removable parts
• CPC Class Codes: G10H 1/00 Details of electrophonic musical instruments
• CPC Class Codes: G10H 2210/021 Background music, e.g. for video sequences or elevator music
• CPC Class Codes: G10H 2240/056 MIDI or other note-oriented file format

Abstract

A script file includes a text section that has a text label to designate a point during execution of the script sequence when an audio rendition of a video event is to be initiated. The script file also includes a container that maintains audio content within the script file. The audio content is identified in the container with a content label that corresponds to a text label in the text section. The audio content is initiated to be generated as the audio rendition at the designated point during execution of the script sequence when the script file is executed and when a script processor determines that the content label corresponds to the text label.

Claims

1. A script file, comprising:

a text section that includes a text label to designate a point during execution of a script sequence when an audio rendition of a video event is to be initiated;

a container configured to maintain audio content within the script file, the audio content identified in the container with a content label corresponding to the text label; and

the audio content being auto-referable and generated as the audio rendition at the designated point during execution of the script sequence.

2. A script file as recited in claim 1, wherein the audio content is initiated to be generated as the audio rendition without a reference in the text section to identify a location of the audio content.

3. A script file as recited in claim 1, wherein the audio content is initiated to be generated as the audio rendition without an instruction in the text section to render the audio content.

4. A script file as recited in claim 1, wherein the audio content is generated as the audio rendition when a script processor executes the script file and determines that the content label corresponds to the text label.

5. A script file as recited in claim 1, wherein:

the text section includes a second text label to designate a second point during execution of the script sequence when a second audio rendition is to be initiated;

the container is further configured to maintain a reference to additional audio content, the reference identified in the container with a reference label corresponding to the second text label; and

the additional audio content being auto-referable and generated as the second audio rendition at the designated second point during execution of the script sequence when the script file is executed.

6. A script file as recited in claim 5, wherein the additional audio content is generated as the second audio rendition when a script processor executes the script file and determines that the reference label corresponds to the second text label.

7. A script file as recited in claim 1, wherein:

the text section includes a second text label to designate a second point during execution of the script sequence when a second script is to be executed;

the container is further configured to maintain a reference to the second script, the reference identified in the container with a reference label corresponding to the second text label; and

the second script is executed when a script processor executes the script file and determines that the reference label corresponds to the second script.

8. A script file as recited in claim 1, wherein:

the text section includes at least a second text label to designate a second point during execution of the script sequence when a second audio rendition is to be initiated;

the container is further configured to maintain additional audio content within the script file, the additional audio content identified in the container with a second content label corresponding to the at least second text label;

the audio content is generated as the audio rendition when a script processor executes the script file and determines that the content label corresponds to the text label; and

the additional audio content is generated as the second audio rendition when the script processor executes the script file and determines that the second content label corresponds to the at least second text label.

9. A script file as recited in claim 1, wherein the text section includes an instruction set configured to instantiate one or more audio processing components that are configured to generate an audio rendition corresponding to a video event.

10. A script file as recited in claim 1, wherein the text section includes an instruction set configured to instantiate one or more audio processing components, an individual audio processing component having interface methods that are callable by the script file.

11. A script file as recited in claim 1, wherein the text section includes an instruction set configured to instantiate one or more audio processing components, an individual audio processing component having interface methods that are callable by the script file via an iDispatch interface between the script file and the individual audio processing component.

12. A script file as recited in claim 1, wherein the text section includes an instruction set configured to:

instantiate a performance manager that includes at least one audio segment having one or more audio content components, each audio content component configured to generate audio instructions from the audio content; and

instantiate an audio rendition manager that includes one or more audio rendering components configured to process the audio instructions to render an audio rendition corresponding to the audio content.

13. A script file as recited in claim 12, wherein the performance manager is instantiated when an application program initiates execution of the script file, the performance manager instantiated as a component object having an interface that is callable by the application program.

14. A script file as recited in claim 12, wherein the performance manager is instantiated as a component object having interface methods that are callable by the script file via a translation interface between the script file and the performance manager.

15. A script file as recited in claim 14, wherein the translation interface is an iDispatch application.

16. A script file as recited in claim 12, wherein the audio rendition manager is instantiated when an application program initiates execution of the script file, the audio rendition manager instantiated as a component object having an interface that is callable by the application program.

17. A script file as recited in claim 12, wherein the audio rendition manager is instantiated as a component object having interface methods that are callable by the script file via a translation interface between the script file and the audio rendition manager.

18. A script file as recited in claim 17, wherein the translation interface is an iDispatch application.

19. A script file as recited in claim 12, wherein the text section includes a second instruction set configured to monitor one or more parameters of the audio segment to determine when to input the audio content to the audio segment to render the audio content.

20. A script file as recited in claim 12, wherein the performance manager is instantiated when an application program initiates execution of the script file, and wherein the text section includes a second instruction set configured to monitor one or more parameters of the application program to determine when to input the audio content to the audio segment to render the audio content.

21. A script file as recited in claim 12, wherein the text section includes a second instruction set configured to instantiate a script track as a component of the audio segment, the script track configured to monitor one or more parameters of the audio segment to determine when to input the audio content to the audio segment to render the audio content.

22. A script file as recited in claim 12, wherein the performance manager is instantiated when an application program initiates execution of the script file, and wherein the text section includes a second instruction set configured to instantiate a script track as a component of the audio segment, the script track configured to monitor one or more parameters of the application program to determine when to input the audio content to the audio segment to render the audio content.

24. A script file as recited in claim 23, wherein the audio content is initiated to be generated as the audio rendition without a reference in the text section to identify a location of the audio content.

25. A script file as recited in claim 23, wherein the audio content is initiated to be generated as the audio rendition without an instruction in the text section to render the audio content.

26. A script file as recited in claim 23, wherein the audio content is generated as the audio rendition when a script processor executes the script file and determines that the reference label corresponds to the text label.

30. A script track as recited in claim 29, wherein the audio content is input to the audio segment without a reference in the text section to identify a location of the audio content.

31. A script track as recited in claim 29, wherein the audio content is input to the audio segment when a script processor determines that the content label corresponds to the text label.

32. A script track as recited in claim 29, wherein:

the text section includes a reference text label to designate when additional audio content is to be rendered;

the container is further configured to maintain a reference to the additional audio content, the reference identified with a reference label corresponding to the second text label; and

the additional audio content being auto-referable and input to the audio segment when the script file is executed.

33. A script track as recited in claim 32, wherein the additional audio content is input to the audio segment when a script processor determines that the reference label corresponds to the reference text label.

35. A script file as recited in claim 34, wherein the performance manager and the audio rendition manager are instantiated when an application program initiates execution of the script file, the performance manager instantiated as a component object having an interface that is callable by the application program, and the audio rendition manager instantiated as a component object having an interface that is callable by the application program.

36. A script file as recited in claim 34, wherein the performance manager is instantiated as a component object having interface methods that are callable by the script file via a translation interface between the script file and the performance manager, and wherein the audio rendition manager is instantiated as a component object having interface methods that are callable by the script file via the translation interface between the script file and the audio rendition manager.

37. A script file as recited in claim 34, further comprising at least a third instruction set configured to determine when to input the audio content to the audio segment to generate the audio rendition.

38. A script file as recited in claim 34, further comprising at least a third instruction set configured to instantiate a script track as a component of the audio segment, the script track configured to monitor one or more parameters of the audio segment to determine when to input the audio content to the audio segment to generate the audio rendition.

39. A script file as recited in claim 34, wherein the performance manager and the audio rendition manager are instantiated when an application program initiates execution of the script file, and wherein the text section includes at least a third instruction set configured to instantiate a script track as a component of the audio segment, the script track configured to monitor one or more parameters of the application program to determine when to input the audio content to the audio segment to generate the audio rendition.

40. A script file as recited in claim 34, further comprising:

a text section that includes the first instruction set and the second instruction set, and further includes a text label to designate when to input the audio content to the audio segment;

a container configured to maintain the audio content within the script file, the audio content identified with a content label corresponding to the text label; and

the audio content being auto-referable and input to the audio segment when the script file is executed.

41. A script file as recited in claim 40, wherein the audio content is input to the audio segment when a script processor executes the script file and determines that the content label corresponds to the text label.

42. A script file as recited in claim 34, further comprising:

a text section that includes the first instruction set and the second instruction set, and further includes a text label to designate when to input the audio content to the audio segment;

a container configured to maintain a reference to the audio content, the reference identified with a reference label corresponding to the second text label; and

the audio content being auto-referable and input to the audio segment when the script file is executed.

43. A script file as recited in claim 42, wherein the audio content is input to the audio segment when a script processor executes the script file and determines that the reference label corresponds to the second text label.

23. A script file, comprising:

a text section that includes a text label to designate a point during execution of a script sequence when an audio rendition of a video event is to be initiated;

a container configured to maintain a reference to audio content, the reference identified in the container with a reference label corresponding to the text label; and

the audio content being auto-referable and generated as the audio rendition at the designated point during execution of the script sequence.

27. A script track implemented as a component of an audio segment which is instantiated to represent audio content, the script track configured to monitor one or more parameters of the audio segment to determine when to initiate execution of one or more script files.

28. A script track implemented as a component of an audio segment which is instantiated to represent audio content, the script track configured to monitor one or more parameters of the audio segment to determine when to initiate execution of one or more script files, a script file comprising:

a text section that includes a text label to designate when the audio content is to be rendered;

a container configured to maintain the audio content, the audio content identified with a content label corresponding to the text label; and

the audio content being auto-referable and input to the audio segment when the script file is executed.

29. A script track implemented as a component of an audio segment which is instantiated to represent audio content, the script track comprising one or more script files, a script file including:

a text section that includes a text label to designate when the audio content is to be rendered;

a container configured to maintain the audio content, the audio content identified with a content label corresponding to the text label; and

the audio content being auto-referable and input to the audio segment when the script file is executed.

34. A script file, comprising:

a first instruction set configured to instantiate a performance manager that includes at least one audio segment having one or more audio content components, each audio content component configured to generate audio instructions from received audio content; and

a second instruction set configured to instantiate an audio rendition manager that includes one or more audio rendering components configured to process the audio instructions to generate an audio rendition corresponding to the audio content.

44. A method for managing audio generation with a script file, comprising:

instantiating a performance manager that includes at least one audio segment having one or more audio content components, each audio content component generating audio instructions from received audio content; and

instantiating an audio rendition manager that includes one or more audio rendering components for processing the audio instructions to generate an audio rendition corresponding to the audio content.

45. A method for managing audio generation as recited in claim 44, wherein instantiating the performance manager is in response to an application program initiating execution of the script file.

46. A method for managing audio generation as recited in claim 45, wherein the performance manager is instantiated as a component object having an interface that is callable by the application program.

47. A method for managing audio generation as recited in claim 44, wherein the performance manager is instantiated as a component object having interface methods that are callable by the script file via a translation interface between the script file and the performance manager.

48. A method for managing audio generation as recited in claim 47, wherein the translation interface is an iDispatch application.

49. A method for managing audio generation as recited in claim 44, wherein instantiating the audio rendition manager is in response to an application program initiating execution of the script file.

50. A method for managing audio generation as recited in claim 49, wherein the audio rendition manager is instantiated as a component object having an interface that is callable by the application program.

51. A method for managing audio generation as recited in claim 44, wherein the audio rendition manager is instantiated as a component object having interface methods that are callable by the script file via a translation interface between the script file and the audio rendition manager.

52. A method for managing audio generation as recited in claim 51, wherein the translation interface is an iDispatch application.

53. A method for managing audio generation as recited in claim 44, wherein instantiating the performance manager is in response to an application program initiating execution of the script file, and the method further comprising monitoring one or more parameters of the application program to determine when to input the audio content to the audio segment.

54. A method for managing audio generation as recited in claim 44, further comprising monitoring one or more parameters of the audio segment to determine when to input the audio content to the audio segment.

55. A method for managing audio generation as recited in claim 44, further comprising instantiating a script track as a component of the audio segment, the script track monitoring one or more parameters of the audio segment to determine when to input the audio content to the audio segment.

56. A method for managing audio generation as recited in claim 44, wherein instantiating the performance manager is in response to an application program initiating execution of the script file, and the method further comprising instantiating a script track as a component of the audio segment, the script track monitoring one or more parameters of the application program to determine when to input the audio content to the audio segment.

57. One or more computer-readable media comprising computer-executable instructions that, when executed, direct a computing system to perform the method of claim 44.

58. One or more computer-readable media comprising computer-executable instructions that, when executed, direct a computing system to perform the method of claim 47.

59. One or more computer-readable media comprising computer-executable instructions that, when executed, direct a computing system to perform the method of claim 51.

60. One or more computer-readable media comprising computer-executable instructions that, when executed, direct a computing system to perform the method of claim 55.

61. One or more computer-readable media comprising computer executable instructions that, when executed, direct a computing system to perform a method comprising:

executing a multimedia application;

rendering a video event of the multimedia application;

receiving a request from the multimedia application to create an audio generation system to generate an audio rendition corresponding to the video event;

in response to receiving the request, executing a script file to create the audio generation system, the script file comprising computer executable instructions that further direct the computing system to perform;

instantiating a performance manager that includes at least one audio segment having one or more audio content components, each audio content component generating audio instructions from received audio content; and

instantiating an audio rendition manager that includes one or more audio rendering components for processing the audio instructions to generate the audio rendition.

62. One or more computer-readable media as recited in claim 61, wherein the performance manager is instantiated as a component object having an interface that is callable by the interactive video program.

63. One or more computer-readable media as recited in claim 61, wherein the performance manager is instantiated as a component object having interface methods that are callable by the script file via a translation interface between the script file and the performance manager.

64. One or more computer-readable media as recited in claim 61, wherein the audio rendition manager is instantiated as a component object having an interface that is callable by the interactive video program.

65. One or more computer-readable media as recited in claim 61, wherein the audio rendition manager is instantiated as a component object having interface methods that are callable by the script file via a translation interface between the script file and the audio rendition manager.

66. One or more computer-readable media as recited in claim 61, wherein the script file further comprises computer executable instructions that further direct the computing system to perform instantiating a script track as a component of the audio segment, the script track monitoring one or more parameters of the audio segment to determine when to input the received audio content to the audio segment.

67. One or more computer-readable media as recited in claim 61, wherein the script file further comprises computer executable instructions that further direct the computing system to perform instantiating a script track as a component of the audio segment, the script track monitoring one or more parameters of the interactive video program to determine when to input the received audio content to the audio segment.