Declaratively responding to state changes in an interactive multimedia environment

• US 20070006078A1
• Filed: 04/18/2006
• Published: 01/04/2007
• Est. Priority Date: 07/01/2005
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Davis, Jeffrey, Hayes, Sean, Jewsbury, Andrew, Finger, James
• Application Number:
  US11/405,736
• Publication Number:
  US 20070006078A1
• Time in Patent Office: Days
• US Class Current: 715/716
• CPC Class Codes: G06F 16/4393 Multimedia presentations, e.g. slide shows, multimedia albums
• CPC Class Codes: G06F 16/986 Document structures and storage, e.g. HTML extensions
• CPC Class Codes: G06F 40/143 Markup, e.g. Standard Generalized Markup Language [SGML] or Document Type Definition [DTD]
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: G11B 27/322 used signal is digitally coded
• CPC Class Codes: H04N 21/443 OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
• CPC Class Codes: H04N 21/4438 Window management, e.g. event handling following interaction with the user interface
• CPC Class Codes: H04N 21/8543 using a description language, e.g. Multimedia and Hypermedia information coding Expert Group [MHEG], eXtensible Markup Language [XML] information retrieval of semistructured data, the underlying structure being taken into account, e.g. mark-up language structure data G06F16/80

Abstract

Using declarative language application instructions, actions associated with playing interactive content of an interactive multimedia presentation are triggered based on a state change of a particular media object. Certain application instructions specify the characteristic of the media object, while other application instructions specify the actions associated with playing the interactive content (for example, when media objects are renderable, event generation, script execution, or changes in variables) based on a state change of the characteristic. The state change is detected by querying a structured representation of the application such as a document object model, which includes nodes associated with the application instructions, the media object, and/or the characteristic. When state changes are detected, one or more of the specified actions are triggered to thereby declaratively respond to the state change. In an illustrative example, the state changes are tracked using attributes which include foreground, focused, pointer, actioned, enabled, and value.

Claims

1. A method for arranging an application to respond to state changes, the application comprising a markup component and at least one script component and providing one or more graphic elements that are synchronous with a video stream in an interactive multimedia environment, the method comprising the steps of:

in response to an event generated by a user, modifying at least one state attribute of a content element in the markup component;

parsing the markup component to create a document object model (“

DOM”

);

recursively introspecting the DOM to retrieve the at least one state attribute; and

triggering processing responsively to the recursive introspection to thereby respond to the state change.

2. The method of claim 1 in which the recursive introspection is performed using an XPATH query.

3. The method of claim 2 in which time in the interactive media environment is counted using a sequence of ticks and the XPATH query is performed at each tick.

4. The method of claim 1 in which the interactive media environment comprises a high definition DVD environment provided at least in part through use of an optical media selected from one of HD-DVD, Blu-Ray, Enhanced Versatile Disc, Digital Multilayer Disc, Holographic Versatile Disc, Versatile Multilayer Disc.

5. The method of claim 1 in which the at least one state attribute is selected from one of foreground, focused, pointer, actioned, enabled, or value.

6. The method of claim 5 in which each of the at least one state attributes, except value, is a Boolean attribute describable as being either true or false.

7. The method of claim 1 in which values of the state attributes are selected from one of binary values, numeric values, string values and predetermined sets of values.

8. The method of claim 1 in which the DOM is created from one or more XML documents.

9. The method of claim 1 in which the processing comprises consuming the event.

10. The method of claim 1 in which the processing comprises receiving the event by the at least one script component through use of an event listener.

11. The method of claim 1 in which the processing comprises manipulating the interactive multimedia environment through changes in the application'"'"'s focus, Z order, or receipt of user events.

12. A machine-readable medium containing instructions which, when performed by one or more processors disposed in an electronic device, performs a method for handling user events in interactive multimedia environment, the method comprising the steps of:

processing an application in which at least a portion of an application is defined using a declarative description;

creating a runtime context for the application by generating a document object model (“

DOM”

) using the declarative description, the DOM comprising a plurality of state elements and providing an interface to the application to thereby enable modification to the declarative description;

responsively to a user event, modifying one or more state elements among the plurality of state elements in the DOM and delivering the user event to the application through the interface according to the modified state elements.

13. The machine-readable medium of claim 12 in which the modifying of the one of more state elements comprises changing a state attribute of at least one state element in the plurality of state elements.

14. The machine-readable medium of claim 12 further including a step of propagating the user event to a script component of the application through an event element in the DOM.

15. The machine-readable medium of claim 12 in which the instructions comprise first and second instructions, the first instruction specifying an attribute associated with an XML content element and the second instruction comprising an XML timing element.

16. A machine-readable medium including software executed by at least one processor, the software comprising:

a presentation engine arranged for

a) decoding a declarative description of an application running in an interactive multimedia environment to thereby generate a document object model (“

DOM”

) comprising a plurality of nodes, and

b) querying the DOM to retrieve a state attribute from an element disposed in a node in the plurality of nodes;

an input event interface operatively coupled to the presentation engine for receiving an event associated with user interaction; and

a memory interface coupled to the presentation engine for addressing a memory arranged for storing the DOM.

17. The machine-readable medium of claim 16 in which the presentation engine is further arranged for modifying the DOM to reflect changes in the retrieved state attribute.

18. The machine-readable medium of claim 16 in which the query comprises an XPATH query that is performed periodically to examine nodes in the plurality of nodes in the DOM.

19. The machine-readable medium of claim 16 which the presentation engine is further arranged for delivering the received user event to the application in accordance with the retrieved state attribute.

20. The machine-readable medium of claim 16 which the presentation engine is further arranged for delivering the received user event to a content element generated from the decoded declarative description.