Using Cinematographic Techniques for Conveying and Interacting with Plan Sagas

• US 20120151348A1
• Filed: 12/11/2010
• Published: 06/14/2012
• Est. Priority Date: 12/11/2010
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Mital, Vijay, Murillo, Oscar E., Rubin, Darryl E., Estrada, Colleen G.
• Application Number:
  US12/965,861
• Publication Number:
  US 20120151348A1
• Time in Patent Office: Days
• US Class Current: 715/727
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: H04N 21/47205 for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
• CPC Class Codes: H04N 21/8541 involving branching, e.g. to different story endings

Abstract

The subject disclosure is directed towards obtaining a linear narrative synthesized from a set of objects, such as objects corresponding to a plan, and using cinematographic and other effects to convey additional information with that linear narrative when presented to a user. A user interacts with data from which the linear narrative is synthesized, such as to add transition effects between objects, change the lighting, focus, size (zoom), pan and so forth to emphasize or de-emphasize an object, and/or to highlight a relationship between objects. A user instruction may correspond to a theme (e.g., style or mood), with the effects, possibly including audio, selected based upon that theme.

Claims

1. In a computing environment, a system, comprising:

a content synthesizer configured to process data including at least two content objects into a synthesized linear narrative for presentation; and

an interaction mechanism configured to change at least some of the data into modified data based upon one or more instructions, and to have the content synthesizer re-synthesize the modified data into a re-synthesized linear narrative for presentation.

2. The system of claim 1 wherein the interaction mechanism changes the data into the modified data by using at least one transition effect between two objects presented sequentially in the re-synthesized linear narrative.

3. The system of claim 1 wherein the interaction mechanism changes the data into the modified data by using at least one lighting effect to change the appearance of at least one object or part of an object that is presented in the re-synthesized linear narrative.

4. The system of claim 1 wherein the interaction mechanism changes the data into the modified data by using a focus effect, a zoom effect, a pan effect or a truck effect to change the appearance of at least one object or part of an object that is presented in the re-synthesized linear narrative.

5. The system of claim 1 wherein the interaction mechanism changes the data into the modified data by adding, deleting or replacing audio that is presented in combination with at least one other object.

6. The system of claim 1 wherein the interaction mechanism changes the data into the modified data by adding, deleting or replacing text that is presented in combination with at least one other object.

7. The system of claim 1 wherein the one or more instructions correspond to a theme, and wherein the interaction mechanism changes the data into the modified data by choosing at least two effects based upon the theme.

8. The system of claim 1 wherein the interaction mechanism communicates with the content synthesizer to provide an indication of at least one interaction point in the narrative to indicate that a user may interact to change the data.

9. The system of claim 1 wherein the objects comprise a set of plan objects, and wherein the interaction mechanism modifies the data into modified data by changing at least one object in the set of plan objects.

10. In a computing environment, a method performed at least in part on at least one processor, comprising:

generating a plan comprising plan objects based on rules, constraints and equations associated with a model;

synthesizing data including the plan objects into a linear narrative;

playing the linear narrative in an initial playback;

obtaining one or more instructions instruction directed towards the data, including at least one instruction corresponding to a cinematographic technique;

changing the data into modified data based upon the one or more instructions;

re-synthesizing the modified data into a re-synthesized linear narrative; and

playing the re-synthesized linear narrative in a subsequent playback.

11. The method of claim 10 wherein changing the data comprises using at least one transition effect between two objects presented sequentially in the re-synthesized linear narrative.

12. The method of claim 10 wherein changing the data comprises using a lighting effect, a focus effect, a zoom effect, a pan effect, a flashback effect, a change of pace effect, a truck effect, or the like, or any combination of a lighting effect, a focus effect, a zoom effect, a pan effect, a flashback effect, a change of pace effect, a truck effect, or the like.

13. The method of claim 10 wherein changing the data comprises adding, deleting or replacing audio or text, or both audio and text, that is presented in combination with at least one other object.

14. The method of claim 10 wherein the one or more instructions correspond to a theme, and wherein changing the data comprises choosing at least two cinematographic techniques based upon the theme.

15. The method of claim 10 further comprising, providing at least one interaction point to indicate that the user may interact to change the data.

16. The method of claim 10 further comprising, detecting interaction that reschedules or repositions, or both reschedules and repositions, at least one of the plan objects in the modified data.

17. The method of claim 10 further comprising changing at least one object in the set of plan objects.

18. One or more computer-readable media having computer-executable instructions, which when executed perform steps, comprising,

(a) synthesizing data including a plurality of objects into a linear narrative;

(b) playing back the linear narrative;

(c) modifying the data based on a received instruction to include a transition effect between two of the objects, or to direct attention to a particular object or part of a particular object, or both to include a transition effect between two of the objects or to direct attention to a particular object or part of a particular object; and

(d) returning to step (a) until a final linear narrative is saved.

19. The one or more computer-readable media of claim 18 having further computer-executable instructions comprising modifying the data to indicate a relationship between two objects that appear in the linear narrative.

20. The one or more computer-readable media of claim 18 wherein a received instruction corresponds to a theme, and wherein modifying the data based on the received instruction comprises combining at least one cinematographic technique with audio to convey the theme.