Authoring system

• US 7,068,290 B2
• Filed: 10/09/2001
• Issued: 06/27/2006
• Est. Priority Date: 10/09/2000
• Status: Expired due to Term

• Current Assignee: Dolby Laboratories Licensing Corporation (Dolby Laboratories Incorporated)
• Original Assignee: Lake Technology Ltd. (Dolby Laboratories Incorporated)
• Inventors: Bennett, Stephen James, Cartwright, Richard James, Helyer, Nigel Lloyd William, Butler, Roger David
• Primary Examiner(s): Tung, Kee M.
• Assistant Examiner(s): SAMS, MICHELLE L
• Application Number:
  US10/381,997
• Publication Number:
  US 20040051718A1
• Time in Patent Office: 1,722 Days
• Field of Search: 345419-427, 345 7- 8, 345/702, 345/633, 345/169, 345/173, 715/864, 701/213
• US Class Current: 345/633
• CPC Class Codes: G06F 16/29 Geographical information databases
• CPC Class Codes: Y02A 90/10 Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation

Abstract

An authoring system and authoring method to assigning a real geo-spatial position to sensory-effect data representing virtual sensations, including a virtual sound sensation. The system includes an author interface for displaying a representation of a real geo-space, means for accepting the sensory-effect data, and means for an author to assign the virtual sensory effect data to a location within the displayed representation corresponding to a real location within the geo-space, such that a user has the sensation of the virtual sound coming from the location assigned for the sensory-effect data.

Claims

1. An authoring system for creating data for playback through a renderer, including assigning a geo-spatial position to one or more virtual sensory-effects represented by virtual sensory-effect data, the virtual sensory-effect data including at least one sound represented by sound data, the authoring system comprising:

an author interface to display to an author a representation of a real geo-space, a representation of an exposee in the real geo-space, and a representation of one or more virtual sensory-effects to be rendered by the renderer, including at least one sound, the author interface further for providing for the author a mechanism to interactively manipulate the locations in the real geo-space of the exposee and of the sensory-effects;

a trigger creator coupled to the author interface and arranged in operation to accept a trigger description of how one or more events associated with the trigger are generated as a result of the exposee approaching, moving away, or both approaching and moving away from a region in the geo-space, the trigger creator creating in operation a trigger to trigger one or more the events; and

a position assignor coupled to the author interface and arranged in operation to accept and assign positions for the sounds and further to accept and assign positions for the triggers, and further to assign relationships between triggers and one or more of the sensory effects, including at least one of the sounds, according to input provided by the author using the author interface;

data creator arranged in operation to create data for playback through the renderer based on any of the sounds, created triggers, assigned positions, and relationships therebetween,

wherein the renderer is wearable by, carried by, or otherwise movable with the exposee, and arranged to accept the data created by the data creator and information related to the location of an exposee within the geo-space, and to present to the exposee the sensory effects of the created data in a manner such that the exposee is provided with the illusion of the sounds coming from the assigned locations and triggered according to the triggers.

2. An authoring system as claimed in claim 1, wherein, in addition to the sound data, the virtual sensory-effect data further includes at least one of the group consisting of virtual image data, virtual smell data, virtual temperature data, virtual humidity data, virtual wind data, virtual pressure data and virtual light data.

3. An authoring system as claimed in claim 1, wherein the data for playback comprises computer readable code for, in use, instructing the renderer to control presentation of the virtual sensory-effect data consisting of at least one of the group of virtual sound, virtual image, virtual smell, virtual humidity, virtual wind, virtual pressure, or virtual light data.

4. An authoring system as claimed in claim 1, wherein the author interface is arranged in a manner such as to enable the author to assign the location to one or more objects by placing and manipulating markers on the interface, the markers representing the objects, the objects including one or more of the triggers, an object defining movement along a trajectory, an object defining the real-time-determined-position of the exposee, an object defining the real-time-determined orientation, and the virtual sensory effects including the one or more sounds.

5. An authoring system as claimed in claim 4, wherein the authoring system comprises means for defining relationships between markers.

6. An authoring system as claimed in claim 4, wherein the author interface is arranged in a manner such as to enable the author to define relationships between the objects represented by markers.

7. An authoring system as claimed in claim 5, wherein the relationship comprises one or more of defining an object as a parent of another object, and defining an object as a child of another object, such that respective child objects inherit a functionality of their respective parent.

8. An authoring system as claimed in claim 7, wherein assigning triggers to one or more of the sensory effects includes defining a parent-child relationship.

9. An authoring system as claimed in claim 7, wherein assigning triggers to one or more of the sensory effects includes defining a parent-child relationship.

10. An authoring system as claimed in claim 8, wherein the object defining movement along a trajectory is arranged in a manner such that, during rendering, upon being triggered by an associated trigger, a source of data for presentation to the exposee is moved during rendering along a predetermined path.

11. An authoring system as claimed in claim 8, wherein the object defining movement along a trajectory may be arranged, by defining a relationship between the exposee and the object defining movement, in a manner such that, upon being triggered by the associated trigger, a source of data for presentation to the exposee is attached to the exposee, such that during rendering, the movement of the source follows that of the exposee.

12. An authoring system as claimed in claim 8, wherein the object defining movement along a trajectory is arranged in a manner such that it provides its own triggering functionality.

13. An authoring system as claimed in claim 8, wherein the marker for the object defining the real-time-determined-position of the exposee is arranged in a manner such that, during playback in the renderer, its movement within the geo-space is dependant upon positioning data externally provided to the renderer.

14. An authoring system as claimed in claim 13, wherein the positioning data is provided to the renderer by way of a global positioning system (GPS) that is wearable by, carried by, or otherwise movable with the exposee.

15. An authoring system as claimed in claim 8, wherein the marker for the object defining the real-time-determined-orientation of the exposee is arranged in a manner such that, during playback in the renderer, its orientation within the geo-space is dependant upon orientation data externally provided to renderer.

16. An authoring system as claimed in claim 15, wherein the orientation data is provided, in use, by way of sensor means that is wearable by, carried by, or otherwise movable with the exposee.

17. An authoring system as claimed in claim 1, wherein the trigger is arranged in a manner such that, during playback, the one or more events associated with the trigger are triggered depending on the exposee marker entering or leaving a triggering zone around the location of the trigger.

18. An authoring system as claimed in claim 17, wherein the triggering zone is of a circular shape.

19. An authoring system as claimed in claim 17, wherein the triggering zone is of a user-defined shape.

20. An authoring system as claimed in claim 1, wherein the authoring system is arranged to transfer the created data to the renderer via a data carrier means comprising one or more of the group of a computer network, a portable data carrier, or a wireless data carrier for effecting the presentation of the sensory-effect data to the exposee.

21. An authoring system as claimed in claim 20, wherein the authoring system is arranged in a manner such that, in use, the effecting of the presentation by the renderer of the sensory-effect data to the exposee can be manipulated in real-time by the user.

22. An authoring system as claimed in claim 1, wherein the authoring system further comprises a rendering tool for effecting the presentation by the renderer of the sensory-effect data to the author to provide feedback of what would be presented to the exposee.

23. An authoring system as claimed in claim 1, further comprising trigger assigning means enabling the author to assign a trigger condition to said sensory-effect data, said trigger condition controlling the delivery of said sensory-effect data at said real location.

24. An authoring system as claimed in claim 1, wherein in the case of the virtual sound, the data from the renderer is presented to the exposee in binaural form.

25. An authoring system as claimed in claim 1, further comprising a sound creator coupled to the author interface and arranged in operation to accept for each sound, one or more sound behavior properties, and to produce a modified sound having the sound behavior properties.

26. An authoring system as claimed in claim 25, wherein the renderer includes a sound renderer arranged to present to the exposee the sounds in a manner such that the exposee is provided with the illusion of the sounds coming from the assigned locations and behaving according to the sound behavior properties and triggered according to the triggers.

27. An authoring system as claimed in claim 26, wherein the sound renderer includes a spatialization system that binauralizes audio signals to produce binauralized signals that are input to headphones worn by the exposee to provide the illusion to the exposee that the sounds are coming from the assigned locations.

28. An authoring tool comprising means for accepting data representing a virtual sensory effect, including a virtual sound effect, and means for creating a data stream which is a combination of data representing a location in a real geo-space and the accepted data representing the virtual sensory effect, including a virtual sound effect, the data stream being for a renderer wearable by, carried by, or otherwise movable with an exposee arranged to present rendered data to an exposee such that the exposee has the sensation that the virtual sound effect is located at the location of the real geo-space.

29. An authoring tool adapted to create a data stream useable by a presentation means, the presentation means being wearable by, carried by, or otherwise movable with an exposee and arranged to present a sensory effect to the exposee as the exposee moves through a real geo-space, the sensory effect including a sound effect, said data stream comprising a combination of data representing said real geo-space, and data representing the sensory effect, the sensory effect including a sound effect, the authoring tool adapted to interactively assign geo-spatial location to the sensory effect in said representation of said real geo-space, the data stream arranged such that the exposee presented the output of the presentation means has the sensation that the sound effect is located at the location to which the sound effect is assigned in the real geo-space.

30. An authoring system comprising means for accepting virtual sensory-effect data, including virtual audio data, and means for assigning a real geo-spatial position to the virtual sensory-effect data, to create data for a renderer that is wearable by, carried by, or otherwise movable with an exposee, and arranged to present information to the exposee such that an exposee has the sensation that the virtual audio of the virtual audio data is located at the real geo-spatial position.

31. A renderer arranged, in use, to effect presentation to an exposee of data created by an authoring tool for creating playback through a renderer, the authoring tool designed in operation to assign a geo-spatial position and one or more behaviors to one or more virtual sensory-effects represented by virtual sensory-effect data, the virtual sensory-effect data including at least one sound represented by sound data, wherein the authoring tool includes:

an author interface to display to an author a representation of a real geo-space, a representation of an expose in the real geo-space, and a representation of one or more virtual sensory-effects created by the renderer, including at least one sound, the author interface further for providing for the author a mechanism to interactively manipulate the locations in the real geo-space of the exposee and of the sensory-effects;

a trigger creator coupled to the author interface and arranged in operation to accept a trigger description of how one or more events associated with the trigger are generated as a result of the exposee approaching, moving away, or both approaching and moving away from a region in the geo-space, the trigger creator creating in operation a trigger to trigger one or more the events; and

a position assignor coupled to the author interface and arranged in operation to accept and assign positions in the real geo-space for the sounds and further to accept and assign positions in the real geo-space for the triggers, and further to assign relationships between triggers and one or more of the sensory effects, including at least one of the sounds, according to input provided by the author using the author interface;

data creator arranged in operation to create the data for the renderer based on any of the sounds, created triggers, assigned positions, and relationships therebetween,

the rendering tool comprising;

a first input arranged in operation to accept information related to the location of an exposee within the geo-space;

a second input arranged in operation to accept the data created by the authoring tool, and

a rendering engine arranged in operation to present the accepted authoring tool-created data to the exposee in a manner such that the exposee is provided with the illusion of the sounds coming from the assigned locations and triggered according to the triggers,

wherein the renderer is wearable by, carried by, or otherwise movable with the exposee.

32. A method of enabling an author to assign a geo-spatial position to virtual sensory-effect data corresponding to one or more virtual sensory effects, including a sound effect, the method comprising the steps of:

providing an author interface for displaying a representation of a real geo-space,

providing sourcing means for sourcing virtual sensory-effect data, and

providing assigning means for enabling an author using the author interface to assign said sensory effect data to a location within the representation corresponding to a real location within the geo-space at which it is desired the sensory effects to be perceived by an exposee in the geo-space, the assigning producing data for a means for rendering, the means for rendering being wearable by, carried by, or otherwise movable with the exposee, and including;

means for accepting information related to the location of the exposee; and

means for processing the data such that information is presented to the exposee in a manner such that the exposee is provided with the illusion of the virtual sensory-effects coming from the location to which the author assigned the virtual sensory effect data.

33. A method in an authoring system for creating data for playback through a renderer, the data representing one or more virtual sensory-effects represented by virtual sensory-effect data, including at least one sound represented by sound data, the method comprising:

displaying to an author at an author interface a representation of a real geo-space, a representation of an exposee in the real geo-space, and a representation of one or more virtual sensory-effects to be rendered by the renderer, including at least one sound;

accepting from the author at least one trigger, including a trigger description of how one or more events associated with the trigger are generated as a result of the exposee approaching, moving away, or both approaching and moving away from a region in the geo-space; and

accepting from the author positions assigned by the author using the author interface, the positions including positions for the sounds and positions for the triggers;

accepting from the author relationships between triggers and one or more of the sensory effects, including at least one of the sounds;

creating data for playback through the renderer based on any of the sounds, created triggers, assigned positions, and relationships therebetween,

wherein the renderer is wearable by, carried by, or otherwise movable with the exposee, and arranged to accept the created data and information related to the location of an exposee within the geo-space, and to present to the exposee the sensory effects of the created data in a manner such that the exposee is provided with the illusion of the sounds coming from the assigned locations and triggered according to the triggers.

34. A method as claimed in claim 33, wherein in the case of the virtual sound, the rendering by the renderer includes presenting data to the exposee in binaural form.