Information processing apparatus/method and presentation medium

• US 6,626,954 B1
• Filed: 02/09/1999
• Issued: 09/30/2003
• Est. Priority Date: 02/13/1998
• Status: Expired due to Fees

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Aga, Hiroyuki, Kamachi, Teruhisa, Karasawa, Hidenori, Nagahara, Junichi, Arakawa, Emi, Tsukahara, Hiroki
• Primary Examiner(s): Feild, Joseph H.
• Application Number:
  US09/246,397
• Time in Patent Office: 1,694 Days
• Field of Search: 707/500.1, 707/513, 707/501.1, 345/473-475, 345/757-758, 345/419, 345/706, 345/760, 345/727-728, 715/500.1, 715/501.1, 715/513, 463/30-35
• US Class Current: 715/236
• CPC Class Codes: G06T 13/205 driven by audio data
• CPC Class Codes: G10H 1/0058 Transmission between separate instruments or between individual components of a musical system G10H1/0083 takes precedence
• CPC Class Codes: G10H 2240/056 MIDI or other note-oriented file format
• CPC Class Codes: G10H 2240/245 ISDN [Integrated Services Digital Network]
• CPC Class Codes: G10H 2240/305 Internet or TCP/IP protocol use for any electrophonic musical instrument data or musical parameter transmission purposes

Abstract

A browser generates a sound of track 0 recorded in a MIDI file named music.mid. A Sony_AudioClip node receives data of the music.mid file as an event, outputting the data from a musicData field thereof to a musicData field of a Sony_MusicNoteInterpolator node. The Sony_MusicNoteInterpolator node interpolates a value between a value of a high sound and a value of a low sound prescribed by a keyValue field, outputting a result of the interpolation from value_changed. A PositionIP.value_changed field of a PositionInterpolator node outputs position data corresponding to data of the height of the sound supplied from the Sony_MusicNoteInterpolator node to a CONE_OBJ.set_translation field of a CONE_OBJ Transform node. As a result, the position of an object is changed in synchronization with the generation of a sound.

Claims

1. An information processing apparatus for presenting a 3-dimensional virtual reality space expressed in a VRML, said apparatus comprising:

a specification means for specifying a sound source to be played;

an output means for outputting data of the sound source specified by said specification means as an event prior to actual playing of the sound source;

a display control means for displaying a picture of a predetermined object; and

a modification means for making a change to the picture of said object related to the event output by said output means, the modification means predetermining a lapsed playing time of the sound source by processing the data of the sound source prior to actual playing of the sound source;

wherein the modification means changes the picture of the obiect in synchronization with the actual playing of the sound source based on the predetermined lapsed playing time of the sound source.

2. An information processing apparatus according to claim 1 wherein said modification means changes a position of the picture of said object.

3. An information processing apparatus according to claim 1 wherein said modification means changes a color of the picture of said object.

4. An information processing method for presenting a 2-dimensional virtual reality space expressed in a VRML, said method comprising:

a specification step of specifying a sound source to be played;

an output step of outputting data of the sound source specified at said specification step as an event prior to actual playing of the sound source;

a display control step of displaying a picture of a predetermined object; and

a modification step of making a change to the picture of said object related to the event output a t said output step, the modification step predetermining a lapsed p laying time of the sound source by processing a the data of the sound source prior to a actual playing of the sound source;

wherein the modification step changes the picture of the object in synchronization with the actual playing of the sound source based on the predetermined lapsed playing time of the sound source.

5. An information processing method according to claim 4 whereby, at said modification step, a position of picture of said object is changed .

6. An information processing method according to claim 4 whereby, at said modification step, a color of the picture of said object is changed.

7. A recording medium for recording a computer program to be executed by an information processing apparatus for presenting a 3-dimensional virtual reality space expressed in a VRML, said recording medium used for providing a computer with a computer program comprising:

a specification step of specifying a sound source to be played;

an output step of outputting data of the sound source specified at said specification step as an event prior to actual playing of the sound source;

a display control step of displaying a picture of a predetermined object; and

a modification step of making a change to the picture of said object related to the event output at said output step, the modification step predetermining a lapsed playing time of the sound source by processing the data of the sound source prior to actual playing of the sound source;

wherein the modification step changes the picture of the object in synchronization with the actual playing of the sound source based on the predetermined lapsed playing time of the sound source.

8. A recording medium according to claim 7 whereby, at said modification step, a position of the picture of said object is changed.

9. A recording medium according to claim 7 whereby, at said modification step, a color of the picture of said object is changed.