Information transmission method, information transmission apparatus, information recording or reproducing method, information recording or reproducing apparatus and recording medium

• US 8,094,588 B2
• Filed: 12/11/2003
• Issued: 01/10/2012
• Est. Priority Date: 01/17/2003
• Status: Expired due to Fees

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Sako, Yoichiro, Miura, Masayoshi, Yabe, Susumu, Takai, Motoyuki, Inoue, Akiko
• Primary Examiner(s): Ngo, Ricky
• Assistant Examiner(s): LIU, BEN H
• Application Number:
  US10/541,278
• Publication Number:
  US 20060083218A1
• Time in Patent Office: 2,952 Days
• Field of Search: 370/271, 370260-264, 370/265
• US Class Current: 370/265
• CPC Class Codes: A61B 5/024 Detecting, measuring or recording pulse rate or heart rate A61B5/0205, A61B5/021 take precedence
• CPC Class Codes: A61B 5/08 Detecting, measuring or recording devices for evaluating the respiratory organs A61B5/0205 takes precedence
• CPC Class Codes: A61B 5/103 Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes A61B5/08 takes precedence; measuring aids for tailors A41H1/00; measuring instruments specially adapted for dentistry A61C19/04
• CPC Class Codes: A61B 5/165 Evaluating the state of mind, e.g. depression, anxiety
• CPC Class Codes: A61B 5/7232 involving compression of the physiological signal, e.g. to extend the signal recording period
• CPC Class Codes: G10K 15/02 Synthesis of acoustic waves synthesis of speech G10L13/00
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/23614 Multiplexing of additional data and video streams arrangements for simultaneous broadcast of plural pieces of information H04H20/28
• CPC Class Codes: H04N 21/42201 biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user input arrangements for interaction with the human body based on nervous system activity detection G06F3/015
• CPC Class Codes: H04N 21/4348 Demultiplexing of additional data and video streams
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream

Abstract

An information transmission method capable of reproducing the atmosphere of a concert hall or a live performance hall, wherein bio-information of a speaker, player, actor or conductor, who serves as a source of speech, sounds or music and/or bio-information of a performer included within an image are multiplexed with respect to information of speech or music and/or information of the image for transmission thereof. At the receiving side, sense stimulation based on the bio-information is provided to the viewer, or information of speech or music and/or information of the image are controlled on the basis of the bio-information to thereby reproduce presence or live appeal.

Claims

1. An information transmission method, comprising:

acquiring one or more of audio information and video information of a music performance at a given location;

detecting, concurrent with the acquiring of the one or more of audio information and video information of the music performance, body motion information indicative of a tempo of music of the music performance and bio-information of at least one individual present at the given location;

partitioning the acquired one or more of audio information and video information of the music performance into lengths of partitioned data each of which corresponds to a predefined time interval;

compressing and packetizing the lengths of partitioned data into a stream of first data packets having empty regions resulting from the compression of the lengths of the partitioned data;

performing statistical processing of the body motion information indicative of the tempo of the music of the music performance and bio-information over predetermined time intervals corresponding to respective pluralities of the first data packets of the one or more of audio information and video information;

packetizing the statistically processed body motion information indicative of the tempo of the music of the music performance and bio-information into respective pluralities of second data packets corresponding to the respective pluralities of the first data packets;

multiplexing the stream of first data packets with the second data packets by inserting a respective plurality of second data packets, which corresponds to one of the predetermined time intervals, into one of the empty regions of the stream that is adjacent to a respective plurality of first data pockets which corresponds to a same one of the predetermined time intervals; and

transmitting the multiplexed stream.

2. The information transmission method as set forth in claim 1, wherein the at least one individual includes a speaker, a player, an actor, an actress, or a conductor who serves as a source of the audio information, and/or a performer of a photographed person who is included within the video information.

3. The information transmission method as set for in claim 1, wherein the at least one individual includes a listener who is present at the given location when the audio information is acquired and/or a viewer present at the given location when the video information is acquired.

4. The information transmission method as set forth in claim 1, wherein the bio-information selected from the group consisting of myoelectricity, body surface temperature, skin sweating, skin pressure, pulse, breath, micro-vibration, cardioelectricity, heartbeat, and blood pressure.

5. The information transmission method as set forth in claim 1, wherein the detected body motion information indicative of the tempo of the music of the music performance and bio-information is extracted from the one or more of audio information and video information of the music performance,

6. An information transmission apparatus, comprising:

information acquiring means for acquiring one or more of audio information and video information of a music performance at a given location;

detecting means for detecting, concurrent with the acquiring of the one or more of audio information and video information of the music performance, body motion information indicative of a tempo of music of the music performance and bio-information of at least one individual present at the given location; and

first packetizing means for partitioning the acquired one or more of audio information and video information of the music performance into lengths of partitioned data each of which corresponds to a predefined time interval, and for compressing and packetizing the lengths or partitioned data into a stream of first data packets having empty regions resulting from the compression of the partitioned data;

analysis means for performing statistical processing of the body motion information indicative of the tempo of the music of the music performance and bio-information over predetermined time intervals corresponding to respective pluralities of the first data packets of the one or more of audio information and video information;

second packetizing means for packetizing the statistically processed body motion information indicative of the tempo of the music of the music performance and bio-information into respective pluralities of second data packets corresponding to the respective pluralities of the first data packets;

multiplexing means for multiplexing the stream of first data packets with the second data packets by inserting a respective plurality of second data packets, which corresponds to one of the predetermined time intervals, into one of the empty regions of the stream that is adjacent to a respective plurality of first data packets which corresponds to a same one of the predetermined time intervals; and

transmission means for transmitting the multiplexed stream.

7. The information transmission apparatus as set forth in claim 6, wherein the at least one individual includes a speaker, a player, an actor, or a conductor who serves as a source of the audio information, and/or a performer or a photographed person who is included within the video information.

8. The information transmission apparatus as set forth in claim 6, wherein the at least one individual includes a listener who is present at the given location when the audio information is acquired and/or a viewer present at the given location when the video information is acquired.

9. The information transmission apparatus as set forth in claim 6, wherein the bio-information is selected from the group consisting of myoelectricity, body surface temperature, skin sweating, skin resistance, pulse, breath, micro-vibration, cardioelectricity, heartbeat, and blood pressure.

10. The information transmission apparatus as set forth in claim 6, wherein the detecting means extracts the detected body motion information indicative of the tempo of the music of the music performance and bio-information from the one or more of audio information and video information of the music performance.

11. An information recording method, comprising:

acquiring one or more of audio information and video information of a music performance at a given location;

detecting, concurrent with the acquiring of the one or more of audio information and video information of the music performance, body motion information indicative of a tempo of music of the music performance and bio-information of at least one individual present at the given location;

partitioning packetizing the acquired one or more of audio information and video information of the music performance into lengths of partitioned data each of which corresponds to a predefined time interval;

compressing and packetizing the lengths of partitioned data into a stream of first data packets having empty regions resulting from the compression of the partitioned data;

performing statistical processing of the body motion information indicative of the tempo of the music of the music performance and bio-information over predetermined time interval corresponding to respective pluralities of first data packets of one or more of audio information and video information;

packetizing the statistically processed body motion information indicative of the tempo of the music of the music performance and bio-information into respective pluralities of second data packets corresponding to the respective pluralities of the first data packets;

multiplexing the stream of first data packets with the second data packets by inserting a respective plurality of second data packets, which corresponds to one of the predetermined time intervals, into one of the empty regions of the stream that adjacent to a respective plurality of first data packets which corresponds to a same one of the predetermined time intervals; and

recording the multiplexed stream onto a predetermined recording medium.

12. The information recording method as set forth in claim 11, wherein the at least one individual includes a speaker, a player, an actor, or a conductor who serves a source of the audio information, and/or a performer or a photographed person who is included within the video information.

13. The information recording method as set forth in claim 11, wherein the at least one individual includes a listener who is present at the given location when the audio information is acquired and/or a viewer present at the given location when the video information is acquired.

14. The information recording method as set forth in claim 11, wherein the bio-information is selected from the group consisting of myoelectricity, body surface temperature, skin sweating, skin resistance, pulse, breath, micro-vibration, cardioelectricity, heartbeat, and blood pressure.

15. The information recording method as set forth in claim 11, wherein the detected the recording medium is at least one of optical disc, magnetic tape, hard disc and semiconductor memory.

16. The information recording method as set forth in claim 11, wherein the body motion information indicative of the tempo of the music of the music performance and bio-information is extracted from the one or more of audio information and video information of the music performance.

17. An information recording apparatus, comprising:

information acquiring means, for acquiring one or more of audio information and video information of a music performance at a given location;

detecting means for detecting, concurrent with the acquiring of the one or more of audio information and video information of the music performance, body motion information indicative of a tempo of music of the music performance and bio-information of at least one individual present at the given location; and

first packetizing means for partitioning the acquired one or more of audio information and video information of the music performance into lengths of partitioned data each of which corresponds to a predefined time interval, and for compressing and packetizing the lengths of partitioned data into a stream of first data packets having empty regions resulting from the compression of the partitioned data;

analysis means for performing statistical processing of the body motion information indicative of the tempo of the music of the music performance and bio-information over predetermined time intervals corresponding to respective pluralities of the first data packets of the one or more of audio information and video information;

second packetizing means for packetizing the statistically processed body motion information indicative of the tempo of the music of the music performance and bio-information into respective pluralities of second date packets corresponding to the respective pluralities of the first data packets;

multiplexing means for multiplexing the stream of first data packets with the second data packets by inserting a respective plurality of second data packets, which corresponds to one of the predetermined time intervals, into one of the empty regions of the stream that is adjacent to a respective plurality of first data packets which corresponds to a same one of the predetermined time intervals; and

recording means for recording the multiplexed stream onto a predetermined recording medium.

18. The information recording apparatus as set forth in claim 17, wherein the at least one individual includes a speaker, a player, an actor, or a conductor who serves as a source of the audio information, and/or a performer or a photographed person who is included within the video information.

19. The information recording apparatus as set forth in claim 17, wherein the at least one individual includes a listener who is present at the given location when the audio information is acquired and/or a viewer present at the given location when the video information is acquired.

20. The information recording apparatus as set forth in claim 17, wherein the bio-information is selected from the group consisting of myoelectricity, body surface temperature, skin sweating, skin resistance, pulse, breath, micro-vibration, cardioelectricity, heartbeat, and blood pressure.

21. The information recording apparatus as set forth in claim 17, wherein the recording medium is selected from the group consisting of optical disc, magnetic tape, hard disc, and semiconductor memory.

22. The information recording apparatus as set forth in claim 17, wherein the detecting means extracts the detected body motion information indicative of the tempo of the music of the music performance and bio-information from the one or more of audio information and video information.

23. An information reproducing method, comprising:

acquiring one or more of audio information and video information of a music performance at a given location;

detecting, concurrent with the acquiring of the one or more of audio information and video information of the music performance, body motion information indicative of a tempo of music of the music performance and bio-information of at least one individual present at the given location;

partitioning the acquired one or more of audio information and video information of the music performance into lengths of partitioned data each of which corresponds to a predefined time interval;

compressing and packetizing the lengths of partitioned data into a stream of first data packets having empty regions resulting from the compression of the lengths of the partitioned data;

performing statistical processing of the body motion information indicative of the tempo of the music of the music performance and bio-information over predetermined time intervals corresponding to respective pluralities of the first data packets of the one or more of audio information and video information;

packetizing the statistically processed body motion information indicative of the tempo of the music of the music performance and bio-information into respective pluralities of second data packets corresponding to the respective pluralities of the first data packets;

multiplexing the stream of first data packets with the second data by inserting a respective plurality of second data packets, which corresponds to one of the predetermined time intervals, into one of the empty regions of the stream that is adjacent to a respective plurality of first data packets which corresponds to a same one of the predetermined time intervals;

decomposing a multiplexed data stream into respective pluralities of first data packets at one or more of audio information and video information of a music performance and into corresponding respective pluralities of second data packets of statistically processed body motion information indicative of a tempo of music of the music performance and bio-information, the multiplexed data stream having each respective plurality of second data packets of the statistically processed body motion information indicative of the tempo of the music of the music performance and bio-information which corresponds to a given predetermined time interval being disposed adjacent to a respective plurality of first data packets which corresponds to a same predetermined time interval in regions of the data stream resulting from partitioning acquired one or more of audio information and video information into lengths of partitioned data each corresponding to a predefined time interval and compressing the lengths of partitioned data, the acquired one or more of audio information and video information of the music performance being acquired at a performance at a given location, the body motion information indicative of the tempo of the music of the music performance and bio-information being of at least one individual present at the given location and being detected concurrent with the acquiring of the one or more of audio information and video information, the statistically processed body motion information indicative of the tempo of the music of the music performance and bio-information being generated by performing statistical processing of the detected body motion information indicative of the tempo of the music of the music performance and bio-information over predetermined time intervals corresponding to respective pluralities of the first data packets;

reproducing the one or more of audio information and video information for delivery to a user;

providing, to the user, sense stimulation based on the body motion information indicative of the tempo of the music of the music performance and bio-information concurrent with the delivery of the one or more of the audio information and video information of the music performance; and

generating video information for a moving image in correspondence with the body motion information indicative of the tempo of the music of the music performance.

24. The information reproducing method as set forth in claim 23, wherein the multiplexed data stream is received through a transmission method.

25. The information reproducing method as set forth in claim 23, wherein the multiplexed data stream is read out from a recording medium.

26. The information reproducing method as set forth in claim 23, wherein the at least one individual includes a speaker, a player, an actor, or a conductor who serves as a source of the audio information, and/or a performer or a photographed person who is included within the video information.

27. The information reproducing method as set forth in claim 23, wherein the at least one individual includes a listener present at the given location when the audio information is acquired and/or a viewer present at the given location when the video information is acquired.

28. An information reproducing method, comprising:

acquiring one or more of audio information and video information of a music performance at a given location;

detecting, concurrent with the acquiring of the one or more of audio information and video information of the music performance, body motion information indicative of a tempo of music of the music performance and bio-information of at least one individual present at the given location;

partitioning the acquired one or more of audio information and video information of the music performance into lengths of partitioned data each of which corresponds to a predefined time interval;

compressing and packetizing the lengths of partitioned data into a stream of first data packets having empty regions resulting from the compression of the lengths of the partitioned data;

performing statistical processing of the body motion information indicative of the tempo of the music of the music performance and bio-information over predetermined time intervals corresponding to respective pluralities of the first data packets of the one or more of audio information and video information;

packetizing the statistically processed body motion information indicative of the tempo of the music of the music performance and bio-information into respective pluralities of second data packets corresponding to the respective pluralities of the first data packets;

multiplexing the stream of first data packets with the second data packets by inserting a respective plurality of second data packets, which corresponds to one of the predetermined time intervals, into one of the empty regions of the stream that is adjacent to a respective plurality of first data packets which corresponds to a same one of the predetermined time intervals;

decomposing a multiplexed data stream into respective pluralities of first data packets of one or more of audio information and video information of a music performance and into corresponding respective pluralities of second data packets of statistically processed body motion information indicative of a tempo of music of the music performance and bio-information, the multiplexed data stream having each respective plurality of second data packets of the statistically processed body motion information indicative of the tempo of the music of the music performance and bio-information which corresponds to a given predetermined time interval being disposed adjacent to a respective plurality of first data packets which corresponds to a same predetermined time interval in regions of the data stream resulting from partitioning acquired one or more at audio information and video information of the music performance into lengths of partitioned data each corresponding to a predefined time interval and compressing the lengths of partitioned data, the acquired one or more of audio information and video information being acquired at a performance at a given location, the body motion information indicative of the tempo of the music of the music performance and bio-information being of at least one individual present at the given location and being detected concurrent with the acquiring of the one or more of audio information and video information, the statistically processed body motion information indicative of the tempo of the music of the music performance and bio-information being generated by performing statistical processing of the detected body motion information indicative of the tempo of the music of the music performance and bio-information over predetermined time intervals corresponding to respective pluralities of the first data packets;

controlling, based on the body motion information indicative of the tempo of the music of the music performance and bio-information, reproduction of the one or more of audio information and video information of the music performance; and

generating video information for a moving image in correspondence with the body motion information indicative of the tempo of the music of the music performance.

29. The information reproducing method a set forth in claim 28, wherein the multiplexed data stream is are received through a transmission medium.

30. The information reproducing method as set forth in claim 28, wherein the multiplexed data stream is read out from a record medium.

31. The information reproducing method as set forth in claim 28, wherein the at least one individual includes a speaker, a player, an actor, or a conductor who serves as a source of the audio information, and/or a performer or a photographed person who is included within the video information.

32. The information reproducing method as set forth in claim 28, wherein the at least one individual includes a listener present at the given location when the audio information is acquired and/or a viewer present at the given location when the video information is acquired.

33. A system, comprising:

an information processing apparatus, including;

information acquiring means for acquiring one or more of audio information and video information of a music performance at a given location,

detecting means for detecting, concurrent with the acquiring or the one or more of audio information and video information of the music performance, body motion information indicative of a tempo of music of the music performance and bio-information of at least one individual present at the given location, and

first packetizing means for partitioning the acquired one or more of audio information and video information of the music performance into lengths of partitioned data each of which corresponds to a predefined time interval, and for compressing and packetizing the lengths of partitioned data into a stream of first data packets having empty regions resulting from the compression of the partitioned data,

analysis means for performing statistical processing of the body motion information indicative of the tempo of the music of the music performance and bio-information over predetermined time intervals corresponding to respective pluralities of the first data packets of the one or more of audio information and video information,

second packetizing means for packetizing the statistically processed body motion information indicative of the tempo of the music of the music performance and bio-information into respective pluralities second data packets corresponding to the respective pluralities of the first data packets, and

multiplexing means for multiplexing the stream of first data packets with the second data packets by inserting a respective plurality of second data packets, which corresponds to one of the predetermined time intervals, into one of the empty regions of the stream that is adjacent to a respective plurality of first data packets which corresponds to a same one of the predetermined time intervals;

an information reproducing apparatus, including;

means for decomposing the multiplexed data stream into respective pluralities of first data packets of one or more of audio information and video information of a music performance and into corresponding respective pluralities of second data packets of statistically processed body motion information indicative of a tempo of music of the music performance and bio-information, the multiplexed data stream having each respective plurality of second data packets of the statistically processed body motion information indicative of the tempo of the music of the music performance and bio-information which corresponds to a given predetermined time interval being disposed adjacent to a respective plurality of first data packets which corresponds to a same predetermined time interval in regions of the data stream resulting from partitioning acquired one or more of audio information and video information into lengths of partitioned data each corresponding to a predefined time interval and compressing the lengths of partitioned data, the acquired one or more of audio information and video information of the music performance being acquired at a performance at a given location, the body motion information indicative of the tempo of the music of the music performance and bio-information being of at least one individual present at the given location and being detected concurrent with the acquiring or the one or more of audio information and video information, the statistically processed body motion information indicative of the tempo of the music of the music performance and bio-information being generated by performing statistical processing of the detected body motion information indicative of the tempo of the music of the music performance and bio-information over predetermined time intervals corresponding to respective pluralities of the first data packets,

means for reproducing the one or more of audio information and video information of the music performance for delivery to a user,

means for providing, to the user, sense stimulation based on the body motion information indicative of the tempo of the music of the music performance and bio-information concurrent with the delivery of the one or more of the audio information and video information of the music performance, and

means for generating video information for a moving image in correspondence with the body motion information indicative of the tempo of the music of the music performance,

34. The information reproducing apparatus as set forth in claim 33, further comprising:

means for receiving the multiplexed data stream through a transmission medium.

35. The information reproducing apparatus as set forth in claim 33, further comprising:

means for reading out the multiplexed data stream from a recording medium.

36. The information reproducing apparatus as set forth in claim 33, wherein the at least one individual includes a speaker, a player, an actor, or a conductor who serves as a source of the audio information, and/or a performer or a photographed person who is included within the video information.

37. The information reproducing apparatus as set forth in claim 33, wherein the at least one individual includes a listener present at the given location when the audio information is acquired and/or a viewer present at the given location when the video information is acquired.

38. A system, comprising:

an information processing apparatus, including;

information acquiring means for acquiring one or more of audio information and video information of a music performance at a given location,

detecting means for detecting, concurrent with the acquiring of the one or more of audio information and video information of the music performance, body motion information indicative of a tempo of music of the music performance and bio-information of at least one individual present at the given location, and

first packetizing means for partitioning the acquired one or more of audio information and video information of the music performance into lengths of partitioned data each of which corresponds to a predefined time interval, and for compressing and packetizing the lengths of partitioned data into a stream of first data packets having empty regions resulting from the compression of the partitioned data,

analysis means for performing statistical processing of the body motion information indicative of the tempo of the music of the music performance and bio-information over predetermined time intervals corresponding to respective pluralities of the first data packets of the one or more of audio information and video information,

second packetizing means for packetizing the statistically processed body motion information indicative of the tempo of the music of the music performance bio-information into respective pluralities of second data packets corresponding to the respective pluralities of the first data packets, and

multiplexing means for multiplexing the stream of first data packets with the second data packets by inserting a respective plurality of second data packets, which corresponds to one of the predetermined time intervals, into one of the empty regions of the stream that is adjacent to a respective plurality of first data packets which corresponds to a same one of the predetermined time intervals;

an information reproducing apparatus, including;

means for decomposing the multiplexed data stream into respective pluralities of first data packets of one or more of audio information and video information of a music performance and into corresponding respective pluralities of second data packets of statistically processed body motion information indicative of a tempo of music of the music performance and bio-information, the multiplexed data stream having each respective plurality of second data packets of the statistically processed body motion information indicative of the tempo of the music of the music performance and bio-information which corresponds to a given predetermined time interval being disposed adjacent to a respective plurality of first data packets which corresponds to a same predetermined time interval in regions of the data stream resulting from partitioning acquired one or more of audio information and video information of the music performance into lengths of partitioned data each corresponding to a predefined time interval and compressing the lengths of partitioned data, the acquired one or more of audio information and video information of the music performance being acquired at a performance at a given location, the body motion information indicative of the tempo of the music of the music performance and bio-information being of at least one individual present at the given location and being detected concurrent with the acquiring of the one or more of audio information and video information of the music performance, the statistically processed body motion information indicative of the tempo of the music of the music performance and bio-information being generated by performing statistical processing of the detected body motion information indicative of the tempo of the music of the music performance and bio-information over predetermined time intervals corresponding to respective pluralities of the first data packets,

means for controlling, based on the body motion information indicative of the tempo of the music of the music performance and bio-information, reproduction of the one or more of audio information and video information of the music performance, and

means for generating video information for a moving image in correspondence with the body motion information indicative of the tempo of the music of the music performance.

39. The information reproducing apparatus as set forth in claim 38, further comprising:

means for receiving the multiplexed data stream through a transmission medium.

40. The information reproducing apparatus as set forth in claim 38, further comprising:

means for reading out the multiplexed data stream from a recording medium.

41. The information reproducing apparatus as set forth in claim 38, wherein the at least one individual includes a speaker, a player, an actor, or a conductor who serves as a source of the audio information, and/or a performer or a photographed person who is included within the video information.

42. The information reproducing apparatus as set forth in claim 38, wherein the at least one individual includes a listener present at the given location when the audio information is acquired and/or a viewer present at the given location when the video information is acquired.

43. A system, comprising:

an information recording apparatus, comprising;

information acquiring means for acquiring one or more of audio information and video information of a music performance at a given location,

detecting means for detecting, concurrent with the acquiring of the one or more of audio information and video information of the music performance, body motion information indicative of a tempo of music of the music performance and bio-information of at least one individual present at the given location,

first packetizing means for partitioning the acquired one or more of audio information and video information of the music performance into lengths of partitioned data each of which corresponds to a predefined time interval, and for compressing and packetizing the lengths of partitioned data into a stream of first data packets having empty regions resulting from the compression of the partitioned data,

analysis means for performing statistical processing of the body motion information indicative of the tempo of the music of the music performance and bio-information over predetermined time intervals corresponding to respective pluralities of the first data packets of the one or more of audio information and video information,

second packetizing means for packetizing the statistically processed body motion information indicative of the tempo of the music of the music performance and bio-information into respective pluralities of second data packets corresponding to the respective pluralities of the first data packets,

multiplexing means for multiplexing the stream of first data packets with the second data packets by inserting a respective plurality of second data packets, which corresponds to one of the predetermined time intervals, into one of the empty regions of the stream that is adjacent to a respective plurality of first data packets which corresponds to a same one of the predetermined time intervals, and

recording means for recording the multiplexed stream onto a predetermined recording medium; and

a non-transitory recording medium having recorded therein the multiplexed data stream comprised of respective pluralities of first data packets of one or more of audio information and video information of a music performance and corresponding respective pluralities of second data packets of statistically processed body motion information indicative of a tempo of music of the music performance and bio-information, the multiplexed data stream having each respective plurality of second data packets of the statistically processed body motion information indicative of the tempo of the music of the music performance and bio-information which corresponds to a given predetermined time interval being disposed adjacent to a respective plurality of first data packets which corresponds to a same predetermined time interval in regions of the data stream resulting from partitioning acquired one or more of audio information and video information into lengths of partitioned data each corresponding to a predefined time interval and compressing the lengths of partitioned data, the acquired one or more of audio information and video information of the music performance being acquired at a performance at a given location, the body motion information indicative of the tempo of the music of the music performance and bio-information being of at least one individual present at the given location and being detected concurrent with the acquiring of the one or more of audio information and video information, the statistically processed body motion information indicative of the tempo of the music of the music performance and bio-information being generated by performing statistical processing of the detected body motion information indicative of the tempo of the music of the music performance and bio-information over predetermined time intervals corresponding to respective pluralities of the first data packets.

44. The recording medium as set forth in claim 43, wherein the at least one individual includes a speaker, a player, an actor, or a conductor who serves as a source of the audio information, and/or a performer or a photographed person who is included within the video information.

45. The recording medium as set forth in claim 43, wherein the at least one individual includes a listener present at the given location when the audio information is acquired and/or a viewer present at the given location when the video information is acquired.

46. The recording medium as set forth in claim 43, wherein the bio-information is selected from the group consisting of myoelectricity, body surface temperature, skin sweating, skin resistance, pulse, breath, micro-vibration, cardioelectricity, heartbeat, and blood pressure.