Information transmission method and device, information recording or reproduction method and device, and recording medium

• US 9,185,440 B2
• Filed: 12/20/2011
• Issued: 11/10/2015
• Est. Priority Date: 01/17/2003
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Sako, Yoichiro, Miura, Masayoshi, Yabe, Susumu, Takai, Motoyuki, Inoue, Akiko
• Primary Examiner(s): Sinkantarakorn, Pao
• Application Number:
  US13/331,655
• Publication Number:
  US 20120086853A1
• Time in Patent Office: 1,421 Days
• Field of Search: 370260-264, 370/271
• US Class Current: 1/1
• CPC Class Codes: A61B 5/024 Detecting, measuring or recording pulse rate or heart rate A61B5/0205, A61B5/021 take precedence
• CPC Class Codes: A61B 5/08 Detecting, measuring or recording devices for evaluating the respiratory organs A61B5/0205 takes precedence
• CPC Class Codes: A61B 5/103 Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes A61B5/08 takes precedence; measuring aids for tailors A41H1/00; measuring instruments specially adapted for dentistry A61C19/04
• CPC Class Codes: A61B 5/165 Evaluating the state of mind, e.g. depression, anxiety
• CPC Class Codes: A61B 5/7232 involving compression of the physiological signal, e.g. to extend the signal recording period
• CPC Class Codes: G10K 15/02 Synthesis of acoustic waves synthesis of speech G10L13/00
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/23614 Multiplexing of additional data and video streams arrangements for simultaneous broadcast of plural pieces of information H04H20/28
• CPC Class Codes: H04N 21/42201 biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user input arrangements for interaction with the human body based on nervous system activity detection G06F3/015
• CPC Class Codes: H04N 21/4348 Demultiplexing of additional data and video streams
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream

Abstract

An information transmission method capable of reproducing the atmosphere of a concert hall or a live performance hall, wherein bio-information of a speaker, player, actor or conductor, who serves as a source of speech, sounds or music and/or bio-information of a performer included within an image are multiplexed with respect to information of speech or music and/or information of the image for transmission thereof. At the receiving side, sense stimulation based on the bio-information is provided to the viewer, or information of speech or music and/or information of the image are controlled on the basis of the bio-information to thereby reproduce presence or live appeal.

Claims

1. An information transmission method comprising:

acquiring one or more of audio information and video information of a music performance at a given location;

detecting, using one or more bio-sensors, concurrent with the acquiring of the one or more of audio information and video information of the music performance, bio-information of at least one individual;

compressing a first portion of the one or more of audio information and video information, wherein the first portion corresponds to a predetermined time length of the one or more of audio information and video information; and

transmitting the acquired one or more of audio information and video information of the music performance in synchronism with the bio-information of the at least one individual, wherein a second portion of the bio-information corresponding to the predetermined time length is inserted into an area in the one or more of audio information and video information, wherein the area is formed by compressing the first portion.

2. The information transmission method as set forth in claim 1, wherein the at least one individual includes a speaker, a player, an actor, an actress, or a conductor who serves as a source of the audio information, and/or a performer or a photographed person who is included within the video information.

3. The information transmission method as set forth in claim 1, wherein the at least one individual includes a listener who is present at the given location when the audio information is acquired and/or a viewer present at the given location when the video information is acquired.

4. The information transmission method as set forth in claim 1, wherein the bio-information is selected from a group consisting of myoelectricity, body surface temperature, skin sweating, skin pressure, pulse, breath, micro-vibration, cardioelectricity, heartbeat, and blood pressure.

5. The information transmission method as set forth in claim 1, wherein the bio-information is extracted from the one or more of audio information and video information of the music performance.

6. An information transmission apparatus, comprising:

a microphone for acquiring audio information of a music performance at a given location;

one or more bio-sensors for detecting, concurrent with the acquiring of the audio information of the music performance, bio-information of at least one individual;

an encoder for compressing a first portion of the audio information, wherein the first portion corresponds to a predetermined time length of the audio information; and

a communication interface for transmitting the acquired audio information of the music performance and the bio-information of the at least one individual in a synchronous relationship to allow for reproduction an atmosphere of the music performance, wherein a second portion of the bio-information corresponding to the predetermined time length is inserted into an area in the audio information, wherein the area is formed by compressing the first portion.

7. The information transmission apparatus as set forth in claim 6, wherein the at least one individual includes a speaker, a player, an actor, or a conductor who serves as a source of the audio information, and/or a performer or a photographed person who is included within a video information of the music performance.

8. The information transmission apparatus as set forth in claim 6, wherein the at least one individual includes a listener who is present at the given location when the audio information is acquired and/or a viewer present at the given location when a video information of the music performance is acquired.

9. The information transmission apparatus as set forth in claim 6, wherein the bio-information is selected from a group consisting of myoelectricity, body surface temperature, skin sweating, skin resistance, pulse, breath, micro-vibration, cardioelectricity, heartbeat, and blood pressure.

10. The information transmission apparatus as set forth in claim 6, wherein the one or more bio-sensors extracts the bio-information from the audio information of the music performance.

11. An information recording method, comprising:

acquiring one or more of audio information and video information of a music performance at a given location;

detecting, using at least one bio-sensor, concurrent with the acquiring of the one or more of audio information and video information of the music performance, bio-information of at least one individual;

compressing a first portion of the one or more of audio information and video information, wherein the first portion corresponds to a predetermined time length of the one or more of audio information and video information; and

recording the acquired one or more of audio information and video information of the music performance in a fixed timing relationship with the bio-information of the at least one individual onto a recording medium, wherein a second portion of the bio-information corresponding to the predetermined time length is inserted into an area in the one or more of audio information and video information, wherein the area is formed by compressing the first portion.

12. The information recording method as set forth in claim 11, wherein the at least one individual includes a speaker, a player, an actor, or a conductor who serves as a source of the audio information, and/ or a performer or a photographed person who is included within the video information.

13. The information recording method as set forth in claim 11, wherein the at least one individual includes a listener who is present at the given location when the audio information is acquired and/or a viewer present at the given location when the video information is acquired.

14. The information recording method as set forth in claim 11, wherein the bio-information is selected from a group consisting of myoelectricity, body surface temperature, skin sweating, skin resistance, pulse, breath, micro-vibration, cardioelectricity, heartbeat, and blood pressure.

15. The information recording method as set forth in claim 11, wherein the recording medium is at least one of optical disc, magnetic tape, hard disc and semiconductor memory.

16. The information recording method as set forth in claim 11, wherein the bio-information is extracted from the one or more of audio information and video information of the music performance.

17. An information recording apparatus, comprising:

a microphone for acquiring audio information and an image pick-up device for acquiring video information of a music performance at a given location;

at least one bio-sensor for detecting, concurrent with the acquiring of one or more of the audio information and the video information of the music performance, bio-information of at least one individual;

an encoder for compressing a first portion of the one or more of the audio information and the video information, wherein the first portion corresponds to a predetermined time length of the one or more of the audio information and the video information; and

an information writing unit for recording the acquired one or more of the audio information and the video information of the music performance in a pre-defined timing relationship with the bio-information of the at least one individual onto a recording medium so as to allow synchronism between the one or more of the audio information and the video information and the bio-information, wherein a second portion of the bio-information corresponding to the predetermined time length is inserted into an area in the one or more of the audio information and the video information, wherein the area is formed by compressing the first portion.

18. The information recording apparatus as set forth in claim 17, wherein the at least one individual includes a speaker, a player, an actor, or a conductor who serves as a source of the audio information, and/or a performer or a photographed person who is included within the video information.

19. The information recording apparatus as set forth in claim 17, wherein the at least one individual includes a listener who is present at the given location when the audio information is acquired and/or a viewer present at the given location when the video information is acquired.

20. The information recording apparatus as set forth in claim 17, wherein the bio-information is selected from a group consisting of myoelectricity, body surface temperature, skin sweating, skin resistance, pulse, breath, micro-vibration, cardioelectricity, heartbeat, and blood pressure.

21. The information recording apparatus as set forth in claim 17, wherein the recording medium is selected from a group consisting of optical disc, magnetic tape, hard disc, and semiconductor memory.

22. The information recording apparatus as set forth in claim 17, wherein the at least one sensor extracts the bio-information from the one or more of the audio information and the video information.

23. An information reproducing method, comprising:

reproducing one or more of audio information and video information of a music performance at a given location;

reproducing, in a synchronism with the one or more audio information and video information, body motion information indicative of the music performance, and bio-information of at least one individual present at the given location, wherein

a first portion corresponding to a predetermined time length of the one or more of audio information and video information is compressed, and

a second portion of the bio-information corresponding to the predetermined time length is inserted into an area in the one or more of audio information and video information, wherein the area is formed by compressing the first portion;

providing, to a user, sense stimulation based on the body motion information indicative of the music performance and the bio-information of the at least one individual; and

generating video information for a moving image in correspondence with the body motion information indicative of the music performance.

24. The information reproducing method as set forth in claim 23, wherein the one or more of audio information and video information of the music performance at the given location, the body motion information indicative of the music performance, and the bio-information of the at least one individual present at the given location are received through a transmission method.

25. The information reproducing method as set forth in claim 23, wherein the one or more of audio information and video information of the music performance at the given location, the body motion information indicative of the music performance, and the bio-information of the at least one individual present at the given location are read out from a recording medium.

26. The information reproducing method as set forth in claim 23, wherein the at least one individual includes a speaker, a player, an actor, or a conductor who serves as a source of the audio information, and/or a performer or a photographed person who is included within the video information.

27. The information reproducing method as set forth in claim 23, wherein the at least one individual includes a listener present at the given location when the audio information is acquired and/ or a viewer present at the given location when the video information is acquired.

28. An information reproducing method, comprising:

reproducing body motion information indicative of a music performance at a given location and bio-information of at least one individual present at the given location;

controlling, based on the body motion information indicative of the music performance and the bio-information, reproduction of one or more of audio information and video information of the music performance so that the one or more of audio information and video information is reproduced in synchronism with the body motion information and the bio-information, wherein

a first portion corresponding to a predetermined time length of the one or more of audio information and video information is compressed, and

a second portion of the bio-information corresponding to the predetermined time length is inserted into an area in the one or more of audio information and video information, wherein the area is formed by compressing the first portion; and

generating video information for a moving image in correspondence with the body motion information indicative of the music performance.

29. The information reproducing method as set forth in claim 28, wherein the one or more of audio information and video information of the music performance at the given location, the body motion information indicative of the music performance, and the bio-information of the at least one individual present at the given location are received through a transmission medium.

30. The information reproducing method as set forth in claim 28, wherein the one or more of audio information and video information of the music performance at the given location, the body motion information indicative of the music performance, and the bio-information of the at least one individual present at the given location are read out from a record medium.

31. The information reproducing method as set forth in claim 28, wherein the at least one individual includes a speaker, a player, an actor, or a conductor who serves as a source of the audio information, and/or a performer or a photographed person who is included within the video information.

32. The information reproducing method as set forth in claim 28, wherein the at least one individual includes a listener present at the given location when the audio information is acquired and/ or a viewer present at the given location when the video information is acquired.

33. A system, comprising:

an information processing apparatus, including;

information acquiring means for acquiring one or more of audio information and video information of a music performance at a given location,

a bio-sensor for detecting, synchronously with the acquiring of the one or more of audio information and video information of the music performance, body motion information indicative of the music performance and bio-information of at least one individual present at the given location, and

an encoder for compressing a first portion of the one or more of audio information and video information, wherein the first portion corresponds to a predetermined time length of the one or more of audio information and video information, and wherein

a second portion of the bio-information corresponding to the predetermined time length is inserted into an area in the one or more of audio information and video information, wherein the area is formed by compressing the first portion; and

an information reproducing apparatus, including;

means for reproducing the one or more of audio information and video information of the music performance for delivery to a user,

means for providing, to the user, sense stimulation based on the body motion information indicative of the music performance and the bio-information concurrent with the delivery of the one or more of audio information and video information of the music performance so that the one or more of audio information and video information is reproduced in synchronism with the body motion information or the bio-information allowing reproduction of an atmosphere at the given location, and

means for generating video information for a moving image in correspondence with the body motion information indicative of the music performance.

34. The system as set forth in claim 33, wherein

the information processing apparatus includes:

means for transmitting the one or more of audio information and video information of the music performance, the body motion information indicative of the music performance, and the bio-information of the at least one individual; and

the information reproducing apparatus includes;

means for receiving the one or more of audio information and video information of the music performance, the body motion information indicative of the music performance, and the bio-information of the at least one individual through a transmission medium.

35. The system as set forth in claim 33, wherein

the information processing apparatus includes:

means for recording the one or more of audio information and video information of the music performance, the body motion information indicative of the music performance, and the bio-information of the at least one individual onto a recording medium; and

the information reproducing apparatus includes;

means for reading out the one or more of audio information and video information of the music performance, the body motion information indicative of the music performance, and the bio-information of the at least one individual from the recording medium.

36. The system as set forth in claim 33, wherein the at least one individual includes a speaker, a player, an actor, or a conductor who serves as a source of the audio information, and/or a performer or a photographed person who is included within the video information.

37. The system as set forth in claim 33, wherein the at least one individual includes a listener present at the given location when the audio information is acquired and/ or a viewer present at the given location when the video information is acquired.

38. A system, comprising:

an information processing apparatus, including;

information acquiring means for acquiring one or more of audio information and video information of a music performance at a given location, and

detecting means for detecting, concurrent with the acquiring of the one or more of audio information and video information of the music performance, body motion information indicative of the music performance and bio-information of at least one individual present at the given location, wherein

a first portion corresponding to a predetermined time length of the one or more of audio information and video information is compressed, and

a second portion of the bio-information corresponding to the predetermined time length is inserted into an area in the one or more of audio information and video information, wherein the area is formed by compressing the first portion; and

an information reproducing apparatus, including;

means for controlling, based on the body motion information indicative of the music performance and the bio-information, reproduction of the one or more of audio information and video information of the music performance so that the one or more of audio information and video information is reproduced in synchronism with the body motion information and the bio-information allowing reproduction of an atmosphere at the given location, and

means for generating video information for a moving image in correspondence with the body motion information indicative of the music performance.

39. The system as set forth in claim 38, wherein

the information processing apparatus includes:

means for transmitting the one or more of audio information and video information of the music performance, the body motion information indicative of the music performance, and the bio-information of the at least one individual; and

the information reproducing apparatus includes;

means for receiving the one or more of audio information and video information of the music performance, the body motion information indicative of the music performance, and the bio-information of the at least one individual through a transmission medium.

40. The system as set forth in claim 38, wherein

the information processing apparatus includes:

means for recording the one or more of audio information and video information of the music performance, the body motion information indicative of the music performance, and the bio-information of the at least one individual onto a recording medium; and

the information reproducing apparatus includes;

means for reading out the one or more of audio information and video information of the music performance, the body motion information indicative of the music performance, and the bio-information of the at least one individual from the recording medium.

41. The system as set forth in claim 38, wherein the at least one individual includes a speaker, a player, an actor, or a conductor who serves as a source of the audio information, and/or a performer or a photographed person who is included within the video information.

42. The system as set forth in claim 38, wherein the at least one individual includes a listener present at the given location when the audio information is acquired and/ or a viewer present at the given location when the video information is acquired.

43. A system, comprising:

an information recording apparatus, comprising;

information acquiring means for acquiring one or more of audio information and video information of a music performance at a given location,

a bio-sensor for detecting, concurrent with the acquiring of the one or more of audio information and video information of the music performance, bio-information of at least one individual present at the given location,

an encoder for compressing a first portion of the one or more of audio information and video information, wherein the first portion corresponds to a predetermined time length of the one or more of audio information and video information, and

recording means for recording the one or more of audio information and video information of the music performance in synchronism with the bio-information of the at least one individual, wherein a second portion of the bio-information corresponding to the predetermined time length is inserted into an area in the one or more of audio information and video information, wherein the area is formed by compressing the first portion; and

a non-transitory recording medium having recorded thereon the one or more of audio information and video information of the music performance in synchronism with the bio-information of the at least one individual.

44. The system as set forth in claim 43, wherein the at least one individual includes a speaker, a player, an actor, or a conductor who serves as a source of the audio information, and/or a performer or a photographed person who is included within the video information.

45. The system as set forth in claim 43, wherein the at least one individual includes a listener present at the given location when the audio information is acquired and/ or a viewer present at the given location when the video information is acquired.

46. The system as set forth in claim 43, wherein the bio-information is selected from a group consisting of myoelectricity, body surface temperature, skin sweating, skin resistance, pulse, breath, micro-vibration, cardioelectricity, heartbeat, and blood pressure.