Recording apparatus, reproducing apparatus, recording and reproducing apparatus, recording method, reproducing method, recording and reproducing method, and record medium

• US 8,945,008 B2
• Filed: 04/04/2007
• Issued: 02/03/2015
• Est. Priority Date: 04/05/2006
• Status: Expired due to Fees

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Takehara, Mitsuru, Sako, Yoichiro, Terauchi, Toshiro
• Primary Examiner(s): Thomson, William
• Assistant Examiner(s): JIAN, SHIRLEY XUEYING
• Application Number:
  US11/919,266
• Publication Number:
  US 20090048494A1
• Time in Patent Office: 2,862 Days
• US Class Current: 600/301
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/436 using biological or physiological data of a human being, e.g. blood pressure, facial expression, gestures
• CPC Class Codes: G06F 16/489 using time information
• CPC Class Codes: G06F 2203/011 Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: G11B 27/30 on the same track as the main recording
• CPC Class Codes: G11B 27/322 used signal is digitally coded
• CPC Class Codes: H04N 21/4122 additional display device, e.g. video projector digital output for controlling a plurality of local displays G06F3/1423
• CPC Class Codes: H04N 21/4147 PVR [Personal Video Recorder] H04N5/76 takes precedence ; arrangements for broadcast with accumulation-type receivers H04H20/40
• CPC Class Codes: H04N 21/42201 biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user input arrangements for interaction with the human body based on nervous system activity detection G06F3/015
• CPC Class Codes: H04N 21/42202 environmental sensors, e.g. for detecting temperature, luminosity, pressure, earthquakes
• CPC Class Codes: H04N 21/44 Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
• CPC Class Codes: H04N 5/765 Interface circuits between an apparatus for recording and another apparatus
• CPC Class Codes: H04N 9/8042 involving data reduction
• CPC Class Codes: H04N 9/8063 using time division multiplex of the PCM audio and PCM video signals
• CPC Class Codes: H04N 9/8205 involving the multiplexing of an additional signal and the colour video signal
• CPC Class Codes: H04N 9/8233 the additional signal being a character code signal

Abstract

Changes of a user'"'"'s emotion that occurs when content is reproduced and a user'"'"'s surrounding environment that occurs when the content is reproduced are recorded as sensing meta data and content is reproduced in a reproducing mode corresponding to the recorded sensing meta data. Content supplied from a content providing section 11 is normally reproduced. A human body sensor 24 measures biological information of a user of content. An environmental sensor 25 measures a user'"'"'s surrounding environment. A sensing meta data generating section 19 generates sensing meta data using information detected by at least one of the human body sensor 24 and the environmental sensor 25. A recording processing section 20 records the generated sensing meta data to a record medium 21. A reproducing processing section 23 reproduces sensing meta data. A reproducing control section 12 reproduces content in a reproducing mode that changes corresponding to the reproduced sensing meta data.

Claims

1. A recording and reproducing apparatus comprising:

a content providing section that provides entertainment content comprising a movie, music, and/or a photo;

a biological information measuring section that measures at least one user'"'"'s biological information while the entertainment content is reproduced;

an environment measuring section that measures at least one environmental characteristic of the at least one user'"'"'s surrounding environment while the entertainment content is reproduced, the at least one environmental characteristic being selected from the group consisting of temperature, humidity, airflow volume, atmospheric pressure, weather, and location;

a sensing metadata generating section that generates sensing metadata using information detected by the biological information measuring section and the environment measuring section;

a recording processing section that records in at least one storage medium the sensing metadata and the entertainment content such that the sensing metadata are associated with the entertainment content, and such that the at least one measured environmental characteristic is associated with the entertainment content that was being reproduced when the at least one environmental characteristic was measured; and

a reproducing controlling section that reproduces the entertainment content a second time different from the first time, in an enhanced reproducing mode adapted, based on the sensing metadata, to reinforce the at least one user'"'"'s memory of changes of the at least one user'"'"'s emotion that occurred while the entertainment content was reproduced the first time and/or the at least one user'"'"'s surrounding environment that was measured while the entertainment content was reproduced the first time, wherein reproducing the entertainment content the second time in the enhanced reproducing mode comprises adjusting one or more features within the entertainment content to cause the memory to recur.

2. The recording and reproducing apparatus of claim 1, wherein the entertainment content comprises picture content, and wherein reproducing the entertainment content the second time in the enhanced reproducing mode comprises changing a luminance level, contrast, and/or hue of the picture content corresponding to the at least one user'"'"'s emotion at a reproducing position and/or in a reproducing region of the picture content described in the sensing metadata.

3. The recording and reproducing apparatus of claim 1, wherein the entertainment content comprises audio content, and wherein reproducing the entertainment content the second time in the enhanced reproducing mode comprises changing a frequency characteristic and/or a sound volume level and/or creating a sound effect for the audio content corresponding to the at least one user'"'"'s emotion in a particular region of the audio content described in the sensing metadata.

4. A reproducing apparatus that reproduces entertainment content comprising a movie, music, and/or a photo, the reproducing apparatus comprising:

a reproducing processing section that reproduces sensing metadata from at least one storage medium, wherein the sensing metadata was generated using biological information measured from at least one user while the entertainment content was reproduced a first time and/or environmental information measured from the at least one user'"'"'s surrounding environment while the entertainment content was reproduced the first time; and

a reproducing controlling section that reproduces the entertainment content a second time different from the first time, in an enhanced reproducing mode adapted, based on the sensing metadata, to reinforce the at least one user'"'"'s memory of changes of the at least one user'"'"'s emotion that occurred while the entertainment content was reproduced the first time and/or the at least one user'"'"'s surrounding environment that was measured while the entertainment content was reproduced the first time, wherein reproducing the entertainment content the second time in the enhanced reproducing mode comprises adjusting one or more features within the entertainment content to cause the memory to recur.

5. The reproducing apparatus as set forth in claim 4, wherein the reproducing controlling section reproduces the entertainment content such that the at least one user of the entertainment content is capable of recognizing the at least one user'"'"'s surrounding environment specified by the sensing metadata.

6. A recording and reproducing apparatus, comprising:

a content providing section that provides entertainment content comprising a movie, music, and/or a photo;

a biological information measuring section that measures at least one user'"'"'s biological information while the entertainment content is reproduced a first time and/or an environment measuring section that measures the at least one user'"'"'s surrounding environment while the entertainment content is reproduced the first time;

a sensing metadata generating section that generates sensing metadata using information detected by the biological information measuring section and/or the environment measuring section;

a recording processing section that records in at least one storage medium the sensing metadata in association with the entertainment content; and

a reproducing controlling section that reproduces the entertainment content a second time different from the first time, in an enhanced reproducing mode adapted, based on the sensing metadata, to reinforce the at least one user'"'"'s memory of changes of the at least one user'"'"'s emotion that occurred while the entertainment content was reproduced the first time and/or the at least one user'"'"'s surrounding environment that was measured while the entertainment content was reproduced the first time, wherein reproducing the entertainment content the second time in the enhanced reproducing mode comprises adjusting one or more features within the entertainment content to cause the memory to recur.

7. The recording and reproducing apparatus as set forth in claim 6, wherein the reproducing controlling section reproduces the entertainment content such that the at least one user of the entertainment content is capable of recognizing the at least one user'"'"'s surrounding environment specified by the sensing metadata.

8. The recording and reproducing apparatus of claim 6, wherein the entertainment content comprises picture content, and wherein reproducing the entertainment content the second time in the enhanced reproducing mode comprises changing a luminance level, contrast, and/or hue of the picture content corresponding to the at least one user'"'"'s emotion at a reproducing position and/or in a reproducing region of the picture content described in the sensing metadata.

9. The recording and reproducing apparatus of claim 6, wherein the entertainment content comprises audio content, and wherein reproducing the entertainment content the second time in the enhanced reproducing mode comprises changing a frequency characteristic and/or a sound volume level and/or creating a sound effect for the audio content corresponding to the at least one user'"'"'s emotion in a particular region of the audio content described in the sensing metadata.

10. A recording and reproducing method, comprising:

generating, using at least one computer, sensing metadata using at least one user'"'"'s biological information measured while entertainment content comprising a movie, music, and/or a photo is reproduced and environmental information measured from the at least one user'"'"'s surrounding environment while the entertainment content is reproduced, the environmental information comprising at least one measurement of at least one characteristic selected from the group consisting of temperature, humidity, airflow volume, atmospheric pressure, weather, and location;

recording in at least one storage medium the sensing metadata and the entertainment content such that the sensing metadata are associated with the entertainment content, and such that the environmental information is associated with the entertainment content that was being reproduced when the environmental information was measured; and

reproducing the entertainment content a second time different from the first time, in an enhanced reproducing mode adapted, based on the sensing metadata, to reinforce the at least one user'"'"'s memory of changes of the at least one user'"'"'s emotion that occurred while the entertainment content was reproduced the first time and/or the at least one user'"'"'s surrounding environment that was measured while the entertainment content was reproduced the first time, wherein reproducing the entertainment content the second time in the enhanced reproducing mode comprises adjusting one or more features within the entertainment content to cause the memory to recur.

11. The recording and reproducing method of claim 10, wherein the entertainment content comprises picture content, and wherein reproducing the entertainment content the second time in the enhanced reproducing mode comprises changing a luminance level, contrast, and/or hue of the picture content corresponding to the at least one user'"'"'s emotion at a reproducing position and/or in a reproducing region of the picture content described in the sensing metadata.

12. The recording and reproducing method of claim 10, wherein the entertainment content comprises audio content, and wherein reproducing the entertainment content the second time in the enhanced reproducing mode comprises changing a frequency characteristic and/or a sound volume level and/or creating a sound effect for the audio content corresponding to the at least one user'"'"'s emotion in a particular region of the audio content described in the sensing metadata.

13. A reproducing method of reproducing entertainment content comprising a movie, music, and/or a photo, the reproducing method comprising:

reproducing from a storage medium sensing metadata generated using biological information measured from at least one user while the entertainment content was reproduced a first time and/or environmental information measured from the at least one user'"'"'s surrounding environment while the entertainment content was reproduced the first time; and

reproducing the entertainment content a second time different from the first time, in an enhanced reproducing mode adapted, based on the sensing metadata, to reinforce the at least one user'"'"'s memory of changes of the at least one user'"'"'s emotion that occurred while the entertainment content was reproduced the first time and/or the at least one user'"'"'s surrounding environment that was measured while the entertainment content was reproduced the first time, wherein reproducing the entertainment content the second time in the enhanced reproducing mode comprises adjusting one or more features within the entertainment content to cause the memory to recur.

14. A recording and reproducing method, comprising:

generating sensing metadata using biological information measured from at least one user while entertainment content comprising a movie, music, and/or a photo is reproduced a first time and/or environmental information measured from the at least one user'"'"'s surrounding environment while the entertainment content is reproduced the first time;

recording in at least one storage medium the sensing meta data and the entertainment content such that the sensing metadata are associated with the entertainment content; and

reproducing the entertainment content a second time different from the first time, in an enhanced reproducing mode adapted, based on the sensing metadata, to reinforce the at least one user'"'"'s memory of changes of the at least one user'"'"'s emotion that occurred while the entertainment content was reproduced the first time and/or the at least one user'"'"'s surrounding environment that was measured while the entertainment content was reproduced the first time, wherein reproducing the entertainment content the second time in the enhanced reproducing mode comprises adjusting one or more features within the entertainment content to cause the memory to recur.

15. The recording and reproducing method of claim 14, wherein the entertainment content comprises picture content, and wherein reproducing the entertainment content the second time in the enhanced reproducing mode comprises changing a luminance level, contrast, and/or hue of the picture content corresponding to the at least one user'"'"'s emotion at a reproducing position and/or in a reproducing region of the picture content described in the sensing metadata.

16. The recording and reproducing method of claim 14, wherein the entertainment content comprises audio content, and wherein reproducing the entertainment content the second time in the enhanced reproducing mode comprises changing a frequency characteristic and/or a sound volume level and/or creating a sound effect for the audio content corresponding to the at least one user'"'"'s emotion in a particular region of the audio content described in the sensing metadata.

17. At least one computer-readable storage medium storing program instructions for causing a computer to:

reproduce sensing metadata generated using at least one user'"'"'s biological information measured while entertainment content comprising a movie, music, and/or a photo was reproduced a first time and environmental information measured from the at least one user'"'"'s surrounding environment while the entertainment content was reproduced the first time; and

reproduce the entertainment content a second time different from the first time, in an enhanced reproducing mode adapted, based on the sensing metadata, to reinforce the at least one user'"'"'s memory of changes of the at least one user'"'"'s emotion that occurred while the entertainment content was reproduced the first time and/or the at least one user'"'"'s surrounding environment that was measured while the entertainment content was reproduced the first time, wherein reproducing the entertainment content the second time in the enhanced reproducing mode comprises adjusting one or more features within the entertainment content to cause the memory to recur.