Methods and apparatus for selecting and providing content data using content data status information

• US 7,610,260 B2
• Filed: 07/13/2006
• Issued: 10/27/2009
• Est. Priority Date: 07/19/2005
• Status: Expired due to Fees

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Inoue, Makoto, Sako, Yoichiro, Terauchi, Toshiro, Nakamura, Takatoshi, Shirai, Katsuya, Takehara, Mitsuru, Asukai, Masamichi
• Primary Examiner(s): Vital; Pierre M
• Assistant Examiner(s): LIAO, JASON G
• Application Number:
  US11/486,334
• Publication Number:
  US 20070022112A1
• Time in Patent Office: 1,202 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: Y10S 707/99931 Database or file accessing
• CPC Class Codes: Y10S 707/99953 Recoverability

Abstract

Methods and apparatus for selecting and providing content data such as visual data and audio data. Pieces of content data are associated with corresponding metadata. The metadata includes information regarding a status at the time of generation of the content data. For example, at the time a picture is taken. The status may include information such as a time, location, and bio-information of a user. A recollection value, representing the significance in recollecting the user'"'"'s memory, is calculated for each piece of content data using the associated metadata. Content data is selected for output based on the recollection values. Various types of content data may be selected at appropriate times so that the content data will affect the user'"'"'s memory or feeling.

Claims

1. A storage medium storing a plurality of pieces of content data, each of the plurality of pieces of content data stored in the storage medium captured by a camera and/or audio recorder and having metadata attached thereto, the metadata including information regarding a status, the status determined at a time of capture, the time of capture being a time the piece of content data was captured by the camera and/or audio recorder;

a processor configured to calculate a recollection value of each of the plurality of pieces of content data stored in the storage medium using the metadata associated with the piece of content data and to select a piece of content data from the plurality of pieces of content data stored in the storage medium to be output, the selected piece of content data selected based on the recollection values of the individual pieces of content data;

an output device for outputting the selected piece of content data;

wherein the output device is configured to adjust an output parameter in accordance with an emotional value and a nostalgia value;

wherein the selected piece of content data is audio data captured by the audio recorder, the audio recorder having a microphone,

wherein when the piece of content data that is output is the audio data, the output device adjusts at least a parameter regarding output level in accordance with a magnitude of the emotional value and adjusts at least a parameter regarding audio quality in accordance with a magnitude of the nostalgia value.

2. The information providing apparatus according to claim 1, wherein the emotional value decreases with time:

wherein the nostalgia value increases with time; and

wherein the processor calculates the recollection value of each of the plurality of pieces of content data based on the emotional value and the nostalgia value.

3. The information providing apparatus according to claim 1, wherein the processor is configured to increase the emotional value and decrease the nostalgia value of the selected piece of content data output via the output device.

4. The information providing apparatus according to claim 1, further comprising:

an input unit configured to accept input of an instruction by an operation by a user,

wherein the processor is configured to correct a magnitude of the emotional value and a magnitude of the nostalgia value of each piece of content data output via the output device, based on the instruction input by the operation by the user and accepted via the input unit in association with the piece of content data output via the output device.

5. The information providing apparatus according to claim 1,

wherein the information regarding a status determined at the time of capture of the piece of content data includes time information, position information, and user-emotion information at the time of capture of the piece of content data,

wherein the processor manages each of the plurality of pieces of content data using the metadata based on three axes including a time axis, a position axis, and an emotion axis, and clusters the plurality of pieces of content data based on spatial distances based on the three axes,

wherein the processor calculates individual recollection values of a plurality of clusters, each of the recollection values corresponding to a sum of the recollection values of pieces of content data belonging to the associated cluster,

wherein the processor selects a cluster that is to be output based on the individual recollection values of the plurality of clusters, and

wherein the output device is configured to output content data on a cluster-by-cluster basis correspondingly to each selected cluster.

6. The information providing apparatus according to claim 5, further comprising:

an input unit configured to accept input of an instruction by an operation by a user,

wherein the processor is configured to correct a magnitude of the emotional value and a magnitude of the nostalgia value of each piece of content data output via the output device, based on the instruction input by the operation by the user and accepted via the input unit in association with the piece of content data output via the output device.

7. The information providing apparatus according to claim 5,

wherein the processor changes a probability of selecting each of the plurality of pieces of content data or each of the plurality of clusters in accordance with an amount of attenuation of the emotional value associated with the piece of content data or the cluster.

8. The information providing apparatus according to claim 5,

wherein the processor changes a probability of selecting each of the plurality of pieces of content data or each of the plurality of clusters in accordance with an amount of attenuation of the nostalgia value associated with the piece of content data or the cluster.

9. The information providing apparatus according to claim 5,

wherein the processor changes a probability of selecting each of the plurality of pieces of content data or each of the plurality of clusters in accordance with a linear combination of a magnitude of the emotional value and a magnitude of the nostalgia value associated with the piece of content data or the cluster.

10. The information providing apparatus according to claim 1,

wherein the selected piece of content data comprises image data captured by the camera;

wherein the output device comprises a display,

wherein when the piece of content data that is output comprises the image data, the output device adjusts one or more parameters among display period, display area size, and luminance in accordance with a magnitude of the emotional value, and adjusts one or more parameters among transparency and color saturation in accordance with a magnitude of the nostalgia value.

11. The information providing apparatus according to claim 5, further comprising:

status obtaining device for obtaining information regarding a current status when a piece of content data is to be output,

wherein the processor calculates a degree of reproduction representing a degree of similarity between the information regarding the status at the time of capture, the information being included in the metadata attached to each of the plurality of pieces of content data stored in the storage medium, and the information regarding the current status obtained by the status obtaining device,

wherein the processor selects the piece of content data or the cluster based on magnitudes of the recollection values and the degrees of reproduction of the individual pieces of content data.

12. The information providing apparatus according to claim 11,

wherein the status obtaining device at least includes

a timekeeping circuit for providing a current time;

a position determining device for providing a current position; and

a bio-sensor for detecting bio-information relating to emotion,

wherein the time information comprises the current time at the time of capture of the piece of content data, the position information comprises the current position at the time of capture of the piece of content data, and the user-emotion information comprises bio-information relating to emotion at the time of capture of the piece of content data.

13. An information providing method comprising the steps of:

Storing a plurality of pieces of content data in storage means, each of the plurality of pieces of content data having metadata attached thereto, the metadata including information regarding a status, the status determined at a time of capture, the time of capture being a time the piece of content data was captured by a camera and/or audio recorder;

calculating a recollection value of each of the plurality of pieces of content data stored in the storage means, using the metadata associated with the piece of content data;

selecting a piece of content data from the plurality of pieces of content data that is to be output, based on the calculated recollection values of the individual pieces of content data;

outputting the selected piece of content data, wherein the selecting is performed after the storing;

wherein when the selected piece of content data is output, and output parameter is adjusted in accordance with an emotional value and a nostalgia value;

wherein the selected piece of content data is audio data captured by the audio recorder, the audio recorder having a microphone,

wherein when the piece of content data that is output is the audio data, at least a parameter regarding output level is adjusted in accordance with a magnitude of the emotional value, and at least a parameter regarding audio quality is adjusted in accordance with a magnitude of the nostalgia value.

14. The information providing method according to claim 13,

wherein the emotional value decreases with time;

wherein the nostalgia value increases with time; and

wherein the recollection value of each of the plurality of pieces of content data is calculated based on the emotional value and the nostalgia.

15. The information providing method according to claim 13, further comprising the step of:

exercising management so as to increase the emotional value and decrease the nostalgia value of the piece of content data output.

16. The information providing method according to claim 13, further comprising the steps of:

accepting input of an instruction by an operation by a user; and

correcting a magnitude of the emotional value and a magnitude of the nostalgia value of each piece of content data output, based on the instruction input by the operation by the user and accepted in association with the piece of content data output.

17. The information providing method according to claim 13,

wherein the metadata of each of the plurality of pieces of content data stored in the storage means includes time information, position information, and user-emotion information at the time of capture of the piece of content data,

wherein the information providing method includes the step of managing each of the plurality of pieces of content data using the metadata based on three axes including a time axis, a position axis, and an emotion axis, and clustering the plurality of pieces of content data based on spatial distances based on the three axes,

wherein individual recollection values of a plurality of clusters formed by the clustering are calculated, each of the recollection values corresponding to a sum of the recollection values of pieces of content data belonging to the associated cluster,

wherein a cluster that is to be output is selected based on the individual recollection values of the plurality of clusters, and

wherein content data is output on a cluster-by-cluster basis correspondingly to each cluster selected.

18. The information providing method according to claim 17, further comprising the steps of:

accepting input of an instruction by an operation by a user; and

correcting a magnitude of the emotional value and a magnitude of the nostalgia value of each piece of content data output, based on the instruction input by the operation by the user and accepted in association with the piece of content data output.

19. The information providing method according to claim 17,

wherein a probability of selecting each of the plurality of pieces of content data or each of the plurality of clusters is changed in accordance with an amount of attenuation of the emotional value associated with the piece of content data or the cluster.

20. The information providing method according to claim 17,

wherein a probability of selecting each of the plurality of pieces of content data or each of the plurality of clusters is changed in accordance with an amount of attenuation of the nostalgia value associated with the piece of content data or the cluster.

21. The information providing method according to claim 17,

wherein a probability of selecting each of the plurality of pieces of content data or each of the plurality of clusters is changed in accordance with a linear combination of a magnitude of the emotional value and a magnitude of the nostalgia value associated with the piece of content data or the cluster.

22. The information providing method according to claim 15,

wherein the selected piece of content data comprises image data captured by the camera;

wherein when the piece of content data that is output comprises the image data, one or more parameters among display period, display area size, and luminance are adjusted in accordance with a magnitude of the emotional value, and one or more parameters among transparency and color saturation are adjusted in accordance with a magnitude of the nostalgia value.

23. The information providing method according to claim 17, further comprising the steps of:

obtaining information regarding a current status when a piece of content data is to be output; and

calculating a degree of reproduction representing a degree of similarity between information regarding the status at the time of capture, the information being included in the metadata attached to each of the plurality of pieces of content data stored in the storage means, and the information regarding the current status obtained;

wherein the piece of content data or the cluster is selected based on magnitudes of the recollection values and the degrees of reproduction of the individual pieces of content data.

24. The information providing method according to claim 23,

wherein the step of obtaining information regarding a current status at least includes the steps of

obtaining a current time;

obtaining a current position; and

detecting bio-information relating to emotion.

25. A computer-storage medium comprising computer-executable modules, the modules comprising:

a storage module storing a plurality of pieces of content data, each of the plurality of pieces of content data having metadata attaché

thereto, the metadata including information regarding a status of a user, the status determined at a time of user perceivable generation of the piece of content data;

a value calculator module configured to calculate a recollection value of each of the plurality of pieces of content data stored in the storage unit, using the metadata attached to the piece of content data;

a selector module configured to select a piece of content data from the plurality of pieces of content data stored by the storage module that is to be output by an output device, based on the recollection values of the individual pieces of content data;

wherein when the selected piece of content data is output, and output parameter is adjusted in accordance with an emotional value and a nostalgia value;

wherein the selected piece of content data is audio data captured by the audio recorder, the audio recorder having a microphone,

wherein when the piece of content data that is output is the audio data, at least a parameter regarding output level is adjusted in accordance with a magnitude of the emotional value, and at least a parameter regarding audio quality is adjusted in accordance with a magnitude of the nostalgia value.