Method and apparatus for providing multimedia data using event index

• US 20070088833A1
• Filed: 09/25/2006
• Published: 04/19/2007
• Est. Priority Date: 10/17/2005
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Choi, Ki-wan, Yoo, Myung-hyun, Yang, Gyung-hye, Chung, Seung-Nyung
• Granted Patent: US 8,718,447 B2
• Time in Patent Office: Days
• US Class Current: 709/227
• CPC Class Codes: G06F 16/41 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/436 using biological or physiological data of a human being, e.g. blood pressure, facial expression, gestures

Abstract

A method and apparatus for providing multimedia data using an event index are provided. The method includes; to detect a biometric signal of a user when the user captures a multimedia data, digitize the detected biometric signal and indexing the multimedia data using the result of the digitization, and selectively edit the indexed multimedia data and playing back the result of the selectively editing. Accordingly, it is possible to facilitate the management of moving data files by indexing part of a moving data corresponding to an emotional event of a user who has captured the moving data, editing the moving data according to the results of the indexing, and playing back the edited moving data to provide a preview of the moving data.

Claims

1. A method of providing multimedia data using an event index, comprising:

detecting a biometric signal of a user when the user captures a multimedia data;

digitizing the detected biometric signal and indexing the multimedia data using the result of the digitization; and

editing the indexed multimedia data.

2. The method of claim 1, further comprising:

playing back the result of the edited indexed multimedia data.

3. The method of claim 1, wherein the detecting the biometric signal of the user to detect the biometric signal of the user using a photoplethysmography (PPG) sensor, which is synchronized with a button used for capturing the multimedia data.

4. The method of claim 3, wherein the digitizing the detected biometric signal and indexing the multimedia data using the result of the digitizing comprises:

digitizing the detected biometric signal and obtaining a signal processing parameter from the result of the digitization;

determining an emotional event period for the signal processing parameter; and

indexing the multimedia data by recording the multimedia data in synchronization with the emotional event period.

5. The method of claim 4, wherein the determining an emotional event period for the signal processing parameter comprises:

determining whether an overlapping time period of a first interval before and after a peak value of the signal processing parameter is detected and a second interval before and after a user behavioral response to the multimedia data occurs meets a predetermined standard; and

determining the overlapping time period of the first interval before and after the peak value of the signal processing parameter is detected and the second interval before and after the user behavioural response to the multimedia data occurs as the emotional event period for the signal processing parameter if the corresponding overlapping time period meets the predetermined standard.

6. The method of claim 5, wherein the predetermined standard is whether the interval between the time when the peak value of the signal processing parameter is detected and the time when the user behavioural response to the multimedia data occurs is within a predetermined value, which is determined in consideration of the characteristic of the human body in that the time when a biometric signal is detected is not likely to coincide with the time when a user behavioural response occurs.

7. The method of claim 5, wherein the predetermined standard is whether the time when the user behavioural response to the multimedia data occurs prior to the detection of the peak value of the signal processing parameter and the interval between the time when the peak value of the signal processing parameter is detected and the time when the user behavioural response to the multimedia data occurs is within a predetermined value.

8. The method of claim 5, wherein the editing indexed multimedia data comprises:

adjusting the amount of part of the indexed multimedia data to be played back

9. The method of claim 8, further comprises:

playing back the multimedia data according to the results of the adjustment performed.

10. The method of claim 5, wherein the user behavioural response to the multimedia data comprises a facial response and/or a vocal response made by the user.

11. The method of claim 6, wherein the user behavioural response to the multimedia data comprises a facial response and/or a vocal response made by the user.

12. The method of claim 7, wherein the user behavioural response to the multimedia data comprises a facial response and/or a vocal response made by the user.

13. The method of claim 4, wherein the signal processing parameter is SDNN10, which is a standard deviation of heartbeat intervals of the user within ten seconds.

14. The method of claim 5, wherein the signal processing parameter is SDNN10, which is a standard deviation of heartbeat intervals of the user within ten seconds.

15. The method of claim 6, wherein the signal processing parameter is SDNN10, which is a standard deviation of heartbeat intervals of the user within ten seconds.

16. The method of claim 7, wherein the signal processing parameter is SDNN10, which is a standard deviation of heartbeat intervals of the user within ten seconds.

17. The method of claim 8, wherein the signal processing parameter is SDNN10, which is a standard deviation of heartbeat intervals of the user within ten seconds.

18. The method of claim 8, wherein adjusting the amount of part of the indexed multimedia data to be played back comprises adjusting a summarization level using a graphic user interface (GUI) of a multimedia player, which plays back the multimedia data, the summarization level representing the ratio of the length of the emotional event period and the length of the multimedia data.

19. The method of claim 18, wherein adjusting the amount of part of the indexed multimedia data to be played back comprises gradually or discontinuously varying the ratio of the amount of part of the multimedia data to be played

back and the amount of the remaining multimedia data not to be played back according to the summarization level,

wherein the ratio of the amount of part of the multimedia data to be played back and the amount of the remaining multimedia data not to be played back is represented by a progress bar of the multimedia player.

20. The method of claim 9, wherein playing back the multimedia data comprises:

indicating the times when the peak value of the signal processing parameter is respectively detected by displaying a plurality of pointers on a progress bar of a multimedia player, which plays back the multimedia data; and

if the user chooses one of the peak value detection times respectively indicated by the pointers, playing back part of the multimedia data corresponding to the peak value detection time chosen by the user.

21. The method of claim 9, wherein playing back the multimedia data comprises:

representing the emotional event period as a bar, which is filled with shades of a color and is located above a progress bar of a multimedia player, which plays back the multimedia data; and

if the user chooses a location on the bar, playing back part of the multimedia data corresponding to the chosen location.

22. The method of claim 18, wherein the user determines the summarization level by directly typing in a desired summarization rate and a desired summarization time to the multimedia player.

23. The method of claim 19, wherein the user determines the summarization level by directly typing in a desired summarization rate and a desired summarization time to the multimedia player.

24. A computer-readable recording medium storing a computer program to execute the method of claim 1.

53. The method of claim 1, wherein the indexed multimedia data is selectively edited and played back.

55. The method of claim 1, wherein the multimedia data is a multimedia image.

25. An apparatus for providing multimedia data using an event index, comprising:

a biometric signal detection unit to detect a biometric signal of a user when the user captures a multimedia data;

an indexing unit to digitize the detected biometric signal and index the multimedia data using the result of the digitization; and

a playback unit to edit the indexed multimedia data and plays back the result of the selectively editing.

26. The apparatus of claim 25, wherein the biometric signal detection unit detects the biometric signal of the user using a photoplethysmography (PPG) sensor, which is synchronized with a button used for capturing the multimedia data.

27. The apparatus of claim 26, wherein the indexing unit comprises:

a parameter calculator digitizes the detected biometric signal and obtains a signal processing parameter from the result of the digitization;

an event period generator which determines an emotional event period for the signal processing parameter; and

a synchronization recorder which indexes the multimedia data by recording the multimedia data in synchronization with the emotional event period.

28. The apparatus of claim 27, wherein the event period generator determines whether an overlapping time period of a first interval before and after a peak value of the signal processing parameter is detected and a second interval before and after a user behavioral response to the multimedia data occurs meets a predetermined standard;

and determines the overlapping time period of the first interval before and after the peak value of the signal processing parameter is detected and the second interval before and after the user behavioural response to the multimedia data occurs as the emotional event period for the signal processing parameter if the corresponding overlapping time period meets the predetermined standard.

29. The apparatus of claim 28, wherein the predetermined standard is whether the interval between the time when the peak value of the signal processing parameter is detected and the time when the user behavioural response to the multimedia data occurs is within a predetermined value, which is determined in consideration of the characteristic of the human body in that the time when a biometric signal is detected is not likely to coincide with the time when a user behavioural response occurs.

30. The apparatus of claim 28, wherein the predetermined standard is whether the time when the user behavioural response to the multimedia data occurs prior to the detection of the peak value of the signal processing parameter and the interval between the time when the peak value of the signal processing parameter is detected and the time when the user behavioural response to the multimedia data occurs is within a predetermined value.

31. The apparatus of claim 28, wherein the playback unit comprises an adjustment unit which adjusts the amount of part of the indexed multimedia data to be played back,

wherein the playback unit plays back the multimedia data according to the results of the adjustment performed by the adjustment unit.

32. The apparatus of claim 28, wherein the user behavioural response to the multimedia data comprises a facial response and/or a vocal response made by the user.

33. The apparatus of claim 29, wherein the user behavioural response to the multimedia data comprises a facial response and/or a vocal response made by the user.

34. The apparatus of claim 30, wherein the user behavioural response to the multimedia data comprises a facial response and/or a vocal response made by the user.

35. The apparatus of claim 27, wherein the signal processing parameter is SDNN10, which is a standard deviation of heartbeat intervals of the user within ten seconds.

36. The apparatus of claim 28, wherein the signal processing parameter is SDNN10, which is a standard deviation of heartbeat intervals of the user within ten seconds.

37. The apparatus of claim 29, wherein the signal processing parameter is SDNN10, which is a standard deviation of heartbeat intervals of the user within ten seconds.

38. The apparatus of claim 30, wherein the signal processing parameter is SDNN10, which is a standard deviation of heartbeat intervals of the user within ten seconds.

39. The apparatus of claim 31, wherein the signal processing parameter is SDNN10, which is a standard deviation of heartbeat intervals of the user within ten seconds.

40. The apparatus of claim 31, wherein the adjustment unit adjusts a summarization level using a graphic user interface (GUI) of a multimedia player, which plays back the multimedia data, wherein the summarization level represents the ratio of the length of the emotional event period and the length of the multimedia data.

41. The apparatus of claim 40, wherein the adjustment unit gradually or discontinuously varies the ratio of the amount of part of the multimedia data to be played back and the amount of the remaining multimedia data not to be played back according to the summarization level, wherein the ratio of the amount of part of the multimedia data to be played back and the amount of the remaining multimedia data not to be played back is represented by a progress bar of the multimedia player.

42. The apparatus of claim 31, wherein the playback unit indicates the times when the peak value of the signal processing parameter is respectively detected by displaying a plurality of pointers on a progress bar of a multimedia player, which plays back the multimedia data;

and if the user chooses one of the peak value detection times respectively indicated by the pointers, plays back part of the multimedia data corresponding to the peak value detection time chosen by the user.

43. The apparatus of claim 31, wherein the playback unit represents the emotional event period as a bar, which is filled with shades of a color and is located above a progress bar of a multimedia player, which plays back the multimedia data;

and if the user chooses a location on the bar, playing back part of the multimedia data corresponding to the chosen location.

44. The apparatus of claim 40, wherein the user determines the summarization level by directly typing in a desired summarization rate and a desired summarization time to the multimedia player.

45. The apparatus of claim 41, wherein the user determines the summarization level by directly typing in a desired summarization rate and a desired summarization time to the multimedia player.

54. The apparatus of claim 25, wherein the indexed multimedia data is selectively edited and played back.

56. The apparatus of claim 25, wherein the multimedia data is a multimedia image.

46. A method of recording and/or replaying a multimedia data using a biometric signal, comprising:

detecting a biometric signal of a user when the user captures a multimedia data;

indexing the multimedia data using the biometric signal;

recording the indexed multimedia data; and

replaying the indexed multimedia data.

47. The method of claim 46, further comprising:

editing the indexed multimedia data.

48. The method of claim 46, wherein in the biometric signal is a heart rate signal of the user.

49. The method of claim 46, wherein the detecting the biometric signal using a PPG(Photoplethysmography) sensor.

50. An apparatus for providing multimedia data, comprising:

a biometric signal detection unit to detect a biometric signal of a user when the user captures a multimedia data;

an indexing unit to index the multimedia data using the detected the biometric signal; and

a playback unit to playback the indexed multimedia data.

51. A method of recording and/or reproducing multimedia data using an biometric signal, comprising:

detecting a biometric signal of a user when the user captures the multimedia data;

indexing the multimedia data using the biometric signal;

selectively recording multimedia data using the biometric signal; and

reproducing the recorded multimedia data.

52. An apparatus for recording and/or playing back multimedia data, comprising:

a biometric signal detection unit to detect a biometric signal of a user when the user captures a multimedia data;

an indexing unit to index the multimedia data when recording the multimedia data using the detected biometric signal; and

a playback unit to vary the playback time of the multimedia data using the indexed multimedia data.