Printable representations for time-based media

• US 20050010409A1
• Filed: 03/30/2004
• Published: 01/13/2005
• Est. Priority Date: 11/19/2001
• Status: Active Grant

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Graham, Jamey, Hart, Peter E., Hull, Jonathan J.
• Granted Patent: US 7,747,655 B2
• Time in Patent Office: Days
• US Class Current: 704/243
• CPC Class Codes: G06K 15/00 Arrangements for producing a permanent visual presentation of the output data , e.g. computer output printersprinting or plotting combined with another operation, e.g. with conveying, G06K17/00
• CPC Class Codes: G06K 2215/0082 Architecture adapted for a particular function
• CPC Class Codes: G10H 1/00 Details of electrophonic musical instruments
• CPC Class Codes: G10H 2210/086 for transcription of raw audio or music data to a displayed or printed staff representation or to displayable MIDI-like note-oriented data, e.g. in pianoroll format
• CPC Class Codes: G10H 2240/056 MIDI or other note-oriented file format
• CPC Class Codes: G10H 2240/061 MP3, i.e. MPEG-1 or MPEG-2 Audio Layer III, lossy audio compression

Abstract

The system of the present invention allows a user to generate a representation of time-based media. The system of the present invention includes a feature extraction module for extracting features from media content. For example, the feature extraction module can detect solos in a musical performance, or can detect music, applause speech, and the like. A formatting module formats a media representation generated by the system. The formatting module also applies feature extraction information to the representation, and formats the representation according to a representation specification. In addition, the system can include an augmented output device that generates a media representation based on the feature extraction information and the representation specification. The methods of the present invention include extracting features from media content, and formatting a media representation being generated using the extracted features and based on a specification or data structure specifying the representation format. The methods can also include generating a media representation based on the results of the formatting.

Claims

1. A system for generating a representation of time-based media, the system comprising:

a feature extraction module for extracting features from media content; and

a formatting module for formatting a media representation generated by the system, the formatting module being communicatively coupled to the feature extraction module to apply feature extraction information to the representation, wherein the formatting module formats the representation according to a representation specification.

2. The system of claim 1, wherein the feature extraction module further comprises content recognition software for recognizing features in media content.

3. The system of claim 1, further comprising processing logic for controlling an augmented output device driver interface.

4. The system of claim 1, further comprising processing logic for controlling an augmented output device console.

5. The system of claim 1, wherein the media representation is generated in digital format.

6. The system of claim 1, wherein the media representation is generated in paper format.

7. The system of claim 1, wherein the media representation includes at least one user-selectable identifier allowing a user to access media content.

8. The system of claim 7, wherein the at least one user-selectable identifier comprises at least one barcode printed on the media representation.

9. The system of claim 7, wherein the at least one user-selectable identifier can be selected to play associated media content.

10. The system of claim 8, wherein the at least one barcode can be selected on the media representation by scanning the barcode to play the associated media content on a display device.

11. The system of claim 1, wherein the media representation includes a graphical representation of media content along a timeline.

12. The system of claim 11, wherein the graphical representation of audio content is displayed in audio waveform timeline.

13. The system of claim 11, wherein the timeline includes markers along its length that correspond to user-selected segments of media content.

14. The system of claim 11, wherein the timeline includes markers along its length that correspond to segments of audio content, the segments being defined by a search for particular features within the media content.

15. The system of claim 11, wherein the timeline includes markers along its length that correspond to segments of media content, at least one of the markers having text information describing the segment of media content.

16. The system of claim 11, wherein the timeline includes markers along its length that correspond to segments of media content, at least one of the markers having timestamp information describing the segment of media content.

17. The system of claim 1, wherein the media representation includes a header describing the media content.

18. The system of claim 1, wherein the media representation is generated according to format specifications included in a data structure.

19. The system of claim 18, wherein the format specifications included in the data structure comprise a number of user-definable fields specifying the format of a graphical representation printed on the media representation.

20. The system of claim 18, wherein the format specifications included in the data structure comprise a number of user-definable fields specifying the layout of the media representation.

21. The system of claim 18, wherein the format specifications included in the data structure comprise a number of user-definable fields specifying the media content markers included in the media representation.

22. The system of claim 20, wherein the format specifications included in the data structure comprise a number of user-definable fields specifying the feature extraction applied to the media content.

23. The system of claim 1, further comprising an augmented output device for generating a media representation, the augmented output device being communicatively coupled to the formatting module to receive instructions for generation of a media representation.

24. The system of claim 23, wherein the augmented output device includes a printer for printing media representations on paper.

25. A method for generating a representation of time-based media, the method comprising:

extracting features from media content; and

formatting the representation according to a representation specification, the formatting including applying feature extraction information.

26. The method of claim 25, further comprising generating a representation of media content.

27. The method of claim 25, wherein extracting features of media content further comprises performing keyword searching on the media data.

28. The method of claim 25, wherein extracting features of media content further comprises performing speech recognition on the media data.

29. The method of claim 25, wherein extracting features of media content further comprises performing event detection on the media data.

30. The method of claim 26, wherein generating a representation further comprises generating a graphical representation of media content along a timeline.

31. The method of claim 30, wherein generating a graphical representation further comprises generating an audio content waveform along a timeline.

32. The method of claim 26, wherein generating a representation further comprises generating at least one user-selectable identifier in the media representation that allows a user to access media content.

33. The method of claim 32, wherein generating at least one user-selectable identifier comprises generating at least one barcode printed on the media representation.

34. The method of claim 33, further comprising selecting the at least one user-selectable identifier on the media representation by scanning the barcode to play the associated media content on a display device.

35. The method of claim 30, wherein generating a graphical representation along a timeline further comprises generating markers along a timeline, the markers corresponding to user-selected media content.

36. The method of claim 30, wherein generating a graphical representation along a timeline further comprises generating markers along a timeline, at least one of the markers corresponding to features extracted from the media content.

37. The method of claim 30, wherein generating a graphical representation along a timeline further comprises generating markers along a timeline, at least one of the markers including text information describing the media content.

38. The method of claim 30, wherein generating a graphical representation along a timeline further comprises generating markers along a timeline, at least one of the markers including timestamp information describing the media content.

39. The method of claim 26, wherein generating a representation further comprises generating a header describing the media content.

40. The method of claim 26, wherein generating a representation further comprises generating a representation in digital format.

41. The method of claim 26, wherein generating a representation further comprises printing a representation in paper format.

42. The method of claim 25, wherein formatting the representation according to a representation specification further comprises defining the format of a media representation using a data structure with format specifications.

43. The method of claim 25, further comprising inputting audio content and a representation specification into the system.

44. The method of claim 33, wherein generating at least one barcode further comprises applying a barcode generation algorithm to render a barcode image including identifier information.

45. The method of claim 33, wherein generating at least one barcode further comprises applying a barcode generation algorithm to render a barcode image including timestamp information.