Printable representations for time-based media

• US 7,747,655 B2
• Filed: 03/30/2004
• Issued: 06/29/2010
• Est. Priority Date: 11/19/2001
• Status: Active Grant

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Graham, Jamey, Hart, Peter E., Hull, Jonathan J.
• Primary Examiner(s): Stevens; Robert
• Application Number:
  US10/814,844
• Publication Number:
  US 20050010409A1
• Time in Patent Office: 2,282 Days
• Field of Search: 707/100, 715/500.1, 715/100, 715/201, 715/204, 715/209, 715/210, 704/221, 704/243, 704/245
• US Class Current: 707/802
• CPC Class Codes: G06K 15/00 Arrangements for producing a permanent visual presentation of the output data , e.g. computer output printersprinting or plotting combined with another operation, e.g. with conveying, G06K17/00
• CPC Class Codes: G06K 2215/0082 Architecture adapted for a particular function
• CPC Class Codes: G10H 1/00 Details of electrophonic musical instruments
• CPC Class Codes: G10H 2210/086 for transcription of raw audio or music data to a displayed or printed staff representation or to displayable MIDI-like note-oriented data, e.g. in pianoroll format
• CPC Class Codes: G10H 2240/056 MIDI or other note-oriented file format
• CPC Class Codes: G10H 2240/061 MP3, i.e. MPEG-1 or MPEG-2 Audio Layer III, lossy audio compression

Abstract

The system of the present invention allows a user to generate a representation of time-based media. The system of the present invention includes a feature extraction module for extracting features from media content. For example, the feature extraction module can detect solos in a musical performance, or can detect music, applause, speech, and the like. A formatting module formats a media representation generated by the system. The formatting module also applies feature extraction information to the representation, and formats the representation according to a representation specification. In addition, the system can include an augmented output device that generates a media representation based on the feature extraction information and the representation specification. The methods of the present invention include extracting features from media content, and formatting a media representation being generated using the extracted features and based on a specification or data structure specifying the representation format. The methods can also include generating a media representation based on the results of the formatting.

Claims

1. A computer system for generating a representation of time-based media, the system comprising:

a feature extraction module for;

extracting, using a feature extraction technique, features from the time-based media, the feature extraction technique specified by a document format specification file; and

generating a media representation of the time-based media that represents the extracted features, the media representation including a waveform representing the time based media including the extracted features, a corresponding timeline and a plurality of user-selectable identifiers indicating locations on the timeline corresponding to the extracted features;

a formatting module communicatively coupled to the feature extraction module, the formatting module for;

formatting the media representation according to layout parameters specified by the document format specification file; and

a printer communicatively coupled to the formatting module, the printer for;

printing the formatted media representation, wherein each of the plurality of user-selectable identifiers in the printed, formatted media representation can be selected to access a corresponding part of the time-based media.

2. The system of claim 1, wherein the feature extraction module further comprises content recognition software for recognizing features in the time-based media.

3. The system of claim 1, further comprising processing logic for controlling a printer driver interface associated with the printer.

4. The system of claim 1, further comprising processing logic for controlling a printer console on the printer.

5. The system of claim 1, wherein the feature extraction module is further adapted to generate the media representation in digital format.

6. The system of claim 1, wherein the feature extraction module is further adapted to generate the media representation in paper format.

7. The system of claim 1, wherein at least one of the user-selectable identifiers comprises a barcode printed on a document displaying the formatted media representation.

8. The system of claim 7, wherein the barcode on the document can be scanned to play time-based media associated with the extracted features on a display device.

9. The system of claim 1, wherein the waveform represents audio content.

10. The system of claim 1, wherein the timeline includes markers along its length that correspond to user-selected segments of the time-based media.

11. The system of claim 1, wherein the timeline includes markers along its length that correspond to segments of audio content, the segments being defined by a search for particular features within the time-based media.

12. The system of claim 1, wherein the timeline includes markers along its length that correspond to segments of media content, at least one of the markers having text information describing a corresponding segment of media content.

13. The system of claim 1, wherein the timeline includes markers along its length that each correspond to a segment of the time-based media, at least one of the markers having timestamp information describing the corresponding segment of the time-based media.

14. The system of claim 1, wherein the media representation includes a header describing the time-based media.

15. The system of claim 1, wherein the formatting module is further adapted to format the media representation according to format specifications included in the document format specification file.

16. The system of claim 15, wherein the format specifications included in the document format specification comprise a number of user-definable fields specifying a format of the media representation of the time-based media.

17. The system of claim 15, wherein the format specifications included in the document format specification comprise a number of user-definable fields specifying a layout of the media representation.

18. The system of claim 15, wherein the format specifications included in the document format specification comprise a number of user-definable fields specifying media content markers included in the media representation.

19. The system of claim 1, wherein the document format specification comprises a number of user-definable fields specifying feature extraction techniques to apply to the time-based media.

20. A method for generating a representation of time-based media, the method comprising:

extracting, using a feature extraction technique, features from the time-based media, the feature extraction technique specified by a document format specification file;

generating a media representation of the time-based media that represents the extracted features, the media representation including a waveform representing the time based media including the extracted features, a corresponding timeline and a plurality of user-selectable identifiers indicating locations on the timeline corresponding to the extracted features;

formatting the media representation according to layout parameters specified by the document format specification file; and

printing the formatted media representation, wherein each of the plurality of user-selectable identifiers in the printed, formatted media representation can be selected to access a corresponding part of the time-based media.

21. The method of claim 20, wherein extracting features from the time-based media further comprises performing keyword searching on the time-based media.

22. The method of claim 20, wherein extracting features from the time-based media further comprises performing speech recognition on the time-based media.

23. The method of claim 20, wherein extracting features from the time-based media further comprises performing event detection on the time-based media.

24. The method of claim 20, wherein the waveform represents audio content.

25. The method of claim 20, wherein at least one of the user-selectable identifiers comprises a barcode printed on a document displaying the formatted media representation.

26. The method of claim 25, wherein the barcode on the document can be scanned to play time-based media associated with the extracted features on a display device.

27. The method of claim 25, further comprising applying a barcode generation algorithm to render a barcode image including identifier information.

28. The method of claim 25, further comprising applying a barcode generation algorithm to render a barcode image including timestamp information.

29. The method of claim 20, further comprising generating markers along the timeline, the markers corresponding to user-selected segments of the time-based media.

30. The method of claim 20, further comprising generating markers along the timeline, at least one of the markers corresponding to features extracted from the time-based media.

31. The method of claim 20, further comprising generating markers along the timeline, at least one of the markers including text information describing the time-based media.

32. The method of claim 20, further comprising generating markers along the timeline, at least one of the markers including timestamp information describing the time-based media.

33. The method of claim 20, wherein printing the formatted media representation further comprises printing a header describing the time-based media.

34. The method of claim 20, wherein printing the formatted media representation further comprises generating a representation in digital format.

35. The method of claim 20, wherein printing the formatted media representation further comprises printing a representation in paper format.