Printer with audio/video localization

• US 7,415,670 B2
• Filed: 03/30/2004
• Issued: 08/19/2008
• Est. Priority Date: 11/19/2001
• Status: Expired due to Term

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Hart, Peter E., Hull, Jonathan J., Erol, Berna
• Primary Examiner(s): BAUTISTA, XIOMARA L
• Application Number:
  US10/813,946
• Publication Number:
  US 20050034057A1
• Time in Patent Office: 1,603 Days
• Field of Search: 715/500, 715/500.1, 715/501.1, 715/513, 715/517, 715/523, 715/526, 715/700, 715/726, 715/717, 715/719, 715/727, 715/764, 715/835, 715/838, 715/839, 715/855, 715/978, 715200-203, 715/205, 715/234, 715/276, 358/1.1, 358/1.15, 358/1.18, 358/530, 358/540, 382/173, 705/55
• US Class Current: 715/716
• CPC Class Codes: G06F 40/106 Display of layout of documents; Previewing
• CPC Class Codes: G06F 40/169 Annotation, e.g. comment data or footnotes
• CPC Class Codes: G10H 1/00 Details of electrophonic musical instruments
• CPC Class Codes: G10H 2210/086 for transcription of raw audio or music data to a displayed or printed staff representation or to displayable MIDI-like note-oriented data, e.g. in pianoroll format
• CPC Class Codes: G10H 2240/056 MIDI or other note-oriented file format
• CPC Class Codes: G10H 2240/061 MP3, i.e. MPEG-1 or MPEG-2 Audio Layer III, lossy audio compression

Abstract

A multimedia printing device receives multimedia data, processes it, and outputs it, thereby enhancing the handling and use of such data. In an embodiment, the processed data are output in a variety of formats, including on video paper, through a multimedia broadcast, or a bar code pointer to a digital archive. In another embodiment, the multimedia printing device receives multimedia data and uses the data to perform multimedia and video localization on the peripheral devices that generate the multimedia data. In another embodiment, the multimedia printing device carries out commands to capture and process multimedia data, including by inserting multimedia objects into existing documents.

Claims

1. A method, comprising:

receiving multimedia data by a multimedia printer for outputting a document;

processing the multimedia data, by the multimedia printer, to identify at least one multimedia event in the multimedia data and generate a continuous timeline of the multimedia data;

associating the multimedia event with a location in the timeline; and

outputting, by the multimedia printer, a graphical representation of the timeline, wherein the graphical representation comprises a representation of the at least one identified multimedia event.

2. The method of claim 1, wherein the multimedia data is one from a group of audio data and video data.

3. The method of claim 1, wherein the multimedia data is a multimedia data stream.

4. The method of claim 1, wherein the multimedia data is received from a network.

5. The method of claim 1, wherein the multimedia data is received from a storage device.

6. The method of claim 1, wherein the step of processing the multimedia data further comprises:

identifying a pre-determined multimedia event in the multimedia data.

7. The method of claim 6, further comprising:

performing an action if the pre-determined multimedia event is identified.

8. The method of claim 6, further comprising:

performing an action associated with the multimedia event in an event table if the pre-determined multimedia event is identified.

9. The method of claim 1, wherein the step of receiving includes receiving the multimedia data in an analog format;

and the method further comprises;

converting the multimedia data from the analog format to a digital format.

10. The method of claim 1, wherein the step of outputting the processed multimedia data is performed by writing the processed multimedia data to an archive file.

11. The method of claim 1, wherein the processed multimedia data comprises a representation of the multimedia data received by the multimedia printer.

12. The method of claim 1, wherein the step of outputting the processed multimedia data includes outputting portions of the multimedia data as video paper.

13. The method of claim 1, wherein the step of outputting the processed multimedia data includes printing portions of the multimedia data as a paper document.

14. The method of claim 1, wherein the step of outputting the processed multimedia data includes storing portions of the multimedia data to a sewer from which the processed multimedia data can be accessed and displayed.

15. The method of claim 1, wherein the multimedia data is video data, and wherein the step of processing the multimedia data includes capturing a video frame from the video data and saving it to a file.

16. The method of claim 1, wherein the step of outputting further comprises saving the processed multimedia data to a storage medium and indexing the processed data.

17. The method of claim 1, wherein the multimedia data is audio data, and further comprising:

transcribing the audio data into text and wherein the step of outputting the processed multimedia data comprises outputting the text.

18. A method for capturing data, the method comprising:

receiving, by a multimedia printer, multimedia data captured by a peripheral device;

processing the multimedia data to generate a control signal, identify at least one multimedia event in the multimedia data, and generate a continuous timeline of the multimedia;

associating the multimedia event with a location in the timeline;

outputting, by the multimedia printer, a graphical representation of the timeline, wherein the graphical representation comprises a representation of the at least one identified multimedia event; and

transmitting the control signal to the peripheral device.

19. The method of claim 18, wherein the step of processing the multimedia data comprises performing localization;

and the control signal is for orienting the peripheral device in order to improve monitoring quality.

20. The method of claim 19, wherein the step of processing the multimedia data comprises performing audio localization;

and the control signal controls orientation of at least one microphone.

21. The method of claim 19, wherein the step of processing the multimedia data comprises performing video localization;

and the control signal controls orientation of a video capture device.

22. A method, comprising:

receiving multimedia data by a multimedia printer for outputting a document;

processing the multimedia data with the multimedia printer to identify at least one multimedia event in the multimedia data and generate a continuous timeline of the multimedia data;

associating the multimedia event with a location in the timeline; and

storing the processed multimedia data and generated timeline in the multimedia printer for later access.

23. A method, comprising:

receiving multimedia data by a multimedia printer;

processing the multimedia data, by the multimedia printer, to identify at least one multimedia event in the multimedia data and generate a continuous timeline of the multimedia data;

associating the multimedia event with a location in the timeline; and

outputting a graphical representation of the timeline, wherein the graphical representation comprises a representation of the at least one identified multimedia event through an interface on the multimedia printer wherein the multimedia printer is configured to output the processed multimedia data in paper-based and electronic formats.

24. The method of claim 23, wherein the step of outputting the processed multimedia data includes saving the processed multimedia data to a storage medium and indexing the processed data.

25. The method of claim 23, further comprising

receiving by the multimedia printer a command to process the multimedia data and to perform an action responsive to a multimedia event;

detecting the multimedia event in the multimedia data; and

executing the command responsive to detection of the multimedia event.

26. The method of claim 25, wherein the step of receiving by the multimedia printer the command comprises receiving an event table having a plurality of events and a plurality of corresponding actions.

27. The method of claim 23, further comprising outputting the processed multimedia data to a server from which the processed multimedia data can be accessed.

28. The method of claim 23, wherein the processed multimedia data comprises a portion of the multimedia data received by the multimedia printer.

29. A printing device, comprising:

a printer;

an interface adapted to receive multimedia data;

a processor for processing multimedia data received by the interface to identify at least one multimedia event in the multimedia data and generate a continuous timeline of the multimedia data, the processor coupled to the interface and to the printer;

a report module for associating the multimedia event with a location in the timeline;

a memory for storing processed multimedia data and from which the processed multimedia data can be accessed after its creation, the memory coupled to the processor; and

an output module for outputting a graphical representation of the timeline, wherein the graphical representation comprises a representation of the at least one identified multimedia event.

30. The apparatus of claim 29, farther comprising an output system for outputting the multimedia data.

31. An apparatus, comprising:

an interface adapted to receive multimedia data;

a processor for processing multimedia data coupled to the interface to identify at least one multimedia event in the multimedia data and generate a continuous timeline of the multimedia data;

a report module for associating the multimedia event with a location in the timeline; and

an output system, coupled to the processor, for outputting a graphical representation of the timeline, wherein the graphical representation comprises a representation of the at least one identified multimedia event generated by the processor, the output system for outputting data in a plurality of formats.

32. The apparatus of claim 31 wherein the output system is configured to output processed multimedia data to one of the group of a paper document and electronic data.

33. The apparatus of claim 31 wherein the output system is configured to output processed multimedia data to a paper document and electronic data.

34. The apparatus of claim 31, further comprising an indexing/mapping module for mapping contents of the multimedia data to a second file, the indexing/mapping module coupled to the processor.

35. The apparatus of claim 31, further comprising an archiving module for storing processed multimedia data for future access by a user, the archiving module coupled to the processor.

36. The apparatus of claim 31, further comprising a localization module for generating positioning commands for a peripheral device to improve capture of multimedia data from the peripheral device, the localization module coupled to the processor.

37. The apparatus of claim 31, further comprising an event detection module for determining whether a multimedia data event has occurred, the event detection module coupled to the processor.

38. The apparatus of claim 31, wherein the event detection module uses a event table to determine whether or not an event has occurred and an action is associated with the event.