Multimedia print driver dialog interfaces

• US 7,861,169 B2
• Filed: 03/30/2004
• Issued: 12/28/2010
• Est. Priority Date: 11/19/2001
• Status: Expired due to Fees

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Graham, Jamey, Piersol, Kurt, Hart, Peter E., Hull, Jonathan J.
• Primary Examiner(s): Lo; Weilun
• Assistant Examiner(s): TRAN, MYLINH T
• Application Number:
  US10/814,944
• Publication Number:
  US 20040181747A1
• Time in Patent Office: 2,464 Days
• Field of Search: 715/512, 715/704, 715/730, 715/727, 715/723, 715/716, 715/719, 715/720, 707/104.1, 713/193
• US Class Current: 715/704
• CPC Class Codes: G06F 3/1204 resulting in reduced user or operator actions, e.g. presetting, automatic actions, using hardware token storing data
• CPC Class Codes: G06F 3/1206 resulting in increased flexibility in input data format or job format or job type
• CPC Class Codes: G06F 3/1253 Configuration of print job parameters, e.g. using UI at the client
• CPC Class Codes: G06F 3/1256 User feedback, e.g. print preview, test print, proofing, pre-flight checks
• CPC Class Codes: G06F 3/1285 Remote printer device, e.g. being remote from client or server
• CPC Class Codes: H04N 1/00413 using menus, i.e. presenting the user with a plurality of selectable options H04N1/00464 takes precedence

Abstract

The system of the present invention includes a media-printing interface that allows users to interact with a multimedia transformation process and format multimedia data to generate a representation of multimedia data. The present invention provides a user interface that permits users to interact with media content analysis and media representation generation. A media analysis software module receives media content analysis instructions from the user through the user interface, and the media analysis software module analyzes and recognizes features of the media content, such as faces, speech, text, etc. The media representation can be generated in a paper-based format, in digital format, and in any other representation formats. The user interface includes a number of fields through which the user can view media content and modify the media representation being generated. The methods of the present invention include interacting with a user interface to control the media data analysis and media representation generation, and analyzing features of media data. The methods also include driving the media data analysis, and driving the media representation generation by receiving instructions and sending instructions regarding media representation parameters. The methods can also include generating a media representation.

Claims

1. A system having a display for printing comprising:

a user interface for receiving instructions from a user for controlling segmentation of audio or video time-based media content for printing based on one or more features within the audio or video time-based media content, the features including any of speech recognition, optical character recognition, facial recognition, speaker detection, facial detection and event detection, and for generation of a printable representation of the media content, the user interface comprising a content selection field displaying a graphical representation of the audio or video time-based media content and the instructions from the user comprising selection of a segment of the graphical representation of the audio or video time-based media content;

a media analysis module communicatively coupled to the user interface, the media analysis module analyzing the features of the audio or video time-based media content to extract the segment of the audio or video time-based media content selected from the graphical representation based at least in part on the instructions received from the user in the user interface;

a media representation generation module for generating the printable representation of the audio or video time-based media content based at least in part on the extracted segment of the audio or video time-based media content and the instructions received from the user in the user interface; and

an output device for printing the printable representation of the audio or video time-based media content to a tangible medium.

2. The system of claim 1, wherein the media analysis module further comprises content recognition software for recognizing the analyzed features in the audio or video time-based media content.

3. The system of claim 1, further comprising processing logic for controlling display of the user interface.

4. The system of claim 1, further comprising hardware for writing a digital representation of the audio or video time-based media content in digital format.

5. The system of claim 4, further comprising a storage medium for storing the digital representation of the audio or video time-based media content written in the digital format.

6. The system of claim 1, wherein the output device is configured to print to a paper format.

7. The system of claim 6, wherein the output device is further configured to print at least one user-selectable identifier associated with the audio or video time-based media content.

8. The system of claim 7, wherein the at least one user-selectable identifier comprises at least one barcode identifying the audio or video time-based media content in the printable representation.

9. The system of claim 7, wherein the at least one user-selectable identifier further comprises at least one play identifier that can be selected to play an associated audio or video time-based media content.

10. The system of claim 1, further comprising a data structure for representing transformation of the audio or video time-based media content.

11. The system of claim 1, further comprising a communication monitoring module for monitoring communication between the components of the system, wherein the communication monitoring module forwards requests for information and replies to requests among system components.

12. The system of claim 1, wherein the user interface further comprises a field for setting a threshold on confidence values associated with results of analyzing the features of the audio or video time-based media content.

13. The system of claim 1, wherein the user interface further comprises at least one field for managing and modifying display of media information in the printable representation of the audio or video time-based media content.

14. The system of claim 1, wherein the user interface further comprises a preview field for previewing active media frames within selected audio or video time-based media content.

15. The system of claim 1, wherein the user interface further comprises a preview field for previewing the printable representation generated by the media representation generation module.

16. The system of claim 1, wherein the content selection field further comprises a selector that a user can slide along the content selection field in order to select the segment.

17. The system of claim 1, wherein the graphical representation of the audio or video time-based media content enables a user to view the audio or video time-based media content and select segments of the audio or video time-based media content.

18. The system of claim 1, wherein the graphical representation of the audio or video time-based media content further comprises an audio waveform timeline displaying audio content.

19. The system of claim 1, wherein the graphical representation of the audio or video time-based media content further comprises a video timeline displaying video frames extracted from video content.

20. The system of claim 1, wherein the graphical representation of the audio or video time-based media content further comprises a video timeline displaying text extracted from video content.

21. The system of claim 1, wherein the content selection field further comprises a field for displaying the results of analyzing the audio or video time-based media content, the results being displayed as defined segments along a timeline.

22. The system of claim 21 wherein the content selection field comprises an edit segment option to edit a length of the defined segments.

23. The system of claim 1, further comprising an output device driver module for driving the audio or video time-based media content analysis and the media representation generation, the output device driver module being communicatively coupled to the user interface to receive user instructions.

24. The system of claim 23, further comprising an augmented output device for generating a media representation, the augmented output device being communicatively coupled to the media analysis software module to receive transformed media data, the augmented output device being communicatively coupled to the output device driver module to receive instructions for media representation generation.

25. The system of claim 1, wherein the printable representation of the audio or video time-based media content further comprises one or more timelines and the user interface comprises an option to specify a number of timelines displayed per page.

26. The system of claim 1, wherein the printable representation of the audio or video time-based media content further comprises one or more timelines and the user interface comprises an option to specify a number of pages to fit the one or more timelines.

27. A method for printing, the method comprising:

displaying a print dialog driver box to a user wherein the print dialog driver box comprises a user interface for receiving instructions from the user for controlling segmentation of audio or video time-based media content for printing based on one or more features within the audio or video time-based media content, the features including any of speech recognition, optical character recognition, facial recognition, speaker detection, facial detection and event detection, and for generation of a printable representation of the audio or video time-based media content, the user interface comprising a content selection field displaying a graphical representation of the audio or video time-based media content and the instructions from the user comprising selection of a segment of the graphical representation of the audio or video time-based media content;

receiving the instructions from the user in the print dialog driver box;

analyzing the features of the audio or video time-based media content to extract the segment of the audio or video time-based media content selected from the graphical representation based at least in part on the instructions received from the user in the print dialog driver box;

generating the printable representation of the audio or video time-based media content based at least in part on the extracted segment of the audio or video time-based media content selected from the graphical representation and the instructions received from the user in the print dialog driver box; and

printing the printable representation of the audio or video time-based media content to a tangible medium.

28. The method of claim 27, wherein analyzing features of the audio or video time-based media content comprises performing speech recognition on the audio or video time-based media content.

29. The method of claim 27, wherein analyzing features of the audio or video time-based media content comprises performing optical character recognition on the audio or video time-based media content.

30. The method of claim 27, wherein analyzing features of the audio or video time-based media content comprises performing face recognition on the audio or video time-based media content.

31. The method of claim 27, wherein analyzing features of the audio or video time-based media content comprises performing speaker detection on the audio or video time-based media content.

32. The method of claim 27, wherein analyzing features of the audio or video time-based media content further comprises performing face detection on the audio or video time-based media content.

33. The method of claim 27, wherein analyzing features of the audio or video time-based media content comprises performing event detection on the media content.

34. The method of claim 27, wherein displaying the print dialog box is responsive to receiving from the user a selection of a print function in a media rendering application.

35. The method of claim 27, further comprising storing the audio or video time-based media content on a storage medium that is accessible to an augmented output device.

36. The method of claim 27, wherein the print dialog box further displays audio or video time-based media content formatting options to the user.

37. The method of claim 27, further comprising receiving a selection of a threshold value to be applied to confidence levels associated with defined features that are recognized in media content.

38. The method of claim 27, further comprising outputting a preview of the printable representation of the audio or video time-based media content in a preview field that displays the printable representation prior to printing the printable representation.

39. The method of claim 38, further comprising receiving a selection of an update field after modifying the audio or video time-based content in the print dialog box to update the preview field.

40. The method of claim 27, further comprising receiving a selection of user-selected segments of the audio or video time-based media content in a field of the print dialog box by sliding a selector along a timeline displaying a representation of the audio or video time-based media content.

41. The method of claim 27, further comprising receiving selection of a play option on the print dialog box, and playing the audio or video time-based media content responsive to receiving the selection.

42. The method of claim 27, further comprising receiving a selection of a print option on a media rendering application, wherein the user selects parameters for transformation of the audio or video time-based media content.

43. The method of claim 27, further comprising:

receiving a selection of a print option on media rendering application;

performing a default audio or video time-based media content transformation on the audio or video time-based media content; and

showing the media representation is shown in a preview field of the print dialog box.

44. The method of claim 27, wherein printing the printable representation comprises printing the printable representation in a paper-based format.

45. The method of claim 44, further printing a user-selectable identifier on the paper-based format, the user-selectable identifier when selected instructs a media player to play the associated audio or video time-based media content.