Printer user interface

• US 7,570,380 B2
• Filed: 03/30/2004
• Issued: 08/04/2009
• Est. Priority Date: 09/25/2003
• Status: Active Grant

• Current Assignee: Ricoh Company Limited
• Original Assignee: Ricoh Company Limited
• Inventors: Graham, Jamey, Piersol, Kurt, Hart, Peter E., Hull, Jonathan J.
• Primary Examiner(s): Coles; Edward L.
• Assistant Examiner(s): Thompson; James A
• Application Number:
  US10/814,700
• Publication Number:
  US 20050068570A1
• Time in Patent Office: 1,953 Days
• Field of Search: 358/1.15, 358/1.16, 358/1.9, 358/518, 382/117, 382/118, 382/162, 382/170, 345/505, 345/619, 709/205, 709/220, 715/738
• US Class Current: 358/1.15
• CPC Class Codes: H04N 1/00175 from a still image storage medium H04N1/00172, H04N1/0018 take precedence
• CPC Class Codes: H04N 1/00188 Printing, e.g. prints or reprints H04N1/0019, H04N1/00196 take precedence
• CPC Class Codes: H04N 1/00297 with a television signal recorder, e.g. for recording facsimile images on a VCR motion video recording combined with still video recording in a still video camera H04N1/212
• CPC Class Codes: H04N 1/00331 with an apparatus performing optical character recognition character recognition G06V30/10
• CPC Class Codes: H04N 1/00336 with an apparatus performing pattern recognition, e.g. of a face or a geographic feature image or video recognition or understanding of scenes G06V20/00
• CPC Class Codes: H04N 1/00384 Key input means, e.g. buttons or keypads electromechanical details of key input means in general H01H13/00
• CPC Class Codes: H04N 1/00411 the display also being used for user input, e.g. touch screen
• CPC Class Codes: H04N 1/00424 using a list of graphical elements, e.g. icons or icon bar
• CPC Class Codes: H04N 1/00435 arranged in a predetermined sequence, e.g. using next and previous buttons
• CPC Class Codes: H04N 1/0045 vertically
• CPC Class Codes: H04N 1/00474 outputting a plurality of functional options, e.g. scan, copy or print
• CPC Class Codes: H04N 1/2338 according to user specified instructions, e.g. user selection of reproduction mode
• CPC Class Codes: H04N 1/2346 according to a detected condition or state of the reproducing device, e.g. temperature or ink quantity
• CPC Class Codes: H04N 1/2369 Selecting a particular reproducing mode from amongst a plurality of modes, e.g. paper saving or normal, or simplex or duplex
• CPC Class Codes: H04N 2201/0094 Multifunctional device, i.e. a device capable of all of reading, reproducing, copying, facsimile transception, file transception

Abstract

A multifunction printer enables the printing of time-based media and is operated via a user interface. The user interface includes a touch screen for accepting command inputs and providing information to a user. Time-based media data is received by the printer from a media source specified via the user interface. A user specifies one or more multimedia processing functions for the printer to apply to the data. The printer performs the specified functions, and previews the output to the user via a display of the user interface. If the user decides to print the previewed output, the user specifies one or more output devices, such that the printer can print conventional printed output and/or to a specified electronic output.

Claims

1. A multifunction printer for printing time-based media, the multifunction printer comprising:

a communication interface for receiving time-based media data from a media source;

a user interface display on the multifunction printer that displays a function selection menu comprising a plurality of user-selectable audio and video range selection functions to be applied to the time-based media by a processor within the multifunction printer;

an input device for receiving from a user a selection of a multimedia function from the plurality of user-selectable video and audio range selection functions displayed on the function selection menu;

the processor within the multifunction printer for performing the multimedia function selected from the plurality of user-selectable video and audio range selection functions and for generating a printable representation comprising results of the multimedia function applied to the time-based media;

a first output device for receiving the printable representation from the processor and for automatically printing the printable representation to a tangible medium; and

a second output device coupled to the processor for receiving the printable representation from the processor and for outputting an electronic output including the printable representation.

2. The printer of claim 1 wherein the multimedia function includes instructions for selecting a range of audio data in response to the user selecting one of the audio range selection functions from the function selection menu.

3. The printer of claim 1 wherein the multimedia function includes instructions for applying audio event detection to the time-based media data.

4. The printer of claim 3 wherein the multimedia function further includes instructions for determining a confidence level associated with the audio event detection.

5. The printer of claim 1 wherein the multimedia function includes instructions for applying a speaker segmentation function to the time-based media data.

6. The printer of claim 1 or 5 wherein the multimedia function includes instructions for applying a speaker recognition function to the time-based media data.

7. The printer of claim 1 wherein the multimedia function includes instructions for applying a sound source localization function to the time-based media data.

8. The printer of claim 7 wherein the multimedia function further includes instructions for applying audio event detection to the time-based media data.

9. The printer of claim 1 wherein the multimedia function includes instructions for applying a speech recognition function to the time-based media data.

10. The printer of claim 9 wherein the multimedia function includes instructions for applying a profile analysis function to the time-based media data.

11. The printer of claim 9 wherein the multimedia function includes instructions for applying an audio event detection function to the time-based media data.

12. The printer of claim 11 wherein the multimedia function further includes instructions for applying a speaker recognition function to the time-based media data.

13. The printer of claim 11 wherein the multimedia function further includes instructions for applying a speaker segmentation function to the time-based media data.

14. The printer of claim 11 wherein the multimedia function further includes instructions for applying a sound localization function to the time-based media data.

15. The printer of claim 1 wherein the multimedia function includes instructions for selecting a range of video data in response to the user selecting one of the audio range selection functions from the function selection menu.

16. The printer of claim 1 wherein the multimedia function includes instructions for applying a video event detection function to the time-based media data.

17. The printer of claim 1 wherein the multimedia function includes instructions for applying a color histogram analysis function to the time-based media data.

18. The printer of claim 1 wherein the multimedia function includes instructions for applying a face detection function to the time-based media data.

19. The printer of claim 18 wherein the multimedia function includes instructions for applying a clustering function to the time-based media data to merge multiple instances of a face into a representative face image.

20. The printer of claim 1 wherein the multimedia function includes instructions for applying a face recognition function to the time-based media data.

21. The printer of claim 1 wherein the multimedia function includes instructions for applying an optical character recognition function to the time-based media data.

22. The printer of claim 21 wherein the multimedia function further includes instructions for applying a clustering function to the time-based media data to merge similar results of the optical character recognition.

23. The printer of claim 1 wherein the multimedia function includes instructions for applying a motion analysis function to the time-based media data.

24. The printer of claim 1 or claim 23 wherein the multimedia function includes instructions for applying a distance estimation function to the time-based media data.

25. The printer of claim 1 wherein the multimedia function includes instructions for applying foreground/background segmentation function to the time-based media data.

26. The printer of claim 1 wherein the multimedia function includes instructions for applying a scene segmentation function to the time-based media data.

27. The printer of claim 26 wherein the multimedia function further includes instructions for applying a face recognition function to the time-based media data.

28. The printer of claim 26 wherein the multimedia function further includes instructions for applying a face detection function to the time-based media data.

29. The printer of claim 26 wherein the multimedia function includes instructions for applying an optical character recognition function to the time-based media data.

30. The printer of claim 29 wherein the multimedia function further includes instructions for applying a face recognition function to the time-based media data.

31. The printer of claim 29 wherein the multimedia function includes instructions for applying a face detection function to the time-based media data.

32. The printer of claim 1 wherein the multimedia function includes instructions for applying an automobile recognition function to the time-based media data.

33. The printer of claim 32 wherein the multimedia function further includes instructions for applying a motion analysis function to the time-based media data.

34. The printer of claim 1 wherein the multimedia function includes instructions for applying a license plate recognition function to the time-based media data.

35. The printer of claim 1 wherein the multimedia function includes instructions for applying a visual inspection function to the time-based media data.

36. The printer of claim 1 wherein the user interface display is configured to allow a user to control a compact disc (CD) device.

37. The printer of claim 1 wherein the user interface display is configured to allow a user to control a digital video disc (DVD) device.

38. The printer of claim 1 wherein the user interface display is configured to allow a user to control an audio tape device.

39. The printer of claim 1 wherein the user interface display is configured to allow a user to control a video tape device.

40. The printer of claim 1 wherein the user interface display is configured to allow a user to control a multimedia server.

41. The printer of claim 1 wherein the user interface display is configured to allow a user to control encryption hardware.

42. The printer of claim 1 wherein the user interface display is configured to allow a user to control audio sound localization hardware.

43. The printer of claim 1 wherein the user interface display is configured to allow a user to control motion detection hardware.

44. The printer of claim 1 wherein the user interface display is configured to allow a user to control a MIDI player.

45. The printer of claim 1 wherein the user interface display is configured to allow a user to control a cellular telephone.

46. The printer of claim 1 wherein the user interface display is configured to allow a user to control a two-way radio.

47. The printer of claim 1 wherein the user interface display is configured to allow a user to control a world wide web display.

48. The printer of claim 1 wherein the user interface display is configured to allow a user to control a climate sensor.

49. The printer of claim 1 wherein the user interface display is configured to allow a user to control a radio receiver.

50. The printer of claim 1 wherein the second output device is a DVD drive.

51. The printer of claim 1 wherein the second output device is a CD drive.

52. The printer of claim 1 wherein the second output device is an audio tape drive.

53. The printer of claim 1 wherein the second output device is a video cassette device.

54. The printer of claim 1 wherein the second output device is a removable media device.

55. The printer of claim 1 wherein the second output device is an embedded audio recorder.

56. The printer of claim 1 wherein the second output device is an embedded video recorder.

57. The printer of claim 1 wherein the second output device is a non-volatile storage device.

58. The printer of claim 1 wherein the second output device is an embedded multimedia server.

59. The printer of claim 1 wherein the second output device is audio encryption hardware.

60. The printer of claim 1 wherein the second output device is video encryption hardware.

61. The printer of claim 1 wherein the second output device is audio sound localization hardware.

62. The printer of claim 1 wherein the second output device is a cellular telephone.

63. The printer of claim 1 wherein the second output device is a two-way radio.

64. The printer of claim 1 wherein the second output device is a world-wide web display.

65. The printer of claim 1 wherein the second output device is a radio receiver for receiving AM signals.

66. The printer of claim 1 wherein the second output device is a radio receiver for receiving FM signals.

67. The printer of claim 1 wherein the second output device is a radio receiver for receiving short wave signals.

68. The printer of claim 1 wherein the second output device is a satellite radio receiver.

69. The printer of claim 1 wherein the second output device is a weather alert receiver.

70. The printer of claim 1 wherein the second output device is an emergency alert monitor for receiving emergency broadcast system alerts.

71. The printer of claim 1 wherein the second output device is hardware for performing VGA screen captures.

72. The printer of claim 1 wherein the second output device is hardware for performing audio capture.

73. The printer of claim 1 wherein the second output device is hardware for capturing data from an electronic pen.

74. The printer of claim 1 wherein the second output device is a disposable media writer.

75. The printer of claim 1 wherein the second output device is a flash memory device.

76. The printer of claim 1 wherein the second output device is a wireless device.

77. The multifunction printer of claim 1, wherein the user interface display on the multifunction printer further displays an input source selection menu comprising a plurality of user-selectable input sources, wherein the input device further receives a selection of an input source from the plurality of user-selectable input sources, and wherein the communication interface receives the time-based media data from the input source selected by the user.

78. The multifunction printer of claim 1, wherein the user interface display on the multifunction printer further displays an output source selection menu comprising a plurality of user-selectable electronic output sources, wherein the input device further receives a selection of an electronic output source from the plurality of user-selectable output sources, and wherein the second output device outputs the electronic output to the electronic output source selected by the user.

79. The multifunction printer of claim 1, wherein the user interface display outputs the function selection menu responsive to the user selecting the input source using the input source selection menu.

80. The multifunction printer of claim 1, wherein the user interface display outputs the output source selection menu responsive to the user selecting the multimedia function using the function selection menu.

81. The multifunction printer of claim 1, wherein the user interface display on the multifunction printer further displays a sub-menu for displaying options to the user specific to the user-selected multimedia function, wherein the sub-menu is displayed responsive to the user selecting one of the video range selection functions and the audio range selection functions from the function selection menu.

82. The multifunction printer of claim 1, wherein the user interface display on the multifunction printer further displays a preview menu for displaying a preview of the printable representation to the user responsive to the user selecting the multimedia function using the function selection menu.

83. The multifunction printer of claim 82, wherein the preview includes a timeline of the multimedia data indicating results of applying the multimedia function to the time-based media data along the timeline.

84. The multifunction printer of claim 83, wherein the preview includes user-selectable options for refining parameters of the multimedia function, the user interface display updating the timeline responsive to the user changing the parameters.

85. The multifunction printer of claim 1, wherein the plurality of user-selectable audio range selection functions on the function selection menu displayed by the user interface display on the multifunction printer comprises at least one of an event detection function, a speaker segmentation function, a speaker recognition function, a sound source location function, a speech recognition function, and a profile analysis function.

86. The multifunction printer of claim 1, wherein the plurality of user-selectable video range selection functions on the function selection menu displayed by the user interface display on the multifunction printer comprises at least one of an event detection function, a color histogram analysis, a face detection function, a face recognition function, an optical character recognition function, a motion analysis function, a distance estimation function, a foreground/background segmentation function.

87. The multifunction printer of claim 1, wherein the user interface display further displays a user-selectable print function for printing the printable representation, and wherein the first output device prints the printable representation responsive to the input device receiving a selection of the print function from the user.

88. A method for printing time-based media, the method comprising:

receiving time-based media data from a media source;

displaying, on a user interface display of a multifunction printer, a function selection menu comprising a plurality of user-selectable audio and video range selection functions to be applied to the time-based media;

receiving a user selected multimedia function, wherein the user selected multimedia function is a function selected from the plurality of user-selectable audio range and video range selection functions displayed on the function selection menu;

performing, by the multifunction printer, the user selected multimedia function on the time-based media data;

generating, by the multifunction printer, a printable representation comprising results of the user selected multimedia function applied to the time-based media;

printing the printable representation to a tangible medium; and

outputting an electronic output of the printable representation.

89. The method of claim 88 wherein the multimedia function includes instructions for selecting a range of audio data in response to a user selecting one of the audio range selection functions from the function selection menu.

90. The method of claim 88 wherein the multimedia function includes instructions for applying audio event detection to the time-based media data.

91. The method of claim 90 wherein the multimedia function further includes instructions for determining a confidence level associated with the audio event detection.

92. The method of claim 88 wherein the multimedia function includes instructions for applying a speaker segmentation function to the time-based media data.

93. The method of claim 88 or 92 wherein the multimedia function includes instructions for applying a speaker recognition function to the time-based media data.

94. The method of claim 88 wherein the multimedia function includes instructions for applying a sound source localization function to the time-based media data.

95. The method of claim 94 wherein the multimedia function further includes instructions for applying audio event detection to the time-based media data.

96. The method of claim 88 wherein the multimedia function includes instructions for applying a speech recognition function to the time-based media data.

97. The method of claim 96 wherein the multimedia function includes instructions for applying a profile analysis function to the time-based media data.

98. The method of claim 96 wherein the multimedia function includes instructions for applying an audio event detection function to the time-based media data.

99. The method of claim 98 wherein the multimedia function further includes instructions for applying a speaker recognition function to the time-based media data.

100. The method of claim 98 wherein the multimedia function further includes instructions for applying a speaker segmentation function to the time-based media data.

101. The method of claim 98 wherein the multimedia function further includes instructions for applying a sound localization function to the time-based media data.

102. The method of claim 88 wherein the multimedia function includes instructions for selecting a range of video data in response to a user selecting one of the audio range selection functions from the function selection menu.

103. The method of claim 88 wherein the multimedia function includes instructions for applying a video event detection function to the time-based media data.

104. The method of claim 88 wherein the multimedia function includes instructions for applying a color histogram analysis function to the time-based media data.

105. The method of claim 88 wherein the multimedia function includes instructions for applying a face detection function to the time-based media data.

106. The method of claim 105 wherein the multimedia function includes instructions for applying a clustering function to the time-based media data to merge multiple instances of a face into a representative face image.

107. The method of claim 88 wherein the multimedia function includes instructions for applying a face recognition function to the time-based media data.

108. The method of claim 88 wherein the multimedia function includes instructions for applying an optical character recognition function to the time-based media data.

109. The method of claim 108 wherein the multimedia function further includes instructions for applying a clustering function to the time-based media data to merge similar results of the optical character recognition.

110. The method of claim 88 wherein the multimedia function includes instructions for applying a motion analysis function to the time-based media data.

111. The method of claim 88 or claim 110 wherein the multimedia function includes instructions for applying a distance estimation function to the time-based media data.

112. The method of claim 88 wherein the multimedia function includes instructions for applying foreground/background segmentation function to the time-based media data.

113. The method of claim 88 wherein the multimedia function includes instructions for applying a scene segmentation function to the time-based media data.

114. The method of claim 113 wherein the multimedia function further includes instructions for applying a face recognition function to the time-based media data.

115. The method of claim 113 wherein the multimedia function further includes instructions for applying a face detection function to the time-based media data.

116. The method of claim 113 wherein the multimedia function includes instructions for applying an optical character recognition function to the time-based media data.

117. The method of claim 116 wherein the multimedia function further includes instructions for applying a face recognition function to the time-based media data.

118. The method of claim 116 wherein the multimedia function includes instructions for applying a face detection function to the time-based media data.

119. The method of claim 88 wherein the multimedia function includes instructions for applying an automobile recognition function to the time-based media data.

120. The method of claim 119 wherein the multimedia function further includes instructions for applying a motion analysis function to the time-based media data.

121. The method of claim 88 wherein the multimedia function includes instructions for applying a license plate recognition function to the time-based media data.

122. The method of claim 88 wherein the multimedia function includes instructions for applying a visual inspection function to the time-based media data.