Cameraless A/V documenting of user interactions with MFP device user interface

• US 20110265001A1
• Filed: 04/21/2010
• Published: 10/27/2011
• Est. Priority Date: 04/21/2010
• Status: Abandoned Application

• Current Assignee: Sharp Laboratories of America Incorporated (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Sharp Laboratories of America Incorporated (Hon Hai Precision Industry Co., Ltd.)
• Inventors: Runde, Neil Joseph, Patton, Roniie Neil
• Application Number:
  US12/799,284
• Publication Number:
  US 20110265001A1
• Time in Patent Office: Days
• US Class Current: 715/702
• CPC Class Codes: H04N 21/4135 external recorder interface circuits between an apparatus for recording television signals and a television receiver H04N5/775
• CPC Class Codes: H04N 21/43622 Interfacing an external recording device
• CPC Class Codes: H04N 5/765 Interface circuits between an apparatus for recording and another apparatus
• CPC Class Codes: H04N 5/82 using deformable thermoplastic recording medium
• CPC Class Codes: H04N 9/806 with processing of the sound signal
• CPC Class Codes: H04N 9/8211 the additional signal being a sound signal H04N9/835 takes precedence

Abstract

Methods and systems for cameraless audiovisual (A/V) documenting of user interactions with a multifunction peripheral (MFP) device user interface. User interactions are documented in an A/V file that is essentially a motion picture recorded without a camera, and that captures digital image edits or selections made on the user interface by a walk-up user along with the user'"'"'s audio narration. The A/V file can be advantageously used, by way of example, as a dynamic presentation, or in MFP device training, diagnostics or support provisioning.

Claims

1. A multifunction peripheral (MFP) device, comprising:

a user interface having a touch screen video display and a microphone;

a network interface; and

a processor communicatively coupled with the user interface and the network interface, wherein under control of the processor the MFP device generates an audiovisual (A/V) file containing a video sequence capturing one or more edits made in a cameraless recording session to a digital image rendered on the touch screen video display and an audio sequence capturing one or more sounds detected by the microphone, and transmits the A/V file to a network destination via the network interface.

2. The device of claim 1, wherein the video sequence is created from a series of recorded bitmap images of the digital image each capturing a present state of the digital image.

3. The device of claim 1, wherein the edits are made through touches on the digital image.

4. The device of claim 3, wherein the touches are hand touches.

5. The device of claim 3, wherein the touches are stylus touches.

6. The device of claim 1, wherein the recording session is started and ended in response to touches on the user interface.

7. The device of claim 1, wherein the recording session is paused and resumed in response to touches on the user interface.

8. The device of claim 1, wherein a file format for the NV file is selected in response to a touch on the user interface.

9. The device of claim 1, wherein the destination is selected in response to a touch on the user interface.

10. The device of claim 1, wherein the sounds are detected in the cameraless recording session.

11. The device of claim 1, wherein the sounds are detected in a second cameraless recording session in which the video sequence is played-back on the user interface.

12. An MFP device, comprising:

a user interface having a microphone; and

a processor communicatively coupled with the user interface, wherein under control of the processor the MFP device generates an A/V file containing a video sequence capturing one or more state changes to the user interface in a cameraless recording session and an audio sequence capturing one or more sounds detected by the microphone, and transmits the A/V file to a destination.

13. The device of claim 12, wherein the video sequence is created from a series of recorded bitmap images of the user interface each capturing a present state of the user interface.

14. The device of claim 12, wherein the state changes include state changes made through touches on the user interface.

15. The device of claim 12, wherein the state changes include state changes made through touches on touch panel video display buttons and hard keys.

16. The device of claim 12, wherein a file format and a destination for the A/V file are selected through touches on the user interface.

17. The device of claim 12, wherein the sounds are detected during the cameraless recording session.

18. The device of claim 12, wherein the sounds are detected after the cameraless recording session during playback of the video sequence.

19. The device of claim 12, wherein the destination is on the MFP device.

20. The device of claim 12, wherein the destination is a destination device that is communicatively coupled with the MFP device over a communication network.