Method of and system for dynamically controlling during run time a multifunction peripheral (MFP) touch panel user interface (UI) from an external remote network-connected computer

• US 8,418,065 B2
• Filed: 07/16/2001
• Issued: 04/09/2013
• Est. Priority Date: 07/16/2001
• Status: Active Grant

• Current Assignee: Kofax Incorporated
• Original Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Inventors: Conley, Michael, Hansen, Eric
• Primary Examiner(s): ABDUL-ALI, OMAR R
• Application Number:
  US09/906,473
• Publication Number:
  US 20030011633A1
• Time in Patent Office: 4,285 Days
• Field of Search: 345/702, 345/173, 319/527, 715/527, 715/740, 715/826, 715/744, 715/747
• US Class Current: 715/740
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/025 for remote control or remote monitoring of applications
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 Network security protocols
• CPC Class Codes: H04N 1/00204 with a digital computer or a digital computer system, e.g. an internet server programmed control between transmitter and receiver or between image input and image output device H04N1/32561
• CPC Class Codes: H04N 1/0035 User-machine interface; Control console input or output arrangements for computers G06F3/00
• CPC Class Codes: H04N 1/00411 the display also being used for user input, e.g. touch screen
• CPC Class Codes: H04N 1/00509 Personalising for a particular user or group of users, e.g. a workgroup or company
• CPC Class Codes: H04N 1/00973 from a remote device, e.g. receiving via the internet instructions input to a computer terminal
• CPC Class Codes: H04N 2201/001 Sharing resources, e.g. processing power or memory, with a connected apparatus or enhancing the capability of the still picture apparatus
• CPC Class Codes: H04N 2201/0039 Connection via a network
• CPC Class Codes: H04N 2201/0094 Multifunctional device, i.e. a device capable of all of reading, reproducing, copying, facsimile transception, file transception

Abstract

In a system for dynamically and remotely providing user interface (UI) display and processing information to a touch panel embedded within a multifunction peripheral (MFP) such as a digital copier having an internal computer for controlling the touch panel, a method that comprises linking the internal computer to an external data communication network having an external remote computer on the network; and upon the inputting of desired selections by a user at the UI and communicating the same over the network to the external computer, providing information from the external computer via the network back to the internal computer that enables dynamically changing or updating the UI display and behavior during run time of the MFP.

Claims

1. A system for providing user interface (UI) display and processing information to a touch panel embedded within a multifunction peripheral (MFP) device at which the user is located and operates the touch panel, the MFP being controlled by a computer disposed internally of the MFP for controlling the touch panel and connected to an external data communication network, the system having, in combination, an external computer connected on the network remotely of the MFP device but linked by the network to the internal computer of the MFP device;

and the external computer being provided with software adapted for remotely providing updating and supplemental information data back to the MFP device internal computer, via the network, for dynamically changing the UI display and behavior during operation of the MFP such that the user may select, via the embedded touch panel, among dynamically changing MFP capabilities displayed on the UI.

2. The system of claim 1 wherein said data for dynamic changing of the UI display and behavior comprises XML data relating to UI display content and data for providing rules for processing the updating of the UI display touch panel in accordance with MFP user selections.

3. The system of claim 2 wherein the MFP device is a digital document copier enhanced to support functions including document scanning, printing and faxing;

and the touch panel serves as the user interface for controlling said functions.

4. The system of claim 3 wherein the communicating of XML data between the MFP device internal computer and the external network computer provides integration of document scanning and enterprise applications.

5. The system of claim 4 wherein, once an MFP device user has made a selection by inputting data on the UI touch panel and such data has been sent via the network to the external network computer, said software is adapted to send additional XML data back to the MFP device internal computer required to update the UI in order to enable the user to supply additional data.

6. The system of claim 3, wherein software operating the network computer enables providing a description of how to display or present UI controls on the touch panel.

7. The system of claim 6, wherein software operating the network computer enables providing a description of default data values for each UI control displayed on the touch panel.

8. The system of claim 7, wherein software operating the network computer enables providing an updated description of default data values.

9. The system of claim 3, wherein software operating the network computer enables providing a low resolution image of pages of the document being scanned, and display information for displaying these images on the touch panel.

10. The system of claim 3, wherein the MFP device internal computer processes UI selections made thereat by the MFP device user that results in the MFP device internal computer sending the user-selected data to the network computer for further processing.

11. The system of claim 3 wherein the touch panel is provided with a display and a pointing device for use by MFP users to access said document scanning and enterprise applications.

12. The system of claim 2 wherein user interface display information communicated over the network between the MFP device internal computer and the external network computer is provided in the form selected from the group consisting of a) XML data describing the UI display and rules for processing MFP user requests, b) HTML, c) binary data, and d) text.

13. The system of claim 12, wherein software operating the network computer enables providing a description of the processing rules used by a computer program running on the MFP device internal computer to process the data within each UI control.

14. The system of claim 1, wherein software operating the network computer enables providing UI descriptions that are unique for each MFP device user, providing for personalized touch panel presentations and capabilities, and adapted to be dynamically changed.

15. The system of claim 1 wherein the UI display is dynamically changed in response to user inputs without an MFP device reset.

16. A method of dynamically and remotely providing user interface (UI) display and processing information to a touch panel embedded within a multifunction peripheral (MFP) at which the user is located and operates the touch panel, the MFP having an internal computer for controlling the touch panel, the method comprising (i) linking the internal computer of the MFP to an external remote computer via a data-communication network;

and (ii) causing the remote computer to dynamically change the UI display and behavior during operation of the MFP by the user, enabling the user to select, via the embedded touch panel, among dynamically changing MFP capabilities displayed on the UI.

17. The method of claim 16 wherein the MFP is a digital document copier enhanced to support multifunctions including document scanning, printing and faxing;

and the touch panel serves as the user interface for controlling said functions.

18. The method of claim 17 wherein the interactive communicating of data betweens the internal and external computers over the network provides integration of document scanning and enterprise applications.

19. The method of claim 18 wherein the network external computer provides a description of how to display or present UI controls on the touch panel.

20. The method of claim 19 wherein the network external computer provides a description of default data values for each UI control displayed on the touch panel.

21. The method of claim 20 wherein the network external computer provides an updated description of default data values.

22. The method of claim 19 wherein the network external computer provides a description of the processing rules used by a computer program running on the MFP internal computer to process the data within each UI control.

23. The method of claim 18 wherein the network external computer provides a low resolution image of pages of the documents being scanned, and display information, for displaying these images on the touch panel.

24. The method of claim 17 wherein the network external computer provides UI descriptions that are unique for each MFP user, providing for personalized touch panel presentations and capabilities.

25. The method of claim 24 wherein such personalized presentations and capabilities are dynamically changed, as desired, under control of the external computer.

26. The method of claim 17 wherein the MFP internal computer processes UI selections made thereat by the MFP user that results in the internal computer sending the user-selected data to the network external computer for further processing.

27. The method of claim 16 wherein the information provided from the remote computer comprises XML data relating to UI display content and data for providing rules for processing the updating of the UI display touch panel.

28. The method of claim 27 wherein said updating is effected in response to the interactive data communication via the network between the internal and external computers and in accordance with MFP user selections on the touch panel communicated to the external computer.

29. The method of claim 28 wherein the MFP user selection is effected by using the touch panel and sending XML data as to the same via the network back to the network computer.

30. The method of claim 29 wherein the network computer thereupon sends additional XML data to the MFP internal computer required to update the UI in order to afford the MFP user the capability to supply additional data and selection.

31. The method of claim 16 wherein the dynamically changing MFP capabilities arise in response to user inputs without an MFP device reset.

32. In a system for dynamically and remotely providing user interface (UI) display and processing information to a touch panel embedded within a multifunction peripheral (MFP) such as a digital copier at which the user is located and operates the touch panel, the MFP having an internal computer for controlling the touch panel, a method that comprises (i) linking the internal computer of the MFP to an external remote computer via a data-communication network;

(ii) upon the inputting of desired selections by a user at the UI embedded touch panel, communicating the selections over the network to the external computer; and

(iii) causing the external computer to dynamically change or update the UI display during operation of the MFP.

33. The method of claim 32 wherein the MFP is a digital document copier enhanced to support multifunctions including document scanning, printing and faxing, and the touch panel serves as the UI for controlling said functions.

34. The method of claim 33 wherein the external computer sends additional XML data to the copier internal computer required to update the UI in order to afford the copier user the capability to supply additional data and selection.

35. The method of claim 33 wherein the interactive communicating of data between the internal and external computer over the network provides integration of the document scanning and enterprise applications.

36. The system of claim 32 wherein the UI display is dynamically changed in response to user inputs without an MFP device reset.

37. A method of supplementing and/or dynamically changing initializing information loaded into an internal computer of a multifunction peripheral device (MFP) having an embedded touch-panel-controlled user interface (UI) at which a user is located, the touch panel being controlled by software and information loaded in the internal computer, the method comprising (i) linking said internal computer of the MFP via an external data communication network to an external computer, and (ii) causing the external computer to provide supplemental or changed information back to the internal computer of the MFP so as to dynamically change the UI display and behavior during operation of the MFP.

38. The method of claim 37 wherein the MFP is a digital copier.

39. The method of claim 38 wherein said user at the copier communicates selections to the remote external computer via the UI.

40. The method of claim 38 wherein the copier touch panel accesses document scanning and desired enterprise applications.

41. The method of claim 40 wherein the remote external computer is used as a gateway for integrating the copier with one or more of such enterprise applications running on one or more application servers, with said external computer software thus controlling the touch panel of the copier to display the user interface processing information required to integrate scanned documents with said enterprise applications.

42. The method of claim 41 wherein, during said running of an application, the copier user inputs data using the touch panel and sends data to the external computer, thereby permitting the external computer to send additional data back to the copier internal computer, thus enabling integration of said enterprise applications and the document scanning, by the copier.

43. The method of claim 42 wherein said data is one or more of XML, HTML, binary data and text.

44. The method of claim 38 wherein the copier internal computer, while the copier remains operational, communicates via said network to the external network computer the form data selected by the UI user.

45. The method of claim 37 wherein said enterprise applications are selected from the group consisting of document management;

e-mail;

fax server;

directory services;

application service providers; and

document delivery services.

46. The method of claim 37 wherein the external computer during operation of the MFP causes, via the network, the MFP internal computer to perform one or more of dynamically providing UI presentation form data, dynamically changing the content contained in UI, dynamically defining rules for processing each control within the UI at the touch panel, and dynamically changing the content displayed within such UI control.

47. The method of claim 37 wherein the following data streams are communicated over the network by the external computer to the copier internal computer:

XML data providing UI presentation that contains a description of how to display each UI control;

XML data that contains the definitions for each UI control, the initial values for each UI control, and the input processing rules for each UI control;

XML data used by the copier internal computer to initiate a request for new content within UI control, with the external computer updating the XML data with new content and returning the same via the network to the copier internal computer; and

XML data used to provide the UI information selected by the copier user to the external network computer.

48. The method of claim 37 wherein the external computer communicates via the network during run time of the copier to the internal computer one or more of the following information:

a description of the UI display presentation on the touch panel;

a low-resolution image of pages being scanned and display information for their display for each UI control on the touch panel;

a description of default values for each UI control displayed on the touch panel;

a description of the processing rules to be used by the copier internal computer program to process the data within each UI control displayed on the touch panel;

an up-dated description of default data values for UI controls that may differ from said default value; and

personalized descriptions unique to each copier user and to unique access or functions available at the touch panel for that individual.

49. The method of claim 37 wherein the UI display is dynamically changed in response to user inputs without an MFP device reset.

50. A system for supplementing and/or dynamically changing initializing information loaded into an internal computer of a multifunction peripheral device (MFP) having an embedded touch-panel-controlled user interface (UI) at which a user is located, and wherein the user-operated touch panel is controlled by software and information loaded in the internal computer, the system comprising, in combination, an external data communication network linking said internal computer of the MFP to an external computer, the external computer being provided with software adapted for remotely enabling supplemental or changed information to be communicated back to the internal computer of the MFP, remotely to effect the dynamic changing of the UI display and behavior during continued MFP operation, enabling a user to actively use an MFP capability via the embedded touch panel in accordance with the dynamically changed or updated UI.

51. The system of claim 50 wherein the MFP is a digital document copier having an e-mail distribution capability.

52. The system of claim 51 wherein said user at the copier touch panel communicates solutions to the remote external computer.

53. The system of claim 51 wherein the copier touch panel enables accessing document scanning and desired enterprise applications.

54. The system of claim 53 wherein the remote external computer is adapted for use as a gateway for integrating the copier with one or more of such enterprise applications running on one or more application servers, with said external computer software thus controlling the touch panel of the copier to display the user interface processing information required to integrate scanned documents with said enterprise applications.

55. The system of claim 54 wherein, during an application running, the copier user inputs data using the touch panel and sends such data to the external computer, thereby permitting the external computer to send additional data back to the copier internal computer, enabling integration of said enterprise applications and the document scanning by the copier.

56. The system of claim 55 wherein said data is one or more of XML, HTML, binary data and text.

57. The system of claim 51 wherein said enterprise applications are selected from the group consisting of document management;

e-mail;

fax server;

directory services;

application service providers; and

document delivery services.

58. The system of claim 51 wherein the external computer during said run time communicates via said network to the copier internal computer information that performs one or more of dynamically providing UI presentation form data, dynamically changing the content contained in UI, dynamically defining rules for processing each control within the UI at the touch panel, and dynamically changing the content displayed within such UI control.

59. The system of claim 51 wherein the following data streams are communicated over the network by the external computer to the copier internal computer:

XML data providing UI presentation that contains a description of how to display each UI control;

XML data that contains the definitions for each UI control, the initial values for each UI control, and the input processing rules for each UI control;

XML data used by the copier internal computer to initiate a request for new content within UI control, with the external computer updating the XML data with new content and returning the same via the network to the copier internal computer; and

XML data used to provide the UI information selected by the copier user to the external network computer.

60. The system of claim 51 wherein the external computer during run time of the copier communicates via the network to the copier internal computer one or more of the following information:

a description of the UI display presentation on the touch panel;

a low-resolution image of pages being scanned and display information for their display for each UI control on the touch panel;

a description of default values for each UI control displayed on the touch panel;

a description of the processing rules to be used by the copier internal computer program to process the data within each UI control displayed on the touch panel;

an up-dated description of default data values for UI controls that may differ from said default value; and

personalized descriptions unique to each copier user and to unique access or functions available at the touch panel for that individual.

61. The system of claim 51 wherein the copier internal computer during run time communicates via said network to the external network computer the form data selected by the UI user.

62. The system of claim 50 wherein the UI display is dynamically changed in response to user inputs without an MFP device reset.