System and method for operating an electronic reading device user interface

• US 6,611,259 B1
• Filed: 10/31/2000
• Issued: 08/26/2003
• Est. Priority Date: 02/16/2000
• Status: Expired due to Term

• Current Assignee: Telefonaktiebolaget LM Ericsson
• Original Assignee: Telefonaktiebolaget LM Ericsson
• Inventors: Olsson, Patrik, Tillgren, Magnus, Hollström, Magnus
• Primary Examiner(s): Shankar, Vijay
• Assistant Examiner(s): Patel, Nitin
• Application Number:
  US09/703,506
• Time in Patent Office: 1,029 Days
• Field of Search: 235/407, 235/494, 235/495, 345/175, 345/179, 345/178, 178/18.01, 178/19.01, 348/207, 348/325
• US Class Current: 345/179
• CPC Class Codes: B41J 2/315 characterised by selective application of heat to a heat sensitive printing or impression-transfer material B41J2/385, B41J2/435 take precedence
• CPC Class Codes: B41J 29/393 Devices for controlling or analysing the entire machine ; Controlling or analysing mechanical parameters involving printing of test patterns
• CPC Class Codes: B41J 3/36 for portability , i.e. hand-held printers or laptop printers B41J3/4075 takes precedence
• CPC Class Codes: G06F 16/955 using information identifiers, e.g. uniform resource locators [URL]
• CPC Class Codes: G06F 3/002 Specific input/output arrangements not covered by G06F3/01 - G06F3/16 other optical apparatus G02B27/00
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0321 by optically sensing the absolute position with respect to a regularly patterned surface forming a passive digitiser, e.g. pen optically detecting position indicative tags printed on a paper sheet constructional details of pen-shaped pointing devices G06F3/03545, G06F3/03542, G06F3/037
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06K 15/028 by thermal printers
• CPC Class Codes: G06K 2215/0005 Accepting output data; Preparing data for the controlling system
• CPC Class Codes: G06K 7/10 by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
• CPC Class Codes: H04N 1/00307 with a mobile telephone apparatus constructional features of portable telephone sets H04M1/0202; mobile radio systems H04W84/00
• CPC Class Codes: H04N 1/047 Detection, control or error compensation of scanning velocity or position H04N1/0402 and H04N1/17 take precedence
• CPC Class Codes: H04N 1/107 with manual scanning
• CPC Class Codes: H04N 2201/04712 using unbroken arrays of detectors, i.e. detectors mounted on the same substrate
• CPC Class Codes: H04N 2201/04717 on the scanned sheet, e.g. a reference sheet
• CPC Class Codes: H04N 2201/04734 Detecting at frequent intervals, e.g. once per line for sub-scan control
• CPC Class Codes: H04N 2201/04737 by detecting the scanned medium directly, e.g. a leading edge

Abstract

A method and system for operating a user interface uses an electronic reading device to detect a portion of an address pattern. A client device receives data identifying the detected portion of the address pattern and uses the data to request a corresponding application description. The request is sent to an application server that retrieves the corresponding application description and forwards it to the client device. The application description includes an address pattern grid description that is further forwarded to the electronic reading device. The electronic reading device stores the grid description and uses it to identify positions corresponding to successively detected portions of the address pattern, to determine whether the positions are within the current grid description, to generate strokes from the positions, and to initiate actions based on the generated strokes. Action data is then sent to the client device, which processes the data in accordance with the application description.

Claims

1. A user interface system, comprising:

an electronic reading device for detecting a portion of an address pattern;

a client device for receiving data identifying the detected portion of the address pattern and for requesting an application description corresponding to an area of the address pattern that includes the detected portion of the address pattern, said application description including description of an application to be loaded into the client device; and

an application server for retrieving the application description in response to the request by the client device, said application server forwarding the application description to the client device.

2. The system of claim 1, wherein the client device further forwards, to the electronic reading device, a grid description for said area of the address pattern.

3. The system of claim 2, wherein the application description includes the grid description.

4. The system of claim 2, wherein the electronic reading device generates at least one stroke using the grid description.

5. The system of claim 4, wherein the electronic reading device further identifies an action based on the at least one stroke.

6. The system of claim 5, wherein the electronic reading device further sends data relating to the action to the client device, the client device processing the action in accordance with the application description.

7. The system of claim 1, wherein the electronic reading device includes the client device.

8. The system of claim 1, wherein the client device comprises one of a mobile station, a personal digital assistant (PDA), a television, and a personal computer.

9. The system of claim 1, further comprising a name server for identifying an address for the application server based on the detected portion of the address pattern.

10. The system of claim 1, further comprising a translation server for receiving data relating to positions detected by the electronic reading device and translating the received data into a text input.

11. The system of claim 1, further comprising a control node for generating real-time control commands.

12. A method of operating a user interface, comprising the steps of:

detecting a portion of an address pattern with an electronic reading device;

determining a position on the address pattern based on the detected portion of the address pattern;

identifying an application to be loaded corresponding to an area that contains the detected portion of the address pattern; and

retrieving a description of the application to be loaded to a local memory, said description including information about the application to be loaded.

13. The method of claim 12, further comprising the step of identifying, based on the detected portion of the address pattern, a location of an application server that stores the application description.

14. The method of claim 12, further comprising the step of retrieving a grid description for the area.

15. The method of claim 14, further comprising the step of determining a plurality of detected positions on the address pattern using the retrieved grid description.

16. The method of claim 15, further comprising the step of processing the plurality of determined positions in accordance with the application description.

17. An electronic reading device, comprising:

a sensor for detecting portions of an address pattern;

a position buffer for storing data identifying the detected portions of the address pattern;

a memory for storing a grid description of a current address pattern area, said grid description being descriptive of actions associated with the detected positions of the address pattern; and

a processor for determining an action to be performed based on a plurality of detected positions using the grid description of the current address pattern area, each detected position determined from data stored in the position buffer.

18. The electronic reading device of claim 17, wherein the processor further generates at least one stroke from the plurality of detected positions.

19. The electronic reading device of claim 18, wherein the processor further initiates the action based on the at least one stroke.

20. The electronic reading device of claim 17, wherein the processor further determines whether each detected portion of the address pattern is within the current address pattern area.

21. The electronic reading device of claim 20, wherein the processor requests a grid description of a new address pattern area that corresponds to a particular detected portion of the address pattern when the particular detected portion is determined not to be within the current address pattern area.

22. A method for processing information detected by an electronic reading device, comprising the steps of:

detecting, by the electronic reading device, an initial portion of an address pattern;

retrieving, by the electronic reading device, an address pattern grid that contains the initial detected portion of the address pattern, said address pattern grid identifying actions to be taken based on the detected portion,

storing, in the electronic reading device, the address pattern grid; and

identifying a plurality of successive positions corresponding to a plurality of successively detected portions of the address pattern, the plurality of successive positions identified using the stored address pattern grid.

23. The method of claim 22, further comprising the step of generating data defining a stroke from the plurality of identified successive positions.

24. The method of claim 23, further comprising the step of initiating an action that corresponds to the stroke.

25. The method of claim 22, further comprising the step of initiating an action based on the plurality of identified successive positions.

26. The method of claim 22, further comprising the step of determining whether each successive position is within the stored address pattern grid.

27. The method of claim 26, further comprising the step of:

retrieving a new address pattern grid in response to a determination that a particular successive position is not within the stored address pattern grid, the new address pattern grid containing the particular successive position; and

storing the new address pattern grid.

28. A method for processing information detected by an electronic reading device, comprising the steps of:

detecting, by the electronic reading device, an initial position on an address pattern;

retrieving an application description containing an address pattern grid description for an application that relates to the detected initial position;

detecting a plurality of successive positions on the address pattern; and

processing the plurality of detected successive positions in accordance with the address pattern grid description contained within the application description.

29. The method of claim 28, further comprising the steps of:

identifying an address where the application description is stored, said identification based on the detected initial position; and

sending a request for the application description to the identified address.

30. The method of claim 28, wherein the step of retrieving the application description includes retrieving an address pattern grid description, the address pattern grid description used in the step of detecting the plurality of successive positions.

31. The method of claim 28, wherein the step of processing includes converting the plurality of detected successive positions into a data entry.

32. The method of claim 31, further comprising the step of submitting the data entry to an application server associated with the application.

33. The method of claim 31, wherein the plurality of detected successive positions represent handwritten symbols, said conversion into a data entry involving performing a handwriting recognition operation.

34. A system for configuring an electronic reading device, comprising:

an electronic reading device storing configuration instructions;

a separate electronic device including an electronic man-machine interface (MMI), said separate electronic device operating to;

receive the configuration instructions from the electronic reading device;

display at least one configuration option identified in the configuration instructions;

receive, via the electronic MMI, a user selection relating to the at least one configuration option; and

send an identification of the user selection to the electronic reading device, said electronic reading device executing a function based on the user selection.

35. The system of claim 34, wherein communications between the electronic reading device and the separate electronic device are performed using wireless application protocol (WAP).

36. The system of claim 35, wherein the electronic reading device includes a WAP server and the separate electronic device includes a WAP client.

37. The system of claim 36, wherein the configuration instructions comprise a WAP page.

38. The system of claim 37, wherein the user selection comprises a selection of a link on the WAP page.

39. The system of claim 35, wherein the identification of the user selection comprises a common gateway interface (CGI) call.

40. The system of claim 34, wherein the configuration instructions use an application program interface (API) for the separate electronic device.

41. The system of claim 34, wherein the at least one configuration option is displayed using a dynamic menu.

42. The system of claim 34, wherein the separate electronic device is selected from the group consisting of a mobile phone, a personal digital assistant (PDA), and a personal computer.

43. A method for configuring an electronic reading device, comprising the steps of:

receiving configuration data identifying a plurality of configuration options for an electronic reading device, said configuration data received at a separate electronic device;

displaying the plurality of configuration options on the separate electronic device;

receiving a user selection of at least one of the plurality of configuration options;

notifying the electronic reading device of the at least one selected configuration option; and

executing a function based on the at least one selected configuration option.

44. The method of claim 43, wherein the configuration data is contained in one of a wireless application protocol (WAP) page and a web page, the step of displaying the plurality of configuration options comprising displaying said one of the WAP page and the web page.

45. The method of claim 44, wherein each configuration option comprises a link on said one of the WAP page and the web page.

46. The method of claim 44, wherein the step of notifying comprises sending a common gateway interface (CGI) call to the electronic reading device.

47. The method of claim 46, further comprising the step of executing the CGI call.

48. The method of claim 43, wherein the configuration data conforms to an application program interface (API) for the separate electronic device.

49. A system for interacting with an application, comprising:

a formatted surface having an address pattern, wherein a position on the address pattern can be determined from a portion of the address pattern;

an electronic reading device for detecting a portion of the address pattern;

an application server storing application data associated with the detected portion of the address pattern; and

an electronic device separate from the electronic reading device, said electronic device operating to receive the application data and display the application data on a display screen, wherein a user makes a selection from the displayed application data using one of the electronic reading device in connection with the formatted surface and a man-machine interface (MMI) for the separate electronic device.

50. The system of claim 49, wherein the separate electronic device is selected from the group consisting of a mobile phone, a personal digital assistant (PDA), and a personal computer.

51. The system of claim 49, wherein the separate electronic device comprises a wireless application protocol (WAP) client.

52. The system of claim 49, wherein the application data comprises one of a wireless application protocol (WAP) page and a web page.

53. The system of claim 52, wherein the user selection is sent to the application server in the form of a common gateway interface (CGI) call.

54. The system of claim 49, wherein the separate electronic device has a unique Internet protocol (IP) address, said separate electronic device acting as a proxy for the electronic reading device.

55. The system of claim 49, wherein the electronic reading device has a unique Internet protocol (IP) address, said electronic reading device acting as a proxy for the separate electronic device.

56. The system of claim 49, wherein the application data received by the separate electronic device is sent via the electronic reading device.

57. A method for interacting with an application, comprising the steps of:

detecting a portion of an address pattern with an electronic reading device;

determining a position of the electronic reading device relative to the address pattern based on the detected portion of the address pattern;

retrieving application data associated with the determined position;

displaying at least one option from the application data on an electronic device separate from the electronic reading device; and

receiving a user selection of one of the at least one option.

58. The method of claim 57, wherein the application data comprises one of a wireless application protocol (WAP) page and a web page.

59. The method of claim 58, wherein the user selection comprises a selection of a link on said one of the WAP page and the web page.

60. The method of claim 57, wherein the step of receiving the user selection comprises detecting a portion of the address pattern with the electronic reading device.

61. The method of claim 57, wherein the user selection is received via a man-machine interface on the separate electronic device.

62. The method of claim 57, further comprising the step of sending the application data to the separate electronic device via the electronic reading device.