Predefined electronic pen applications in specially formatted paper

• US 6,738,053 B1
• Filed: 10/31/2000
• Issued: 05/18/2004
• Est. Priority Date: 02/16/2000
• Status: Expired due to Term

• Current Assignee: Telefonaktiebolaget LM Ericsson
• Original Assignee: Telefonaktiebolaget LM Ericsson
• Inventors: Gärdenfors, Torbjörn, Rydbeck, Nils, Johansson, Örjan, Borgström, Anders, Hollström, Magnus
• Primary Examiner(s): Shankar, Vijay
• Assistant Examiner(s): PATEL, NITIN
• Application Number:
  US09/703,704
• Time in Patent Office: 1,295 Days
• Field of Search: 235/487, 235/494, 235/495, 345/175, 345/179, 178/18.01, 178/18.09, 178/19.01, 348/207, 348/335
• US Class Current: 345/179
• CPC Class Codes: B41J 2/315 characterised by selective application of heat to a heat sensitive printing or impression-transfer material B41J2/385, B41J2/435 take precedence
• CPC Class Codes: B41J 29/393 Devices for controlling or analysing the entire machine ; Controlling or analysing mechanical parameters involving printing of test patterns
• CPC Class Codes: B41J 3/36 for portability , i.e. hand-held printers or laptop printers B41J3/4075 takes precedence
• CPC Class Codes: G06F 16/955 using information identifiers, e.g. uniform resource locators [URL]
• CPC Class Codes: G06F 3/002 Specific input/output arrangements not covered by G06F3/01 - G06F3/16 other optical apparatus G02B27/00
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0321 by optically sensing the absolute position with respect to a regularly patterned surface forming a passive digitiser, e.g. pen optically detecting position indicative tags printed on a paper sheet constructional details of pen-shaped pointing devices G06F3/03545, G06F3/03542, G06F3/037
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 9/465 Distributed object oriented systems remote method invocation [RMI] G06F9/548
• CPC Class Codes: G06K 15/028 by thermal printers
• CPC Class Codes: G06K 2215/0005 Accepting output data; Preparing data for the controlling system
• CPC Class Codes: G06K 7/10 by electromagnetic radiation, e.g. optical sensing; by corpuscular radiation
• CPC Class Codes: H04N 1/00307 with a mobile telephone apparatus constructional features of portable telephone sets H04M1/0202; mobile radio systems H04W84/00
• CPC Class Codes: H04N 1/047 Detection, control or error compensation of scanning velocity or position H04N1/0402 and H04N1/17 take precedence
• CPC Class Codes: H04N 1/107 with manual scanning
• CPC Class Codes: H04N 2201/04712 using unbroken arrays of detectors, i.e. detectors mounted on the same substrate
• CPC Class Codes: H04N 2201/04717 on the scanned sheet, e.g. a reference sheet
• CPC Class Codes: H04N 2201/04734 Detecting at frequent intervals, e.g. once per line for sub-scan control
• CPC Class Codes: H04N 2201/04737 by detecting the scanned medium directly, e.g. a leading edge

Abstract

A method and system for initiating functions on an electronic device includes using a sensor to detect a pattern on a specially formatted surface. The pattern can comprise an arrangement of dots, a particular symbol printed on the surface, or a specific pattern written with an electronic reading device. Using the detected pattern, a corresponding predefined function stored in a memory is identified and performed by a processor/controller. The electronic device can include an electronic reading device that includes the sensor and the processor/controller or can include a device that is separate from the sensor. Similarly, the function can be stored in the electronic reading device, in the electronic device that performs the function, or in an external server. The specially formatted surface preferably comprises a paper having preprinted areas associated with particular functions and/or applications executable on the electronic device.

Claims

1. An electronic reading device, comprising:

a sensor for detecting at least a first portion and a second portion of a pattern on a specially formatted surface, information being associated with the at least a first portion of the pattern;

a memory for storing a predefined function corresponding to the at least a second portion of the pattern; and

a controller for performing the predefined function with respect to the information associated with the at least a first portion of the pattern when the sensor detects the at least a second portion of the pattern; and

wherein the memory gores a plurality of predefined functions, each predefined function corresponding to at least one specific second portion of the pattern; and

wherein the controller performs the corresponding predefined function when the sensor detects the at least one specific second portion of the pattern.

2. The electronic reading device of claim 1, wherein the sensor comprises a camera.

3. The electronic reading device of claim 1, wherein the predefined function performed by the controller involves interacting with at least one other electronic device that further performs an additional function.

4. The electronic reading device of claim 1, wherein the predefined function comprises sending information to a separate electronic device.

5. The electronic reading device of claim 4, wherein the predefined function is selected from the group consisting of sending the information to an address on the Internet and sending the information to one of a mobile phone, a personal digital assistant (PDA), a television, and a personal computer.

6. The electronic reading device of claim 4, wherein the separate electronic device maps the information received from the controller to a particular server.

7. The electronic reading device of claim 1, wherein the predefined function comprises storing the information.

8. The electronic reading device of claim 1, wherein the predefined function comprises deleting the information from a memory.

9. The electronic reading device of claim 1, wherein the predefined function includes retrieving the information from a memory.

10. The electronic reading device of claim 9, wherein the retrieved information is selected from the group consisting of predetermined text and a predetermined image.

11. The electronic reading device of claim 1, wherein the predefined function comprises requesting that the information be displayed on a display.

12. The electronic reading device of claim 1, wherein the controller further compares the detected pattern with a pattern stored in the memory to determine whether the detected pattern matches the stored pattern.

13. The electronic reading device of claim 1, wherein the pattern comprises a portion of an overall address pattern formatted such that a substantially exact location on the overall address pattern can be identified based on an examination of a portion of the overall address pattern that is adjacent to the location.

14. The electronic reading device of claim 1, wherein the at least a second portion of the pattern comprises a symbol printed on the specially formatted surface.

15. A method of using an electronic reading device, comprising the steps of:

reading, with the electronic reading device, at least a first portion and a second portion of a specific pattern printed on a specially formatted paper, information being associated with the at least a first portion;

identifying a specific function associated with the second portion of the pattern; and

performing the specific function with respect to the information associated with the at least a first portion; and

wherein the specially formatted paper comprises a plurality of second portions, each associated with a predetermined function.

16. The method of claim 15, wherein the second portion of the specific pattern comprises a symbol.

17. The method of claim 15, further comprising the steps of:

storing each of the predetermined functions in the electronic reading device;

storing further predetermined functions in at least one separate electronic device; and

contacting the at least one separate electronic device to perform a further function when each of the predetermined functions does not include a function associated with the second portion of the specific pattern.

18. The method of claim 17, further comprising the step of retrieving an application description associated with the second portion of the specific pattern.

19. The method of claim 15, wherein the specific function is selected from the group consisting of sending information to a separate electronic device, storing information, and deleting information.

20. The method of claim 15, wherein the specific pattern comprises an arrangement of dots on the specially formatted paper.

21. The method of claim 15, wherein the step of reading the at least a second portion of the specific pattern involves reading a portion of the specific pattern substantially smaller than an area covered by the specific pattern.

22. The method of claim 15, wherein the specific pattern comprises a portion of an overall address pattern, different portions of the overall address pattern corresponding to different functions.

23. The method of claim 15, wherein the step of identifying the specific function further comprises transmitting information relating to the read portion of the specific pattern from the electronic reading device to a server.

24. The method of claim 15, wherein the step of performing the specific function comprises executing a script.

25. The method of claim 15, wherein the function comprises a handwriting to text translation.

26. The method of claim 15, wherein the function comprises a language translation application.

27. The method of claim 15, wherein the function comprises a spell help application.

28. The method of claim 15, wherein the function comprises sending information to a mobile electronic device.

29. The method of claim 15, wherein the function comprises accessing a web page.

30. The method of claim 15, wherein the function comprises creating an electronic credit card receipt.

31. The method of claim 15, wherein the function comprises retrieving product information.

32. The method of claim 15, wherein the function comprises generating one of an email, a telefax, and a short message service (SMS) message.

33. The method of claim 15, wherein the specific pattern is associated with an icon printed on a specially formatted paper.

34. The method of claim 15, further comprising the step of identifying a sheet of paper having printed thereon the specific pattern, said identification performed using the read specific pattern, wherein the sheet of paper corresponds to at least one application executable on an electronic device.

35. An electronic reading device, comprising:

a sensor for detecting symbols as the symbols are written on a surface with the electronic reading device;

a memory for storing at least one predefined symbol; and

a processor for comparing a symbol detected by the sensor with the at least one predefined symbol stored in the memory and, if there is a match, executing a function corresponding to the detected symbol; and

wherein the sensor detects symbols by monitoring movement of the electronic reading device relative to an address pattern of the surface; and

wherein the function executed by the processor further corresponds to the area of the address pattern on which the detected symbol is written.

36. A method of using an electronic reading device, comprising the steps of:

detecting a symbol written with the electronic reading device on a specially formatted surface;

comparing the detected symbol with each of at least one stored symbol; and

performing a function associated with one of the at least one stored symbol if the detected symbol matches said one of the at least one stored symbol; and

wherein the step of detecting the written symbol comprises detecting a movement of the electronic reading device relative to an address pattern of the specially formatted surface; and

wherein the function associated with said one of the at least one stored symbol is further associated with an area of the address pattern on which the detected symbol is written.

37. The method of claim 36, wherein the at least one stored symbol and the function associated with said one of the at least one stored symbol are stored in a server, further comprising the step of sending information relating to the detected symbol to the server.

38. The method of claim 37, wherein the information relating to the detected symbol is sent using a web browsing protocol.

39. The method of claim 37, further comprising the step of executing a script stored in the server in response to the detected symbol.

40. The method of claim 36, wherein the function associated with said one of the at least one stored symbol is selected from the group consisting of retrieving predetermined text and retrieving a predetermined image.

41. A user interface system, comprising:

a specially formatted surface having printed thereon an address pattern;

an electronic reading device, including;

a sensor for detecting at least a first position of the electronic reading device relative to a first portion of the address pattern adjacent to the electronic reading device, and detecting at least a second position of the electronic reading device relative to a second portion of the address pattern; and

a controller for sending first information relating to the at least a first detected position, and second information relating to the at least a second detected position;

a server for receiving the first information relating to the at least a first detected position and the second information relating to, the at least a second detected position, and executing a function corresponding to the at least a second detected position using the first information; and

an electronic device having a display, wherein the function comprises sending information to the electronic device for display on the display.

42. The user interface system of claim 41, wherein the function comprises a script corresponding to an area of the address pattern on which the at least a second position is detected.

43. The user interface system of claim 42, wherein the script is executed by the server.

44. The user interface system of claim 42, wherein the script is delivered to a separate electronic device for execution by the separate electronic device.

45. The user interface system of claim 41, wherein the function further comprises a handwriting recognition application.

46. The user interface system of claim 45, wherein the function further comprises converting handwriting to text.

47. The user interface system of claim 41, wherein the function further comprises a language translation application.

48. The user interface system of claim 41, wherein the function further comprises a spelling help application.

49. The user interface system of claim 41, wherein the function further comprises creating an electronic credit card receipt.

50. The user interface system of claim 41, wherein the function is selected from the group consisting of displaying a web page on the display, displaying product information on the display, and displaying a translated word on the display.

51. The user interface system of claim 41, further comprising an electronic device selected from the group consisting of a mobile phone, a personal digital assistant (PDA), a television, and a personal computer, wherein the function further comprises sending information to the electronic device, said information selected from the group consisting of an audio message for playback by a speaker on the electronic device and a textual message for display on a screen of the electronic device.

52. The user interface system of claim 41, wherein the specially formatted surface is preprinted with at least one icon, wherein a portion of the address pattern on which the at least one icon is preprinted is associated with the function.

53. The user interface system of claim 41, further comprising a notebook that includes a plurality of sheets of paper, each sheet of paper including an area of the address pattern associated with a particular application, wherein the server executes a particular application in response to a detection by the sensor of an area associated with the particular application.

54. The user interface system of claim 53, wherein the server monitors usage of the sheets of paper and sends a message prompting a user to obtain more paper based on said monitored usage.

55. The user interface system of claim 41, wherein the function further comprises sending a message over the Internet.

56. The user interface system of claim 55, wherein the message is selected from the group consisting of an email, a telefax, and a short message service (SMS) message.