METHOD OF INTERACTING WITH PRINTED FORM

• US 20100262539A1
• Filed: 04/22/2010
• Published: 10/14/2010
• Est. Priority Date: 05/25/1999
• Status: Active Grant

• Current Assignee: Silverbrook Research Pty Limited
• Original Assignee: Silverbrook Research Pty Limited
• Inventors: Silverbrook, Kia, Lapstun, Paul, Lapstun, Jacqueline Anne
• Granted Patent: US 7,895,107 B2
• Time in Patent Office: Days
• US Class Current: 705/40
• CPC Class Codes: G06F 3/0321 by optically sensing the absolute position with respect to a regularly patterned surface forming a passive digitiser, e.g. pen optically detecting position indicative tags printed on a paper sheet constructional details of pen-shaped pointing devices G06F3/03545, G06F3/03542, G06F3/037
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06Q 20/10 specially adapted for electronic funds transfer [EFT] systems; specially adapted for home banking systems
• CPC Class Codes: G06Q 20/102 Bill distribution or payments
• CPC Class Codes: G06Q 40/00 Finance; Insurance; Tax strategies; Processing of corporate or income taxes
• CPC Class Codes: G06V 10/12 Details of acquisition arrangements; Constructional details thereof
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32
• CPC Class Codes: G08C 21/00 Systems for transmitting the position of an object with respect to a predetermined reference system, e.g. tele-autographic system

Abstract

A method of interacting with a printed form. The method includes the steps of: maintaining a page description corresponding to a printed form; receiving, indicating data from an optically imaging pen operated by the user, the indicating data being indicative of the identity of the form and of a position of a nib of the pen relative to the form; retrieving the page description using the identity of the form; and identifying an interaction with the form using the position of the nib and the retrieved page description. The position of the nib is determined by inferring a perspective transform from perspective-distorted corners of a tag of known size when sensing the coded data and using the perspective transform together with a known geometry of pen optics to compute the position of the nib.

Claims

1. A method of interacting with a printed form, the method comprising the steps of:

maintaining a page description corresponding to a printed form in a computer system, said printed form including human-readable content and coded data printed as a collection of tags, each tag being indicative of an identity of the form and of a location of the tag on the form, at least some of the coded data being coincident with the content;

receiving, indicating data from an optically imaging pen operated by a user, the indicating data being indicative of the identity of the form and of a position of a nib of the pen relative to the form, the indicating data having been generated by the pen using at least some of the coded data it sensed when placed in an operative position relative to the form;

retrieving the page description using the identity of the form; and

identifying an interaction with the form using the position of the nib and the retrieved page description,

wherein the position of the nib is determined by inferring a perspective transform from perspective-distorted corners of a tag of known size when sensing the coded data and using the perspective transform together with a known geometry of pen optics to compute the position of the nib.

2. The method of claim 1, wherein at least one parameter relating to the form is associated with a zone of the form, said method comprising the further step of:

identifying, in the computer system and from the zone indicated by the position of the nib, said at least one parameter.

3. The method of claim 2 wherein:

the indicating data includes movement data indicative of movement of the pen relative to the form, the pen having generated the movement data using at least some of the coded data, and wherein the at least one parameter is identified in the computer system by determining that the movement was at least partially within said at least one zone.

4. The method of claim 2 in which the form is a bill and the at least one parameter is associated with a bill paying transaction.

5. The method of claim 4 in which the parameter associated with the bill paying transaction is selected from the group consisting of:

requesting information relating to a bill, initiating bill payment, resetting the form, electronically forwarding a bill, paying a bill, printing a bill, canceling a bill payment, listing due bills, listing or adding billers, listing, adding or removing payment methods and listing or removing failed bills.

6. The method of claim 4 in which the parameter associated with the bill paying transaction is selected from the group consisting of:

a payment method, card type, bill payment line, autopay option, and account type.

7. The method of claim 3, wherein the at least one parameter is a text parameter, the method comprising the further steps of:

identifying, in the computer system, that the user has entered handwritten text data by means of the pen and effecting, in the computer system, an operation associated with the text parameter.

8. The method of claim 7, further comprising the step of:

converting, in the computer system, the handwritten text data to computer text.

9. The method of claim 3 in which the at least one parameter is an authorization parameter of a bill paying transaction, the method comprising the further steps of:

identifying, in the computer system, that a payer has entered a handwritten signature by means of the pen, and effecting, in the computer system, an operation associated with the authorization parameter.

10. The method of claim 1, wherein the pen contains an identification means which imparts a unique identity to the pen and identifies it as belonging to the user.

11. A computer system for enabling user interaction with a printed form, said computer system being programmed and configured for:

form including human-readable content and coded data printed as a collection of tags, each tag being indicative of an identity of the form and of a location of the tag on the form, at least some of the coded data being coincident with the content;

receiving, indicating data from an optically imaging pen operated by a user, the indicating data being indicative of the identity of the form and of a position of a nib of the pen relative to the form, the indicating data having been generated by the pen using at least some of the coded data it sensed when placed in an operative position relative to the form;

retrieving the page description using the identity of the form; and

identifying an interaction with the form using the position of the nib and the retrieved page description,

wherein the position of the nib is determined by inferring a perspective transform from perspective-distorted corners of a tag of known size when sensing the coded data and using the perspective transform together with a known geometry of pen optics to compute the position of the nib.

12. The system of claim 11, wherein at least one parameter relating to the form is associated with a zone of the form, said method comprising the further step of:

identifying, in the computer system and from the zone indicated by the position of the nib, said at least one parameter.

13. The system of claim 12 wherein:

the indicating data includes movement data indicative of movement of the pen relative to the form, the pen having generated the movement data using at least some of the coded data, and wherein the at least one parameter is identified in the computer system by determining that the movement was at least partially within said at least one zone.

14. The system of claim 12, wherein the form is a bill and the at least one parameter is associated with a bill paying transaction.

15. The system of claim 14 in which the parameter associated with the bill paying transaction is selected from the group consisting of:

requesting information relating to a bill, initiating bill payment, resetting the form, electronically forwarding a bill, paying a bill, printing a bill, canceling a bill payment, listing due bills, listing or adding billers, listing, adding or removing payment methods and listing or removing failed bills.

16. The system of claim 14 in which the parameter associated with the bill paying transaction is selected from the group consisting of:

a payment method, card type, bill payment line, autopay option, and account type.

17. The system of claim 13, wherein the at least one parameter is a text parameter, and said computer system is further configured for:

identifying that the user has entered handwritten text data by means of the pen and effecting, in the computer system, an operation associated with the text parameter.

18. The system of claim 17, wherein said computer system is further configured for:

converting the handwritten text data to computer text.

19. The system of claim 13 in which the at least one parameter is an authorization parameter of a bill paying transaction and said computer system is further configured for:

identifying, in the computer system, that a payer has entered a handwritten signature by means of the pen, and effecting, in the computer system, an operation associated with the authorization parameter.