Method of interacting with printed substrate

• US 8,001,028 B2
• Filed: 01/03/2011
• Issued: 08/16/2011
• Est. Priority Date: 05/25/1999
• Status: Expired due to Fees

• Current Assignee: Silverbrook Research Pty Limited
• Original Assignee: Silverbrook Research Pty Limited
• Inventors: Lapstun, Jacqueline Anne, Silverbrook, Kia, Lapstun, Paul
• Primary Examiner(s): Hamilton, Lalita M
• Application Number:
  US12/983,843
• Publication Number:
  US 20110096041A1
• Time in Patent Office: 225 Days
• Field of Search: 705/21, 705/23, 705 33- 35, 705 38- 39, 705/53, 705/56, 705/58, 705/62, 705/67, 705/70, 705 72- 73, 705/79, 705/40
• US Class Current: 705/35
• CPC Class Codes: G06F 3/0321 by optically sensing the absolute position with respect to a regularly patterned surface forming a passive digitiser, e.g. pen optically detecting position indicative tags printed on a paper sheet constructional details of pen-shaped pointing devices G06F3/03545, G06F3/03542, G06F3/037
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06Q 20/10 specially adapted for electronic funds transfer [EFT] systems; specially adapted for home banking systems
• CPC Class Codes: G06Q 20/102 Bill distribution or payments
• CPC Class Codes: G06Q 40/00 Finance; Insurance; Tax strategies; Processing of corporate or income taxes
• CPC Class Codes: G06V 10/12 Details of acquisition arrangements; Constructional details thereof
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32
• CPC Class Codes: G08C 21/00 Systems for transmitting the position of an object with respect to a predetermined reference system, e.g. tele-autographic system

Abstract

A method of interacting with a printed substrate. The method includes the steps of: interacting with the printed substrate using an optically imaging pen having a nib; imaging a tag on the substrate to provide image data; identifying target elements in the image data and inferring a perspective transform using perspective distortion of the target elements due to a tilt of the pen; acquiring and decoding coded data contained in the imaged tag; calculating a nib position using a tag location, the perspective transform and a known geometry of pen optics; and communicating digital ink to a computer system. The digital ink identifies the nib position and the substrate identity such that the computer system can interpret the digital ink and perform an action in response to the interaction with the printed substrate.

Claims

1. A method of interacting with a printed substrate, the method comprising the steps of:

interacting with the printed substrate using an optically imaging pen having a nib, said printed substrate including human-readable content and a plurality of contiguous tags, each tag having a plurality of target elements, each tag containing coded data indicative of a substrate identity and of a tag location on the substrate;

imaging at least one tag to provide image data;

identifying target elements in the image data and inferring a perspective transform using perspective distortion of the target elements due to a tilt of the pen;

acquiring and decoding the coded data contained in the imaged tag, the decoded coded data identifying the substrate identity and the tag location on the substrate;

calculating a nib position using the tag location, the perspective transform and a known geometry of pen optics, said nib position being different than the tag location; and

communicating digital ink to a computer system, said digital ink identifying the nib position and the substrate identity such that the computer system can interpret the digital ink and perform an action in response to the interaction with the printed substrate.

2. The method of claim 1, wherein said human-readable content is at least partially coincident with said tags.

3. The method of claim 1, wherein said nib is retractable.