Method of interacting with printed substrate

• US 8,100,329 B2
• Filed: 05/11/2010
• Issued: 01/24/2012
• Est. Priority Date: 05/25/1999
• Status: Expired due to Fees

• Current Assignee: Silverbrook Research Pty Limited
• Original Assignee: Silverbrook Research Pty Limited
• Inventors: Silverbrook, Kia, Lapstun, Paul, Walmsley, Simon Robert, Lapstun, Jacqueline Anne
• Primary Examiner(s): Franklin, Jamara
• Application Number:
  US12/778,110
• Publication Number:
  US 20100219239A1
• Time in Patent Office: 623 Days
• Field of Search: 235/454, 23547201-47203, 178 18- 20, 345163-184
• US Class Current: 235/454
• CPC Class Codes: G06Q 20/10 specially adapted for electronic funds transfer [EFT] systems; specially adapted for home banking systems
• CPC Class Codes: G06Q 20/102 Bill distribution or payments
• CPC Class Codes: G06Q 20/14 specially adapted for billing systems
• CPC Class Codes: G06Q 20/208 Input by product or record sensing, e.g. weighing or scanner processing
• CPC Class Codes: G06Q 20/3674 involving authentication
• CPC Class Codes: G06Q 20/382 insuring higher security of transaction
• CPC Class Codes: G06Q 30/04 Billing or invoicing
• CPC Class Codes: G06Q 30/0601 Electronic shopping [e-shopping]
• CPC Class Codes: G06Q 30/0633 Lists, e.g. purchase orders, compilation or processing
• CPC Class Codes: G06Q 30/0641 Shopping interfaces
• CPC Class Codes: G06Q 40/00 Finance; Insurance; Tax strategies; Processing of corporate or income taxes
• CPC Class Codes: G06Q 40/03 Credit; Loans; Processing thereof
• CPC Class Codes: G06Q 50/188 Electronic negotiation
• CPC Class Codes: G07F 17/26 for printing, stamping, franking, typing or teleprinting apparatus ticket printing or the like apparatus G07F17/42

Abstract

A method of interacting with a printed substrate. The comprises the steps of: interacting with the substrate using an optically imaging pen having a nib; optically imaging target elements and coded data; calculating a position of the nib; and generating digital ink in the pen, the digital ink being indicative of the identity of the substrate and the position of the nib relative to the substrate; and sending the digital ink to a computer system such that the computer system can identify the interaction with the substrate. The position of the nib is calculated using the coded data, a perspective transform and a known spatial relationship between an optical axis of the pen and the nib. The perspective transform is determined using the imaged target elements which are perspective-distorted due to a tilt of the pen.

Claims

1. A method of interacting with a printed substrate, the method comprising the steps of:

providing the printed substrate, said substrate having printed thereon;

human-readable information and a position-coding pattern comprising a plurality of target elements and coded data, said coded data identifying an identity of the substrate and a plurality of locations on the substrate, the human-readable information being coincident with the position-coding pattern;

interacting with the substrate using an optically imaging pen, said pen having a nib;

optically imaging target elements and coded data;

calculating a position of the nib; and

generating digital ink in the pen, said digital ink being indicative of the identity of the substrate and the position of the nib relative to the substrate; and

sending the digital ink to a computer system such that the computer system identifies the interaction with the substrate,

wherein the position of the nib is calculated using the coded data, a perspective transform and a known spatial relationship between an optical axis of the pen and the nib, and wherein the perspective transform is determined using the imaged target elements which are perspective-distorted due to a tilt of the pen.

2. The method of claim 1, wherein said pen has a stored pen identity, said pen identity is sent with said digital ink to said computer system.

3. The method of claim 1, wherein said pen has a force sensor coupled to said nib, and said method further comprises the step of:

detecting contact between said nib and said substrate using said force sensor.

4. The method of claim 1, wherein said nib is retractable.

5. The method of claim 1, wherein said coded data is redundantly encoded.

6. A system for interacting with a printed substrate, the system comprising:

the printed substrate, said substrate having printed thereon;

human-readable information and a position-coding pattern comprising a plurality of target elements and coded data, said coded data identifying an identity of the substrate and a plurality of locations on the substrate, the human-readable information being coincident with the position-coding pattern; and

an optically imaging pen having a nib, said pen being configured to;

image the target elements and the coded data;

calculate a position of the nib;

generate digital ink in the pen, said digital ink being indicative of the identity of the substrate and the position of the nib relative to the substrate; and

send the digital ink to a computer system such that the computer system identifies the interaction with the substrate,

wherein the position of the nib is calculated using the coded data, a perspective transform and a known spatial relationship between an optical axis of the pen and the nib, and wherein the perspective transform is determined using the imaged target elements which are perspective-distorted due to a tilt of the pen.

7. The system of claim 6, further comprising the computer system.

8. The system of claim 6, wherein said pen has a stored pen identity, said pen identity is sent with said digital ink to said computer system.

9. The system of claim 6, wherein said pen has a force sensor coupled to said nib for detecting contact between said nib and said substrate.

10. The system of claim 6, wherein said nib is retractable.

11. The system of claim 6, wherein said coded data is redundantly encoded.

12. An optically imaging pen having a nib for interacting with a printed substrate, said substrate having printed thereon:

human-readable information and a position-coding pattern comprising a plurality of target elements and coded data, said coded data identifying an identity of the substrate and a plurality of locations on the substrate, the human-readable information being coincident with the position-coding pattern, wherein said pen is configured to;

image the target elements and the coded data;

calculate a position of the nib;

generate digital ink in the pen, said digital ink being indicative of the identity of the substrate and the position of the nib relative to the substrate; and

send the digital ink to a computer system such that the computer system identifies the interaction with the substrate,

wherein the position of the nib is calculated using the coded data, a perspective transform and a known spatial relationship between an optical axis of the pen and the nib, and wherein the perspective transform is determined using the imaged target elements which are perspective-distorted due to a tilt of the pen.

13. The pen of claim 12, wherein a unique pen identity is stored in the pen.

14. The pen of claim 12, wherein said pen has a force sensor coupled to said nib for detecting contact between said nib and said substrate.

15. The pen of claim 12, wherein said nib is retractable.