Sensing device for sensing a position relative to a surface

• US 7,936,343 B2
• Filed: 06/20/2005
• Issued: 05/03/2011
• Est. Priority Date: 05/25/1999
• Status: Expired due to Fees

• Current Assignee: Silverbrook Research Pty Limited
• Original Assignee: Silverbrook Research Pty Limited
• Inventors: Silverbrook, Kia, Lapstun, Paul
• Primary Examiner(s): Lefkowitz; Sumati
• Assistant Examiner(s): Carter, III; Robert E
• Application Number:
  US11/155,557
• Publication Number:
  US 20050237312A1
• Time in Patent Office: 2,143 Days
• Field of Search: 178 1801- 2004, 345180-183
• US Class Current: 345/179
• CPC Class Codes: G06F 3/0321 by optically sensing the absolute position with respect to a regularly patterned surface forming a passive digitiser, e.g. pen optically detecting position indicative tags printed on a paper sheet constructional details of pen-shaped pointing devices G06F3/03545, G06F3/03542, G06F3/037
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06Q 20/10 specially adapted for electronic funds transfer [EFT] systems; specially adapted for home banking systems
• CPC Class Codes: G06Q 20/102 Bill distribution or payments
• CPC Class Codes: G06Q 40/00 Finance; Insurance; Tax strategies; Processing of corporate or income taxes
• CPC Class Codes: G06V 10/12 Details of acquisition arrangements; Constructional details thereof
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32
• CPC Class Codes: G08C 21/00 Systems for transmitting the position of an object with respect to a predetermined reference system, e.g. tele-autographic system

Abstract

A sensing device for sensing a position relative to a surface. The surface has printed therein or thereon coded data including at least one data portion, and visible information, at least some of the coded data being coincident with the visible information. The sensing device includes a sensor for sensing at least one data portion when placed in an operative position relative to the at least one region and generating indicating data using the sensed data portion. The indicating data is indicative of a position of the data portion relative to the surface and an orientation of the sensing device relative to the data portion. The indicating data is then communicated to a computer system to allow the position of the sensing device relative to the surface to be determined.

Claims

1. A sensing device for sensing a position relative to a surface, the surface having coded data in a machine readable form and visible information for unaided human interpretation, the coded data having an array of separate data portions, each of the data portions respectively encoding data indicative of a position of the data portion on the surface, a plurality of the data portions encoding data indicative of respective positions in a region of the surface, the region being at least partially coincident with the visible information, the sensing device including:

a retractable nib for interacting with the surface;

a retraction mechanism for slidably retracting and extending the nib relative to a housing of the sensing device;

a force sensor coupled to the retractable nib, said force sensor sensing a nib force applied to the surface by the nib;

an image sensor and processor configured for;

sensing at least one of the data portions when placed in an operative position relative to the surface;

determining if the sensed data portion is within the region;

determining if the sensed data portion contains control data indicating the sensing device to capture continuous nib force readings;

generating, using the sensed data portion, digital ink at least partially indicative of;

a position of the nib relative to the surface;

an orientation of the sensing device relative to the data portion;

generating force data as continuous nib force readings only if the sensed data portion contains said control data; and

a communicator configured to communicate the digital ink and the force data to a computer system,

wherein said image sensor generates said digital ink only when said sensed nib force exceeds a predetermined threshold.

2. A sensing device according to claim 1, wherein the orientation is indicative of at least one of the pitch, yaw and roll of the sensing device relative to the surface.

3. A sensing device according to claim 1, wherein the surface has a plurality of regions and the data portions each encode data that is at least partially indicative of an identity of at least one of the regions, wherein the indicating data is at least partially indicative of the identity of the at least one region.

4. A sensing device according to claim 1, wherein the digital ink is in the form of a stroke, the stroke being indicative of a sequence of nib positions relative to the region.

5. A sensing device according to claim 4, wherein the stroke extends from a position where the sensing device is placed in the operative position to a position when the sensing device is removed from the operative position.

6. A sensing device according to claim 4, wherein the stroke defines a sequence of nib positions determined from the sensed coded data, the sequence of nib positions being at least one of:

a sequence of relative positions; and

,

a sequence of absolute positions.

7. A sensing device according to claim 1, wherein each data portion in at least one region has an identical data portion identity, wherein the image sensor:

senses a number of images of the coded data;

compares the images to determine common features in sequential images; and

,

determines movement of the sensing device relative to the at least one region by determining changes in position of the common features between the sequential images.

8. A sensing device according to claim 1, wherein each data portion in at least one region has a unique data portion identity indicative of a location of the coded data portion in the region, and wherein the image sensor:

senses a number of images of the coded data;

determines at least one unique data portion identity from at least one imaged data portion; and

,

generates the indicating data using each of the determined data portion identities.

9. A sensing device according to claim 1, wherein each data portion includes at least one orientation axis, and wherein the image sensor:

images at least some of the coded data; and

,

determines the orientation of the at least one data portion by detecting at least one orientation axis in the imaged coded data.

10. A sensing device according to claim 1, wherein each data portion includes a plurality of perspective targets, and wherein the image sensor:

images at least some of the coded data; and

,

determines a perspective of the at least one data portion relative to the sensing device by detecting a plurality of perspective targets in the imaged coded data.

11. A sensing device according to claim 1, wherein each data portion has a respective location on the surface, and wherein, during a stroke, the image sensor:

senses a plurality of data portions;

determines, for each sensed data portion;

the location of the data portion; and

,

the orientation of the sensing device relative to the data portion; and

,

generates the digital ink as a stroke by encoding the sequence of locations and corresponding orientations.

12. A sensing device according to claim 1, wherein the coded data is substantially invisible to the unaided eye.

13. A sensing device according to claim 1, wherein any 10 millimeter diameter area of the first coded data includes sufficient information to identify the surface.