Orientation sensing device with processor

• US 7,041,916 B2
• Filed: 11/12/2002
• Issued: 05/09/2006
• Est. Priority Date: 05/25/1999
• Status: Expired due to Fees

• Current Assignee: Livescribe Incorporated (Anoto Group AB)
• Original Assignee: Silverbrook Research Pty Limited
• Inventors: Paul, Lapstun, Silverbrook, Kia
• Primary Examiner(s): MENGISTU, AMARE
• Assistant Examiner(s): MENGISTU, AMARE
• Application Number:
  US10/291,503
• Publication Number:
  US 20040075650A1
• Time in Patent Office: 1,274 Days
• Field of Search: 178 1801- 1907, 345/179
• US Class Current: 178/19.05
• CPC Class Codes: G06F 3/0321 by optically sensing the absolute position with respect to a regularly patterned surface forming a passive digitiser, e.g. pen optically detecting position indicative tags printed on a paper sheet constructional details of pen-shaped pointing devices G06F3/03545, G06F3/03542, G06F3/037
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06Q 20/10 specially adapted for electronic funds transfer [EFT] systems; specially adapted for home banking systems
• CPC Class Codes: G06Q 20/102 Bill distribution or payments
• CPC Class Codes: G06Q 40/00 Finance; Insurance; Tax strategies; Processing of corporate or income taxes
• CPC Class Codes: G06V 10/12 Details of acquisition arrangements; Constructional details thereof
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32
• CPC Class Codes: G08C 21/00 Systems for transmitting the position of an object with respect to a predetermined reference system, e.g. tele-autographic system

Abstract

A sensing device for generating orientation data when positioned or moved relative to a surface, the orientation data being indicative of an orientation of the sensing device relative to the surface, the surface having coded data disposed upon it, the coded data being indicative, when sensed by the sensing device, of the orientation, the sensing device including: a housing; orientation sensing means configured to generate the orientation data using at least some of the coded data; and communications means configured to communicate the orientation data to a computer system.

Claims

1. A sensing device for generating orientation data when positioned or moved relative to a surface, the orientation data being indicative of an orientation of the sensing device relative to the surface, the surface having coded data disposed upon it, the coded data being indicative, when sensed by the sensing device, of the orientation, the sensing device including:

a housing;

an orientation sensor comprising;

(a) an image sensor adapted to capture images of at least some of the coded data when the sensing device is placed in an operative position relative to the surface; and

(b) a processor adapted to;

(i) identify at least some of the coded data from one or more of the captured images;

(ii) determine an orientation, within the captured images, of at least some of the coded data;

(iii) decode at least some of the coded data; and

(iv) generate the orientation data using at least some of the decoded coded data, the orientation data being indicative of at least the yaw or the housing relative to the surface; and

a communicator configured to communicate the orientation data to a computer system.

2. A sensing device according to claim 1, wherein the orientation data is further indicative of at least one of a pitch and a roll of the housing relative to the surface.

3. A sensing device according to claim 1, further including a motion sensor for generating at least one of movement data and position data when the sensing device is moved relative to the surface, the communicator being configured to communicate the movement data to the computer system.

4. A sensing device according to claim 3, further including region identity sensor configured to sense, when the sensing device is positioned or moved relative to a region of the surface, and using at least some of the coded data, region identity data indicative of an identity of the region, the communicator being configured to communicate the region identity data to the computer system.

5. A sensing device according to claim 4, wherein the motion sensor is configured to generate at least one of the movement data and the position data using at least some of the coded data.

6. A sensing device according to claim 5, wherein the coded data is also indicative of a plurality of reference points of the region, the motion sensor being configured to generate at least one of the movement data and the position data on the basis of at least one of the movement and position of the sensing device relative to at least one of the reference points.

7. A sensing device according to claim 5, wherein the coded data includes periodic elements, the motion sensor being configured to generate at least one of the movement data and the position data on the basis of at least one of the movement and position of the sensing device relative to at least one of the periodic elements.

8. A sensing device according to claims 6 or 7, wherein the motion sensor is configured to sample the position of the sensing device relative to the at least one reference point or periodic element, thereby to generate at least one of the movement data and the position data.

9. A sensing device according to claim 8, further including a distance estimator configured to estimate a distance of the sensing device from the at least one reference point or periodic element.

10. A sensing device according to claim 9, wherein the communicator is configured to communicate distance data to the computer system, the distance data being indicative of the distance.

11. A sensing device according to claim 9, wherein the motion sensor is configured to use the distance estimated by the distance estimator to resolve a more accurate position of the sensing device than indicated by the at least one reference point or periodic element alone.

12. A sensing device according to claim 4, further including a timer configured to generate a time reference as the sensing device is moved relative to the surface region.

13. A sensing device according to claim 12, wherein the communicator is configured to communicate time reference data to the computer system, the time reference data being indicative of the time reference of the movement data as generated by the timer.

14. A sensing device according to claim 1, wherein the communicator is a wireless communicator.

15. A sensing device according to claim 1, further including a force sensor configured to sense a force applied to the surface by the sensing device.

16. A sensing device according to claim 15, wherein the communicator is configured to communicate force data to the computer system, the force data being indicative of the force.

17. A sensing device according to claim 15, further including a stroke detector configured to detect, by way of the force, when the sensing device is applied to the surface and removed from the surface, thereby to identify the duration of a stroke.

18. A sensing device according to claim 1, wherein the orientation sensor is configured to infer the orientation from perspective distortion of at least some of the coded data.

19. A sensing device according to claim 1, wherein the processor is housed within the housing.

20. The sensing device according to claim 1, wherein the processor is adapted to operate at processing speeds ranging from 1 instruction per second to 1×

10¹² instructions per second.

21. The sensing device according to claim 20 wherein the processor is adapted to operate at processing speeds ranging from 10 instructions per second to 1×

10⁶ instructions per second.

22. The sensing device according to claim 1, wherein the image sensor is housed within the housing.

23. The sensing device according to claim 1, wherein the image sensor is adapted to capture images at rates ranging from 1 image per second to 1,000 images per second.

24. The sensing device according to claim 23 wherein the image sensor is adapted to capture images at rates ranging from 10 images per second to 200 images per second.

25. The sensing device according to claim 1, wherein the coded data comprises non-barcode coded data.