Sensing device for coded electronic ink surface

• US 6,724,374 B1
• Filed: 10/20/2000
• Issued: 04/20/2004
• Est. Priority Date: 10/25/1999
• Status: Expired due to Fees

• Current Assignee: Silverbrook Research Pty Limited
• Original Assignee: Silverbrook Research Pty Limited
• Inventors: Silverbrook, Kia, Lapstun, Paul
• Primary Examiner(s): Shalwala, Bipin
• Assistant Examiner(s): Dharia, Prabodh M.
• Application Number:
  US09/693,473
• Time in Patent Office: 1,278 Days
• Field of Search: 345/5, 345/13, 345/23, 345/158, 345/173, 345/177, 345/179, 178/18-1-, 342/558, 382/219, 382/315, 401/45, 401/495, 360/74.6
• US Class Current: 345/179
• CPC Class Codes: A63F 13/12 involving interaction between a plurality of game devices, e.g. transmisison or distribution systems protocols for networked virtual reality, networked games H04L29/06034
• CPC Class Codes: A63F 13/30 Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
• CPC Class Codes: A63F 2003/0439 using geographical maps
• CPC Class Codes: A63F 2009/186 Guessing games
• CPC Class Codes: A63F 2009/241 Touch screen
• CPC Class Codes: A63F 2300/532 using secure communication, e.g. by encryption, authentication
• CPC Class Codes: A63F 9/183 electric
• CPC Class Codes: B41J 13/106 for the sheet output section
• CPC Class Codes: B41J 2/17503 Ink cartridges
• CPC Class Codes: B41J 2/17513 Inner structure
• CPC Class Codes: B41J 2/17553 Outer structure
• CPC Class Codes: B41J 2/2114 Ejecting transparent or white coloured liquids, e.g. processing liquids B41J2/211 takes precedence
• CPC Class Codes: B42C 9/0081 applying adhesive to individual sheets for binding them together by fusing, welding B42C9/0093
• CPC Class Codes: G01C 21/362 received from an external device or application, e.g. PDA, mobile phone or calendar application
• CPC Class Codes: G01C 21/3623 using a camera or code reader, e.g. for optical or magnetic codes
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32
• CPC Class Codes: G09B 29/007 using computer methods
• CPC Class Codes: G09B 29/106 using electronic means
• CPC Class Codes: G09B 5/02 with visual presentation of the material to be studied, e.g. using film strip
• CPC Class Codes: H04N 1/00204 : with a digital computer or a digital computer system, e.g. an internet server programmed control between transmitter and receiver or between image input and image output device H04N1/32561
• CPC Class Codes: H04N 1/00358 : Type of the scanned marks
• CPC Class Codes: H04N 1/00376 : Means for identifying a mark sheet or area
• CPC Class Codes: H04N 1/00567 : Handling of original or reproduction media, e.g. cutting, separating, stacking
• CPC Class Codes: H04N 1/32101 : Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
• CPC Class Codes: H04N 1/32122 : in a separate device, e.g. in a memory or on a display separate from image data
• CPC Class Codes: H04N 1/32128 : attached to the image data, e.g. file header, transmitted message header, information on the same page or in the same computer file as the image for information embedded in the image H04N1/32144
• CPC Class Codes: H04N 1/32133 : on the same paper sheet, e.g. a facsimile page header
• CPC Class Codes: H04N 1/32771 : in response to a request, e.g. for a particular document
• CPC Class Codes: H04N 1/32778 : using a mark-sheet or machine-readable code request
• CPC Class Codes: H04N 2201/3205 : of identification information, e.g. name or ID code H04N2201/3209 takes precedence
• CPC Class Codes: H04N 2201/3207 : of an address
• CPC Class Codes: H04N 2201/3226 : of identification information or the like, e.g. ID code, index, title, part of an image, reduced-size image
• CPC Class Codes: H04N 2201/3242 : of processing required or performed, e.g. for reproduction or before recording H04N2201/3256 and subgroups take precedence
• CPC Class Codes: H04N 2201/327 : which are undetectable to the naked eye, e.g. embedded codes
• CPC Class Codes: H04N 2201/3271 : Printing or stamping
• CPC Class Codes: H04N 2201/3278 : Transmission

Abstract

A sensing device for use with a surface having coded data and electronic ink disposed on the surface, the coded data being indicative of an identity of a region associated with the surface, the sensing device including: a region identity generator configured to generate region identity data indicative of the identity of the region using the coded data; and a transmitter configured to transmit the region identity data to a computer system.

Claims

1. A sensing device for use with a surface having coded data and electronic ink disposed on he surface, the coded data being indicative of an identity of a region associated with the surface, the sensing device including:

an image sensor adapted to optically sense at least some of the coded data when placed in an operative position relative to the surface;

a region identity generator configured to generate region identity data indicative of the identity of the region using at least some of the optically sensed coded data; and

a transmitter configured to transmit the region identity data to a computer system.

2. A sensing device as claimed in claim 1, further including a motion sensor configured to generate movement data indicative of movement of the sensing device relative to the region.

3. A sensing device as claimed in claim 2, wherein the motion sensor is configured to generate the movement data using at least some of the optically sensed coded data.

4. A sensing device as claimed in claim 3, wherein the coded data is indicative of a plurality of reference points of the region, the motion sensor being configured to generate the movement data as the sensing device moves relative to at least one of the reference points.

5. A sensing device as claimed in claim 3, wherein the coded data includes periodic elements, the motion sensor being configured to generate the movement data as the sensing device moves relative to at least one of the periodic elements.

6. A sensing device as claimed in claim 4, wherein the motion sensor is configured to sample the position of the sensing device relative to the at least one reference point, thereby to generate the movement data.

7. A sensing device as claimed in claim 5, wherein the motion sensor is configured to sample the position of the sensing device relative to the at least one periodic element, thereby to generate the movement data.

8. A sensing device as claimed in claim 2, wherein the motion sensor includes at least one acceleration sensor, the acceleration sensor being configured to sense acceleration of the sensing device as the sensing device moves relative to the surface region, the motion sensor being configured to generate the movement data by periodically sapling the acceleration.

9. A sensing device as claimed in claim 8, wherein the acceleration sensor is configured to sense at least two substantially orthogonal components of acceleration.

10. A sensing device as claimed in claim 1, wherein the state changing device is activatable and deactivatable.

11. A sensing device as claimed in claim 10, further including a force sensor adapted to activate the state changing device when the relative force between the apparatus and the surface exceeds a predetermined value.

12. A sensing device as claimed in claim 10, further including a detector responsive to a marker associated with the surface to enable or disable the state changing device in response to detection of the marker.

13. A sensing device as claimed in claim 12, wherein the coded data includes a plurality of tags, each tag being indicative of an identity of a region within which the tag lies, and each tag including a marker.

14. A sensing device as claimed in claim 1, wherein the state changing device includes an electric field generator.

15. A sensing device as claimed in claim 4, wherein the coded data includes a plurality of tags, each tag being indicative of an identity of a region within which the tag lies, and each tag being indicative of a reference point of the region, the region being associated with the surface, and the reference point being indicative of the position of the tag relative to the region.

16. A sensing device as claimed in claim 5, wherein the coded data includes a plurality of tags, each tag being indicative of an identity of a region within which the tag lies, and each tag including at least one periodic element.

17. A system for capturing information applied freehand, said system including a sensing device as claimed in claim 1, and a surface having electronic ink associated with the surface and coded data associated with the surface.

18. A system as claimed in claim 17, wherein said surface is provided with electronic ink and color visible ink which is not electronic ink.

19. A substrate for use with a sensing device as claimed in claim 1, the substrate including a surface having electronic ink associated with the surface and coded data associated with the surface, the coded data being indicative of an identity of a region associated with the surface.

20. A sensing device for use with a surface having coded data and electronic ink disposed on the surface, the coded data being indicative of an identity of a region associated with the surface, the sensing device including:

a region identity generator configured to generate region identity data indicative of the identity of the region using the coded data;

a transmitter configured to transmit the region identity data to a computer system; and

a state changing device for changing the state of the electronic ink.

21. A sensing device as claimed in claim 20, wherein the state changing device includes a first state changing devise for changing the state of the electronic ink to a first state and a second state changing device for changing the state of the electronic ink to a second state.

22. A sensing device as claimed in claim 21, wherein the apparatus is elongate, the first state changing device is disposed adjacent a first longitudinal end of the apparatus and the second state changing device is disposed adjacent a second opposite longitudinal end of the apparatus.

23. A sensing device as claimed in claim 20, further including a motion sensor configured to generate movement data indicative of movement of the sensing devise relative to the region.

24. A sensing device as claimed in claim 23, wherein the motion sensor is configured to generate the movement data using the coded data.

25. A sensing device as claimed in claim 24, wherein the coded data is indicative of plurality of reference points of the region, the motion sensor being configured to generate the movement data as the sensing device moves relative to at least one of the reference points.

26. A sensing device as claimed in claim 24, wherein the coded data includes periodic elements, the motion sensor being configured to generate the movement data as the sensing device moves relative to at least one of periodic elements.

27. A sensing device as claimed in claim 25, wherein the motion sensor is configured to sample the position of the sensing device relative to the at least one reference point, thereby to generate the movement data.

28. A sensing device as claimed in claim 26, wherein the motion sensor is configured to sample the position of the sensing device relative to the at least one periodic element, thereby to generate the movement data.

29. A sensing device as claimed in claim 23, wherein the motion sensor includes at least one acceleration sensor, the acceleration sensor being configured to sense acceleration of the sensing device as the sensing device moves relative to the surface region the motion sensor being configured to generate the movement data by periodically sampling the acceleration.

30. A sensing device as claimed in claim 29, wherein the acceleration sensor is configured to sense at least two substantially orthogonal components of acceleration.

31. A sensing device as claimed in claim 20, wherein the state changing device is activatable and deactivatable.

32. A sensing device as claimed in claim 31, further including a force sensor adapted to activate the state changing device when the relative force between the apparatus and the surface exceeds a predetermined value.

33. A sensing device as claimed in claim 31, further including a detector responsive to a marker associated with the surface to enable or disable the state changing device in response to detection of the marker.

34. A sensing device as claimed in claim 33, wherein the coded data includes a plurality of tags, each tag being indicative of an identity of a region within which the tag lies, and each tag including a marker.

35. A sensing device as claimed in claim 20, wherein the state changing device includes an electric field generator.

36. A sensing device as claimed in claim 25, wherein the coded data includes a plurality of tags, each tag being indicative of an identity of a region within which the tag lies, and each tag being indicative of a reference point of the region, the region being associated with the surface, and the reference point being indicative of the position of the tag relative to the region.

37. A sensing device as claimed in claim 26, wherein the coded data includes a plurality of tags, each tag being indicative of an identify of a region within which the tag lies, and each tag including at least one periodic element.

38. A system for capturing information applied freehand, said system including a sensing device as claimed in claim 20, and a surface having electronic ink associated with the surface and coded data associated with the surface.

39. A system as claimed in claim 38, wherein said surface is provided with electronic ink and color visible ink which is not electronic ink.

40. A substrate for use with a sensing device as claimed in claim 20, the substrate including a surface having electronic ink associated with the surface and coded data associated with the surface, the coded data being indicative of an identity of a region associated with the surface.