Handheld apparatus for recognition of writing, for remote communication, and for user defined input templates

• US 6,456,749 B1
• Filed: 02/26/1999
• Issued: 09/24/2002
• Est. Priority Date: 02/27/1998
• Status: Expired due to Term

• Current Assignee: Carnegie Mellon University
• Original Assignee: Carnegie Mellon University
• Inventors: Kasabach, Chris Dominick, Stivoric, John Michael, Teller, Eric, Pacione, Christopher, Gemperle, Francine Duskey
• Primary Examiner(s): Johnson, Timothy M.
• Application Number:
  US09/258,560
• Time in Patent Office: 1,306 Days
• Field of Search: 358/473, 358/478, 382/119-123, 382/181, 382/186-189, 382/312-314, 382/317, 382/321, 356/614, 356/623, 345/179
• US Class Current: 382/314
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32
• CPC Class Codes: G06V 30/32 Digital ink

Abstract

A device including a housing, a writing tip connected to the housing, a writing surface position indicator, a processor in the housing, a memory device in the housing connected to the processor, and a sensor in the housing and cooperative with the writing surface position indicator. The device may be used to record writings and drawings applied to a surface by a user, to transmit that data to a remote device, to download data from remote devices, and to otherwise communicate with remote devices.

Claims

1. A handheld device for applying markings to a writing surface, comprising:

a housing;

a writing tip connected to the housing;

a writing surface position indicator;

a processor in the housing;

a memory device in the housing connected to the processor; and

a sensor in the housing and cooperative with the writing surface position indicator, wherein the writing surface position indicator is removeably attachable to both the housing and the writing surface.

2. The device of claim 1, further comprising a plurality of accelerometers connected to the writing tip.

3. The device of claim 2, further comprising a pressure sensor connected to the writing tip.

4. The device of claim 1, wherein the writing surface position indicator includes a signal transmitter.

5. The device of claim 4, wherein the sensor includes a signal receiver.

6. The device of claim 5, wherein the sensor includes a second signal receiver.

7. The device of claim 5, wherein the writing surface position indicator includes a second signal transmitter.

8. The device of claim 4, wherein the writing surface position indicator includes a signal transmitter selected from the group consisting of a active signal transmitter and a passive signal transmitter.

9. The device of claim 4, wherein the writing surface position indicator includes a signal transmitter selected from the group consisting of an infrared signal transmitter, an ultrasonic signal transmitter, and an electromagnetic signal transmitter.

10. The device of claim 1, wherein the memory device includes instructions stored thereon which when executed by the processor cause the processor to determine relative position between the writing tip and a writing surface.

11. The device of claim 10, wherein:

the sensor periodically receives a signal from the writing surface position indicator; and

the memory device includes instructions which when executed by the processor cause the processor to periodically update the relative position between the writing tip and the writing surface.

12. The device of claim 1, wherein the memory device includes instructions which when executed by the processor cause the processor to recognize data written with the writing tip on a writing surface.

13. The device of claim 12, wherein the memory device includes instructions which when executed by the processor cause the processor to execute commands in response to the recognized data.

14. The device of claim 12, wherein the memory device includes instructions which when executed by the processor cause the processor to recognize a user-defined interface defined by the recognized data.

15. The device of claim 1, further comprising a base connected to the housing.

16. A handheld device for applying markings to a writing surface, comprising:

a housing;

a writing tip connected to the housing;

a writing surface position indicator;

a plurality of accelerometers connected to the housing;

a pressure sensor connected to the writing tip;

a processor in the housing;

a memory device in the housing connected to the processor; and

a sensor in the housing and cooperative with the writing surface position indicator, wherein the writing surface position indicator is removeably attachable to both the housing and the writing surface.

17. A handheld device for applying markings to a writing surface, comprising:

a housing;

a writing tip connected to the housing;

means for providing a signal indicative of a writing surface;

a sensor connected to the housing for receiving the signal, wherein the means for providing a signal is removeably attachable to both the housing and the writing surface.

18. The device of claim 17, further comprising means for determining the relative position of the writing tip to the writing surface.

19. The device of claim 18, further comprising means for tracking the relative position of the writing tip to the writing surface.

20. The device of claim 19, further comprising means for recognizing data written on the writing surface in response to the means for tracking.

21. A method for determining a relative position between a writing instrument and a writing surface, comprising:

removeably attaching a writing surface position indicator to the writing surface, wherein the writing surface position indicator is removeably attachable to both the writing instrument and the writing surface;

transmitting a signal at a fixed location relative to the writing surface from the writing surface position indicator when the writing surface position indicator is removeably attached to the writing surface;

receiving the signal at the writing instrument; and

determining the relative position of the writing instrument relative to the fixed location.

22. The method of claim 21, wherein producing a signal is selected from the group consisting of producing an infrared signal, producing an ultrasonic signal, and producing an electromagnetic signal.

23. The method of claim 21, wherein producing a signal is selected from the group consisting of producing an active signal and producing a passive signal.

24. The method of claim 21, wherein determining the relative position includes determining the relative position by triangulation.

25. The method of claim 21, further comprising producing a second signal from a second fixed location relative to the surface, wherein the fixed location and the second fixed location are spaced apart by a distance.

26. A method of tracking relative movement between a writing instrument and a writing surface, comprising:

removeably attaching a writing surface position indicator to the writing surface, wherein the writing surface position indicator is removeably attachable to both the writing instrument and the writing surface;

determining movement of the writing instrument;

periodically producing a signal from a fixed location relative to the writing surface from the writing surface position indicator when the writing surface position indicator is removeably attached to the writing surface;

receiving the signal at the writing instrument; and

updating a position of the writing instrument relative to the writing surface.