Apparatus and methods for hand motion tracking and handwriting recognition

• US 6,831,632 B2
• Filed: 04/09/2001
• Issued: 12/14/2004
• Est. Priority Date: 04/09/2001
• Status: Expired due to Term

• Current Assignee: I.C. + Technologies Ltd.
• Original Assignee: I-Rocks Technology Company Limited (I-Rocks)
• Inventors: Vardi, Micha
• Primary Examiner(s): WU, XIAO MIN
• Application Number:
  US09/829,230
• Publication Number:
  US 20020145596A1
• Time in Patent Office: 1,345 Days
• Field of Search: 345/179, 345/173, 345/158, 345/169, 345/156, 178/18.1, 178/18.01, 178/19.01, 382/312, 382/313, 382/181, 382/186, 382/187, 382/188, 382/189
• US Class Current: 345/179
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/0383 Signal control means within the pointing device
• CPC Class Codes: G06F 3/046 by electromagnetic means
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32
• CPC Class Codes: G06V 30/228 of three-dimensional handwriting, e.g. writing in the air

Abstract

Apparatus and method for handwriting recognition including a hand-held device including at least one accelerometer providing an acceleration indicating output, computation circuitry receiving the acceleration indicating output and providing a velocity indicating output and a handwritten multiple character recognizer receiving the velocity indicating output and providing a multiple character recognition output indication.

Claims

1. Apparatus for handwriting recognition comprising:

a hand-held device comprising at least one accelerometer providing an acceleration indicating output;

computation circuitry receiving said acceleration indicating output, discarding user specific components from said acceleration indicating output from said at least one accelerometer and providing a non-user specific output; and

a handwritten character recognizer receiving said non-user specific output and employing said non-user specific output for providing a character recognition output indication.

2. Apparatus for handwriting recognition according to claim 1 and wherein said at least one accelerometer comprises a plurality of accelerometers providing outputs to acceleration processing circuitry, which provides said acceleration indicating output.

3. Apparatus for handwriting recognition according to claim 1 and wherein said computation circuitry is also operable to perform at least one of Calculator, Database, Personal Information Management (PIM) and Personal Digital Assistant (PDA) functionalities, including at least one of address and phone book, data-bank, calendar, time management, calculator, expenses tracking and management, “

to do list”

management, note and memo taking, dictionary, translator and speller, smart-card, magnetic card, credit-card, electronic-wallet, remote-control and smart key functionalities and to provide a computation output resulting therefrom.

4. Apparatus for handwriting recognition according to claim 1 and also comprising communication circuitry.

5. Apparatus for handwriting recognition according to claim 1 and also comprising at least one of a microphone, a speaker, an earphone, an audio interface, an audio processor, a digital signal processor, a display, an image processor, a control circuitry, a CPU, a MPU, a memory, a transceiver, an antenna, a baseband controller, a baseband interface, an Input/Output port, a wireless port, a Bluetooth output, an infra-red port, a serial port, a USB port and data acquisition circuitry.

6. Apparatus according to claim 4 and also comprising a communication functionality, for providing at least one of a telephone, paging, SMS, WAP, Email, Internet browsing, POTS and other types of communications functionality.

7. Apparatus for handwriting recognition according to claim 1 and wherein said apparatus is employed as a writing implement.

8. Apparatus for hand motion tracking comprising:

a hand-held device comprising at least one accelerometer providing an acceleration indicating output;

computation circuitry receiving said acceleration indicating output and providing a proportionally normalized velocity indicating output; and

a hand motion tracker receiving said velocity indicating output and providing a tracking output indication.

9. Apparatus for hand motion tracking according to claim 8 and wherein said at least one accelerometer comprises a plurality of mutually orthogonal arranged accelerometers providing outputs to acceleration processing circuitry which provides said acceleration indicating output.

10. Apparatus for hand motion tracking according to claim 9 and wherein said hand motion tracker provides at least one of a three-dimension tracking output indication, a two-dimension tracking output indication and a character tracking output indication.

11. Apparatus for motion tracking according to claim 8 and also comprising communication circuitry.

12. Apparatus for motion tracking according to claim 8 and also comprising at least one of a microphone, a speaker, an earphone, an audio interface, an audio processor, a digital signal processor, a display, an image processor, a control circuitry, a CPU, a MPU, a memory, a transceiver, an antenna, a baseband controller, a baseband interface, an Input/Output port, a wireless port, a Bluetooth output, an infra-red port, a serial port, a USB port and data acquisition circuitry.

13. Apparatus for motion tracking according to claim 8 and wherein said apparatus is employed as a writing implement.

14. Apparatus for motion tracking according to claim 8 and wherein said computation circuitry provides at least one of proportional normalization of velocity, identification of minimum motion points, normalization at least a portion of the acceleration indicating output to a level of an average of a first few samples of the acceleration indicating output, and determination a last intentional motion sample of the acceleration indicating output and eliminating samples following said last intentional motion sample of the acceleration indicating output.

15. Apparatus for hand motion tracking according to claim 8 and wherein said proportionally normalized velocity indicating output depends on the position of a sample within a velocity record relative to the beginning and end of said record.

16. Apparatus for hand motion tracking according to claim 8 and wherein an extent of normalization applied to an individual sample depends on the position of the sample with a velocity record relative to the beginning and end of said velocity record.

17. Apparatus for hand motion tracking according to claim 8 and wherein said proportionally normalized velocity indicating output depends only on the position of a sample within a velocity record relative to the beginning and end of said record.

18. Apparatus for hand motion tracking according to claim 8 and wherein an extent of normalization applied to an individual sample depends only on the position of the sample with a velocity record relative to the beginning and end of said velocity record.

19. Apparatus for handwriting recognition and hand motion tracking comprising:

a hand-held device comprising at list one accelerometer providing an acceleration indicating output;

computation circuitry receiving said acceleration indicating output discarding user specific components from said acceleration indicating output from said at least one accelerometer and providing a non-user specific output;

a handwritten character recognizer receiving said non-user specific output and employing said non-user specific output for providing a character recognition output indication; and

a hand motion tracker receiving said non-user specific output and providing a tracking output indication.

20. Apparatus for handwriting recognition and hand motion tracking according to claim 19 and wherein said at least one accelerometer comprises a plurality of accelerometers providing outputs to acceleration processing circuitry, which provides said acceleration indicating output.

21. Apparatus for handwriting recognition and hand motion tracking according to claim 19 and wherein said hand motion tracker provides at least one of a three-dimension tracking output indication, a two-dimension tracking output indication and a character tracking output indication.

22. Apparatus for handwriting recognition and hand motion tracking according to claim 19 and wherein said computation circuitry is also operable to perform at least one of Calculator, Database, Personal Information Management (PIM) and Personal Digital Assistant (PDA) functionality, including at least one of address and phone book, data-bank, calendar, time management, calculator, expenses tracking and management, “

to do list”

management, note and memo taking, dictionary, translator and speller, smart-card, magnetic card, credit-card, electronic-wallet, remote-control and smart key functionalities and to provide a computation output resulting therefrom.

23. Apparatus for handwriting recognition and hand motion tracking according to claim 19 and also comprising communication circuitry.

24. Apparatus for handwriting recognition and hand motion tracking according to claim 19 and also comprising at least one of a microphone, a speaker, an earphone, an audio interface, an audio processor, a digital signal processor, a display, an image processor, a control circuitry, a CPU, a MPU, a memory, a transceiver, an antenna, a baseband controller, a baseband interface, an Input/Output port, a wireless port, a Bluetooth output, an infra-red port, a serial port, a USB port and data acquisition circuitry.

25. Apparatus according to claim 23 and wherein said communication circuitry provides functionality for at least one of a telephone, paging, SMS, WAP, Email, Internet browsing and POTS functions.

26. Apparatus for handwriting recognition and hand motion tracking according to claim 19 and wherein said apparatus is employed as a writing implement.

27. A pen computer comprising:

a hand-held device comprising at least one accelerometer providing an acceleration indicating output;

computation circuitry located within said hand-held device and receiving said acceleration indicating output and providing a non-user specific output;

a handwritten character recognizer located within said hand-held device and receiving said non-user specific output and employing said non-user specific output for providing a character recognition output indication; and

a computer located within said hand-held device for receiving said character recognition output indication as performing computer operations in response thereto.

28. A pen computer according to claim 27 and wherein said at least one accelerometer comprises a plurality of mutually orthogonal arranged accelerometers providing outputs to acceleration processing circuitry which provides said acceleration indicating output.

29. A pen computer recognition according to claim 27 and wherein said computer is also operable to perform at least one of Calculator, Database, Personal Information Management (PIM) and Personal Digital Assistant (PDA) functionalities, including at least one of address and phone book, data-bank, calendar, time management, calculator, expenses tracking and management, “

to do list”

management, note and memo taking, dictionary, translator and speller, smart-card, magnetic card, credit-card, electronic-wallet, remote-control and smart key functionalities and to provide a computation output resulting therefrom.

30. A pen computer according to claim 27 and also comprising communication circuitry.

31. A pen computer according to claim 27 and also comprising at least one of a microphone, a speaker, an earphone, an audio interface, an audio processor, a digital signal processor, a display, an image processor, a control circuitry, a memory, a transceiver, an antenna, a baseband controller, a baseband interface, an Input/Output port, a wireless port, a Bluetooth output, an infra-red port, a serial port, a USB port and data acquisition circuitry.

32. Apparatus according to claim 30 and wherein said communication circuitry provides functionality for at least one of a telephone, paging, SMS, WAP, Email, Internet browsing and POTS functions.

33. A pen computer according to claim 27 wherein said computer is employed as a writing implement.

34. A pen communicator comprising:

a hand-held device comprising at least one accelerometer providing an acceleration indicating output;

computation circuitry located within said hand-held device and receiving said acceleration indicating output and providing a proportionally normalized velocity indicating output;

a handwritten character recognizer located within said hand-held device and receiving said proportionally normalized velocity indicating output and employing said velocity indicating output for providing a character recognition output indication; and

a communication device located within said hand-held device for receiving said character recognition output indication and performing communication operations in response thereto.

35. A pen communicator according to claim 34 and wherein said at least one accelerometer comprises a plurality of mutually orthogonal arranged accelerometers providing outputs to acceleration processing circuitry which provides said acceleration indicating output.

36. A pen communicator claim 34 and comprising also hand motion tracker receiving said velocity indicating output and providing at least one of a three-dimension tracking output indication, a two-dimension tracking output indication and a character tracking output indication.

37. A pen communicator according to claim 34 wherein said computation circuitry is also operable to perform at least one of Calculator, Database, Personal Information Management (PIM) and Personal Digital Assistant (PDA) functionalities, including at least one of address and phone book, data-bank, calendar, time management, calculator, expenses tracking and management, “

to do list”

management, note and memo taking, dictionary, translator and speller, smart-card, magnetic card, credit-card, electronic-wallet, remote-control and smart key functionalities and to provide a computation output resulting therefrom.

38. A pen communicator according to claim 34 and also comprising at least one of a microphone, a speaker, an earphone, an audio interface, an audio processor, a digital signal processor, a display, an image processor, a control circuitry, a CPU, a MPU, a memory, a transceiver, an antenna, a baseband controller, a baseband interface, an Input/Output port, a wireless port, a Bluetooth output, an infra-red port, a serial port, a USB port and data acquisition circuitry.

39. A pen communicator according to claim 34 and wherein said communication device provides functionality for at least one of a telephone, paging, SMS, WAP, Email, Internet browsing and POTS functions.

40. A pen communicator according to claim 34 and wherein said communicator is employed as a writing implement.

41. A method for handwriting recognition comprising:

providing an acceleration indicating output from a hand-held device;

receiving said acceleration indicating output, discarding user specific components therein and providing a non-user specific output; and

receiving said non-user specific output and employing said non-user specific output for providing a character recognition output indication.

42. A method for hand handwriting recognition according to claim 41 and also comprising at least one of a computation related to the character recognition output indication, a database operation related to the character recognition output indication, communication of character recognition output indication and a control operation based on the character recognition output indication.

51. A method for hand motion tracking according to claim 42 and wherein said providing a proportionally normalized velocity indicating output comprises:

applying an extent of normalization to an individual sample depending on the position of the sample within a velocity record relative to the beginning and end of said velocity record.

52. A method for hand motion tracking according to claim 42 and wherein said providing a proportionally normalized velocity indicating output comprises:

normalizing a velocity record depending only on the position of a sample within said velocity record relative to the beginning and end of said velocity record.

53. A method for hand motion tracking according to claim 42 and wherein said providing a proportionally normalized velocity indicating output comprises:

applying an extent of normalization to an individual sample depending only on the position of the sample within a velocity record relative to the beginning and end of said velocity record.

43. A method for hand motion tracking comprising:

providing an acceleration indicating output from a hand-held device;

receiving said acceleration indicating output and providing a V proportionally normalized velocity indicating output; and

receiving said velocity indicating output and providing a tracking output indication.

44. A method for hand motion tracking according to claim 43 and wherein said providing a tracking indicating output includes at least one of representing a multi-dimensional object, representing drawing in the air, representing drawing in on a surface, representing a character tracking in the air, and representing a character tracking on a surface.

45. A method for hand motion tracking according to claim 43 and also comprising at least one of a computation based on the tracking output indication, a database operation on the tracking output indication, communication of tracking output indication and a control operations based on the tracking output indications.

46. A method according to claim 43 and further comprising:

normalizing at least a portion of the acceleration indicating output to a level of the average of the first few samples of the acceleration indicating output.

47. A method according to claim 43 and further comprising:

determining the last intentional motion sample of the acceleration indicating output and eliminating samples following said last intentional motion sample of the acceleration indicating output.

48. A method according to claim 47 and wherein determining of the last intentional motion sample comprises:

examining a record of the output of at least one of said acceleration sensors in order to determine the average of the last few samples;

thereafter, examining said record sequentially from the last few samples backwards in time direction until a variation from the average of at least a predetermined magnitude is encountered; and

determining a time location of this variation to be the time location of the last intentional motion.

49. A method according to claim 43 and wherein said providing a velocity indicating output further comprises identification of minimum motion points.

50. A method for hand motion tracking according to claim 43 and wherein said providing a proportionally normalized velocity indicating output comprises:

normalizing a velocity record depending on the position of a sample within said velocity record relative to the beginning and end of said velocity record.