Electronic acquisition of a hand formed expression and a context of the expression

• US 20060209051A1
• Filed: 03/18/2005
• Published: 09/21/2006
• Est. Priority Date: 03/18/2005
• Status: Active Grant

• Current Assignee: The Invention Science Fund I, L.L.C. (Intellectual Ventures LLC)
• Original Assignee: Searete LLC (Intellectual Ventures LLC)
• Inventors: Cohen, Alexander J., Lord, Robert W., Jung, Edward K.Y., Levien, Royce A., Malamud, Mark A., Rinaldo, John D. Jr.
• Granted Patent: US 8,340,476 B2
• Time in Patent Office: Days
• US Class Current: 345/179
• CPC Class Codes: G06F 3/002 Specific input/output arrangements not covered by G06F3/01 - G06F3/16 other optical apparatus G02B27/00
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 40/169 Annotation, e.g. comment data or footnotes
• CPC Class Codes: G06F 40/174 Form filling; Merging
• CPC Class Codes: G06V 10/12 Details of acquisition arrangements; Constructional details thereof
• CPC Class Codes: G06V 30/1423 the instrument generating sequences of position coordinates corresponding to handwriting preprocessing or recognising digital ink G06V30/32
• CPC Class Codes: G06V 30/32 Digital ink
• CPC Class Codes: H04L 67/04 specially adapted for terminals or networks with limited capabilities; specially adapted for terminal portability

Abstract

Embodiments include an apparatus, device, method, and computer program product. In an embodiment, a device includes a handheld writing device that includes a writing element, and a writing detector module operable to generate information indicative of a handwriting movement of the writing element. The device also includes a context detector module operable to generate information indicative of a content portion of a document proximate to the handwriting movement of the writing element.

Claims

1. A handheld writing device comprising:

a) a writing element;

b) a writing detector module operable to generate information indicative of a handwriting movement of the writing element; and

c) a context detector module operable to generate information indicative of a content portion of a document proximate to the handwriting movement by the writing element.

2. The handheld writing device of claim 1, wherein the writing element includes a marking element.

3. The handheld writing device of claim 1, wherein the writing element includes a non-marking element.

4. The handheld writing device of claim 1, wherein the writing detector module operable to generate information indicative of a handwriting movement of the writing element includes an electrical circuit operable to generate information indicative of a handwriting movement of the writing element.

5. The handheld writing device of claim 1, wherein the context detector module operable to generate information indicative of a content portion of a document proximate to the handwriting movement of the writing element includes an electrical circuit operable to generate information indicative of a content portion of a document proximate to the handwriting movement of the writing element.

6. The handheld writing device of claim 1, wherein the writing detector module operable to generate information indicative of a handwriting movement of the writing element includes a writing detector module operable to generate information indicative of a handwriting movement by the writing element generated by an activity of writing by hand.

7. The handheld writing device of claim 1, wherein the writing detector module operable to generate information indicative of a handwriting movement by the writing element includes a writing detector module operable to generate information indicative of a handwriting movement by the writing element in response to a hand generated activity.

8. The handheld writing device of claim 1, wherein the writing detector module includes the content detector module.

9. The handheld writing device of claim 1, wherein the context detector module operable to generate information indicative of a content portion of a document proximate to the handwriting movement by the writing element includes a context detector module operable to generate information indicative of a content portion of a displayed document proximate to the handwriting movement of the writing element.

11. The handheld writing device of claim 1, wherein the context detector module operable to generate information indicative of a content portion of a document proximate to the handwriting movement by the writing element includes a context detector module operable to generate information indicative of a printed content portion of a document proximate to the handwriting movement by the writing element.

14. The handheld writing device of claim 1, wherein the information indicative of a content portion of a document proximate to the handwriting movement of the writing element includes information indicative of a textual content portion of a document proximate to the handwriting movement of the writing element.

15. The handheld writing device of claim 1, wherein the information indicative of a content portion of a document proximate to the handwriting movement of the writing element includes information indicative of a human language content portion of a document proximate to the handwriting movement of the writing element.

16. The handheld writing device of claim 1, wherein the information indicative of a content portion of a document proximate to the handwriting movement of the writing element includes information indicative of a human readable content portion of a document proximate to the handwriting movement of the writing element.

17. The handheld writing device of claim 1, wherein the information indicative of a content portion of a document proximate to the handwriting movement of the writing element includes information indicative of a graphical content portion of a document proximate to the handwriting movement of the writing element.

18. The handheld writing device of claim 1, further comprising:

d) a recognition module operable to generate information indicative of a human readable content of the hand driven movement of the writing element in response to the information indicative of the hand driven movement of the writing element.

10. (canceled)

12. (canceled)

13. (canceled)

19. (canceled)

20. (canceled)

21. (canceled)

22. (canceled)

23. (canceled)

24. (canceled)

25. (canceled)

26. (canceled)

27. (canceled)

28. (canceled)

29. (canceled)

30. (canceled)

31. (canceled)

32. An apparatus having operability to:

a) mark a document;

b) generate an indicator of a position of the mark relative to an existing character of the document; and

c) save the mark and the indicator within the pen.

33. The apparatus of claim 32, wherein the existing character of the document includes at least one existing letter displayed by the document.

34. The apparatus of claim 32, wherein the existing character of the document includes at least one existing word displayed by the document.

35. The apparatus of claim 32, wherein the existing character of the document includes at least one existing image displayed by the document.

36. A device comprising a pen configured to mark relative to an existing character of a document based, at least in part, on a marking position relative to the existing character of the document, wherein the mark and an indicator of the marking position are saved within the pen.

37. An apparatus comprising:

a) a stylus configured to write on a surface;

b) a position sensor operable to generate information indicative of one or more handwriting movements of the stylus relative to the surface; and

c) an imaging element operable to generate information representing at least a portion of a content displayed from the surface proximate to the handwriting movements.

38. A method comprising:

a) generating in a handheld device a first information indicative of a handwriting movement of a writing element physically associated with the handheld device; and

b) generating in the handheld device a second information indicative of a content portion of a document proximate to the handwriting movement of the writing element.

39. A method comprising:

a) marking at least a portion of a document in response to a hand driven movement of a handheld marking device;

b) generating in the handheld marking device a first data set indicative of the marking; and

c) generating in the handheld marking device a second data set indicative of a content portion of the document proximate to the marking.

40. The method of claim 39, further comprising:

d) saving the first data set indicative of the marking in a digital storage medium physically associated with the handheld device.

41. The method of claim 39, further comprising:

d) saving the second data set indicative of a content portion of the document proximate to the marking in a digital storage medium physically associated with the handheld device.

42. The method of claim 39, further comprising:

d) transmitting from the handheld marking device the first data set indicative of the marking and the second data set indicative of a content portion of the document proximate to marking.

43. The method of claim 39, further comprising:

d) transmitting the first data set indicative of the marking from the handheld device.

44. The method of claim 42, wherein the transmitting the first data set indicative of the marking from the handheld device includes transmitting processed data corresponding to the first data set indicative of the marking from the handheld device.

45. The method of claim 39, further comprising:

d) transmitting the second data set indicative of a content portion of the document proximate to marking from the handheld device.

46. The method of claim 45, wherein the transmitting the second data set indicative of a content portion of the document proximate to marking from the handheld device includes transmitting processed data corresponding to the second data set indicative of a content portion of the document proximate to marking from the handheld device.

47. A computer program product embodied in code and operable to execute a computer process in a handheld computing device, the computer process comprising:

a) generating in the handheld device a first data set indicative of a handwriting movement of a writing element physically associated with the handheld device; and

b) generating in the handheld device a second data set indicative of a content portion of a document proximate to the handwriting movement of the writing element.

48. The computer program product of claim 47, further comprising:

c) saving in a digital storage medium physically associated with the handheld device the first data set indicative of a handwriting movement and the second data set indicative of a content portion of the document proximate to the handwriting movement.

49. The computer program product of claim 47, further comprising:

c) transmitting the first data set indicative of the handwriting movement.

50. The computer program product of claim 47, further comprising:

c) transmitting the second data set indicative of a content portion of the document proximate to the handwriting movement.

51. The computer program product of claim 47, wherein the computer program product includes a computer storage medium product.

52. The computer program product of claim 50, wherein the computer storage medium product includes a computer program product carried by a computer-readable carrier.

53. The computer program product of claim 47, wherein the computer program product includes a communications medium product.

54. (canceled)

55. (canceled)

56. (canceled)

57. (canceled)

58. (canceled)

59. (canceled)

60. (canceled)

61. (canceled)