Incorporating handwritten notations into an electronic document

• US 7,013,029 B2
• Filed: 06/29/2001
• Issued: 03/14/2006
• Est. Priority Date: 06/29/2001
• Status: Expired due to Fees

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Bowman, Mic, Keskar, Dhananjay V.
• Primary Examiner(s): Mehta, Bhavesh M.
• Assistant Examiner(s): CARTER, AARON W
• Application Number:
  US09/897,703
• Publication Number:
  US 20030026481A1
• Time in Patent Office: 1,719 Days
• Field of Search: 382119-123, 382/115, 382/116, 382/112, 382187-189, 382/314, 738/654, 178 1801- 2004, 348/161
• US Class Current: 382/119
• CPC Class Codes: G06F 3/002 Specific input/output arrangements not covered by G06F3/01 - G06F3/16 other optical apparatus G02B27/00
• CPC Class Codes: G06F 3/0317 in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface
• CPC Class Codes: G06F 3/03545 Pens or stylus

Abstract

An apparatus is disclosed that includes a memory storage unit to store an electronic version of a page and a processor coupled to the memory storage unit. The processor is configured to receive data associated with a handwritten notation applied to a printed page and an electronic image of an area of the printed version of the page near the notation, to identify a corresponding passage in the electronic version of the page and to create an electronic notation based on the received data and associated with the corresponding passage.

Claims

1. An apparatus comprising:

a memory storage unit to store an electronic version of a page; and

a processor coupled to the memory storage unit, the processor to receive data associated with a handwritten notation applied to a printed page and an electronic image of an area of the printed page near the notation, the electronic image including a printed passage comprising text, illustrations, or both the text and the illustrations, the processor to use the printed passage to identify a corresponding passage in the electronic version of the page stored in the memory storage unit, to use the data associated with the handwritten notation to create an electronic notation, and to incorporate the electronic notation in the electronic version of the page stored in the memory storage unit as a comment linked to the corresponding passage.

2. The apparatus of claim 1 wherein the processor is configured to identify the electronic version of the page based on a received page identifier.

3. The apparatus of claim 1 wherein the processor is configured to identify a first portion of the electronic image that represents the printed passage and to identify a second portion of the electronic image that represents the handwritten notation.

4. The apparatus of claim 3 wherein the processor is configured to apply optical character recognition to transform the first portion of the electronic image into digital text.

5. The apparatus of claim 4 wherein the processor is configured to identify the corresponding passage by searching the electronic version of the page for the digital text.

6. The apparatus of claim 1 wherein the processor is configured to create a bitmap image based on the data associated with the handwritten notation and to identify a correlation with the corresponding passage of the electronic version of the page.

7. The apparatus of claim 1 wherein the processor is configured to apply handwritten character recognition to transform the data associated with the handwritten notation into digital text and to identify a correlation between the digital text and the corresponding passage.

8. A system comprising:

a computer comprising a processor and a memory storage device storing an electronic version of a printed page; and

a writing utensil to apply a notation to the printed page, the writing utensil including a scanner positioned to scan a surface of the printed page as the notation is being applied to the printed page, the surface of the printed page including visible printed matter corresponding to a part of the electronic version of the printed page;

wherein the processor includes a port to receive from the writing utensil stroke data associated with the notation applied by the writing utensil and an electronic image of the visible printed matter of an area of the surface of the printed page near the applied notation scanned by the scanner, and is configured to create an electronic notation based on the stroke data and to incorporate the electronic notation into the electronic version of the printed page as a comment linked to the corresponding part of the electronic version of the printed page.

9. The system of claim 8 wherein the port is configured to receive an image of a page identifier scanned by the scanner and the processor is configured to identify the electronic version of the printed page in the memory storage device based on the received image of the page identifier.

10. The system of claim 8 wherein the processor is configured to apply optical character recognition to transform a part of the electronic image that represents the area of the printed page near the applied notation into digital text.

11. The system of claim 10 wherein the processor is configured to identify the corresponding part of the electronic version of the printed page by searching the electronic version of the printed page for a passage containing the digital text.

12. The system of claim 8 wherein the processor is configured to create a bitmap image based on the received stroke data and to identify a correlation between the bitmap image and the corresponding part of the electronic version of the printed page.

13. The system of claim 8 wherein the processor is configured to apply handwritten character recognition to transform the stroke data into digital text.

14. A method comprising:

applying a handwritten notation with a writing utensil to a page that includes a visible printed passage with which the handwritten notation is associated;

simultaneously capturing stroke data associated with the handwritten notation and scanning a portion of the associated printed passage with a scanner connected to the writing utensil to create a scanned image; and

correlating the captured stroke data with a particular portion of an electronic version of the page based on the scanned image.

15. The method of claim 14 comprising identifying a portion of the scanned image that represents the associated printed passage and applying optical character recognition to transform the portion into digital text.

16. The method of claim 15 comprising identifying the particular portion of the electronic version of the page by searching the electronic version of the page for a specific passage containing the digital text.

17. The method of claim 14 wherein capturing the stroke data comprises utilizing an echo-location technique.

18. The method of claim 14 wherein the page comprises grid marks and wherein capturing the stroke data comprises utilizing an image processing technique to track movement of the writing utensil based on the grid marks.

19. The method of claim 14 comprising creating a bitmap image based on the captured stroke data.

20. The method of claim 14 comprising applying handwritten character recognition to convert the stroke data into digital text.

21. The method of claim 20 comprising creating a link between the digital text and the particular portion of the electronic version of the page.

22. The method of claim 14 wherein correlating the captured stroke data with the particular portion of the electronic version of the page comprises employing a pattern recognition technique.

23. An article comprising a computer-readable medium that stores computer-executable instructions for causing a computer system to:

create an electronic notation in response to received data associated with a handwritten notation applied to a printed version of a page and a received electronic image of a passage identifier indicative of a visible printed passage on the page; and

incorporate the electronic notation into an electronic version of the page stored in memory as a comment linked to a passage in the electronic version of the page, wherein the passage in the electronic version of the page corresponds to the received electronic image of the passage identifier.

24. The article of claim 23 comprising computer-executable instructions for causing the computer system to identify the electronic version of the page in response to a received page identifier associated with the printed version of the page.

25. The article of claim 23 comprising computer-executable instructions for causing the computer system to apply optical character recognition to transform the received passage identifier into digital text and to identify the corresponding passage of the electronic version of the page by searching the electronic version of the page for a passage containing the digital text.

26. The article of claim 25 comprising computer-executable instructions for causing the computer system to indicate a correlation between the data associated with the notation and the passage containing the digital text.

27. An apparatus comprising:

a writing utensil having a writing tip to selectively dispense a writing medium onto a printed page for creating a notation and to capture stroke data associated with the notation, the writing utensil including a scanner positioned immediately above and outward from the writing tip to scan an area of the printed page near the notation as the notation is being applied to create an image, the scanned area including a printed passage, the printed passage visible to a user of the writing utensil;

a processor coupled to the writing utensil to identify a correlation between the stroke data and the image; and

memory coupled to the processor to store the stroke data, the image and the correlation.

28. The apparatus of claim 27 comprising a wireless transmitting device to transmit the image to a remote device.

29. The apparatus of claim 27 comprising an adjustable power switch to enable a user to selectively disconnect a power source from the scanner.

30. The apparatus of claim 27 comprising a conductive contact positioned to mate with an external adapter to transmit the image to a remote device.