Electronic ink as a software object

• US 7,292,727 B2
• Filed: 04/03/2006
• Issued: 11/06/2007
• Est. Priority Date: 07/19/2001
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Geidl, Erik M., Karlov, Donald D., Dain, Robert A.
• Primary Examiner(s): MARIAM, DANIEL G
• Application Number:
  US11/397,598
• Publication Number:
  US 20060182345A1
• Time in Patent Office: 582 Days
• Field of Search: 382/165, 382186-189, 382/202, 382/313, 382/100, 382/301, 178/18.01, 178/18.03, 178/19.01, 345/173, 345/179
• US Class Current: 382/188
• CPC Class Codes: G06F 40/166 Editing, e.g. inserting or deleting
• CPC Class Codes: G07C 9/37 using biometric data, e.g. fingerprints, iris scans or voice recognition

Abstract

Described is electronic ink maintained as a software object, thereby associating ink functionality with electronic ink data. The ink may be separated into words or characters, with one object per word or character. By the associated functionality, applications that deal with embedded objects in general can automatically benefit from electronic ink, including having the object'"'"'s functionality render the ink data as part the application'"'"'s document. Further, because the ink data is maintained as an object, the data is automatically persisted in association with the document into which it is embedded. Ink-aware applications may call on methods of the electronic ink object to adjust formatting, search recognized ink along with text, and perform other functions. Via the electronic ink object, electronic ink substantially approaches much of the behavior normally available with text data, without requiring applications to interpret the ink data.

Claims

1. In a computing device, a system comprising:

an input device configured to receive handwriting input and convert the handwriting input to electronic ink information;

a mechanism configured to provide an object to maintain electronic ink data that corresponds to the electronic ink information, the object being embeddable within a software application and having electronic ink-related functionality maintained as part of the object;

executable code associated with the object comprising functionality arranged to interpret the electronic ink data, output a representation of the electronic ink data therefrom, and to enable manipulation of the format representation of the electronic ink data; and

a software module that invokes the functionality of the object via at least one interface to cause the object to interpret the electronic ink data to output the representation.

2. The system of claim 1 wherein the input device comprises a tablet.

3. The system of claim 1 further comprising a display device, wherein the object outputs the representation of the electronic ink data as a visual image to the display device.

4. The system of claim 1 wherein the software module comprises an application program, and wherein the functionality is further arranged to enable the application program to control the output of the representation.

5. The system of claim 4 wherein the output comprises a displayed image, and wherein the application program controls the output by requesting a particular representation of the displayed image.

6. The system of claim 1 wherein the output comprises a displayed image, and wherein the object includes additional data and functionality for adjusting the image appearance to correspond to information displayed relative to the image.

7. The system of claim 1 further comprising a handwriting recognizer that converts electronic ink information to other information, and wherein the object maintains at least some results from the handwriting recognizer.

8. The system of claim 1 wherein the object is further associated with functionality comprising, a method directed to performing at least one of the following operations:

editing, formatting and searching.

9. The system of claim 1 wherein the object is further associated with functionality comprising, a method directed to performing at least one of the following operations:

combining multiple objects into a single object, and separating a single object into multiple objects.

10. The system of claim 1 further comprising, a handwriting recognizer that converts electronic ink information to words, and wherein the object represents a single word.

11. The system of claim 1 wherein the object includes additional data comprising at least one of the following types of data:

normalization data, previous object identification data, and next object identification data.

12. A computer-readable medium having stored thereon a data structure, comprising,

a data field including electronic ink data;

at least one interface for invoking functionality associated with the data structure, including functionality for rendering a representation of the electronic ink data; and

the functionality invoked via the interface by executable code that has opened a document containing the data structure, the functionality invoked to render a representation of the electronic ink data relative to other information contained in the document; and

at least one other data field that maintains information related to the format of the rendered electronic ink data representation, and further comprising other functionality associated with the data structure to enable the executable code to modify the style information.

13. The data structure of claim 12 further comprising, other functionality for matching the appearance of the representation to the other information contained in the document.

14. The data structure of claim 12 wherein the other information contained in the document comprises text data, and further comprising, at least one other data field in the data structure for maintaining adjustment information for adjusting the representation to match the text data, and other functionality associated with the data structure for adjusting the representation based on the adjustment information to match the text data.

15. The data structure of claim 14 wherein the at least one other field contains baseline data, and wherein the functionality adjusts the representation to match the text data by evaluating the baseline information.

16. The data structure of claim 14 wherein the at least one other field contains midline data, and wherein the functionality adjusts the representation to match the text data by evaluating the midline information.

17. The data structure of claim 12 further comprising, at least one other data field that maintains identifier information of another object.

18. The data structure of claim 12 further comprising, at least one other data field that maintains information related to normalization of the electronic ink data.

19. The data structure of claim 12 further comprising, at least one other data field that maintains information related to formatting the electronic ink data, and further comprising other functionality associated with the data structure to enable the executable code to modify the information related to formatting the electronic ink data.

20. The data structure of claim 12 further comprising, at least one other data field, the other data field or fields containing data corresponding to at least one of:

data that maintains color information related to a color of the electronic ink data, data that maintains size information related to a displayed size of the electronic ink data, data that maintains recognition information related to recognition of the electronic ink data by a recognition engine, data that maintains recognition state information, data that maintains a result from the recognition engine, and data that maintains at least one candidate corresponding to the electronic ink data.