Script character processing method and system

• US 6,499,043 B1
• Filed: 09/12/1996
• Issued: 12/24/2002
• Est. Priority Date: 03/20/1991
• Status: Expired due to Fees

• Current Assignee: Microsoft Corporation
• Original Assignee: Microsoft Corporation
• Inventors: Forcier, Mitchell D.
• Primary Examiner(s): Hong, Stephen S.
• Application Number:
  US08/711,906
• Time in Patent Office: 2,294 Days
• Field of Search: 395/804, 395/802, 395/792, 395/358, 382/179, 382/187, 382/311, 345/358, 707/530, 707/539, 707/541
• US Class Current: 715/273
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 40/10 Text processing natural language analysis G06F40/20; semantic analysis G06F40/30; processing or translation of natural language G06F40/40
• CPC Class Codes: G06F 40/166 Editing, e.g. inserting or deleting

Abstract

A pen-based processor needs to be usable to input and edit script like a text-based computer but retain a resemblance to the user of a pad and pencil. The disclosed system and method implement input, editing and other manipulation of glyphs including handwritten script, ASCII test, bit-mapped images and drawings in a common document, using a compatible internal representation of the data and a simple, consistent set of user control functions. These functions are invoked using an intuitive and interactive set of user gestures which do not distract the user from the task of inputting or editing the document. A two-step gesture method avoids confusion between strokes and command gestures and allows use of similar gestures for different functions within the same and different contexts. The system infers from customary user writing conventions that certain relationships of data are to be preserved, including delineation of words and paragraphs, and maintains the relationships, subject to user override, during editing. The display document is formatted to contain lined or unlined areas of glyphs that can be edited, including insertion of a moving space into pre-existing document text and word wrapping. Adjoining drawing areas are unaffected by editing of text data.

Claims

1. A computerized method for processing ink stroke representations into groups for manipulation as at least one distinct set of data, said method comprising the steps of:

grouping the ink stroke representations into a plurality of line groups based on a position of each ink stroke representation;

combining the ink stroke representations of a selected line group into at least one word group;

determining whether strokes on a display area on a screen are substantially indented;

determining whether strokes on a display area on a screen leave blank space for a statistically significant distance prior to a right margin;

determining placement of the ink stroke representations for a first line group;

determining placement of the ink stroke representations for a second line group, said second line group adjacent to and following the first line group;

combining the first and second line groups into a common distinct set of data if the first line group has strokes that are determined to not leave blank space for the statistically significant distance prior to the right margin and the second line group does not begin with a stroke that is substantially indented; and

forming separate distinct sets of data corresponding to the first and second line groups if the first line group has strokes that are determined to leave blank space for the statistically significant distance prior to the right margin or the second line group begins with a stroke that is substantially indented.

2. The method of claim 1, wherein the step of combining the ink stroke representations of the selected line group into at least one word group further comprises the steps of:

a) retrieving a first ink stroke representation associated with a line area;

b) calculating x position values for the first ink stroke representation;

c) forming a first word from the first stroke and the x position values of the first stroke;

d) retrieving a second ink stroke representation;

e) calculating x position values for the second ink stoke representation;

f) comparing the x position values for the first ink stroke representation to the x position values for the second ink stroke representation;

g) grouping the first ink stroke representation and the second ink stroke representation together as a first word, if any of the x position values of the first ink stroke representation are within a predetermined distance of corresponding x position values of the second ink stroke representation;

h) grouping the first ink stroke representation as the first word and the second ink stroke representation as a second word, if none of the x position values are within a predetermined distance of corresponding x position values of the second ink stroke representation.

4. The method of claim 2, further comprising the steps of:

comparing the first word to an existing word already formed on the line area; and

grouping the ink stroke representations forming the first word and the ink stroke representations forming the existing word together into a single new word, if any of the x position values of ink stroke representations forming the first word are within a predetermined distance of corresponding x position values of ink stroke representations forming the existing word.

3. A computerized method for processing a plurality of ink stroke representations associated with a line area into words, said method comprising the steps of:

a) retrieving a first ink stroke representation associated with the line area;

b) calculating x position values for the first ink stroke representation;

c) retrieving a second ink stroke representation;

d) calculating x position values for the second ink stroke representation;

e) comparing the x position values for the first ink stroke representation to the x position values for the second ink stroke representation;

f) grouping the first ink stroke representation and the second ink stroke representations together as a first word, if any of x position values of the first ink stroke representation are within a predetermined distance of the corresponding x position values of the second ink stroke representation;

g) grouping the first ink stroke representation as the first word and the second ink stroke representation as a second word, if none of the x position values of the first ink stroke representation are within a predetermined distance of the corresponding x position values of the second ink stroke representation.

5. The method of claim 3, wherein step (g) further comprises the steps of:

retrieving a third ink stroke reprentation associated with the line area;

calcuating x position values for the third ink stroke representation;

comparing x position values of the third ink stroke representation to the x position values of the first word band by band;

grouping the third ink stroke representation and the first word together as an increased sized first word, if any of the x position values of the third ink stroke representation are within a predetermined distance of corresponding x position values of the first word; and

grouping the third ink stroke representation as a second word if none of the x position values of the third ink stroke representation are within a predetermined distance of corresponding x position values of the first word.

6. A computerized method for grouping a plurality of lines of ink stroke representations into at least one distinct set of data, said method comprising the steps of:

determining a placement of the ink stroke representations on a first line;

determining a placement of the ink stroke representations on a second line, said second line adjacent to and following the first line; and

grouping the first line and the second line together as a distinct set of data if the first line has ink stroke representations beyond a statistically significant distance left of a right margin and the second line has ink stroke representations in within a substantial indentation distance relative to a left margin.

7. The computerized method of claim 6, wherein the left and right margins extend substantially vertically across the display area.

8. The computerized method of claim 6, wherein an area between the statistically significant distance to the left of the right margin and the right margin, and an area between the left margin and the substantial indentation distance relative to the left margin, extend substantially horizontally across the display area.

9. The computerized method of claim 6, wherein the display area has no visible representation thereon of where the statistically significant distance to the left of the right margin is located, and no visible representation of where the substantial indentation distance relative to the left margin is located.

10. A computerized method for grouping a plurality of lines of ink stroke representations into distinct sets of data, said method comprising the steps of:

determining placement of the ink stroke representations on a first line;

determining placement of the ink stroke representations on a second line, said second line following the first line;

determining placement of the ink stroke representations on a third line, said third line following the second line;

grouping the first line and the second line together as a distinct set of data if the first line has ink stroke representations between a right margin and a position defined by a statistically significant distance to the left of the right margin, and the second line has ink stroke representations between a left margin and a location defined by a substantial indentation distance to the right of the left margin; and

grouping the third line with the first line and the second line as a distinct set of data if the second line has ink stroke representations between the right margin and the location defined by a statistically significant distance to the left of the right margin and the third line has ink stroke representations within a predetermined indentation distance based on a leftmost ink stroke representation of the second line.

11. A computerized method for grouping a plurality of lines of ink stroke representations into distinct sets of data, said method comprising the steps of:

defining on a display area of a screen a plurality of line areas extending in a first direction;

defining an indentation space based on a substantial rightward indentation distance relative to a left point of reference, and a blank evaluation space based a statistically significant leftward distance relative to a right point of reference, the indentation space and blank evaluation space each extending in a second direction substantially perpendicular to the first direction and across the plurality of line areas;

determining placement of the ink stroke representations in a first line area;

determining placement of the ink stroke representations in a second line area, said second line area adjacent and following the first line area;

grouping the ink stroke representations associated with the first line area and the second line area together as a distinct set of data if the first line area has ink stroke representations in the blank evaluation space and the second line area has ink stroke representations in the indentation space; and

grouping the ink stroke representations associated with the first line area as a first distinct set of data and the ink stroke representations associated with the second line area as a second distinct set of data if the first line area does not have ink stroke representations in the blank evaluation space or the second line area does not have ink stroke representations in the indentation space.

12. A computerized method for processing a plurality of ink stroke representations associated with a line area into words, said method comprising the steps of:

a) retrieving a first ink stroke representation associated with the line area;

b) calculating leftmost and rightmost horizontal extents for the first ink stroke representation across a vertical extent of the strokes;

c) retrieving a second ink stroke representation;

d) calculating leftmost and rightmost horizontal extents for the second ink stroke representation across a vertical extent of the strokes;

e) comparing the horizontal extents for the first ink stroke representation to the horizontal extents for the second ink stroke representation;

f) grouping the first ink stroke representation and the second ink stroke representations together as a first word, if one of the horizontal extents of the first ink stroke representation is within a predetermined distance of one of the horizontal extents of the second ink stroke representation;

g) grouping the first ink stroke representation as the first word and the second ink stroke representation as a second word, if none of the horizontal extents of the first ink stroke representation are within a predetermined distance of any of the horizontal extents of the second ink stroke representation.

13. A method for displaying text in a pen-based computer system comprising the steps of:

entering a word into a document, the word comprising at least one character entered into a pen-based computer system by a stylus means;

displaying said word on a screen of said computer system;

automatically associating said word with a first distinct set of at least one other word defined by an associated marker in the document if entry of said word does not meet defined rules for inserting a new marker, wherein said word is incorporated into said first distinct set without receiving an explicit command to incorporate said word; and

creating a second distinct set of at least one word by inserting a second marker into the document to define a second distinct set of at least one word and associating said word with the second distinct set if entry of said word meets defined rules for inserting a new marker.

14. A computerized method for automatically detecting distinct sets of data among lines of text, which include one or more of ink stroke, binary encoded character, or bitmapped image glyphs, the method comprising:

associating the text with line spaces;

examining the text within the line spaces according to a set of rules;

automatically inserting a marker datum preceding all text in a line space if, according to the rules, the text in the line space should be grouped separately from text in the preceding line space; and

automatically deleting a marker datum preceding all text in a line space if, according to the rules, the text in the line space should be grouped with the text in the preceding line space.

15. A method according to claim 14 including a rule according to which a marker datum is always inserted for the first line space of the document.

16. A method according to claim 14 including a rule according to which a marker datum is inserted whenever the line space is blank and is followed by a line space containing text.

17. A method according to claim 14 including a rule according to which a marker datum is inserted whenever the line space contains text and immediately follows a blank line space.

18. A method according to claim 14 including a rule according to which a marker datum is inserted whenever the line space contains text and said preceding line space does not contain text for a predetermined distance prior to the end of the line space.

19. A method according to claim 18 including a rule according to which a marker datum will be deleted if a text word greater in width than said predetermined distance is detected at the beginning of the line space.

20. A method according to claim 14 including a rule according to which a marker datum is inserted whenever the text in the line space is indented beyond a predetermined distance from the beginning of the line space.

21. A method according to claim 14 including a rule according to which an existing marker datum will be deleted if none of the rules for inserting a marker datum can be applied.

22. A method according to claim 14 wherein a marker datum will not be automatically inserted if a previous marker datum was explicitly removed from the line space.

23. A method according to claim 14 wherein a marker datum will not be automatically deleted if the marker was explicitly inserted into the line space.

24. A method according to claim 14 whereby said automatic detection of distinct sets of data is performed dynamically as the document text is entered and edited.

25. A method according to claim 14 whereby said automatic detection of distinct sets of data is performed on the text of a pre-existing document without the addition of new text.

26. A method according to claim 14 whereby a series of adjacent line spaces bounded by a first marker datum preceding text in a first line space and a second marker datum preceding text in a subsequent line space is treated as a standard text set of data.

27. A method according to claim 14 including a rule according to which text is associated with a non-text area and is considered to be part of a graphic set of data which is edited differently from text-type sets of data.

28. A computerized method for automatically detecting first and second sets of data among lines of text, which include one or more of ink stroke, binary encoded character, or bitmapped image glyphs, the method comprising:

associating the text with line spaces;

examining the text within first and second line spaces according to a set of rules;

automatically grouping the text in the first line space in a first set of data;

automatically grouping all text in the second line space as a part of a second set of data if, according to the rules, the text in the second line space should be grouped separately from the text in a preceding first line space; and

automatically grouping all text in the first and second line spaces together as a single set of data if, according to the rules, the text in the second line space should be grouped with the text in the preceding first line space.

29. A method according to claim 28 including a rule according to which the second line space is grouped into the second set of data whenever the second line space contains text and said preceding first line space does not contain text for a predetermined distance prior to the end of the first line space.

30. A method according to claim 29 including a rule according to which the second line space is grouped into the first set of data if a text word greater in width than said predetermined distance is detected at the beginning of the second line space.

31. A method according to claim 28 including a rule according to which the second line space is grouped into the second set of data whenever the second line space is indented beyond a predetermined distance from the beginning of the second line space.

32. A method according to claim 28 whereby said automatic detection of sets of data is performed dynamically as the document text is entered and edited.

33. A method according to claim 28 including:

inserting additional text into the first set of data;

word wrapping text from an end of the first line space into the second line space; and

shifting the text in the second line space to a third line space, preserving the grouping of the second set of data.

34. A device for positioning handwritten data on a display comprising:

a receiver for receiving input of handwritten data;

a display for displaying said handwritten data;

a data entry device for entering a set of handwritten strokes of said handwritten data;

a positional identifier for identifying a positional guideline for said set of handwritten strokes; and

a data positioner for positioning said set of handwritten strokes on said display based on said positional guideline of said set of handwritten strokes.

35. The device of claim 34 wherein said positional guideline is a baseline of said set of handwritten strokes.

36. method for positioning handwritten data on a display comprising:

receiving input of handwritten data;

displaying said handwritten data;

entering a set of handwritten strokes of said handwritten data;

identifying a positional guidefine for said set of handwritten strokes; and

positioning said set of handwritten strokes on said display based on said positional guideline of said set of handwritten strokes.

37. The method of claim 36 wherein said positional guideline is a baseline of said set of handwritten strokes.

38. The method of claim 36 wherein said display receives and displays said handwritten data.

39. The method of claim 36 wherein a pen is used to enter said set of handwritten strokes of said handwritten data.