Script/binary-encoded-character processing method and system with moving space insertion mode

• US 5,220,649 A
• Filed: 04/29/1991
• Issued: 06/15/1993
• Est. Priority Date: 03/20/1991
• Status: Expired due to Term

• Current Assignee: Microsoft Corporation
• Original Assignee: Mitchell D. Forcier
• Inventors: Forcier, Mitchell D.
• Primary Examiner(s): Herndon, Heather R.
• Application Number:
  US07/693,316
• Time in Patent Office: 778 Days
• Field of Search: 395/144-148, 395/155, 395/161, 340/706, 340/721, 340/723
• US Class Current: 715/273
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 40/10 Text processing natural language analysis G06F40/20; semantic analysis G06F40/30; processing or translation of natural language G06F40/40
• CPC Class Codes: G06F 40/166 Editing, e.g. inserting or deleting

Abstract

A pen-based processor needs to be usable to input and edit script like a text-based computer but retain a resemblance to the user of a pad and pencil. The pen-based computer implements input, editing and other manipulation of glyphs including handwritten script, ASCII test, bitmapped images and drawings in a common document, using a compatible internal representation of the data and a simple, consistent set of user control functions. These functions are invoked using an intuitive and interactive set of user gestures which do not distract the user from the task of inputting or editing the document. A two-step gesture method avoids confusion between strokes and command gestures and allows use of similar gestures for different functions within the same and different contexts. The system infers from customary user writing conventions that certain relationships of data are to be preserved and maintains the relationships, subject to user override, during editing. The display document is formatted to contain both lined areas of glyphs that can be edited, including insertion of a moving space into pre-existing document text and word wrapping. Adjoining unlined drawing areas are unaffected by editing of lined area contents.

Claims

1. A pen-based computer method for a user interactively to edit a series of glyphs which include one or more of handwritten script, text or bitmapped images using a pen-type electrical input device on a dynamic document display having a series of lines defining line spaces for writing script, the method comprising:

displaying the series of glyphs on the document display along at least one of said lines;

entering a first command using the input device in a predetermined manner at a user-determined location along a selected one of said lines to assert an insert moving space function, the computer and document display being responsive to open a predetermined amount added space at said location in the selected line including shifting any pre-existing glyphs on the selected line on one side of said location in a direction along the line away from said location;

entering one or more added glyphs in the added space proceeding in said direction along the line using the input device, the computer and document display being responsive to the entry of the added glyphs to supplement the added space to approximate the amount of added glyphs; and

entering a second command to assert a collapse moving space function, the computer and document display being responsive to close the added space including shifting the pre-existing glyphs on said one side of said location along said line toward the added glyphs.

2. A method according to claim 1 including setting a triggerpoint at an offset defining a distance from said location in said direction, the computer and document display being responsive to entry of an added glyph in said direction past the triggerpoint to initiate supplementing of the added space.

3. A method according to claim 2 in which the offset distance is less than the predetermined amount of added space.

4. A method according to claim 2 in which said offset is set by the user.

5. A method according to claim 2 in which the predetermined amount of added space is set by the user.

6. A method according to claim 1 in which said location is positioned between adjacent first and second pre-existing glyphs having an initial glyph spacing, the computer being responsive to save said initial glyph spacing.

7. A method according to claim 6 in which said computer is responsive to the second command to restore said initial glyph spacing relative to the added glyphs upon closing the added space.

8. A method according to claim 6 in which said computer is responsive to the second command to reposition each part of the split stroke to adjoin opposite ends of the added glyphs upon closing the added space.

9. A method according to claim 1 in which said location is positioned within a selected pre-existing glyph so as to intersect a stroke defining a portion of the selected glyph, the computer being responsive to split the stroke and save each part thereof.

10. A method according to claim 1 in which said lines extend horizontally across the document display and the direction in which glyphs are shifted in response to the first command and script is entered using the input device in a rightward direction.

11. A pen-based computer method for a user interactively to edit glyphs on a dynamic document display to insert handwritten script using a pen-type electrical input device, the method comprising:

forming a series of lines, each having a beginning point and an end point, to define line spaces for writing script;

entering glyphs, including one or more of handwritten script, text or bitmapped images, along one or more of said line spaces on the document display;

entering a first command using the input device at a user-determined location along a selected one of said line spaces to assert an insert moving space function, the computer and document display being responsive to open a predetermined amount of added space at said location in the selected line space including shifting any pre-existing glyphs in the selected line space on one side of said location in a direction along the line away from said location; and

entering handwritten script in the added space proceeding in said direction along the line using the input device, the computer and document display being responsive to the entry of the script to supplement the added space to approximate the amount of added script.

12. A method according to claim 11 including setting a triggerpoint at an offset defining a distance from said location in said direction, the computer and document display being responsive to entry of added script in said direction past the triggerpoint to initiate supplementing of the added space.

13. A method according to claim 12 in which the offset distance is less than the predetermined amount of added space.

14. A method according to claim 12 in which said offset is set by the user.

15. A method according to claim 11 in which the predetermined amount of added space is set by the user.

16. A method according to claim 11 in which said location is positioned between adjacent first and second pre-existing glyphs having an initial glyph spacing, the computer being responsive to save said initial glyph spacing.

17. A method according to claim 16 including entering a second command to assert a collapse moving space function, the computer and document display being responsive to close the added space including shifting the pre-existing glyphs on said one side of said location along said line toward the added script a distance sufficient to restore said initial glyph spacing relative to an endpoint of the added script.

18. A method according to claim 11 including entering a third command using the input device within the added space to assert a moving space propagation function, the computer and document display being responsive to the third command to supplement the added space.

19. A method according to claim 11 in which the amount of added space is sufficient to shift at least a portion of one or more of the pre-existing glyphs in the selected line space in said direction past one of the endpoint and beginning point of the line, the computer and document display being responsive to wrap the glyphs thus shifted between the end and beginning points of successive line spaces.

20. A method according to claim 11 in which the amount of added space is sufficient to shift at least a portion of one or more of the pre-existing glyphs in the selected line space rightward past the endpoint of the line, the computer and document display being responsive to wrap the glyphs shifted past the endpoint to a position rightward of the beginning point of the next successive line space.

21. A method according to claim 11 in which the insert moving space function is context sensitive to open a different amount of added space at the user-determined location of the first command in the selected line space depending on whether said location is between glyphs within a word or between words.

22. A method according to claim 11 in which the moving space remains open for entry of added script while the user enters strokes elsewhere on the document display.

23. In a pen-based computer, a dynamic document display in combination with a pen-type electrical input device, the display comprising:

a display window;

a group of lines arranged in a parallel, spaced-apart manner on the display window, each line having beginning and ending points defining a length of each line; and

line space segments between the lines, each line space segment bounded widthwise by a pair of adjacent liens and lengthwise by the length of an associated one of the lines;

the line space segments each including a matrix of data points for receiving and displaying data therein, and being coupled in series so as to establish continuity of the line space segments from an endpoint of a first line to a beginning point of a second line;

means responsive to a first user action at a selected location in the first line for inserting a first amount of moving space in the associated line space segment and shifting a portion of the data displayed in the data points of the associated line space segment lengthwise therealong in a predetermined direction away from said location; and

means responsive to entry of added data in a portion of the moving space for supplementing the first amount of moving space by adding a second amount thereto approximately equal to the portion filled by the added data and further shifting the previously-shifted portion of data in said predetermined direction.

24. A document display according to claim 23 including means for shifting said portion of data serially across the endpoint of the first line and beginning point of the second line to a successive line space segment.

25. A document display according to claim 24 in which the data points are organized into separable words each having first and last points defining a length of the word, the shifting means being operative to shift each word as a unit, including all data points between the first and last points, across the beginning and ending points of lines to the adjoining line space segment.

26. A document display according to claim 24 including means for entering a beginning of line (BOL) marker at the beginning point of the second line, the shifting means being responsive to the BOL marker to shift the BOL marker and the data points in the line space segment at the second line to a third line.

27. A document display according to claim 23 including means responsive to a second user action for collapsing the moving space by shifting the previously-shifted portion of data serially in a direction opposite said predetermined direction toward said added data.

28. A document display according to claim 27 in which the data points are organized into separable glyphs or words each having first and last points and a glyph or word spacing therebetween, the shifting means including means responsive to a first user action for storing the spacing between glyphs or words adjacent said location and the means responsive to the second user action including means for restoring a spacing approximately equal to the stored glyph or word spacing upon collapsing of the moving space.

29. A document display according to claim 23 in which the display window is formatted as a page with a margin along one or more of the top, bottom, left and right page boundaries containing said lines, including a margin adjoining one of the beginning and ending points of the lines having a width that can be varied inversely with the lengths of the lines and defining a drawing space that is nonresponsive to said means responsive to a user action for shifting data in the data points lengthwise along the line space segments.

30. A document display according to claim 23 including means responsive to a predetermined user action when the added moving space is shifted out of a visible area of the display window to automatically scroll more lines into the visible area.

31. A pen-based computer method for a user interactively to enter and edit glyphs including handwritten script and drawing strokes using a pen-type electrical input device on a dynamic document display, the method comprising:

forming a series of lines, each having a beginning point and an end point, to define line spaces for writing script, each line space being associated with one of said lines;

entering handwritten script or drawing strokes or both in one or more of said line spaces on the document display, each stroke comprising a finite series of data points including a starting point; and

encoding the handwritten script or drawing strokes entered in the line spaces for storage, retrieval and display, including, for each script or drawing stroke;

determining and storing the line associated with the line space to which the stroke belongs;

storing a location of the starting point of the stroke within the line space; and

determining and storing a direction for each successive data point in the stroke in a format that permits substantially replication of the stroke, including storing a datum defining each occurrence or an absence of a change of direction from one point to a successive point.

32. A method according to claim 31 in which an initial direction is encoded from the starting point to a second point and a second direction from the second point to a third point is encoded so as to define one of no-change-in-direction from the preceding point and a clockwise or counterclockwise change from said direction to establish a new direction.

33. A method according to claim 32 including encoding the initial direction as at least three binary digits, encoding the no-change-of-direction as a single binary digit, encoding the clockwise or counterclockwise change of direction as at least two binary digits, and serially concatenating said binary digits for the finite series of points in the stroke.

34. A method according to claim 33 including encoding a predetermined number of binary digits defining a number of data points in each stroke and concatenating said plurality of binary digits with the binary digits serially concatenated for the finite series of points in the stroke.

35. A method according to claim 32 including preprocessing the data points defining each stroke to remove gaps or duplicate data points.

36. A method according to claim 35 in which preprocessing the data points includes searching for series of three adjoining data points which form an L and deleting a selected one of said three points.

37. A method according to claim 36 in which the selected one of three points is selected by determining which one of adjoining second and third points forming an L formation with a first point is located at a largest distance in X-Y coordinates from the first point.

38. A method according to claim 32 including selecting strokes having a length exceeding a predetermined maximum length or a change in direction exceeding a predetermined maximum deflection, and dividing the selected strokes into at least two concatenated ministrokes and encoding each ministroke as a separate stroke.

39. A method according to claim 31 including storing each stroke within a given line space in a stroke database according to a leftmost point of each stroke so that the strokes are ordered from left to right in the database.

40. A method according to claim 31 in which the line space to which a stroke belongs is determined by the starting point of the stroke.