Apparatus and method for editing handwritten stroke

• US 5,796,866 A
• Filed: 12/08/1994
• Issued: 08/18/1998
• Est. Priority Date: 12/09/1993
• Status: Expired due to Fees

• Current Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation)
• Original Assignee: Matsushita Electric Industrial Company Limited (Panasonic Holdings Corporation)
• Inventors: Sakurai, Yasuhiro, Kamo, Osamu
• Primary Examiner(s): Johns, Andrew W.
• Assistant Examiner(s): Davis, Monica S.
• Application Number:
  US08/351,785
• Time in Patent Office: 1,349 Days
• Field of Search: 382/186, 382/187, 382/310, 395/146, 358/280
• US Class Current: 382/187
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06V 30/333 Preprocessing; Feature extraction

Abstract

A handwritten stroke data editing system comprising: a group management unit for managing group data and box data for each group, the group data representing strokes within one group, the box data representing a box that is circumscribed to each group, the group including at least one of a character group representing a handwritten character, a word group representing a handwritten word, a line group consisting of a plurality of handwritten characters and/or words, a figure group representing a handwritten figure, a gesture recognition unit for recognizing an editing area based on a gesture inputted by unit of a stylus, the stylus being furnished for the system, the input gesture being represented by the stroke data, the editing area including the stroke data; and a to-be-edited group selection unit for selecting a to-be-edited group by computing an overlapping area of the editing area and each box, the selected to-be-edited group having the overlapping area more than a predetermined ratio to an area of the box. The to-be-edited group selection unit includes: an area computing unit for computing the overlapping area of the editing area and each box; a judgment unit for judging whether the overlapping area computed by the area computing unit exceeds the predetermined ratio; and a selection unit for selecting groups whose box overlaps on the editing area more than the predetermined ratio.

Claims

1. A handwritten stroke data editing system comprising:

group management means for managing group data and box data for each group, said group data representing strokes within one group, said box data representing a box that is circumscribed to each group, said group including at least two of a character group representing a handwritten character, a word group representing a handwritten word, a line group consisting of a plurality of handwritten characters and words, and a figure group representing a handwritten figure;

gesture recognition means for recognizing an editing area based on a gesture inputted by means of a stylus, said stylus being furnished for said system, said input gesture being represented by the stroke data, said editing area including said stroke data; and

to-be-edited group selection means for selecting a to-be-edited group by computing an overlapping area of the editing area and each box, said selected to-be-edited group having the overlapping area more than a predetermined ratio to an area of the box, and the predetermined ratio being different for the character group, word group, line group, and figure group, respectively.

2. The system of claim 1, wherein said to-be-edited group selection means includes:

area computing means for computing the overlapping area of the editing area and each box;

judgment means for judging whether the overlapping area computed by said area computing means exceeds the predetermined ratio corresponding to the character group, line group, word group, and figure group; and

selection means for selecting groups whose box overlaps on the editing area more than the predetermined ratio corresponding to the character group, line group, word group, and figure group.

3. The system of claim 2, wherein said to-be-edited group selection means selects the character group, word group, line group, and figure group if they area included within the selected to-be-edited group according to a predetermined hierarchy.

4. The system of claim 1, wherein said gesture recognition means computes coordinates of two opposing vertices of a rectangle that is circumscribed to a gesture stroke, said coordinates representing the editing area.

5. The system of claim 4, wherein said to-be-edited group selection means includes:

an area computing means for computing an overlapping area of the editing area and each box based on the two vertices represented by the box data for each group and two vertices coordinates specified by the editing area;

judgment means for judging whether the overlapping area computed by said area computing means exceeds the predetermined ratio; and

selection means for selecting groups whose box overlaps on the editing area more than the predetermined ratio.

6. The system of claim 5, wherein said judgment means judges a predetermined value representing an attribute for each hierarchy as the predetermined ratio.

7. The system of claim 6, wherein said to-be-edited group selection means includes:

group retrieval means for retrieving the box data in all the groups based on said first pointer and said second pointer included in the group data,

whereby said area computing means computes the overlapping area of the editing area and each retrieved box data successively.

12. The system of claim 1, wherein said edit command generation means includes:

layout data hold means for holding layout data, said layout data indicating whether to leave spaces between lower hierachial groups and whether to allow an overlap on any other group of same hierachy for each group managed by said group management means; and

generation means for generating a move command to move other groups successively when said layout data disallows the spaces between the lower hierachial groups caused by deleting a group, and for generating a move command to move the other groups successively not to allow an overlap on any other group of same hierachy.

13. The system of claim 12, wherein said gesture recognition means computes coordinates of two opposing vertices of a rectangle that is circumscribed to a gesture stroke, said coordinates representing the editing area.

14. The system of claim 13, wherein said to-be-edited group selection means includes:

an area computing means for computing an overlapping area of the editing area and each box based on the two vertices represented by the box data for each group and two vertices coordinates specified by the editing area;

judgment means for judging whether the overlapping area computed by said area computing means exceeds the predetermined ratio; and

selection means for selecting groups whose box overlaps on the editing area more than the predetermined ratio.

15. The system of claim 14, wherein said judgment means judges a predetermined value representing an attribute for each hierarchy as the predetermined ratio.

16. The system of claim 15, wherein said to-be-edited group selection means includes:

group retrieval means for retrieving the box data in all the groups based on said first pointer and said second pointer included in the group data,

whereby said area computing means computes the overlapping area of the editing area and each retrieved box data successively.

18. The system of claim 21, wherein said rotation command generation means includes:

center coordinate computation means for computing a center of the selected to-be-edited group, around which the selected group is rotated;

sample coordinate computation means for computing a sample coordinate for each group within the selected to-be-edited group;

post-rotation coordinate computation means for computing a post-rotation sample coordinate for each group after the sample coordinate is rotated for a given degree;

distance computation means for computing a distance from the pre-rotation sample coordinate to the post-rotation sample coordinate for each group; and

edit command generating means for generating an edit command to add the distance to the sample coordinate for each group.

19. The system of claim 18, wherein said to-be-edited group selection means includes:

area computing means for computing the overlapping area of the editing area and each box;

judgment means for judging whether the overlapping area computed by said area computing means exceeds the predetermined ratio; and

selection means for selecting groups whose box overlaps on the editing area more than the predetermined ratio.

20. The system of claim 19, wherein said to-be-edited group selection means selects the character group, word group, line group, and figure group if they are included within the selected to-be-edited group according to a predetermined hierarchy.

21. The system of claim 1, wherein said rotation command generation means includes:

center coordinated computation means for computing a center of the selected to-be-edited group, around which the selected group is rotated;

sample coordinate computation means for computing a sample coordinate for each group within the selected to-be-edited group;

post-rotation coordinate computation means for computing a post-rotation sample coordinate for each group after the sample coordinate is rotated for a given degree;

distance computation means for computing a distance from the pre-rotation sample coordinate to the post-rotation sample coordinate for each group; and

edit command generating means for generating an edit command to add the distance to the sample coordinate for each group.

22. The system of claim 21, wherein said sample coordinate computation means successively retrieves the groups in the selected group using said first pointer and said second pointer and computes the sample coordinate, said sample coordinate being a middle point of two vortices specified by data of each group.

23. The system of claim 22, wherein said gesture recognition means computes coordinates of two opposing vertices of a rectangle that is circumscribed to a gesture stroke, said coordinates representing the editing area.

24. The system of claim 23, wherein said to-be-edited group selection means includes:

an area computing means for computing an overlapping area of the editing area and each box based on the two vertices represented by the box data for each group and two vertices coordinates specified by the editing area;

judgment means for judging whether the overlapping area computed by said area computing means exceeds the predetermined ratio; and

selection means for selecting groups whose box overlaps on the editing area more than the predetermined ratio.

25. The system of claim 24, wherein said judgment means judges a predetermined value representing an attribute for each hierarchy as the predetermined ratio.

26. The system of claim 25, wherein said to-be-edited group selection means includes:

group retrieval means for retrieving the box data in all the groups based on said first pointer and said second pointer included in the group data,

whereby said area computing means computes the overlapping area of the editing area and each retrieved box data successively.

8. A handwritten stroke data editing system comprising:

group management means for managing group data and box data for each group, said group data representing strokes within one group, said box data representing a box that is circumscribed to each group, said group including at least two of a character group representing a handwritten character, a word group representing a handwritten word, a line group consisting of a plurality of handwritten characters and words, a figure group representing a handwritten figure;

gesture recognition means for recognizing an editing area and manipulation commands to said editing area based on a gesture inputted by means of a stylus, said stylus being furnished for said system, said input gesture being represented by the stroke data, said editing area including said stroke data;

to-be-edited group selection means for selecting a to-be-edited group by computing an overlapping area of the editing area and each box, said selected to-be-edited group having the overlapping area more than a predetermined ratio to an area of the box, and the predetermined ratio being different for the character group, word group, line group, and figure group, respectively;

edit command generation means for generating an edit command for strokes in the selected group in a manner recognized by said gesture recognition means, and for generating an edit command to delete spaces between the groups caused by deleting the group if said edit command includes a delete command, and for generating an edit command to eliminate an overlap between the groups caused by inserting a group if said edit command includes an insert command; and

edit means for editing strokes in both the selected and non-selected groups stored in said group management means according to the edit commands from said edit command generation means.

9. The system of claim 8, wherein said edit command generation means includes:

layout data hold means for holding layout data, said layout data indicating whether to leave spaces between the lines, words, and characters in each group stored in said group management means, and whether to allow an overlap on any other group; and

generation means for generating a move command to move other groups successively when said layout data disallows the spaces between the groups caused by deleting a group, and for generating a move command to move the other groups successively not to allow an overlap on any other group.

10. The system of claim 9, wherein said to-be-edited group selection means includes:

area computing means for computing the overlapping area of the editing area and each box;

judgment means for judging whether the overlapping area computed by said area computing means exceeds the predetermined ratio; and

selection means for selecting groups whose box overlaps on the editing area more than the predetermined ratio.

11. The system of claim 10, wherein said to-be-edited group selection means selects the character group, word group, line group, and figure group if they are included within the selected to-be-edited group according to a predetermined hierarchy.

17. A handwritten stroke data editing system comprising:

group management means for managing group data and box data for each group, said group data representing strokes within in one group, said box data representing a box that is circumscribed to each group, said group including at least two of a character group representing a handwritten character, a word group representing a handwritten word, a line group consisting of a plurality of handwritten characters and words, a figure group representing a handwritten figure;

gesture recognition means for recognizing an editing area and manipulation commands to said editing area based on a gesture inputted by means of a stylus, said stylus being furnished for said system, said input gesture being represented by the stroke data, said editing area including said stroke data;

to-be-edited group selection means for selecting a to-be-edited group by computing an overlapping area of the editing area and each box, said selected to-be-edited group having the overlapping area more than a predetermined ratio to an area of the box, and the predetermined ratio being different for the character group, word group, line group, and figure group, respectively;

rotation command generation means for generating an edit command to rotate the character and a figure within one group while maintaining their respective legible directions when the edit command for the selected to-be-edited group recognized by said gesture recognition means is a rotation command; and

edit means for deleting strokes in the to-be-edited group and the groups within said to-be-edited group stored in said group management means according to the edit commands from said rotation command generation means.

27. A handwritten stroke editing system comprising:

stylus means for inputting handwritten text and graphics into the system, said text and graphics including characters, words, lines of text, and figures, where words are comprised of characters and lines of text are comprised of words;

display means for displaying said handwritten text;

means for calculating an area of a box about each character, word, line of text, and figure input into the system;

means for entering editing gestures overlain on said display of said handwritten test for processing one of said character, word, line of text, or figure;

means for calculating an area to be edited based on said editing gestures;

first judging means for judging whether said area to be edited based on said editing gestures is common with two of said boxes about said characters, words, lines of text, and figures;

second judging means for judging, when said first judging means determines that there is a common area between said characters, words, lines of text, and figures and said area to be edited, which of said characters, words, lines of text, and figures is to be processed, said judging based on a predetermine hierarchy and a predetermined ratio of common area between said area to be edited and said boxes about each character, word, line of text, and figure, and where the predetermined ratio is different for characters, words, lines of text, and figures, respectively.

28. A handwritten stroke data editing system comprising:

group management means for managing group data and box data for each grup, said group data representing strokes within one group, said box data representing a box that is circumscribed to each group, said group including at least two of a character group representing a handwritten character, a word group representing a handwritten word, a line group consisting of a plurality of handwritten characters and words, and a figure group representing a handwritten figure, including;

stroke storage means for storing the stroke data representing a range of points data for a handwritten character stroke and a handwritten figure stroke;

group data storage means for storing group data, said group data including an attribute indicating a hierarchy of each group, a first pointer specifying a lower hierarchy group within one group, a second pointer specifying a group in a same hierarchy within the group, said attribute including at least one of character attribute identifying as being the character group, a word attribute identifying as being the word group, a line attribute identifying as being the line group, a paragraph attribute for identifying as being a paragraph group, and a block attribute identifying as being a block group, said first pointer in a last hierarchy group representing the stroke data composing the group; and

box data storage means for storing box data for each group, said box data being composed of two opposing vertices of a rectangle that is circumscribed to the group;

gesture recognition means for recognizing an editing area based on a gesture inputted by means of a stylus, said stylus being furnished for said system, said input gesture being represented by the stroke data, said editing area including said stroke data; and

to-be-edited group selection means for selecting a to-be-edited group by computing an overlapping area of the editing are and each box, said selected to-be-edited group by computing an overlapping area of the editing area and each box, said selected to-be-edited group having the overlapping are more than a predetermined ratio to an area of the box, and the predetermined are being different for the character group, word group, line group, and figure group, respectively.

29. A handwritten stroke data editing system comprising:

group management means for managing group data and box data for each group, said group data representing strokes within one group, said box data representing a box that is circumscribed to each group, said group including at least two of a character group representing a handwritten character, a word group representing a handwritten word, a line group consisting a plurality of handwritten characters and words, a figure group representing a handwritten figure, includes;

stroke storage means for storing the stroke data representing a range of points data for a handwritten character stroke and a handwritten figure stroke;

group data storage means for storing group data, said group data including an attribute indicating a hierarchy of each group, a first pointer specifying a lower hierarchy group within one group, a second pointer specifying a group in a same hierarchy within the group, said attribute including at least one of character attribute identifying as being the character group, a word attribute identifying to as being the word group, a line attribute identifying as being the line group, a paragraph attribute for identifying as being a paragraph group, and a block attribute identifying as being a block group, said first pointer in a last hierarchy group representing the stroke data composing the group; and

box data storage means for storing box data for each group, said box data being composed of two opposing vertices of a rectangle that is circumscribed to the group;

gesture recognition means for recognizing an editing area and manipulation commands to said editing area based on a gesture inputted by means of a stylus, said stylus being furnished for said system, said input gesture being represented by the stroke data, said editing area including said stroke data;

to-be-edited group selection means for selecting a to-be-edited group by computing an overlapping area of the editing area and each box, said selected to-be-edited group having the overlapping area more than a predetermined ratio to an area of the box, and the predetermined ratio being different for the character group, word group, line group, and figure group, respectively;

edit command generation means for generating an edit command for strokes in the selected group in a manner recognized by said gesture recognition means, and for generating an edit command to delete spaces between the groups caused by deleting the group if said edit command includes a delete command, and for generating an edit command to eliminate an overlap between the groups caused by inserting a group if said edit command includes an insert command; and

edit means for editing strokes in both the selected and non-selected groups stored in said group management means according to the edit commands from said edit command generation means.

30. A handwritten stroke data editing system comprising:

group management means for managing group data and box data for each group, said group data representing strokes within one group, said box data representing a box that is circumscribed to each group, said group including at least two of a character group representing a handwritten character, a word group representing a handwritten word, a line group consisting of a plurality of handwritten characters and words, a figure group representing a handwritten figure, includes;

stroke storage means for storing the stroke data representing a range of points data for a handwritten character stroke and a handwritten figure stroke;

group data storage means for storing group data, said group data including an attribute indicating a hierarchy of each group, a first pointer specifying a lower hierarchy group within one group, a second pointer specifying a group in a same hierarchy within the group, said attribute including at least one of character attribute identifying as being the character group, a word attribute identifying to as being the word group, a line attribute identifying as being the line group, a paragraph attribute for identifying as being a paragraph group, and a block attribute identifying as being a block group, said first pointer in a last hierarchy group representing the stroke data composing the group; and

box data storage means for storing box data for each group, said box data being composed of two opposing vertices of a rectangle that is circumscribed to the group;

gesture recognition means for recognizing an editing area and manipulation commands to said editing area based on a gesture inputted by means of a stylus, said stylus being furnished for said system, said input gesture being represented by the stroke data, said editing area including said stroke data;

to-be-edited group selection means for selecting a to-be-edited group by computing an overlapping area of the editing area and each box, said selected to-be-edited group having the overlapping area more than a predetermined ratio to an area of the box, and the predetermined ratio being different for the character group, word group, line group, and figure group, respectively;

edit command generation means for generating an edit command for strokes in the selected group in a manner recognized by said gesture recognition means, and for generating an edit command to delete spaces between the groups caused by deleting the group if said edit command includes a delete command, and for generating an edit command to eliminate an overlap between the groups caused by inserting a group if said edit command includes an insert command; and

edit means for editing strokes in both the selected and non-selected groups stored in said group management means according to the edit commands from said edit command generation means.