System and method for recognizing geometric shapes

• US 10,181,076 B2
• Filed: 05/04/2016
• Issued: 01/15/2019
• Est. Priority Date: 12/02/2014
• Status: Active Grant

• Current Assignee: Myscript
• Original Assignee: Myscript
• Inventors: Melinand, Robin, Buisson, Florent
• Primary Examiner(s): Chawan, Sheela C
• Application Number:
  US15/146,654
• Publication Number:
  US 20160247040A1
• Time in Patent Office: 986 Days
• Field of Search: 382156, 382189, 382107, 382120, 382123, 382188, 382203, 382214, 382253, 382290, 382309, 382321, 345418, 345419, 345420, 345440, 345441
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06T 11/203 Drawing of straight lines or curves
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 7/60 Analysis of geometric attributes
• CPC Class Codes: G06V 30/32 Digital ink
• CPC Class Codes: G06V 30/347 Sampling; Contour coding; Stroke extraction
• CPC Class Codes: G06V 30/36 Matching; Classification
• CPC Class Codes: G06V 40/28 Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

A system and method that is able to recognize a user'"'"'s natural drawing of geometric shapes. The system and method is able to process single-stroke and multi-stroke geometric shapes. It can also apply implicit and user defined constraints to the geometric shapes. The system and method applies these constraints at the vector component level rather than the primitive level. It does this by breaking down both the geometric shapes and constraints on a vector component level. This allows the system and method to handle a larger number of geometric shapes and constraints. After applying the constraints to the geometric shapes at the vector component level, the system and method outputs smooth geometric shapes that incorporated both the implicit and user defined constraints.

Claims

1. A non-transitory computer readable medium having a computer readable program code embodied therein, said computer readable program code adapted to be executed to implement a method for providing geometric shape recognition for at least one input stroke, said method comprising:

recognizing at least one shape primitive that corresponds to at least one input stroke;

defining the at least one shape primitive as a plurality of vector components;

applying at least one vector component level constraint to the vector components, the at least one constraint geometrically linking at least two of the vector components; and

providing an output based on the application of the at least one constraint to the vector components.

2. A non-transitory computer readable medium according to claim 1, wherein the plurality of vector components include components selected from at least one point, length and slope angle.

3. A non-transitory computer readable medium according to claim 2, wherein the at least one vector component level constraint is defined as applying to at least one point, length, or slope angle.

4. A non-transitory computer readable medium according to claim 3, wherein the at least one vector component level constraint comprises at least one of length equality, angle equality, parallelism, symmetry, alignment, tangency, connection, and perpendicularity.

5. A non-transitory computer readable medium according to claim 1, the method further comprising recognizing at least one gesture with respect to the at least one input stroke, wherein the output is further based on application of at least one further constraint associated with the at least one gesture to the vector components.

6. A non-transitory computer readable medium according to claim 5, wherein the at least one gesture provides graphical editing instructions of the at least one shape primitive.

7. A non-transitory computer readable medium according to claim 1, wherein if the at least one vector component level constraint comprises multiple constraints, the multiple constraints are applied to the vector components based on a priority order, wherein the priority order comprises constraints maintaining the at least one shape primitive'"'"'s integrity, constraints implicit in the at least one shape primitive, and constraints defined by a gesture.

8. A non-transitory computer readable medium according to claim 1, the method further comprising rebuilding the recognized at least one shape primitive from the vector components having the at least one constraint applied thereto to provide the output.

9. A non-transitory computer readable medium according to claim 8, wherein the at least one input stroke is user drawn and the output is at least one smooth geometric shape.

10. A method for providing geometric shape recognition for at least one input stroke on a computing device, the computing device comprising a processor and at least one non-transitory computer readable medium under control of the processor, said method comprising:

recognizing, by the at least one non-transitory computer readable medium, at least one shape primitive that corresponds to at least one input stroke;

defining, by the at least one non-transitory computer readable medium, the at least one shape primitive as a plurality of vector components;

applying, by the at least one non-transitory computer readable medium, at least one vector component level constraint to the vector components, the at least one constraint geometrically linking at least two of the vector components; and

providing, by the at least one non-transitory computer readable medium, an output based on the application of the at least one constraint to the vector components.

11. A method according to claim 10, wherein the plurality of vector components include components selected from at least one point, length and slope angle.

12. A method according to claim 11, wherein the at least one vector component level constraint is defined as applying to at least one point, length, or slope angle.

13. A method according to claim 12, wherein the at least one vector component level constraint comprises at least one of length equality, angle equality, parallelism, symmetry, alignment, tangency, connection, and perpendicularity.

14. A method according to claim 10, further comprising recognizing at least one gesture with respect to the at least one input stroke, wherein the output is further based on application of at least one further constraint associated with the at least one gesture to the vector components.

15. A method according to claim 14, wherein the at least one gesture provides graphical editing instructions of the at least one shape primitive.

16. A method according to claim 10, wherein if the at least one vector component level constraint comprises multiple constraints, the multiple constraints are applied to the vector components based on a priority order, wherein the priority order comprises constraints maintaining the at least one shape primitive'"'"'s integrity, constraints implicit in the at least one shape primitive, and constraints defined by a gesture.

17. A method according to claim 10, further comprising rebuilding the recognized at least one shape primitive from the vector components having the at least one constraint applied thereto to provide the output.

18. A method according to claim 17, wherein the at least one input stroke is user drawn and the output is at least one smooth geometric shape.

19. A system for providing geometric shape recognition for at least one input stroke on a computing device, the computing device comprising a processor and at least one non-transitory computer readable medium under control of the processor, the system comprising:

causing recognition, by the at least one non-transitory computer readable medium, of at least one shape primitive that corresponds to at least one input stroke;

causing definition, by the at least one non-transitory computer readable medium, of the at least one shape primitive as a plurality of vector components;

causing application, by the at least one non-transitory computer readable medium, of at least one vector component level constraint to the vector components, the at least one constraint geometrically linking at least two of the vector components; and

causing output, by the at least one non-transitory computer readable medium, based on the application of the at least one constraint to the vector components.

20. A system according to claim 19, wherein the plurality of vector components include components selected from at least one point, length and slope angle.

21. A system according to claim 20, wherein the at least one vector component level constraint is defined as applying to at least one point, length, or slope angle.

22. A system according to claim 21, wherein the at least one vector component level constraint comprises at least one of length equality, angle equality, parallelism, symmetry, alignment, tangency, connection, and perpendicularity.

23. A system according to claim 19, further comprising recognizing at least one gesture with respect to the at least one input stroke, wherein the output is further based on application of at least one further constraint associated with the at least one gesture to the vector components.

24. A system according to claim 23, wherein the at least one gesture provides graphical editing instructions of the at least one shape primitive.

25. A system according to claim 19, wherein if the at least one vector component level constraint comprises multiple constraints, the multiple constraints are applied to the to the vector components based on a priority order, wherein the priority order comprises constraints maintaining the at least one shape primitive'"'"'s integrity, constraints implicit in the at least one shape primitive, and constraints defined by a gesture.

26. A system according to claim 19, further comprising causing rebuilding of the recognized at least one shape primitive from the vector components having the at least one constraint applied thereto to provide the output.

27. A system according to claim 26, wherein the at least one input stroke is user drawn and the output is at least one smooth geometric shape.