Method for gesture based modeling

• US 20040060037A1
• Filed: 10/31/2002
• Published: 03/25/2004
• Est. Priority Date: 03/30/2000
• Status: Active Grant

• Current Assignee: Tyrsted Management ApS
• Original Assignee: Tyrsted Management ApS
• Inventors: Thomsen, Michael, Tyrsted, Michael, Damm, Christian Heide, Hansen, Klaus Marius
• Granted Patent: US 7,096,454 B2
• Time in Patent Office: Days
• US Class Current: 717/104
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A computer program based method is described for creating models using gestures. On an input device, such as an electronic whiteboard, a user draws a gesture which is recognised by a computer program and interpreted relative to a predetermined meta-model. Based on the interpretation, an algorithm is assigned to the gesture drawn by the user. The executed algorithm may, for example, consist in creating a new model element, modifying an existing model element, or deleting an existing model element.

Claims

1. Method for gesture based modeling comprising

a a model including a number of general elements and possible relations between these general elements,

a number of predetermined general gestures, each general gesture linked to at least one general algorithm,

reading of an input gesture,

comparing said input gesture with said number of predetermined general gestures, identifying a specific gesture among said predetermined, general gestures as resembling said input gesture,

assigning among said at least one general algorithm a specific algorithm to said specific gesture,

characterised in that said method comprises

providing a metamodel for said model and determining the allowance of said specific algorithm according to said metamodel and model and, in case of allowance,

upon request as a response to said specific gesture modifying said model in accordance with said specific algorithm,

upon request modifying a diagram representing said model on an output display to indicate the response to said input gesture.

2. Method according to claim 1, characterised in that said input gesture has visual similarity with an element created or modified in response to said input gesture.

3. Method according to claim 1 or 2, characterised in that said identifying is linked to a quantitative measure reflecting the possibility for that said specific gesture resembles said input gesture.

4. Method according to claim 1-3, characterised in that said method further comprises adapting the model format of said model to a external format readable by an external computer program.

5. Method according to claim 4, characterised in that said external computer program is a CASE tool computer program, preferably Rational Rose®

or Microgold WithClass™

, or a CAPE tool computer program.

6. Method according to claim 4 or 5, characterised in that said method further comprises reading of a response from said external computer program and changing said external format to a format in congruence with said model.

7. Method according to any one of the preceding claims, characterised in that said model is linked to a modeling language supporting object-oriented modeling.

8. Method according to claim 7, characterised in that said modeling language is UML.

9. Method according to any one of the preceding claims, characterised in that said identifying of said one specific of said predetermined general gestures implies Rubine'"'"'s algorithm.

10. Method according to any one of the preceding claims, characterised in that said reading of said input gesture is from an input device which comprises at least one from the group consisting of a touch-sensitive computer screen, touch-sensitive whiteboard, a drawing tablet, a mouse, a pen-based computer, a joy stick system coupled to a computer, or a movement sensor system.

11. Method according to claim 1-9, characterised in that said reading of said input gesture is from a database in which a sequence of input gestures is stored.

12. Computer program comprising program code performing the method according to any one of the claims 1-11 when said program is run on a computer.

13. Computer program product comprising program code means stored on a computer readable medium for performing the method according to any one of the claims 1-11 when said computer program product is run on a computer.

14. Use of a method according to the invention for at least one from the group consisting of

design and optimisation of chemical or mechanical production plants, production lines, refineries, pipeline systems, flare and vent systems, or distillation systems,

design, simulation, administration, evaluation and optimisation of production processes, preferably for polymers, semiconductors, petrochemical products, or food products;

teaching of students in design, simulation, administration, evaluation and optimisation of processes,

design, simulation, evaluation and optimisation of electronic circuits, vehicles, ships, aeroplanes or parts thereof,

town planning,

general architecture;

composition of music;

design of games;

design of movies;

generation of sale plans or goods distribution plans;

ressource allocation in hospitals.