Method for gesture based modeling

• US 7,096,454 B2
• Filed: 03/27/2001
• Issued: 08/22/2006
• Est. Priority Date: 03/30/2000
• Status: Expired due to Fees

• Current Assignee: Tyrsted Management ApS
• Original Assignee: Tyrsted Management ApS
• Inventors: Thomsen, Michael, Tyrsted, Michael, Damm, Christian Heide, Hansen, Klaus Marius
• Primary Examiner(s): Khatri, Anil
• Application Number:
  US10/240,188
• Publication Number:
  US 20040060037A1
• Time in Patent Office: 1,974 Days
• Field of Search: 717104-108, 717/109, 717113-116
• US Class Current: 717/105
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A computer program based method is described for creating models using gestures. On an input device, such as an electronic whiteboard, a user draws a gesture which is recognized by a computer program and interpreted relative to a predetermined meta-model. Based on the interpretation, an algorithm is assigned to the gesture drawn by the user. The executed algorithm may, for example, consist in creating a new model element, modifying an existing model element, or deleting an existing model element.

Claims

1. Method for gesture based modeling of a diagram representing the graphical notation for a model, the method comprising:

providing a model represented by a diagram, the diagram including a number of general diagram elements and possible relations between these general diagram elements,

providing a number of predetermined general gestures stored in a database of a computer system, the general gestures comprising a pattern of one or more curves, each general gesture linked to at least one general algorithm for modification of the diagrarm,

providing an input device functionally connected to the computer system and reading of an input gesture by the input device, the read input gesture being a sensed movement of a hand along one or more curves,

providing a graphical output device and giving a feedback on the output device in the form of a curved shaped exactly as the movement alone one or more curves as read by the input device,

comparing by software routines in the computer system said input gesture with said number of stored predetermined general gestures, identifying a specific gesture among said predetermined general gestures as resembling said input gesture,

assigning in the computer system among said at least one general algorithm a specific algorithm to said specific gesture,

wherein said method comprises providing in the computer system a metamodel for said model, said metamodel defining how a model may be constructed, and determining the allowance of said specific algorithm according to said metamodel and model and, in case of allowance,

upon request as a response to said specific gesture modifying said model in accordance with said specific algorithm,

upon request modifying the a diagram representing said model on an output display to indicate the response to said input gesture.

2. Method according to claim 1, wherein said input gesture has visual similarity with an element created or modified in response to said input gesture.

3. Method according to claim 1, wherein said identifying is linked to a quantitative measure reflecting the possibility for that said specific gesture resembles said input gesture.

4. Method according to claim 1, wherein said method further comprises adapting the model format of said model to a external format readable by an external computer program.

5. Method according to claim 4, wherein said external computer program is a CASE tool computer program, preferably Rational Rose®

or Microgold WithC1ass™

, or a CAPE tool computer program.

6. Method according to claim 4, wherein said method further comprises reading of a response from said external computer program and changing said external format to a format in congruence with said model.

7. Method according to claim 1, wherein said model is linked to a modeling language supporting object-oriented modeling.

8. Method according to claim 7, wherein said modeling language is UML.

9. Method according to claim 1, wherein said identifying of said one specific of said predetermined general gestures implies Rubine'"'"'s algorithm.

10. Method according to claim 1, wherein said reading of said input gesture is from an input device which comprises at least one from the group consisting of a touch-sensitive computer screen, touch-sensitive whiteboard, a drawing tablet, a mouse, a pen-based computer, ajoy stick system coupled to a computer, or a movement sensor system.

11. Method according to claim 1, wherein said reading of said input gesture is from a database in which a sequence of input gestures is stored.

12. Computer program comprising program code performing the method according to claim 1 when said program is run on a computer.

13. Computer program product comprising program code means stored on a computer readable medium for performing the method according to claim 1 when said computer program product is run on a computer.

14. Method according to claim 1, wherein the method implies the step of using the model for design and optimization of chemical or mechanical production plants, production lines, refineries, pipeline systems, flare and vent systems, or distillation systems.

15. Method according to claim 1, wherein the method implies the step of using the model design, simulation, administration, evaluation and optimization of production processes.

16. Method according to claim 1, wherein the method implies the step of using the model design, simulation, administration, evaluation and optimization of production processes for polymers, semiconductors, petrochemical products, or food products.

17. Method according to claim 1, wherein thc method implies the step of using the model teaching of students in design, simulation, administration, evaluation and optimization of processes.

18. Method according to claim 1, wherein the method implies the step of using the model for design, simulation, evaluation and optimization of electronic circuits, vehicles, ships, airplanes or parts thereof.

19. Method according to claim 1, wherein the method implies the step of using the model for town planning or general architecture.

20. Method according to claim 1, wherein the method implies the step of using the model for composition of music.

21. Method according to claim 1, wherein the method implies the step of using the model for design of games or movies.

22. Method according to claim 1, wherein the method implies the step of using the model for generation of sale plans or goods distribution plans.

23. Method according to claim 1, wherein the method implies the step of using the model for resource allocation in hospitals.