Animated user interface for computer program creation, control and execution

• US 5,517,663 A
• Filed: 11/09/1994
• Issued: 05/14/1996
• Est. Priority Date: 03/22/1993
• Status: Expired due to Term

• Current Assignee: Kenneth M. Kahn
• Original Assignee: Kenneth M. Kahn
• Inventors: Kahn, Kenneth M.
• Primary Examiner(s): Coleman, Eric
• Assistant Examiner(s): HARRITY, JOHN E
• Application Number:
  US08/336,557
• Time in Patent Office: 552 Days
• Field of Search: 395/800, 395/152, 395/155, 364/226.2, 364/DIG. 1
• US Class Current: 345/473
• CPC Class Codes: G06F 11/323 Visualisation of programs or trace data
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 8/34 Graphical or visual programming

Abstract

A computer programming system provides animated program sources that are created in an interactive visual manner. Animation is integrated with computer programming to allow a user or programmer to visualize programming flow and operation. Animated depictions are thus produced for dynamic phenomenon, such as concurrent computations. The program system supports a computation model of concurrent communicating agents. A concrete metaphor for the computation model is provided, e.g. agents are implemented as buildings; rules or methods are implemented robots or workers inside of buildings; local state is posted on bulletin boards inside of buildings; couriers carry messages between buildings; and so on.

Claims

1. An apparatus for independently and/or simultaneously creating, modifying, controlling, and executing a computer program, comprising:

at least one programmer persona in an interactive animated computer sustained artificial world in which said computer program creation, modification, control, and execution proceeds in real time in accordance with the actions of said programmer persona, said computer sustained artificial world comprising;

at least one animated agent;

said agent including at least one animated personified rule, each rule having a guard portion for visually representing preconditions of said personified rule, and a body portion for visually representing actions of said personified rule;

each agent including a visual representation of local state; and

animated messages for exchanging information between said agents; and

display means for visually representing data structures which are representations of local state and are components of rules, and which are or which may include at least one of data items, other data structures, logic variables, and messages.

2. The invention of claim 1, wherein said complex process is a computer program.

3. The invention of claim 2, wherein said computer program is a concurrent program.

4. The invention of claim 2, wherein said computer program is an object oriented program.

5. The invention of claim 2, wherein said computer program is a concurrent object oriented program.

6. The invention of claim 2, wherein said computer program is a source code of a general purpose computer programming language.

7. The invention of claim 1, further comprising:

audio means for audibly representing at least portions of said computer sustained artificial world.

8. A process for independently and/or simultaneously creating, modifying, controlling, and executing a computer program, said process comprising the steps of:

providing at least one programmer persona in an interactive animated, computer sustained artificial world in which said computer program creation, modification, control, and execution proceeds in real time in accordance with the actions of said programmer persona; and

, in said computer sustained artificial world;

displaying at least one animated computational agent which corresponds to underlying processes in said complex process;

displaying preconditions of a personified rule;

displaying actions of said personified rule;

displaying local state;

displaying data structures which are visual representations of local state and are components of rules, and which are or which may include at least one of data items, other data structures, logic variables, and messages; and

displaying information exchange between said agents.

9. The invention of claim 8, wherein said complex process is a computer program.

10. The invention of claim 9, wherein said computer program is a concurrent program.

11. The invention of claim 9, wherein said computer program is an object oriented program.

12. The invention of claim 9, wherein said computer program is a source code of a general purpose computer programming language.

13. The invention of claim 8, further comprising the step of:

audibly representing at least portions of said computer sustained artificial world.

14. A user interface computer program, for independently and/or simultaneously creating, modifying, controlling, and executing an animated visual representation of an underlying computer program, said underlying computer program being described in a high-level computer language, said interface comprising:

at least one programmer persona in an interactive animated computer sustained artificial world in which said computer program creation, modification, control, and execution proceeds in real time in accordance with the actions of said programmer persona, said computer sustained artificial world comprising;

at least one animated computational agent;

said agent including at least one animated personified rule, each rule having a guard portion for visually representing preconditions of said personified rule, and a body portion for visually representing actions of said personified rule;

each agent including a visual representation of local state; and

animated messages for exchanging information between said agents; and

display means for visually representing data structures which are representations of local state and are components of rules and which are or which may include at least one of data items, other data structures, logic variables, and messages.

15. The invention of claim 14, said visual representation of said underlying computer operation further comprising:

a theme that defines a programming environment.

16. The invention of claim 14, said theme further comprising:

a metaphor that defines user perceptible programming environment elements.

17. The invention of claim 16, said metaphor comprising:

at least one building corresponding to each agent;

at least one robot within said building, said robot corresponding to each rule, said robot including a thought bubble, said thought bubble representing a rule precondition and rule actions;

said robot being animated to represent said rule body portion;

at least one bulletin board within said building, said bulletin board representing agent local state;

at least one form visually representing data structures which are representations of local state and are components of rules, and which are or which may include at least one of data items, other data structures, logic variables, and messages; and

at least one courier, representing communications between agents, for exchanging messages between buildings.

18. The invention of claim 17, said metaphor further comprising:

at least one camera for providing a programmer with at least one selected view for observing program execution.

19. The invention of claim 17, said metaphor further comprising:

a programmer persona present in said programming environment to effect programming in the underlying language.

20. The invention of claim 19, wherein said programmer persona is a first person representation.

21. The invention of claim 19, wherein said programmer persona is a third person representation.

22. The invention of claim 17, further comprising:

locks on said buildings to limit access within said buildings and thereby limit access to the underlying source code and local state.

23. The invention of claim 17, further comprising:

robots for training and supervising other robots to effect meta-programming.

24. The invention of claim 17, further comprising:

at least one room within a building, said room containing a city corresponding to an underlying computer program component to provide lexical scoping.

25. The invention of claim 16, said metaphor further comprising:

means for effecting inheritance and/or delegation, such that if an original agent from which other agents were copied is modified, those changes propagate to all copies of said original agent.

26. The invention of claim 16, said metaphor further comprising:

multiple bulletin boards and sets of robots inside a building, all but one of each set of robots and bulletin boards corresponding, respectively, to state variables and behaviors inherited from a super-class, said sets of robots being ordered such that a first set of robots is associated with a sub-class of said super-class and is given an opportunity to act, and such that if none of said first set of robots can act, then sets of robots associated with an immediate super-class and more distant super-classes are, in order, given a chance to act.

27. The invention of claim 14, wherein said animated visual representation is implemented in a virtual reality environment.

28. The invention of claim 14, further comprising:

means for effecting format conversion of said representation from said visual format to a machine readable format.

29. A method for independently and/or simultaneously creating, modifying, controlling, and executing an animated visual representation of an underlying computer program, said underlying computer program being described in a high-level computer language, said method comprising the steps of:

providing at least one programmer persona in an interactive animated, computer sustained artificial world in which said computer program creation, modification, control, and execution proceeds in real time in accordance with the actions of said programmer persona; and

, in said computer sustained artificial world;

providing at least one animated computational agent;

said agent including at least one animated personified rule, each rule having a guard portion for visually representing preconditions of said personified rule, and a body portion for visually representing actions of said personified rule;

each agent including a visual representation of local state; and

exchanging information between said agents with animated messages; and

displaying data structures which are visual representations of local state and are components of rules, and which are or which may include at least one of data items, other data structures, logic variables, and messages.

30. The invention of claim 29, further comprising the step of:

providing a selected theme that defines a representation environment; and

providing a selected metaphor that defines user perceptible elements in said representation environment.

31. The invention of claim 30, wherein said metaphor comprises:

at least one building corresponding to each agent;

at least one robot within said building, said robot corresponding to each rule, said robot including a thought bubble, said thought bubble representing said rule precondition and rule actions;

said robot being animated to represent said rule body portion;

at least one bulletin board within said building, said bulletin board representing agent local state;

at least one form visually representing data structures which are representations of local state and are components of rules, and which are or which may include at least one of data items, other data structures, logic variables, and messages; and

at least one courier, representing communications between agents, for exchanging messages between buildings.

32. The invention of claim 31, further comprising the step of:

providing a programmer with at least one camera having at least one selected view, wherein said programmer may observe program execution.

33. The invention of claim 31, further comprising the step of:

manipulating, with a robot, entities, including those entities whose existence or state is explicitly confirmed by being in the thought bubble, including any of the steps of;

copying an existing building, together with everything inside the building;

calling upon a builder to expand a building;

tearing down its own building; and

manipulating a paper by copying, filling in a value within dotted lines, removing a clipping along dotted lines or perforations, combining by filling hole with a clipping, or calling upon a courier to deliver a clipping.

34. The invention of claim 31, further comprising the step of:

manipulating, with a programmer persona, entities, including those entities whose existence or state is explicitly confirmed by being in the thought bubble, including any of the steps of;

copying an existing building, together with everything inside the building;

calling upon a builder to expand a building;

tearing down its own building;

manipulating a paper by copying, filling in a value within dotted lines, removing a clipping along dotted lines or perforations, combining by filling a hole with a clipping, or calling upon a courier to deliver a clipping;

moving around outside of houses, either on foot or with vehicles;

inspecting, creating, changing, or destroying expectations and plans of robots;

putting robots to sleep and waking robots up;

inspecting, creating, changing, moving, destroying, and decorating buildings, including model miniature buildings which robots can copy;

creating, copying, destroying, and decorating forms with perforated regions which can be clipped out, where the kind of thing that can fill that region may be indicated by region shape, background images, tags, labels, etc.; and

turning on and off or moving cameras.

35. The invention of claim 30, said metaphor representing said underlying computer program, said metaphor comprising:

at least one animated computational agent;

said agent including at least one animated personified rule, each rule having a guard portion for visually representing preconditions of said personified rule, and a body portion for visually representing actions of said personified rule;

each agent including a visual representation of local state; and

said method further comprising the steps of

exchanging information between said agents with animated messages; and

displaying data structures which are representations of local state and are components of rules, and which are or which may include at least one of data items, other data structures, logic variables, and messages.