System and method for providing suggested graphical programming operations

• US 7,137,071 B2
• Filed: 12/12/2001
• Issued: 11/14/2006
• Est. Priority Date: 12/12/2001
• Status: Active Grant

• Current Assignee: National Instruments Corporation (Emerson Electric Company)
• Original Assignee: National Instruments Corporation (Emerson Electric Company)
• Inventors: Vazquez, Nicolas, Cifra, Christopher, Chandhoke, Sundeep, Fuller, David
• Primary Examiner(s): Bayerl, Raymond J.
• Application Number:
  US10/021,728
• Publication Number:
  US 20030107599A1
• Time in Patent Office: 1,798 Days
• Field of Search: 345/763, 706/45, 700/86, 700/299, 700/83, 700/85, 700/87, 700/108, 715/762, 715/763, 715/967, 715/853, 715/835, 715/970, 715/809, 715/727, 715/978, 715/705, 715/708, 715/714, 715/764, 715/769, 715/771, 715/810, 715/811, 715/812, 715/825, 717/105, 717/109, 717/110, 717/111, 717/113, 717/116
• US Class Current: 715/771
• CPC Class Codes: G06F 8/33 Intelligent editors
• CPC Class Codes: G06F 8/34 Graphical or visual programming
• CPC Class Codes: Y10S 715/967 Visual or iconic programming

Abstract

A system and method for enabling a graphical programming development environment to provide suggested graphical programming operations, such as suggested nodes or icons to include in a graphical program. User input specifying one or more nodes to include in the graphical program may be received. The one or more specified nodes may then be included in the graphical program. One or more suggested nodes to include in the graphical program may be then be automatically displayed or otherwise suggested to the user. The one or more suggested nodes may be based on the nodes already included in the graphical program. In various embodiments, the one or more suggested nodes may be displayed or otherwise suggested in various ways.

Claims

1. A computer-implemented method for creating a graphical program, the method comprising:

receiving user input selecting one or more nodes to include in the graphical program from at least one first palette, wherein the at least one first palette presents a plurality of all available nodes for selection;

including the one or more selected nodes in the graphical program; and

displaying one or more suggested nodes to include in the graphical program in a second palette, based on the one or more nodes selected by the user input, wherein the second palette is separate from the at least one first palette, and wherein the one or more suggested nodes are selectable by the user for inclusion in the graphical program.

2. The method of claim 1,

wherein the graphical program comprises a block diagram portion and a user interface portion.

3. The method of claim 1,

wherein the graphical program comprises a graphical data flow program.

4. The method of claim 1, further comprising:

interconnecting nodes included in the graphical program to visually indicate functionality of the graphical program.

5. The method of claim 1,

wherein said displaying the one or more suggested nodes comprises displaying the one or more suggested nodes as shadow nodes that follow a mouse cursor.

6. The method of claim 1, further comprising:

receiving user input requesting to include a first suggested node in the graphical program; and

including the first suggested node in the graphical program.

7. The method of claim 1, further comprising:

automatically including the one or more suggested nodes in the graphical program.

8. The method of claim 1, further comprising:

determining the one or more suggested nodes.

9. The method of claim 8,

wherein said determining the one or more suggested nodes comprises determining that the one or more suggested nodes are necessary to complete an operation performed by the one or more nodes selected by the user input.

10. The method of claim 8,

wherein said determining the one or more suggested nodes comprises performing an algorithm to determine the one or more suggested nodes based on the one or more nodes selected by the user input.

11. The method of claim 10,

wherein the algorithm is hard-coded to always determine the one or more suggested nodes in response to the one or more nodes selected by the user input.

12. The method of claim 10,

wherein the algorithm is operable to determine the one or more suggested nodes based on previously stored data regarding nodes that frequently occur in graphical programs along with the one or more nodes selected by the user input.

13. The method of claim 8,

wherein said determining the one or more suggested nodes comprises determining that the one or more suggested nodes frequently appear in graphical programs that include the one or more selected nodes.

14. The method of claim 8,

wherein said determining the one or more suggested nodes comprises performing an artificial intelligence heuristic to determine the one or more suggested nodes based on the one or more nodes selected by the user input.

15. The method of claim 1, further comprising:

receiving user input specifying suggestion criteria;

determining the one or more suggested nodes based on the one or more nodes selected by the user input and based on the suggestion criteria.

16. The method of claim 1,

wherein the graphical program is operable to perform one or more of:

an industrial automation function;

a process control function;

a test and measurement function.

17. A memory medium for creating a graphical program, the memory medium comprising program instructions executable to:

receive user input selecting one or more nodes to include in the graphical program from at least one first palette, wherein the at least one first palette presents a plurality of all available nodes for selection;

include the one or more selected nodes in the graphical program; and

displaying one or more suggested nodes to include in the graphical program in a second palette, based on the one or more nodes selected by the user input, wherein the second palette is separate from the at least one first palette, and wherein the one or more suggested nodes are selectable by the user for inclusion in the graphical program.

18. The memory medium of claim 17,

wherein the graphical program comprises a block diagram portion and a user interface portion.

19. The memory medium of claim 17,

wherein the graphical program comprises a graphical data flow program.

20. The memory medium of claim 17, further comprising program instructions executable to:

receive user input requesting to include a first suggested node in the graphical program; and

include the first suggested node in the graphical program.

21. The memory medium of claim 17, further comprising program instructions executable to:

automatically include the one or more suggested nodes in the graphical program.

22. The memory medium of claim 17, further comprising program instructions executable to:

determine the one or more suggested nodes.

23. The memory medium of claim 22,

wherein said determining the one or more suggested nodes comprises determining that the one or more suggested nodes are necessary to complete an operation performed by the one or more nodes selected by the user input.

24. The memory medium of claim 22,

wherein said determining the one or more suggested nodes comprises performing an algorithm to determine the one or more suggested nodes based on the one or more nodes selected by the user input.

25. The memory medium of claim 22,

wherein said determining the one or more suggested nodes comprises determining that the one or more suggested nodes frequently appear in graphical programs that include the one or more selected nodes.

26. The memory medium of claim 22,

wherein said determining the one or more suggested nodes comprises performing an artificial intelligence heuristic to determine the one or more suggested nodes based on the one or more nodes selected by the user input.

27. A system for creating a graphical program, the system comprising:

a memory medium storing program instructions;

a processor;

wherein the processor is operable to execute the program instructions to;

receive user input specifying one or more nodes to include in a graphical program from at least one first palette, wherein the at least one first palette presents a plurality of all available nodes for selection;

include the one or more selected nodes in the graphical program; and

display one or more suggested nodes to include in the graphical program in a second palette, based on the one or more nodes selected by the user input, wherein the second palette is separate from the at least one first palette, and wherein the one or more suggested nodes are selectable by the user for inclusion in the graphical program.

28. The system of claim 27, wherein the processor is further operable to execute the program instructions to:

receive user input requesting to include a first suggested node in the graphical program; and

include the first suggested node in the graphical program.

29. A computer-implemented method for creating a graphical program, the method comprising:

displaying a graphical programming window for creating a graphical program;

displaying one or more nodes in the window in response to user input selecting the one or more nodes from at least one first palette, wherein the at least one first palette presents a plurality of all available nodes for selection;

determining one or more suggested nodes in response to the user input; and

displaying the one or more suggested nodes in a second palette, wherein the second palette is separate from the at least one first palette, and wherein the one or more suggested nodes are selectable by the user for inclusion in the graphical program.

30. A computer-implemented method for creating a graphical user interface for a graphical program, the method comprising:

displaying a window for creating the graphical user interface for the graphical program;

displaying one or more user interface elements in the window in response to user input;

determining one or more suggested user interface elements in response to the user input; and

displaying the one or more suggested user interface elements.

31. A computer-implemented method for creating a script, the method comprising:

receiving user input selecting one or more steps to include in the script from at least one first palette, wherein the at least one first palette presents a plurality of all available steps for selection;

including the one or more selected steps in the script; and

displaying one or more suggested steps to include in the script in a second palette, based on the one or more steps selected by the user input, wherein the second palette is separate from the at least one first palette, and wherein the one or more suggested nodes are selectable by the user for inclusion in the graphical program.

32. The method of claim 31,

wherein the steps comprise image processing steps;

wherein the script is operable to perform an image processing process.

33. A computer-implemented method for creating a graphical program, the method comprising:

receiving user input selecting one or more nodes to include in the graphical program from at least one first palette, wherein the at least one first palette presents a plurality of all available nodes for selection;

including the one or more selected nodes in the graphical program;

determining one or more suggested nodes to include in the graphical program, based on the one or more nodes selected by the user input; and

displaying the one or more suggested nodes as shadow nodes that follow a mouse cursor, wherein the one or more suggested nodes are selectable by the user for inclusion in the graphical program.

34. A memory medium for creating a graphical program, the memory medium comprising program instructions executable to:

receive user input selecting one or more nodes to include in the graphical program from at least one first palette, wherein the at least one first palette presents a plurality of all available nodes for selection;

include the one or more selected nodes in the graphical program;

determine one or more suggested nodes to include in the graphical program, based on the one or more nodes selected by the user input; and

display the one or more suggested nodes as shadow nodes that follow a mouse cursor, wherein the one or more suggested nodes are selectable by the user for inclusion in the graphical program.

35. A computer-implemented method for creating a graphical program, the method comprising:

receiving user input selecting one or more nodes to include in the graphical program from at least one first palette, wherein the at least one first palette presents a plurality of all available nodes for selection;

including the one or more selected nodes in the graphical program;

determining one or more suggested nodes to include in the graphical program, based on the one or more nodes selected by the user input; and

providing audio suggestions indicating the one or more suggested nodes, wherein one or more suggested nodes are selectable by the user for inclusion in the graphical program.

36. A memory medium for creating a graphical program, the memory medium comprising program instructions executable to:

receive user input selecting one or more nodes to include in the graphical program from at least one first palette, wherein the at least one first palette presents a plurality of all available nodes for selection;

include the one or more selected nodes in the graphical program;

determine one or more suggested nodes to include in the graphical program, based on the one or more nodes selected by the user input; and

provide audio suggestions indicating the one or more suggested nodes, wherein one or more suggested nodes are selectable by the user for inclusion in the graphical program.

37. A computer-implemented method for creating a graphical program, the method comprising:

receiving user input selecting one or more nodes to include in the graphical program from at least one first palette, wherein the at least one first palette presents a plurality of all available nodes for selection;

including the one or more selected nodes in the graphical program;

determining one or more suggested nodes to include in the graphical program, based on the one or more nodes selected by the user input; and

including the one or more suggested nodes in the graphical program, wherein the one or more suggested nodes are selectable by the user for removal from the graphical program.

38. A memory medium for creating a graphical program, the memory medium comprising program instructions executable to:

receiving user input selecting one or more nodes to include in the graphical program from at least one first palette, wherein the at least one first palette presents a plurality of all available nodes for selection;

including the one or more selected nodes in the graphical program;

determining one or more suggested nodes to include in the graphical program, based on the one or more nodes selected by the user input; and

including the one or more suggested nodes in the graphical program, wherein the one or more suggested nodes are selectable by the user for removal from the graphical program.

39. A computer-implemented method for creating a graphical program, the method comprising:

receiving user input selecting one or more nodes to include in the graphical program from at least one first palette, wherein the at least one first palette presents a plurality of all available nodes for selection;

including the one or more selected nodes in the graphical program;

displaying one or more suggested nodes to include in the graphical program in a second palette, based on the one or more nodes selected by the user input, wherein the second palette is separate from the at least one first palette, and wherein the one or more suggested nodes are selectable by the user for inclusion in the graphical program;

displaying a window for creating a graphical user interface for the graphical program;

displaying one or more user interface elements in the window in response to user input;

determining one or more suggested user interface elements in response to the user input; and

displaying the one or more suggested user interface elements, wherein the one or more suggested user interface elements are selectable by the user for inclusion in the graphical program.

40. A memory medium for creating a graphical program, the memory medium comprising program instructions executable to:

receive user input selecting one or more nodes to include in the graphical program from at least one first palette, wherein the at least one first palette presents a plurality of all available nodes for selection;

include the one or more selected nodes in the graphical program;

display one or more suggested nodes to include in the graphical program in a second palette, based on the one or more nodes selected by the user input, wherein the second palette is separate from the at least one first palette, and wherein the one or more suggested nodes are selectable by the user for inclusion in the graphical program;

display a window for creating a graphical user interface for the graphical program;

display one or more user interface elements in the window in response to user input;

determine one or more suggested user interface elements in response to the user input; and

display the one or more suggested user interface elements, wherein the one or more suggested user interface elements are selectable by the user for inclusion in the graphical program.

41. A computer-implemented method for creating a graphical program, the method comprising:

receiving user input selecting one or more nodes to include in the graphical program from at least one first graphical user interface, wherein the at least one first graphical user interface presents a plurality of all available nodes for selection;

including the one or more selected nodes in the graphical program; and

displaying one or more suggested nodes to include in the graphical program in a second graphical user interface, based on the one or more nodes selected by the user input, wherein the second graphical user interface is separate from the at least one first graphical user interface, and wherein the one or more suggested nodes are selectable by the user for inclusion in the graphical program.

42. The method of claim 41, wherein the at least one first graphical user interface and/or the second graphical user interface comprises one or more of:

a palette;

a menu;

buttons;

checkboxes;

a list box;

a graph; and

a shadow node display that follows a mouse cursor.

43. The method of claim 41, further comprising:

receiving user input requesting to include a first suggested node in the graphical program; and

including the first suggested node in the graphical program.

44. The method of claim 41, further comprising:

automatically including the one or more suggested nodes in the graphical program.

45. The method of claim 41, further comprising:

determining the one or more suggested nodes.

46. The method of claim 45,

wherein said determining the one or more suggested nodes comprises determining that the one or more suggested nodes are necessary to complete an operation performed by the one or more nodes selected by the user input.

47. The method of claim 45,

wherein said determining the one or more suggested nodes comprises determining that the one or more suggested nodes frequently appear in graphical programs that include the one or more selected nodes.

48. The method of claim 45,

wherein said determining the one or more suggested nodes comprises performing an artificial intelligence heuristic to determine the one or more suggested nodes based on the one or more nodes selected by the user input.

49. A memory medium for creating a graphical program, the memory medium comprising program instructions executable to:

receive user input selecting one or more nodes to include in the graphical program from at least one first graphical user interface, wherein the at least one first graphical user interface presents a plurality of all available nodes for selection;

include the one or more selected nodes in the graphical program; and

display one or more suggested nodes to include in the graphical program in a second graphical user interface, based on the one or more nodes selected by the user input, wherein the second graphical user interface is separate from the at least one first graphical user interface, and wherein the one or more suggested nodes are selectable by the user for inclusion in the graphical program.

50. A computer-implemented method for creating a graphical program, the method comprising:

receiving user input selecting one or more nodes to include in the graphical program from at least one graphical user interface, wherein the at least one graphical user interface presents a plurality of all available nodes for selection;

including the one or more selected nodes in the graphical program; and

displaying one or more suggested nodes to include in the graphical program in a palette, based on the one or more nodes selected by the user input, wherein the palette is separate from the at least one graphical user interface, and wherein the one or more suggested nodes are selectable by the user for inclusion in the graphical program.