System and method for providing audio probe and debugging features in a graphical data flow program

• US 6,064,409 A
• Filed: 02/14/1997
• Issued: 05/16/2000
• Est. Priority Date: 09/22/1993
• Status: Expired due to Term

• Current Assignee: National Instruments Corporation (Emerson Electric Company)
• Original Assignee: National Instruments Corporation (Emerson Electric Company)
• Inventors: Thomsen, Carsten, Kodosky, Jeffrey L.
• Primary Examiner(s): Geckil, Mehmet B.
• Application Number:
  US08/799,956
• Time in Patent Office: 1,187 Days
• Field of Search: 395/500, 395/347, 395/398, 395/676, 395/356, 395/967, 395/977, 395/978, 395/970, 395/440, 395/339, 395/340, 395/526, 345/37, 391/356
• US Class Current: 715/700
• CPC Class Codes: G06F 11/3664 Environments for testing or debugging software
• CPC Class Codes: Y10S 715/97 Instrumentation and component modelling, e.g. interactive control panel

Abstract

An audio probe feature which enables a user to select a wire or connector connected to a graphical object and "hear" the signals propagating on the wire or input to/output from the object. This provides a more complete and more informative debugging environment for certain classes of signals. The present invention also provides various features for obtaining audial information regarding signals in the graphical program. A cursor driver icon is also disclosed which can be used in conjunction with the audio probe icon and which provides a motor driven audible cursor capability.

Claims

1. A method for audially probing signals in a graphical program in a computer system including a display screen, wherein said audial probing is used in debugging the graphical program, the method comprising:

assembling a graphical program comprising a plurality of interconnected function icons, wherein the plurality of interconnected function icons include a first function icon including at least one input and at least one output, ad a first wire connected to the at least one output of the first function icon;

receiving a user input request to enable an audio probe feature to audially generate data transferred on said first wire, wherein said audio probe feature is requested to aid in debugging the graphical program;

beginning execution of said graphical program;

the first function icon executing after said beginning execution, wherein the first function icon generates first data;

converting said first data into first audio signals; and

generating sounds corresponding to said first audio signals after said converting said first data into said first audio signals, wherein said converting said first data into first audio signals and said generating sounds corresponding to said first audio signals is performed in response to said audio probe feature being enabled;

wherein said sounds are useable in debugging the graphical program.

2. The method of claim 1, wherein the first data corresponds to a signal, wherein the signal is not an audio signal.

3. The method of claim 1, wherein the graphical program performs a measurement function on a signal;

wherein the first data corresponds to the signal.

4. The method of claim 3, wherein the signal is not an audio signal.

5. The method of claim 1, wherein said receiving said request to enable said audio probe feature comprises selecting said first wire in response to user input.

6. The method of claim 5, further comprising:

displaying on the screen an audio probe icon connected to said first wire after said selecting said first wire and prior to said beginning execution.

7. The method of claim 1, wherein said first data comprises one or more digital signals;

wherein said converting said first data into said first audio signals comprises converting said one or more digital signal comprising said first data into one or more analog audio signals,

wherein said generating sounds comprises;

providing said one or more analog audio signals to one or more speakers;

said one or more speakers generating sounds corresponding to said one or more analog audio signals.

8. The method of claim 1, further comprising:

receiving volume control input from a user;

wherein said generating sounds includes generating said sounds at a volume in response to said received volume control input.

9. The method of claim 1, further comprising:

receiving sampling input from a user;

wherein said converting said first data into said first audio signals includes sampling said first data at a sampling rate, wherein said sampling rate is based on said received sampling input.

10. The method of claim 1,

wherein the plurality of interconnected function icons further include a second function icon, the second function icon including at least one input and at lest one output, and a second wire connected to the at least one output of the first function icon, the method further comprising:

receiving a user input request to enable an audio probe feature to audially generate data transferred on said second wire, wherein said audio probe feature is requested to aid in debugging the graphical program;

displaying on the screen an audio probe icon connected to said second wire after said selecting said second wire and prior to said beginning execution

the second function icon executing after said beginning execution, wherein the second function icon generates second data;

converting said second data into second audio signals;

generating second sounds corresponding to said second audio signals after said converting said second data into second audio signals, wherein said converting said second data into second audio signals and said generating second sounds corresponding to said second audio signals is performed in response to sad audio probe feature being enabled;

wherein said second sounds are useable in debugging the graphical program.

11. The method of claim 1, wherein the plurality of interconnected function icons further includes a second function icon including at least one input and at least one output, and a second wire connected to the at least one output of the second function icon, the method further comprising:

receiving modulation input from a user prior to said beginning execution;

the second function icon executing after said beginning execution, wherein the second function icon generates second data;

converting said second data into second audio signals;

modulating said first audio signals onto said second audio signals, wherein said modulating is performed in response to said receiving modulation input;

generating sounds corresponding to said first audio signals modulated onto said second audio signals after said modulating, wherein said generating sounds is performed in response to said audio probe feature being enabled.

12. The method of claim 1, wherein said graphical program comprises a graphical data flow program.

13. The method of claim 1, wherein said graphical program comprises a virtual instrument.

14. A method for audially probing signals in a graphical program in a computer system including a display screen, the method comprising:

assembling a graphical program comprising a plurality of interconnected function icons, wherein the plurality of interconnected function icons include a first function icon including at least one input and at lest one output, and a first wire connected to the at least one output of the first function icon, wherein the graphical program implements an instrumentation function using a first signal, wherein the first signal is not an audio signal;

receiving a user input request to enable an audio probe feature to audially generate data transferred on said first wire;

beginning execution of said graphical program;

the first function icon executing after said beginning execution, wherein the first function icon generates first data corresponding to the first signal;

converting said first data into first audio signals; and

generating sounds corresponding to said first audio signals after said converting said first data into said first audio signals, wherein said converting said first data into first audio signals and said generating sounds corresponding to said first audio signals is performed in response to said audio probe feature being enabled.

15. The method of claim 14, wherein the graphical program performs a measurement function to increase the first signal.

16. The method of claim 14, wherein said audial probing is used in debugging the graphical program.

17. The method of claim 14, wherein said graphical program comprises a virtual instrument.

18. A method for debugging a graphical program in a computer system including a display screen, the method comprising:

assembling on the screen a graphical program comprising a plurality of interconnected function icons, wherein the function icons are connected by a plurality of wires,

placing a plurality of audio probe icons in said graphical program, wherein said plurality of audio probe icons are connected to a first plurality of said plurality of wires, wherein said plurality of audio probe icons are also connected to outputs of a first plurality of said plurality of function icons;

beginning execution of said graphical program;

each of said function icons executing after said beginning execution in accordance with said graphical program, wherein each of said function icons generates data;

converting data generated by said first plurality of function icons into audio signals as said first plurality of function icons execute;

generating sounds corresponding to said audio signals as said first plurality of function icons execute, wherein said sounds indicate an execution progression of said graphical program;

wherein said sound are useable in debugging the graphical program.

19. The method of claim 18, wherein each of said function icons generates non-audio data.

20. The method of claim 18, wherein the graphical program implements an instrumentation function.

21. The method of claim 18, further comprising:

receiving sound selection input from a user for each of said plurality of audio probe icons to assign unique sounds to each of said plurality of audio probe icons;

wherein said converting converts said data into audio signals based on said received sound selection input;

wherein said generating sounds comprises generating sounds corresponding to said audio signals to produce said selected sounds as said first plurality of function icons execute, wherein said selected sounds indicate an executing progression of said graphical program.

22. A computer-implemented method for improved debugging of a graphical diagram in a computer system including a display screen, wherein the computer system further includes a sound system including one or more speakers, the method comprising:

assembling on the screen a graphical program comprising a plurality of interconnected function icons, wherein the function icons perform operations in the graphical program;

receiving a user input request to enable an audio autoprobe feature to audially present data associated with or produced by said icons in said graphical program;

beginning execution of said graphical program after said receiving said request to enable said audio autoprobe feature;

executing said plurality of function icons after beginning execution, wherein each of said plurality of function icons generate data as said function icons are executed;

generating sounds in response to said data output from each of said plurality of function icons during said executing said plurality of function icons, wherein said generating sounds in response to said data output from each of said plurality of function icons is performed in response to said audio autoprobe feature being enabled;

wherein said sounds are useable in debugging the graphical program.

23. The method of claim 22, wherein said step of generating sounds is performed for each of said plurality of function icons as said function icons are executed.

24. The method of claim 23, further comprising:

displaying on the screen data output from each of said plurality of function icons proximate to each of said plurality of function icons during said executing said plurality of function icons, wherein said displaying on the screen said data output from each of said plurality of function icons is performed in response to said audio autoprobe feature being enabled.

25. The method of claim 22, wherein said data output from each of said plurality of function icons comprises non-audio data.

26. In an iconic programming system process within a computer system, wherein said process performs functions defined within an iconic program containing a plurality of connected graphical objects, a computer implemented method for audially presenting data associated with or produced by one or more of said plurality of graphical objects of said process, said computer implemented method comprising:

accepting an audio probe request to generate sounds in response to signals associated with or produced by one or more of said plurality of graphical objects, wherein said audio probe request is made to aid in debugging of the iconic program;

beginning execution of said iconic program;

programmatically obtaining data from said one or more of said plurality of graphical objects as said graphical objects are executed;

generating sounds for said one or more of said plurality of graphical objects in response to said programmatically obtaining data, wherein sounds for a respective graphical object are generated as said data is generated by said respective graphical object.

27. The method of claim 26, further comprising:

displaying said data from said one or more of said plurality of graphical objects, wherein data for a respective graphical object is displayed proximate to said respective graphical object as said data is generated by said respective graphical object.

28. The method of claim 26, wherein said data comprises non-audio data.

29. The method of claim 26, wherein said iconic program implements an instrumentation function.

30. A method for audially presenting data in a graph in a graphical program in a computer system including a display screen, the method comprising:

displaying on the screen a graph which presents data, wherein the graph includes a cursor along a first axis;

receiving a request to enable an audio probe feature to audially present the data displayed in said graph;

displaying on the screen a cursor driver icon connected to said graph, wherein said cursor driver icon is operable to move the cursor across said axis of said graph;

operating said cursor driver icon to move the cursor across said axis of said graph;

moving the cursor across said axis of said graph in response to operating said cursor driver icon;

converting said data from said graph into audio signals during said moving the cursor across said axis of said graph;

generating sounds corresponding to said audio signals in response to said converting said data into said audio signals, wherein said generating sounds corresponding to said audio signals is performed during said moving the cursor across said axis of said graph.

31. A computer system which includes an audio probe, comprising:

a display device including a screen;

a graphical program comprising a plurality of interconnected function icons displayed on the video screen, wherein the plurality of interconnected function icons include a first function icon including at lest one input and at least one output, and a first wire connected to the at least one output of the first function icon, wherein the first function icon generates first data;

an audio probe icon coupled to the first function icon which receives data from the first function icon during execution of the graphical program, wherein the audio probe icon provides debugging for the graphical program;

a sound system which converts said first data into first audio signals and generates sounds corresponding to said first audio signals, wherein said sound operates in response to said audio probe icon.

32. A computer-readable storage medium comprising program instructions for audially probing signals in a graphical program in a computer system, the computer system including a display screen, wherein the program instructions are executable to implement:

assembling a graphical program comprising a plurality of interconnected function icons, wherein the plurality of interconnected function icons include a first function icon including at least one input and at least one output, and a first wire connected to the at least one output of the first function icon;

receiving a user input request to enable an audio probe feature to audially generate data transferred on said first wire, wherein said audio probe feature is requested to aid in debugging the graphical program;

beginning execution of said graphical program;

the first function icon executing after said beginning execution, wherein the first function icon generates first data;

converting said first data into first audio signals; and

generating sounds corresponding to said first audio signals after said converting said first data into said audio signals, wherein said converting said first data into first audio signals and said generating sounds corresponding to said first audio signals is performed in response to said audio probe feature being enabled;

wherein said sounds are useable in debugging the graphical program.