Multi-protocol, multi-interface communications device testing system

• US 20030231741A1
• Filed: 06/14/2002
• Published: 12/18/2003
• Est. Priority Date: 06/14/2002
• Status: Active Grant

• Current Assignee: Keysight Technologies Singapore (Holdings) Pte. Limited. (Keysight Technologies, Inc.)
• Original Assignee: G3 NOVA Technology, Inc. (Keysight Technologies, Inc.)
• Inventors: Moldovan, Mihai, Rancu, Ovidiu
• Granted Patent: US 7,099,438 B2
• Time in Patent Office: Days
• US Class Current: 379/9
• CPC Class Codes: H04M 3/08 Indicating faults in circuits or apparatus
• CPC Class Codes: H04M 3/2209 for lines also used for data transmission
• CPC Class Codes: H04M 3/303 and using PCM multiplexers, e.g. pair gain systems
• CPC Class Codes: H04M 3/36 Statistical metering, e.g. recording occasions when traffic exceeds capacity of trunks
• CPC Class Codes: H04W 24/06 Testing, supervising or monitoring using simulated traffic
• CPC Class Codes: H04W 88/06 adapted for operation in multiple networks or having at least two operational modes, e.g. multi-mode terminals
• CPC Class Codes: H04W 88/10 adapted for operation in multiple networks, e.g. multi-mode access points

Abstract

A multi-protocol, multi-interface communications device testing system is disclosed. The system simultaneously control communication channels of a communications platform though multiple Interface Protocols, such as TDM, IP and Telephony Application Program Interfaces. The system also allows the creation of multi Interface Protocol Test Scenarios, and displays the results of executing The test results from all Protocols Interfaces and records and displays results.

Claims

1. [System—

A Telephony API and a Second Interface Protocol] A communications platform testing system,

wherein the communications platform comprises

a plurality of Communications Channels through which telephony communications pass via at least two different Interface Protocols;

a telephony applications program interface operable to receive commands to thereby control a telephony communication through the plurality of Communications Channels;

the communications platform testing system comprising;

a Test Scenario storage means operable to store a Test Scenario comprising;

a first Communications Channel control function for controlling a Communications Channel via a first Interface Protocol;

a second Communications Channel control function for controlling a Communications Channel via a second Interface Protocol;

and in which either the first or second Communications Channel control function corresponds to a function of one of a plurality of functions defined by telephony API;

an Execution Manager that;

sends Communications Channel control commands to the communications platform in accordance with a Test Scenario,

receives information regarding the status of the communications platform in response to sending the telephony API Communications Channel control commands sent to the communications platform; and

wherein

at least one of Communications Channel control commands that may be sent is in accordance with a telephony API;

a Results Reporter operable to report information regarding the plurality of Communications Channels during execution of a Test Scenario.

2. [System—

Telephony API and a Second Interface Protocol—

Synchronization] The System of claim 1, further comprising;

a Test Scenario builder comprising

means for defining a Test Function for a first Communications Channel;

means for defining a Test Function for a second Communications Channel;

means for defining synchronicity a between the Test Functions of different Communications Channels such that the execution of a Test Function of a second Communications Channel does not begin until completion of a Test Function on the first Communications Channel; and

wherein the Execution Manager is responsive to a defined synchronization between Test Functions in a Test Scenario for two different Communications Channels.

3. [Agents are Used] The system of claim 1 wherein:

at least two computers on a network are used to perform the function of sending Communications Channel control commands to the communications platform in accordance with a Test Scenario.

4. [Method—

Telephony API and a Second Interface Protocol] A method for testing a communications platform,

wherein the communications platform comprises

a plurality of Communications Channels through which telephony communications pass via at least two different Interface Protocols;

a telephony applications program interface operable to receive commands to thereby control a telephony communication through the plurality of Communications Channels;

the method comprising the steps of;

providing a Test Scenario comprising;

a first Communications Channel control function for controlling a first Communications Channel via a first Interface Protocol;

a second Communications Channel control function for controlling a second Communications Channel via a second Interface Protocol;

and in which either the first or second Communications Channel control function corresponds to a function of one of a plurality of functions defined by telephony API;

sending the first and second Communications Channel control functions to the communications platform to thereby control communications thereon in accordance with the Test Scenario;

receiving information regarding the status of the communications platform in response to sending the first and second control functions to the communications platform;

reporting the status of the plurality of Communications Channels during execution of the Test Scenario using information received in response to executing the first and second control Communications Channel control functions.

5. [Method—

Telephony API and a Second Interface Protocol—

Synchronization] The method of claim 4, further comprising the steps of;

defining a Test Function for the first Communications Channel;

defining a Test Function for the second Communications Channel;

defining synchronicity a between the Test Functions of different Communications Channels such that the execution of a Test Function of a second Communications Channel does not begin until completion of a Test Function on the first Communications Channel;

deferring execution the synchronized Test Function of the second Communications Channel until completion of the synchronized Test Function of the first Communications Channel.

6. [Method—

Telephony API—

Agents are Used] The method of claim 4 wherein;

at least two computers on a network are used to perform each of the sending and receiving functions.

7. [System—

Synchronization between Channels using different Interface Protocols (Does not Require Telephony API)] A communications platform testing system,

wherein the communications platform comprises

a plurality of Communications Channels through which telephony communications pass via at least two different Interface Protocols;

the communications platform testing system comprising;

a Test Scenario builder comprising

means for defining a Test Function for controlling a first Communications Channel through which communications may pass using a first Interface Protocol;

means for defining a Test Function for controlling a second Communications Channel through which communications may pass using a second Interface Protocol;

means for defining synchronicity a between the Test Functions of different Communications Channels such that the execution of a Test Function of a second Communications Channel does not begin until completion of a Test Function on the first Communications Channel;

an Execution Manager that;

sends Communications Channel control commands to the communications platform in accordance with a Test Scenario,

receives information regarding the status of the communications platform in response to sending the Communications Channel control commands sent to the communications platform; and

is responsive to a defined synchronization between Test Functions in a Test Scenario for two different Communications Channels; and

a Results Reporter operable to report the status of the plurality of Communications Channels during execution of a Test Scenario.

8. [System—

GUI for defining Synchronization] The communications platform testing system of claim 7, wherein;

the Test Scenario builder further comprises means for graphically displaying icons representing Test Functions to be performed on first and second Communications Channels, the first icon having an output area and the second icon having an input area; and

wherein the means for defining synchronicity includes dragging a cursor from the output area of one icon to the input area of the second icon, such that a connection between such areas is graphically displayed.

9. [Method—

Synchronization between Channels using different Interface Protocols (Does not Require Telephony API)] A method of building a Test Scenario usable on a communications test system, the method comprising the steps of;

displaying a first Test Function icon having an output area;

associating the first Test Function icon with a first Communications Channel of a communications platform to be tested, wherein in the first Communications Channel communicates via a first Interface Protocol;

displaying a second Test Function icon having an input area;

associating the second Test Function icon with a second Communications Channel of a communication platform to be tested, wherein in the second Communications Channel communicates via a second Interface Protocol; and

defining synchronicity a between the first and second Test Functions by dragging a cursor from the output area of the first Test Function icon to the input area of the second Test Function icon.

10. [Method—

Synchronization—

Connector line] The method of claim 9 further comprising the step of;

graphically displaying a line representing the defined synchronicity, the line connecting the output area of the first Test Function icon to the input area of the second Test Function icon.

11. [System—

Testing System with Identification of Communications Resources of Agents] A communications platform testing system;

wherein the communications platform comprises

a plurality of Communications Channels through which telephony communications pass;

a plurality of Interface Protocols for receiving commands to thereby control a telephony communication through the plurality of Communications Channels;

the communications platform testing system comprising;

means for receiving from an Agent an identification of

communications resources connectable to the Communications Channels available to the Agent and

an Interface Protocol used by the Agent; and

means for associating a communications Test Function with an identified communications resource available to an Agent.

12. [Method—

Scenario Builder with Identification of Communications Resources of Agents] A method for building a Test Scenario usable on a communications test system for a communications platform,

wherein the communications platform comprises

a plurality of Communications Channels through which telephony communications pass;

a plurality of Interface Protocols for receiving commands to thereby control a telephony communication through the plurality of Communications Channels;

the method comprising the steps of;

receiving from an Agent an identification of;

communications resources connectable to the Communications Channels available to the Agent and

an Interface Protocol used by the Agent;

associating a communications Test Function with an identified communications resource available to an Agent.

13. [System—

Associating different Communications Channels with different Test Scenarios] A communications platform testing system scenario builder,

wherein the communications platform comprises

a plurality of Communications Channels through which telephony communications pass;

a plurality of Interface Protocols for receiving commands to thereby control a telephony communication through the plurality of Communications Channels;

the communications platform testing system scenario builder comprising;

means for specifying first and second Communications Channels to be tested;

means for defining a plurality of different test sequences independently of Communications Channels to be tested, within a Test Scenario, the plurality of different test sequences implementing at least two different Interface Protocols,

means for storing the plurality of test sequences, and

means for associating multiple Communications Channels to be tested with one of the stored plurality of test sequences.

14. [System—

Associating different Communications Channels with different Test Scenarios—

multiple Interface Protocols—

at least one TAPI] The communications platform testing system scenario builder of claim 13,

wherein at least one of the Interface Protocols implemented is a telephony Application Program Interface.

15. [Method—

Associating different channels with different Test Scenarios] A method of building a Test Scenario for a communications platform usable on a communications test system;

wherein the communications platform comprises

a plurality of Communications Channels through which telephony communications pass;

a plurality of Interface Protocols for receiving commands to thereby control a telephony communication through the plurality of Communications Channels;

the method comprising the steps of;

specifying first and second Communications Channels to be tested;

defining a plurality of different test sequences independently of Communications Channels to be tested, within a Test Scenario, the plurality of different test sequences implementing at least two different Interface Protocols,

storing the plurality of test sequences

associating multiple Communications Channels to be tested with one of the stored plurality of test sequences.

16. [Method—

Associating different channels with different Test Scenarios—

at least one TAPI] The method of claim 15,

wherein at least one of the Interface Protocols implemented is a telephony Application Program Interface.

17. [System—

Specifying different log levels for each Communications Channel] A communications platform testing system scenario builder,

wherein the communications platform comprises a plurality of Communications Channels through which telephony communications pass;

the communications platform testing system scenario builder comprising;

means for specifying, for each Communications Channel, a Log Detail Level.

18. [System—

Specifying User Specified Data for a Test Sequence] A communications platform testing system scenario builder,

wherein the communications platform comprises a plurality of Communications Channels through which telephony communications pass;

the communications platform testing system scenario builder comprising;

means for specifying, for any Communications Channel, User Specified Statistical Data to collect during execution of the Test Scenario.

19. [System—

Specifying at Time Profile for a Communications Channel] A communications platform testing system scenario builder,

wherein the communications platform comprises a plurality of Communications Channels through which telephony communications pass;

the communications platform testing system scenario builder comprising;

means for specifying a Time Profile for a Test Sequence.

20. [System—

Data Capture Option] A communications platform testing system,

the communications platform testing system comprising;

a database capable of storing testing scenario results, the database being runable on a first computer

an execution manager the execution manager being operable to cause at least one Agent to execute a portion of a Test Scenario;

at least one Agent, each Agent;

being runable on a second computer, and further comprising;

means for executing a Test Scenario according to instructions received from an execution manager;

means for selectively storing Test Scenario results either on the first computer or the second computer

21. [System—

Showing results of different protocol tests executed simultaneously (“

Cross Analysis”

)] A communications platform testing system,

wherein the communications platform comprises

a plurality of Communications Channels through which telephony communications pass;

a plurality of Interface Protocols for receiving commands to thereby control a telephony communication through the plurality of Communications Channels;

the communications platform testing system comprising;

means for associating Test Function Sequences with a plurality of different Communications Channels, wherein at least two of the Communications Channels may be controlled by different Interface Protocols by the testing system;

means for causing the Test Function Sequences to be simultaneously executed;

means for displaying the results of the execution of the Test Scenarios, such that the results from each Test Scenario share a common time baseline.

22. [System—

Cross Analysis—

Synchronicity] The communications platform testing system of claim 21, wherein;

each Test Function Sequence is comprised of at least one Test Function;

and further comprising means for defining synchronicity a between the Test Functions of at least two different Communications Channels such that the execution of a Test Function of a second Communications Channel does not begin until completion of a Test Function associated with the first Communications Channel.

23. [Method—

Showing results of different protocol tests executed simultaneously (“

Cross Analysis”

)] A method for testing a communications platform,

wherein the communications platform comprises

a plurality of Communications Channels through which telephony communications pass;

a plurality of Interface Protocols for receiving commands to thereby control a telephony communication through the plurality of Communications Channels;

the method comprising;

associating Test Function Sequences to a plurality of different Communications Channels, wherein at least two of the Communications Channels may be controlled by different Interface Protocols by the testing system;

simultaneously executing the Test Function Sequences;

displaying the results of the execution of the Test Scenarios, such that the results from each Test Scenario share a common time baseline.

24. [Method—

Cross Analysis—

Synchronicity] The method of claim 23, wherein;

each Test Function Sequence is comprised of at least one Test Function;

and further comprising the step of defining synchronicity a between the Test Functions of at least two different Communications Channels such that the execution of a Test Function of a second Communications Channel does not begin until completion of a Test Function associated with the first Communications Channel.

25. [System—

Layered Results Analysis] A communications platform testing system,

wherein the communications platform comprises

a plurality of Communications Channels through which telephony communications pass;

a plurality of Interface Protocols for receiving commands to thereby control a telephony communication through the plurality of Communications Channels;

the communications platform testing system comprising;

means for defining a Test Scenario comprised of a plurality of Test Function Sequences each of which is associated with a Communications Channel,

means for executing the Test Function Sequences,

means for recording for Log Data associated with the execution of each Test Function;

means for generating information from the Log Data regarding the execution of each Test Sequence associated with a Communications Channel;

means for generating statistics regarding the execution of all Test Function Sequences.

means for displaying;

Log Data for any Test Function associated with a Test Function;

the generated information regarding each test sequence; and

the generated statistics regarding the execution of the Test Function Sequences.

26. [System—

Layered Results Analysis—

Hyperlinks from channel to Log Data] The communications platform testing system of claim 25, wherein;

The Log Data for any first Test Function may be displayed by;

Displaying a list of all Test Sequences iteration(s) for a Communications Channel; and

Selecting a displayed Test Sequence iteration.

27. [System—

Layered Results Analysis—

All-channel Pane with highlighted channel linked to pane showing channel summary.] The communications platform testing system of claim 25, further comprising;

simultaneously viewable first and second panes;

the first pane displaying

references to all Communications Channels referenced in a Test Scenario, and

means for selecting any Communications Channel reference; and

the second pane displaying generated information regarding the test sequence for a Communications Channel reference selected in the first pane.

28. [System—

Layered Results Analysis—

Telephony API.] The communications platform testing system of claim 25, wherein;

at least one of the Test Function Sequences associated with a Communications Channel is includes a telephony API Test Function.

29. [System—

Analysis Profiles.] A communications platform testing system,

wherein the communications platform comprises a plurality of Communications Channels through which telephony communications pass;

the communications platform testing system comprising;

means for recording for Log Data associated with the execution of Test Scenarios

means for defining pass/fail criteria, and

means for applying the pass/fail criteria to the recorded Log Data to generate pass/fail information,

means for displaying the pass/fail information.

30. [System—

Analysis Profile—

Save/Retrieve] The communications platform testing system of claim 29, further comprising;

means for saving and retrieving the defined pass/fail criteria, such that said criteria may be applied to different databases of Log Data.

31. [System—

Call Race View] A communications platform testing system,

wherein the communications platform comprises

a plurality of Communications Channels through which telephony communications pass;

a plurality of Interface Protocols for receiving commands to thereby control a telephony communication through the plurality of Communications Channels;

the communications platform testing system comprising;

means for associating Test Function Sequences for different Interface Protocols with a plurality of different Communications Channels,

means for storing the results of the execution of the test sequences, such that at least some of the results from different Test Function Sequences have a common time baseline,

means for displaying the results of the execution of the test sequences, such that;

the results are displayed in an area having first and second axes,

the first axis represents time,

the second axis displays a bar for each Communications Channel, each bar having markers corresponding to the time spent performing each Test Function applied to the Communications Channel;

such that all bars are displayed according to a common time baseline.

32. [System—

Call Race View—

context menu] The communications platform testing system of claim 31 wherein

the means for displaying the results comprises computer monitor output,

and further comprising;

means responsive to positioning a cursor over a displayed bar, to display information regarding the Test Function underneath the cursor.

33. [System—

Mapping Multiple Channels to Relative Channels of a Test Scenario] A communications platform testing system

wherein the communications platform comprises

a plurality of Communications Channels through which telephony communications pass;

the testing system comprising;

means for defining a Test Scenario having Relative Channels,

means for defining a plurality of Logical Channels that may be mapped to Communications Channels,

means for mapping the Relative Channels of the Test Scenario to plurality of Logical Channels.

34. [System—

Mapping Multiple Channels to Relative Channels of a Test Scenario—

One-step] The communications platform testing system of claim 33, wherein;

the means for mapping allows simultaneous mapping of multiple Relative Channels to multiple Logical Channels.

35. [Method—

Mapping Multiple Channels to Relative Channels of a Test Scenario] A method for building a Test Scenario for a communications platform testing system, comprising the steps of;

defining a Test Scenario having Relative Channels,

defining a plurality of Logical Channels that may be mapped to Communications Channels of a Communications Platform,

mapping the Relative Channels of the Test Scenario to plurality of Logical Channels.

36. [System—

Mapping Multiple Channels to Relative Channels of a Test Scenario—

One-step] The method of claim 35, wherein;

the mapping step is performed by simultaneously mapping of multiple Relative Channels to multiple Logical Channels.