System and method for automating network device operability testing

• US 8,238,833 B1
• Filed: 04/05/2007
• Issued: 08/07/2012
• Est. Priority Date: 04/05/2007
• Status: Expired due to Fees

• Current Assignee: Nextel Communications (Deutsche Telekom AG)
• Original Assignee: Nextel Communications (Deutsche Telekom AG)
• Inventors: Mehmood, Arsalan, Zangara, Joseph, Klonoski, Nathan
• Primary Examiner(s): Gonzales, April G
• Application Number:
  US11/697,233
• Time in Patent Office: 1,951 Days
• Field of Search: 455/424, 455/67.11, 455/67.14, 370/231, 370/246, 702/117, 714/4.12
• US Class Current: 455/67.11
• CPC Class Codes: H04W 16/22 Traffic simulation tools or models

Abstract

Network device operability testing is performed by defining a universe of possible device states as a combination of network coverages, available network services and possible subscriber features. In one embodiment, each individual combination of network coverage, for a particular service and feature collectively defines a particular device state for operability testing purposes. In one embodiment, test point data may be generated, where each test point corresponds to the device'"'"'s operability for a particular device state. In another embodiment, state transitions and test point data may be represented as a node-based device state tree, which may navigated for pinpointing the nature and cause of device operability failures.

Claims

1. A method for network device operability testing comprising:

establishing a device profile for a network device;

determining a coverage combination, a service combination and a feature combination for the network device based on the device profile,

wherein the coverage combination comprises a plurality of network coverages which the network device is capable of receiving minus incompatible network coverages,

wherein the service combination comprises services that the network device is capable of minus services not within the coverage combination and services of one network coverage incompatible with another network coverage, and

wherein the feature combination is features of the network device minus features requiring services unavailable in the coverage combination;

identifying a plurality of possible device states corresponding to said coverage combination, service combination and feature combination; and

generating test point data for each of said plurality of possible device states.

2. The method of claim 1, wherein the coverage combination comprises a set of network environments in which the operability of said network device is to be tested.

3. The method of claim 1, wherein the service combination comprises a set of network services for which the operability of said network device is to be tested, wherein said set of network services includes at least one of telephony services, mobility management events, emergency/non-emergency location-based services, push-to-talk, games, selective dynamic group calling, streaming media, over-the-air software and firmware updates and desktop synchronization.

4. The method of claim 1, wherein the feature combination comprises a set of features for which the operability in said network device is to be tested, wherein said set of features includes at least one of browser feature, a chat feature, an email feature, a personal information management feature, personal information management application, media player/downloader, picture/video capture and phone-as-modem client.

5. The method of claim 1, further comprising:

defining a plurality of operation procedures for said network device, wherein said plurality of operation procedures are usable to cause said network device to enter said plurality of possible device states, and

associating each of said plurality of operation procedures with a corresponding one of said plurality of possible device states.

6. The method of claim 1, further comprising filtering said test point data based on a user-defined test scope to identify a select set of test points.

7. The method of claim 6, further comprising defining a plurality of state transitions for said select set of test points, each of said plurality of state transitions being representative of operability testing data corresponding to the network device transitioning from one device state to an adjacent device state.

8. The method of claim 7, further comprising generating a node-based device state tree comprising a plurality of nodes connected graphically by a plurality of node links, wherein said plurality of nodes correspond to said select set of test points, and said plurality of node links correspond to said plurality of state transitions.

9. The method of claim 7, wherein the adjacent device state is characterized by a change in only one of the coverage combination, the service combination and the feature combination.

10. The method of claim 1, wherein generating the test point data further comprises comparing a test result for each of the plurality of possible device states to corresponding threshold values representative of valid device operation.

11. The method of claim 1, wherein the network device is one of a cellular-capable electronic device, a network server, a network router and a network gateway.

12. A computer program product, comprising:

a processor readable medium having processor executable code embodied therein to perform network device operability testing, the processor readable medium having;

processor executable program code to establish a device profile for a network device,

processor executable program code to determine a coverage combination, a service combination and a feature combination for the network device based on the device profile,

wherein the coverage combination comprises a plurality of network coverages which the network device is capable of receiving minus incompatible network coverages,

wherein the service combination comprises services that the network device is capable of minus services not within the coverage combination and services of one network coverage incompatible with another network coverage, and

wherein the feature combination is features of the network device minus features requiring services unavailable in the coverage combination,

processor executable program code to identify a plurality of possible device states corresponding to said coverage combination, service combination and feature combination, and

processor executable program code to generate test point data for each of said plurality of possible device states.

13. The computer program product of claim 12, wherein the coverage combination comprises a set of network environments in which the operability of said network device is to be tested.

14. The computer program product of claim 12, wherein the service combination comprises a set of network services for which the operability of said network device is to be tested, and wherein said set of network services includes at least one of telephony services, mobility management events, emergency/nonemergency location-based services, push-to-talk, games, selective dynamic group calling, streaming media, over-the-air software and firmware updates and desktop synchronization.

15. The computer program product of claim 12, wherein the feature combination comprises a set of features for which the operability in said network device is to be tested, and wherein said set of features includes at least one of browser feature, a chat feature, an email feature, a personal information management feature, personal information management application, media player/downloader, picture/video capture and phone-as-modem client.

16. The computer program product of claim 12, wherein the processor readable medium further includes:

processor executable program code to define a plurality of operation procedures for said network device, wherein said plurality of operation procedures are usable to cause said network device to enter said plurality of possible device states; and

processor executable program code to associate each of said plurality of operation procedures with a corresponding one of said plurality of possible device states.

17. The computer program product of claim 12, wherein the processor readable medium further includes processor executable program code to filter said test point data based on a user-defined test scope to identify a select set of test points.

18. The computer program product of claim 17, wherein the processor readable medium further includes processor executable program code to define a plurality of state transitions for said select set of test points, each of said plurality of state transitions being representative of operability testing data corresponding to the network device transitioning from one device state to an adjacent device state.

19. The computer program product of claim 18, wherein the processor readable medium further includes processor executable program code to generate a node-based device state tree comprising a plurality of nodes connected graphically by a plurality of node links, wherein said plurality of nodes correspond to said select set of test points, and said plurality of node links correspond to said plurality of state transitions.

20. The computer program product of claim 18, wherein the adjacent device state is characterized by a change in only one of the coverage combination, the service combination and the feature combination.

21. The computer program product of claim 12, wherein the processor executable program code to generate the test point data further comprises processor executable program code to compare a test result for each of the plurality of possible device states to corresponding threshold values representative of valid device operation.

22. The computer program product of claim 12, wherein the network device is one of a cellular-capable electronic device, a network server, a network router and a network gateway.

23. A method for network device operability testing comprising:

establishing a device profile for a network device;

determining a coverage combination, a service combination and a feature combination for the network device based on the device profile,

wherein the coverage combination comprises a plurality of network coverages which the network device is capable of receiving minus incompatible network coverages,

wherein the service combination comprises services that the network device is capable of minus services not within the coverage combination and services of one network coverage incompatible with another network coverage, and

wherein the feature combination is features of the network device minus features requiring services unavailable in the coverage combination;

identifying a plurality of possible device states corresponding to said coverage combination, service combination and feature combination;

generating test point data for each of said plurality of possible device states;

defining a plurality of state transitions for the plurality of possible device states, wherein each of said plurality of state transitions is representative of the network device moving from one device state to an adjacent device state; and

generating a node-based device state tree comprising a plurality of nodes connected graphically by a plurality of node links, wherein said plurality of nodes correspond to said plurality of possible device states, and said plurality of node links correspond to said plurality of state transitions.

24. The method of claim 23, wherein the coverage combination comprises a set of network environments in which the operability of said network device is to be tested.

25. The method of claim 23, wherein the service combination comprises a set of network services for which the operability of said network device is to be tested, and wherein said set of network services includes at least one of telephony services, mobility management events, emergency/non-emergency location-based services, push-to-talk, games, selective dynamic group calling, streaming media, over-the-air software and firmware updates and desktop synchronization.

26. The method of claim 23, wherein the feature combination comprises a set of device features for which the operability in said network device is to be tested, wherein said set of features includes at least one of browser feature, a chat feature, an email feature, a personal information management feature, personal information management application, media player/downloader, picture/video capture and phone-as-modem client.

27. The method of claim 23, further comprising:

defining a plurality of operation procedures for said network device, wherein said plurality of operation procedures are usable to cause said network device to enter said plurality of possible device states; and

associating each of said plurality of operation procedures with a corresponding one of said plurality of possible device states.

28. The method of claim 23, further comprising filtering said test point data based on a user-defined test scope to identify a select set of test points.

29. The method of claim 23, wherein the adjacent device state is characterized by a change in only one of the coverage combination, the service combination and the feature combination.

30. The method of claim 23, wherein generating test point data further comprises comparing a test result for each of the plurality of possible device states to corresponding threshold values representative of valid device operation.

31. The method of claim 23, wherein the network device is one of a cellular-capable electronic device, a network server, a network router and a network gateway.