System and method for evaluating accuracy of an automatic location identification system
First Claim
1. A method for evaluating accuracy of an automatic location identification (ALI) system configured to locate a wireless communication device originating a call through a wireless communication network, said method comprising:
- identifying a validation region in which a service area of a public safety answering point (PSAP) and a radio frequency (RF) coverage area of said wireless communication network overlap;
selecting a test scenario that represents a calling environment in which said call may occur;
choosing a test point in said validation region exhibiting said calling environment represented by said test scenario;
determining a ground truth of said test point;
performing a test call from said test point, said test call simulating said call;
obtaining a reported location of said test point from said ALI system in response to said performing operation; and
comparing said reported location with said ground truth to determine said accuracy of said ALI system in response to predetermined accuracy parameters.
8 Assignments
0 Petitions
Accused Products
Abstract
A method (38) and system (56) evaluate the accuracy of an Automatic Location Identification (ALI) system (36) deployed within an environment (20) and configured to location a wireless communication device (24) originating an emergency call (22) through a wireless communication network (26). The method (38) includes a subprocesses that identify a validation region (144) in which a service area (106) of a public service answering point (PSAP) (32) and an RF coverage area (129) overlap, classify sub-regions within the validation region (144) according to a predetermined set of test scenarios (148) representing unique calling environments, and select test points (200) within the validation region (144) from which test calls, that simulate emergency calls, will be performed. The method (38) further includes an empirical test call execution subprocess (50) for performing test calls within the validation region (144) and a predictive test call execution subprocess (52) for simulating test calls within a simulated environment (260).
145 Citations
46 Claims
-
1. A method for evaluating accuracy of an automatic location identification (ALI) system configured to locate a wireless communication device originating a call through a wireless communication network, said method comprising:
-
identifying a validation region in which a service area of a public safety answering point (PSAP) and a radio frequency (RF) coverage area of said wireless communication network overlap; selecting a test scenario that represents a calling environment in which said call may occur; choosing a test point in said validation region exhibiting said calling environment represented by said test scenario; determining a ground truth of said test point; performing a test call from said test point, said test call simulating said call; obtaining a reported location of said test point from said ALI system in response to said performing operation; and comparing said reported location with said ground truth to determine said accuracy of said ALI system in response to predetermined accuracy parameters. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A method of evaluating accuracy of an automatic location identification (ALI) system configured to locate a wireless communication device originating an emergency call through a wireless communication network, said method comprising:
-
identifying a validation region in which a service area of a public safety answering point (PSAP) and a radio frequency (RF) coverage area of said wireless communication network overlap; selecting a test scenario that represents a calling environment in which said emergency call may occur; choosing a test point in said validation region exhibiting said calling environment represented by said test scenario; determining a ground truth of said test point; performing a test call from said test point, said test call simulating said emergency call; obtaining a reported location of said test point from said ALI system in response to said performing operation; and comparing said reported location with said ground truth to determine said accuracy of said ALI system in response to predetermined accuracy parameters. - View Dependent Claims (14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24)
-
-
25. A computer-based method for evaluating accuracy of an automatic location identification (ALI) system configured to locate a wireless communication device originating a call through a wireless communication network, said computer-based method comprising:
-
identifying a validation region in which a service area of a public safety answering point (PSAP) and a radio frequency (RF) coverage area of said wireless communication network overlap, said identifying operation comprising; obtaining a first map of said service area; acquiring a second map of said RF coverage area; selecting unit areas that are common to each of said first and second maps; and compiling said unit areas to form a validation region map identifying said validation region; populating said validation region map with geographic and land use features of said validation region; partitioning said validation region map into a plurality of sub-regions; correlating each of said sub-regions with one of a plurality of test scenarios; selecting one of said plurality of test scenarios that represents a unique calling environment in which said call may occur; choosing a test point in said validation region exhibiting said unique environment represented by said one test scenario; determining a ground truth of said test point; performing a test call from said test point, said test call simulating said call; obtaining a reported location of said test point from said ALI system in response to said performing operation; and comparing said reported location with said ground truth to determine said accuracy of said ALI system in response to predetermined accuracy parameters. - View Dependent Claims (26, 27, 28, 29)
-
-
30. A computer-based method for evaluating accuracy of an automatic location identification (ALI) system configured to locate a wireless communication device originating an emergency call through a wireless communication network, said computer-based method comprising:
-
identifying a validation region in which a service area of a public safety answering point (PSAP) and a radio frequency (RF) coverage area of said wireless communication network overlap, said identifying operation comprising; obtaining a first map of said service area; acquiring a second map of said RF coverage area; selecting unit areas that are common to each of said first and second maps; and compiling said unit areas to form a validation region map identifying said validation region; populating said validation region map with geographic and land use features of said validation region; partitioning said validation region map into a plurality of sub-regions; correlating each of said sub-regions with one of a plurality of test scenarios; selecting one of said plurality of test scenarios that represents a unique calling environment in which said emergency call may occur; choosing a test point in said validation region exhibiting said unique environment represented by said one test scenario; determining a ground truth of said test point; performing a test call from said test point, said test call simulating said emergency call; obtaining a reported location of said test point from said ALI system in response to said performing operation; and comparing said reported location with said ground truth to determine said accuracy of said ALI system in response to predetermined accuracy parameters. - View Dependent Claims (31, 32, 33, 34)
-
-
35. A computing system for selecting test points in a validation region, said test points being used to validate accuracy of an automatic location identification (ALI) system operating in said validation region, said ALI system being configured to locate a wireless communication device originating a call through a wireless communication network, said computing system comprising:
-
a processor; a computer-readable storage medium; and executable code recorded on said computer-readable storage medium for instructing said processor to select said test points, said executable code including; a validation region map subprocess for forming a validation region map of said validation region, said validation region map representing an overlap of a service area of a public safety answering point (PSAP) and a radio frequency (RF) coverage area of said wireless communication network; a sub-region classification subprocess for partitioning said validation region map into a plurality of sub-regions and correlating each of said sub-regions with one of a plurality of test scenarios, each of said test scenarios representing a unique calling environment in which said call may occur; and a test point selection subprocess for choosing said test points in response to a selected one of said test scenarios, said test points exhibiting said unique calling environment represented by said selected one of said test scenarios. - View Dependent Claims (36, 37, 38, 39, 40)
-
-
41. A computing system for selecting test points in a validation region, said test points being used to validate accuracy of an automatic location identification (ALI) system operating in said validation region, said ALI system being configured to locate a wireless communication device originating an emergency call through a wireless communication network, said computing system comprising:
-
a processor; a computer-readable storage medium; and executable code recorded on said computer-readable storage medium for instructing said processor to select said test points, said executable code including; a validation region map subprocess for forming a validation region map of said validation region, said validation region map representing an overlap of a service area of a public safety answering point (PSAP) and a radio frequency (RF) coverage area of said wireless communication network; a sub-region classification subprocess for partitioning said validation region map into a plurality of sub-regions and correlating each of said sub-regions with one of a plurality of test scenarios, each of said test scenarios representing a unique calling environment in which said emergency call may occur; and a test point selection subprocess for choosing said test points in response to a selected one of said test scenarios, said test points exhibiting said unique calling environment represented by said selected one of said test scenarios. - View Dependent Claims (42, 43, 44, 45, 46)
-
Specification