Spatial asset management system and method

• US 7,003,443 B2
• Filed: 05/23/2001
• Issued: 02/21/2006
• Est. Priority Date: 09/16/1996
• Status: Expired due to Term

• Current Assignee: Lockheed Martin Corporation (Martin Marietta Corporation)
• Original Assignee: Datria Systems Incorporated (Honeywell International Inc.)
• Inventors: Yotka, John Anthony, Ford, Terry Edward, Turek, Richard James Jr.
• Primary Examiner(s): McFadden, Susan
• Assistant Examiner(s): Vo, Huyen X.
• Application Number:
  US09/863,670
• Publication Number:
  US 20010039489A1
• Time in Patent Office: 1,735 Days
• Field of Search: 455/456.5, 701/35, 704/201, 704/7, 704/9
• US Class Current: 704/9
• CPC Class Codes: G01C 21/3629 Guidance using speech or audio output, e.g. text-to-speech text to speech systems per se G10L13/00
• CPC Class Codes: G06T 17/05 Geographic models
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence

Abstract

A data collection and automatic database population system which combines global positioning system (GPS), speech recognition software, radio frequency (RF) communications, and geographic information system (GIS) to allow rapid capture of field data, asset tracking, and automatic transfer of the data to a GIS database. A pre-defined grammar allows observations to be continuously captured along with GPS location and time, and stored on the field mobile unit. A mobile unit'"'"'s location is tracked in real time or post processed through wireless RF transmission of location information between the mobile unit and a central processing station. The captured data is electronically transferred to a central processing station for quality assurance and automatic population of the GIS database. The system provides for automatic correlation of field data with other GIS database layers. Tools to generate predefined or user defined reports, work orders, and general data queries allow exploitation of the GIS database.

Claims

1. A method for automatically processing and managing spatial asset information in a repository, the method comprising:

defining instances primary observation types and associations between each of the specific instances;

identifying reference networks and geographic information system asset layers in the repository;

configuring the repository based on said instances definitions and said associations;

collecting field data;

converting said collected field data to specific observations;

correlating said specific observations to the appropriate said reference network and said geographic information system asset layers; and

updating said appropriate geographic information system asset layers in the repository;

wherein said collecting of field data step further comprises;

capturing free speech stating verbal observations containing voice data;

capturing location data contemporaneously with each of said verbal observations;

time-stamping each of said captured verbal observations to create a raw verbal observation; and

time-stamping said capture location.

2. The method defined in claim 1 further comprising:

configuring automatically analysis tools to exploit data in the repository so that said analysis tools are based on said instances definitions.

3. The method defined in claim 1 further comprising:

using a mobile unit computer in communication with a global positioning satellite receiver to capture said location data.

4. The method defined in claim 1 further comprising:

using a mobile unit computer in communication with a sound board for capturing said free speech stating verbal observations containing voice data.

5. The method defined in claim 1 further comprising:

constructing a predefined reference grammar for said voice data to be captured;

incorporating a semantic relationship structure in said predefined reference grammar; and

using said predefined reference grammar and said semantic relationship structure to enable said voice data in at least two of said raw verbal observations to be combined automatically with said captured location data into a single record in a geographic information system database.

6. The method defined in claim 5 further comprising:

using a mobile unit computer for capturing both said location data and said free speech stating verbal observations containing voice data; and

transferring said captured location data and said captured voice data from said mobile unit computer to a processing computer, wherein said processing computer combines said captured voice data and said captured location data into said single record which is stored in said geographic information system database which is connectable to said processing computer.

7. The method defined in claim 5 further comprising:

configuring said predefined reference grammar and said semantic relationship structure to a specific form for a specific application.

8. The method defined in claim 7 wherein said specific application is a street maintenance application and said predefined reference grammar and said semantic relationship structure are configured to said specific form for use in said street maintenance application.

9. The method defined in claim 5 further comprising:

time-stamping all records in said geographic information system database using only a central processing unit clock of a computer.

10. The method defined in claim 9 further comprising:

capturing a third stream of sensor data;

time-stamping all said captured third stream of sensor data by said central processing unit clock of said computer; and

combining automatically specific items of sensor data into specific records having specific voice data and specific location data by using said time-stamping as a synchronizing key.

11. An apparatus for automatically processing and managing spatial asset information in a repository, the apparatus comprising:

defining means for defining instances of primary observation types and associations between each of the specific instances;

identifying means for identifying reference networks and geographic information system asset layers in the repository;

configuring means for configuring the repository based on said instances definitions and said associations;

data collection means for collecting field data;

converting means for converting said collected field data to specific observations;

correlating means for correlating said specific observations to the appropriate said reference network and said geographic information system asset layers; and

updating means for updating said appropriate geographic information system asset layers in the repository;

wherein said data collection means captures free speech stating verbal observations containing voice data and also captures location data contemporaneously With each of said verbal observations, and wherein the apparatus includes time-stamping means for time-stamping each of said captured verbal observations to create a raw verbal observation and for time-stamping said captured location data.

12. The apparatus defined in claim 11 further comprising:

configuring means for automatically configuring analysis tools to exploit data in the repository so that said analysis tools are based on said instances definitions.

13. The apparatus defined in claim 11 wherein said data collection means includes a mobile unit computer in communication with a global positioning satellite receiver to capture said location data.

14. The apparatus defined in claim 11 wherein said data collection means includes a mobile unit computer in communication with a sound board for capturing said free speech stating verbal observations containing voice data.

15. The apparatus defined in claim 11 further comprising:

reference grammar means for interpreting captured voice data contained in a plurality of verbal observations;

said reference grammar means incorporating a semantic relationship structure means for combining said captured voice data contained in at least two of said plurality of verbal observations; and

data conversion processing means for using said reference grammar means and said semantic relationship structure means to enable said captured voice data in said at least two of said plurality of verbal observations to be combined automatically with said captured location data into a single record in a geographic information system database.

16. The apparatus defined in claim 15 wherein said data collection means includes a mobile unit computer for capturing both said location data and said free speech stating verbal observations containing voice data, and wherein the apparatus further comprises:

a processing computer and a data transfer means for transferring said captured location data and said captured voice data from said mobile unit computer to said processing computer which combines said captured voice data and said captured location data into a single record which is stored in said geographic information system database connectable to said processing computer.

17. The apparatus defined in claim 15 further comprising:

a grammar configuring means for configuring said reference grammar means and said semantic relationship structure means to a specific form for a specific application.

18. The apparatus defined in claim 17 wherein said specific application is a street maintenance application and said reference grammar means and said semantic relationship structure means are configured to said specific form for use in said street maintenance application.

19. The apparatus defined in claim 15 wherein said time-stamping means time-stamps all records in said geographic information system database using only a central processing unit clock of a computer.

20. The apparatus defined in claim 19 wherein said data collection means captures a third stream of sensor data, and wherein said time-stamping means time-stamps all captured third stream of sensor data by said central processing unit clock of said computer, and wherein said converting means automatically combines specific items of sensor data into specific records having specific voice data and specific location data by using said time-stamping as a synchronizing key.

21. Computer-readable media tangibly embodying a program of instructions executable computer perform a method for automatically processing and managing spatial asset information in repository, the method comprising:

defining instances of primary observation types and associations between each of the specific instances;

identifying reference networks and geographic information system asset layers In the repository;

configuring the repository based on said instances definitions and said associations;

collecting field data;

converting said collected field data to specific observations;

correlating said specific observations to the appropriate said reference network and said geographic information system asset layers;

updating said appropriate geographic Information system asset layers in the repository;

wherein said collecting of field data step further comprises;

capturing free speech stating verbal observations containing voice data;

capturing location data contemporaneously with each of said verbal observations;

time-stamping each of said captured verbal create a raw verbal observation; and

time-stamping said captured location data.

22. The computer-readable media defined in claim 21 further comprising:

configuring automatically analysis tools to exploit data in the repository so that said analysis tools are based on said instances definitions.

23. The computer-readable media defined in claim 21 wherein the computer is a mobile unit computer in communication with a global positioning satellite receiver to capture said location data.

24. The computer-readable media defined in claim 21 wherein the computer is a mobile unit computer in communication with a sound board for capturing said free speech stating verbal observations containing voice data.

25. The computer-readable media defined in claim 21 further comprising:

constructing a predefined reference grammar for said voice data to be captured;

incorporation a semantic relationship structure in said predefined reference grammar; and

using said predefined reference grammar and said semantic relationship structure to enable said voice data in at least two of said raw verbal observations to be combined automatically with said captured location data into a single record in a geographic information system database.

26. The computer-readable media defined in claim 25 wherein the computer is a mobile unit computer used for capturing both said location data and said free speech stating verbal observations containing voice data, and further comprising:

transferring said captured location data and said captured voice data from said mobile unit computer to a processing computer, wherein said processing computer combines said captured voice data and said captured location data into said single record which is stored in said geographic information system database which is connectable to said processing computer.

27. A computer programmed to execute process for automatically processing and managing spatial asset information in a repository, the process defining instances comprising:

defining instances of primary observation types and associations between each of the specific instances;

identifying reference networks and geographic information system asset layers in the repository;

configuring the repository based on said instances definitions and said associations;

collecting field data;

converting said collected field data to specific observations;

correlating said specific observations to the appropriate said reference network and said geographic information system asset layers; and

updating said appropriate geographic information system asset layers in the repository;

capturing free speech stating verbal observations containing voice data;

capturing location data contemporaneously with each of said verbal observations;

time-stamping each of said captured verbal observations to create a raw verbal observation; and

time-stamping said captured location data.

28. The computer as in claim 27 wherein the process further comprises:

configuring automatically analysis tools to exploit data in the repository so that said analysis tools are based on said instances definitions.

29. The computer as in claim 27 wherein the process further comprises:

using a mobile unit computer in communication with a global positioning satellite receiver to capture said location data.

30. The computer as in claim 27 wherein the process further comprises:

using a mobile unit computer in communication with a sound board for capturing said free speech stating verbal observations containing voice data.

31. The computer as in claim 27 wherein the process further comprises:

constructing a predefined reference grammar for said voice data to be captured;

incorporating a semantic relationship structure in said predefined reference grammar; and

using said predefined reference grammar and said semantic relationship structure to enable said voice data in at least two of said raw verbal observations to be combined automatically with said captured location data into a single record in a geographic information system database.

32. The computer as in claim 31 wherein the process further comprises:

using a mobile unit computer for capturing both said location data and said free speech stating verbal observations containing voice data, and

transferring said captured location data and said captured voice data from said mobile unit computer to a processing computer, wherein said processing computer combines said captured voice data and said captured location data into said single record which is stored in said geographic information system database which is connectable to said processing computer.

33. An apparatus for automatically processing and managing spatial asset information, the apparatus comprising:

a processing computer for receiving a plurality of field data that has been collected; and

a data repository connectable to said processing computer for receiving processing results of said processing computer, wherein said data repository further comprises,

a plurality of reference networks;

a geographic information system having a plurality asset layers;

a plurality of pre-defined instances of primary observation types; and

a plurality pre-defined associations between each of said plurality of pre-defined instances of primary observation types, wherein said data repository is configured based upon said plurality of pre-defined instances of primary observation types and said plurality of pre-defined associations;

wherein said processing computer,

converts each of said plurality of field data into an appropriate one said primary observation types;

correlates each of said converted primary observation types of each of said plurality of field data to an appropriate one of said plurality of reference networks and an appropriate one said plurality of asset layers; and

updates said appropriate one of said plurality of asset layers with each of said converted primary observation types of each of said plurality of field data; and

wherein said collecting of field data further comprises;

capturing free speech stating verbal observations containing voice data;

capturing location data contemporaneously with each of said verbal observations;

time-stamping each of said captured verbal create a raw verbal observation; and

time-stamping said captured location data.

34. The apparatus defined in claim 33 further comprising:

a mobile unit computer for collecting said plurality of field data; and

a radio frequency transmitter connectable to said mobile unit computer for transferring said collected field data to said processing computer.

35. The apparatus defined in claim 34 wherein said mobile unit computer further comprises:

a microphone connectable to a sound board for capturing free speech stating verbal observations containing voice data; and

a global positioning satellite receiver for capturing location data contemporaneously with each of said verbal observations, wherein each of said captured verbal observations and said contemporaneously captured location data is time-stamped to create a plurality of raw verbal observations.

36. The apparatus defined in claim 35 wherein said data repository further comprises:

a geographic information system database;

a reference grammar for interpreting captured voice data contained in said plurality of raw verbal observations, wherein said reference grammar has a semantic relationship structure for combining said captured voice data contained in at least two of said plurality of raw verbal observations; and

a data converter for using said reference grammar and said semantic relationship structure to enable said captured voice data in said at least two of said plurality of verbal observations to be combined automatically with said captured location data into a single record in said geographic information system database.

37. The apparatus defined in claim 36 wherein said reference grammar and said semantic relationship structure are configured for a specific form for a specific application.

38. The apparatus defined in claim 37 wherein said specific application is a street maintenance application and said reference grammar and said semantic relationship structure are configured to said specific form for use in said street maintenance application.

39. The apparatus defined in claim 36 wherein said processing computer further comprises:

a processing computer clock used for time-stamping all records in said geographic information system database.

40. The apparatus defined in claim 39 wherein said mobile unit computer captures a third stream of sensor data, and further wherein said processing computer clock is used to time-stamp all captured third stream of sensor data, and further wherein said data converter automatically combines specific items of sensor data into specific records having specific voice data and specific location data by using said time-stamping as a synchronizing key.

41. The apparatus defined in claim 33 wherein said data repository further comprises:

a plurality of analysis tools automatically configured to exploit data in said data repository based on said plurality of pre-defined instances of primary observation types.