Spatial asset management system and method

• US 20010039489A1
• Filed: 05/23/2001
• Published: 11/08/2001
• Est. Priority Date: 09/16/1996
• Status: Active Grant

• Current Assignee: Lockheed Martin Corporation (Martin Marietta Corporation)
• Original Assignee: John Anthony Yotka, Richard James Jr. Turek, Terry Edward Ford
• Inventors: Turek,, Richard James Jr., Yotka, John Anthony, Ford, Terry Edward
• Granted Patent: US 7,003,443 B2
• Time in Patent Office: Days
• US Class Current: 704/1
• CPC Class Codes: G01C 21/3629 Guidance using speech or audio output, e.g. text-to-speech text to speech systems per se G10L13/00
• CPC Class Codes: G06T 17/05 Geographic models
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence

Abstract

A data collection and automatic database population system which combines global positioning system (GPS), speech recognition software, radio frequency (RF) communications, and geographic information system (GIS) to allow rapid capture of field data, asset tracking, and automatic transfer of the data to a GIS database. A pre-defined grammar allows observations to be continuously captured along with GPS location and time, and stored on the field mobile unit. A mobile unit'"'"'s location is tracked in real time or post processed through wireless RF transmission of location information between the mobile unit and a central processing station. The captured data is electronically transferred to a central processing station for quality assurance and automatic population of the GIS database. The system provides for automatic correlation of field data with other GIS database layers. Tools to generate predefined or user defined reports, work orders, and general data queries allow exploitation of the GIS database.

Claims

1. A method for automatically processing and managing spatial asset information in a repository, the method comprising:

defining instances of primary observation types and associations between each of the specific instances;

identifying reference networks and geographic information system asset layers in the repository;

configuring the repository based on said instances definitions and said associations;

collecting field data;

converting said collected field data to specific observations;

correlating said specific observations to the appropriate said reference network and said geographic information system asset layers; and

updating said appropriate geographic information system asset layers in the repository.

2. The method defined in

claim 1

further comprising:

configuring automatically analysis tools to exploit data in the repository so that said analysis tools are based on said instances definitions.

3. The method defined in

claim 1

wherein said collecting of field data step further comprises:

capturing free speech stating verbal observations containing voice data;

capturing location data contemporaneously with each of said verbal observations;

time-stamping each of said captured verbal observations to create a raw verbal observation; and

time-stamping said captured location data.

4. The method defined in

claim 3

further comprising:

using a mobile unit computer in communication with a global positioning satellite receiver to capture said location data.

5. The method defined in

claim 3

further comprising:

using a mobile unit computer in communication with a sound board for capturing said free speech stating verbal observations containing voice data.

6. The method defined in

claim 3

further comprising:

constructing a predefined reference grammar for said voice data to be captured;

incorporating a semantic relationship structure in said predefined reference grammar; and

using said predefined reference grammar and said semantic relationship structure to enable said voice data in at least two of said raw verbal observations to be combined automatically with said captured location data into a single record in a geographic information system database.

7. The method defined in

claim 6

further comprising:

using a mobile unit computer for capturing both said location data and said free speech stating verbal observations containing voice data; and

transferring said captured location data and said captured voice data from said mobile unit computer to a processing computer, wherein said processing computer combines said captured voice data and said captured location data into said single record which is stored in said geographic information system database which is connectable to said processing computer.

8. The method defined in

claim 6

further comprising:

configuring said predefined reference grammar and said semantic relationship structure to a specific form for a specific application.

9. The method defined in

claim 8

wherein said specific application is a street maintenance application and said predefined reference grammar and said semantic relationship structure are configured to said specific form for use in said street maintenance application.

10. The method defined in

claim 6

further comprising:

time-stamping all records in said geographic information system database using only a central processing unit clock of a computer.

11. The method defined in

claim 10

further comprising:

capturing a third stream of sensor data;

time-stamping all said captured third stream of sensor data by said central processing unit clock of said computer; and

combining automatically specific items of sensor data into specific records having specific voice data and specific location data by using said time-stamping as a synchronizing key.

12. An apparatus for automatically processing and managing spatial asset information in a repository, the apparatus comprising:

defining means for defining instances of primary observation types and associations between each of the specific instances;

identifying means for identifying reference networks and geographic information system asset layers in the repository;

configuring means for configuring the repository based on said instances definitions and said associations;

data collection means for collecting field data;

converting means for converting said collected field data to specific observations;

correlating means for correlating said specific observations to the appropriate said reference network and said geographic information system asset layers; and

updating means for updating said appropriate geographic information system asset layers in the repository.

13. The apparatus defined in

claim 12

further comprising:

configuring means for automatically configuring analysis tools to exploit data in the repository so that said analysis tools are based on said instances definitions.

14. The apparatus defined in

claim 12

wherein said data collection means captures free speech stating verbal observations containing voice data and also captures location data contemporaneously with each of said verbal observations, and wherein the apparatus includes time-stamping means for time-stamping each of said captured verbal observations to create a raw verbal observation and for time-stamping said captured location data.

15. The apparatus defined in

claim 14

wherein said data collection means includes a mobile unit computer in communication with a global positioning satellite receiver to capture said location data.

16. The apparatus defined in

claim 14

wherein said data collection means includes a mobile unit computer in communication with a sound board for capturing said free speech stating verbal observations containing voice data.

17. The apparatus defined in

claim 12

further comprising:

reference grammar means for interpreting captured voice data contained in a plurality of verbal observations;

said reference grammar means incorporating a semantic relationship structure means for combining said captured voice data contained in at least two of said plurality of verbal observations; and

data conversion processing means for using said reference grammar means and said semantic relationship structure means to enable said captured voice data in said at least two of said plurality of verbal observations to be combined automatically with said captured location data into a single record in a geographic information system database.

18. The apparatus defined in

claim 17

wherein said data collection means includes a mobile unit computer for capturing both said location data and said free speech stating verbal observations containing voice data, and wherein the apparatus further comprises:

a processing computer and a data transfer means for transferring said captured location data and said captured voice data from said mobile unit computer to said processing computer which combines said captured voice data and said captured location data into a single record which is stored in said geographic information system database connectable to said processing computer.

19. The apparatus defined in

claim 17

further comprising:

a grammar configuring means for configuring said reference grammar means and said semantic relationship structure means to a specific form for a specific application.

20. The apparatus defined in

claim 19

wherein said specific application is a street maintenance application and said reference grammar means and said semantic relationship structure means are configured to said specific form for use in said street maintenance application.

21. The apparatus defined in

claim 17

wherein said time-stamping means time-stamps all records in said geographic information system database using only a central processing unit clock of a computer.

22. The apparatus defined in

claim 21

wherein said data collection means captures a third stream of sensor data, and wherein said time-stamping means time-stamps all captured third stream of sensor data by said central processing unit clock of said computer, and wherein said converting means automatically combines specific items of sensor data into specific records having specific voice data and specific location data by using said time-stamping as a synchronizing key.

23. Computer-readable media tangibly embodying a program of instructions executable by a computer to perform a method for automatically processing and managing spatial asset information in a repository, the method comprising:

defining instances of primary observation types and associations between each of the specific instances;

identifying reference networks and geographic information system asset layers in the repository;

configuring the repository based on said instances definitions and said associations;

collecting field data;

converting said collected field data to specific observations;

correlating said specific observations to the appropriate said reference network and said geographic information system asset layers; and

updating said appropriate geographic information system asset layers in the repository.

24. The computer-readable media defined in

claim 23

further comprising:

configuring automatically analysis tools to exploit data in the repository so that said analysis tools are based on said instances definitions.

25. The computer-readable media defined in

claim 23

wherein said collecting of field data step further comprises:

capturing free speech stating verbal observations containing voice data;

capturing location data contemporaneously with each of said verbal observations;

time-stamping each of said captured verbal observations to create a raw verbal observation; and

time-stamping said captured location data.

26. The computer-readable media defined in

claim 25

wherein the computer is a mobile unit computer in communication with a global positioning satellite receiver to capture said location data.

27. The computer-readable media defined in

claim 25

wherein the computer is a mobile unit computer in communication with a sound board for capturing said free speech stating verbal observations containing voice data.

28. The computer-readable media defined in

claim 25

further comprising:

constructing a predefined reference grammar for said voice data to be captured;

incorporation a semantic relationship structure in said predefined reference grammar; and

using said predefined reference grammar and said semantic relationship structure to enable said voice data in at least two of said raw verbal observations to be combined automatically with said captured location data into a single record in a geographic information system database.

29. The computer-readable media defined in

claim 28

wherein the computer is a mobile unit computer used for capturing both said location data and said free speech stating verbal observations containing voice data, and further comprising:

transferring said captured location data and said captured voice data from said mobile unit computer to a processing computer, wherein said processing computer combines said captured voice data and said captured location data into said single record which is stored in said geographic information system database which is connectable to said processing computer.

30. A computer programmed to execute a process for automatically processing and managing spatial asset information in a repository, the process comprising:

defining instances of primary observation types and associations between each of the specific instances;

identifying reference networks and geographic information system asset layers in the repository;

configuring the repository based on said instances definitions and said associations;

collecting field data;

converting said collected field data to specific observations;

correlating said specific observations to the appropriate said reference network and said geographic information system asset layers; and

updating said appropriate geographic information system asset layers in the repository.

31. The computer as in

claim 30

wherein the process further comprises:

configuring automatically analysis tools to exploit data in the repository so that said analysis tools are based on said instances definitions.

32. The computer as in

claim 30

wherein the process further comprises:

capturing free speech stating verbal observations containing voice data;

capturing location data contemporaneously with each of said verbal observations;

time-stamping each of said captured verbal observations to create a raw verbal observation; and

time-stamping said captured location data.

33. The computer as in

claim 32

wherein the process further comprises:

using a mobile unit computer in communication with a global positioning satellite receiver to capture said location data.

34. The computer as in

claim 32

wherein the process further comprises:

using a mobile unit computer in communication with a sound board for capturing said free speech stating verbal observations containing voice data.

35. The computer as in

claim 32

wherein the process further comprises:

constructing a predefined reference grammar for said voice data to be captured;

incorporating a semantic relationship structure in said predefined reference grammar; and

using said predefined reference grammar and said semantic relationship structure to enable said voice data in at least two of said raw verbal observations to be combined automatically with said captured location data into a single record in a geographic information system database.

36. The computer as in

claim 35

wherein the process further comprises:

using a mobile unit computer for capturing both said location data and said free speech stating verbal observations containing voice data, and

transferring said captured location data and said captured voice data from said mobile unit computer to a processing computer, wherein said processing computer combines said captured voice data and said captured location data into said single record which is stored in said geographic information system database which is connectable to said processing computer.

37. An apparatus for automatically processing and managing spatial asset information, the apparatus comprising:

a processing computer for receiving a plurality of field data that has been collected; and

a data repository connectable to said processing computer for receiving processing results of said processing computer, wherein said data repository further comprises,

a plurality of reference networks;

a geographic information system having a plurality of asset layers;

a plurality of pre-defined instances of primary observation types; and

a plurality of pre-defined associations between each of said plurality of pre-defined instances of primary observation types, wherein said data repository is configured based upon said plurality of pre-defined instances of primary observation types and said plurality of pre-defined associations;

wherein said processing computer,

converts each of said plurality of field data into an appropriate one of said primary observation types;

correlates each of said converted primary observation types of each of said plurality of field data to an appropriate one of said plurality of reference networks and an appropriate one of said plurality of asset layers; and

said appropriate one of said plurality of asset layers with each of said converted primary observation types of each of said plurality of field data.

38. The apparatus defined in

claim 37

further comprising:

a mobile unit computer for collecting said plurality of field data; and

a radio frequency transmitter connectable to said mobile unit computer for transferring said collected field data to said processing computer.

39. The apparatus defined in

claim 38

wherein said mobile unit computer further comprises:

a microphone connectable to a sound board for capturing free speech stating verbal observations containing voice data; and

a global positioning satellite receiver for capturing location data contemporaneously with each of said verbal observations, wherein each of said captured verbal observations and said contemporaneously captured location data is time-stamped to create a plurality of raw verbal observations.

40. The apparatus defined in

claim 39

wherein said data repository further comprises:

a geographic information system database;

a reference grammar for interpreting captured voice data contained in said plurality of raw verbal observations, wherein said reference grammar has a semantic relationship structure for combining said captured voice data contained in at least two of said plurality of raw verbal observations; and

a data converter for using said reference grammar and said semantic relationship structure to enable said captured voice data in said at least two of said plurality of verbal observations to be combined automatically with said captured location data into a single record in said geographic information system database.

41. The apparatus defined in

claim 40

wherein said reference grammar and said semantic relationship structure are configured for a specific form for a specific application.

42. The apparatus defined in

claim 41

wherein said specific application is a street maintenance application and said reference grammar and said semantic relationship structure are configured to said specific form for use in said street maintenance application.

43. The apparatus defined in

claim 40

wherein said processing computer further comprises:

a processing computer clock used for time-stamping all records in said geographic information system database.

44. The apparatus defined in

claim 43

wherein said mobile unit computer captures a third stream of sensor data, and further wherein said processing computer clock is used to time-stamp all captured third stream of sensor data, and further wherein said data converter automatically combines specific items of sensor data into specific records having specific voice data and specific location data by using said time-stamping as a synchronizing key.

45. The apparatus defined in

claim 37

wherein said data repository further comprises:

a plurality of analysis tools automatically configured to exploit data in said data repository based on said plurality of pre-defined instances of primary observation types.