Serving geospatially organized flat file data

• US 7,818,325 B1
• Filed: 05/17/2007
• Issued: 10/19/2010
• Est. Priority Date: 10/10/2001
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Ohazama, Chikai J., Keslin, Phillip C., Aubin, Mark A.
• Primary Examiner(s): Trujillo; James
• Assistant Examiner(s): Spieler; William
• Application Number:
  US11/750,282
• Time in Patent Office: 1,251 Days
• Field of Search: 707/743, 707/754, 707/756, 707/787, 707/796, 707/797, 707/809, 707/919, 707/921
• US Class Current: 707/743
• CPC Class Codes: G06F 16/29 Geographical information databases
• CPC Class Codes: G06F 21/60 Protecting data
• CPC Class Codes: G06F 21/6218 to a system of files or objects, e.g. local or distributed file system or database
• CPC Class Codes: Y10S 707/919 Geographic
• CPC Class Codes: Y10S 707/921 Spatial
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing
• CPC Class Codes: Y10S 707/99954 Version management

Abstract

A flat file data organization technique is used for storing and retrieving geospatially organized data. The invention reduces transfer time by transferring a few large files in lieu of a large number of small files. It also moves the process of locating a given data file away from the file system to a proprietary code base. Additionally, the invention simplifies database management by having quadtree packets generated on demand.

Claims

1. A system for providing geospatially organized flat file data comprising:

a customer input module, for receiving geospatial data;

a data migration tool, coupled to the input module, for converting the geospatial data to a flat file database format, the flat file database format comprising a data section containing spatially indexed data packets, each data packet containing geospatial data associated with a quadnode of a quadtree index which is stored in a format wherein no regeneration is required to traverse the quadtree index;

a storage device, for storing the converted data in the flat file database format; and

a stream server, for receiving the converted data and delivering the converted data to a client.

2. The system of claim 1, wherein the stream server delivers the converted data to the client via an Internet data transport mechanism.

3. The system of claim 1, wherein the stream server delivers the converted data to the client via Internet data protocols.

4. The system of claim 1, wherein the stream server delivers the converted data to the client in response to direct access requests from the client.

5. The system of claim 1, wherein:

the storage device stores a plurality of local databases, each comprising data in the flat file database format; and

the stream server comprises a database merge utility, for merging at least two of the local databases.

6. The system of claim 1, further comprising:

a plurality of remote databases, each comprising data in the flat file database format;

wherein the stream server merges at least two of the remote databases.

7. The system of claim 1, further comprising:

a plurality of remote databases, each comprising data in the flat file database format;

wherein;

the storage device stores a plurality of local databases, each comprising data in the flat file database format; and

the stream server merges at least two of the remote and local databases.

8. The system of claim 1, further comprising:

an authentication server, coupled to the stream server, for distributing session keys to registered users.

9. The system of claim 8, wherein the authentication server authenticates the session keys.

10. The system of claim 8, wherein each session key comprises an expiration time, and wherein the stream server checks the expiration times of the session keys before delivering the converted data to a client.

11. The system of claim 8, wherein each session key comprises a package identifier granting access to a portion of the geospatial data.

12. The system of claim 1, wherein the stream server selectively restricts access to the converted data.

13. The system of claim 1, wherein the stream server selectively restricts database access resolution.

14. The system of claim 1, wherein the stream server selectively restricts database access channels.

15. The system of claim 1, wherein the stream server is integrated with a billing/administration system.

16. The system of claim 1, wherein the stream server performs user authentication before delivering the converted data to the client.

17. The system of claim 1, wherein the stream server delivers the converted data to the client in response to successful authentication of a user.

18. The system of claim 1, wherein the stream server performs user authentication and delivers the converted data to the client in response to successful user authentication.

19. A method for providing geospatially organized flat file data comprising:

receiving geospatial data;

converting the geospatial data to a flat file database format, the flat file database format comprising a data section containing spatially indexed data packets, each data packet containing geospatial data associated with a quadnode of a quadtree index which is stored in a format wherein no regeneration is required to traverse the quadtree index;

storing the converted data in the flat file database format in a storage device accessible by a server; and

delivering by the server the converted data to a client.

20. The method of claim 19, wherein delivering the converted data to the client comprises delivering the converted data via an Internet data transport mechanism.

21. The method of claim 19, wherein delivering the converted data to the client comprises delivering the converted data via Internet data protocols.

22. The method of claim 19, wherein delivering the converted data to the client comprises delivering the converted data in response to direct access requests from the client.

23. The method of claim 19, wherein:

storing the converted data comprises storing the converted data in a plurality of local databases, each comprising data in the flat file database format;

the method further comprising;

merging at least two of the local databases.

24. The method of claim 19, wherein:

storing the converted data comprises storing the converted data in a plurality of remote databases, each comprising data in the flat file database format;

the method further comprising;

merging at least two of the remote databases.

25. The method of claim 19, wherein:

storing the converted data comprises storing the converted data in a plurality of local and remote databases, each comprising data in the flat file database format;

the method further comprising;

merging at least two of the local and remote databases.

26. The method of claim 19, further comprising distributing session keys to registered users.

27. The method of claim 26, further comprising authenticating the session keys.

28. The method of claim 26, wherein each session key comprises an expiration time, further comprising checking the expiration times of the session keys before delivering the converted data to a client.

29. The method of claim 26, wherein each session key comprises a package identifier granting access to a portion of the geospatial data.

30. The method of claim 19, further comprising selectively restricting access to the converted data.

31. The method of claim 19, further comprising selectively restricting database access resolution.

32. The method of claim 19, further comprising selectively restricting database access channels.

33. The method of claim 19, further comprising performing user authentication before delivering the converted data to the client.

34. The method of claim 19, wherein delivering the converted data to the client comprises delivering the converted data in response to successful authentication of a user.

35. The method of claim 19, further comprising performing user authentication, and wherein delivering the converted data to the client comprises delivering the converted data in response to successful user authentication.

36. A computer program product for providing geospatially organized flat file data comprising:

a computer-readable storage medium; and

computer program code, encoded on the medium, for;

receiving geospatial data;

converting the geospatial data to a flat file database format, the flat file database format comprising a data section containing spatially indexed data packets, each data packet containing geospatial data associated with a quadnode of a quadtree index which is stored in a format wherein no regeneration is required to traverse the quadtree index;

storing the converted data in the flat file database format; and

delivering the converted data to a client.

37. The computer program product of claim 36, wherein the computer program code for delivering the converted data to the client comprises computer program code for delivering the converted data via an Internet data transport mechanism.

38. The computer program product of claim 36, wherein the computer program code for delivering the converted data to the client comprises computer program code for delivering the converted data via Internet data protocols.

39. The computer program product of claim 36, wherein the computer program code for delivering the converted data to the client comprises computer program code for delivering the converted data in response to direct access requests from the client.

40. The computer program product of claim 36, wherein:

the computer program code for storing the converted data comprises computer program code for storing the converted data in a plurality of local databases, each comprising data in the flat file database format;

the computer program product further comprising;

computer program code, encoded on the medium, for merging at least two of the local databases.

41. The computer program product of claim 36, wherein:

the computer program code for storing the converted data comprises computer program code for storing the converted data in a plurality of remote databases, each comprising data in the flat file database format;

the computer program product further comprising;

computer program code, encoded on the medium, for merging at least two of the remote databases.

42. The computer program product of claim 36, wherein:

the computer program code for storing the converted data comprises computer program code for storing the converted data in a plurality of local and remote databases, each comprising data in the flat file database format;

the computer program product further comprising;

computer program code, encoded on the medium, for merging at least two of the local and remote databases.

43. The computer program product of claim 36, further comprising computer program code, encoded on the medium, for distributing session keys to registered users.

44. The computer program product of claim 43, further comprising computer program code, encoded on the medium, for authenticating the session keys.

45. The computer program product of claim 43, wherein each session key comprises an expiration time, the computer program product further comprising computer program code, encoded on the medium, for checking the expiration times of the session keys before delivering the converted data to a client.

46. The computer program product of claim 43, wherein each session key comprises a package identifier granting access to a portion of the geospatial data.

47. The computer program product of claim 36, further comprising computer program code, encoded on the medium, for selectively restricting access to the converted data.

48. The computer program product of claim 36, further comprising computer program code, encoded on the medium, for selectively restricting database access resolution.

49. The computer program product of claim 36, further comprising computer program code, encoded on the medium, for selectively restricting database access channels.

50. The computer program product of claim 36, further comprising computer program code, encoded on the medium, for performing user authentication before delivering the converted data to the client.

51. The computer program product of claim 36, wherein the computer program code for delivering the converted data to the client comprises computer program code for delivering the converted data in response to successful authentication of a user.

52. The computer program product of claim 36, further comprising computer program code, encoded on the medium, for performing user authentication, and wherein the computer program code for delivering the converted data to the client comprises computer program code for delivering the converted data in response to successful user authentication.

53. A method of migrating geospatial data into a database having a flat file database format, the method comprising:

accessing by a computer a list of data items;

for each data item in the list, receiving the data item and adding the received data item to a quadtree structure having a plurality of nodes which is stored in a format wherein no regeneration is required to traverse the quadtree structure; and

for each node in the quadtree structure;

retrieving data items associated with the node;

creating a data packet for the retrieved data items; and

storing by a computer the data packet in the database having the flat file database format.

54. A system for migrating geospatial data into a database having a flat file database format, the system comprising:

a storage device, for storing a list of data items;

a database update module, coupled to the storage device, for;

for each data item in the list, obtaining the data item from the storage device and adding the data item to a quadtree structure having a plurality of nodes which is stored in a format wherein no regeneration is required to traverse the quadtree structure; and

for each node in the quadtree structure;

retrieving data items associated with the node;

creating a data packet for the retrieved data items; and

storing the data packet in the database having the flat file database format.

55. A computer program product for migrating geospatial data into a database having a flat file database format, the computer program product comprising:

a computer-readable storage medium; and

computer program code, encoded on the medium, for;

accessing a list of data items;

for each data item in the list, receiving the data item and adding the received data item to a quadtree structure having a plurality of nodes which is stored in a format wherein no regeneration is required to traverse the quadtree structure; and

for each node in the quadtree structure;

retrieving data items associated with the node;

creating a data packet for the retrieved data items; and

storing the data packet in the database having the flat file database format.