Method, system, and apparatus for enterprise wide storage and retrieval of large amounts of data

• US 8,819,163 B2
• Filed: 12/07/2011
• Issued: 08/26/2014
• Est. Priority Date: 12/08/2010
• Status: Active Grant

• Current Assignee: YottaStor, LLC
• Original Assignee: YottaStor, LLC
• Inventors: Carlson, Robert John
• Primary Examiner(s): Ibrahim, Mohamed
• Application Number:
  US13/313,509
• Publication Number:
  US 20120151049A1
• Time in Patent Office: 993 Days
• Field of Search: None
• US Class Current: 709/213
• CPC Class Codes: G06F 16/2471 Distributed queries
• CPC Class Codes: H04L 67/1042 using topology management mechanisms
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

A scalable network of mobile data storage containers that are connected in peer-to-peer networks to archive large data storage capacities. The various embodiments provide a method of extracting a large amount of data from a variety of sources and storing the extracted data in mobile, storage units. The various embodiments provide storage units housed in mobile containers that can store multiple days/weeks of sensor data in the order of petabytes (1024 terabytes). The various embodiments, integrate high performance computing devices into the mobile storage containers that are able to perform critical extraction, pattern, and index processing on the sensor data. The various embodiments, provide a method for the efficient physical transport of the mobile storage containers from current locations to a center analysis location for re-connecting in another peer-to-peer network for integration into a central enterprise data warehouses.

Claims

1. A method for collecting, storing, and analyzing information, comprising:

provisioning a first mobile data storage unit at a first location, the provisioning comprising installation of analysis software;

transporting the first mobile data storage unit to an area of operations at a second location;

connecting the first mobile data storage unit with one or more mobile data storage units in a peer-to-peer network;

collecting information in the area of operations;

transmitting the collected information to the first mobile data storage unit within the area of operations;

sorting and storing the transmitted information in the first mobile data storage unit;

wherein the analysis software allows the first mobile data storage unit to be identified to the mobile data storage units in the peer-to-peer network and allows the first mobile data storage unit and the plurality of mobile data storage units to have access to information in the other mobile data storage units in the peer-to-peer network;

disconnecting the first mobile data storage unit from the peer-to-peer network;

transporting the first mobile data storage unit to a third location wherein a second peer-to-peer network is located;

re-provisioning the first mobile data storage unit with updates to the provisioned software;

authenticating the rights of the first mobile data storage unit to be present on the second peer-to-peer network;

wherein the re-provisioned software allows the mobile data storage units in the second peer-to-peer network to become aware of the presence of the first mobile data storage unit and to have access tagged information in the other mobile storage units in the second peer-to-peer network.

2. The method of claim 1, wherein sorting the information further comprises tagging the information with metadata.

3. The method of claim 1 wherein the analysis software further comprises instruction for self-replication of information stored on the newly arrived mobile data storage unit.

4. The method of claim 1 wherein the analysis software further comprises instruction for establishing a unique namespace for the newly arrived mobile data storage unit.

5. The method of claim 1 wherein the analysis software further comprises instruction for conducting searches across all mobile data storage units in the peer-to-peer network.

6. The method of claim 1 wherein the analysis software further comprises instruction for installation of a unique namespace for all mobile data storage units in the peer-to-peer network.

7. The method of claim 1 wherein the analysis software further comprises instructions for providing authentication information to the peer-to-peer network before the newly arrived mobile storage unit is activated on the peer-to-peer network.

8. A system for collecting, storing, and analyzing information, comprising:

a processor operable to execute an analysis software stored on a non-transitory computer readable medium;

a first mobile data storage unit provisioned at a first location, the provisioning comprising installation of the analysis software; and

a plurality of mobile data storage units connected with the first data storage units in a first peer-to-peer network;

wherein the first mobile data storage unit is transported to an area of operations at a second location;

the analysis software allows the first mobile data storage unit to be identified to the plurality of mobile data storage units in the peer-to-peer network and allows the first mobile data storage unit and the plurality of mobile data storage units to have access to information in the other mobile data storage units in the peer-to-peer network;

information collected in the area of operations is transmitted to the first mobile data storage unit; and

the transmitted information is sorted and stored in the first mobile data storage unit;

the first mobile data storage unit is disconnected from the first peer-to-peer network;

the first mobile data storage unit is transported to a third location wherein a second

peer-to-peer network is located;

the first mobile data storage unit is re-provisioned with updates to the analysis software;

the first mobile data storage unit is authenticated to be present on the second peer-to-peer network;

and wherein the re-provisioned software allows the mobile data storage units in the second peer-to-peer network to become aware of the newly added mobile data storage unit and to have access to information in the mobile storage units in the second peer-to-peer network.

9. The system of claim 8, wherein sorting the information further comprises tagging the information with metadata.

10. The system of claim 8 wherein the analysis software further comprises instruction for self-replication of information stored on the first mobile data storage unit.

11. The system of claim 8 wherein the analysis software further comprises instruction for establishing a unique namespace for the first mobile data storage unit.

12. The system of claim 8 wherein the analysis software further comprises instruction for conducting searches across the mobile data storage units in the peer-to-peer network.

13. The system of claim 8 wherein the analysis software further comprises instruction for installation of a unique namespace for the mobile data storage units in the peer-to-peer network.

14. The system of claim 8 wherein the analysis software further comprises instructions for providing authentication information to the first peer-to-peer network before first storage unit is activated on the first peer-to-peer network.