ARCHIVAL DATA IDENTIFICATION

• US 20160085797A1
• Filed: 12/07/2015
• Published: 03/24/2016
• Est. Priority Date: 08/08/2012
• Status: Abandoned Application

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Patiejunas, Kestutis, Donlan, Bryan J., Lazier, Colin L., Sorenson, James Christopher III, Seigle, Mark C., Claiborn, Christian L.
• Application Number:
  US14/961,742
• Publication Number:
  US 20160085797A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/113 Details of archiving lifecycle management in storage systems G06F3/0649; backup systems G06F11/1446
• CPC Class Codes: G06F 16/2365 Ensuring data consistency and integrity
• CPC Class Codes: G06F 16/907 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 21/606 by securing the transmission between two devices or processes
• CPC Class Codes: G06F 21/6209 to a single file or object, e.g. in a secure envelope, encrypted and accessed using a key, or with access control rules appended to the object itself
• CPC Class Codes: G06F 21/6218 to a system of files or objects, e.g. local or distributed file system or database
• CPC Class Codes: H04L 63/08 for authentication of entities cryptographic mechanisms or cryptographic arrangements for entity authentication H04L9/32
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

A request to retrieve a persistently stored data object is received, the request including a data object identifier that encodes at least storage location information and validation information related to the data object. The data object is retrieved using at least the storage location information to form a retrieved data object, and validation is performed using at least the validation information.

Claims

1. A computer-implemented method, comprising:

under the control of one or more computer systems that execute instructions,

receiving a request to retrieve a persistently stored data object, the request including a data object identifier, the data object identifier encoding at least storage location information and validation information related to the data object;

retrieving the data object using at least the storage location information to form a retrieved data object; and

performing validation using at least the validation information.

2. The computer-implemented method of claim 1, the storage location information encodes at least a volume identifier and an object identifier, the volume identifier indicating a volume at which the data object is stored and the object identifier usable for identifying a location within the volume at which the data object is stored.

3. The computer-implemented method of claim 1, wherein:

the validation information includes at least policy information; and

performing validation includes determining, based at least in part on at least the policy information, whether access to the data object is permitted.

4. The computer-implemented method of claim 1, wherein:

the validation information includes at least payload validation information; and

performing the validation includes validating integrity of the retrieved data object using at least the payload validation information.

5. The computer-implemented method of claim 4, wherein the payload validation information includes at least a cryptographic hash of at least a portion of the data object.

6. The computer-implemented method of claim 1, wherein:

the validation information includes at least metadata validation information; and

performing validation includes verifying integrity of the data object identifier using at least the metadata validation information.

7. The computer-implemented method of claim 6, wherein the metadata validation information includes at least an error-detection code.

8. The computer-implemented method of claim 1, wherein retrieving the data object includes:

decrypting, using a cryptographic key, at least a portion of the data object identifier to form a decoded data object identifier; and

extracting at least the storage location information from the decoded data object identifier.

9. A system, comprising:

one or more processors; and

memory including instructions executable by the one or more processors to cause a computer system to at least;

provide one or more application programming interfaces for performing a plurality of data operations;

receive, through the one or more application programming interfaces, a request to retrieve a data object, the request including a data object identifier, the data object identifier encapsulating at least storage location information and validation information related to the data object;

de-encapsulate the data object identifier to obtain the storage location information and the validation information;

validate the request based at least in part on the validation information;

retrieve the data object based at least in part on the storage location information; and

verify integrity of the data object using at least the validation information.

10. The system of claim 9, wherein the storage location information encapsulated in the data object identifier enables the system to retrieve the data object without accessing a data structure that maps the data object to a storage location.

11. The system of claim 9, wherein the plurality of data operations include data storage, data retrieval, data deletion, and metadata query.

12. The system of claim 9, wherein the instructions that cause the computer system to de-encapsulate the data object identifier includes instructions that cause the computer system to decrypt at least a portion of the data object identifier using a cryptographic key.

13. The system of claim 9, wherein the instructions executable by the one or more processors further cause the computer system to:

receive, through the application programming interface, one or more requests to store the data object, each of the one or more requests specifying at least a portion of the data object;

store the data object; and

provide, through the application programming interface, the data object identifier.

14. The system of claim 13, wherein at least some of the validation information is based at least in part on the one or more requests to store the data objects.

15. The system of claim 13, wherein the data object identifier is associated with the portions of the data object collectively specified by the one or more requests.

16. A non-transitory computer-readable storage medium having stored thereon executable instructions that, as a result of being executed by one or more processors of a computer system of a computing resource service provider, cause the computer system to at least:

receive a request to retrieve a persistently stored data object, the request including a data object identifier, the data object identifier encoding at least storage location information and validation information related to the data object;

validate the request using at least the validation information;

retrieve a plurality of data components using at least the storage location information, the plurality of data components being generated by causing application of one or more encoding schemes to the data object;

restore the data object at least by causing application of one or more decoding schemes corresponding to the one or more encoding schemes to the plurality of data components; and

verify integrity of the data object using at least the validation information.

17. The non-transitory computer-readable storage medium of claim 16, wherein the data object identifier encodes user-provided information.

18. The non-transitory computer-readable storage medium of claim 16, wherein the data object identifier is generated in response to a request to store the data object.

19. The non-transitory computer-readable storage medium of claim 16, wherein the executable instructions that cause the computer system to restore the data object further cause the computer system to combine one or more data parts resulting from the application of the one or more decoding schemes corresponding to the one or more encoding schemes to the plurality of data components.

20. The non-transitory computer-readable storage medium of claim 16, wherein the executable instructions that cause the computer system to restore the data object further include executable instructions that cause the computer system to combine one or more data parts that are retrievable based at least in part on the data object identifier.

21. The non-transitory computer-readable storage medium of claim 16, wherein the validation information includes payload validation information for verifying integrity of the data object, data authorization information for verifying data access rights associated with the data object, and metadata validation information for verifying integrity of information included in the data object identifier.

22. The non-transitory computer-readable storage medium of claim 16, wherein the executable instructions include executable instructions that further cause the computer system to:

receive a request to delete the data object, the request specifying the data object identifier;

validate the request using at least the validation information;

locate the data object using at least the storage location information; and

delete the data object.