DATA TRANSFER SERVICE

• US 20150350316A1
• Filed: 05/30/2014
• Published: 12/03/2015
• Est. Priority Date: 05/30/2014
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: CALDER, BRADLEY G., EDWARDS, ANDREW JAMES, HARIDAS, JAIDEN, HENDEL, MATTHEW DOUGLAS, FAN, SHUITAO, YUAN, CHUN, OO, AUNG MAW, TARON, PHILLIP
• Granted Patent: US 9,565,250 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 11/0778 Dumping, i.e. gathering error/state information after a fault for later diagnosis
• CPC Class Codes: G06F 11/1004 to protect a block of data words, e.g. CRC or checksum G06F11/1076 takes precedence; security arrangements for protecting computers or computer systems against unauthorized activity G06F21/00
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 21/60 Protecting data
• CPC Class Codes: G06F 21/6209 to a single file or object, e.g. in a secure envelope, encrypted and accessed using a key, or with access control rules appended to the object itself
• CPC Class Codes: H04L 63/0428 wherein the data content is protected, e.g. by encrypting or encapsulating the payload
• CPC Class Codes: H04L 63/08 for authentication of entities cryptographic mechanisms or cryptographic arrangements for entity authentication H04L9/32
• CPC Class Codes: H04L 67/1095 Replication or mirroring of data, e.g. scheduling or transport for data synchronisation between network nodes

Abstract

In various embodiments, methods and systems for transferring data using a storage medium are provided. A storage medium may be shipped by a customer to a datacenter such that the data on the storage medium is copied to a storage associated with the datacenter or data in the storage is copied to the storage medium. The datacenter may support a cloud computing infrastructure that provides a storage account to the customer that is associated with the data copied from or copied to the storage medium. The storage medium further corresponds to a data transfer manifest that includes at least in part data mapping between storage service infrastructure and data in the storage medium. It is contemplated that embodiments of the present invention may further be implemented with data transfer service components that support a client component, storage service component, and a data transfer management component.

Claims

1. One or more computer storage media storing computer-useable instructions that, when executed by one or more processors, cause the one or more processors to perform a method for importing data on storage media, the method comprising:

accessing a storage medium, wherein the storage medium corresponds to a data transfer manifest, and wherein the storage medium is associated with an import job;

referencing the data transfer manifest, wherein the data transfer manifest at least provides data mapping between storage service infrastructure and data in the storage medium; and

copying data from the storage medium to the storage service infrastructure, based on the data transfer manifest.

2. The media of claim 1, wherein the data transfer manifest that corresponds to the storage medium is stored on the storage medium.

3. The media of claim 1, wherein the data transfer manifest that corresponds to the storage medium is stored in a storage service infrastructure.

4. The media of claim 1, wherein the storage medium corresponds with the data transfer manifest configured using a data transfer client component.

5. The media of claim 1, wherein the data transfer manifest further comprises a location object, wherein the location object identifies a destination location in the storage service infrastructure for data from the storage medium.

6. The media of claim 1, wherein the data transfer manifest comprises an authentication security object, wherein the authentication security object authenticates the storage medium with reference to a storage account in the storage service infrastructure.

7. The media of claim 1, wherein the storage medium is associated with an encryption security object that is communicated to the storage service infrastructure using a secure channel, wherein the encryption security object encrypts the data on the storage medium.

8. The media of claim 1, wherein a portion of the storage medium that facilitates access to the data of the storage medium is secured using a hash security object, wherein the hash security object communicated to the storage service infrastructure using a secure channel that is different from a shipment of the storage medium.

9. The media of claim 8, further comprising:

verifying the integrity of the portion of the storage medium based on the hash security object; and

upon verifying the integrity of the portion of the storage medium, providing the storage medium for data transfer processing.

10. The media of claim 1, wherein the data transfer manifest comprises a validation object, wherein the validation object facilitates verifying integrity of data copied to the storage medium such that corrupted data are identified as data error events.

11. The media of claim 1, further comprising:

generating a log object for the data, wherein the log object comprises, at least in part, a data error event associated with the data processed from the storage medium.

12. The media of claim 11, wherein the log object data provides for repairing the data associated with the data error event based on the log object, wherein the data is repaired using repair data retrieved from an identified location.

13. One or more computer storage media storing computer-useable instructions that, when executed by one or more processors, cause the one or more processors to perform a method for exporting data onto storage media, the method comprising:

accessing a storage medium, wherein the storage medium is associated with an export job, the export job corresponding to one or more data transfer objects;

copying data from a storage service infrastructure to the storage medium; and

generating a data transfer manifest based on the one or more data transfer objects and the data copied from the storage service infrastructure, the data transfer manifest corresponds to the storage medium.

14. The media of claim 13, wherein the export job is created using a data transfer client component.

15. The media of claim 13, wherein the data transfer manifest that corresponds to the storage medium is stored on the storage medium.

16. The media of claim 13, wherein the data transfer manifest that corresponds to the storage medium is stored in the storage service infrastructure.

17. The media of claim 13, wherein the one or more data transfer objects includes an authentication security object, wherein the authentication security object authenticates the storage medium with reference to a storage account in a storage service infrastructure.

18. The media of claim 13, wherein the one or more data transfer objects includes a data object, wherein the data object identifies data in the storage service infrastructure to be transferred to the storage medium.

19. The media of claim 13, wherein the data transfer manifest comprises a validation object, wherein the validation object facilitates verifying integrity of data copied to the storage medium such that corrupted data are identified as data error events.

20. The media of claim 13, further comprising:

generating a log object for the data, wherein the log object comprises, at least in part, a data error event associated with the data processed from the storage medium, wherein the log object data provides for repairing the data associated with the data error event based on the log object, wherein the data is repaired using repair data retrieved from an identified location.

21. A computer-implemented method for monitoring data transfer for storage media, the method comprising:

receiving a notification that indicates that a data transfer job has been created, wherein the data transfer job is created at least in part using a data transfer client component;

determining a progress of the data transfer job for at least one data transfer artifact, wherein the at least one data transfer artifact is associated with a logical state based on the progress of the data transfer job; and

registering the logical state of the at least one data transfer artifact.

22. The method of claim 21, wherein the at least one data transfer artifact is selected from the following:

a job;

a storage medium;

a storage medium bay;

a package;

a ticket; and

a health of the storage medium, the storage medium bay, and the ticket.

23. The method of claim 21, further comprising generating a ticket based on the progress of the data transfer job.

24. The method of claim 21, further comprising:

receiving additional information associated with the data transfer job;

determining the progress of the data transfer job based on receiving on the additional information; and

registering the logical state updated based on the progress of the data transfer job.

25. The method of claim 21, wherein the logical state is registered for a designated entity to access, wherein the designated entity includes at least one of:

a customer entity; and

a storage service administrator entity.

26. The method of claim 21, further comprising:

identifying an error event associated with a logical state for the at least one data transfer artifact; and

registering the logical state updated based on a resolution action associated with the error event.

27. A system for importing data from storage media, the system comprising:

a data transfer client component configured for;

preparing a storage medium for an import job, wherein preparing the storage medium comprises;

receiving a selection of data to be imported to a storage service infrastructure;

copying the data to the storage medium; and

generating a data transfer manifest for the storage medium; and

creating the import job using one or more data transfer objects as parameters; and

a data transfer storage service component configured for;

accessing the storage medium, wherein the storage medium corresponds to the data transfer manifest;

referencing the data transfer manifest, wherein the data transfer manifest at least provides data mapping between a storage service infrastructure and data in the storage medium; and

copying data from the storage medium to the storage service infrastructure, based on the data transfer manifest; and

generating a log object for the import job, wherein the log object comprises, at least in part, a data error event associated with the data processed from the storage medium.

28. The system of claim 27, wherein the data transfer client component is further configured for:

receiving package information for the storage medium, wherein the package information is associated with a shipment of the storage medium.

29. The system of claim 27, further comprising the data transfer storage service component configured for:

validating the data based on a validation object in the data transfer manifest, wherein the validation object comprises checksums stored for individual portions of the data;

referencing the log object for an error event associated with the data, wherein the log object comprises the error event associated with the data based on validating the data; and

repairing a portion of the data associated with the error event, wherein the data is repaired using repair data retrieved from an identified location.

30. The system of claim 27, further comprising:

the data transfer client component configured for;

securing a portion of the storage medium that facilitates access to the data of the storage medium using a hash security object; and

communicating the hash security object using a secure channel that is different from a shipment of the storage medium.

31. The system of claim 30, further comprising:

the data transfer storage service component configured for;

receiving the hash security object using the secure channel;

verifying the integrity of the portion of the storage medium based on the hash security object; and

upon verifying the integrity of the portion of the storage medium, providing the storage medium for data transfer processing.

32. A system for exporting data to storage media, the system comprising:

a data transfer client component configured for;

receiving an indication of data to be exported from a storage service infrastructure; and

creating an export job using one or more data transfer objects as parameters; and

a data transfer storage service component configured for;

accessing the storage medium associated with an export job;

copying data from the storage service infrastructure to the storage medium;

generating a log object for the export job; and

generating a data transfer manifest, based on the one or more data transfer objects and the data copied from the storage service infrastructure, the data transfer manifest corresponds to the storage medium for the storage medium.

33. The system of claim 32, wherein the data transfer client component is further configured for:

receiving package information for the storage medium, wherein the package information is associated with a shipment of the storage medium.

34. The system of claim 33, further comprising the data transfer client component configured for:

validating the data based on a validation object in the data transfer manifest, wherein the validation object comprises checksums stored for individual portions of the data;

referencing the log object for an error event associated with the data, wherein the log object comprises the error event associated with the data based on validating the data; and

repairing a portion of the data associated with the error event, wherein the data is repaired using repair data retrieved from an identified location.

35. A computer-implemented method for verifying storage media for data transfer, the method comprising:

receiving a hash security object using a secure channel, wherein the hash security object secures a portion of a storage medium that facilitates access to the data on the storage medium;

verifying the integrity of the portion of the storage medium based on the hash security object; and

upon verifying the integrity of the portion of the storage medium, providing the storage medium for data transfer processing.

36. The method of claim 35, wherein processing the storage medium further comprises:

accessing the storage medium; and

copying data from the storage medium to the storage service infrastructure.

37. The method of claim 36, wherein the storage medium corresponds to a data transfer manifest, wherein the data transfer manifest at least provides data mapping between storage service infrastructure and data in the storage medium.

38. The method of claim 35, wherein processing the storage medium further comprises:

accessing the storage medium; and

copying data from the storage medium to a customer service infrastructure.

39. The method of claim 38, wherein the storage medium is associated with an export job, the export job corresponding to one or more data transfer objects.

40. The method of claim 38, wherein the storage medium is processed via a dedicated virtual machine that is securely segregated from the storage service infrastructure.