DEDUPLICATION IN NETWORK STORAGE WITH DATA RESIDENCE COMPLIANCE

• US 20130036100A1
• Filed: 08/02/2011
• Published: 02/07/2013
• Est. Priority Date: 08/02/2011
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Nagpal, Abhinay R., Patil, Sandeep R., Sivakumar, Gandhi, Whitehead, Carolyn A.
• Granted Patent: US 8,447,732 B2
• Time in Patent Office: Days
• US Class Current: 707/692
• CPC Class Codes: G06F 16/1748 De-duplication implemented within the file system, e.g. based on file segments de-duplication techniques in storage systems for the management of data blocks G06F3/0641

Abstract

Deduplication in a network storage environment includes, for files stored in a network, determining a location constraint status specified by a compliance agreement for each of the files. Location constraint statuses include a location of persistent residency and no residency restriction. Deduplication also includes selecting a file from the files in the network and identifying corresponding redundant files, the selected file and the corresponding redundant files representing a set. Deduplication further includes determining the location constraint status for each of the files in the set. For the files in the set having a location constraint status specifying a location of persistent residency, the deduplication includes retaining a master copy at the respective location of persistent residency, and removing the corresponding redundant files from the network.

Claims

1. A method for deduplication in a network storage environment, comprising:

for files distributively stored across a network spanning multiple geographic regions, determining via a computer processor, a location constraint status specified by a compliance agreement for each of the files, wherein location constraint statuses include a geographic location of persistent residency and no geographic residency restriction;

selecting a file from the files in the network and identifying corresponding redundant files, the selected file and the corresponding redundant files representing a set;

determining the location constraints status for each of the files in the set; and

for the files in the set having a location constraint status specifying a geographic location of persistent residency, retaining via the computer processor, a master copy at the respective geographic location of persistent residency, and removing the corresponding redundant files from the network.

2. The method of claim 1, wherein removing the corresponding redundant files from the network includes removing redundant files stored in the same geographic location as the master copy.

3. The method of claim 1, further comprising:

assigning the location constraint status to each of the files stored in the network.

4. The method of claim 3, wherein the geographic location of persistent residency is provided by a file owner.

5. The method of claim 3, wherein the geographic location of the persistence residency is specified by a government agency.

6. The method of claim 1, wherein the location constraint status is assigned via a table having a user identification representing one of a file owner and a government agency with respect to the master copy, and a file name.

7. The method of claim 1, wherein the location constraint status is assigned by examining contents of the file for a confidentiality indicator.

8. A system for deduplication in a network storage environment, comprising:

a computer processor; and

deduplication logic executable by the computer processor, the deduplication logic configured to implement a method, the method comprising;

for files distributively stored across a network spanning multiple geographic regions, determining a location constraint status specified by a compliance agreement for each of the files, wherein location constraint statuses include a geographic location of persistent residency and no geographic residency restriction;

selecting a file from the files in the network and identifying corresponding redundant files, the selected file and the corresponding redundant files representing a set;

determining the location constraints status for each of the files in the set; and

for the files in the set having a location constraint status specifying a geographic location of persistent residency, retaining a master copy at the respective geographic location of persistent residency, and removing the corresponding redundant files from the network.

9. The system of claim 8, wherein removing the corresponding redundant files from the network includes removing redundant files stored in the same geographic location as the master copy.

10. The system of claim 8, wherein the deduplication logic is further configured to implement:

assigning the location constraint status to each of the files stored in the network.

11. The system of claim 10, wherein the geographic location of persistent residency is provided by a file owner.

12. The system of claim 10, wherein the geographic location of the persistence residency is specified by a government agency.

13. The system of claim 8, wherein the location constraint status is assigned via a table having a user identification representing one of a file owner and a government agency with respect to the master copy, and a file name.

14. The system of claim 8, wherein the location constraint status is assigned by examining contents of the file for a confidentiality indicator.

15. A computer program product for deduplication in a network storage environment, the computer program product comprising a storage medium having program instructions embodied thereon, which when executed by a computer, cause the computer to implement a method, the method comprising:

for files distributively stored across a network spanning multiple geographic regions, determining a location constraint status specified by a compliance agreement for each of the files, wherein location constraint statuses include a geographic location of persistent residency and no geographic residency restriction;

selecting a file from the files in the network and identifying corresponding redundant files, the selected file and the corresponding redundant files representing a set;

determining the location constraints status for each of the files in the set; and

for the files in the set having a location constraint status specifying a geographic location of persistent residency, retaining a master copy at the respective geographic location of persistent residency, and removing the corresponding redundant files from the network.

16. The computer program product of claim 15, wherein removing the corresponding redundant files from the network includes removing redundant files stored in the same geographic location as the master copy.

17. The computer program product of claim 15, further comprising program instructions for:

assigning the location constraint status to each of the files stored in the network.

18. The computer program product of claim 17, wherein the geographic location of persistent residency is provided by a file owner.

19. The computer program product of claim 17, wherein the geographic location of the persistence residency is specified by a government agency.

20. The computer program product of claim 15, wherein the location constraint status is assigned via a table having a user identification representing one of a file owner and a government agency with respect to the master copy, and a file name.

21. The computer program product of claim 15, wherein the location constraint status is assigned by examining contents of the file for a confidentiality indicator.