Methods for managing ownership of redundant data

• US 8,768,946 B2
• Filed: 05/30/2012
• Issued: 07/01/2014
• Est. Priority Date: 09/29/2010
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Jaquette, Glen A.
• Primary Examiner(s): Perveen, Rehana
• Assistant Examiner(s): BUI, THUY T
• Application Number:
  US13/484,157
• Publication Number:
  US 20120239691A1
• Time in Patent Office: 762 Days
• Field of Search: 707/758, 707/661, 707/781
• US Class Current: 707/758
• CPC Class Codes: G06F 16/2228 Indexing structures
• CPC Class Codes: G06F 16/24 Querying
• CPC Class Codes: H04N 21/2181 comprising remotely distributed storage units, e.g. when movies are replicated over a plurality of video servers distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS], H04L67/1097
• CPC Class Codes: H04N 21/23116 involving data replication, e.g. over plural servers synchronization of replicated data G06F11/1658; error detection or correction by means of data replication G06F11/2053; replication in distributed file systems G06F16/10; replication in distributed file systems G06F16/27; replication or mirroring of data in data networks H04L67/1095

Abstract

According to one embodiment, a method includes storing instances of a file in a first storage tier and a second storage tier of a storage system; associating each instance of the file on the first and second storage tier with a unique program identifier (UPI); receiving a request to access the file or instance thereof from a user in a group of users; searching for a UPI associated with an instance of the file that exists on the first storage tier; and providing the user requesting access to the file with remote access to the instance of the file on the first storage tier. Additional methods are also presented.

Claims

1. A method, comprising:

storing instances of a file in a first storage tier and a second storage tier of a storage system;

associating each instance of the file on the first and second storage tier with a unique program identifier (UPI), wherein multiple instances which include a common collection of data are associated with a common UPI;

receiving a request to access the file or instance thereof from a user in a group of users;

searching for a UPI associated with an instance of the file that exists on the first storage tier; and

providing the user requesting access to the file with remote access to the instance of the file on the first storage tier, wherein providing the user with remote access to the instance of the file on the first storage tier includes providing the remote access only when the instance of the file that exists on the first storage tier is not being used by any other user in the group of users.

2. The method as recited in claim 1, wherein the file and instances thereof include video data recorded from a broadcast.

3. The method as recited in claim 1, further comprising setting a UPI associated with an instance of the file to null or marked as modified if data in the instance of the file is manipulated in any way.

4. The method as recited in claim 1, wherein the second storage tier uses less expensive and/or slower-to-access storage media than the first storage tier.

5. The method as recited in claim 1, wherein the instance of the file that exists on the first storage tier is associated with a second user in the group of users and is not being accessed by the second user, and further comprising:

setting an ownership status of the instance of the file on the first storage tier to owned by the user requesting access to the file; and

setting an ownership status of an unused instance of the file on the second storage tier from owned by the user requesting access to the file to owned by the second user.

6. The method as recited in claim 5, further comprising:

associating each user in the group of users with a unique user identifier and storing the association in a first index;

associating each instance of the file on the storage system with a unique user in the group of users via the unique user identifiers and storing the association in a second index; and

associating each instance of the file on the storage system to one usage status related to usage of the instance of the file and storing the association in a third index.

7. A method, comprising:

storing instances of a file in a first storage tier and a second storage tier of a storage system;

associating each instance of the file on the first and second storage tier with a unique program identifier (UPI);

receiving a request to access the file or instance thereof from a first user in a group of users;

searching for a UPI associated with an instance of the file that exists on the first storage tier in response to the request;

when the instance of the file found by the searching and that exists on the first storage tier is associated with a second user in the group of users and is not being accessed by the second user;

setting an ownership status of the instance of the file on the first storage tier to owned by the first user; and

setting an ownership status of an unused instance of the file on the second storage tier from owned by the first user to owned by the second user;

providing the first user with remote access to the instance of the file on the first storage tier;

determining when to migrate the instance of the file owned by the user requesting access from the first storage tier to the second storage tier;

searching for an instance of the file or portion thereof on the second storage tier that is not owned by any user;

setting an ownership status of the instance of the file or portion thereof on the second storage tier with the user requesting access;

disassociating the instance of the file on the first storage tier from the first user;

associating each user in the group of users with a unique user identifier and storing the association in a first index;

associating each instance of the file on the storage system with a unique user in the group of users via the unique user identifiers and storing the association in a second index; and

associating each instance of the file on the storage system to one usage status related to usage of the instance of the file and storing the association in a third index.

8. The method as recited in claim 7, wherein the file and instances thereof include video data from a broadcast.

9. The method as recited in claim 7, further comprising setting a UPI associated with an instance of the file to null or marked as modified if data in the instance of the file is manipulated in any way.

10. The method as recited in claim 7, wherein the second storage tier uses less expensive and/or slower-to-access storage media than the first storage tier.

11. The method as recited in claim 7, wherein multiple instances which include a common collection of data are associated with a common UPI.

12. A method, comprising:

storing instances of a file in a first storage tier and a second storage tier of a storage system;

associating each instance of the file on the first and second storage tier with a unique program identifier (UPI), wherein multiple instances which include a common collection of data are associated with a common UPI;

receiving a request to access the file or instance thereof from a user in a group of users;

searching for a UPI associated with an instance of the file that exists on the first storage tier;

providing the user requesting access to the file with remote access to the instance of the file on the first storage tier;

selecting which of a plurality of instances of the file in the first storage tier are to be migrated to the second storage tier; and

copying the selected instance of the file from the first storage tier or an intermediate storage tier to the second storage tier for creating multiple instances of the file on the second storage tier thereby creating a unique instance of the file on the second storage tier for each instance of the file on the first storage tier that is to be migrated to the second storage tier, wherein the logic for determining includes determining which instances of the file on the first storage tier have not been accessed by any user associated therewith for a predetermined period of time.

13. A storage system, comprising:

a first storage tier;

a second storage tier, wherein the second storage tier uses less expensive and/or slower-to-access storage media than the first storage tier;

logic for storing instances of a file in the first storage tier and the second storage tier;

logic for associating each instance of the file on the first and second storage tier with a unique program identifier (UPI), wherein multiple instances which include a common collection of data are associated with a common UPI;

logic for receiving a request to access the file or instance thereof from a user in a group of users;

logic for searching for a UPI associated with an instance of the file that exists on the first storage tier; and

logic for providing the user requesting access to the file with remote access to the instance of the file on the first storage tier.

14. The storage system as recited in claim 13, wherein the file and instances thereof include video data recorded from a broadcast.

15. The storage system as recited in claim 13, wherein the logic for providing the user with remote access to the instance of the file on the first storage tier is configured to provide the remote access only when the instance of the file that exists on the first storage tier is not being used by any other user in the group of users.

16. The storage system as recited in claim 13, wherein the instance of the file that exists on the first storage tier is associated with a second user in the group of users and is not being accessed by the second user, and further comprising:

logic for setting an ownership status of the instance of the file on the first storage tier to owned by the user requesting access to the file; and

logic for setting an ownership status of an unused instance of the file on the second storage tier from owned by the user requesting access to the file to owned by the second user.

17. The storage system as recited in claim 16, further comprising:

logic for associating each user in the group of users with a unique user identifier and storing the association in a first index;

logic for associating each instance of the file on the storage system with a unique user in the group of users via the unique user identifiers and storing the association in a second index; and

logic for associating each instance of the file on the storage system to one usage status related to usage of the instance of the file and storing the association in a third index.

18. The storage system as recited in claim 16, further comprising:

logic for determining when to migrate the instance of the file owned by the user requesting access from the first storage tier to the second storage tier;

logic for searching for an instance of the file or portion thereof on the second storage tier that is not owned by any user;

logic for setting an ownership status of the instance of the file or portion thereof on the second storage tier with the user requesting access; and

logic for disassociating the instance of the tile on the first storage tier from the first user.

19. The storage system as recited in claim 13, wherein the first storage tier includes at least one random access storage medium, and wherein the second storage tier includes at least one sequential access storage medium.

20. The storage system as recited in claim 13, wherein the UPI is protected by a file system of the storage system such that any manipulation of data in an instance of the file associated with the UPI causes the UPI to be set to a null value or marked as modified.

21. The storage system as recited in claim 13, further comprising logic for storing the association of the UPI to each instance of the file in an index.

22. The storage system as recited in claim 13, further comprising logic for storing the UPI to metadata associated with each instance of the file.

23. The storage system as recited in claim 13, further comprising:

logic for determining when to migrate an instance of the file associated with a first user and stored on the first storage tier to the second storage tier;

logic for searching for an instance of the file or portion thereof on the second storage tier that is not associated with any user;

logic for associating the instance of the file or portion thereof on the second storage tier with the first user; and

logic for disassociating the instance of the file on the first storage tier from the first user.

24. The storage system as recited in claim 13, further comprising:

logic for selecting which of a plurality of instances of the file in the first storage tier are to be migrated to the second storage tier;

logic for copying the selected instance of the file from the first storage tier or an intermediate storage tier to the second storage tier for creating multiple instances of the file on the second storage tier thereby creating a unique instance of the file on the second storage tier for each instance of the file on the first storage tier that is to be migrated to the second storage tier, wherein the logic for determining includes determining which instances of the file on the first storage tier have not been accessed by any user associated therewith for a predetermined period of time.

25. A storage system, comprising:

a first storage tier;

a second storage tier;

logic for storing instances of a file in the first storage tier and the second storage tier;

logic for associating each instance of the file on the first and second storage tier with a unique program identifier (UPI);

logic for receiving a request to access the file or instance thereof from a first user in a group of users;

logic for searching for a UPI associated with an instance of the file that exists on the first storage tier;

logic for setting an ownership status of the instance of the file on the first storage tier to owned by the first user when the instance of the file that exists on the first storage tier is associated with a second user in the group of users and is not being accessed by the second user;

logic for setting an ownership status of an unused instance of the file on the second storage tier from owned by the first user to owned by the second user when the instance of the file that exists on the first storage tier is associated with the second user in the group of users and is not being accessed by the second user; and

logic for providing the first user with remote access to the instance of the file on the first storage tier.

26. The storage system as recited in claim 25, wherein any instance of the file is capable of being owned by no more than one user at a time.

27. The storage system as recited in claim 25, wherein the instance of the file that exists on the first storage tier is not being used by any other user in the group of users.

28. The storage system as recited in claim 25, wherein the first storage tier includes at least one random access storage medium, and wherein the second storage tier includes at least one sequential access storage medium.

29. The storage system as recited in claim 25, wherein the UPI is protected by a file system of the storage system such that any manipulation of data in an instance of the file associated with the UPI causes the UPI to be set to a null value or marked as modified.

30. The storage system as recited in claim 25, wherein multiple instances which are associated to a common UPI include a common collection of data.

31. The storage system as recited in claim 25, further comprising logic for storing the association of the UPI to each instance of the file in an index.

32. The storage system as recited in claim 25, further comprising logic for storing the UPI to metadata associated with each instance of the file.

33. The storage system as recited in claim 25, further comprising:

logic for determining when to migrate the instance of the file owned by the user requesting access from the first storage tier to the second storage tier;

logic for searching for an instance of the file or portion thereof on the second storage tier that is not owned by any user;

logic for setting an ownership status of the instance of the tile or portion thereof on the second storage tier with the user requesting access; and

logic for disassociating the instance of the file on the first storage tier from the first user.

34. The storage system as recited in claim 33, further comprising:

logic for associating each user in the group of users with a unique user identifier and storing the association in a first index;

logic for associating each instance of the file on the storage system with a unique user in the group of users via the unique user identifiers and storing the association in a second index; and

logic for associating each instance of the file on the storage system to one usage status related to usage of the instance of the file and storing the association in a third index.

35. The storage system as recited in claim 25, further comprising:

logic for selecting which of a plurality of instances of the file in the first storage tier are to be migrated to the second storage tier;

logic for copying the selected instance of the file from the first storage tier or an intermediate storage tier to the second storage tier for creating multiple instances of the file on the second storage tier thereby creating a unique instance of the file on the second storage tier for each instance of the file on the first storage tier that is to be migrated to the second storage tier, wherein the logic for determining includes determining which instances of the file on the first storage tier have not been accessed by any user associated therewith for a predetermined period of time.

36. A computer program product for managing a storage system, the computer program product comprising:

a non-transitory computer readable storage medium having computer readable program code embodied therewith, the computer readable program code comprising;

computer readable program code configured to store instances of a file in a first storage tier and a second storage tier of a storage system;

computer readable program code configured to associate each instance of the file on the first and second storage tier with a unique program identifier (UPI);

computer readable program code configured to receive a request to access the file or instance thereof from a first user in a group of users;

computer readable program code configured to search for a UPI associated with an instance of the file that exists on the first storage tier;

computer readable program code configured to set an ownership status of the instance of the file on the first storage tier to owned by the first user when the instance of the file that exists on the first storage tier is associated with a second user in the group of users and is not being accessed by the second user;

computer readable program code configured to set an ownership status of an unused instance of the file on the second storage tier from owned by the first user to owned by the second user when the instance of the file that exists on the first storage tier is associated with the second user in the group of users and is not being accessed by the second user; and

computer readable program code configured to provide the first user with remote access to the instance of the file on the first storage tier.

37. The computer program product as recited in claim 36, further comprising computer readable program code configured to set a UPI associated with an instance of the file to null if data in the instance of the file is manipulated in any way.