METHODS AND APPARATUSES FOR STORING SHARED DATA FILES IN DISTRIBUTED FILE SYSTEMS

• US 20130007091A1
• Filed: 07/01/2011
• Published: 01/03/2013
• Est. Priority Date: 07/01/2011
• Status: Abandoned Application

• Current Assignee: Yahoo Holdings, Inc. (Verizon Communications Inc.)
• Original Assignee: Yahoo! Inc. (Apollo Global Management, Inc.)
• Inventors: Rao, Sriram, Silberstein, Adam, Sears, Russell, Abouzeid, Azza
• Application Number:
  US13/175,782
• Publication Number:
  US 20130007091A1
• Time in Patent Office: Days
• US Class Current: 709/201
• CPC Class Codes: G06F 16/184 implemented as replicated file system

Abstract

Various methods and apparatuses are provided which may be implemented using one or more computing devices within a networked computing environment to support a computing grid having selective storage of shared data files within certain distributed the systems provided by dusters of computing devices. The selective storage may represent limited duplicative storage of a shared file.

Claims

1. A method comprising, with at least one computing device:

determining that a data the is a shared data the with regard to a plurality of distributed data file systems within a computing grid, wherein each of said plurality of distributed file systems is provided via a corresponding cluster of computing nodes; and

in response to a determination that a number of said plurality of distributed file systems satisfies a first threshold number, initiating transmission of one or more electrical signals to initiate limited storage of said shared data file in only a portion of said plurality of distributed data file systems.

2. The method as recited in claim 1, further comprising, with said at least one computing device:

in response to a determination that said shared data file stored in one of said portion of said plurality of distributed data file systems is either unavailable or is needed in another one of said plurality of distributed data file systems, initiating transmission of one or more additional electrical signals to initiate further storage of said shared data file in said another one of said plurality of distributed data file systems.

3. The method as recited in claim 1, further comprising, with said at least one computing device:

in response to a determination that at least a portion of said shared data file stored in one of said portion of said plurality of distributed data file systems is unavailable, initiating transmission of one or more additional electrical signals to initiate restoration of said storage of at least said portion of said shared data file in said one of said portion of said plurality of distributed data file systems.

4. The method as recited in claim 1, :

herein said portion of said plurality of distributed data file systems comprises at least a second threshold number of said plurality of distributed data file systems, said second threshold number being greater than two and less than said first threshold number.

5. The method as recited in claim 4, further comprising, with said at least one computing device:

maintaining said number of said portion of said plurality of distributed data file systems equal to said second threshold number by selectively initiating transmission of one or more additional electrical signals to either initiate removal of said shared data file, from one or more of said portion of said plurality of distributed data file systems or storage of said shared data the in one or more of said plurality of distributed data the systems.

6. The method as recited in claim 4, wherein said second threshold number is based, at least in part, on at least one of:

at least one the attribute associated with said shared data file, or at least one system attribute associated with at least one of said plurality of distributed data file systems.

7. The method as recited in claim 1, wherein at least a portion of said shared data the comprises a read-only data file.

8. The method as recited in claim 1, wherein at least a portion of said shared data file is redundantly stored in at least one of said portion of said plurality of distributed data file systems using two or more of said computing nodes in said corresponding duster of computing nodes.

9. An apparatus comprising:

a network interface; and

at least one processing unit to;

determine that a data file is a shared data file with regard to a plurality of distributed data file systems, each of said plurality of distributed file systems being provided via a corresponding duster of computing nodes;

determine a number of said plurality of distributed file systems; and

in response to a determination that said number of said plurality of distributed file systems satisfies a first threshold number, initiate transmission of one or more electrical signals via said network interface indicative that said shared data file is to be stored in only a portion of said plurality of distributed data file systems.

10. The apparatus as recited in claim 9, wherein said portion of said plurality of distributed data file systems comprises at least a second threshold number of said plurality of distributed data file systems, said second threshold number being greater than two and less than said first threshold number, and said at least one processing unit to further:

maintain said number of said portion of said plurality of distributed data file systems equal to said second threshold number by selectively initiating transmission of one or more additional electrical signals via said network interface indicative that either said shared data file be removed from one or more of said portion of said plurality of distributed data file systems;

or that said shared data file be stored in one or more of said plurality of distributed data file systems.

11. The apparatus as recited in claim 10, wherein said second threshold number is based, at least in part, on at least one of:

at least one file attribute associated with said shared data file, or at least one system attribute associated with at least one of said plurality of distributed data file systems.

12. The apparatus as recited in claim 9, said at least one processing unit to further:

in response to a determination that said shared data file stored in one of said portion of said plurality of distributed data file systems is either unavailable or is needed in another one of said plurality of distributed data file systems, initiate transmission of one or more additional electrical signals via said network interface indicative that said shared data file be stored in said another one of said plurality of distributed data file systems.

13. The apparatus as recited in claim 9, said at least one processing unit to further:

in response to a determination that at least a portion of said shared data file stored in one of said portion of said plurality of distributed data file systems is unavailable, initiate transmission of one or more additional electrical signals via said network interface indicative that at least said portion of said shared data file be restored in said one of said portion of said plurality of distributed data file systems.

14. The apparatus as recited in claim 9, wherein at least a portion of said shared data file comprises a read-only data file.

15. The apparatus as recited in claim 9, wherein said at least one processing unit is provided at a proxy computing node of a computing grid comprising said plurality of distributed file systems.

16. An article comprising;

a non-tangible computer-readable medium having stored therein computer-implementable instructions executable by at least one processing unit to;

determine that a data file is a shared data file with regard to a plurality of distributed data file systems, each of said plurality of distributed file systems being provided via a corresponding cluster of computing nodes;

determine a number of said plurality of distributed file systems; and

in response to a determination that said number of said plurality of distributed file systems satisfies a first threshold number, initiate transmission of one or more electrical signals via a network interface indicative that said shared data file is to be stored in only a portion of said plurality of distributed data file systems.

17. The article as recited in claim 16, wherein said portion of said plurality of distributed data the systems comprises at least a second threshold number of said plurality of distributed data the systems, said second threshold number being greater than two and less than said first threshold number, and said computer-implementable instructions being further executable by said at least one processing unit to:

maintain said number of said portion of said plurality of distributed data file systems equal to said second threshold number by selectively initiating transmission of one or more additional electrical signals via said network interface indicative that either said shared data file be removed from one or more of said portion of said plurality of distributed data file systems;

or that said shared data file be stored in one or more of said plurality of distributed data file systems.

18. The article as recited in claim 16, said computer-implementable instructions being further executable by said at least one processing unit to:

in response to a determination that said shared data file stared in one of said portion of said plurality of distributed data file systems is either unavailable or is needed in another one of said plurality of distributed data file systems, initiate transmission of one or more additional electrical signals via said network interface indicative that said shared data file be stored in said another one of said plurality of distributed data file systems.

19. The article as recited in claim 16, said computer-implementable instructions being further executable by said at least one processing unit to:

in response to a determination that at least a portion of said shared data file stored in one of said portion of said plurality of distributed data file systems is unavailable, initiate transmission of one or more additional electrical signals via said network interface indicative that at least said portion of said shared data file be restored in said one of said portion of said plurality of distributed data file systems.

20. The article as recited in claim 16, wherein said at least one processing unit is provided at a proxy computing node of a computing grid comprising said plurality of distributed file systems.