Object file system

• US 8,849,877 B2
• Filed: 08/31/2010
• Issued: 09/30/2014
• Est. Priority Date: 08/31/2010
• Status: Active Grant

• Current Assignee: DataDirect Networks Incorporated
• Original Assignee: DataDirect Networks Incorporated
• Inventors: Olderdissen, Jan, Olster, Dan, Robertson, Craig, Schafer, Doug, Fellinger, Dave
• Primary Examiner(s): ALAM, SHAHID AL
• Application Number:
  US12/873,137
• Publication Number:
  US 20120054252A1
• Time in Patent Office: 1,491 Days
• Field of Search: 707/823, 707/826, 707/825, 709/203, 709/217, 709/230, 705/35
• US Class Current: 707/823
• CPC Class Codes: G06F 11/1076 Parity data used in redundant arrays of independent storages, e.g. in RAID systems
• CPC Class Codes: G06F 16/18 File system types
• CPC Class Codes: G06F 16/1847 specifically adapted to static storage, e.g. adapted to flash memory or SSD
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 2211/1038 LFS, i.e. Log Structured File System used in RAID systems with parity
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

An object based file system for storing and accessing objects is disclosed. The file system may be implemented as a method in hardware, firmware, software, or a combination thereof. The method may include receiving from an application program an object write request. A selected storage node on which to store the object may be selected, including identifying a least busy storage node and/or a least full storage node. The object and the object write request may be sent to the selected storage node. A write success message may be received from the selected storage node. The successful writing of the object may be reported to the application program. An object identifier and object data may be stored in a database.

Claims

1. A method for accessing objects comprising:

object access software on a server receiving from an application program an object write request, the write request including an object comprised of object data and meta data

the object access software selecting a best storage node from a plurality of storage nodes on which to store the object including identifying and evaluating among a least busy storage node, a most used storage node and a least full storage node of the plurality of storage nodes

the object access software selecting at least one additional storage node from the plurality of storage nodes on which to store the object

the object access software sending the object and the object write request to the best storage node and concurrently sending the object to the at least one additional storage node

the object access software receiving a first write success message from the best storage node, the first write success message including an object identifier, the object identifier including a version identifier, a location identifier and a unique identifier

the object access software receiving a second write success message from the additional storage node

the object access software reporting successful writing of the object to the application program

the object access software storing the object identifier and object data in a database

the object access software receiving a read request for a requested object specifying the object identifier

the object access software selecting to obtain the requested object from between at least the best storage node and the additional storage node according to criteria including a shortest path, a highest speed connection, and a least accessed.

2. The method of claim 1 wherein each storage node includes a plurality of storage media.

3. The method of claim 2 wherein each storage node runs a local file system.

4. The method of claim 2 wherein the local file system is one of a well known file system or a proprietary file system.

5. The method of claim 2 wherein the storage media are one or more selected from the group including hard disk drives, silicon storage devices and magnetic tape devices.

6. The method of claim 1 wherein the meta data includes at least one selected from the group including an object creator, object owner, access permissions, and a creation time.

7. The method of claim 1 further comprising:

recognizing the addition of a new storage node

automatically adapting to the new storage node including redistributing objects from a more full node of the plurality of storage nodes to the new storage node.

8. A storage medium having instructions stored thereon which when executed by a processor cause the processor to perform actions comprising:

receiving from an application program an object write request, the write request including an object comprised of object data and meta data

selecting a best storage node from a plurality of storage nodes on which to store the object including identifying and evaluating among a least busy storage node, a most used storage node and a least full storage node of the plurality of storage nodes

selecting at least one additional storage node from the plurality of storage nodes on which to store the object

sending the object and the object write request concurrently to the best storage node and the at least one additional storage node

receiving a first write success message from the selected storage node, the write success message including an object identifier, the object identifier including a version identifier, a location identifier and a unique identifier

receiving a second write success message from the additional storage node

reporting successful writing of the object to the application program

storing the object identifier and object data in a database

receiving a read request for a requested object specifying the object identifier

selecting to obtain the requested object from between at least the best storage node and the additional storage node according to criteria including a shortest path, a highest speed connection, and a least accessed.

9. The storage medium of claim 8 wherein each storage node includes a plurality of storage media.

10. The storage medium of claim 9 wherein each storage node runs a local file system.

11. The storage medium of claim 9 wherein the local file system is one of a well known file system or a proprietary file system.

12. The storage medium of claim 9 wherein the storage media are one or more selected from the group including hard disk drives, silicon storage devices and magnetic tape devices.

13. The storage medium of claim 8 wherein the meta data includes at least one selected from the group including an object creator, object owner, access permissions, and a creation time.

14. The storage medium of claim 8 having further instructions stored thereon which when executed by the processor cause the processor to perform further actions comprising:

recognizing the addition of a new storage node

automatically adapting to the new storage node including redistributing objects from a more full node of the plurality of storage nodes to the new storage node.

15. A computing device to manage a plurality of storage arrays of storage devices, the computing device comprising:

a processor;

a memory coupled with the processor;

a storage medium having instructions stored thereon which when executed cause the computing device to perform actions comprising;

receiving from an application program an object write request, the write request including an object comprised of object data and meta data

selecting a best storage node from a plurality of storage nodes on which to store the object including identifying and evaluating among a least busy storage node, a most used storage node and a least full storage node of the plurality of storage nodes

selecting at least one additional storage node from the plurality of storage nodes on which to store the object

sending the object and the object write request concurrently to the best storage node and the additional storage node

receiving a first write success message from the selected storage node, the write success message including an object identifier, the object identifier including a version identifier, a location identifier and a unique identifier

receiving a second write success message from the additional storage node

reporting successful writing of the object to the application program

storing the object identifier and object data in a database

receiving a read request for a requested object specifying the object identifier

selecting to obtain the requested object from between at least the best storage node and the additional storage node according to criteria including a shortest path, a highest speed connection, and a least accessed.

16. The computing device of claim 15 wherein each storage node includes a plurality of storage media.

17. The computing device of claim 16 wherein each storage node runs a local file system.

18. The computing device of claim 16 wherein the local file system is one of a well known file system or a proprietary file system.

19. The computing device of claim 16 wherein the storage media are one or more selected from the group including hard disk drives, silicon storage devices and magnetic tape devices.

20. The computing device of claim 15 wherein the meta data includes at least one selected from the group including an object creator, object owner, access permissions, and a creation time.

21. The computing device of claim 15 wherein the database is further configured to store meta data about the objects in addition to the object identifiers.

22. The computing device of claim 15 wherein the storage medium has further instructions stored thereon which when executed cause the computing device to perform further actions comprising:

recognizing the addition of a new storage node

automatically adapting to the new storage node including redistributing objects from a more full node of the plurality of storage nodes to the new storage node.