Systems, methods and devices for integrating end-host and network resources in distributed memory

• US 9,390,055 B2
• Filed: 05/09/2013
• Issued: 07/12/2016
• Est. Priority Date: 07/17/2012
• Status: Active Grant

• Current Assignee: Open Invention Network LLC
• Original Assignee: Coho Data, Inc.
• Inventors: Cully, Brendan Anthony, Jamieson, Kevin, Deegan, Timothy John, Clark, Christopher, Fraser, Keir, Guyader, Jean Maurice Guy, Meyer, Dutch, Stodden, Daniel, Wires, Jacob Taylor, Lefebvre, Geoffrey, Warfield, Andrew
• Primary Examiner(s): Chan, Wing F
• Assistant Examiner(s): MANIWANG, JOSEPH R
• Application Number:
  US13/890,850
• Publication Number:
  US 20140025770A1
• Time in Patent Office: 1,160 Days
• Field of Search: 709/213, 709/214, 709/216
• US Class Current: 1/1
• CPC Class Codes: G06F 15/17331 Distributed shared memory [DSM], e.g. remote direct memory access [RDMA]
• CPC Class Codes: G06F 16/134 Distributed indices
• CPC Class Codes: G06F 16/183 Provision of network file services by network file servers, e.g. by using NFS, CIFS network file access protocols H04L67/1097
• CPC Class Codes: G06F 16/25 Integrating or interfacing systems involving database management systems
• CPC Class Codes: G06F 16/256 in federated or virtual databases
• CPC Class Codes: G06F 2009/45595 Network integration; Enabling network access in virtual machine instances
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects
• CPC Class Codes: H04L 2101/686 using dual-stack hosts, e.g. in Internet protocol version 4 [IPv4]/Internet protocol version 6 [IPv6] networks
• CPC Class Codes: H04L 41/12 Discovery or management of network topologies
• CPC Class Codes: H04L 45/74 Address processing for routing
• CPC Class Codes: H04L 61/103 across network layers, e.g. resolution of network layer into physical layer addresses or address resolution protocol [ARP]
• CPC Class Codes: H04L 61/5007 Internet protocol [IP] addresses
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

Systems, methods and devices for distributed memory management comprising a network component configured for network communication with one or more memory resources that store data and one or more consumer devices that use data, the network component comprising a switching device in operative communication with a mapping resource, wherein the mapping resource is configured to associate mappings between data addresses associated with memory requests from a consumer device relating to a data object and information relating to a storage location in the one or more memory resources associated with the data from the data object, wherein each data address has contained therein identification information for identifying the data from the data object associated with that data address; and the switching device is configured to route memory requests based on the mappings.

Claims

1. A network switching interface for a distributed digital data storage system, said network switching interface comprising:

a plurality of network interface ports for interfacing, over a digital network, a plurality of digital data storage devices for storing data and one or more client devices that send memory requests, each of said memory requests relating to a portion of said data and comprising a data address associated with the distributed digital data system, wherein said data address comprises therein embedded information that identifies one or more characteristics of said portion;

a physical mapping database, comprising a data address index in accessible memory storage for associating each said data address with a given digital data storage device communicatively connected to the network interface ports; and

a switching device that routes a given memory request to a given digital data storage device associated in the data address index with the given data address of said given memory request;

wherein said data is redistributed amongst at least one of said plurality of digital data storage devices based on said one or more characteristics;

wherein at least one of said plurality of digital data storage devices sends unsolicited data address resolution commands for updating the data address index upon said redistribution of any of the data.

2. The network switching interface of claim 1, wherein the embedded information in the data address identifies one or more characteristics of said portion of data based on an encoding convention.

3. The network switching interface of claim 2, wherein the embedded information is embedded in the data address in accordance with an embedding convention.

4. The network switching interface of claim 1, wherein the data address is an IP address.

5. The network switching interface of claim 4, wherein the IP address is selected from one of the following group:

an IPv4 and IPv6 address.

6. The network switching interface of claim 1, wherein the data address is an Ethernet address.

7. The network switching interface of claim 1, wherein the physical mapping database is further configured to dynamically generate mappings between data addresses and information relating to storage locations in the plurality of digital data storage devices.

8. The network switching interface of claim 7, wherein the generation of mappings is in accordance with a routing methodology.

9. The network switching interface of claim 8, wherein the routing methodology is based on one of the following:

a prefix of the data address, a portion of the data address, a static mapping, striping, hash function, round-robin assignment, assessment of operational characteristics, and a combination thereof.

10. The network switching interface of claim 7, wherein the network switching interface is further configured to:

receive information relating to characteristics relating to;

one or more of the digital data storage devices, the network, the data object, the client devices, a user of the client device, or a combination thereof;

in response to the information relating to the characteristics, redistribute one or more portions of the data to different storage locations in accordance with one or more pre-existing storage objectives based on the one or more characteristics of the one or more portions.

11. The network switching interface of claim 10, wherein the one or more pre-existing storage objectives include at least one of the following:

maintaining memory request latency below a pre-determined threshold, replication, maintaining a pre-determined level of redundancy, maintaining consistency between replicas, and maintaining secure access.

12. The network switching interface of claim 1, wherein the network switching device, if there is no association in the data address index related to the given portion of data, routes the given memory request related to said given portion of data in accordance with a pre-existing address resolution protocol to one of the following:

a port of the network component, a network segment, one of the digital data storage devices, and a storage location in one of the memory resources.

13. The network switching interface of claim 12, wherein the pre-existing address resolution protocol is ARP.

14. The network switching interface of claim 1, wherein at least one of the unsolicited data address resolution commands is sent in accordance with ARP.

15. The network switching interface of claim 1, wherein the one or more characteristics comprises at least one of:

a position of said portion in the data and an identifier of the data.

16. The network switching interface of claim 1, wherein the one or more characteristics comprises at least one of:

an operational characteristic of the data, a user of the data, a use of the data, and a type of the data.

17. A distributed digital data system for storing and accessing data, said system comprising:

a network switching interface comprising a plurality of network interface ports for interfacing, via network communication, a plurality of digital data storage devices for storing said data and one or more client devices that send memory requests relating to said data, the network switching interface further comprising a physical mapping database, wherein the physical mapping database comprises a data address index stored in accessible physical memory for associating data and addresses with information relating to a storage location on the one or more digital data storage devices;

at least one client device comprising a client data processor and a stored set of instructions that, when executed;

associate a given data address from a range of data addresses associated with said distributed digital data storage system with a given portion of data, wherein said given data address comprises therein embedded information identifying one or more characteristics of said given portion of said data; and

send memory requests relating to said given portion of the data with the given data address associated therewith; and

at least one digital data storage device, said at least one digital data storage device comprising a memory resource processor, for string said portion of the data in storage locations in accordance with the corresponding associations in the data address index, wherein said data is redistributed amongst at least one of said at least one digital data storage devices based on said one or more characteristics of said given portion, and wherein said at least one digital data storage device sends unsolicited data address resolution commands for updating the data address index upon said redistribution of any of the data.

18. The distributed digital data system of claim 17, wherein the information relating to a storage location comprises information identifying at least one of:

a location on a storage medium in a digital data storage device, a storage medium in a digital data storage device, a digital data storage device, and a group of digital data storage devices.

19. The distributed digital data system of claim 18, wherein the group of digital storage devices is accessed via a common network interface port.

20. The distributed digital data system of claim 17, wherein the at least one digital data storage device is configured to associate memory requests with storage locations according to the embedded information in the given data address.

21. The distributed digital data system of claim 17, wherein at least one of the unsolicited data address resolution commands is sent in accordance with ARP.

22. The distributed digital data system of claim 17, wherein the one or more characteristics include at least one of:

a position of said portion in the data and an identifier of the data.

23. The distributed digital data system of claim 17, wherein the one or more characteristics include at least one of:

an operational characteristic of the data, a user of the data, a use of the data, and a type of the data.

24. A method for using and storing data across distributed digital data storage devices over a network, the method comprising the steps:

generating for a portion of data a data address from a range of addresses associated with the distributed digital memory resources, the data address comprising therein embedded information that identifies one or more characteristics of said portion;

sending memory requests relating to the portion of data over the digital network to a digital network switching interface using said data address, said digital network switching interface comprising a physical mapping database and plurality of network interface ports, said physical mapping database comprising access to a data address index stored on accessible physical memory;

receiving the memory request at the digital network switching interface and checking to see if the data address has been associated in the data address index with information relating to a storage location in the distributed digital data storage devices communicatively coupled to the digital network switching interface; and

forwarding the memory request to the storage location associated with the data address in the data address index, if the data address is associated with information relating to a storage location in the data address index, else forwarding the memory request to the distributed digital data storage devices in accordance with a data routing methodology;

wherein said data is redistributed amongst at least one of said digital data storage devices based on said one or more characteristics; and

wherein at least one of the digital data storage devices sends unsolicited data address resolution commands for updating the data address index upon said redistribution of any of the data.

25. The method of claim 24, further comprising the steps:

receiving data system information relating to characteristics relating to one of the following;

the digital data storage devices, the digital network, the data, the client devices, and users of the client devices;

in response to the data system information, redistributing at least some of the portions of the data to different storage locations in accordance with one or more pre-existing storage objectives based on the one or more characteristics of the one or more portions.

26. The method of claim 24, wherein the data routing methodology is based on one of:

a prefix of the data address, a portion of the data address, a static mapping, striping, a hash function, round-robin assignment, assessment of operational characteristics, or a combination thereof.

27. The method of claim 24, wherein at least one of the unsolicited data address resolution commands is sent in accordance with ARP.

28. The method of claim 24, wherein the one or more characteristics include at least one of the following:

a position of said portion in the data and an identifier of the data.

29. The method of claim 24, wherein the one or more characteristics include at least one of the following:

an operational characteristic of the data, a user of the data, a use of the data, and a type of the data.