LARGE-SCALE DATA STORAGE AND DELIVERY SYSTEM

• US 20150222705A1
• Filed: 09/06/2013
• Published: 08/06/2015
• Est. Priority Date: 09/06/2012
• Status: Abandoned Application

• Current Assignee: Pi-Coral Incorporated
• Original Assignee: Pi-Coral Incorporated
• Inventors: Stephens, Donpaul C.
• Application Number:
  US14/426,567
• Publication Number:
  US 20150222705A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 12/0246 in block erasable memory, e.g. flash memory
• CPC Class Codes: G06F 12/0253 Garbage collection, i.e. reclamation of unreferenced memory
• CPC Class Codes: G06F 12/0813 with a network or matrix configuration
• CPC Class Codes: G06F 12/0868 Data transfer between cache memory and other subsystems, e.g. storage devices or host systems
• CPC Class Codes: G06F 2212/1048 Scalability
• CPC Class Codes: G06F 2212/222 Non-volatile memory
• CPC Class Codes: G06F 2212/314 In storage network, e.g. network attached cache
• CPC Class Codes: G06F 2212/7205 Cleaning, compaction, garbage collection, erase control
• CPC Class Codes: G06F 3/0611 in relation to response time
• CPC Class Codes: G06F 3/0626 Reducing size or complexity of storage systems
• CPC Class Codes: G06F 3/0658 Controller construction arrangements
• CPC Class Codes: G06F 3/0661 Format or protocol conversion arrangements
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0688 Non-volatile semiconductor memory arrays
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/568 Storing data temporarily at an intermediate stage, e.g. caching

Abstract

This described technology generally relates to a data management system configured to implement, among other things, web-scale computing services, data storage and data presentation. Web-scale computing services are the fastest growing segment of the computing technology and services industry. In general, web-scale refers to computing platforms that are reliable, transparent, scalable, secure, and cost-effective. Illustrative web-scale platforms include utility computing, on-demand infrastructure, cloud computing, Software as a Service (SaaS), and Platform as a Service (PaaS). Consumers are increasingly relying on such web-scale services, particularly cloud computing services, and enterprises are progressively migrating applications to operate through web-scale platforms.

Claims

1. A data storage array comprising:

at least one array access module operatively coupled to a plurality of computing devices, the at least one array access module being configured to;

receive data requests from the plurality of computing devices, the data requests comprising read requests and write requests,

format the data requests for transmission to a data storage system comprising a cache storage component and a persistent storage component, and

format output data in response to a data request for presentation to the plurality of computing devices; and

at least one cache lookup module operatively coupled to the at least one array access module and the persistent storage component, the at least one cache lookup module having at least a portion of the cache storage component arranged therein, wherein the at least one cache lookup module is configured to;

receive the data requests from the at least one array access module, lookup meta-data associated with the data requests in the data storage system, read output data associated with read data requests from the data storage system for transmission to the at least one array access module, and

store input data associated with the write data requests in the data storage system.

2. A data storage array comprising:

at least one access module operatively coupled to a plurality of computing devices, the at least one access module being configured to;

receive data requests from the plurality of computing devices, the data requests comprising read requests and write requests,

format the data requests for transmission to a data storage system comprising a cache storage layer and a persistent storage layer, wherein;

the cache storage layer comprises at least one cache storage component, and

the persistent storage layer comprises at least one persistent storage module, wherein the at least one persistent storage module comprises a plurality of persistent storage components; and

format output data in response to a data request for presentation to the plurality of computing devices; and

at least one cache lookup module operatively coupled to the at least one access module and the persistent storage layer, the at least one cache lookup module having at least a portion of the cache storage layer arranged therein, wherein the at least one cache lookup module is configured to;

receive the data requests from the at least one access module,

lookup meta-data associated with the data requests in the data storage system, read output data associated with read data requests from the data storage system for transmission to the at least one access module, and

store input data associated with the write data requests in the data storage system, and update and record the meta-data associated with the data requests in the data storage system.

7. The data storage array of claim 2, wherein the at least one access module comprises a processor operatively coupled to the plurality of computing devices, the processor being configured to receive the data requests from the plurality of computing devices and to format the output data for presentation to the plurality of computing devices.

8. The data storage array of claim 2, wherein the at least one access module comprises an integrated circuit operatively coupled to the processor, the integrated circuit being configured to:

receive data requests from the processor, and

format the data requests for presentation to the at least one cache lookup module.

10. The data storage array of claim 2, wherein the cache storage component comprises at least one of a dynamic random access memory module, a dual in-line memory module, and a flash memory module.

13. The data storage array of claim 2, wherein the at least one persistent storage module comprises at least one of a plurality of hard disk drives, a plurality of optical drives, a plurality of solid state drives, and at least one network-connected external storage server.

22. The data storage array of claim 2, wherein the at least one cache lookup module is further configured to read requested data from the persistent storage layer responsive to the requested data not being stored in the cache storage component.

23. The data storage array of claim 22, wherein the at least one cache lookup module is further configured to store the requested data from the persistent storage layer in the cache storage component before transmitting the requested data to the at least one access module.

24. The data storage array of claim 2, wherein the at least a portion of the plurality of persistent storage components comprise flash cards.

25. The data storage array of claim 24, wherein each of the plurality of flash cards comprises a plurality of flash chips configured to store data.

29. The data storage array of claim 2, wherein Ethernet is used for control path communications and peripheral component interconnect express is used for internal data path communications.

41. The data storage array of claim 2, wherein the plurality of persistent storage components are arranged into logical tiers according to characteristics of each of the plurality of persistent storage components.

42. The data storage array of claim 2, wherein a processor-to-processor communication channel is used for control path communication within the data storage array.

3-6. -6. (canceled)

9. (canceled)

11. (canceled)

12. (canceled)

14-21. -21. (canceled)

26-28. -28. (canceled)

30-40. -40. (canceled)

43. A method of manufacturing a data storage array, the method comprising:

providing at least one access module configured to be operatively coupled to a plurality of computing devices;

configuring the at least one access module to;

receive data requests from the plurality of computing devices, the data requests comprising read requests and write requests,

format the data requests for transmission to a data storage system comprising a cache storage layer and a persistent storage layer, wherein;

the cache storage layer comprises at least one cache storage component, and,

the persistent storage layer comprises at least one persistent storage module, wherein

the at least one persistent storage module comprises a plurality of persistent storage components; and

format output data in response to a data request for presentation to the plurality of computing devices;

providing at least one cache lookup module configured to be operatively coupled to the at least one access module and the persistent storage layer,

arranging at least a portion of the cache storage layer within the at least one cache lookup module; and

configuring the at least one cache lookup module to;

receive the data requests from the at least one access module,

lookup meta-data associated with the data requests in the data storage system,

read output data associated with read data requests from the data storage system for transmission to the at least one access module, and

store input data associated with the write data requests in the data storage system, and

update and record the meta-data associated with the data requests in the data storage system.

45. The method of claim 43, further comprising providing an integrated circuit resident within the at least one access module and operatively coupled to the processor, the integrated circuit being configured to:

receive data requests from the processor, and

format the data requests for presentation to the at least one cache lookup module.

48. The method of claim 43, further comprising configuring the cache storage component to store data using at least one of a dynamic random access memory module and a flash memory module.

51. The method of claim 43, further comprising arranging a plurality of flash cards within the persistent storage module for storing data in the persistent storage layer.

52. The method of claim 51, further comprising arranging a plurality of flash chips on the flash cards for storing data on the plurality of flash cards.

44. (canceled)

46. (canceled)

47. (canceled)

49. (canceled)

50. (canceled)

53. (canceled)

54. (canceled)

55. A method of managing access to data stored in a data storage array for a plurality of computing devices, the method comprising:

operatively coupling at least one access module to a plurality of computing devices;

receiving data requests from the plurality of computing devices at the at least one access module, the data requests comprising read requests and write requests;

formatting, by the at least one access module, the data requests for transmission to a data storage system comprising a cache storage layer and a persistent storage layer, wherein the cache storage layer comprises at least one cache storage component, and the persistent storage layer comprises at least one persistent storage module, wherein the at least one persistent storage module comprises a plurality of persistent storage components; and

formatting, by the at least one access module, output data in response to a data request for presentation to the plurality of computing devices;

operatively coupling at least one cache lookup module to the at least one access module and the persistent storage layer, the at least one cache lookup module having at least a portion of the cache storage layer arranged therein;

receiving the data requests from the at least one access module at the at least one cache lookup module;

looking up, by the at the at least one cache lookup module, meta-data associated with the data requests in the data storage system;

reading, by the at the at least one cache lookup module, output data associated with read data requests from the data storage system for transmission to the at least one access module; and

storing, by the at the at least one cache lookup module, input data associated with the write data requests in the data storage system, and

updating and recording the meta-data associated with the data requests in the data storage system.

56. The method of claim 55, wherein the at least one access module stores the input data in the cache lookup modules.

58. The method of claim 55, wherein the data storage array comprises at least 6 cache lookup modules and the at least one access module stores the input data in the at least one cache lookup module using at least one of a 4+1 parity method and a 4+2 parity method.

60. The method of claim 55, wherein the data storage array comprises at least 11 persistent storage modules and the at least one access module stores the input data in the at least one cache lookup module using at least one of a 9+2 dual parity method and an erasure code parity method.

62. The method of claim 55, wherein the data storage array applies a second parity method to the data in the cache storage components that is separate from and logically orthogonal to the parity method applied to data in the persistent data modules.

66. The method of claim 55, wherein the at least one access module formats the data requests by arranging the data requests into a fixed size logical data envelope.

67. The method of claim 66, wherein the at least one access module divides the logical data envelope for distribution to a plurality of cache lookup modules.

68. The method of claim 55, further comprising de-staging, by the at least one cache lookup module, infrequently used data from the cache storage layer to the persistent storage layer.

69. The method of claim 68, wherein the cache lookup modules are configured to de-stage based on backup power duration times.

70. The method of claim 55, further comprising evicting, by the at least one cache lookup module, unmodified and infrequently used data from the cache storage layer.

71. The method of claim 70, wherein the cache lookup modules are configured to evict based on backup power duration times.

72. The method of claim 55, further comprising configuring the at least one cache storage components to store data using at least one dual in-line memory module.

74. The method of claim 55, wherein the at least one cache lookup module stores the input data in the at least one cache storage components using a multi-way mirroring method.

75. The method of claim 55, wherein the data storage array distributes the meta-data across a number of cache lookup modules such that all incorporated access modules have symmetric access to any data stored in the data storage system.

80. The method of claim 55, further comprising interconnecting processors within the data storage array via a memory mapped region, wherein non-transparent mode address translation provides each processor with a memory region for writing.

84. The method of claim 55, wherein the at least one access module is configured to communicate with the at least one persistent storage module via the at least one cache lookup module.

85. The method of claim 55, wherein the at least one cache lookup module stores data in the persistent storage layer as single level pages under power-loss conditions, thereby improving write bandwidth and reducing power consumption of writes.

86. The method of claim 55, wherein data is stored within the data storage array according to a parity mechanism using a processor to divide a write request among a plurality of cache storage components.

87. The method of claim 55, wherein data is stored within the data storage array according to a parity mechanism using a processor to assemble a read among a plurality of cache storage components.

88. The method of claim 55, wherein peripheral component interconnect express switches are used to divide a write request among a plurality of cache storage components.

89. The method of claim 55, wherein optical data switches are used to divide a write request amongst among a plurality of cache storage components.

90. The method of claim 55, wherein peripheral component interconnect express switches are used to assemble a read request among a plurality of cache storage components.

92. The method of claim 55, further comprising configuring the at least one persistent storage module to mark pages to denote whether the data is valid, overwritten, or freed in its entirety.

57. (canceled)

59. (canceled)

61. (canceled)

63-65. -65. (canceled)

73. (canceled)

76-79. -79. (canceled)

81-83. -83. (canceled)

91. (canceled)

93. (canceled)

94. (canceled)