Multi-tier storage environment with burst buffer middleware appliance for batch messaging
First Claim
1. A multi-tier storage system, comprising:
- at least first and second storage tiers comprising storage for storing data; and
at least one burst buffer appliance comprising a high-speed memory having a substantially lower access time than at least one of said first and second storage tiers, wherein said at least one burst buffer appliance further comprises an abstract storage interface comprising a software interface module that communicates with at least one persistent storage device in at least one of said first and second storage tiers, wherein said at least one persistent storage device provides a list application programming interface (API) that processes multiple input-output operations as a single function, wherein said software interface module of said at least one burst buffer appliance provides a batch operation that aggregates a plurality of individual input-output operations to said at least one persistent storage device using a single aggregated message, wherein at least one argument of said batch operation comprises an array having a plurality of elements, where each of said individual input-output operations corresponds to one element of said array, wherein said batch operation aggregates a plurality of metadata operations and wherein said batch operation processes metadata from said metadata operations using one or more key-value operations that process at least one key-value metadata element.
7 Assignments
0 Petitions
Accused Products
Abstract
A multi-tier storage system is provided that employs a burst buffer middleware appliance for batch messaging. An exemplary multi-tier storage system comprises at least first and second storage tiers comprising storage for storing data; and at least one burst buffer appliance, wherein the at least one burst buffer appliance comprises an abstract storage interface comprising a software interface module that communicates with at least one persistent storage device in at least one of the first and second storage tiers, wherein the at least one persistent storage device provides a list application programming interface, wherein the software interface module provides a batch operation comprised of a plurality of individual operations to the at least one persistent storage device using an aggregated message. The batch operation optionally comprises a batch operation for processing metadata. A burst buffer appliance is also provided for implementing the batch messaging techniques described herein.
5 Citations
20 Claims
-
1. A multi-tier storage system, comprising:
-
at least first and second storage tiers comprising storage for storing data; and at least one burst buffer appliance comprising a high-speed memory having a substantially lower access time than at least one of said first and second storage tiers, wherein said at least one burst buffer appliance further comprises an abstract storage interface comprising a software interface module that communicates with at least one persistent storage device in at least one of said first and second storage tiers, wherein said at least one persistent storage device provides a list application programming interface (API) that processes multiple input-output operations as a single function, wherein said software interface module of said at least one burst buffer appliance provides a batch operation that aggregates a plurality of individual input-output operations to said at least one persistent storage device using a single aggregated message, wherein at least one argument of said batch operation comprises an array having a plurality of elements, where each of said individual input-output operations corresponds to one element of said array, wherein said batch operation aggregates a plurality of metadata operations and wherein said batch operation processes metadata from said metadata operations using one or more key-value operations that process at least one key-value metadata element. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A burst buffer appliance for use in a multi-tier storage system comprising at least first and second storage tiers comprising storage for storing data, said burst buffer appliance comprising:
-
a high-speed memory having a substantially lower access time than at least one of said first and second storage tiers; and at least one hardware device configured to provide an abstract storage interface comprising a software interface module that communicates with at least one persistent storage device in said multi-tier storage system providing a list application programming interface (API)) that processes multiple input-output operations as a single function, wherein said software interface module of said at least one burst buffer appliance provides a batch operation that aggregates a plurality of individual input-output operations to said at least one persistent storage device using a single aggregated message, wherein at least one argument of said batch operation comprises an array having a plurality of elements, where each of said individual input-output operations corresponds to one element of said array, wherein said batch operation aggregates a plurality of metadata operations and wherein said batch operation processes metadata from said metadata operations using one or more key-value operations that process at least one key-value metadata element. - View Dependent Claims (9, 10, 11, 12, 13)
-
-
14. A method performed by a burst buffer appliance in a multi-tier storage system comprising at least first and second storage tiers comprising storage for storing data, wherein the first storage tier comprises a high-speed memory having a substantially lower access time than the second storage tier, comprising:
-
providing, by said burst buffer appliance, an abstract storage interface comprising a software interface module that communicates with at least one persistent storage device in said multi-tier storage system providing a list application programming interface (API) that processes multiple input-output operations as a single function, wherein said burst buffer appliance comprises a high-speed memory having a substantially lower access time than at least one of said first and second storage tiers; obtaining a batch operation that aggregates a plurality of individual input-output operations; and providing, by said software interface module of said at least one burst buffer appliance, said batch operation to said at least one persistent storage device using a single aggregated message, wherein at least one argument of said batch operation comprises an array having a plurality of elements, where each of said individual input-output operations corresponds to one element of said array, wherein said batch operation aggregates a plurality of metadata operations and wherein said batch operation processes metadata from said metadata operations using one or more key-value operations that process at least one key-value metadata element. - View Dependent Claims (15, 16, 17, 18, 19, 20)
-
Specification