Method and apparatus for providing a key-value based storage interface

• US 8,700,683 B2
• Filed: 10/24/2011
• Issued: 04/15/2014
• Est. Priority Date: 10/24/2011
• Status: Active Grant

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Corporation
• Inventors: Cooney, Geoffrey Thomas, McCracken, Kenneth D., Pan, Zane Zheng Yan, Yang, Fujian
• Primary Examiner(s): LE, UYEN T
• Application Number:
  US13/280,144
• Publication Number:
  US 20130103729A1
• Time in Patent Office: 904 Days
• Field of Search: None
• US Class Current: 707/812
• CPC Class Codes: G06F 16/168 Details of user interfaces specifically adapted to file systems, e.g. browsing and visualisation, 2d or 3d GUIs query results presentation G06F16/156
• CPC Class Codes: G06F 16/188 Virtual file systems
• CPC Class Codes: G06F 16/24568 Data stream processing; Continuous queries
• CPC Class Codes: G06F 16/252 between a Database Management System and a front-end application

Abstract

An approach is provided for implementing a virtual file system using a key-value-based storage interface. A key-value directory framework determines one or more files stored in at least one stream-based file store. The key-value directory framework causes, at least in part, a grouping of the one or more files into at least one key-value directory. The key-value directory includes, at least in part, one or more key-value pairs of a distributed key-value store. The key-value directory framework also causes, at least in part, a storage of (a) at least one identifier of the one or more files, the at least one key-value directory, or a combination thereof as one or more keys of the one or more key-value pairs; (b) block-based access information associated with the one or more files as one or more values of the key-value pairs; and (c) a locking mechanism to facilitate coordination of threads across multiple hosts.

Claims

1. A method comprising facilitating a processing of and/or processing (1) data and/or (2) information and/or (3) at least one signal, the (1) data and/or (2) information and/or (3) at least one signal based, at least in part, on the following:

one or more files stored in at least one stream-based file store;

a grouping of the one or more files into at least one key-value directory, wherein the key-value directory includes, at least in part, one or more key-value pairs of a distributed key-value store; and

a storage of (a) at least one identifier of the one or more files, the at least one key-value directory, or a combination thereof as one or more keys of the one or more key-value pairs; and

(b) block-based access information associated with the one or more files as one or more values of the key-value pairs.

2. A method of claim 1, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

a processing of a request specifying one or more operations acting on the one or more files to identify at the one or more keys in the key-value directory corresponding to the one or more files; and

a processing of the block-based access information associated with the identified one or more keys to determine one or more pointers to the one or more files, to one or more locations within the one or more files, or combination thereof in the at least one stream-based file store for performing the one or more operations.

3. A method of claim 2, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

a locking of the one or more files, the one or more locations, or a combination thereof associated with the one or more pointers,

wherein the locking is for at least a duration of a predetermined time period, for performing the one or more operations, or a combination thereof.

4. A method of claim 3, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

a transmission of a heartbeat signal to maintain the lock.

5. A method of claim 2, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

at least one determination that the one or more files, the one or more locations, or a combination thereof associated with the one or more pointers are in a locked state; and

at least one determination to delay the one or more operations, to verify the locking, to override the locking, or a combination thereof.

6. A method of claim 5, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

at least one determination of whether to delay, the one or more operations, to verify the locking, to override the locking, or a combination thereof based, at least in part, on metadata associated with the locking,

wherein the metadata includes, at least in part, timestamp information, priority information, or a combination thereof.

7. A method of claim 1, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

a concatenation of one or more names associated with the one or more files, the at least one key-value directory, the at least one stream-based file store, or a combination to generate the at least one identifier.

8. A method of claim 1, wherein the (1) data and/or (2) information and/or (3) at least one signal are further based, at least in part, on the following:

metadata associated with the one or more files; and

a storage of the metadata in the one or more values of the key-value pairs associated with the one or more keys.

9. A method of claim 8, wherein the metadata includes, at least in part, filename information, update information, owner information, access rights information, or a combination thereof.

10. A method of claim 1, wherein the at least one key-value directory includes one or more subordinate key-value directories.

11. An apparatus comprising:

at least one processor; and

at least one memory including computer program code for one or more programs,

the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to perform at least the following,

determine one or more files stored in at least one stream-based file store;

cause, at least in part, a grouping of the one or more files into at least one key-value directory, wherein the key-value directory includes, at least in part, one or more key-value pairs of a distributed key-value store; and

cause, at least in part, a storage of (a) at least one identifier of the one or more files, the at least one key-value directory, or a combination thereof as one or more keys of the one or more key-value pairs; and

(b) block-based access information associated with the one or more files as one or more values of the key-value pairs.

12. An apparatus of claim 11, wherein the apparatus is further caused to:

process and/or facilitate a processing of a request specifying one or more operations acting on the one or more files to identify at the one or more keys in the key-value directory corresponding to the one or more files; and

process and/or facilitate a processing of the block-based access information associated with the identified one or more keys to determine one or more pointers to the one or more files, to one or more locations within the one or more files, or combination thereof in the at least one stream-based file store for performing the one or more operations.

13. An apparatus of claim 12, wherein the apparatus is further caused to:

cause, at least in part, a locking of the one or more files, the one or more locations, or a combination thereof associated with the one or more pointers,

wherein the locking is for at least a duration of a predetermined time period, for performing the one or more operations, or a combination thereof.

14. An apparatus of claim 13, wherein the apparatus is further caused to:

cause, at least in part, a transmission of a heartbeat signal to maintain the lock.

15. An apparatus of claim 12, wherein the apparatus is further caused to:

determine that the one or more files, the one or more locations, or a combination thereof associated with the one or more pointers are in a locked state; and

determine to delay the one or more operations, to verify the locking, to override the locking, or a combination thereof.

16. An apparatus of claim 15, wherein the apparatus is further caused to:

determine whether to delay, the one or more operations, to verify the locking, to override the locking, or a combination thereof based, at least in part, on metadata associated with the locking,

wherein the metadata includes, at least in part, timestamp information, priority information, or a combination thereof.

17. An apparatus of claim 11, wherein the apparatus is further caused to:

cause, at least in part, a concatenation of one or more names associated with the one or more files, the at least one key-value directory, the at least one stream-based file store, or a combination to generate the at least one identifier.

18. An apparatus of claim 11, wherein the apparatus is further caused to:

determine metadata associated with the one or more files; and

cause, at least in part, a storage of the metadata in the one or more values of the key-value pairs associated with the one or more keys.

19. An apparatus of claim 18, wherein the metadata includes, at least in part, filename information, update information, owner information, access rights information, or a combination thereof.

20. An apparatus of claim 11, wherein the at least one key-value directory includes one or more subordinate key-value directories.