Storage scheme for a distributed storage system

• US 10,620,871 B1
• Filed: 11/15/2018
• Issued: 04/14/2020
• Est. Priority Date: 11/15/2018
• Status: Active Grant

• Current Assignee: Robin Systems, Inc. (Rakuten Group, Inc.)
• Original Assignee: Robin Systems, Inc. (Rakuten Group, Inc.)
• Inventors: Mukku, Jagadish Kumar, Narasimha Subban, Kallur Vasudeva Rao
• Primary Examiner(s): Thai, Tuan V
• Application Number:
  US16/192,471
• Time in Patent Office: 516 Days
• CPC Class Codes: G06F 16/185 Hierarchical storage management [HSM] systems, e.g. file migration or policies thereof details of archiving G06F16/11
• CPC Class Codes: G06F 3/0604 Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/0631 by allocating resources to storage systems
• CPC Class Codes: G06F 3/0644 Management of space entities, e.g. partitions, extents, pools
• CPC Class Codes: G06F 3/065 Replication mechanisms
• CPC Class Codes: G06F 3/0659 Command handling arrangements, e.g. command buffers, queues, command scheduling
• CPC Class Codes: G06F 3/0662 Virtualisation aspects
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 9/455 Emulation; Interpretation; Software simulation, e.g. virtualisation or emulation of application or operating system execution engines
• CPC Class Codes: H04L 41/0897 by horizontal or vertical scaling of resources, or by migrating entities, e.g. virtual resources or entities
• CPC Class Codes: H04L 41/122 of virtualised topologies, e.g. software-defined networks [SDN] or network function virtualisation [NFV]
• CPC Class Codes: H04L 41/5058 Service discovery by the service manager
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]

Abstract

An application executing on a first computing platform includes containers executing role instances. One or more logical storage volumes include segments allocated to the application and references in a mapping table. The mapping table indicates a tier ID corresponding to the computing platform on which each segment is located. A snapshot of the application may be restored on a second computing platform. The mapping table may be copied to the second computing platform and used without transferring segments from the first computing platform to the second computing platform. Reads will be routed to the first computing platform using the tier ID in the mapping table.

Claims

1. A method comprising:

executing a first instance of an application on a first tier of a plurality of tiers, each tier of the plurality of tiers including computing resources and storage resources, the computing resources of the first tier executing the first instance of the application;

maintaining, by module executed by one of the plurality of tiers, a mapping table that maps segments of a logical volume written to by the first instance of the application to a tier of the plurality of tiers, a first portion of the segments of the logical volume being stored in the storage resources of the first tier and the mapping table being stored in the storage resources of the first tier;

accessing, by the application, the segments of the logical volume using the mapping table;

instantiating a second instance of the application on a second tier of the plurality of tiers that is different from the first tier;

transferring the mapping table from the storage resources of the first tier to the storage resources of the second tier;

commencing executing of the second instance of the application effective to access the segments of the logical volume, including the first portion of the segments, using the mapping table without first copying the first portion of the segments to the storage resources of the second tier.

2. The method of claim 1, wherein executing the first instance of the application in the first tier comprises executing instances of a plurality of roles of the first instance in containers executing on the computing resources of the first tier.

3. The method of claim 2, wherein the computing resources of the first tier comprise a plurality of computing devices.

4. The method of claim 3, wherein the storage resources of the first tier comprise storage devices mounted to the plurality of computing devices.

5. The method of claim 4, wherein the second tier is a cloud computing platform, the computing resources of the second tier are virtualized computing resources, and the storage resources of the second tier are virtualized storage resources.

6. The method of claim 1, wherein the first tier and the second tier are different cloud computing platforms, the computing resources of the first tier and the second tier being virtualized computing resources, and the storage resources of the first tier and the second tier being virtualized storage resources.

7. The method of claim 1, further comprising:

following commencing executing the second instance of the application, transferring the first portion of the segments to the storage resources of the second tier; and

updating the mapping table to map the first portion of the segments to the second tier.

8. The method of claim 7, further comprising transferring the first portion of the segments to the storage resources in response to usage of the first portion of the segments.

9. The method of claim 1, further comprising:

capturing a snapshot of a state of the first instance of the application; and

configuring the state of the second instance of the application according to the snapshot.

10. The method of claim 9, wherein the state of the first instance of the application includes states of a plurality of roles of the application.

11. The method of claim 10, wherein the state of the first instance of the application includes a topology of a plurality of roles of the application.

12. The method of claim 9, further comprising:

capturing a snapshot of the logical storage volume; and

mounting the snapshot of the logical storage volume to the second instance of the application.

13. A system comprising:

a first computing platform including a plurality of computing resources and storage resources implemented by a plurality of computing devices;

wherein the first computing platform is programmed to;

restore a second instance of a bundled application on the first computing platform from a snapshot of a first instance of the bundled application, the snapshot of the first instance of the bundled application being received from a second computing platform remote from the first computing platform;

receive a mapping table for the first instance of the bundled application from the second computing platform, the mapping table mapping segments of a logical volume written to the first instance of the bundled application, the segments being stored in storage resources of the second computing platform;

commence executing of the second instance of the bundled application effective to access the segments of the logical volume using the mapping table without first copying the segments to storage resources of the first computing platform.

14. The system of claim 13, wherein first computing platform is programmed to execute the second instance of the bundled application by executing instances of a plurality of roles of the second instance of the bundled application in containers executing on computing resources of the first computing platform.

15. The system of claim 14, wherein the first computing platform is a cloud computing platform, the computing resources of the first computing platform being virtualized computing resources.

16. The system of claim 14, wherein the storage resources of the first computing platform are virtualized storage resources.

17. The system of claim 13, wherein the first computing platform is further programmed to:

following commencing executing the second instance of the bundled application, transfer the segments to storage resources of the first computing platform; and

update the mapping table to map the segments to the first computing platform.

18. The system of claim 13, wherein the snapshot of the first instance of the application includes a topology of a plurality of roles of the application.

19. The system of claim 18, wherein the first computing platform is further programmed to invoke transfer the segments to the storage resources in response to usage of the segments.

20. The system of claim 18, wherein the first computing platform is further programmed to restore the second instance of the bundled application on the first computing platform from the snapshot of a first instance of the bundled application by:

instantiating containers executing instances of roles of the application according to the topology.