Storage arrangement and method using a plurality of storage spaces which have separate control layers and separate mapping structures

• US 9,645,943 B2
• Filed: 02/22/2012
• Issued: 05/09/2017
• Est. Priority Date: 02/22/2011
• Status: Active Grant

• Current Assignee: Infinidat Ltd.
• Original Assignee: Infinidat Ltd.
• Inventors: Kopylovitz, Haim, Corry, Leo, Yochai, Yechiel
• Primary Examiner(s): Elmore, Reba I
• Application Number:
  US14/000,889
• Publication Number:
  US 20130332700A1
• Time in Patent Office: 1,903 Days
• Field of Search: 711209, 711214, 711218, 710 7, 710 12, 710 26, 710 34, 710 36, 710 53, 709218, 709225, 709232
• CPC Class Codes: G06F 3/0604 Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/061 Improving I/O performance
• CPC Class Codes: G06F 3/0631 by allocating resources to storage systems
• CPC Class Codes: G06F 3/0644 Management of space entities, e.g. partitions, extents, pools
• CPC Class Codes: G06F 3/0664 at device level, e.g. emulation of a storage device or system
• CPC Class Codes: G06F 3/0665 at area level, e.g. provisioning of virtual or logical volumes
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Abstract

There is provided a storage arrangement and a method of operating thereof. The storage arrangement comprises a first storage system and one or more second storage systems operatively coupled to the first storage system. First control layer is operable to handle a first logical address space comprising a first logical group characterized by a plurality of logical block addresses; first control layer comprises a first mapping module handling a first mapping structure associated with first logical group. Each second control layer comprises, respectively, a second mapping module handling a second mapping structure associated with first logical group. The first mapping structure is configured to provide mapping between logical addresses related to first logical group and corresponding addresses related to first physical address spaces, and/or to point to respective second mapping structure configured to provide mapping between these logical addresses and corresponding addresses related to respective second physical address spaces.

Claims

1. A system comprising a first storage system that comprises:

a first physical storage space that includes a first plurality of physical storage devices, and a first control layer that includes one or more first storage control devices, and wherein one or more second storage systems are operatively coupled to the first storage system and each includes;

a second physical storage space that includes a second plurality of physical storage devices, and a second control layer that includes second storage control devices;

wherein the first control layer is configured to provide access to a first logical group characterized by a plurality of logical block addresses;

wherein said first control layer includes a first mapping structure, wherein the first mapping structure is a data structure for mapping the plurality of logical block addresses of said first logical group into first values indicative of physical addresses;

wherein said second control layer includes a second mapping structure, wherein the second mapping structure is a data structure for mapping the plurality of logical block addresses of said first logical group into second values indicative of physical addresses, wherein at least one of the second values is a physical address within the second physical storage space; and

wherein the first mapping structure is configured to provide translation between logical addresses within said first logical group and the values indicative of physical addresses, wherein each of the values indicative of physical addresses includes a value selected from;

a physical address within the first physical storage space, and a value that points to the second mapping structure;

wherein at least one logical address within the first logical group is mapped by the first mapping structure into a certain value that points to the second mapping structure;

wherein in response to receiving, by the first storage system, an I/O request addressed to a requested logical address included in said first logical group, the first storage system is configured to translate the requested logical address into a certain value indicative of physical addresses, by using the first mapping structure;

in a case where the certain value includes a first physical address range included within the first physical storage space, the first storage system is configured to serve the I/O request with data stored in the first physical address range; and

in a case where the certain value includes a value that points to the second mapping structure, the first storage system is configured to serve the I/O request with data stored in a second physical address range included in the second physical storage space, wherein the second physical address range is provided by using the second mapping structure for translating the requested logical address into the second physical address range;

wherein the first control layer further comprises a first virtual layer operable to represent a logical address space that comprises the plurality of logical block addresses of the first logical group, said first virtual layer characterized by a plurality of virtual unit addresses (VUA), and wherein the first control layer further comprises a second virtual layer operable to represent the first physical storage space, said second virtual layer characterized by a plurality of virtual disk addresses (VDA), and wherein the first mapping structure is configured to provide at least one of mapping option selected from a group consisting of;

a) mapping between the plurality of logical block addresses and addresses within the first physical storage space;

b) mapping between VUA and VDA addresses;

c) mapping between the plurality of logical block addresses and VDA addresses; and

d) mapping between VUA and addresses within the first physical storage space.

2. The system of claim 1, wherein the first logical group is selected from a group consisting of one or more logical volumes, one or more virtual partitions, one or more snapshots, one or more combinations of a given logical volume and its respective one or more snapshots.

3. The system of claim 1, wherein the first mapping structure is a mapping tree;

wherein a plurality of leaves of the first mapping tree represent the plurality of logical addresses within the first logical group and comprise the values indicative of physical addresses, wherein at least part of the plurality of leaves comprise an indication of a certain second mapping tree responsible for translating logical addresses represented by the at least part of the plurality of leaves into various physical addresses handled by a second storage system of the one or more second storage systems.

4. The system of claim 1, wherein the first mapping structure comprises a first ordered tree data structure comprising one or more leaves and wherein a) a depth of a leaf in the first ordered tree data structure represents a length of a contiguous range of addresses within said first logical group;

b) a path followed from a tree root to the leaf indicates an offset of the contiguous range of addresses within said first logical group;

c) a value associated with the leaf indicates either;

(i) an offset of contiguous range of physical addresses within the first physical storage space and corresponding to said contiguous range of addresses within said first logical group;

or (ii) a value that points to a respective second mapping structure handling mapping of said contiguous range of addresses related to said first logical group into addresses related to a respective second physical storage space.

5. The system of claim 4,

wherein a certain second mapping structure comprised in a certain second storage system of the one or more storage systems is configured as a second ordered tree data structure that comprises a single leaf representing the plurality of logical block addresses of said first logical group, wherein the single leaf comprises a value indicating said first ordered tree data structure for mapping all the plurality of logical block addresses corresponding to said first logical group.

6. The system of claim 1, wherein the first and the second storage systems are part of a cloud storage arrangement.

7. The system of claim 1, wherein the first and the second storage systems constitute a storage cluster.

8. A method of operating a system that includes a first storage system operatively coupled to a second storage system, each includes a physical storage space constituted by a plurality of physical storage devices, the method comprising:

configuring a first mapping structure, wherein the first mapping structure is a data structure for mapping a plurality of logical block addresses of a logical group into first values indicative of physical addresses, wherein each of the values indicative of physical addresses includes a value selected from;

a physical address within the first storage system and a value that points to a second mapping structure included in the second storage system;

wherein at least one logical address within the first logical group is mapped by the first mapping structure into a certain value that points to the second mapping structure;

responsive to receiving by the first storage system an I/O request addressed to a requested logical address included in said logical group, translating the requested logical address into a certain value indicative of a certain physical address, by using the first mapping structure;

in a case where the certain value includes a first physical address range included within the first storage system, serving, by the first storage system, the I/O request with data stored in the first physical address range; and

in a case where the certain value includes a value that points to the second mapping structure included in the second storage system, using the second mapping structure for translating the requested logical address into a second physical address range included in the second storage system; and

serving the I/O request by the first storage system with data stored in the second physical address range;

wherein the first storage system further comprises a first virtual layer operable to represent a logical address space that comprises the plurality of logical block addresses of the logical group, said first virtual layer characterized by a plurality of virtual unit addresses (VUA), and wherein the first storage system further comprises a second virtual layer operable to represent the physical storage space, said second virtual layer characterized by a plurality of virtual disk addresses (VDA), and wherein the first mapping structure is configured to provide mapping options selected from a group consisting of;

a) mapping between the plurality of logical block addresses and addresses within the physical storage space (DBA);

b) mapping between VUA and VDA addresses;

c) mapping between the plurality of logical block addresses and VDA addresses; and

d) mapping between VUA and addresses within the first physical storage space.

9. The method of claim 8, wherein the I/O request is a read request, and wherein said read request is served by the first storage system.

10. The method of claim 8, wherein the I/O request is a write request, and wherein said write request is served by the second storage system.

11. The method of claim 10 further comprising updating the second mapping structure in accordance with the write request being served.

12. The method of claim 8, wherein the logical group is selected from a group consisting of:

one or more logical volumes, one or more virtual partitions, one or more snapshots, one or more combinations of a given logical volume and its respective one or more snapshots.

13. The method of claim 8, wherein the first mapping structure comprises a first ordered tree data structure comprising one or more leaves and wherein a) a depth of a leaf in the first ordered tree data structure represents a length of a contiguous range of addresses within said logical group;

b) a path followed from a tree root to the leaf indicates an offset of the contiguous range of addresses within said logical group;

c) a value associated with the leaf indicates either;

(i) an offset of contiguous range of physical addresses within the first storage system and corresponding to said contiguous range of addresses related to said logical group, and (ii) a value that points to the second mapping structure handling mapping of said contiguous range of addresses related to said logical group into corresponding physical addresses within the second storage system.

14. The method of claim 13, wherein a certain second mapping structure comprised in a certain second storage system of the one or more storage systems is configured as a second ordered tree data structure that comprises a single leaf representing the plurality of logical block addresses of said first logical group, wherein the single leaf comprises a value indicating said first ordered tree data structure for mapping all the plurality of logical block addresses corresponding to said logical group.

15. A non-transitory computer readable storage medium comprising computer readable program code embodied therein for operating a first storage system, wherein the computer readable program code to cause the first storage system to:

configuring a first mapping structure for mapping a plurality of logical block addresses of a logical group into values indicative of physical addresses, wherein each of the values indicative of physical addresses includes a value selected from;

a physical address within the first storage system and a value that points to a second mapping structure included in a second storage system that is coupled to the first storage system;

wherein at least one logical address within the first logical group is mapped by the first mapping structure into a certain value that points to the second mapping structure;

responsive to receiving by the first storage system an I/O request addressed to a requested address included in said logical group, translating the requested logical address into a certain value indicative of a certain physical address, by using the first mapping structure;

in a case where the certain value includes a first physical address range included within the first storage system, serving, by the first storage system, the I/O request with data stored in the first physical address range; and

in a case where the certain value includes a value that points to the second mapping structure included in the second storage system, serving, by the first storage system, the I/O request with data stored in a second physical address range included in the second storage system, wherein the second physical address range is provided by using the second mapping structure for translating the requested logical address into the second physical address range;

wherein the first storage system further comprises a first virtual layer operable to represent a logical address space that comprises the plurality of logical block addresses of the logical group, said first virtual layer characterized by a plurality of virtual unit addresses (VUA), and wherein the first storage system further comprises a second virtual layer operable to represent the physical storage space, said second virtual layer characterized by a plurality of virtual disk addresses (VDA), and wherein the first mapping structure is configured to provide mapping options selected from a group consisting of;

a) mapping between the plurality of logical block addresses and addresses within the physical storage space (DBA);

b) mapping between VUA and VDA addresses;

c) mapping between the plurality of logical block addresses and VDA addresses; and

d) mapping between VUA and addresses within the first physical storage space.