Cloud Storage Data Access Method, Apparatus and System

• US 20120136960A1
• Filed: 12/01/2010
• Published: 05/31/2012
• Est. Priority Date: 11/29/2010
• Status: Abandoned Application

• Current Assignee: Beijing Z & W Technology Consulting Company Limited
• Original Assignee: Beijing Z & W Technology Consulting Company Limited
• Inventors: Liu, Hui
• Application Number:
  US13/000,569
• Publication Number:
  US 20120136960A1
• Time in Patent Office: Days
• US Class Current: 709/217
• CPC Class Codes: G06F 16/1752 based on file chunks
• CPC Class Codes: G06F 3/061 Improving I/O performance
• CPC Class Codes: G06F 3/0643 Management of files
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Abstract

This invention relates to technology field of cloud storage and especially relates to a cloud storage data access method. The method comprises: a step of data storing and a step of data retrieving. The data storing step comprises: converting a file to be stored into a group of data blocks to form a physical part of the file, saving a logical part of the file, which is formed by information of restoring the physical part back to original file; distributing the physical part to multiple cloud storage data centers for storage; and saving storing location information of the data blocks of the physical part in the cloud storage data centers in the logical part; the step of data retrieving comprises: acquiring the file'"'"'s logical part according to a file access request; retrieving the physical part of the file from at least one of the cloud storage data centers according to the logical part information and restoring the physical part to the original file according to the logical part information. This invention also provides a cloud storage data access apparatus and system. This invention improves cloud storage data access performance, facilitates storage space saving, increases data transmission bandwidth, and strengthens data security.

Claims

1. A cloud storage data access method comprising a step of data storing and a step of data retrieving wherein:

the data storing step comprises;

converting a file to be stored into a group of data blocks to form a physical part of the file and saving a logical part of the file, which is formed by information of restoring the physical part back to the original file;

distributing the physical part to multiple cloud storage data centers for storage; and

saving storing location information of the data blocks of the physical part in the cloud storage data centers, in the logical part;

the data retrieving step comprises;

acquiring the file'"'"'s logical part according to a file access request;

retrieving the physical part of the file from at least one of the cloud storage data centers according to the logical part; and

restoring the physical part back to the file according to the logical part.

2. The method of claim 1 wherein the step of distributing comprises;

binding the data blocks of the physical part dispersedly and randomly to multiple predetermined cloud storage data centers based on users'"'"' predetermined rule; and

distributing the physical part to multiple determined cloud storage data centers for storage by multi-process parallel transmission based on the binding setting between the data blocks of the physical part and the cloud storage data centers.

3. The method of claim 1 wherein the logical part is stored at a local server or a server that is not being used to store the physical part.

4. The method of claim 1 wherein each of the cloud storage data centers stores one or more data blocks of the physical part of the file.

5. The method of claim 1 wherein the logical part comprises information about composition of the data blocks of the physical part, storing location of the physical part in the cloud storage data centers, approach to recompose data blocks, and the attribute, access authority and check value information of the file.

6. A cloud storage data access apparatus comprising a data storage module for storing data and a data retrieval module for retrieving data;

wherein;

the data storage module comprises;

a file conversion unit used for converting a file to be stored into a group of data blocks and forming a physical part of the file;

a physical part transmission unit used for distributing the physical part formed by the file conversion unit to multiple cloud storage data centers for storage; and

a logical part storage unit used for saving information of restoring the physical part back to the original file, when the file conversion unit converts the file and forms the physical part, and saving storing location information of the data blocks of the physical part in the cloud storage data centers, after the physical part transmission unit transmits the physical part;

the data retrieval module comprises;

a logical part acquisition unit used for acquiring the logical part of the file according to a file access request;

a physical part retrieval unit used for retrieving the physical part of the file from at least one of the cloud storage data centers according to the logical part acquired by the logical part acquisition unit; and

a file recovery unit used for restoring the physical part retrieved by the physical part retrieval unit to the original file according to the logical part acquired by the logical part acquisition unit.

7. The apparatus of claim 6 wherein the logical part transmission unit comprises:

a random distribution subunit used for binding the data blocks of the physical part, dispersedly and randomly to multiple predetermined cloud storage data centers according to a user'"'"'s predefined policy; and

a parallel transmission subunit used for distributing the physical part to multiple determined cloud storage data centers for storage by multi-process parallel transmission according to the binding setting between the data blocks and the cloud storage data centers created by the random distribution subunit.

8. A cloud storage data access system comprising a data storage module for storing data, a data retrieval module for retrieving data, and multiple cloud storage data centers, wherein:

the data storage module comprises;

a file conversion unit used for converting a file to be stored into a group of data blocks to form a physical part of the file;

a physical part transmission unit used for distributing the physical part to multiple cloud storage data centers for storage; and

a logical part storage unit used for saving, information of restoring the physical part back to original file, when the file conversion unit converts the file and forms the physical part, and saving storing location information of the data blocks of the physical part in the cloud storage data centers, after the physical part transmission unit transmits the physical part;

the data retrieval module comprises;

a logical part acquisition unit used for acquiring the logical part of the file according to a file access request;

a physical part retrieval unit used for retrieving the physical part of the file from at least one of the cloud storage data centers according to the logical part acquired by the logical part acquisition part; and

a file recovery unit used for restoring the physical part retrieved by the physical part retrieval unit back to the original file according to the logical part acquired by the logical part acquisition unit.

9. The system of claim 8 wherein the physical part transmission unit comprises:

a random distribution subunit used for binding the data blocks of the physical part dispersedly and randomly to multiple predetermined cloud storage data centers according to a user'"'"'s predefined policy; and

a parallel transmission subunit used for distributing the physical part to multiple determined cloud storage data centers for storage by multi-process parallel transmission according to the binding setting between the data blocks of physical part and the cloud storage data centers created by the random distribution subunit.

10. The system of claim 8 wherein each of the cloud storage data centers stores one or more data blocks of the physical part of the file.