Distributed storage method and system
First Claim
1. A distributed storage system, applied in a distributed file system, wherein the distributed file system comprises data nodes, the distributed storage system comprises:
- at least one processor;
a non-transitory storage system coupled to the at least one processor and configured to store one or more programs, wherein the one or more programs are executed by the at least one processor, the one or more programs including instructions for;
splitting an original file into data blocks;
storing the data blocks in a data block queue;
assigning multiple data nodes to form a first pipe for transmitting a first data block from the data block queue, and when the first one of the data nodes in the first pipe have been written in the data block, assigning another multiple data node to form a second pipe for transmitting a second data block from the data block queue;
transmitting the pipes when the overall data nodes of the first and second pipes have been written in the first and second data blocks; and
reading the first and second data block from the first and second pipes, and when the first and second pipes are transmitted to a target area of the distributed file system, dissolving the first and second pipes to release the overall data nodes.
2 Assignments
0 Petitions
Accused Products
Abstract
The present disclosure recites a distributed storage method applied in a distributed file system, and the method including steps: splitting the original file into data blocks and storing in a data block queue; assigning multiple data nodes to form a first pipe to transmit a first data block from the data block queue, and when the first one of the data nodes in the first pipe have been written in the data block, assigning another multiple data nodes to form a second pipe to transmit a second data block from the data block queue; transmitting the pipes when the overall data nodes of the first and second pipes been written in the first and second data blocks. The present disclosure also provides a distributed storage system, and all of them can improve the transmission speed of the distributed file system.
-
Citations
10 Claims
-
1. A distributed storage system, applied in a distributed file system, wherein the distributed file system comprises data nodes, the distributed storage system comprises:
-
at least one processor; a non-transitory storage system coupled to the at least one processor and configured to store one or more programs, wherein the one or more programs are executed by the at least one processor, the one or more programs including instructions for; splitting an original file into data blocks; storing the data blocks in a data block queue; assigning multiple data nodes to form a first pipe for transmitting a first data block from the data block queue, and when the first one of the data nodes in the first pipe have been written in the data block, assigning another multiple data node to form a second pipe for transmitting a second data block from the data block queue; transmitting the pipes when the overall data nodes of the first and second pipes have been written in the first and second data blocks; and reading the first and second data block from the first and second pipes, and when the first and second pipes are transmitted to a target area of the distributed file system, dissolving the first and second pipes to release the overall data nodes. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A distributed storage method applied in a distributed file system, wherein the distributed file system comprises data node, the method comprises:
-
splitting an original file into data blocks; storing the data blocks in a data block queue; assigning multiple data nodes to form a first pipe for transmitting a first data block from the data block queue, and when the first one of the data nodes in the first pipe have been written in the data block, assigning another multiple data node to form a second pipe for transmitting a second data block from the data block queue; transmitting the pipes when the overall data nodes of the first and second pipes have been written in the first and second data blocks; and reading the first and second data block from the first and second pipes, and when the first and second pipes are transmitted to a target area of the distributed file system, dissolving the first and second pipes to release the overall data nodes. - View Dependent Claims (7, 8, 9, 10)
-
Specification