Splitting and redundant storage on multiple servers

• US 20040088380A1
• Filed: 09/12/2003
• Published: 05/06/2004
• Est. Priority Date: 03/12/2002
• Status: Abandoned Application

• Current Assignee: EdgeStream, Inc.
• Original Assignee: EdgeStream, Inc.
• Inventors: Parthasarathy, Sivagnanam, Chung, Randall M., Bishay, Maged, Zelevinsky, Michael
• Application Number:
  US10/471,849
• Publication Number:
  US 20040088380A1
• Time in Patent Office: Days
• US Class Current: 709/219
• CPC Class Codes: G06F 11/1464 for networked environments
• CPC Class Codes: G06F 16/10 File systems; File servers
• CPC Class Codes: G06F 2211/1028 Distributed, i.e. distributed RAID systems with parity
• CPC Class Codes: H04N 21/2181 comprising remotely distributed storage units, e.g. when movies are replicated over a plurality of video servers distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS], H04L67/1097
• CPC Class Codes: H04N 21/23116 involving data replication, e.g. over plural servers synchronization of replicated data G06F11/1658; error detection or correction by means of data replication G06F11/2053; replication in distributed file systems G06F16/10; replication in distributed file systems G06F16/27; replication or mirroring of data in data networks H04L67/1095
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments

Abstract

One aspect of the invention involves dividing a single file (300) into multiple sub-files (310, 320, 330, 340) that are subsequently distributed and stored onto one or more servers. The sub-files (310, 320, 330, 340) may be transmitted in parallel and simultaneously from one or more servers, which increases the rate at which the data can be delivered. A second aspect of the invention involves storing at least one of the sub-files (310, 320, 330, 340) on more than one server to provide redundancy. If one server is not available, or if the transmission link is slow or not available, the sub-file can be streamed from another server. In one embodiment, each end user may receive multiple sub-files simultaneously from multiple servers. Disk input/output bandwidth is saved because only the necessary fraction of data needs to be read from each server.

Claims

1. A method for providing content over a network comprising:

splitting said content into a plurality of segments;

organizing a first plurality of said segments into a first sub-file;

organizing a second plurality of said segments into a second sub-file;

storing said first sub-file and second sub-file on one or more servers;

providing sub-file data to a user computer, said sub-file data to identify a server location of said first sub-file and second sub-file;

streaming said first sub-file and second sub-file, in response to a request, to the user computer over the network.

2. The method of claim 1, further comprising organizing a remainder of said plurality of segments into additional sub-files, such that all of said plurality of segments are distributed between said first sub-file, said second sub-file, and said additional sub-files.

3. The method of claim 1, further comprising organizing said plurality of segments into a plurality of sub-files according to an order.

4. The method of claim 3, wherein organizing said plurality of segments comprises organizing said plurality of segments into the plurality of sub-files according to the order, said order to be characterized by organizing a first segment into the first sub-file, a second segment into one of the first or the second sub-file, and a third segment into one of the first or the second sub-file.

5. The method of claim 3, wherein said plurality of sub-files are further organized into a plurality of sub-file groups, and wherein organizing said plurality of segments comprises organizing said plurality of segments into the plurality of sub-files according to the order, said order to be characterized by organizing a first sequence of segments across a first sub-file group, followed by organizing a second sequence across the first sub-file group.

6. The method of claim 1, wherein storing said first sub-file and second sub-file on one or more servers comprises storing each of said first sub-file and second sub-file on a first server connected to said network.

7. The method of claim 1, wherein storing said first sub-file and second sub-file on one or more servers comprises storing said first sub-file on a first server and said second sub-file on a second server, said first server and second server to be connected to the network.

8. The method of claim 1, wherein storing said first sub-file and second sub-file on one or more servers comprises storing each of said first sub-file and second sub-file on a first server, and storing at least one of said first sub-file and second sub-file on a second server, said first server and second server to be connected to the network.

9. The method of claim 8, farther comprising organizing a remainder of said plurality of segments into additional sub-files, and storing at least one of said additional sub-files on a third server.

10. The method of claim 1, wherein providing sub-file data to the user computer comprises providing sub-file data to the user computer where said sub-file data is to include a location of said first sub-file and second sub-file, said sub-file data to further identify which of said plurality of segments is organized into the first sub-file and which of said plurality of segments is organized into the second sub-file.

11. The method of claim 1, further comprising, after said streaming, combining said first sub-file and second sub-file by the user computer using the sub-file data.

12. A network server comprising:

a processor;

a communications port, coupled to the processor, said communications port to be used to connect the network server to a network; and

,

a memory, coupled to the processor, said memory to include instruction sequences for causing said processor to,

split media content into a plurality of segments,

organize a first plurality of said segments into a first sub-file,

organize a second plurality of said segments into a second sub-file,

store said first sub-file and second sub-file on one or more servers,

provide sub-file data to a user computer, said sub-file data to identify a location of said first sub-file and second sub-file, and

stream said first sub-file and second sub-file, in response to a request, to the user computer over the network.

13. The network server of claim 12, wherein said memory further includes instruction sequences to cause said processor to organize a remainder of said plurality of segments into additional sub-files, such that all of said plurality of segments are distributed between said first sub-file, said second sub-file, and said additional sub-files.

14. The network server of claim 12, wherein said memory further includes instruction sequences for causing said processor to organize said plurality of segments into a plurality of sub-files according to an order.

15. The network server of claim 14, wherein said order is characterized by organizing a first segment into the first sub-file, a second segment into one of the first or the second sub-file, and a third segment into one of the first or the second sub-file.

16. The network server of claim 14, wherein said memory further includes instruction sequences for causing said processor to organize said plurality of sub-files into a plurality of sub-file groups, and wherein organizing said plurality of segments comprises organizing said plurality of segments into a plurality of sub-files according to the order, said order to be characterized by organizing a first sequence of segments across a first sub-file group, followed by organizing a second sequence across the first sub-file group.

17. The network server of claim 12, wherein each of said first sub-file and second sub-file are stored on a first server connected to said network.

18. The network server of claim 12, wherein said first sub-file is stored on a first server and said second sub-file is stored on a second server, said first server and second server to be connected to the network.

19. The network server of claim 12, wherein each of said first sub-file and second sub-file are stored on a first server, and at least one of said first sub-file and second sub-file is stored on a second server, said first server and second server to be connected to the network.

20. The network server of claim 19, wherein said memory further includes instruction sequences to cause said processor to organize a remainder of said plurality of segments into additional sub-files, and to store at least one of said additional sub-files on a third server.

21. The network server of claim 12, wherein said sub-file data is to further identify which of said plurality of segments is organized into the first sub-file and which of said plurality of segments is organized into the second sub-file.

22. A computer program product, comprising:

a computer usable medium having computer readable program code embodied therein to provide content over a network, the computer readable program code in said computer program product comprising;

first computer readable program code to split said content into a plurality of segments;

second computer readable program code to organize a first plurality of said segments into a first sub-file;

third computer readable program code to organize a second plurality of said segments into a second sub-file;

fourth computer readable program code to store said first sub-file and second sub-file on one or more servers;

fifth computer readable program code to provide sub-file data to a user computer, said sub-file data to identify a server location of said first sub-file and second sub-file;

sixth computer readable program code to stream said first sub-file and second sub-file, in response to a request, to the user computer over the network.

23. The computer program product of claim 22, further comprising seventh computer readable program code to organize a remainder of said plurality of segments into additional sub-files, such that all of said plurality of segments are distributed between said first sub-file, said second sub-file, and said additional sub-files.

24. The computer program product of claim 22, wherein said first computer readable program code comprises first computer readable program code to split said content into a plurality of segments and to organize said plurality of segments into a plurality of sub-files according to an order.

25. The computer program product of claim 24, wherein said order is characterized by organizing a first segment into the first sub-file, a second segment into one of the first or the second sub-file, and a third segment into one of the first or second sub-file.

26. The computer program product of claim 24, further comprising seventh computer readable program code to organize said plurality of sub-files into a plurality of sub-file groups, and wherein said first computer readable program code comprises first computer readable program code to organize said plurality of segments into a plurality of sub-files according to the order, said order to be characterized by organizing a first sequence of segments across a first sub-file group, followed by organizing a second sequence across the first sub-file group.

27. The computer program product of claim 22, wherein the fourth computer readable program code comprises fourth computer readable program code to store each of said first sub-file and second sub-file on a first server connected to said network.

28. The computer program product of claim 22, wherein the fourth computer readable program code comprises fourth computer readable program code to store said first sub-file on a first server and said second sub-file on a second server, said first server and second server to be connected to the network.

29. The computer program product of claim 22, wherein the fourth computer readable program code comprises fourth computer readable program code to store each of said first sub-file and second sub-file on a first server, and to store at least one of said first sub-file and second sub-file on a second server, said first server and second server to be connected to the network.

30. The computer program product of claim 29, further comprising seventh computer readable program code to organize a remainder of said plurality of segments into additional sub-files, and to store at least one of said additional sub-files on a third server.

31. The computer program product of claim 22, wherein the fifth computer readable program code comprises fifth computer readable program code to provide sub-file data to the user computer, where said sub-file data is to include a location of said first sub-file and second sub-file, said sub-file data to further identify which of said plurality of segments is organized into the first sub-file and which of said plurality of segments is organized into the second sub-file.