Distributed differential store with non-distributed objects and compression-enhancing data-object routing

• US 8,447,864 B2
• Filed: 05/08/2012
• Issued: 05/21/2013
• Est. Priority Date: 04/25/2006
• Status: Active Grant

• Current Assignee: Valtrus Innovations Limited (f/k/a Dolya Holdco 9 Limited) (Key Patent Innovations Limited)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Fineberg, Samuel A., Eshghi, Kave, Mehra, Pankaj, Lillibridge, Mark
• Primary Examiner(s): BAYARD, DJENANE M
• Application Number:
  US13/466,457
• Publication Number:
  US 20120239815A1
• Time in Patent Office: 378 Days
• Field of Search: 709/201, 709/226, 709/229
• US Class Current: 709/226
• CPC Class Codes: G11B 2220/412 Distributed storage methods, i.e. the system may autonomously determine for a storage device that provides enough storage capacity for recording
• CPC Class Codes: G11B 27/002 Programmed access in sequence to a plurality of record carriers or indexed parts, e.g. tracks, thereof, e.g. for editing; transfer of record carriers from magazine G11B15/68, G11B17/10; G11B17/22
• CPC Class Codes: G11B 27/11 by using information not detectable on the record carrier
• CPC Class Codes: H03M 7/30 Compression speech analysis-synthesis for redundancy reduction G10L19/00; for image communication H04N; Expansion; Suppression of unnecessary data, e.g. redundancy reduction

Abstract

One embodiment of the present invention provides a distributed, differential electronic-data storage system that includes client computers, component data-storage systems, and a routing component. Client computers direct data objects to component data-storage systems within the distributed, differential electronic-data storage system. Component data-storage systems provide data storage for the distributed, differential electronic-data storage system. The routing component directs data objects, received from the clients computers, through logical bins to component data-storage systems by a compression-enhancing routing method.

Claims

1. A storage system comprising:

a portal comprising a computer, wherein the portal is to;

map logical bins to corresponding component data-storage systems that provide a distributed, differential data storage;

receive data objects from at least one client computer; and

direct the data objects through the logical bins to the component data-storage systems, wherein the portal is to direct the data objects to the component data-storage systems according to compression-enhancing routing that routes the data objects to the component data-storage systems based on determination by the portal of which of the component data-storage systems provides increased compression of each respective one of the data objects relative to another of the component data-storage systems,

wherein the compression-enhancing routing comprises selecting, for storage of a particular one of the data objects, a component data-storage system from among the component data-storage systems, based on comparing levels of compression that can be obtained by storing the particular data object in the component data storage systems, wherein the selection of the component data-storage system for storage of the particular data object is based on selecting the component data-storage system that is able to achieve a higher level of compression.

2. The storage system of claim 1, wherein the compression-enhancing routing stores groups of the data objects on respective individual ones of the component data-storage systems to allow compression of each of the groups of the data objects at the respective individual component data-storage system.

3. The storage system of claim 2, wherein the compression of each of the groups of the data objects involves differential storing of the data objects of each group that removes redundant copies of data in the data objects of the corresponding group.

4. The storage system of claim 1, wherein the portal is to direct data objects through plural ones of the logical bins to a single one of the component data-storage systems.

5. The storage system of claim 1, wherein the portal is to direct data objects through a single one of the logical bins to plural ones of the component data-storage systems.

6. The storage system of claim 1, wherein in response to removal of one of the component data-storage systems, the portal is to:

redirect logical bins initially mapped to the removed component data-storage system to one or more other of the component data-storage systems; and

copy data objects stored in the removed component data-storage system to the one or more other component data-storage systems.

7. The storage system of claim 1, wherein the compression-enhancing routing is a query-based compression-enhancing routing in which the portal queries the component data-storage systems to obtain information regarding degrees of compression of the data objects at the corresponding component data-storage systems.

8. A method comprising:

mapping, by a portal having a computer, logical bins to corresponding component data-storage systems that provide a distributed, differential data storage;

receiving, by the portal, data objects from at least one client computer; and

directing, by the portal, the data objects through the logical bins to the component data-storage systems, wherein the portal directs the data objects to the component data-storage systems according to compression-enhancing routing that routes the data objects to the component data-storage systems based on determination by the portal of which of the component data-storage systems provides increased compression of each respective one of the data objects relative to another of the component data-storage systems,

wherein the compression-enhancing routing comprises selecting, for storage of a particular one of the data objects, a component data-storage system from among the component data-storage systems, based on comparing levels of compression that can be obtained by storing the particular data object in the component data storage systems, wherein the selection of the component data-storage system for storage of the particular data object is based on selecting the component data-storage system that is able to achieve a higher level of compression.

9. The method of claim 8, wherein the compression-enhancing routing stores groups of the data objects on respective individual ones of the component data-storage systems to allow compression of each of the groups of the data objects at the respective individual component data-storage system.

10. The method of claim 9, wherein the compression of each of the groups of the data objects involves differential storing of the data objects of each group that removes redundant copies of data in the data objects of the corresponding group.

11. The method of claim 8, further comprising directing, by the portal, data objects through plural ones of the logical bins to a single one of the component data-storage systems.

12. The method of claim 8, further comprising directing, by the portal, data objects through a single one of the logical bins to plural ones of the component data-storage systems.

13. The method of claim 8, further comprising the portal responding to removal of one of the component data-storage systems by:

redirecting logical bins initially mapped to the removed component data-storage system to one or more other of the component data-storage systems; and

copying data objects stored in the removed component data-storage system to the one or more other component data-storage systems.

14. The method of claim 8, wherein the compression-enhancing routing is a query-based compression-enhancing routing in which the portal queries the component data-storage systems to obtain information regarding degrees of compression of the data objects at the corresponding component data-storage systems.