×

Techniques for extending grids in data storage systems

  • US 10,127,105 B1
  • Filed: 12/17/2015
  • Issued: 11/13/2018
  • Est. Priority Date: 12/17/2015
  • Status: Expired due to Fees
First Claim
Patent Images

1. A computer-implemented method, comprising:

  • generating, from a first data set using an erasure code, a grid of shards representing the first data set, wherein the grid of shards comprises a set of data shards, a set of null shards, a set of virtual shards, and a set of derived shards, the set of derived shards comprising a first set of columns and a second set of columns, the first set of columns including a set of horizontally derived shards and a set of vertically derived shards, each derived shard of the set of derived shards being respectively reproducible from a subset of the horizontally derived shards in a corresponding row and a subset of the vertically derived shards in a corresponding column, the second set of columns including the set of virtual shards and the set of null shards;

    allocating the grid of shards at a set of datacenter locations by at least, on a respective device at each datacenter location of the set of datacenter locations, storing corresponding first shards of the first set of columns and corresponding second shards of the second set of columns;

    processing a second data set by at least;

    generating, from a first null shard, a second null shard, and the second data set, a respective first converted data shard and a respective second converted data shard, each including at least a portion of the second data set;

    generating, by applying the erasure code to the first converted data shard and the second converted data shard, a third converted derived shard; and

    generating, by respectively applying the erasure code to the first converted data shard, the second converted data shard, and the third converted derived shard, a respective new first derived shard, a respective new second derived shard, and a respective new third derived shard; and

    causing the set of datacenter locations to provide access to both the first data set and the second data set while retaining at least one storage characteristic associated with the first data set, by at least;

    adding, to the corresponding first shards stored at the set of datacenter locations, the new first derived shard, the new second derived shard, and the new third derived shard; and

    replacing some of the corresponding second shards stored at the set of data center locations with the first converted data shard, the second converted data shard, and the third converted data shard.

View all claims
  • 1 Assignment
Timeline View
Assignment View
    ×
    ×