Storage system with compute resources and shared storage resources

  • US 10,452,444 B1
  • Filed: 01/30/2018
  • Issued: 10/22/2019
  • Est. Priority Date: 10/19/2017
  • Status: Active Grant
  • ×
    • Pin
First Claim
Patent Images

1. A method of executing a big data analytics pipeline in a storage system that includes a chassis comprising compute resources and shared storage resources, the method comprising:

  • receiving, by the storage system from a data producer, a dataset by periodically polling a location to which the data producer writes the dataset;

    storing, by the storage system, the dataset within the storage system in the shared storage resources in a location, within the storage system, specific to the data producer;

    allocating, by the storage system, the compute resources within the chassis of the storage system to an analytics application, wherein the shared storage resources are accessible by the allocated compute resources;

    executing the analytics application on the compute resources within the chassis, including ingesting the dataset from the storage system;

    detecting that the analytics application needs additional processing resources;

    allocating additional processing resources to the analytics application, wherein the additional processing resources are within the chassis and local to the shared storage resource storing the dataset; and

    executing the analytics application on the additional processing resources.

View all claims
    ×
    ×

    Thank you for your feedback

    ×
    ×