Data transformation offloading in an artificial intelligence infrastructure

• US 10,275,176 B1
• Filed: 07/26/2018
• Issued: 04/30/2019
• Est. Priority Date: 10/19/2017
• Status: Active Grant

• Current Assignee: Pure Storage, Inc.
• Original Assignee: Pure Storage, Inc.
• Inventors: Gold, Brian, Watkins, Emily, Jibaja, Ivan, Ostrovsky, Igor, Kim, Roy
• Primary Examiner(s): Cox, Natisha D
• Application Number:
  US16/046,102
• Publication Number:
  US 20190121566A1
• Time in Patent Office: 278 Days
• Field of Search: None
• CPC Class Codes: G06F 16/1794 Details of file format conversion
• CPC Class Codes: G06F 16/245 Query processing
• CPC Class Codes: G06F 16/248 Presentation of query results
• CPC Class Codes: G06F 16/972 Access to data in other repository systems, e.g. legacy data or dynamic Web page generation
• CPC Class Codes: G06F 3/0604 Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/0608 Saving storage space on storage systems
• CPC Class Codes: G06F 3/0646 Horizontal data movement in storage systems, i.e. moving data in between storage devices or systems
• CPC Class Codes: G06F 3/0649 Lifecycle management
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0679 Non-volatile semiconductor memory device, e.g. flash memory, one time programmable memory [OTP]
• CPC Class Codes: G06F 9/4881 Scheduling strategies for dispatcher, e.g. round robin, multi-level priority queues
• CPC Class Codes: G06F 9/5027 the resource being a machine, e.g. CPUs, Servers, Terminals
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: G06N 3/063 using electronic means
• CPC Class Codes: G06N 3/08 Learning methods
• CPC Class Codes: G06Q 30/0243 Comparative campaigns
• CPC Class Codes: G06T 1/20 Processor architectures; Processor configuration, e.g. pipelining
• CPC Class Codes: G06T 1/60 Memory management
• CPC Class Codes: G06T 2200/28 involving image processing hardware

Abstract

Data transformation offloading in an artificial intelligence infrastructure that includes one or more storage systems and one or more graphical processing unit (‘GPU’) servers, including: storing, within the storage system, a dataset; identifying, in dependence upon one or more machine learning models to be executed on the GPU servers, one or more transformations to apply to the dataset; and generating, by the storage system in dependence upon the one or more transformations, a transformed dataset.

Claims

1. A method of data transformation offloading in an artificial intelligence infrastructure that includes one or more storage systems and one or more graphical processing unit (‘

GPU’

) servers, the method comprising;

scheduling, by a unified management plane, one or more transformations for one or more of the storage systems to apply to the dataset;

scheduling, by the unified management plane, execution of one or more machine learning algorithms associated with the machine learning model by the one or more GPU servers;

storing, within the storage system, a dataset;

identifying, in dependence upon one or more machine learning models to be executed on the GPU servers, one or more transformations to apply to the dataset; and

generating, by the storage system in dependence upon the one or more transformations, a transformed dataset.

2. The method of claim 1 further comprising transmitting, from the storage system to the one or more GPU servers, the transformed dataset.

3. The method of claim 2 wherein transmitting, from the storage system to the one or more GPU servers, the transformed dataset further comprises transmitting the transformed dataset from the one or more storage systems directly to application memory on the GPU servers.

4. The method of claim 1 further comprising executing, by one or more of the GPU servers, one or more machine learning algorithms associated with the machine learning model using the transformed dataset as input.

5. The method of claim 1 further comprising maintaining, by the storage system, information describing the dataset, the one or more transformations applied to the dataset, and the transformed dataset.

6. The method of claim 1 further comprising:

receiving a first request to transmit the transformed dataset to one or more of the GPU servers;

transmitting, from the storage system to the one or more GPU servers, the transformed dataset;

receiving a second request to transmit the transformed dataset to one or more of the GPU servers; and

transmitting, from the storage system to the one or more GPU servers without performing an additional transformation of the dataset, the transformed dataset.

7. An artificial intelligence infrastructure that includes one or more storage systems and one or more graphical processing unit (‘

GPU’

) servers, the artificial intelligence infrastructure configured to carry out the steps of;

scheduling, by a unified management plane, one or more transformations for one or more of the storage systems to apply to the dataset;

scheduling, by the unified management plane, execution of one or more machine learning algorithms associated with the machine learning model by the one or more GPU servers;

storing, within the storage system, a dataset;

identifying, in dependence upon one or more machine learning models to be executed on the GPU servers, one or more transformations to apply to the dataset; and

generating, by the storage system in dependence upon the one or more transformations, a transformed dataset.

8. The artificial intelligence infrastructure of claim 7 wherein the artificial intelligence infrastructure is further configured to carry out the step of transmitting, from the storage system to the one or more GPU servers, the transformed dataset.

9. The artificial intelligence infrastructure of claim 8 wherein the artificial intelligence infrastructure is further configured to carry out the step of transmitting, from the storage system to the one or more GPU servers, the transformed dataset further comprises transmitting the transformed dataset from the one or more storage systems directly to application memory on the GPU servers.

10. The artificial intelligence infrastructure of claim 7 wherein the artificial intelligence infrastructure is further configured to carry out the step of executing, by one or more of the GPU servers, one or more machine learning algorithms associated with the machine learning model using the transformed dataset as input.

11. The artificial intelligence infrastructure of claim 7 wherein the artificial intelligence infrastructure is further configured to carry out the step of maintaining, by the storage system, information describing the dataset, the one or more transformations applied to the dataset, and the transformed dataset.

12. The artificial intelligence infrastructure of claim 7 wherein the artificial intelligence infrastructure is further configured to carry out the steps of:

receiving a first request to transmit the transformed dataset to one or more of the GPU servers;

transmitting, from the storage system to the one or more GPU servers, the transformed dataset;

receiving a second request to transmit the transformed dataset to one or more of the GPU servers; and

transmitting, from the storage system to the one or more GPU servers without performing an additional transformation of the dataset, the transformed dataset.

13. An apparatus for data transformation offloading in an artificial intelligence infrastructure that includes one or more storage systems and one or more graphical processing unit (‘

GPU’

) servers, the apparatus comprising a computer processor and a computer memory operatively coupled to the computer processor, the computer memory having disposed within it computer program instructions that, when executed by the computer processor, cause the apparatus to carry out the steps of;

scheduling, by a unified management plane, one or more transformations for one or more of the storage systems to apply to the dataset;

scheduling, by the unified management plane, execution of one or more machine learning algorithms associated with the machine learning model by the one or more GPU servers;

storing, within the storage system, a dataset;

identifying, in dependence upon one or more machine learning models to be executed on the GPU servers, one or more transformations to apply to the dataset; and

generating, by the storage system in dependence upon the one or more transformations, a transformed dataset.

14. The apparatus of claim 13 further comprising computer program instructions that, when executed by the computer processor, cause the apparatus to carry out the step of transmitting, from the storage system to the one or more GPU servers, the transformed dataset.

15. The apparatus of claim 14 wherein transmitting, from the storage system to the one or more GPU servers, the transformed dataset further comprises transmitting the transformed dataset from the one or more storage systems directly to application memory on the GPU servers.

16. The apparatus of claim 13 further comprising computer program instructions that, when executed by the computer processor, cause the apparatus to carry out the step of maintaining, by the storage system, information describing the dataset, the one or more transformations applied to the dataset, and the transformed dataset.

17. The apparatus of claim 13 further comprising computer program instructions that, when executed by the computer processor, cause the apparatus to carry out the steps of:

receiving a first request to transmit the transformed dataset to one or more of the GPU servers;

transmitting, from the storage system to the one or more GPU servers, the transformed dataset;

receiving a second request to transmit the transformed dataset to one or more of the GPU servers; and

transmitting, from the storage system to the one or more GPU servers without performing an additional transformation of the dataset, the transformed dataset.