×

Modular architecture for extreme-scale distributed processing applications

  • US 10,248,346 B2
  • Filed: 03/18/2016
  • Issued: 04/02/2019
  • Est. Priority Date: 06/04/2013
  • Status: Active Grant
First Claim
Patent Images

1. A system comprising:

  • a subnode of a distributed processing node, the subnode including;

    at least one processor core operatively connected to a memory, the memory being managed by Memcached;

    a first interconnect operatively connected to the subnode;

    a second interconnect operatively connected to the subnode and to a storage, the storage comprising a first storage unit and a second storage unit, the second storage unit having lower access time and latency than the first storage unit, the storage being accessed via a Hadoop Distributed File System;

    a process running on the subnode, the process being operative to retrieve data from the memory of the subnode;

    wherein;

    the process interrogates the memory of the subnode for requested data;

    if the requested data is not found in the memory of the subnode, the process interrogates the memory of at least one additional subnode of the distributed processing node via the first interconnect;

    if the requested data is found in the memory of the additional subnode, the process copies the requested data to the memory of the subnode; and

    if the requested data is not found in the memory of the subnode or the memory of the additional subnode, the process interrogates the storage via the second interconnect;

    a storage manager allocates data between the first and second storage units based on access patterns, the storage manager preferentially relocating nonsequentially accessed data to the second storage unit from the first storage unit.

View all claims
  • 2 Assignments
Timeline View
Assignment View
    ×
    ×