Method and system for collective file access using an mmap (memory-mapped file)
DCFirst Claim
1. A method for processing using a shared file comprising:
- creating a plurality of mmaps between a shared file and a plurality of address spaces,wherein each of the plurality of mmaps maps at least a portion of the shared file to one of the plurality of address spaces,wherein each of the plurality of address spaces is associated with one of a plurality of processors, andwherein creating the plurality of mmaps comprises;
identifying, for the plurality of processors, a global maximum offset in a shared memory, wherein the global maximum offset is maximum of a plurality of maximum offsets required by the plurality of processors to access the shared file;
determining whether the global maximum offset corresponds to a memory location in the shared memory in which the shared filed is stored; and
expanding the shared file to encompass the memory location corresponding to the global maximum offset when the global maximum offset does not correspond to the memory location in the shared memory in which the shared file is stored;
transferring, in parallel, data between the shared file and the plurality of address spaces using the plurality of mmaps associated with the plurality of address spaces;
processing the data in parallel by the plurality of processors to obtain a result, wherein the plurality of processors access the data from the plurality of address spaces; and
storing the result in the shared memory.
2 Assignments
Litigations
0 Petitions
Accused Products
Abstract
A method for processing using a shared file that includes creating a plurality of mmaps between a shared file and a plurality of address spaces, wherein each of the plurality of mmaps maps at least a portion of the shared file to one of the plurality of address spaces, and wherein each of the plurality of address spaces is associated with one of a plurality of processors, transferring, in parallel, data between the shared file and the address spaces using the plurality of mmaps associated with the plurality of address spaces, processing the data in parallel by the plurality of processors to obtain a result, wherein the plurality of processors access data from the plurality of address spaces, and storing the result in the shared memory.
6 Citations
16 Claims
-
1. A method for processing using a shared file comprising:
-
creating a plurality of mmaps between a shared file and a plurality of address spaces, wherein each of the plurality of mmaps maps at least a portion of the shared file to one of the plurality of address spaces, wherein each of the plurality of address spaces is associated with one of a plurality of processors, and wherein creating the plurality of mmaps comprises; identifying, for the plurality of processors, a global maximum offset in a shared memory, wherein the global maximum offset is maximum of a plurality of maximum offsets required by the plurality of processors to access the shared file; determining whether the global maximum offset corresponds to a memory location in the shared memory in which the shared filed is stored; and expanding the shared file to encompass the memory location corresponding to the global maximum offset when the global maximum offset does not correspond to the memory location in the shared memory in which the shared file is stored; transferring, in parallel, data between the shared file and the plurality of address spaces using the plurality of mmaps associated with the plurality of address spaces; processing the data in parallel by the plurality of processors to obtain a result, wherein the plurality of processors access the data from the plurality of address spaces; and storing the result in the shared memory. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A system comprising:
-
a shared memory for storing a shared file; and a plurality of processors connected to the shared memory and configured to; create a plurality of mmaps between the shared file and a plurality of address spaces, wherein each of the plurality of mmaps maps at least a portion of the shared file to one of the plurality of address spaces, and wherein each of the plurality of address spaces is associated with one of the plurality of processors, and wherein creating the plurality of mmaps comprises; identifying, for the plurality of processors, a global maximum offset in the shared memory, wherein the global maximum offset is maximum of a plurality of maximum offsets required by the plurality of processors to access the shared file; determining whether the global maximum offset corresponds to a memory location in the shared memory in which the shared filed is stored; and expanding the shared file to encompass the memory location corresponding to the global maximum offset when the global maximum offset does not correspond to the memory location in the shared memory in which the shared file is stored; transfer, in parallel, data between the shared file and the plurality of address spaces using the plurality of mmaps associated with the plurality of address spaces; process the data in parallel by the plurality of processors to obtain a result, wherein the plurality of processors access the data from the plurality of address spaces; and store the result in the shared memory. - View Dependent Claims (9, 10, 11, 12, 13, 14)
-
-
15. A shared memory computer system comprising a plurality of processors and a shared memory, wherein each processor in the plurality of processors is configured to:
-
create a mmap between at least a portion of a shared file and an address space associated with the processor; transfer, in parallel, data between the shared file and the address space using the mmap associated with the processor; and process the data by the processor to obtain processed data, wherein the processed data is used to obtain a result, wherein the result is stored in the shared memory, wherein the shared file is in the shared memory and accessible by each of the plurality of processors; and wherein at least one of the plurality of processors is configured to; identify, for the plurality of processors, a global maximum offset in the shared memory, wherein the global maximum offset is maximum of a plurality of maximum offsets required by the plurality of processors to access the shared file; determine whether the global maximum offset corresponds to a memory location in the shared memory in which the shared filed is stored; and expand the shared file to encompass the memory location corresponding to the global maximum offset when the global maximum offset does not correspond to the memory location in the shared memory in which the shared file is stored. - View Dependent Claims (16)
-
Specification