Data processing apparatus, distributed processing system, data processing method and data processing program

• US 8,719,367 B2
• Filed: 10/09/2007
• Issued: 05/06/2014
• Est. Priority Date: 03/28/2007
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment Inc. (Sony Group Corp.)
• Original Assignee: Sony Computer Entertainment Incorporated (Sony Group Corp.), Sony Corporation (Sony Group Corp.)
• Inventors: Kato, Hiroki, Kobayashi, Koji, Hayama, Noritaka, Oyama, Kazufumi, Onogi, Wataru
• Primary Examiner(s): Baturay, Alicia
• Application Number:
  US12/593,191
• Publication Number:
  US 20100095302A1
• Time in Patent Office: 2,401 Days
• Field of Search: 709/217
• US Class Current: 709/217
• CPC Class Codes: G06F 9/5066 Algorithms for mapping a plurality of inter-dependent sub-tasks onto a plurality of physical CPUs mappping at compile time, see G06F8/451
• CPC Class Codes: G06F 9/541 via adapters, e.g. between incompatible applications
• CPC Class Codes: G06F 9/546 Message passing systems or structures, e.g. queues

Abstract

A terminal includes a task information acquiring unit which acquires information on a task of data processing, and a communication task generator which generates a send task to allow a source apparatus of data required by the task to transmit the data required by the task to an apparatus executing the task and which transmits the send task to the source apparatus, when the source apparatus is another apparatus, which is different from the apparatus executing the task and which is connected to the apparatus executing the task via a network.

Claims

1. A distributed processing system, comprising:

a plurality of data processing apparatuses;

a distributed processing management apparatus, connected to the plurality of data processing apparatuses via a network, which manages the plurality of data processing apparatuses in a distributed processing of an application by the plurality of data processing apparatuses,

the distributed processing management apparatus including;

a processing capacity information acquiring unit which acquires, from the plurality of data processing apparatuses, information on the respective processing capacities of the data processing apparatuses via the network;

an application information acquiring unit which acquires information on an application that includes a plurality of tasks to be processed by the data processing apparatuses, the information including an execution sequence of the plurality of tasks contained in the application and information on transfer of data between the tasks;

a task distributing unit which determines which of the plurality of tasks contained in the application are to be processed by which of the data processing apparatuses, based on the information on the respective processing capacities of the data processing apparatuses acquired by the processing capacity information acquiring unit;

a task transmitting unit which transmits tasks to a data processing apparatus determined by the task distributing unit; and

a task information conveying unit which conveys information concerning a source apparatus of input data required by the respective task to the data processing apparatus executing the respective task, and

the data processing apparatus including;

a task acquiring unit which acquires the task;

a task executing unit which executes the task;

a task information acquiring unit which acquires information concerning a source apparatus of data required by the task;

a communication task generator which generates a send task to make the source apparatus transmit data required by the task to the data processing apparatus, and transmits the send task to the source apparatus, when the source apparatus is another data processing apparatus, which is different from the data processing apparatus, connected to the data processing apparatus via the network; and

a send task executing unit which executes, if a send task is acquired from an apparatus executing a subsequent task, the send task and transmits the data required by the subsequent task to the apparatus executing the subsequent task.

2. The distributed processing system according to claim 1, wherein the communication task generator generates a receive task to allow the apparatus executing the task to receive the data transmitted from the source apparatus and generate input data of the task.

3. The distributed processing system according to claim 2, wherein when there are a plurality of source apparatuses, the communication task generator generates the send task for each of the plurality of source apparatuses and transmits the generated send tasks to the source apparatuses, and

wherein the receive task receives data transmitted from the plurality of source apparatuses and generates the input data.

4. The distributed processing system according to claim 2, wherein the receive task adjusts the timing for inputting the input data generated from the data received from the source apparatus.

5. The distributed processing system according to claim 2, wherein the receive task generates the input data by converting the data received from the source apparatus into a data format compatible with an input interface of the task.

6. The distributed processing system according to claim 2, the data processing apparatus further comprising:

a receive task executing unit which executes the receive task and transfers the input data, generated from the data received from the source apparatus, to the task executing unit.

7. The distributed processing system according to claim 6, wherein the task executing unit includes:

an input buffer which stores input data of the task; and

an output buffer which stores output data of the task,

wherein the receive task executing unit transfers the input data to the input buffer.

8. The distributed processing system according to claim 1, wherein the send task selects necessary data from among data stored in the source apparatus and transmits the selected data.

9. The distributed processing system according to claim 1, wherein a communication parameter is set in advance for the send task according to a processing capacity of the source apparatus or the apparatus executing the task or content of the data required by the task.

10. The distributed processing system according to claim 1,

wherein the application information acquiring unit acquires the information on an application by parsing a document including the information described in the markup language.

11. The distributed processing system according to claim 1, wherein the task is so designed as to be executable within the processing capacity of a single apparatus executing the task.

12. A distributed processing system, comprising:

a plurality of data processing apparatuses;

a distributed processing management apparatus, connected to the plurality of data processing apparatuses via a network, which manages the plurality of data processing apparatuses in a distributed processing of an application by the plurality of data processing apparatuses,

the distributed processing management apparatus including;

a processing capacity information acquiring unit which acquires, from the plurality of data processing apparatuses, information on the respective processing capacities of the data processing apparatuses via the network;

an application information acquiring unit which acquires information on an application that includes a plurality of tasks to be processed by the data processing apparatuses, the information including an execution sequence of the plurality of tasks contained in the application and information on transfer of data between the tasks;

a task distributing unit which determines which of the plurality of tasks contained in the application are to be processed by which of the data processing apparatuses, based on the information on the respective processing capacities of the data processing apparatuses acquired by the processing capacity information acquiring unit;

a task transmitting unit which transmits tasks to a data processing apparatus determined by the task distributing unit; and

a communication task generator which generates a send task to make a source apparatus of data required by the task transmit the data required by the task to an apparatus executing the task, and transmits the send task to the source apparatus, when the source apparatus is another apparatus, which is different from the apparatus executing the task, connected to the apparatus executing the task via a network, and

the data processing apparatus including;

a task acquiring unit which acquires the task;

a task executing unit which executes the task; and

a send task executing unit which executes, if a send task is acquired from the distributed processing management apparatus, the send task and transmits the data required by a subsequent task to the apparatus executing the subsequent task.

13. A data processing method, comprising:

acquiring, from a plurality of data processing apparatuses, information on the respective processing capacities of the data processing apparatuses via a network, when a distributed processing of an application is performed by the plurality of data processing apparatuses;

acquiring information on the application that includes a plurality of tasks to be processed by the data processing apparatuses, the information including an execution sequence of the plurality of tasks contained in the application and information on transfer of data between the tasks;

determining which of the plurality of tasks contained in the application are to be processed by which of the data processing apparatuses, based on the information on the respective processing capacities of the data processing apparatuses acquired;

transmitting tasks to a data processing apparatus determined; and

generating a send task to make a source apparatus of data required by the task transmit the data required by the task to an apparatus executing the task and transmitting the send task to the source apparatus, when the source apparatus is another apparatus, which is different from the apparatus executing the task, connected to the apparatus executing the task via a network.

14. A computer program product for processing data, embedded on a non-transitory computer-readable recording medium, the product comprising:

a first acquiring module which acquires, from a plurality of data processing apparatuses, information on the respective processing capacities of the data processing apparatuses via a network, when a distributed processing of an application is performed by the plurality of data processing apparatuses;

a second acquiring module which acquires information on the application that includes a plurality of tasks to be processed by the data processing apparatuses, the information including an execution sequence of the plurality of tasks contained in the application and information on transfer of data between the tasks;

a determining module which determines which of the plurality of tasks contained in the application are to be processed by which of the data processing apparatuses, based on the information on the respective processing capacities of the data processing apparatuses acquired;

a transmitting module which transmits tasks to a data processing apparatus determined; and

a generating module which generates a send task to make a source apparatus of data required by the task transmit the data required by the task to an apparatus executing the task, and transmits the send task to the source apparatus, when the source apparatus is another apparatus, which is different from the apparatus executing the task, connected to the apparatus executing the task via a network.

15. A distributed processing management apparatus, comprising:

a processing capacity information acquiring unit which acquires, from a plurality of data processing apparatuses, information on the respective processing capacities of the data processing apparatuses via a network, when a distributed processing of an application is performed by the plurality of data processing apparatuses;

an application information acquiring unit which acquires information on the application that includes a plurality of tasks to be processed by the data processing apparatuses, the information including an execution sequence of the plurality of tasks contained in the application and information on transfer of data between the tasks;

a task distributing unit which determines which of the plurality of tasks contained in the application are to be processed by which of the data processing apparatuses, based on the information on the respective processing capacities of the data processing apparatuses acquired;

a task transmitting unit which transmits the task to the data processing apparatus determined; and

a communication task generator which generates a send task to make a source apparatus of data required by the task transmit the data required by the task to an apparatus executing the task, and transmits the send task to the source apparatus, when the source apparatus is another apparatus, which is different from the apparatus executing the task, connected to the apparatus executing the task via a network.