Computing system capable of parallelizing the operation of multiple graphics processing units (GPUS) supported on a CPU/GPU fusion-type chip and/or multiple GPUS supported on an external graphics card

• US 20080100629A1
• Filed: 09/26/2007
• Published: 05/01/2008
• Est. Priority Date: 11/19/2003
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Lucid Information Technology, Ltd.
• Inventors: Bakalash, Reuven, Leviathan, Yaniv
• Granted Patent: US 7,944,450 B2
• Time in Patent Office: Days
• US Class Current: 345/505
• CPC Class Codes: G06F 2209/501 Performance criteria
• CPC Class Codes: G06F 9/5044 considering hardware capabilities
• CPC Class Codes: G06T 1/20 Processor architectures; Processor configuration, e.g. pipelining
• CPC Class Codes: G06T 15/005 General purpose rendering architectures
• CPC Class Codes: G06T 2210/52 Parallel processing

Abstract

A computing system capable of parallelizing the operation of multiple graphics processing units (GPUs) supported on a hybrid CPU/GPU fusion-architecture chip and/or on an external graphics card, and employing a multi-mode parallel graphics rendering subsystem having software and hardware implemented components. The computing system includes (i) CPU memory space for storing one or more graphics-based applications, (ii) one or more CPUs for executing the graphics-based applications, (iii) a multi-mode parallel graphics rendering subsystem supporting multiple modes of parallel operation, (iv) a plurality of graphic processing pipelines (GPPLs), implemented using the GPUs, and (vi) an automatic mode control module. During the run-time of the graphics-based application, the automatic mode control module automatically controls the mode of parallel operation of the multi-mode parallel graphics rendering subsystem so that the GPUs are driven in a parallelized manner.

Claims

1. A computing system capable of parallelizing the operation of one or more GPUs supported on a hybrid CPU/GPU fusion chip and one or more GPUs supported on external graphics cards, said computing system comprising:

CPU memory space for storing one or more graphics-based applications and a graphics library for generating graphics commands and data (GCAD) during the execution of said graphics-based application;

a CPU/GPU fusion-architecture chip having one or more GPUs, an interconnect network, and a memory controller for controlling access to said CPU memory space;

an external graphics cards supporting one or more GPUs, and operably connected to said interconnect network by way of a data communication interface;

wherein said external graphics card is connected to said CPU/GPU fusion-architecture chip by way of a data communication interface;

a multi-mode parallel graphics rendering subsystem supporting multiple modes of parallel operation selected from the group consisting of object division, image division, and time division, and wherein each mode of parallel operation includes at least three stages, namely, decomposition, distribution and recomposition; and

a plurality of graphic processing pipelines (GPPLs), implemented using said GPUs, and supporting a parallel graphics rendering process that employs one or more of said object division, image division and/or time division modes of parallel operation in order to execute graphic commands, process graphics data, and render pixel-composited images containing graphics for display on a display device during the run-time of said graphics-based application, and said display device being connectable to said external graphics card.

2. The computing system of claim 1, which further comprises:

an automatic mode control module for automatically controlling the mode of parallel operation of said multi-mode parallel graphics rendering subsystem during the run-time of said graphics-based application so that said GPUs are driven in a parallelized manner during the run-time of said graphics-based application.

3. The computing system of claim 2, wherein said multi-mode parallel graphics rendering subsystem further includes:

(i) first and second decomposition submodules for supporting the decomposition stage of parallel operation;

(ii) a distribution module for supporting the distribution stage of parallel operation; and

(iii) a recomposition module for supporting the recomposition stage of parallel operations.

4. The computing system of claim 2, wherein said automatic mode control module employs profiling of scenes in said graphics-based application.

5. The computing system of claim 4, wherein said profiling of scenes in said graphics-based application, is carried out in real-time during run-time of said graphics-based application.

6. The computing system of claim 5, wherein said real-time profiling of scenes in said graphics-based application involves (i) collecting and analyzing performance data associated with said multi-mode parallel graphics rendering subsystem and said computing system, during application run-time, (ii) constructing scene profiles for the image frames associated with particular scenes in said particular graphics-based application, and (iii) maintaining said scene profiles in a application/scene profile database that is accessible to said automatic mode control module during run-time, so that during the run-time of said graphics-based application, said automatic mode control module can access and use said scene profiles maintained in said application/scene profile Database and determine how to dynamically control the modes of parallel operation of said multi-mode parallel graphics rendering subsystem to optimize system performance.

7. The computing system of claim 5, wherein said automatic mode control module employs real-time detection of scene profile indices programmed within pre-profiled scenes of said graphics-based application;

wherein said pre-profiled scenes are analyzed prior to run-time, and indexed with said scene profile indices; and

wherein and mode control parameters (MCPs) corresponding to said scene profile indices, are stored within an application/scene profile Database accessible to said automatic mode control module during application run-time.

8. The computing system of claim 7, wherein during run-time, said automatic mode control module automatically detects said scene profile indices and uses said detected said scene profile indices to access corresponding MCPs from said application/scene profile database so as to determine how to dynamically control the modes of parallel operation of said multi-mode parallel graphics rendering subsystem to optimize system performance.

9. The computing system of claim 4, wherein said automatic mode control module employs real-time detection of mode control commands (MCCs) programmed within pre-profiled scenes of said graphics-based application;

wherein said pre-profiled scenes are analyzed prior to run-time, and said MCCs are directly programmed within the individual image frames of each scene; and

wherein during run-time, said automatic mode control module automatically detects said MCCs along the graphics command and data stream, and uses said MCCs so as to determine how to dynamically control the modes of parallel operation of said multi-mode parallel graphics rendering subsystem to optimize system performance.

10. The computing system of claim 2, wherein said automatic mode control module employs a user interaction detection (UID) mechanism for real-time detection of the user'"'"'s interaction with said computing system.

11. The computing system of claim 10, wherein, in conjunction with said scene profiling, said automatic mode control module also uses said UID mechanism to determine how to dynamically control the modes of parallel operation of the multi-mode parallel graphics rendering subsystem to optimize system performance, at any instance in time during the run-time of said graphics-based application.

12. The computing system of claim 1, wherein said hybrid CPU/GPU fusion-architecture chip has only one GPU.

13. The computing system of claim 1, wherein said hybrid CPU/GPU fusion-architecture chip has multiple GPUs.

14. The computing system of claim 1, wherein said display device is a device selected from the group consisting of an flat-type display panel, a projection-type display panel, and other image display devices.

15. The computing system of claim 1, wherein said computing system is a machine selected from the group consisting of a PC-level computer, information server, laptop, game console system, portable computing system, and any computational-based machine supporting the real-time generation and display of 3D graphics.

16. The computing system of claim 3, wherein said automatic mode control module and said first decomposition submodule are each implemented as a software package in said CPU memory space;

and wherein said second decomposition submodule, said distribution module and said recomposition module are each implemented within said hybrid CPU/GPU fusion-architecture chip, and are in operable communication with said automatic mode control module in said CPU memory space by way of said interconnect network and said memory controller.

17. The computing system of claim 16, wherein said each said software package is implemented in said CPU memory space.

18. The computing system of claim 16, wherein during operation,

(i) said first decomposition submodule divides the stream of graphic commands and data according to the required parallelization mode, operative at any instant in time;

(ii) said second decomposition submodule receives the stream of graphic commands and data from said first decomposition submodule;

(iii) said distribution module uses said interconnect network to distribute graphic commands and data to said multiple GPUs,

(iv) said recomposition module uses said interconnect network to transfer composited pixel data between said recomposition module and said multiple GPUs during said recomposition stage, and

(v) finally recomposited pixel data sets are displayed as graphical images on said display device.

19. The computing system of claim 3, wherein said automatic mode control module and said first decomposition submodule are each implemented as a software package in said CPU memory space;

wherein said second decomposition submodule and said distribution module are each implemented within said hybrid CPU/GPU fusion-architecture chip, and are in operable communication with said automatic mode control module in said CPU memory space by way of said interconnect network and said memory controller; and

wherein said recomposition module is implemented across two or more of said GPUs in said hybrid CPU/GPU fusion-architecture chip.

20. The computing system of claim 19, wherein said each said software package is implemented in said CPU memory space.

21. The computing system of claim 19, wherein during operation,

(i) said first decomposition submodule divides the stream of graphic commands and data according to the required parallelization mode, operative at any instant in time;

(ii) said second decomposition submodule receives the stream of graphic commands and data from said first decomposition submodule;

(iii) said distribution module uses said interconnect network to distribute graphic commands and data to said multiple GPUs,

(iv) said recomposition module uses inter-GPU communication to transfer composited pixel data between said recomposition module and said multiple GPUs during said recomposition stage, and

(v) finally recomposited pixel data sets are displayed as graphical images on said display device.

22. The computing system of claim 18, wherein only one of said GPUs is designated as the primary GPU and is responsible for driving said display unit with a final pixel image composited within a frame buffer (FB) maintained by said primary GPU, and all other GPUs function as secondary GPUs, supporting the pixel image recompositioning process.

23. The computing system of claim 21, wherein only one of said GPUs is designated as the primary GPU and is responsible for driving said display unit with a final pixel image composited within a frame buffer (FB) maintained by said primary GPU, and all other GPUs function as secondary GPUs, supporting the pixel image recompositioning process.