PC-based computing system employing multiple graphics processing units (GPUS) interfaced with the central processing unit (CPU) using a PC bus and a hardware hub, and parallelized according to the object division mode of parallel operation

• US 7,796,130 B2
• Filed: 10/23/2007
• Issued: 09/14/2010
• Est. Priority Date: 11/19/2003
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Lucid Information Technology, Ltd.
• Inventors: Bakalash, Reuven, Fogel, Efi, Remez, Offir, Shaham, Amir, Bar-or, Gigy
• Primary Examiner(s): Nguyen, Hau H
• Application Number:
  US11/977,177
• Publication Number:
  US 20080165184A1
• Time in Patent Office: 1,057 Days
• Field of Search: 345502-506, 345/519, 345/520, 345/419, 345/522
• US Class Current: 345/419
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06F 3/1438 using more than one graphics controller
• CPC Class Codes: G06F 9/505 considering the load
• CPC Class Codes: G06T 1/20 Processor architectures; Processor configuration, e.g. pipelining
• CPC Class Codes: G06T 15/005 General purpose rendering architectures
• CPC Class Codes: G06T 2200/28 involving image processing hardware
• CPC Class Codes: G09G 5/363 Graphics controllers

Abstract

A PC-based computing system capable of displaying images of 3-D objects during an interactive process between said computing system and a user thereof. The PC-based computing system includes a graphics processing subsystem having a plurality of GPUs arranged in a parallel architecture and operating according to an object division mode of parallel operation so that each GPU supports a graphics pipeline for processing data in a parallel manner according to the object division mode. A hardware hub, interfaces with a CPU interface module and the GPUs, and has a hub router for (i) distributing the stream of geometrical data and graphic commands among the GPUs, and (ii) transferring pixel data output from one or more of GPUs during the composition of frames of pixel data corresponding to final images for display on the display surface. A CPU interface module provides an interface between one or more software hub drivers and the hardware hub.

Claims

1. A PC-based computing system comprising:

a system memory for storing software graphics applications, software drivers and graphics libraries, and;

an operating system (OS), stored in said system memory;

one or more graphics applications, stored in said system memory, for generating a stream of geometrical data and graphics commands supporting (i) the representation of one or more 3D objects in a scene having 3D geometrical characteristics and (ii) the viewing of images of said one or more 3D objects in said scene during an interactive process carried out between said PC-based computing system and a user of said PC-based computing system;

one or more graphic libraries, stored in said system memory, for storing data used to implement said stream of geometrical data and graphics commands;

a central processing unit (CPU), for executing said OS, said one or more graphics applications, said drivers and said graphics libraries;

an CPU interface module for interfacing with said CPU;

a PC bus;

a graphics processing subsystem interfaced with said CPU interface module by way of said PC bus; and

a display surface for displaying said images by graphically displaying frames of pixel data produced by said graphics processing subsystem;

wherein said parallel graphics processing subsystem includes;

a plurality of graphic processing units (GPUs) arranged in a parallel architecture and operating according to an object division mode of parallel operation so that said GPUs support multiple graphics pipelines and process data in a parallel manner;

one or more GPU drivers, stored in said system memory, for allowing said GPUs to interact with said graphic libraries;

one or more software hub drivers, stored in said system memory;

a hardware hub, interfacing with said CPU interface module and said GPUs by way of said PC bus, and including a hub router for (i) distributing the stream of geometrical data and graphic commands among said GPUs according to said objective division mode, and (ii) transferring pixel data output from one or more of said GPUs during the composition of frames of pixel data corresponding to final images for display on said display surface;

wherein said CPU interface module provides an interface between said one or more software hub drivers and said hardware hub;

wherein said one or more software hub drivers perform the following functions;

(i) controlling the operation of said hardware hub,

(ii) interacting with said OS and said graphic libraries,

(iii) analyzing said stream of geometrical data and said graphics commands, and

(iv) forwarding said stream of geometrical data and graphic commands, or a portion thereof, to each said GPUs over said PC bus; and

wherein, for each image of said 3D object to be generated and displayed on said display surface, the following operations are performed;

(i) said hardware hub uses said hub router and said PC bus to distribute said stream of geometrical data and graphic commands, or a portion thereof, to said GPUs,

(ii) said GPUs process said stream of geometrical data and graphic commands, or a portion thereof, during the generation of each said frame, while operating in said object division mode, so as to generate pixel data corresponding to at least a portion of said image, and

(iii) said hardware hub uses said hub router and said PC bus to transfer said pixel data output from one or more of said GPUs and compose a frame of pixel data, representative of the image of said 3D object, for display on said display surface.

2. The PC-based computing system of claim 1, wherein said CPU interface module comprises an I/O chipset.

3. The PC-based computing system of claim 2, wherein said CPU interface module comprises an I/O chip or chipset.

4. The PC-based computing system of claim 1, wherein each said GPU has a frame buffer (FB) for storing a fragment of pixel data.

5. The PC-based computing system of claim 1, wherein said geometrical data comprises a set of scene polygons or vertices.

6. The PC-based computing system of claim 1, wherein said graphics commands includes commands selected from the group consisting of display lists, display vertex arrays, and alpha blending.

7. The PC-based computing system of claim 1, wherein said hardware hub further comprises a control unit for accepting commands from said one or more software hub drivers, over said PC bus, and controlling components within said hardware hub, including said hub router.

8. The PC-based computing system of claim 1, wherein said hub router routes said stream of geometrical data and graphic commands from said one or more graphics applications to one or more of said GPUs, and wherein said hub router routes pixel data results from said GPUs during the composition of said frame of pixel data.

9. The PC-based computing system of claim 1, wherein said hardware hub further comprises a memory unit for storing intermediate processing results from one or more of said multiple GPUs and data required for composition and transferring frames of pixel data for display.

10. The PC-based computing system of claim 1, wherein said one or more software hub drivers control said GPUs while said hardware hub operates transparently to said one or more graphics applications so that said multiple GPUs appear as only a single GPU to said one or more graphics applications.

11. The PC-based computing system of claim 1, wherein said one or more software hub drivers coordinate the operation of said GPUs so generate a continuous sequence of frames of pixel data for displaying a sequence of images of said 3D object on said display surface.

12. The PC-based computing system of claim 1, wherein said hardware hub handles multiple bus paths between said CPU and said GPUs.

13. The PC-based computing system of claim 1, wherein during said object division mode of parallel operation, the 3D object which is to be displayed as an image consisting of a frame of pixels, is decomposed into said stream of geometrical data and graphic commands which are distributed to said GPUs for rendering the frames of pixel data compositing the images to be displayed on said display surface.

14. The PC-based computing system of claim 1, wherein each said 3D object is decomposable into a plurality of polygons, and wherein said geometrical data comprises the vertices of said polygons.

15. The PC-based computing system of claim 1, wherein each pixel associated with a frame of pixel data includes attributes selected from the group consisting of color, alpha, position, depth, and stencil.

16. A PC-based computing system comprising:

system memory for storing software graphics applications, software drivers and graphics libraries, and;

an operating system (OS), stored in said system memory;

one or more graphics applications, stored in said system memory, for generating a stream of geometrical data and graphics commands supporting (i) the representation of one or more 3D objects in a scene having 3D geometrical characteristics and (ii) the viewing of images of said one or more 3D objects in said scene during an interactive process carried out between said PC-based computing system and a user of said PC-based computing system;

one or more graphic libraries, stored in said system memory, for storing data used to implement said stream of geometrical data and graphics commands;

a central processing unit (CPU), for executing said OS, said one or more graphics applications, said drivers and said graphics libraries;

an CPU interface module for interfacing with said CPU;

a graphics processing subsystem interfaced with said CPU interface module; and

a display surface for displaying said images by graphically displaying frames of pixel data produced by said graphics processing subsystem;

wherein said parallel graphics processing subsystem includes;

a plurality of graphic processing units (GPUs) arranged in a parallel architecture and operating according to an object division mode of parallel operation so that said GPUs support multiple graphics pipelines and process data in a parallel manner;

one or more GPU drivers, stored in said system memory, for allowing said GPUs to interact with said graphic libraries;

one or more software hub drivers, stored in said system memory;

a hardware hub, interfacing with said CPU interface module and said GPUs, and including a hub router for (i) distributing the stream of geometrical data and graphic commands among said GPUs according to said objective division mode, and (ii) transferring pixel data output from one or more of said GPUs during the composition of frames of pixel data corresponding to final images for display on said display surface;

wherein said CPU interface module provides an interface between said one or more software hub drivers and said hardware hub;

wherein said one or more software hub drivers perform the following functions;

(i) controlling the operation of said hardware hub,

(ii) interacting with said OS and said graphic libraries,

(iii) analyzing said stream of geometrical data and said graphics commands, and

(iv) forwarding said stream of geometrical data and graphic commands, or a portion thereof, to each said GPUs;

wherein, for each image of said 3D object to be generated and displayed on said display surface, the following operations are performed;

(i) said hardware hub uses said hub router to distribute said stream of geometrical data and graphic commands, or a portion thereof, to said GPUs,

(ii) said GPUs process said stream of geometrical data and graphic commands, or a portion thereof, during the generation of each said frame, while operating in said object division mode, so as to generate pixel data corresponding to at least a portion of said image, and

(iii) said hardware hub uses said hub router to transfer said pixel data output from one or more of said GPUs and compose a frame of pixel data, representative of the image of said 3D object, for display on said display surface; and

wherein said one or more software hub drivers control said GPUs while said hardware hub operates transparently to said graphics application so that said multiple GPUs appear as only a single GPU to said graphics application.

17. The PC-based computing system of claim 16, wherein said CPU interface module comprises an I/O chipset.

18. The PC-based computing system of claim 17, wherein said CPU interface module comprises an I/O chip or chipset.

19. The PC-based computing system of claim 16, wherein each said GPU has a frame buffer (FB) for storing a fragment of pixel data.

20. The PC-based computing system of claim 16, wherein said geometrical data comprises a set of scene polygons or vertices.

21. The PC-based computing system of claim 16, wherein said graphics commands includes commands selected from the group consisting of display lists, display vertex arrays, and alpha blending.

22. The PC-based computing system of claim 16, wherein said hardware hub further comprises a control unit for accepting commands from said one or more software hub drivers, over said PC bus, and controlling components within said hardware hub, including said hub router.

23. The PC-based computing system of claim 16, wherein said hub router routes said stream of geometrical data and graphic commands from said one or more graphics applications to one or more of said GPUs, and wherein said hub router routes pixel data results from said GPUs during the composition of said frame of pixel data.

24. The PC-based computing system of claim 16, wherein said hardware hub further comprises a memory unit for storing intermediate processing results from one or more of said multiple GPUs and data required for composition and transferring frames of pixel data for display.

25. The PC-based computing system of claim 16, wherein said one or more software hub drivers control said GPUs while said hardware hub operates transparently to said one or more graphics applications so that said multiple GPUs appear as only a single GPU to said one or more graphics applications.

26. The PC-based computing system of claim 16, wherein said one or more software hub drivers coordinate the operation of said GPUs so generate a continuous sequence of frames of pixel data for displaying a sequence of images of said 3D object on said display surface.

27. The PC-based computing system of claim 16, wherein said hardware hub handles multiple bus paths between said CPU and said GPUs.

28. The PC-based computing system of claim 16, wherein during said object division mode of parallel operation, the 3D object which is to be displayed as an image consisting of a frame of pixels, is decomposed into said stream of geometrical data and graphic commands which are distributed to said GPUs for rendering the frames of pixel data compositing the images to be displayed on said display surface.

29. The PC-based computing system of claim 16, wherein each said 3D object is decomposable into a plurality of polygons, and wherein said geometrical data comprises the vertices of said polygons.

30. The PC-based computing system of claim 16, wherein each pixel associated with a frame of pixel data includes attributes selected from the group consisting of color, alpha, position, depth, and stencil.