GRAPHICS DISPLAY PROCESSING DEVICE, GRAPHICS DISPLAY PROCESSING METHOD, AND VEHICLE EQUIPPED WITH GRAPHICS DISPLAY PROCESSING DEVICE

• US 20150248742A1
• Filed: 05/22/2014
• Published: 09/03/2015
• Est. Priority Date: 06/03/2013
• Status: Active Grant

• Current Assignee: Sovereign Peak Ventures, LLC (Dominion Harbor Enterprises, LLC)
• Original Assignee: Panasonic Intellectual Property Corporation of America (Panasonic Holdings Corporation)
• Inventors: Yamamoto, Tetsuji, Saito, Masahiko, Kondoh, Takuya
• Granted Patent: US 9,741,090 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 2209/509 Offload
• CPC Class Codes: G06F 9/48 Program initiating; Program switching, e.g. by interrupt
• CPC Class Codes: G06F 9/5027 the resource being a machine, e.g. CPUs, Servers, Terminals
• CPC Class Codes: G06T 1/20 Processor architectures; Processor configuration, e.g. pipelining
• CPC Class Codes: G06T 1/60 Memory management
• CPC Class Codes: G09G 2360/08 Power processing, i.e. workload management for processors involved in display operations, such as CPUs or GPUs
• CPC Class Codes: G09G 2380/10 Automotive applications
• CPC Class Codes: G09G 5/003 Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto specific for a CRT G09G1/165; for a flat panel G09G3/2092
• CPC Class Codes: G09G 5/18 Timing circuits for raster scan displays specially adapted for television H04N ; synchronisation between the display unit and other display units, videodisc player G09G5/12
• CPC Class Codes: G09G 5/39 Control of the bit-mapped memory

Abstract

A graphics display processing device including: a graphics processor that executes GPU instructions based on a primary drawing instruction and a secondary drawing instruction; an acquirer) that acquires the primary drawing instruction and the secondary drawing instruction; an estimator that calculates an estimated GPU processing time required for executing the GPU instructions; a determiner that determines, using the estimated GPU processing time, which of the primary drawing instruction and the secondary drawing instruction is to be executed first; an issuance controller that performs a control when the primary drawing instruction is to be executed first, causing the primary drawing instruction to be issued and issuance of the secondary drawing instruction to be postponed; an instruction issuer that issues each drawing instruction according to the control of the issuance controller; and a graphics driver that generates the GPU instructions by executing each drawing instruction issued.

Claims

1. A graphics display processing device that displays, in a single frame, a primary graphic requiring immediate display and a secondary graphic not requiring immediate display, the graphics display processing device comprising:

a program storage that stores a primary drawing instruction specifying drawing of the primary graphic and a secondary drawing instruction specifying drawing of the secondary graphic;

a graphics processor that performs drawing processing by executing GPU instructions generated based on each drawing instruction;

an acquirer that acquires the primary drawing instruction and the secondary drawing instruction from the program storage;

an estimator that calculates an estimated GPU processing time required for the drawing processing by the graphics processor due to execution of the GPU instructions generated based on the primary drawing instruction or the secondary drawing instruction;

a determiner that determines, by using the estimated GPU processing time, which of the primary drawing instruction and the secondary drawing instruction is to be executed first;

an issuance controller that performs a control when the determiner determines that the primary drawing instruction is to be executed first, causing the primary drawing instruction to be issued and issuance of the secondary drawing instruction to be postponed;

an instruction issuer that issues each drawing instruction according to the control of the issuance controller; and

an instruction executor that generates the GPU instructions by executing each drawing instruction issued.

2. The graphics display processing device of claim 1, wherein

before GPU instructions based on the secondary drawing instruction are executed and within a single frame display unit time in which the GPU instructions are to be executed, execution is completed of GPU instructions generated based on a tertiary drawing instruction specifying a tertiary graphic not requiring immediate display,

the estimator calculates the estimated GPU processing time for execution of the GPU instructions based on the secondary drawing instruction, and

the determiner

stores a cumulative GPU processing time required for execution of the GPU instructions based on the tertiary drawing instruction,

calculates a total GPU processing time by summing the cumulative GPU processing time and the estimated GPU processing time, and

compares the total GPU processing time and a limit value of an acceptable processing time for drawing processing due to GPU instructions of a graphic not requiring immediate display, and when the total GPU processing time exceeds the limit value, determines that the primary drawing instruction is to be executed first within the frame display unit time.

3. The graphics display processing device of claim 1, wherein

the estimator calculates the estimated GPU processing time for execution of the GPU instructions based on the primary drawing instruction, and

the determiner

stores a start time of the GPU instructions generated based on the primary drawing instruction,

calculates an elapsed time from the start time to a current time,

calculates a remaining GPU processing time by subtracting the elapsed time from the estimated GPU processing time, and

compares the remaining GPU processing time and a priority threshold value assigned to the primary drawing instruction, and when the remaining GPU processing time is less than the priority threshold value, determines that the primary drawing instruction is to be executed first.

4. The graphics display processing device of claim 1, wherein

before GPU instructions based on the primary drawing instruction are executed and within a single frame display unit time in which the GPU instructions are to be executed, execution is completed of GPU instructions generated based on a tertiary drawing instruction specifying a tertiary graphic requiring immediate display,

the estimator calculates the estimated GPU processing time for execution of the GPU instructions based on the primary drawing instruction, and

the determiner

stores a cumulative GPU processing time required for execution of the GPU instructions based on the tertiary drawing instruction,

calculates a total GPU processing time by summing the cumulative GPU processing time and the estimated GPU processing time, and

compares the total GPU processing time and a priority threshold value assigned to the primary drawing instruction, and when the estimated GPU processing time is less than the priority threshold value, determines that the primary drawing instruction is to be executed first.

5. The graphics display processing device of claim 1, wherein

the estimator further calculates an estimated CPU processing time for processing by the instruction executor due to execution of the primary drawing instruction and the secondary drawing instruction, and

the determiner uses the estimated CPU processing time and the estimated GPU processing time when determining which of the primary drawing instruction and the secondary drawing instruction is to be executed first.

6. The graphics display processing device of claim 5, wherein

before the secondary drawing instruction and the GPU instructions based on the secondary drawing instruction are executed and within a single frame display unit time in which the secondary drawing instruction and the GPU instructions are to be executed, execution is completed of a tertiary drawing instruction and GPU instructions generated based on the tertiary drawing instruction, the tertiary drawing instruction specifying a tertiary graphic not requiring immediate display,

the estimator calculates the estimated GPU processing time due to execution of the GPU instructions based on the secondary drawing instruction and further calculates an estimated CPU processing time for processing by the instruction executor due to execution of the secondary drawing instruction, and

the determiner

stores a cumulative CPUGPU processing time required for execution of the tertiary drawing instruction by the instruction executor and execution of the GPU instructions based on the tertiary drawing instruction by the graphics processor,

calculates a total CPUGPU processing time by summing the cumulative CPUGPU processing time, the estimated CPU processing time, and the estimated GPU processing time, and

compares the total CPUGPU processing time and a limit value of an acceptable processing time for processing due to drawing instructions and drawing processing due to the GPU instructions of a graphic not requiring immediate display, and when the total CPUGPU processing time exceeds the limit value, determines that the primary drawing instruction is to be executed first within the single frame display unit time.

7. The graphics display processing device of claim 5, wherein

the estimator calculates the estimated GPU processing time due to execution of the GPU instructions based on the primary drawing instruction and further calculates an estimated CPU processing time for processing by the instruction executor due to execution of the primary drawing instruction, and

the determiner

stores a start time of the primary drawing instruction,

calculates an elapsed time from the start time to a current time,

calculates a sum value that is a sum of the estimated GPU processing time and the estimated CPU processing time,

calculates a remaining CPUGPU processing time by subtracting the elapsed time from the sum time, and

compares the remaining CPUGPU processing time and a priority threshold value assigned to the primary drawing instruction and the GPU instructions based on the primary drawing instruction, and when the remaining CPUGPU processing time is less than the priority threshold value, determines that the primary drawing instruction is to be executed first.

8. The graphics display processing device of claim 5, wherein

before the primary drawing instruction and the GPU instructions based on the primary drawing instruction are executed and within a single frame display unit time in which the primary drawing instruction and the GPU instructions are to be executed, execution is completed of a tertiary drawing instruction and GPU instructions generated based on the tertiary drawing instruction specifying a tertiary graphic requiring immediate display,

the estimator calculates the estimated GPU processing time due to execution of the GPU instructions based on the primary drawing instruction and further calculates an estimated CPU processing time for processing by the instruction executor due to execution of the primary drawing instruction, and

the determiner

stores a cumulative CPUGPU processing time required for execution of the tertiary drawing instruction by the instruction executor and execution of the GPU instructions based on the tertiary drawing instruction by the graphics processor,

calculates a total CPUGPU processing time by summing the cumulative CPUGPU processing time, the estimated CPU processing time, and the estimated GPU processing time, and

compares the total CPUGPU processing time and a priority threshold value assigned to the primary drawing instruction and the GPU instructions based on the primary drawing instruction, and when the total CPUGPU processing time is less than the priority threshold value, determines that the primary drawing instruction is to be executed first.

9. The graphics display processing device of claim 1, further comprises:

a prioritizer that sets a priority of the primary drawing instruction higher than a priority of the second drawing instruction when the determiner determines that the primary drawing instruction is to be executed first; and

a task scheduler that controls acquisition by the acquirer according to the priority set by the prioritizer.

10. The graphics display processing device of claim 1 installed in a vehicle, wherein

The primary graphic is one of a graphic indicating speed at which the vehicle is travelling, a graphic indicating revolutions of an engine or motor included in the vehicle, a graphic indicating an alert pertaining to a mechanism, equipment, or machinery included in the vehicle, and a graphic indicating an alert pertaining to traffic conditions around the vehicle while the vehicle is in motion, and the secondary graphic is a map graphic for guiding a driver of the vehicle.

11. A graphics display processing method used in a graphics display processing device that displays, in a single frame, a primary graphic requiring immediate display and a secondary graphic not requiring immediate display, the graphics display processing device including:

a program storage that stores a primary drawing instruction specifying drawing of the primary graphic and a secondary drawing instruction specifying drawing of the secondary graphic; and

a graphics processor that performs drawing processing by executing GPU instructions generated based on each drawing instruction, wherein

the graphics display processing method comprises;

acquiring the primary drawing instruction and the secondary drawing instruction from the program storage;

calculating an estimated GPU processing time required for the drawing processing by the graphics processor due to execution of the GPU instructions generated based on the primary drawing instruction or the secondary drawing instruction;

determining, by using the estimated GPU processing time, which of the primary drawing instruction and the secondary drawing instruction is to be executed first;

performing a control when determining that the primary drawing instruction is to be executed first, causing the primary drawing instruction to be issued and issuance of the secondary drawing instruction to be postponed;

issuing each drawing instruction according to the control; and

generating the GPU instructions by executing each drawing instruction issued.

12. An integrated circuit comprising a graphics display processing device that displays, in a single frame, a primary graphic requiring immediate display and a secondary graphic not requiring immediate display, the integrated circuit comprising:

a program storage that stores a primary drawing instruction specifying drawing of the primary graphic and a secondary drawing instruction specifying drawing of the secondary graphic;

a graphics processor that performs drawing processing by executing GPU instructions generated based on each drawing instruction;

an acquirer that acquires the primary drawing instruction and the secondary drawing instruction from the program storage;

an estimator that calculates an estimated GPU processing time required for the drawing processing by the graphics processor due to execution of the GPU instructions generated based on the primary drawing instruction or the secondary drawing instruction;

a determiner that determines, by using the estimated GPU processing time, which of the primary drawing instruction and the secondary drawing instruction is to be executed first;

an issuance controller that performs a control when the determiner determines that the primary drawing instruction is to be executed first, causing the primary drawing instruction to be issued and issuance of the secondary drawing instruction to be postponed;

an instruction issuer that issues each drawing instruction according to the control of the issuance controller; and

an instruction executor that generates the GPU instructions by executing each drawing instruction issued.

13. A vehicle equipped with a graphics display processing device that displays, in a single frame, a primary graphic requiring immediate display and a secondary graphic not requiring immediate display, wherein

the graphics display processing device comprises:

a program storage that stores a primary drawing instruction specifying drawing of the primary graphic and a secondary drawing instruction specifying drawing of the secondary graphic;

a graphics processor that performs drawing processing by executing GPU instructions generated based on each drawing instruction;

an acquirer that acquires the primary drawing instruction and the secondary drawing instruction from the program storage;

an estimator that calculates an estimated GPU processing time required for the drawing processing by the graphics processor due to execution of the GPU instructions generated based on the primary drawing instruction or the secondary drawing instruction;

a determiner that determines, by using the estimated GPU processing time, which of the primary drawing instruction and the secondary drawing instruction is to be executed first;

an issuance controller that performs a control when the determiner determines that the primary drawing instruction is to be executed first, causing the primary drawing instruction to be issued and issuance of the secondary drawing instruction to be postponed;

an instruction issuer that issues each drawing instruction according to the control of the issuance controller; and

an instruction executor that generates the GPU instructions by executing each drawing instruction issued.