Graphics display processing device, graphics display processing method, and vehicle equipped with graphics display processing device

• US 9,741,090 B2
• Filed: 05/22/2014
• Issued: 08/22/2017
• Est. Priority Date: 06/03/2013
• Status: Expired due to Fees

• Current Assignee: Sovereign Peak Ventures, LLC (Dominion Harbor Enterprises, LLC)
• Original Assignee: Panasonic Intellectual Property Corporation of America (Panasonic Holdings Corporation)
• Inventors: Yamamoto, Tetsuji, Saito, Masahiko, Kondoh, Takuya
• Primary Examiner(s): Xiao, Ke
• Assistant Examiner(s): TRAN, KIM THANH THI
• Application Number:
  US14/427,651
• Publication Number:
  US 20150248742A1
• Time in Patent Office: 1,188 Days
• Field of Search: 345522
• CPC Class Codes: G06F 2209/509 Offload
• CPC Class Codes: G06F 9/48 Program initiating; Program switching, e.g. by interrupt
• CPC Class Codes: G06F 9/5027 the resource being a machine, e.g. CPUs, Servers, Terminals
• CPC Class Codes: G06T 1/20 Processor architectures; Processor configuration, e.g. pipelining
• CPC Class Codes: G06T 1/60 Memory management
• CPC Class Codes: G09G 2360/08 Power processing, i.e. workload management for processors involved in display operations, such as CPUs or GPUs
• CPC Class Codes: G09G 2380/10 Automotive applications
• CPC Class Codes: G09G 5/003 Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto specific for a CRT G09G1/165; for a flat panel G09G3/2092
• CPC Class Codes: G09G 5/18 Timing circuits for raster scan displays specially adapted for television H04N ; synchronisation between the display unit and other display units, videodisc player G09G5/12
• CPC Class Codes: G09G 5/39 Control of the bit-mapped memory

Abstract

A graphics display processing device including: a graphics processor that executes GPU instructions based on a primary drawing instruction and a secondary drawing instruction; an acquirer) that acquires the primary drawing instruction and the secondary drawing instruction; an estimator that calculates an estimated GPU processing time required for executing the GPU instructions; a determiner that determines, using the estimated GPU processing time, which of the primary drawing instruction and the secondary drawing instruction is to be executed first; an issuance controller that performs a control when the primary drawing instruction is to be executed first, causing the primary drawing instruction to be issued and issuance of the secondary drawing instruction to be postponed; an instruction issuer that issues each drawing instruction according to the control of the issuance controller; and a graphics driver that generates the GPU instructions by executing each drawing instruction issued.

Claims

1. A graphics display processing device that displays, in a single frame, a primary graphic requiring immediate display and a secondary graphic not requiring immediate display, the graphics display processing device comprising:

a program storage that stores a primary drawing instruction specifying drawing of the primary graphic and a secondary drawing instruction specifying drawing of the secondary graphic;

a graphics processor that performs drawing processing by executing graphics instructions generated based on each drawing instruction;

an acquirer that acquires the primary drawing instruction and the secondary drawing instruction from the program storage;

an estimator that calculates an estimated graphics processing time required for the drawing processing by the graphics processor due to execution of the graphics instructions generated based on the secondary drawing instruction;

a determiner that determines, by using the estimated graphics processing time, which of the primary drawing instruction and the secondary drawing instruction is to be executed first;

an issuance controller that performs a control when the determiner determines that the primary drawing instruction is to be executed first, causing the primary drawing instruction to be issued and issuance of the secondary drawing instruction to be postponed;

an instruction issuer that issues each drawing instruction according to the control of the issuance controller; and

an instruction executor that generates the graphics instructions by executing each drawing instruction issued by the instruction issuer, wherein

before graphics instructions based on the secondary drawing instruction are executed and within a single frame display unit time in which the graphics instructions are to be executed, execution is completed of graphics instructions generated based on a tertiary drawing instruction specifying a tertiary graphic not requiring immediate display, and

the determiner

stores a cumulative graphics processing time required for execution of the graphics instructions based on the tertiary drawing instruction,

calculates a total graphics processing time by summing the cumulative graphics processing time and the estimated graphics processing time, and

compares the total graphics processing time and a limit value of an acceptable processing time for drawing processing due to graphics instructions of a graphic not requiring immediate display, and when the total graphics processing time exceeds the limit value, determines that the primary drawing instruction is to be executed first within the frame display unit time.

3. The graphics display processing device of claim 1, wherein

before graphics instructions based on the primary drawing instruction are executed and within the single frame display unit time in which the graphics instructions are to be executed, execution is completed of the graphics instructions generated based on the tertiary drawing instruction specifying the tertiary graphic requiring immediate display,

the estimator further calculates the estimated graphics processing time for execution of the graphics instructions based on the primary drawing instruction, and

the determiner

compares the total graphics processing time and a priority threshold value assigned to the primary drawing instruction, and when the estimated graphics processing time is less than the priority threshold value, determines that the primary drawing instruction is to be executed first.

4. The graphics display processing device of claim 1, wherein

the estimator further calculates an estimated central processing time for processing by the instruction executor due to execution of the primary drawing instruction and the secondary drawing instruction, and

the determiner uses the estimated central processing time and the estimated graphics processing time when determining which of the primary drawing instruction and the secondary drawing instruction is to be executed first.

5. The graphics display processing device of claim 4, wherein

before the secondary drawing instruction and the graphics instructions based on the secondary drawing instruction are executed and within the single frame display unit time in which the secondary drawing instruction and the graphics instructions are to be executed, execution is completed of the tertiary drawing instruction and graphics instructions generated based on the tertiary drawing instruction,

the estimator further calculates an estimated CPU central processing time for processing by the instruction executor due to execution of the secondary drawing instruction, and

the determiner

stores a cumulative combined processing time required for execution of the tertiary drawing instruction by the instruction executor and execution of the graphics instructions based on the tertiary drawing instruction by the graphics processor,

calculates a total combined processing time by summing the cumulative combined processing time, the estimated central processing time, and the estimated graphics processing time, and

compares the total combined processing time and the limit value of the acceptable processing time for processing due to drawing instructions and the drawing processing due to the graphics instructions of the graphic not requiring immediate display, and when the total combined processing time exceeds the limit value, determines that the primary drawing instruction is to be executed first within the single frame display unit time.

6. The graphics display processing device of claim 4, wherein

the estimator further calculates the estimated graphics processing time due to execution of the graphics instructions based on the primary drawing instruction and further calculates an estimated central processing time for processing by the instruction executor due to execution of the primary drawing instruction, and

the determiner

stores a start time of the primary drawing instruction,

calculates an elapsed time from the start time to a current time,

calculates a sum value that is a sum of the estimated graphics processing time and the estimated central processing time,

calculates a remaining combined processing time by subtracting the elapsed time from the sum time, and

compares the remaining combined processing time and a priority threshold value assigned to the primary drawing instruction and the graphics instructions based on the primary drawing instruction, and when the remaining combined processing time is less than the priority threshold value, determines that the primary drawing instruction is to be executed first.

7. The graphics display processing device of claim 4, wherein

before the primary drawing instruction and the graphics instructions based on the primary drawing instruction are executed and within the single frame display unit time in which the primary drawing instruction and the graphics instructions are to be executed, execution is completed of the tertiary drawing instruction and graphics instructions generated based on the tertiary drawing instruction specifying the tertiary graphic requiring immediate display,

the estimator calculates the estimated graphics processing time due to execution of the graphics instructions based on the primary drawing instruction and further calculates an estimated central processing time for processing by the instruction executor due to execution of the primary drawing instruction, and

the determiner

stores a cumulative combined processing time required for execution of the tertiary drawing instruction by the instruction executor and execution of the graphics instructions based on the tertiary drawing instruction by the graphics processor,

calculates a total combined processing time by summing the cumulative combined processing time, the estimated central processing time, and the estimated graphics processing time, and

compares the total combined processing time and a priority threshold value assigned to the primary drawing instruction and the graphics instructions based on the primary drawing instruction, and when the total combined processing time is less than the priority threshold value, determines that the primary drawing instruction is to be executed first.

8. The graphics display processing device of claim 1, further comprises:

a prioritizer that sets a priority of the primary drawing instruction higher than a priority of the second drawing instruction when the determiner determines that the primary drawing instruction is to be executed first; and

a task scheduler that controls acquisition by the acquirer according to the priority set by the prioritizer.

9. The graphics display processing device of claim 1 installed in a vehicle, wherein

the primary graphic is one of a graphic indicating speed at which the vehicle is travelling, a graphic indicating revolutions of an engine or motor included in the vehicle, a graphic indicating an alert pertaining to a mechanism, equipment, or machinery included in the vehicle, and a graphic indicating an alert pertaining to traffic conditions around the vehicle while the vehicle is in motion, and

the secondary graphic is a map graphic for guiding a driver of the vehicle.

2. A graphics display processing device that displays, in a single frame, a primary graphic requiring immediate display and a secondary graphic not requiring immediate display, the graphics display processing device comprising:

a program storage that stores a primary drawing instruction specifying drawing of the primary graphic and a secondary drawing instruction specifying drawing of the secondary graphic;

a graphics processor that performs drawing processing by executing graphics instructions generated based on each drawing instruction;

an acquirer that acquires the primary drawing instruction and the secondary drawing instruction from the program storage;

an estimator that calculates an estimated graphics processing time required for the drawing processing by the graphics processor due to execution of the graphics instructions generated based on the primary drawing instruction;

a determiner that determines, by using the estimated graphics processing time, which of the primary drawing instruction and the secondary drawing instruction is to be executed first;

an issuance controller that performs a control when the determiner determines that the primary drawing instruction is to be executed first, causing the primary drawing instruction to be issued and issuance of the secondary drawing instruction to be postponed;

an instruction issuer that issues each drawing instruction according to the control of the issuance controller; and

an instruction executor that generates the graphics instructions by executing each drawing instruction issued by the instruction issuer, wherein and

the determiner

stores a start time of the graphics instructions generated based on the primary drawing instruction,

calculates an elapsed time from the start time to a current time,

calculates a remaining graphics processing time by subtracting the elapsed time from the estimated graphics processing time, and

compares the remaining graphics processing time and a priority threshold value assigned to the primary drawing instruction, and when the remaining graphics processing time is less than the priority threshold value, determines that the primary drawing instruction is to be executed first.

10. A graphics display processing method used in a graphics display processing device that displays, in a single frame, a primary graphic requiring immediate display and a secondary graphic not requiring immediate display, the graphics display processing device including:

a program storage that stores a primary drawing instruction specifying drawing of the primary graphic and a secondary drawing instruction specifying drawing of the secondary graphic; and

a graphics processor that performs drawing processing by executing graphics instructions generated based on each drawing instruction, wherein

the graphics display processing method comprises;

acquiring the primary drawing instruction and the secondary drawing instruction from the program storage;

calculating an estimated graphics processing time required for the drawing processing by the graphics processor due to execution of the graphics instructions generated based on the secondary drawing instruction;

determining, by using the estimated graphics processing time, which of the primary drawing instruction and the secondary drawing instruction is to be executed first;

performing a control when determining that the primary drawing instruction is to be executed first, causing the primary drawing instruction to be issued and issuance of the secondary drawing instruction to be postponed;

issuing each drawing instruction according to the control; and

generating the graphics instructions by executing each drawing instruction issued, and

before graphics instructions based on the secondary drawing instruction are executed and within a single frame display unit time in which the graphics instructions are to be executed, execution is completed of graphics instructions generated based on a tertiary drawing instruction specifying a tertiary graphic not requiring immediate display,

the graphics display processing method comprises

storing a cumulative graphics processing time required for execution of the graphics instructions based on the tertiary drawing instruction,

calculating a total graphics processing time by summing the cumulative graphics processing time and the estimated graphics processing time, and

comparing the total graphics processing time and a limit value of an acceptable processing time for drawing processing due to graphics instructions of a graphic not requiring immediate display, and when the total graphics processing time exceeds the limit value, determining that the primary drawing instruction is to be executed first within the frame display unit time.

11. An integrated circuit comprising a graphics display processing device that displays, in a single frame, a primary graphic requiring immediate display and a secondary graphic not requiring immediate display, the integrated circuit comprising:

a program storage that stores a primary drawing instruction specifying drawing of the primary graphic and a secondary drawing instruction specifying drawing of the secondary graphic;

a graphics processor that performs drawing processing by executing graphics instructions generated based on each drawing instruction;

an acquirer that acquires the primary drawing instruction and the secondary drawing instruction from the program storage;

an estimator that calculates an estimated graphics processing time required for the drawing processing by the graphics processor due to execution of the graphics instructions generated based on the secondary drawing instruction;

a determiner that determines, by using the estimated graphics processing time, which of the primary drawing instruction and the secondary drawing instruction is to be executed first;

an issuance controller that performs a control when the determiner determines that the primary drawing instruction is to be executed first, causing the primary drawing instruction to be issued and issuance of the secondary drawing instruction to be postponed;

an instruction issuer that issues each drawing instruction according to the control of the issuance controller; and

an instruction executor that generates the graphics instructions by executing each drawing instruction issued, wherein

before graphics instructions based on the secondary drawing instruction are executed and within a single frame display unit time in which the graphics instructions are to be executed, execution is completed of graphics instructions generated based on a tertiary drawing instruction specifying a tertiary graphic not requiring immediate display,

the determiner

stores a cumulative graphics processing time required for execution of the graphics instructions based on the tertiary drawing instruction,

calculates a total graphics processing time by summing the cumulative graphics processing time and the estimated graphics processing time, and

compares the total graphics processing time and a limit value of an acceptable processing time for drawing processing due to graphics instructions of a graphic not requiring immediate display, and when the total graphics processing time exceeds the limit value, determines that the primary drawing instruction is to be executed first within the frame display unit time.

12. A vehicle equipped with a graphics display processing device that displays, in a single frame, a primary graphic requiring immediate display and a secondary graphic not requiring immediate display, wherein

the graphics display processing device comprises:

a program storage that stores a primary drawing instruction specifying drawing of the primary graphic and a secondary drawing instruction specifying drawing of the secondary graphic;

a graphics processor that performs drawing processing by executing graphics instructions generated based on each drawing instruction;

an acquirer that acquires the primary drawing instruction and the secondary drawing instruction from the program storage;

an estimator that calculates an estimated graphics processing time required for the drawing processing by the graphics processor due to execution of the graphics instructions generated based on the secondary drawing instruction;

a determiner that determines, by using the estimated graphics processing time, which of the primary drawing instruction and the secondary drawing instruction is to be executed first;

an issuance controller that performs a control when the determiner determines that the primary drawing instruction is to be executed first, causing the primary drawing instruction to be issued and issuance of the secondary drawing instruction to be postponed;

an instruction issuer that issues each drawing instruction according to the control of the issuance controller; and

an instruction executor that generates the graphics instructions by executing each drawing instruction issued, and

before graphics instructions based on the secondary drawing instruction are executed and within a single frame display unit time in which the graphics instructions are to be executed, execution is completed of graphics instructions generated based on a tertiary drawing instruction specifying a tertiary graphic not requiring immediate display,

the determiner

stores a cumulative graphics processing time required for execution of the graphics instructions based on the tertiary drawing instruction,

calculates a total graphics processing time by summing the cumulative graphics processing time and the estimated graphics processing time, and

compares the total graphics processing time and a limit value of an acceptable processing time for drawing processing due to graphics instructions of a graphic not requiring immediate display, and when the total graphics processing time exceeds the limit value, determines that the primary drawing instruction is to be executed first within the frame display unit time.