Hidden area stencil mesh rendering systems and methods

• US 10,297,077 B1
• Filed: 02/27/2017
• Issued: 05/21/2019
• Est. Priority Date: 03/02/2016
• Status: Active Grant

• Current Assignee: Valve Corporation
• Original Assignee: Valve Corporation
• Inventors: Vlachos, Alex
• Primary Examiner(s): Zalalee, Sultana M
• Application Number:
  US15/443,558
• Time in Patent Office: 813 Days
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06T 15/30 Clipping

Abstract

Systems and methods for implementing hidden mesh (or stencil mesh) graphics rendering techniques for use in applications such as head mounted displays (“HMDs”) are described. Exemplary systems and algorithms are disclosed for masking or eliminating pixels in an image from the list of pixels to be rendered, based on the observation that a significant number of pixels in the periphery of HMD images cannot be seen, due to the specific details of the optical and display/electronics performance of each particular implementation.

Claims

1. A graphics processing method, comprising:

applying a masking rendering algorithm to a portion of a digital image to mask out one or more peripheral pixels of the digital image, wherein the one or more peripheral pixels are located in an area within a peripheral vision of a user when the user is not looking directly at the one or more peripheral pixels in a head-mounted display system, wherein the masking rendering algorithm comprises a stencil mask that is automatically generated using an inverse of a function used to generate a distortion mesh associated with the head-mounted display system; and

culling the one or more peripheral pixels from the digital image, wherein subsequent processing of the digital image after applying the masking rendering algorithm excludes the one or more peripheral pixels so as to produce performance gains without detriment to an experience of the user.

2. The graphics processing method of claim 1, wherein the masking rendering algorithm further comprises a hidden area mesh.

3. The graphics processing method of claim 1, further comprising generating the stencil mask based on a physical visibility determination associated with the head-mounted display system.

4. A graphics processing system, comprising:

one or more processors; and

computer-readable media storing computer-executable instructions that, when executed by the one or more processors, cause the one or more processors to perform operations comprising;

applying a masking rendering algorithm to a portion of a digital image to mask out one or more peripheral pixels of the digital image, wherein the one or more peripheral pixels are located in an area within a peripheral vision of a user when the user is not looking directly at the one or more peripheral pixels in a head-mounted display system, wherein the masking rendering algorithm comprises a stencil mask that is automatically generated using an inverse of a function used to generate a distortion mesh associated with the head-mounted display system; and

culling the one or more peripheral pixels from the digital image, wherein subsequent processing of the digital image after applying the masking rendering algorithm excludes the one or more peripheral pixels.

5. The graphics processing system of claim 4, wherein the masking rendering algorithm further comprises a hidden area mesh.

6. The graphics processing system of claim 4, further comprising generating the stencil mask based on a physical visibility determination associated with the head-mounted display system.

7. A computer-readable memory storing computer-executable instructions that, when executed by one or more processors, cause the one or more processors to perform operations comprising:

masking out one or more peripheral pixels of a digital image displayed in a head-mounted display system by applying a masking rendering algorithm to the digital image, wherein the one or more peripheral pixels are located in a peripheral area of the digital image, wherein the masking rendering algorithm comprises a stencil mask;

automatically generating the stencil mask using an inverse of a function used to generate a distortion mesh associated with the head-mounted display system;

culling the one or more peripheral pixels from the digital image; and

processing the digital image, excluding the one or more peripheral pixels, after applying the masking rendering algorithm.

8. The computer-readable memory of claim 7, wherein the masking rendering algorithm further comprises a hidden area mesh.

9. The computer-readable memory of claim 7, the operations further comprising generating the stencil mask based on a physical visibility determination associated with the head-mounted display system.