Real-time user adaptive foveated rendering
First Claim
1. A graphics processing method comprising:
- obtaining gaze tracking data representing a user'"'"'s gaze with respect to one or more images presented to the user;
determining one or more gaze tracking parameters from gaze tracking data, wherein the gaze tracking parameters include one or more gaze tracking error parameters, wherein determining the one or more gaze tracking error parameters from the gaze tracking data includes determining whether the user'"'"'s eye is moving in smooth pursuit;
generating adjusted foveation data representing an adjusted size and/or shape of one or more regions of interest in one or more images to be subsequently presented to the user based on the one or more gaze tracking parameters including the one or more gaze tracking error parameters;
generating foveated image data representing one or more foveated images using the adjusted foveation data, wherein the one or more foveated images are characterized by level of detail within the one or more regions of interest and lower level of detail outside the one or more regions of interest; and
presenting the one or more foveated images to the user.
2 Assignments
0 Petitions
Accused Products
Abstract
Foveated rendering based on user gaze tracking may be adjusted to account for the realities of human vision. Gaze tracking error and state parameters may be determined from gaze tracking data representing a user'"'"'s gaze with respect to one or more images presented to a user. Adjusted foveation data representing an adjusted size and/or shape of one or more regions of interest in one or more images to be subsequently presented to a user may be generated based on the one or more gaze tracking error or state parameters. Foveated image data representing one or more foveated images may be generated with the adjusted foveation data. The foveated images are characterized by level of detail within the one or more regions of interest and lower level of detail outside the one or more regions of interest. The foveated images may then be presented to the user.
-
Citations
19 Claims
-
1. A graphics processing method comprising:
-
obtaining gaze tracking data representing a user'"'"'s gaze with respect to one or more images presented to the user; determining one or more gaze tracking parameters from gaze tracking data, wherein the gaze tracking parameters include one or more gaze tracking error parameters, wherein determining the one or more gaze tracking error parameters from the gaze tracking data includes determining whether the user'"'"'s eye is moving in smooth pursuit; generating adjusted foveation data representing an adjusted size and/or shape of one or more regions of interest in one or more images to be subsequently presented to the user based on the one or more gaze tracking parameters including the one or more gaze tracking error parameters; generating foveated image data representing one or more foveated images using the adjusted foveation data, wherein the one or more foveated images are characterized by level of detail within the one or more regions of interest and lower level of detail outside the one or more regions of interest; and presenting the one or more foveated images to the user. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17)
-
-
18. A system, comprising:
-
a processor; a memory; and computer-readable instructions embodied in the memory, the computer-readable instructions being configured to implement a graphics processing method when executed, the graphics processing method comprising; obtaining gaze tracking data representing a user'"'"'s gaze with respect to one or more images presented to the user; determining one or more gaze tracking parameters from gaze tracking data, wherein the gaze tracking parameters include at least one gaze tracking error parameter or at least one gaze tracking state parameter, wherein determining the one or more gaze tracking error parameters from the gaze tracking data includes determining whether the user'"'"'s eye is moving in smooth pursuit; generating adjusted foveation data representing an adjusted size and/or shape of one or more regions of interest in one or more images to be subsequently presented to the user based on the one or more gaze tracking parameters; generating foveated image data representing one or more foveated images using the adjusted foveation data, wherein the one or more foveated images are characterized by level of detail within the one or more regions of interest and lower level of detail outside the one or more regions of interest; and presenting the one or more foveated images to the user.
-
-
19. A non-transitory computer-readable medium having computer-readable instructions embodied therein, the computer-readable instructions being configured to implement a graphics processing method when executed, the graphics processing method comprising:
-
obtaining gaze tracking data representing a user'"'"'s gaze with respect to one or more images presented to the user; determining one or more gaze tracking parameters from gaze tracking data, wherein the gaze tracking parameters include at least one gaze tracking error parameter or at least one gaze tracking state parameter, wherein determining the one or more gaze tracking error parameters from the gaze tracking data includes determining whether the user'"'"'s eye is moving in smooth pursuit; generating adjusted foveation data representing an adjusted size and/or shape of one or more regions of interest in one or more images to be subsequently presented to the user based on the one or more gaze tracking error parameters; generating foveated image data representing one or more foveated images using the adjusted foveation data, wherein the one or more foveated images are characterized by level of detail within the one or more regions of interest and lower level of detail outside the one or more regions of interest; and presenting the one or more foveated images to the user.
-
Specification