Attention-based rendering and fidelity

• US 9,715,266 B2
• Filed: 06/13/2016
• Issued: 07/25/2017
• Est. Priority Date: 08/29/2013
• Status: Active Grant

• Current Assignee: Sony Interactive Entertainment LLC (Sony Group Corp.)
• Original Assignee: Sony Interactive Entertainment America LLC (Sony Group Corp.)
• Inventors: Timm, Paul, Cevallos, Andres Ramos, Halvorson, Ryan
• Primary Examiner(s): Haley, Joseph
• Assistant Examiner(s): FRANK, EMILY J
• Application Number:
  US15/180,275
• Publication Number:
  US 20160291674A1
• Time in Patent Office: 407 Days
• Field of Search: None
• CPC Class Codes: G06F 1/3231 Monitoring the presence, absence or movement of users
• CPC Class Codes: G06F 1/3265 Power saving in display device
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/015 Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
• CPC Class Codes: G09G 2330/021 Power management, e.g. power saving
• CPC Class Codes: G09G 2340/0407 Resolution change, inclusive of the use of different resolutions for different screen areas
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 5/363 Graphics controllers
• CPC Class Codes: G09G 5/391 Resolution modifying circuits, e.g. variable screen formats
• CPC Class Codes: Y02D 10/00 Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

Methods and systems for attention-based rendering on an entertainment system are provided. A tracking device captures data associated with a user, which is used to determine that a user has reacted (e.g., visually or emotionally) to a particular part of the screen. The processing power is increased in this part of the screen, which increases detail and fidelity of the graphics and/or updating speed. The processing power in the areas of the screen that the user is not paying attention to is decreased and diverted from those areas, resulting in decreased detail and fidelity of the graphics and/or decreased updating speed.

Claims

1. A method for managing processing power for a display, comprising:

generating a display for the single display screen of a display device, wherein the generated display includes one or more events that occur at pre-determined periods of time;

capturing tracking data in response to changes in biometric data associated with at least one user while the user is viewing one or more events that occurred on the generated display, wherein the tracking data is captured via sensors associated with a controller usable by the user to interact with the display device; and

executing instructions stored in memory, wherein execution of the instructions by a processor;

identifies at least one event displayed on the display screen that occurred near the time the tracking data was captured, wherein the identified event corresponds to one of the events to which the user reacted as indicated by the changes in biometric data, and

generates instructions for a graphics processing unit to alter processing power used for rendering graphics on the display device with reference to the identified.

2. The method of claim 1, wherein processing power is increased to render greater detail and graphical fidelity in an area corresponding to the identified event.

3. The method of claim 1, wherein processing power is increased in an area corresponding to the identified event in order to increase a speed by which objects within the area are updated.

4. The method of claim 1, wherein processing power is decreased in an area not corresponding to the identified event thereby reducing the detail or graphical fidelity in the area not corresponding to the identified event or reducing a speed by which objects within the area are updated.

5. The method of claim 1, further comprising identifying that the changes in biometric data correspond to a predetermined response associated with instructions to the graphics processing unit for altering processing power used for rendering graphics based on the identified response corresponding to the changes in biometric data.

6. A non-transitory computer-readable storage medium having embodied thereon a program, the program being executable by a processor to perform a method for managing processing power for a display, comprising:

generating a display for the single display screen of a display device, wherein the generated display includes one or more events that occur at pre-determined periods of time;

capturing tracking data in response to changes in biometric data associated with at least one user while the user is viewing one or more events that occurred on the generated display, wherein the tracking data is captured via sensors associated with a controller usable by the user to interact with the display device;

identifying at least one event displayed on the display screen that occurred near the time the tracking data was captured, wherein the identified event corresponds to one of the events to which the user reacted as indicated by the changes in biometric data; and

generating instructions for a graphics processing unit to alter processing power used for rendering graphics on the display device with reference to the identified event.

7. The non-transitory computer-readable storage medium of claim 6, wherein processing power is increased to render greater detail and graphical fidelity in an area corresponding to the identified event.

8. The non-transitory computer-readable storage medium of claim 6, wherein processing power is increased in an area corresponding to the identified event in order to increase a speed by which objects within the area are updated.

9. The non-transitory computer-readable storage medium of claim 6, wherein processing power is decreased in an area not corresponding to the identified event thereby reducing the detail or graphical fidelity in the area not corresponding to the identified event or reducing a speed by which objects within the area are updated.

10. The non-transitory computer-readable storage medium of claim 6, further comprising executable instructions for identifying that the changes in biometric data correspond to a predetermined response associated with instructions to the graphics processing unit for altering processing power used for rendering graphics based on the identified response corresponding to the changes in biometric data.

11. A system for attention-based rendering, the system comprising:

a memory;

a display device having a single display screen,

a graphics processing unit that generates one or more events that occur at pre-determined period of time, wherein the generated one or more events are displayed on the single display screen;

a tracking device comprising a controller that includes sensors, wherein the tracking device captures tracking data in response to changes in biometric data associated with the user, and wherein the changes in biometric data occurring while the user is viewing one or more events displayed on the single display screen;

a processor for executing instructions stored in memory, wherein execution of the instructions by the processor;

identifies the at least one event displayed on the display screen that occurred near the time the tracking data was captured, wherein the identified event corresponds to one of the events to which the user reacted as indicated by the changes in biometric data, and

generates instructions for a graphics processing unit to alter processing power used for rendering graphics on the display device with reference to the identified event.

12. The system of claim 11, wherein processing power is increased to render greater detail and graphical fidelity in an area corresponding to the identified event.

13. The system of claim 11, wherein processing power is increased in an area corresponding to the identified event in order to increase a speed by which objects within the area are updated.

14. The system of claim 11, wherein processing power is decreased in an area not corresponding to the identified event thereby reducing the detail or graphical fidelity in the area not corresponding to the identified event or reducing a speed by which objects within the area are updated.

15. The system of claim 11, wherein the processor further executes instructions to identify that the changes in biometric data correspond to a predetermined response associated with instructions to the graphics processing unit for altering processing power used for rendering graphics based on the identified response corresponding to the changes in biometric data.

16. A method for managing processing power for a display, comprising:

generating a display for the single display screen of a display device, wherein the generated display includes one or more events that occur at pre-determined periods of time;

capturing tracking data in response to changes in biometric data associated with at least one user in response to at least one event occurring on the generated display; and

executing instructions stored in memory, wherein execution of the instructions by a processor generates instructions for a graphics processing unit to alter processing power used for rendering graphics on the display device with reference to the event to which the user reacted as indicated by the changes in biometric data, wherein processing power is increased to render greater detail and graphical fidelity in an area corresponding to the event.