METHOD AND APPARATUS FOR MODIFYING DISPLAY SETTINGS IN VIRTUAL/AUGMENTED REALITY

• US 20180182161A1
• Filed: 12/27/2016
• Published: 06/28/2018
• Est. Priority Date: 12/27/2016
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Chaudhari, Roshan, Srinivasan, Vittalbabu, Williams, Mitchell, Peri, Christopher
• Granted Patent: US 10,885,676 B2
• Time in Patent Office: Days
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77

Abstract

An apparatus that modifies display settings of image data is provided. The apparatus stores one or more spectral mappings and receives display data for an image. The received display data includes a plurality of colors and each of the colors includes a plurality of attributes. A spectral mapping, of the one or more spectral mappings, is identified based on a detected user visual limitation. Each of the spectral mappings maps a set of spectral colors to an adjusted set of spectral colors and provides attribute adjustments for the set of spectral colors of image data so an image can be displayed in a manner that mitigates the user'"'"'s visual limitation. The mapped and adjusted plurality of colors of the image data that mitigate the visual limitation when displayed on a display may mitigate, for example, viewer color blindness, eye strain, biometric measurements and/or other visual limitations.

Claims

1. An apparatus for modifying display settings, the apparatus comprising:

a memory configured to store one or more spectral mappings, each spectral mapping comprising information about mapping a set of spectral colors to an adjusted set of spectral colors and color attribute adjustments for the set of spectral colors, the color attribute adjustments include at least one of color brightness, saturation and contrast adjustments;

at least one processor operably connected to the memory, the at least one processor configured to;

receive, from an input, display data for an image, the display data comprises;

color information for a plurality of colors in the image; and

image color attributes for the plurality of colors in the image;

detect a state for visual mitigation, the state corresponding to one of a plurality of user visual limitations;

retrieve a first spectral mapping, of the one or more spectral mappings, from the memory based on the detected state;

map the plurality of colors in the image to a first adjusted set of spectral colors according to the first spectral mapping;

adjust the image color attributes for the plurality of colors in the image according to first attribute adjustments of the first spectral mapping; and

a display configured to receive the image with the mapped and adjusted display data and configured to display the image using the first adjusted set of spectral colors and adjusted image color attributes.

2. The apparatus of claim 1, wherein the at least one processor is further configured to map the plurality of colors and adjust the image color attributes using a shader for output to the display for all applications being executed by the at least one processor.

3. The apparatus of claim 1, wherein retrieving the first spectral mapping further comprises the at least one processor being configured to:

detect the state, wherein the state is associated with a user; and

retrieve the first spectral mapping from the memory based on a user profile.

4. The apparatus of claim 1, wherein the at least one processor is further configured to:

detect the state, wherein the state is associated with an application being executed by the at least one processor; and

retrieve the first spectral mapping based on the application.

5. The apparatus of claim 1, further comprising one or more sensors configured to obtain biometric feedback of a user, wherein the at least one processor is further configured to detect the state based on biometric feedback of the user;

and to retrieve the first spectral mapping based on the biometric feedback of the user.

6. The apparatus of claim 1, wherein the at least one processor is further configured to:

obtain metadata related to the display data, wherein the metadata includes a description of the display data; and

retrieve the first spectral mapping based on the description included in the metadata.

7. The apparatus of claim 1, wherein the at least one processor is further configured to:

responsive to determining not to use a predefined calibration, provide a plurality of grids of color hues;

receive a selection of one or more grids; and

determine the state and retrieve the first spectral mapping based on the one or more selected grids.

8. A method of modifying an image color, the method comprising:

receiving, from an input, display data for an image, the display data comprises;

color information for a plurality of colors in the image; and

image color attributes for the plurality of colors in the image;

detecting a state for visual mitigation, the state corresponding to one of a plurality of user visual limitations;

retrieving a first spectral mapping, of one or more spectral mappings, associated with the detected state, each spectral mapping of the one or more spectral mappings comprises information about mapping a set of spectral colors to an adjusted set of spectral colors and color attribute adjustments for the set of spectral colors, the color attribute adjustments include at least one of color brightness, saturation and contrast adjustments;

mapping the plurality of colors in the image to a first adjusted set of spectral colors according to the first spectral mapping;

adjusting the image color attributes for the plurality of colors in the image according to first attribute adjustments of the first spectral mapping; and

displaying the image using the first adjusted set of spectral colors and the adjusted image attributes.

9. The method of claim 8, wherein mapping the plurality of colors and adjusting the image color attributes comprises:

mapping the plurality of colors and adjusting the image color attributes using a shader for output to the display for all applications being executed by at least one processor.

10. The method of claim 8, wherein detecting the state comprises identifying a user profile associated with a user;

and wherein retrieving the first spectral mapping is based on the user profile.

11. The method of claim 8, wherein detecting the state comprises identifying an application being executed by at least one processor;

and wherein retrieving the first spectral mapping is based on the identified application.

12. The method of claim 8, wherein detecting the state comprises obtaining, by one or more sensors, biometric feedback on a user;

and wherein retrieving the first spectral mapping is based on the biometric feedback of the user.

13. The method of claim 8, wherein detecting the state comprises obtaining metadata related to the display data, the metadata includes a description of the display data;

and wherein retrieving the first spectral mapping is based on the description included in the metadata.

14. The method of claim 8, wherein detecting the state comprises determining whether to use a predefined calibration;

responsive to determining not to use the predefined calibration, providing a plurality of grids of color hues;

receiving a selection of one or more grids; and

identifying the first spectral mapping based on the one or more selected grids.

15. A non-transitory computer readable medium comprising program code, that when executed by at least one processor, causes the at least one processor to:

receive display data for an image, the display data comprising color information for a plurality of colors in the image and image color attributes for the plurality of colors in the image;

detect a state for visual mitigation, the state corresponding to one of a plurality user visual limitations;

retrieve a first spectral mapping, of one or more spectral mappings, based on the detected state, each spectral mapping of the one or more spectral mappings comprises information about mapping a set of spectral colors to an adjusted set of spectral colors and color attribute adjustments for the set of spectral colors, the color attribute adjustments include at least one of color brightness, saturation and contrast adjustments;

mapping the plurality of color in the image to a first adjusted set of spectral colors according to the first spectral mapping;

adjust the image color attributes for the plurality of colors in the image according to the color attribute adjustments of the first spectral mapping; and

display the image using the first adjusted set of spectral colors and the adjusted image attributes.

16. The non-transitory computer readable medium of claim 15, wherein the code for adjusting the attribute comprises code for:

mapping the plurality of colors and adjusting the image color attributes using a shader for output to the display for all applications being executed by the at least one processor.

17. The non-transitory computer readable medium of claim 15, wherein the code for detecting the state comprises code for identifying a user profile associated with a user;

and wherein retrieving the first spectral mapping is based on the user profile.

18. The non-transitory computer readable medium of claim 15, wherein the code for detecting the state comprises code for obtaining, by one or more sensors, biometric feedback on a user;

and wherein retrieving the first spectral mapping is based on the biometric feedback of the user.

19. The non-transitory computer readable medium of claim 15, wherein the code for detecting the state comprises code for obtaining metadata related to the display data, the metadata includes a description of the display data;

and wherein retrieving the first spectral mapping is based on the description included in the metadata.

20. The non-transitory computer readable medium of claim 15, wherein the code for detecting the state comprises code for determining whether to use a predefined calibration;

responsive to determining not to use the predefined calibration, providing a plurality of grids of color hues;

receiving a selection of one or more grids;

identifying the first spectral mapping based on the one or more selected grids.