Immersive environment correction display and method

• US 10,401,958 B2
• Filed: 01/11/2018
• Issued: 09/03/2019
• Est. Priority Date: 01/12/2015
• Status: Active Grant

• Current Assignee: Dell Products LP (Dell Technologies Inc.)
• Original Assignee: Dell Products LP (Dell Technologies Inc.)
• Inventors: Peana, Stefan, Aurongzeb, Deeder
• Primary Examiner(s): Demeter, Hilina K
• Application Number:
  US15/868,947
• Publication Number:
  US 20180136724A1
• Time in Patent Office: 600 Days
• Field of Search: 345156, 345158, 345589, 345601, 345633, 359 15, 359614
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: G09G 2320/028 by changing the viewing angle properties, e.g. widening the viewing angle, adapting the viewing angle to the view direction
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 3/03 specially adapted for displays having non-planar surfaces, e.g. curved displays
• CPC Class Codes: G09G 3/36 using liquid crystals
• CPC Class Codes: G09G 5/02 characterised by the way in which colour is displayed details of colour display specific for CRTs G09G1/28; specific for flat matrix panels other than liquid crystal displays G09G3/2003; specific for liquid crystal displays G09G3/3607
• CPC Class Codes: G09G 5/06 using colour palettes, e.g. look-up tables
• CPC Class Codes: G09G 5/10 Intensity circuits

Abstract

An information handling system (IHS) controls a display for an immersive experience based upon a gazing view of one or more users. A processor communicates with the display and a gaze detector to detect a relative location of the user(s) to the display. A graphic processing unit (GPU) allocates a field of view on the display based upon the relative location, centers display content in the field of view on the display, and accesses color point control data in response to the allocated field of view. The GPU manages color and brightness of display components of the display according to the accessed color point control data to compensate for variations of color and brightness in a viewing angle of the field of view.

Claims

1. An information handling system (IHS) comprising:

a display comprising one or more gaze detection sensors;

a gaze detector that synthesizes information from the one or more gaze detection sensors to detect a relative location of one or more users;

a processor that communicates with the display and the gaze detector to detect a relative location of the one or more users to the display and which executes an immersive environment controller that enables an immersive experience for the one or more users viewing the display; and

a graphic processing unit (GPU) that communicates with the processor and the display to;

allocate a field of view on the display based upon the relative locations;

subjectively center display content in the field of view on the display on a portion of the display that presents a most perpendicular surface as an offset field of view to present an immersive environment;

access color point control data in response to the allocated field of view; and

manage color and brightness of display components of the display according to the accessed color point control data to compensate for variations of color and brightness in a viewing angle of the field of view to maintain the immersive environment.

2. The IHS of claim 1, wherein:

the gaze detector comprises a three-dimensional camera to produce a three-dimensional camera image; and

the processor detecting the relative location of the user comprises the processor detecting the user within the three-dimensional camera image.

3. The IHS of claim 1, wherein the processor detects the relative location of the user by:

detecting more than one candidate user within a viewing area of the display;

querying the more than one candidate user to indicate which one candidate is to be deemed as defining the field of view; and

receiving confirmation from one user among the more than one candidate user as having the field of view.

4. The IHS of claim 1, wherein the processor detects the relative location of the user by:

detecting relative locations of more than one candidate user within a viewing area of the display; and

determining a compromise location between the relative locations by three dimensionally averaging the relative locations of the more than one candidate user.

5. The IHS of claim 1, wherein the processor detects the relative location of the user by receiving a communication signal from a portable communication device that is being worn or carried by the user.

6. The IHS of claim 1, further comprising one or more microphones that detect an angular direction to an audio source, wherein the processor is electronically connected to the one or more microphones and detects the relative location of the user by receiving the angular direction based on a verbal utterance from the user that is detected by the one or more microphones.

7. The IHS of claim 1, further comprising a measuring device that:

maps color shift and brightness of pixel display components of the display as a function of viewing angle; and

generates more than one three-dimensional (3D) look up table (LUT) of compensation values for color management of the pixel display components, wherein each 3D LUT corresponds to a selected viewing angle and one of the 3D LUT comprises the accessed color point control data that is associated with the selected viewing angle of the allocated field of view.

8. The IHS of claim 1, wherein:

the display comprises an array of more than one display panel each comprising a gaze detection sensor; and

the gaze detector synthesizes information from the gaze detection sensors to detect the relative location of the user.

9. The IHS of claim 1, wherein the display comprises a curved display panel and the GPU manages color and brightness of display components, while taking a curvative and direct viewing of the curved display panel into consideration to make a correction.

10. The IHS of claim 1, wherein:

the GPU executes a color management component based on color point control data contained in 3D lookup tables which provide a map of display color/brightness characteristics as a function of viewing angle; and

the GPU centering the field of view comprises the color management component executing on the GPU to enable the GPU to calculate a number of pixels that comprise a subjective horizontal dimension width of a pixel, the subjective horizontal width being a function of an angle to the user and a distance from the user.

11. The IHS of claim 1, wherein:

the immersive environment controller directs the color management component of the GPU to compensate for a color shift and change in brightness and to subjectively center graphical information on a portion of the display that presents the most perpendicular surface as an offset field of view; and

the immersive environment controller provides exceptions to centering for immersiveness, the exceptions comprising static 3D images, movies, moving within a gaming world environment, and manipulating objects within a gaming world environment.

12. A computer-implemented method of controlling a display for an immersive experience based upon a gazing view of a user, the method comprising:

detecting, via a processor communicating with a gaze detector, a relative location of one or more users to a display based on input from one or more gaze detector sensors, the processor executing an immersive environment controller that enables an immersive experience for the one or more users viewing the display;

allocating, via a graphic processing unit, a field of view on the display based upon the relative location;

subjectively centering display content in the field of view on the display on a portion of the display that presents a most perpendicular surface as an offset field of view to present an immersive environment;

accessing color point control data in response to the allocated field of view; and

managing, via the graphic processing unit, color and brightness of display components of the display according to the accessed color point control data to compensate for variations of color and brightness in a viewing angle of the field of view to maintain the immersive environment.

13. The method of claim 12, wherein the processor detecting the relative location of the user comprises detecting the user within a three-dimensional camera image.

14. The method of claim 12, wherein detecting the relative location of the user comprises:

detecting more than one candidate user within a viewing area of the display;

querying the more than one candidate user to indicate which one candidate is to be deemed as defining the field of view; and

receiving confirmation from a user among the more than one candidate user as to having the field of view.

15. The method of claim 12, wherein detecting the relative location of the user comprises:

detecting relative locations of more than one candidate user within a viewing area of the display; and

determining a compromise location between the relative locations by three dimensionally averaging the relative locations of the more than one candidate user.

16. The method of claim 12, wherein detecting the relative location of the user comprises receiving a communication signal from a portable communication device that is being worn or carried by the user.

17. The method of claim 12, wherein detecting the relative location of the user comprises:

detecting, via one or more microphones, an angular direction to an audio source; and

detecting, via the processor that is electronically connected to the one or more microphones, the relative location of the user by receiving the angular direction based on an utterance from the user that is detected by the one or more microphones.

18. The method of claim 12, further comprising:

mapping, via a measuring equipment, color shift and brightness of pixel display components of the display as a function of viewing angle; and

generating more than one three-dimensional (3D) look up table (LUT) of compensation values for color management of the pixel display components, each 3D LUT corresponding to a selected viewing angle and one of the 3D LUT comprises the accessed color point control data that is associated with the selected viewing angle of the allocated field of view.

19. The method of claim 12, wherein the display comprises an array of more than one display panel.

20. The method of claim 12, wherein the display comprises a curved display panel.