Ambient light context-aware display

• US 10,204,539 B2
• Filed: 09/28/2016
• Issued: 02/12/2019
• Est. Priority Date: 09/10/2013
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Bell, Cynthia Sue, Woo, Kevin, Barnes, Philip L., Glenner, Steven C.
• Primary Examiner(s): Michaud, Robert
• Application Number:
  US15/278,767
• Publication Number:
  US 20170076653A1
• Time in Patent Office: 867 Days
• CPC Class Codes: G06F 3/1423 controlling a plurality of local displays, e.g. CRT and flat panel display
• CPC Class Codes: G09G 2320/0242 Compensation of deficiencies in the appearance of colours
• CPC Class Codes: G09G 2320/0606 Manual adjustment
• CPC Class Codes: G09G 2320/0626 for control of overall brightness
• CPC Class Codes: G09G 2320/0653 Controlling or limiting the speed of brightness adjustment of the illumination source
• CPC Class Codes: G09G 2320/0666 for control of colour parameters, e.g. colour temperature
• CPC Class Codes: G09G 2320/0673 for control of gamma adjustment, e.g. selecting another gamma curve
• CPC Class Codes: G09G 2340/06 Colour space transformation
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 2360/144 the light being ambient light
• CPC Class Codes: G09G 3/007 Use of pixel shift techniques, e.g. by mechanical shift of the physical pixels or by optical shift of the perceived pixels
• CPC Class Codes: G09G 3/2003 Display of colours specific for liquid crystal displays G09G3/3607
• CPC Class Codes: G09G 3/2096 Details of the interface to the display terminal specific for a flat panel suitable for both CRT and flat panel G09G5/006; specific for a CRT G09G1/167

Abstract

Embodiments are disclosed that relate to modifying a display of a portable electronic device to account for ambient light. For example, one disclosed embodiment provides a method comprising determining an ambient light history including a plurality of ambient light color conditions sensed over a duration of device operation by an ambient light sensor, reading a display-ready image having a plurality of pixels from an image source, adjusting a manner in which the display-ready image is displayed by color-shifting at least a subset of the plurality of pixels based on the plurality of ambient light color conditions in the ambient light history to thereby generate a color-modified image, and displaying the color-modified image on the display of the portable electronic device.

Claims

1. A portable electronic device, comprising:

a display;

a light sensor; and

a processor configured to;

determine an ambient light color condition based on output from the light sensor;

read a first display-ready image from an image source, the first display-ready image having a first plurality of pixels;

receive clock data and a geographic location of the portable electronic device, the geographic location detected by a GPS unit of the portable electronic device;

adjust a manner in which the first display-ready image is displayed on the portable electronic device by color-shifting at least a subset of the first plurality of pixels based on the ambient light color condition, the geographic location, and the clock data to thereby generate a first color-modified image;

display the first color-modified image on the display of the portable electronic device;

read a second display-ready image from the image source, the second display-ready image having a second plurality of pixels;

adjust a manner in which the second display-ready image is displayed on the portable electronic device by color-shifting at least a subset of the second plurality of pixels based on the geographic location and the clock data, and not based on the ambient light color condition to thereby generate a second color-modified image;

display the second color-modified image on the display of the portable electronic device; and

output, at the display, a user interface operable to receive a user input turning on or off an ambient light matching mode, such that at least the subsets of the first and second plurality of pixels are color-shifted when the ambient light matching mode is turned on, and at least the subsets of the first and second plurality of pixels are not color-shifted when the ambient light matching mode is turned off.

2. The portable electronic device of claim 1, wherein the light sensor is an ambient light sensor configured to detect a luminance and a color temperature of ambient light.

3. The portable electronic device of claim 1,

wherein the light sensor is a front camera, the portable electronic device further comprising a rear camera configured to capture ambient light;

and

wherein the ambient light color condition is determined by both the front and the rear camera.

4. The portable electronic device of claim 1,

wherein the first display-ready image has a first white point substantially equal to 6500K;

and

wherein the first color-modified image has a second white point different from the first white point.

5. The portable electronic device of claim 1, wherein the ambient light color condition further includes luminance data, and wherein the processor is further configured to:

detect a threshold brightness increase based on the luminance data; and

apply a brightening pattern to effect a graduated brightening of the display.

6. The portable electronic device of claim 1, wherein the ambient light color condition further includes luminance data, and wherein the processor is further configured to:

detect a threshold brightness decrease based on the luminance data; and

apply a dimming pattern to effect a graduated dimming of the display.

7. The portable electronic device of claim 1,

wherein the ambient light color condition is one of a plurality of ambient light color conditions of an ambient light history sensed over a duration of device operation;

and

wherein the processor is configured to adjust the manner in which the first display-ready image is displayed on the portable electronic device by color-shifting at least the subset of the first plurality of pixels based on the plurality of ambient light color conditions in the ambient light history to thereby generate the first color-modified image.

8. The portable electronic device of claim 1, wherein the ambient light color condition includes a white point;

and

wherein adjusting the manner in which the first display-ready image is displayed includes adjusting respective white points of at least the subset of the first plurality of pixels.

9. The portable electronic device of claim 8, wherein adjusting the respective white points of at least the subset of the first plurality of pixels includes adjusting respective chromaticity coordinates of at least the subset of the first plurality of pixels.

10. The portable electronic device of claim 8,

wherein the respective white points of at least the subset of the first plurality of pixels are increased in response to a transition from indoor light to outdoor light;

and

wherein the respective white points of at least the subset of the first plurality of pixels are decreased in response to a transition from outdoor light to indoor light.

11. At a portable electronic device, a method, comprising:

determining an ambient light color condition based on output from a light sensor;

reading a first display-ready image from an image source, the first display-ready image having a first plurality of pixels;

receiving clock data and a geographic location of the portable electronic device, the geographic location detected by a GPS unit of the portable electronic device;

adjusting a manner in which the first display-ready image is displayed on the portable electronic device by color-shifting at least a subset of the first plurality of pixels based on the ambient light color condition, the geographic location, and the clock data to thereby generate a first color-modified image;

displaying the first color-modified image on a display; and

reading a second display-ready image from the image source, the second display-ready image having a second plurality of pixels;

adjusting a manner in which the second display-ready image is displayed on the portable electronic device by color-shifting at least a subset of the second plurality of pixels based on the geographic location and the clock data, and not based on the ambient light color condition to thereby generate a second color-modified image;

displaying the second color-modified image on the display; and

displaying a user interface operable to receive a user input turning on or off an ambient light matching mode, such that at least the subsets of the first and second plurality of pixels are color-shifted when the ambient light matching mode is turned on, and at least the subsets of the first and second plurality of pixels are not color-shifted when the ambient light matching mode is turned off.

12. The method of claim 11, wherein the light sensor is an ambient light sensor configured to detect a luminance and a color temperature of ambient light.

13. The method of claim 11,

wherein the first display-ready image has a first white point substantially equal to 6500K;

and

wherein the first color-modified image has a second white point different from the first white point.

14. The method of claim 11,

wherein the ambient light color condition further includes luminance data, the method further comprising:

detecting a threshold brightness increase based on the luminance data; and

applying a brightening pattern to effect a graduated brightening of the display.

15. The method of claim 11,

wherein the ambient light color condition further includes luminance data, the method further comprising:

detecting a threshold brightness decrease based on the luminance data; and

applying a dimming pattern to effect a graduated dimming of the display.

16. The method of claim 11, wherein the ambient light color condition includes a white point;

and

wherein adjusting the manner in which the first display-ready image is displayed includes adjusting respective white points of at least the subset of the first plurality of pixels.

17. A portable electronic device, comprising:

a display;

a light sensor;

a GPS unit; and

a processor configured to;

determine an ambient light color condition based on output from the light sensor, the ambient light color condition including a white point and luminance data;

read a first display-ready image from an image source, the first display-ready image having a first plurality of pixels;

receive clock data and a geographic location of the portable electronic device, the geographic location detected by the GPS unit of the portable electronic device;

adjust a manner in which the first display-ready image is displayed on the portable electronic device by adjusting respective white points of at least a subset of the first plurality of pixels based on the ambient light color condition, the geographic location, and the clock data to thereby generate a first color-modified image;

display the first color-modified image on the display of the portable electronic device;

read a second display-ready image from the image source, the second display-ready image having a second plurality of pixels;

adjust a manner in which the second display-ready image is displayed on the portable electronic device by adjusting respective white points of at least a subset of the second plurality of pixels based on the geographic location and the clock data, and not based on the ambient light color condition to thereby generate a second color-modified image;

display the second color-modified image on the display of the portable electronic device;

in response to detecting a threshold brightness increase based on the luminance data, apply a brightening pattern to effect a graduated brightening of the display;

in response to detecting a threshold brightness decrease based on the luminance data, apply a dimming pattern to effect a graduated dimming of the display; and

output, at the display, a user interface operable to receive a user input turning on or off an ambient light matching mode, such that the respective white points of at least the subsets of the first and second plurality of pixels are adjusted when the ambient light matching mode is turned on, and the respective white points of at least the subsets of the first and second plurality of pixels are not adjusted when the ambient light matching mode is turned off.

18. The portable electronic device of claim 17, wherein the light sensor is an ambient light sensor configured to detect a luminance and a color temperature of ambient light.

19. A portable electronic device, comprising:

a display having a plurality of display pixels;

a light sensor;

a GPS unit; and

a processor configured to;

determine an ambient light color condition based on output from the light sensor;

receive clock data and a geographic location of the portable electronic device, the geographic location detected by the GPS unit of the portable electronic device;

read a first display-ready image from an image source, the first display-ready image having a first plurality of image pixels;

adjust a manner in which the first display-ready image is displayed on the portable electronic device by color-shifting at least a first subset of the plurality of display pixels relative to a corresponding subset of the first plurality of image pixels based on the ambient light color condition, the geographic location, and the clock data;

display the first display-ready image on the display of the portable electronic device including the color-shifted first subset of the plurality of display pixels;

read a second display-ready image from the image source, the second display-ready image having a second plurality of image pixels;

adjust a manner in which the second display-ready image is displayed on the portable electronic device by color-shifting at least a second subset of the plurality of display pixels relative to a corresponding subset of the second plurality of image pixels based on the geographic location and the clock data, and not based on the ambient light color condition; and

display the second display-ready image on the display of the portable electronic device including the color-shifted second subset of the plurality of display pixels.