Ambient light adaptive displays

• US 9,947,259 B2
• Filed: 10/21/2016
• Issued: 04/17/2018
• Est. Priority Date: 11/17/2014
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Wu, Jiaying, Zhang, Lu, Chen, Cheng, Marcu, Gabriel, Wang, Chaohao, Xu, Ming, Motta, Ricardo, Chen, Wei, Zhong, John Z.
• Primary Examiner(s): Cheng, Joe H
• Application Number:
  US15/331,722
• Publication Number:
  US 20170039925A1
• Time in Patent Office: 543 Days
• CPC Class Codes: G09G 2320/0242 Compensation of deficiencies in the appearance of colours
• CPC Class Codes: G09G 2320/0261 in the context of movement of objects on the screen or movement of the observer relative to the screen
• CPC Class Codes: G09G 2320/0666 for control of colour parameters, e.g. colour temperature
• CPC Class Codes: G09G 2360/144 the light being ambient light
• CPC Class Codes: G09G 2360/145 the light originating from the display screen
• CPC Class Codes: G09G 3/2003 Display of colours specific for liquid crystal displays G09G3/3607
• CPC Class Codes: G09G 3/3413 Details of control of colour illumination sources
• CPC Class Codes: G09G 5/02 characterised by the way in which colour is displayed details of colour display specific for CRTs G09G1/28; specific for flat matrix panels other than liquid crystal displays G09G3/2003; specific for liquid crystal displays G09G3/3607

Abstract

An electronic device may include a display having an array of display pixels and having display control circuitry that controls the operation of the display. The display control circuitry may adaptively adjust the display output based on ambient lighting conditions. For example, in cooler ambient lighting conditions such as those dominated by daylight, the display may display neutral colors using a relatively cool white. When the display is operated in warmer ambient lighting conditions such as those dominated by indoor light sources, the display may display neutral colors using a relatively warm white. Adapting to the ambient lighting conditions may ensure that the user does not perceive color shifts on the display as the user'"'"'s vision chromatically adapts to different ambient lighting conditions. Adaptively adjusting images in this way can also have beneficial effects on the human circadian rhythm by displaying warmer colors in the evening.

Claims

1. A method for displaying images with a display that emits display light having a color, comprising:

with a light sensor, measuring a color of ambient light;

with display control circuitry, determining an adapted white point for the display based on the color of the ambient light and the color of the display light, wherein determining the adapted white point comprises applying a factor that weights the color of the display light relative to the color of the ambient light; and

adjusting input pixel values based on the adapted white point to obtain adapted input pixel values.

2. The method defined in claim 1 further comprising:

determining the factor based on the brightness of the display light.

3. The method defined in claim 1 wherein the factor is a value ranging from zero to one.

4. The method defined in claim 1 further comprising:

gathering proximity sensor data from a proximity sensor indicating a distance between the user and the display, wherein the factor is based on the distance.

5. The method defined in claim 1 further comprising:

with the light sensor, measuring a brightness level of the ambient light, wherein the factor is based on the brightness level.

6. The method defined in claim 1 wherein the display is operable in first and second user-selectable modes and wherein the factor is based on whether the display is operating in the first mode or the second mode.

7. The method defined in claim 1 further comprising:

determining a time of day, wherein determining the adapted white point color comprises determining the adapted white point based on the time of day.

8. The method defined in claim 1 further comprising:

applying a temporal filter to the adapted input pixel values.

9. The method defined in claim 1 wherein the factor determines whether the adapted white point more closely matches the color of the display light or the color of the ambient light.

10. The method defined in claim 1 wherein adjusting the input pixel values comprises adjusting the input pixel values in the LMS color space.

11. An electronic device, comprising:

at least one light sensor that measures a color of ambient light;

a display operable in at least first, second, and third user-selectable modes, wherein the display emits display light having a color; and

display control circuitry that determines a first white point for the display in the first mode, a second white point for the display in the second mode, and a third white point for the display in the third mode, wherein the first white point is determined based on the color of ambient light and is independent of the color of display light, the second white point is based on the color of ambient light and the color of display light, and the third white point is based on the color of display light and is independent of the color of ambient light.

12. The electronic device defined in claim 11 wherein the display control circuitry adjusts input pixel values based on the first white point in the first mode, the second white point in the second mode, and the third white point in the third mode.

13. The electronic device defined in claim 11 wherein the light sensor comprises a color light sensor that detects whether the ambient light is cool or warm.

14. The electronic device defined in claim 13 wherein the first white point is a warm white when the ambient light is warm and is a cool white when the ambient light is cool.

15. The electronic device defined in claim 11 further comprising a gyroscope, wherein the at least one light sensor comprises a plurality of light sensors that gather ambient light data, and wherein the display control circuitry uses the gyroscope to determine how to weight the ambient light data from the plurality of light sensors.

16. A method for displaying images with a display that emits display light having a color, comprising:

with display control circuitry, gathering ambient light information from a light sensor; and

with the display control circuitry, determining a white point for the display based on the ambient light information, the color of the display light, and a factor, wherein determining the white point comprises applying the factor to a first value associated with the ambient light information and applying the factor to a second value associated with the color of the display light.

17. The method defined in claim 16 wherein the ambient light information indicates whether ambient light is dominated by a first light source that emits light having a first color temperature or a second light source that emits light having a second color temperature, wherein the first color temperature is lower than the second color temperature, wherein the white point has a first color when the ambient light information indicates that the ambient light is dominated by the first light source and has a second color when the ambient light information indicates that the ambient light is dominated by the second light source, and wherein the first color has a lower color temperature than the second color.

18. The method defined in claim 17 wherein the first light source is an indoor light source and the second light source is daylight.

19. The method defined in claim 16 further comprising:

with the light sensor, measuring a brightness level of the ambient light, wherein the factor is based on the measured brightness level.

20. The method defined in claim 16 wherein the factor is determined based on user input.