Systems and methods for simulating adaptation of eyes to changes in lighting conditions

• US 10,546,555 B2
• Filed: 04/02/2018
• Issued: 01/28/2020
• Est. Priority Date: 09/21/2016
• Status: Active Grant

• Current Assignee: GoPro, Inc.
• Original Assignee: GoPro, Inc.
• Inventors: Morat, Julien
• Primary Examiner(s): Edun, Muhammad N
• Application Number:
  US15/943,006
• Publication Number:
  US 20180226057A1
• Time in Patent Office: 666 Days
• CPC Class Codes: G06F 3/147 using display panels
• CPC Class Codes: G09G 2320/0686 with two or more screen areas displaying information with different brightness or colours
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 5/10 Intensity circuits

Abstract

Capture of visual content by image sensor(s) may define a luminance of the visual content. A viewing field of view may define an extent of the visual content presented on a display. The luminance may vary as a function of a viewing field of view. A user may change the viewing field of view from a first viewing field of view to a second viewing field. A first luminance of the visual content within the first viewing field of view and a second luminance of the visual content within the second viewing field of view may be determined. A lighting effect may be applied to the visual content based on a difference between the first luminance and the second luminance.

Claims

1. A system for simulating adaptation of eyes to changes in lighting conditions, the system comprising:

one or more physical processors configured by machine-readable instructions to;

access visual information defining the visual content, the visual content captured by one or more image sensors and including a view of a real world scene, the capture of the visual content by the one or more image sensors defining a luminance of the visual content, the luminance varying as a function of a viewing field of view, the viewing field of view defining an extent of the visual content presented on a display;

present the visual content within the viewing field of view on the display;

determine changes in the viewing field of view, the changes in the viewing field of view including a change from a first viewing field of view to a second viewing field of view different from the first viewing field of view;

determine changes in the luminance of the visual content within the viewing field of view, the changes in the luminance of the visual content within the viewing field of view including a difference in the luminance of the visual content within the first viewing field of view and the second viewing field of view; and

apply a lighting effect to the visual content based on the changes in the luminance of the visual content within the viewing field of view, the lighting effect simulating the adaptation of eyes to a change in lighting conditions between the visual content within the first viewing field of view and the visual content within the second viewing field of view.

2. The system of claim 1, wherein the visual content within the first viewing field of view includes a first luminance and the visual content within the second viewing field of view includes a second luminance, and the difference between the first luminance and the second luminance includes one or more differences in a first median of the first luminance and a second median of the second luminance, a first mean of the first luminance and a second mean of the second luminance, a first range of the first luminance and a second range of the second luminance, and/or a first maximum of the first luminance and a second maximum of the second luminance.

3. The system of claim 1, wherein the first viewing field of view includes a first portion and a second portion, the first portion weighed differently from the second portion for a determination of the luminance of the visual content within the first viewing field of view.

4. The system of claim 3, wherein the first portion includes a center portion of the first viewing field of view and the second portion includes a side portion of the first viewing field of view, the center portion having a greater impact on the determination of the luminance of the visual content within the first viewing field of view than the side portion.

5. The system of claim 1, wherein the lighting effect is applied to the visual content for different time durations based on different changes in the luminance of the visual content within the viewing field of view.

6. The system of claim 1, wherein the lighting effect is applied to the visual content based on the changes in the luminance of the visual content within the viewing field of view meeting or exceeding a threshold.

7. The system of claim 1, wherein the lighting effect simulates the visual content within the viewing field of view being overexposed based on the changes in the luminance of the visual content within the viewing field of view including a rise in the luminance and being underexposed based on the changes in the luminance of the visual content within the viewing field of view including a drop in the luminance.

8. The system of claim 1, wherein the lighting effect changes a brightness of the visual content within the second viewing field of view.

9. The system of claim 8, wherein the visual content within the second viewing field of view includes different portions and the change in the brightness of the visual content within the second viewing field of view includes different amounts of changes in the brightness in the different portions based on the luminance within the different portions.

10. The system of 1, wherein the lighting effect changes one or more tonal ranges of the visual content within the second viewing field of view.

11. A method for simulating adaptation of eyes to changes in lighting conditions, the method performed by a computing system including one or more processors, the method comprising:

accessing, by the computing system, visual information defining visual content, the visual content captured by one or more image sensors and including a view of a real world scene, the capture of the visual content by the one or more image sensors defining a luminance of the visual content, the luminance varying as a function of a viewing field of view, the viewing field of view defining an extent of the visual content presented on a display;

presenting, by the computing system, the visual content within the viewing field of view on the display;

determining, by the computing system, changes in the viewing field of view, the changes in the viewing field of view including a change from a first viewing field of view to a second viewing field of view different from the first viewing field of view;

determining, by the computing system, changes in the luminance of the visual content within the viewing field of view, the changes in the luminance of the visual content within the viewing field of view including a difference in the luminance of the visual content within the first viewing field of view and the second viewing field of view; and

;

applying, by the computing system, a lighting effect to the visual content based on the changes in the luminance of the visual content within the viewing field of view, the lighting effect simulating the adaptation of eyes to a change in lighting conditions between the visual content within the first viewing field of view and the visual content within the second viewing field of view.

12. The method of claim 11, wherein the visual content within the first viewing field of view includes a first luminance and the visual content within the second viewing field of view includes a second luminance, and the difference between the first luminance and the second luminance includes one or more differences in a first median of the first luminance and a second median of the second luminance, a first mean of the first luminance and a second mean of the second luminance, a first range of the first luminance and a second range of the second luminance, and/or a first maximum of the first luminance and a second maximum of the second luminance.

13. The method of claim 12, wherein the first viewing field of view includes a first portion and a second portion, the first portion weighed differently from the second portion for a determination of the luminance of the visual content within the first viewing field of view.

14. The method of claim 13, wherein the first portion includes a center portion of the first viewing field of view and the second portion includes a side portion of the first viewing field of view, the center portion having a greater impact on the determination of the luminance of the visual content within the first viewing field of view than the side portion.

15. The method of claim 11, wherein the lighting effect is applied to the visual content for different time durations based on different changes in the luminance of the visual content within the viewing field of view.

16. The method of claim 11, wherein the lighting effect is applied to the visual content based on the changes in the luminance of the visual content within the viewing field of view meeting or exceeding a threshold.

17. The method of claim 11, wherein the lighting effect simulates the visual content within the viewing field of view being overexposed based on the changes in the luminance of the visual content within the viewing field of view including a rise in the luminance and being underexposed based on the changes in the luminance of the visual content within the viewing field of view including a drop in the luminance.

18. The method of claim 11, wherein the lighting effect changes a brightness of the visual content within the second viewing field of view.

19. The method of claim 18, wherein the visual content within the second viewing field of view includes different portions and the change in the brightness of the visual content within the second viewing field of view includes different amounts of changes in the brightness in the different portions based on the luminance within the different portions.

20. The method of 11, wherein the lighting effect changes one or more tonal ranges of the visual content within the second viewing field of view.