Systems and methods for simulating adaptation of eyes to changes in lighting conditions

• US 9,934,758 B1
• Filed: 09/21/2016
• Issued: 04/03/2018
• Est. Priority Date: 09/21/2016
• Status: Active Grant

• Current Assignee: GoPro, Inc.
• Original Assignee: GoPro, Inc.
• Inventors: Morat, Julien
• Primary Examiner(s): Edun, Muhammad N
• Application Number:
  US15/271,931
• Time in Patent Office: 559 Days
• CPC Class Codes: G06F 3/147 using display panels
• CPC Class Codes: G09G 2320/0686 with two or more screen areas displaying information with different brightness or colours
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 5/10 Intensity circuits

Abstract

Capture of visual content by image sensor(s) may define a luminance of the visual content. A viewing field of view may define an extent of the visual content presented on a display. The luminance may vary as a function of a viewing field of view. A user may change the viewing field of view from a first viewing field of view to a second viewing field. A first luminance of the visual content within the first viewing field of view and a second luminance of the visual content within the second viewing field of view may be determined. A lighting effect may be applied to the visual content based on a difference between the first luminance and the second luminance.

Claims

1. A system for simulating adaptation of eyes to changes in lighting conditions, the system comprising:

a display configured to present visual content within a viewing field of view, the viewing field of view defining an extent of the visual content presented on the display, the visual content captured by one or more image sensors and including a view of a real world scene, the capture of the visual content by the one or more image sensors defining a luminance of the visual content, the luminance varying as a function of the viewing field of view; and

one or more physical processors configured by machine-readable instructions to;

access visual information defining the visual content;

present the visual content on the display;

receive user input indicating a user'"'"'s selections of the viewing field of view, the user'"'"'s selections of the viewing field of view including a first selection of a first viewing field of view at a first time and a second selection of a second viewing field of view at a second time that is subsequent to the first time;

determine a first luminance of the visual content within the first viewing field of view;

determine a second luminance of the visual content within the second viewing field of view;

apply a lighting effect to the visual content based on a difference between the first luminance and the second luminance, the lighting effect simulating the adaptation of eyes to a change in lighting conditions between the visual content within the first viewing field of view and the visual content within the second viewing field of view.

2. The system of claim 1, wherein the difference between the first luminance and the second luminance includes one or more differences in a first median of the first luminance and a second median of the second luminance, a first mean of the first luminance and a second mean of the second luminance, a first range of the first luminance and a second range of the second luminance, and/or a first maximum of the first luminance and a second maximum of the second luminance.

3. The system of claim 1, wherein the first viewing field of view includes a first portion and a second portion, the first portion weighed differently from the second portion for the determination of the first luminance.

4. The system of claim 3, wherein the first portion includes a center portion of the first viewing field of view and the second portion includes a side portion of the first viewing field of view, the center portion having a greater impact on the determination of the first luminance than the side portion.

5. The system of claim 1, wherein the lighting effect is applied to the visual content for a time duration based on the difference between the first luminance and the second luminance.

6. The system of claim 1, wherein the lighting effect is applied to the visual content based on the difference between the first luminance and the second luminance meeting or exceeding a threshold.

7. The system of claim 1, wherein the lighting effect simulates the visual content within the second viewing field of view being overexposed based on the second luminance being higher than the first luminance and being underexposed based on the second luminance being lower than the first luminance.

8. The system of claim 1, wherein the lighting effect changes a brightness of the visual content within the second viewing field of view.

9. The system of claim 8, wherein the visual content within the second viewing field of view includes different portions and the change in the brightness of the visual content within the second viewing field of view includes different amounts of changes in the brightness in the different portions based on the luminance within the different portions.

10. The system of 1, wherein the lighting effect changes one or more tonal ranges of the visual content within the second viewing field of view.

11. A method for simulating adaptation of eyes to changes in lighting conditions, the method comprising:

accessing visual information defining visual content, the visual content captured by one or more image sensors and including a view of a real world scene, the capture of the visual content by the one or more image sensors defining a luminance of the visual content, the luminance varying as a function of a viewing field of view, the viewing field of view defining an extent of the visual content presented on a display;

presenting the visual content within the viewing field of view on the display;

receiving user input indicating a user'"'"'s selections of the viewing field of view, the user'"'"'s selections of the viewing field of view including a first selection of a first viewing field of view at a first time and a second selection of a second viewing field of view at a second time that is subsequent to the first time;

determining a first luminance of the visual content within the first viewing field of view;

determining a second luminance of the visual content within the second viewing field of view;

applying a lighting effect to the visual content based on a difference between the first luminance and the second luminance, the lighting effect simulating the adaptation of eyes to a change in lighting conditions between the visual content within the first viewing field of view and the visual content within the second viewing field of view.

12. The method of claim 11, wherein the difference between the first luminance and the second luminance includes one or more differences in a first median of the first luminance and a second median of the second luminance, a first mean of the first luminance and a second mean of the second luminance, a first range of the first luminance and a second range of the second luminance, and/or a first maximum of the first luminance and a second maximum of the second luminance.

13. The method of claim 12, wherein the first viewing field of view includes a first portion and a second portion, the first portion weighed differently from the second portion for the determination of the first luminance.

14. The method of claim 13, wherein the first portion includes a center portion of the first viewing field of view and the second portion includes a side portion of the first viewing field of view, the center portion having a greater impact on the determination of the first luminance than the side portion.

15. The method of claim 11, wherein the lighting effect is applied to the visual content for a time duration based on the difference between the first luminance and the second luminance.

16. The method of claim 11, wherein the lighting effect is applied to the visual content based on the difference between the first luminance and the second luminance meeting or exceeding a threshold.

17. The method of claim 11, wherein the lighting effect simulates the visual content within the second viewing field of view being overexposed based on the second luminance being higher than the first luminance and being underexposed based on the second luminance being lower than the first luminance.

18. The method of claim 11, wherein the lighting effect changes a brightness of the visual content within the second viewing field of view.

19. The method of claim 18, wherein the visual content within the second viewing field of view includes different portions and the change in the brightness of the visual content within the second viewing field of view includes different amounts of changes in the brightness in the different portions based on the luminance within the different portions.

20. The method of 11, wherein the lighting effect changes one or more tonal ranges of the visual content within the second viewing field of view.