METHOD AND SYSTEM FOR HEAD MOUNTED DISPLAY INFRARED EMITTER BRIGHTNESS OPTIMIZATION BASED ON IMAGE SATURATION

• US 20200137289A1
• Filed: 10/30/2018
• Published: 04/30/2020
• Est. Priority Date: 10/30/2018
• Status: Active Grant

• Current Assignee: Dell Products LP (Dell Technologies Inc.)
• Original Assignee: Dell Products LP (Dell Technologies Inc.)
• Inventors: Iyer, Vivek Viswanathan, Yildiz, Yagiz C.
• Granted Patent: US 10,735,665 B2
• Time in Patent Office: Days
• CPC Class Codes: G06T 2207/10048 Infrared image
• CPC Class Codes: G06T 2207/20072 Graph-based image processing
• CPC Class Codes: G06T 7/80 Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
• CPC Class Codes: G06V 10/225 based on a marking or identifier characterising the area
• CPC Class Codes: H04N 23/56 provided with illuminating means
• CPC Class Codes: H04N 23/74 by influencing the scene brightness using illuminating means

Abstract

An information handling system operating a wearable headset IR emitter saturation correction system may comprise an infrared emitter emitting IR light, a camera capturing a calibration image and a first session image of the IR light reflected from a landmark, and a SLAM engine generating a first session SLAM frame. A processor may execute code instructions to compare the measured calibration pixel brightness value for each pixel associated with the landmark in a calibration image with a measured first session pixel brightness value for each pixel associated with the landmark in the first session image to determine whether the first session SLAM frame is over or under saturated, and determine an adjusted brightness if the first session SLAM frame is over or under saturated. The infrared emitter may emit light according to the adjusted brightness.

Claims

1. An information handling system operating a wearable headset infrared (IR) emitter saturation correction system comprising:

an infrared emitter mounted on a wearable headset emitting IR light at a first brightness;

a camera capturing a calibration image of the IR light reflected from a first landmark;

a memory storing calibration histogram analysis of the calibration image associating each of a plurality of landmarks identified in the calibration image with brightness values for a subset of pixels within the calibration image, and with one or more of a plurality of IR emitters including the infrared emitter;

the camera capturing a session image of the IR light reflected from the first landmark;

a SLAM engine generating a first session SLAM frame based on the first session image;

a processor executing binary divide and conquer code instructions of the IR emitter saturation correction system to;

associate each of the plurality of landmarks identified in the session image with brightness values for a subset of pixels within the session image, and with one or more of the plurality of IR emitters including the infrared emitter;

determine whether the first session SLAM frame is over or under saturated based on a comparison, for each of the plurality of landmarks, of brightness values for the associated subset of pixels within the calibration image to brightness values for the associated subset of pixels within the session image;

determine an adjusted brightness for the infrared emitter based on the first brightness and a brightness range within which the infrared emitter is capable of emitting light if the first session SLAM frame is over or under saturated; and

the infrared emitter emitting light according to the adjusted brightness.

2. The information handling system of claim 1, further comprising:

the infrared emitter emitting light at the first brightness if the SLAM engine generates a consecutive number of over or under saturated SLAM frames meeting a non-convergence threshold value.

3. The information handling system of claim 1, further comprising:

the processor executing the binary divide and conquer code instructions at a regular interval in which the SLAM engine generates a consecutive number of SLAM frames meeting a brightness test threshold value.

4. The information handling system of claim 1, wherein the first session SLAM frame is over saturated and the adjusted brightness is an adjustable convergence coefficient multiplied by a difference between the first brightness and a minimum of the range of brightness values at which the infrared emitter is capable of emitting light, subtracted from the first brightness.

5. The information handling system of claim 3, wherein the convergence coefficient is determined based on a number of headsets emitting IR light reflecting off one or more of the plurality of landmarks.

6. The information handling system of claim 3, wherein the convergence coefficient increases as the number of headsets emitting IR light reflecting off one or more of the plurality of landmarks increases.

7. The information handling system of claim 3, wherein the convergence coefficient decreases as a number of instances in which the infrared emitter is adjusted to emit light at the first brightness during a user session increases.

8. A method of adaptively adjusting brightness of an infrared (IR) emitter comprising:

emitting IR light at a first brightness via an infrared emitter mounted on a wearable headset;

capturing a calibration image of the IR light reflected from a first landmark via a camera;

storing, via a memory, calibration histogram analysis of the calibration image associating each of a plurality of landmarks identified in the calibration image with brightness values for a subset of pixels within the calibration image, and with one or more of a plurality of IR emitters including the infrared emitter;

capturing a session image of the IR light reflected from the first landmark via the camera;

generating a first session SLAM frame based on the first session image, via a SLAM engine;

associating each of the plurality of landmarks identified in the session image with brightness values for a subset of pixels within the session image, and with one or more of the plurality of IR emitters including the infrared emitter, via a processor;

determining, via the processor, whether the first session SLAM frame is over or under saturated based on a comparison, for each of the plurality of landmarks, of brightness values for the associated subset of pixels within the calibration image to brightness values for the associated subset of pixels within the session image;

determining an adjusted brightness for the infrared emitter, via the processor, based on the first brightness and a brightness range within which the infrared emitter is capable of emitting light if the first session SLAM frame is over or under saturated; and

emitting light via the infrared emitter according to the adjusted brightness.

9. The method of claim 8, further comprising:

emitting light via the infrared emitter at the first brightness if the SLAM engine generates a consecutive number of over or under saturated SLAM frames meeting a non-convergence threshold value.

10. The method of claim 8, wherein the adjusted brightness is an adjustable convergence coefficient multiplied by a difference between a maximum of the range of brightness values at which the infrared emitter is capable of emitting light and the first brightness, added to the first brightness.

11. The method of claim 10, wherein the convergence coefficient is determined based on a number of headsets emitting IR light reflecting off one or more of the plurality of landmarks.

12. The method of claim 10, wherein the convergence coefficient decreases as the number of headsets emitting IR light reflecting off one or more of the plurality of landmarks decreases.

13. The method of claim 10, wherein the convergence coefficient decreases as a number of instances in which the infrared emitter is adjusted to emit light at the first brightness during a user session increases.

14. The method of claim 10, wherein the first session SLAM frame is under saturated.

15. An information handling system operating a wearable headset infrared (IR) emitter saturation correction system comprising:

an infrared emitter mounted on a wearable headset emitting IR light at a first brightness;

a camera capturing a calibration image of the IR light reflected from a first landmark;

a memory storing calibration histogram analysis of the calibration image associating each of a plurality of landmarks identified in the calibration image with brightness values for a subset of pixels within the calibration image, and with one or more of a plurality of IR emitters including the infrared emitter;

the camera capturing a session image of the IR light reflected from the first landmark;

a SLAM engine generating a first session SLAM frame based on the first session image;

a processor executing binary divide and conquer code instructions of the IR emitter saturation correction system to;

associate each of the plurality of landmarks identified in the session image with brightness values for a subset of pixels within the session image, and with one or more of the plurality of IR emitters including the infrared emitter;

determine whether the first session SLAM frame is over or under saturated based on a comparison, for each of the plurality of landmarks, of brightness values for the associated subset of pixels within the calibration image to brightness values for the associated subset of pixels within the session image;

determine an adjusted brightness, if the first session SLAM frame is over or under saturated, equivalent to an adjustable convergence coefficient multiplied by a difference between the first brightness and a minimum or maximum of the range of brightness values at which the infrared emitter is capable of emitting light, subtracted from the first brightness; and

the infrared emitter emitting light according to the adjusted brightness.

16. The information handling system of claim 15, further comprising:

the infrared emitter emitting light at the first brightness if the SLAM engine generates a consecutive number of over or under saturated SLAM frames meeting a non-convergence threshold value.

17. The information handling system of claim 15, further comprising:

the processor executing the binary divide and conquer code instructions at a regular interval in which the SLAM engine generates a consecutive number of SLAM frames meeting a brightness test threshold value.

18. The information handling system of claim 15, wherein the convergence coefficient increases as the number of headsets emitting IR light reflecting off one or more of the plurality of landmarks increases.

19. The information handling system of claim 15, wherein the convergence coefficient decreases as the number of headsets emitting IR light reflecting off one or more of the plurality of landmarks decreases.

20. The information handling system of claim 15, wherein the convergence coefficient decreases as a number of instances in which the infrared emitter is adjusted to emit light at the first brightness during a user session increases.