Managing inputs at an information handling system by adaptive infrared illumination and detection

• US 9,791,979 B2
• Filed: 04/21/2015
• Issued: 10/17/2017
• Est. Priority Date: 04/21/2015
• Status: Active Grant

• Current Assignee: Dell Products LP (Dell Technologies Inc.)
• Original Assignee: Dell Products LP (Dell Technologies Inc.)
• Inventors: Pacheco, Roman J., Ancona, Rocco, Sanaullah, Abu S.
• Primary Examiner(s): Elahi, Towfiq
• Application Number:
  US14/691,840
• Publication Number:
  US 20160313866A1
• Time in Patent Office: 910 Days
• CPC Class Codes: G06F 1/1639 the display being based on projection
• CPC Class Codes: G06F 1/1673 Arrangements for projecting a virtual keyboard
• CPC Class Codes: G06F 1/3231 Monitoring the presence, absence or movement of users
• CPC Class Codes: G06F 2203/04106 Multi-sensing digitiser, i.e. digitiser using at least two different sensing technologies simultaneously or alternatively, e.g. for detecting pen and finger, for saving power or for improving position detection
• CPC Class Codes: G06F 2203/04108 Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/03547 Touch pads, in which fingers can move on a surface
• CPC Class Codes: G06F 3/0393 Accessories for touch pads or touch screens, e.g. mechanical guides added to touch screens for drawing straight lines, hard keys overlaying touch screens or touch pads
• CPC Class Codes: G06F 3/0425 using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected tracking a projected light spot to determine a position on a display surface G06F3/0386
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: Y02D 10/00 Energy efficient computing, e.g. low power processors, power management or thermal management

Abstract

A single camera detects user interactions with separate infrared light sources, such as structured light for three dimensional detection and an infrared curtain surface touch interactions. A touch input module monitors user interactions with a desktop surface, such as at a projected or display mat user interface presentation, and selectively illuminates the separate infrared light sources to support camera detection based upon the user interactions. For example, separate infrared light sources illumination in an interleaved manned at variable rates based upon analysis of visible light or structured light images captured by the camera.

Claims

1. An information handling system comprising:

a processor operable to process information for presentation to a user as visual images;

memory interfaced with the processor and operable to store the information;

a graphics system interfaced with the processor and memory, the graphics system operable to generate the visual images at one or more display devices;

a display device interfaced with the graphics system and operable to present the visual images;

a camera aligned to capture an image proximate the visual images;

a first infrared light source operable to generate an infrared curtain along a surface proximate the visual images to aid surface touch input detection;

a second infrared light source operable to generate structured light above the infrared curtain to aid three dimensional object detection; and

a touch input module interfaced with the camera, the first infrared light source and the second infrared light source, the touch input module operable to analyze visual images captured by the camera and to selectively illuminate the first or second infrared light sources based upon the analyzing;

wherein the touch input module selectively interleaves illumination by the first and second infrared light sources based at least in part upon an end user hand position detected in a visual image captured by the camera.

2. The information handling system of claim 1 wherein:

the display device comprises a projector aligned to project the visual images at a desktop surface;

the first infrared light source is aligned to illuminate the infrared curtain proximate to and parallel above the desktop surface; and

the touch input module turns off the first infrared light source unless the visual images captured by the camera indicate an end user body portion situated to perform a touch input at the desktop surface.

3. The information handling system of claim 1 wherein:

the display device comprises a projector aligned to project the visual images at a desktop surface;

the second infrared light source is aligned to illuminate the structured light above the infrared curtain to detect objects disposed above the infrared curtain; and

the touch input module turns off the second infrared light source unless the visual images captured by the camera indicate an end user body portion situated above the desktop surface.

4. The information handling system of claim 1 wherein the touch input module selectively turns off the second infrared light source upon detection by the camera of an end user'"'"'s hands arranged to type at the desktop surface.

5. An information handling system comprising:

a processor operable to process information for presentation to a user as visual images;

memory interfaced with the processor and operable to store the information;

a graphics system interfaced with the processor and memory, the graphics system operable to generate the visual images at one or more display devices;

a display device interfaced with the graphics system and operable to present the visual images;

a camera aligned to capture an image proximate the visual images;

a first infrared light source operable to generate an infrared curtain along a surface proximate the visual images to aid surface touch input detection;

a second infrared light source operable to generate structured light above the infrared curtain to aid three dimensional object detection; and

a touch input module interfaced with the camera, the first infrared light source and the second infrared light source, the touch input module operable to analyze visual images captured by the camera and to selectively illuminate the first or second infrared light sources based upon the analyzing;

wherein the touch input module selectively illuminates the first or second infrared light sources by interleaving the first and second infrared light sources and coordinating the camera to provide touch input detection during illumination by the first infrared light source and to provide three dimensional object detection during illumination by the second infrared light source.

6. The information handling system of claim 5 wherein the touch input module illuminates the first and second infrared light sources at first and second rates based upon one or more predetermined conditions detected by the image captured by the camera.

7. An information handling system comprising:

a processor operable to process information for presentation to a user as visual images;

memory interfaced with the processor and operable to store the information;

a graphics system interfaced with the processor and memory, the graphics system operable to generate the visual images at one or more display devices;

a display device interfaced with the graphics system and operable to present the visual images;

a camera aligned to capture an image proximate the visual images;

a first infrared light source operable to generate an infrared curtain along a surface proximate the visual images to aid surface touch input detection;

a second infrared light source operable to generate structured light above the infrared curtain to aid three dimensional object detection; and

a touch input module interfaced with the camera, the first infrared light source and the second infrared light source, the touch input module operable to analyze visual images captured by the camera and to selectively illuminate the first or second infrared light sources based upon the analyzing;

wherein the display device comprises a projector aligned to project the visual images at a desktop surface and a capacitive mat disposed on the desktop surface, the touch input module interleaving illumination of the first and second infrared light sources at first and second rates based upon a determination of touches by an end user at the capacitive mat or at the desktop surface external to the capacitive mat.

8. The information handling system of claim 7 wherein the touch input module further adjust the first and second rates based upon a determination that touches by the end user are performed with a finger with a writing instrument.

9. A method for adaptive infrared illumination to manage input detection at a user interface presented on a desktop surface, the method comprising:

presenting a user interface on at a desktop surface, the user interface accepting end user inputs detected by a camera;

capturing an image with the camera that includes at least a portion of the user interface;

analyzing the captured interface to determine a first or second condition associated with the user interface;

in response to determining the first condition, providing a first illumination setting for first and second infrared light sources; and

in response to determining the second condition, providing a second illumination setting for the first and second infrared light sources

wherein;

the first condition comprises motion detected proximate the desktop surface;

the first illumination setting comprises cycling on the first infrared light source aligned to illuminate an infrared curtain over the desktop surface at a first cycle rate; and

the second illumination setting comprises cycling on the second infrared light source aligned to track three dimensional objects over the desktop surface at a second cycle rate.

10. The method of claim 9 wherein:

the first condition comprises motion detected above the desktop surface;

the first illumination setting comprises turning off the first infrared light source aligned to illuminate an infrared curtain over the desktop surface; and

the second illumination setting comprises cycling on the second infrared light source aligned to track three dimensional objects over the desktop surface at a first cycle rate.

11. The method of claim 9 further comprising:

interleaving illumination by the first and second infrared light sources;

capturing images with the camera having illumination from the first light source to determine touches at the desktop surface; and

capturing images with the camera having illumination from the second light source to determine three dimensional objects disposed over the desktop surface.

12. The method of claim 9 wherein:

the first condition comprises an end user'"'"'s hands in a typing posture proximate the desktop surface;

the first illumination setting comprises cycling on the first infrared light source aligned to illuminate an infrared curtain over the desktop surface; and

the second illumination setting comprises turning off the second infrared light source aligned to track three dimensional objects over the desktop surface at a second cycle rate.

13. A method for adaptive infrared illumination to manage input detection at a user interface presented on a desktop surface, the method comprising:

presenting a user interface on at a desktop surface, the user interface accepting end user inputs detected by a camera;

capturing an image with the camera that includes at least a portion of the user interface;

analyzing the captured interface to determine a first or second condition associated with the user interface;

in response to determining the first condition, providing a first illumination setting for first and second infrared light sources;

in response to determining the second condition, providing a second illumination setting for the first and second infrared light sources;

monitoring the user interface with the camera to detect an absence of the first and second conditions; and

in response to detecting the absence of the first and second conditions, turning off both the first and second infrared light sources.

14. A method for adaptive infrared illumination to manage input detection at a user interface presented on a desktop surface, the method comprising:

presenting a user interface on at a desktop surface, the user interface accepting end user inputs detected by a camera;

capturing an image with the camera that includes at least a portion of the user interface;

analyzing the captured interface to determine a first or second condition associated with the user interface;

in response to determining the first condition, providing a first illumination setting for first and second infrared light sources;

in response to determining the second condition, providing a second illumination setting for the first and second infrared light sources;

monitoring the user interface to detect a proximity of the user'"'"'s hands to the desktop surface; and

in response to the proximity, adjusting the rate at which the first infrared light source cycles on and off to illuminate an infrared curtain over the desktop surface.

15. The method of claim 14 wherein monitoring the user interface to detect a proximity of the user'"'"'s hand further comprises sensing a distance to the user'"'"'s hand with a proximity sensor disposed on the desktop surface.

16. A system for adaptive infrared illumination to manage input detection at a user interface presented on a desktop surface, the system comprising:

a camera aligned to capture an image proximate the desktop surface;

a first infrared light source operable to generate an infrared curtain along the desktop surface proximate a user interface having touch inputs;

a second infrared light source operable to generate structured light above the infrared curtain to aid three dimensional object detection;

a touch input module interfaced with the camera, the first infrared light source and the second infrared light source, the touch input module operable to selectively illuminate the first or second infrared light sources based upon a predicted detection requirement; and

a power manager interfaced with the touch input module, the power manager operable to monitor images captured by the camera and to selectively power off the first and second infrared light sources based upon the predicted detection requirement and a power management setting.

17. The system of claim 16 wherein:

the predicted detection requirement comprises detection of a touch by an end user to the desktop surface; and

the touch input module responds to the predicted detection of a touch by an end user to the desktop surface by increasing the illumination cycle rate of the first infrared light source relative to the second infrared light source.