Gesture controlled adaptive projected information handling system input and output devices

• US 9,304,599 B2
• Filed: 03/21/2014
• Issued: 04/05/2016
• Est. Priority Date: 03/21/2014
• Status: Active Grant

• Current Assignee: Dell Products LP (Dell Technologies Inc.)
• Original Assignee: Dell Products LP (Dell Technologies Inc.)
• Inventors: Krishnakumar, Karthikeyan, Ligameri, Mark R., Ancona, Rocco, Knoppert, Michiel Sebastiaan Emanuel Petrus, Walline, Erin K.
• Primary Examiner(s): HALEY, JOSEPH R
• Application Number:
  US14/221,928
• Publication Number:
  US 20150268730A1
• Time in Patent Office: 746 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 1/1673 Arrangements for projecting a virtual keyboard
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/0393 Accessories for touch pads or touch screens, e.g. mechanical guides added to touch screens for drawing straight lines, hard keys overlaying touch screens or touch pads
• CPC Class Codes: G06F 3/0426 tracking fingers with respect to a virtual keyboard projected or printed on the surface virtual keyboards on touch screens G06F3/04886
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0486 Drag-and-drop
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

Projected input and output devices adapt to a desktop environment by sensing objects at the desktop environment and altering projected light in response to the sensed objects. For instance, projection of input and output devices is altered to limit illumination against and end user'"'"'s hands or other objects disposed at a projection surface. End user hand positions and motions are detected to provide gesture support for adapting a projection work space, and configurations of projected devices are stored so that an end user can rapidly recreate a projected desktop. A projector scan adjusts to limit traces across inactive portions of the display surface and to increase traces at predetermined areas, such as video windows.

Claims

1. An information handling system comprising:

a housing;

processing components disposed in the housing and operable to cooperate to process information;

a projector interfaced with the processing components and operable to present the information as images at a projection surface, the images including at least one input device;

an input sensor operable to detect end user hand movements proximate the projection surface, the input sensor including at least a camera operable to capture an image of the end user hand; and

a gesture module stored in non-transitory memory and interfaced with the projector and the input sensor, the gesture module operable to adapt a projected input device position on the projection surface in response to an end user hand movement detected by the input sensor;

wherein the gesture module is further operable to determine a unique feature of the end user hand associated with an identification of the end user and in response to the identification to present a user interface associated with the end user.

2. The information handling system of claim 1 wherein the end user movement comprises placement of fingers in a typing position and the input device comprises a keyboard having keys aligned to the placement of fingers.

3. The information handling system of claim 2 wherein the gesture module is further operable to detect an identification feature associated with the end user hand movement and, in response to the identification feature, to generate plural output devices associated with the identification feature including at least output devices previously used by the end user.

4. The information handling system of claim 3 wherein the plural output devices comprise projected content access devices, each projected content access device selectable by an end user touch to open content associated with the end user.

5. The information handling system of claim 1 wherein the end user movement comprises pressing down on a projected touchpad and sliding the touchpad from a first position on the projection surface to a second position on the projection surface.

6. The information handling system of claim 1 wherein the processing components comprise a display integrated in the housing and operable to present information as visual images, and the projected input device comprises a keyboard having an integrated display window, the integrated display window presenting key inputs made by an end user at the keyboard, the key inputs applied to visual images presented at a display.

7. The information handling system of claim 1 wherein the input sensor is further operable to detect end user hand movements in a plane out of alignment with the projection surface and the gesture module is further operable to apply the detected end user hand movements to the projected input device translated to the projection surface plane.

8. The information handling system of claim 1 wherein the projected input device comprises a projected keyboard and the gesture module adapts the projected keyboard to a selected of plural languages in response to an end user gesture.