Gesture Controlled Adaptive Projected Information Handling System Input and Output Devices

• US 20150268730A1
• Filed: 03/21/2014
• Published: 09/24/2015
• Est. Priority Date: 03/21/2014
• Status: Active Grant

• Current Assignee: Dell Products LP (Dell Technologies Inc.)
• Original Assignee: Dell Products LP (Dell Technologies Inc.)
• Inventors: Walline, Erin K., Krishnakumar, Karthikeyan, Ligameri, Mark R., Ancona, Rocco, Knoppert, Michiel Sebastiaan Emanuel Petrus
• Granted Patent: US 9,304,599 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 1/1673 Arrangements for projecting a virtual keyboard
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/03545 Pens or stylus
• CPC Class Codes: G06F 3/0393 Accessories for touch pads or touch screens, e.g. mechanical guides added to touch screens for drawing straight lines, hard keys overlaying touch screens or touch pads
• CPC Class Codes: G06F 3/0426 tracking fingers with respect to a virtual keyboard projected or printed on the surface virtual keyboards on touch screens G06F3/04886
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0486 Drag-and-drop
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

Projected input and output devices adapt to a desktop environment by sensing objects at the desktop environment and altering projected light in response to the sensed objects. For instance, projection of input and output devices is altered to limit illumination against and end user'"'"'s hands or other objects disposed at a projection surface. End user hand positions and motions are detected to provide gesture support for adapting a projection work space, and configurations of projected devices are stored so that an end user can rapidly recreate a projected desktop. A projector scan adjusts to limit traces across inactive portions of the display surface and to increase traces at predetermined areas, such as video windows.

Claims

1. An information handling system comprising:

a housing;

processing components disposed in the housing and operable to cooperate to process information;

a projector interfaced with the processing components and operable to present the information as images at a projection surface, the images including at least one input device;

an input sensor operable to detect end user hand movements proximate the projection surface; and

a gesture module stored in non-transitory memory and interfaced with the projector and the input sensor, the gesture module operable to adapt a projected input device position on the projection surface in response to an end user hand movement detected by the input sensor.

2. The information handling system of claim 1 wherein the end user movement comprises placement of fingers in a typing position and the input device comprises a keyboard having keys aligned to the placement of fingers.

3. The information handling system of claim 2 wherein the gesture module is further operable to detect an identification feature associated with the end user hand movement and, in response to the identification feature, to generate plural output devices associated with the identification feature.

4. The information handling system of claim 3 wherein the plural output devices comprise projected content access devices, each projected content access device selectable by an end user touch to open content associated with the end user.

5. The information handling system of claim 1 wherein the end user movement comprises pressing down on a projected touchpad and sliding the touchpad from a first position on the projection surface to a second position on the projection surface.

6. The information handling system of claim 1 wherein the processing components comprise a display integrated in the housing and operable to present information as visual images, and the projected input device comprises a keyboard having an integrated display window, the integrated display window presenting key inputs made by an end user at the keyboard, the key inputs applied to visual images presented at a display.

7. The information handling system of claim 1 wherein the input sensor is further operable to detect end user hand movements in a plane out of alignment with the projection surface and the gesture module is further operable to apply the detected end user hand movements to the projected input device translated to the projection surface plane.

8. The information handling system of claim 1 wherein the projected input device comprises a projected keyboard and the gesture module adapts the projected keyboard to a selected of plural languages in response to an end user gesture.

9. A method for adapting a projected input device in response to gestures, the method comprising:

projecting an image of an input device at a projection surface;

detecting a predetermined gesture by an end user hand movement, the gesture proximate the projected input device; and

in response to the detecting, adapting the input device image according to a definition of the predetermined gesture.

10. The method of claim 9 wherein:

detecting a predetermined gesture by an end user hand movement further comprises a placement of fingers on the input device and dragging of the fingers along the projection surface; and

adapting the input device image further comprises moving the input device in the direction of the dragging.

11. The method of claim 9 wherein:

detecting a predetermined gesture by an end user hand movement further comprises placing fingers on the projection surface in a typing position; and

adapting the input device image further comprises moving the input device to align predetermined typing keys of the input device to predetermined of the fingers.

12. The method of claim 9 wherein:

detecting a predetermined gesture by an end user hand movement further comprises pointing a finger at an object disposed proximate the projection surface; and

adapting the input device image further comprises populating the input device with information associated with the object.

13. The method of claim 9 wherein:

detecting a predetermined gesture by an end user hand movement further comprises swiping the hand across the input device image; and

adapting the input device image further comprises changing the input device from a first configuration to a second configuration.

14. The method of claim 9 wherein:

detecting a predetermined gesture by an end user hand movement further comprises detecting identification information input by the end user by the gesture; and

adapting the input device image further comprises presenting plural output devices enabled to interact with the input device based upon the identification information.

15. The method of claim 9 wherein:

detecting a predetermined gesture by an end user hand movement further comprises detecting a rotational motion in a plane unaligned with a plane of the projection surface; and

adapting the input device image further comprises rotating the input device image in the projection surface plane.

16. The method of claim 9 wherein:

detecting a predetermined gesture by an end user hand movement further comprises a touch by an end user on the input device image, the input device image having a subdued appearance, the input device image providing access to secured information; and

adapting the input device further comprises providing a password interface to access the secured information.

17. The method of claim 9 wherein:

detecting a predetermined gesture by an end user hand movement further comprises detecting a unique feature associated with the end user hand; and

adapting the input device further comprises projecting a tool bar associated with the unique feature.

18. A system adapting a projected input device in response to gestures, the system comprising:

a projector and operable to present input devices as images projected at a projection surface;

an input sensor interfaced with the projector and operable to detect inputs made at the input devices; and

a gesture module stored in non-transitory memory and interfaced with the projector and the input sensor, the gesture module operable to adapt a projected input device in response to an end user gesture detected by the input sensor.

19. The system of claim 18 wherein the input device comprises a keyboard, the keyboard adapting in response to an end user gesture by adding a tool bar having tools selectable by the end user with a touch to the selected tool.

20. The system of claim 18 wherein the input device comprises keyboard, the keyboard adapting in response to an end user gesture by selectively presenting a typing window that presents inputs made at keys of the keyboard.