DYNAMIC PROJECTED USER INTERFACE

• US 20110285633A1
• Filed: 07/13/2011
• Published: 11/24/2011
• Est. Priority Date: 01/25/2007
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Bathiche, Steven N., Wilson, Andrew D.
• Granted Patent: US 8,493,366 B2
• Time in Patent Office: Days
• US Class Current: 345/168
• CPC Class Codes: G06F 2203/04109 FTIR in optical digitiser, i.e. touch detection by frustrating the total internal reflection within an optical waveguide due to changes of optical properties or deformation at the touch location
• CPC Class Codes: G06F 2203/04809 Textured surface identifying touch areas, e.g. overlay structure for a virtual keyboard
• CPC Class Codes: G06F 3/0238 Programmable keyboards key guide holders G06F3/0224
• CPC Class Codes: G06F 3/0421 by interrupting or reflecting a light beam, e.g. optical touch-screen
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

A dynamic projected user interface device is disclosed, that includes a projector, a projection controller, and an imaging sensor. The projection controller is configured to receive instructions from a computing device, and to provide display images via the projector onto display surfaces. The display images are indicative of a first set of input controls when the computing device is in a first operating context, and a second set of input controls when the computing device is in a second operating context. The imaging sensor is configured to optically detect physical contacts with the one or more display surfaces.

Claims

1. A device comprising:

a projector;

a keypad comprising a plurality of keys disposed on at least a portion of the keypad;

a waveguide comprising an image portion having a first surface forming a first boundary and a second surface forming a second boundary, the first and second surfaces of the image portion converging along the projection path from the projector and each of the plurality of keys having a first key surface facing the image portion and a second key surface opposite the first key surface, the first and second surfaces of the image portion being configured to direct first rays of electromagnetic radiation emitted from the projector onto the first key surface of a first key at a first portion of the image portion and configured to direct second rays of electromagnetic radiation emitted from the projector by internal reflection through the first portion of the image portion and onto the first key surface of a second key at a second portion of the image portion;

a projection controller, configured to receive instructions from a computing device and to provide one or more display images via the projector onto one or more display surfaces, the one or more display surfaces comprising the second key surface of one or more of the plurality of keys, wherein the display images are indicative of a first set of input controls when the computing device is in a first operating context, and a second set of input controls when the computing device is in a second operating context; and

an imaging sensor, configured to optically detect physical contacts between an object and the one or more display surfaces.

2. The device of claim 1, wherein the keypad comprises at least one of a keyboard, a numeric keypad, a game controller, and a musical keyboard.

3. The device of claim 1, wherein the waveguide is disposed between the projector and one or more of the display surfaces.

4. The device of claim 3, wherein the waveguide comprises an expansion portion with boundaries that diverge along the projection path away from the projector, wherein the projector is positioned in interface with the expansion portion and the image portion is positioned in interface with the display surface, such that rays emitted by the projector are internally reflected throughout the expansion portion and are transmitted from the image portion to the display surface.

5. The device of claim 4, wherein the waveguide comprises a waveguide nexus configured to reflect images from the projector onto respective image paths in the expansion portion, wherein the projector is positioned adjacent the waveguide nexus and configured to project the images directly to the waveguide nexus.

6. The device of claim 1, wherein the imaging sensor is disposed in connection with the waveguide and configured to detect physical contacts with the one or more display surfaces by imaging the physical contacts through the waveguide.

7. The device of claim 1, further comprising one or more additional projectors and waveguides, such that each of the waveguides is disposed between one of the projectors and a portion of the one or more display surfaces.

8. The device of claim 1, wherein the projector is configured to emit non-visible light, and the one or more display surfaces comprise a composition adapted to re-emit visible light responsively to absorption of the non-visible light.

9. The device of claim 1, wherein the projector is configured to emit non-visible light, and wherein the imaging sensor is configured to obtain images from reflections of the non-visible light through the one or more display surfaces.

10. The device of claim 1, wherein the projector comprises a spatial light modulator, and one or more laser emitters configured to project the display images in a rasterized scanning beam format.

11. The device of claim 1, further configured to detect a plurality of different modes of physical contact with the one or more display surfaces, such that a plurality of different inputs are enabled for a single one of the display surfaces, as a function of characteristics of the physical contact with that display surface.

12. The device of claim 1, wherein the first portion of the image portion is configured to reflect the second rays of electromagnetic radiation with total internal reflection and the second portion of the image portion is configured to direct the second rays of electromagnetic radiation to the first surface of the image portion at an angle past a critical angle.

13. The device of claim 1, wherein the portion of the keypad is disposed adjacent the first surface of the image portion.

14. The device of claim 1, wherein the plurality of keys are arranged on the keypad in a plurality of rows, wherein the image portion is configured to direct rays of electromagnetic radiation, emitted from the projector, along the projection path and onto a number of keys in each of the plurality of rows.

15. A device comprising:

a keypad, comprising one or more displaceable keys;

an imaging sensor configured for entering input to a computing system;

a substantially flat, tapered waveguide disposed between the keypad and the imaging sensor, the waveguide configured to enable the imaging sensor to detect physical displacement of the one or more keys by imaging at least a portion of the one or more keys; and

a projector operatively connected to an output interface of the computing system, the projector being configured for dynamically generating images as a function of output from the computing system, and projecting the dynamically generated images through the waveguide and onto the one or more keys.

16. The device of claim 15, wherein each of the one or more keys of the keypad have a first surface facing the waveguide and a second surface opposite the first surface, and wherein the waveguide is configured to enable the imaging sensor to detect physical contact with the second surface of the one or more keys and to detect physical displacement of the one or more keys, thereby enabling a plurality of different inputs for each of the one or more keys.

17. The device of claim 15, wherein the waveguide is disposed between the projector and keypad.

18. The device of claim 17, wherein the waveguide comprises an expansion portion with boundaries that diverge along the projection path away from the projector, wherein the projector is positioned in interface with the expansion portion and the image portion is positioned in interface with the keypad, such that rays emitted by the projector are internally reflected throughout the expansion portion and are transmitted from the image portion to the one or more keys.

19. A device comprising:

a projector;

a keypad comprising a plurality of keys disposed on at least a portion of the keypad and including at least first and second keys arranged in a direction of a projection path from the projector;

a waveguide comprising an image portion having a first surface forming a first boundary of the image portion and a second surface that is spaced apart from the first surface and forms a second boundary of the image portion, each of the plurality of keys having a first key surface facing the image portion and a second key surface opposite the first key surface, the first and second surfaces of the image portion being configured to direct rays of electromagnetic radiation emitted from the projector onto the first key surface of each of the first and second keys;

a projection controller, configured to receive instructions from a computing device and to provide one or more display images via the projector onto one or more display surfaces, the one or more display surfaces comprising the second key surface of one or more of the plurality of keys; and

an imaging sensor, configured to optically detect physical contacts between an object and the one or more display surfaces.

20. The device of claim 19, wherein the plurality of keys are arranged on the keypad in a plurality of rows, wherein the image portion is configured to direct rays of electromagnetic radiation, emitted from the projector, along the projection path and onto at least one key in each of the plurality of rows.