Projection of Images onto Tangible User Interfaces

• US 20090276734A1
• Filed: 05/02/2008
• Published: 11/05/2009
• Est. Priority Date: 05/02/2008
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Taylor, Stuart, Izadi, Shahram, Scott, James, Butler, David Alexander, Hodges, Stephen, Villar, Nicolas, Rosenfeld, Daniel A.
• Granted Patent: US 8,042,949 B2
• Time in Patent Office: Days
• US Class Current: 715/863
• CPC Class Codes: G03B 21/005 Projectors using an electronic spatial light modulator but not peculiar thereto
• CPC Class Codes: G06F 2203/04109 FTIR in optical digitiser, i.e. touch detection by frustrating the total internal reflection within an optical waveguide due to changes of optical properties or deformation at the touch location
• CPC Class Codes: G06F 3/0421 by interrupting or reflecting a light beam, e.g. optical touch-screen
• CPC Class Codes: G09F 19/18 involving the use of optical projection means, e.g. projection of images on clouds projection apparatus per se G03B
• CPC Class Codes: H04N 9/3141 Constructional details thereof details not peculiar to the presence of an electronic spatial light modulator G03B21/14

Abstract

A surface computing device is described which has a surface which can be switched between transparent and diffuse states. When the surface is in its diffuse state, an image can be projected onto the surface and when the surface is in its transparent state, an image can be projected through the surface and onto an object. In an embodiment, the image projected onto the object is redirected onto a different face of the object, so as to provide an additional display surface or to augment the appearance of the object. In another embodiment, the image may be redirected onto another object.

Claims

1. A surface computing device comprising:

a surface layer having at least two modes of operation, wherein in a first mode of operation the surface layer is substantially diffusing to visible light and in a second mode of operation, the surface layer is substantially transparent to visible light; and

projection apparatus operable to project graphical data onto the surface layer in the first mode of operation and to project graphical data through the surface onto an object in the second mode of operation.

2. A surface computing device according to claim 1, wherein the projection apparatus is arranged to project different graphical data in each mode of operation.

3. A surface computing device according to claim 1, further comprising:

object detection apparatus arranged to detect at least one of a location and an orientation of the object relative to the surface layer.

4. A surface computing device according to claim 3, wherein the graphical data projected through the surface onto an object in the second mode of operation is dependent upon the detected at least one of a location and an orientation of the object.

5. A surface computing device according to claim 1, further comprising:

imaging apparatus arranged to capture an image through the surface layer in the second mode of operation.

6. A surface computing device according to claim 5, further comprising:

a processor; and

memory arranged to store executable instructions to cause the processor to;

process said image to identify a user input; and

provide an input to a program running on the surface computing device according to said user input.

7. A surface computing device according to claim 1, wherein the projection apparatus comprises a display device operable to project graphical data onto the surface layer in the first mode of operation and a projector operable to project graphical data through the surface onto an object in the second mode of operation.

8. A method of operating a surface computing device comprising:

switching a surface layer between a substantially diffuse state and a substantially transparent state;

in the substantially diffuse state, projecting graphical data onto the surface layer; and

in the substantially transparent state, projecting graphical data through the surface onto an object.

9. A method according to claim 8, further comprising:

detecting a position of the object relative to the surface layer.

10. A method according to claim 9, further comprising:

changing the graphical data projected through the surface onto the object according to the detected position.

11. A method according to claim 8, further comprising:

in the substantially transparent state, capturing an image through the surface.

12. A method according to claim 11, further comprising:

processing said image to identify a user input; and

controlling a program running on the surface computing device according to said user input.

13. A surface computing system comprising:

a layer that can be electrically switched between a first state which is substantially diffusing to visible light and a second state which is substantially transparent to visible light; and

projection apparatus, comprising at least one projector, arranged to project graphical data onto the layer in its first state and to project graphical data through the layer onto an object in its second state.

14. A surface computing system according to claim 13, further comprising the object and wherein the object is operable to redirect the graphical data projected onto the object.

15. A surface computing system according to claim 14, wherein the object comprises a display surface and wherein the object is operable to redirect the graphical data onto the display surface.

16. A surface computing system according to claim 15, wherein the object comprises a plurality of display surfaces and wherein said graphical data projected through the layer in its second state comprises graphical data for display on at least one of the plurality of display surfaces.

17. A surface computing system according to claim 13, further comprising:

object detection apparatus arranged to detect at least one of a position and an orientation of the object.

18. A surface computing system according to claim 17, wherein the projection apparatus is further arranged to project different graphical data onto an object dependent upon the detected at least one of a position and an orientation of the object.

19. A surface computing system according to claim 17, wherein the object detection apparatus comprises an image capture device.

20. A surface computing system according to claim 13, further comprising:

touch detection apparatus arranged to detect a user touching the object and to control a program running on the surface computing system in response to said detection of a user touching the object.