Transparent display interaction

• US 8,941,683 B2
• Filed: 11/01/2010
• Issued: 01/27/2015
• Est. Priority Date: 11/01/2010
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Son, Sung Ho, Fleck, Rod G., Evans, Jordan P.
• Primary Examiner(s): Welch, David T
• Application Number:
  US12/917,265
• Publication Number:
  US 20120105487A1
• Time in Patent Office: 1,548 Days
• Field of Search: 345/629, 345/633
• US Class Current: 345/629
• CPC Class Codes: G06F 1/1637 Details related to the display arrangement, including those related to the mounting of the display in the housing
• CPC Class Codes: G06F 1/1643 the display being associated to a digitizer, e.g. laptops that can be used as penpads details related to the relative motion of the display enclosure with respect to the body enclosure, e.g. to move between laptop and tablet PC configuration G06F1/1615
• CPC Class Codes: G06F 1/1647 including at least an additional display G06F1/1692 takes precedence
• CPC Class Codes: G06F 2203/04804 Transparency, e.g. transparent or translucent windows
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

In embodiments of transparent display interaction, a portable device includes a handheld base movably coupled to a display device. The display device includes a display panel system that displays an image, and includes display surfaces through which the image is viewable. The image may appear as being projected into an environment behind the display device and viewable through the display surfaces of the display device. The display device is also configurable to open relative the handheld base to a position that the environment is viewable through the display device.

Claims

1. A portable device, comprising:

a display device that includes a display panel system configured to display an image, the image configured to display information about an object in an environment viewable through the display device;

a data interface configured to receive the information about the object based at least in part on geo-location information;

display surfaces of the display device through which the image is viewable, the image appearing projected into the environment behind the display device and viewable through the display surfaces of the display device;

a handheld base of the portable device movably coupled to the display device, the display device configurable to open relative to the handheld base to a position that the environment is viewable through the display device;

an additional display device integrated into the handheld base and configured to display information about the object in the environment, the environment not being viewable through the additional display device; and

a display panel controller configured to correlate a display position of the image for display with reference to the object in the environment based on the geo-location information.

2. A portable device as recited in claim 1, wherein the displayed image appears as part of the object in the environment.

3. A portable device as recited in claim 1, wherein the displayed image is a wearable item that appears to be worn by a user who is viewable, at least in part, in the environment that is viewable through the display device.

4. A portable device as recited in claim 1, wherein the data interface is further configured to receive location information from a data source, and wherein the displayed image includes the location information that corresponds to a location in the environment that is viewable through the display device.

5. A portable device as recited in claim 1, wherein the data interface is further configured to receive navigation information from a data source, and wherein the information displayed on the additional display device includes the navigation information that appears to display as part of the environment that is viewable through the display device.

6. A portable device as recited in claim 1, wherein the environment that is viewable through the display device includes text, and wherein the displayed image includes a text image of the text displayed magnified.

7. A portable device as recited in claim 1, the display panel controller further configured to:

move the item from the additional display device for display on the display device responsive to a user input, the item appearing as part of the object in the environment.

8. A portable device as recited in claim 1, wherein the environment that is viewable through the display device includes a page of content when the display device is positioned over the page, and wherein the information displayed on the additional display device includes text associated with the content on the page that is viewable through the display device.

9. A portable device as recited in claim 1, wherein the item includes a game board;

and

wherein the image includes possible moves associated with a game piece on the game board.

10. A display device, comprising:

a transparent display panel system configured to display an image, the image including information about an object in the environment viewable through the transparent display panel system;

a data interface configured to receive the information about the object based at least in part on geo-location information;

a non-transparent display panel system movably coupled to the transparent display and configured to display text and images including the information about the object;

display surfaces of the transparent display panel system that include a front display surface and a back display surface through which the image is viewable, the image appearing projected as part of the environment; and

a display panel controller configured to correlate a display position of the image for display with reference to the object in the environment based on the geo-location information.

11. A display device as recited in claim 10, wherein the displayed image is a wearable item appears to be worn by a user who is viewable, at least in part, in the environment that is viewable through the transparent display panel system.

12. A display device as recited in claim 10, wherein the displayed image appears as part of the object in the environment that is viewable through the transparent display panel system.

13. A display device as recited in claim 10, wherein the displayed image includes location information associated with a location of the object in the environment that is viewable through the transparent display panel system.

14. A display device as recited in claim 10, wherein the information displayed on the non-transparent display panel system includes navigation information that appears to display as part of the environment that is viewable through the transparent display panel system.

15. A display device as recited in claim 10, wherein the environment that is viewable through the transparent display panel system includes a page of content when the transparent display panel system is positioned over the page, and wherein the information displayed on the non-transparent display panel system includes text associated with the content on the page that is viewable through the transparent display panel system.

16. A method, comprising:

displaying an image on a display device, an environment behind the display device not being viewable through the display device;

moving the image from the display device to an additional display device, the additional display device movably coupled to the display device;

displaying the image to be viewable through display surfaces of the additional display device, the image appearing projected as part of an environment that is viewable through the additional display device;

receiving information about an object in the environment viewable through the additional display device based at least in part on geo-location information; and

correlating, based on the geo-location information, a display position of the image on the additional display device to display the image with reference to the object.

17. A method as recited in claim 16, wherein the displayed image includes the information about the object.

18. A method as recited in claim 16, further comprising receiving location information that corresponds to a location of the object in the environment, and wherein the displayed image includes the location information associated with the object.

19. A method as recited in claim 16, further comprising receiving navigation information, and wherein the displayed image includes the navigation information that appears to display as part of the environment that is viewable through the additional display device.