DISPLAY DEVICE, IMAGE DISPLAY SYSTEM, AND INFORMATION PROCESSING METHOD

• US 20150271457A1
• Filed: 03/17/2015
• Published: 09/24/2015
• Est. Priority Date: 03/18/2014
• Status: Abandoned Application

• Current Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Original Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Inventors: WATANABE, Wataru, BABA, Masahiro, KOKOJIMA, Yoshiyuki, SAWADA, Shimpei
• Application Number:
  US14/659,941
• Publication Number:
  US 20150271457A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 3/01 Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

According to an embodiment, a display device includes a projector to project light including information about a projection image; an optical member to transmit light from an information processing device but reflect the light including the information, the information processing device including a detector to detect touch operation onto a display screen and a display displaying a first image representing a display image; and a first obtainer to obtain the projection image formed by transforming a second image, which includes a non-overlapping area of the display image representing an area not overlapping with a part of the first image, based on position of the display such that, from light having come from the information processing device and having passed through the optical member and from the light including the information having reflected from the optical member, a state in which the non-overlapping area is present around the display is viewable.

Claims

1. A display device comprising:

a projector to project light including information about a projection image;

an optical member to transmit light coming from an information processing device but reflect the light including the information about the projection image incident thereon, the information processing device including a first detector capable of detecting a touch operation onto a display screen and a display that displays a first image representing at least a part of a display image; and

a first obtainer to obtain the projection image formed by performing transformation on a second image, which includes a non-overlapping area of the display image representing an area not overlapping with at least a part of the first image, based on position of the display in such a way that, from light that has come from the information processing device and has passed through the optical member and from the light including the information about the projection image that has reflected from the optical member, a state in which the non-overlapping area is present around the display is viewable.

2. The device according to claim 1, wherein the non-overlapping area of the display image represents an area on outside of the first image.

3. The device according to claim 1, further comprising a determiner to, when a positional relationship between the display device and the display does not satisfy a specific standard, perform control not to project the projection image.

4. The device according to claim 3, wherein

the transformation is affine transformation, and

when amount of translation in an affine transformation matrix, which is used in the affine transformation, is equal to or greater than a predetermined threshold value, the determiner determines that the specific standard is not satisfied.

5. The device according to claim 3, wherein

the transformation is affine transformation, and

when amount of rotation in an affine transformation matrix, which is used in the affine transformation, is equal to or greater than a predetermined threshold value, the determiner determines that the specific standard is not satisfied.

6. The device according to claim 3, wherein, based on position of the display, the determiner obtains angle defined by a virtual straight line representing viewing direction of a user and normal line of the display and, when the angle is equal to or greater than a threshold value, determines that the specific standard is not satisfied.

7. The device according to claim 2, wherein

the second image represents an image in which an area of the display image that corresponds to the first image is set to have luminance value equal to or smaller than a predetermined threshold value, and

the display device further comprises a boundary processor to set luminance value of peripheral portion in the area of the second image that corresponds to the first image to a value greater than the threshold value.

8. The device according to claim 1, further comprising a color controller to control luminance of a light source of at least one of the display device and the information processing device or control gradation of at least one of the first image and the second image, in such a way that appearance of a transmission image of the display coincides with appearance of a reflected image of the projection image.

9. The device according to claim 1, further comprising an updating controller to control timing of updating the first image or timing of updating the second image in such a way that timing of updating a transmission image of the display in response to the touch operation coincides with timing of updating a reflected image of the projection image in response to the touch operation.

10. The device according to claim 1, further comprising a second detector to detect position of the display, wherein

the detector is configured with a sensor other than a visible light camera.

11. The device according to claim 1, further comprising:

a second obtainer to obtain the display image;

a third obtainer to obtain operation information which indicates the touch operation detected by the first detector; and

a second image generator to generate the second image based on the display image and the operation information, wherein

the first obtainer generates the projection image by performing the transformation on the second image.

12. The device according to claim 1, wherein the first image has a greater volume of information than the second image.

13. An image display system comprising:

an information processing device that includes

a detector capable of detecting a touch operation onto a display screen, and

a display to display a first image representing at least a part of a display image;

a display device;

a projector to project light including information about a projection image;

an optical member to transmit light coming from the information processing device but reflect the light including the information about the projection image incident thereon; and

a transformer to generate the projection image by performing transformation on a second image, which includes a non-overlapping area of the display image representing an area not overlapping with at least a part of the first image, based on position of the display in such a way that, from light that has come from the information processing device and has passed through the optical member and from the light including the information about the projection image that has reflected from the optical member, a state in which the non-overlapping area is present around the display is viewable.

14. An information processing method comprising:

detecting a touch operation onto a display screen;

obtaining position of a display that displays a first image, which represents at least a part of a display image, in response to the detected touch operation;

generating the projection image by performing transformation on a second image, which includes a non-overlapping area of the display image representing an area not overlapping with at least a part of the first image, based on position of the display in such a way that, from light that has come from an information processing device and has passed through an optical member, which transmits light coming from the information processing device including the display but which reflects light including information about a projection image, and from the light including information about the projection image and that has reflected from the optical member, a state in which the non-overlapping area is present around the display is viewable; and

performing control to project the projection image on a display device that includes the optical member.