Image display device, method of controlling image display device, computer program, and image display system
First Claim
Patent Images
1. A head-mounted display device comprising:
- a camera that picks up an outside scene image;
a transmissive-type display configured to display virtual imagery while allowing real world scenery to be seen through the transmissive-type display; and
a processor or application specific integrated circuit (ASIC) configured to;
establish connections between the head-mounted display device and a plurality of external devices, respectively, the plurality of external devices being provided respective markers;
for each one of the plurality of external devices that a connection is established for;
acquire, from the one of the plurality of external devices that the connection is established for, information identifying the one of the plurality of external devices that the connection is established for;
generate, based on the information identifying the one of the plurality of external devices that the connection is established for, an identification image for distinguishing the one of the plurality of external devices that the connection is established for from the other plurality of external devices connected to the head-mounted display device, wherein the identification image comprises a frame image of a screen including multiple contents for operating the one of the plurality of external devices displayed by the one of the plurality of external devices; and
cut the connection between the head-mounted display device and the one of the plurality of external devices that the connection was established for;
generate a first integrated image including a first display region including the identification images generated for each of the plurality of external devices that were connected to the head-mounted display device organized as a list, each identification image identifying one of the plurality of external devices that were connected to the head-mounted display device;
cause the transmissive-type display to display the first integrated image;
detect one of the markers in the outside scene image captured by the camera;
make a selection of one of the plurality of external devices based on the detected marker;
generate a second integrated image including another first display region including another plurality of identification images organized as another list, and a second display region where a display image is displayed by;
requesting the display image from the selected one of the plurality of external devices;
receiving the display image, which is a frame image obtained by the selected one of the plurality of external devices by rendering an image of a display screen of the selected one of the plurality of external devices that is currently displayed, wherein the respective identification images are superimposed on the display image in the second integrated image; and
cause the transmissive-type display to display the second integrated image.
1 Assignment
0 Petitions
Accused Products
Abstract
An image display device includes a generating unit configured to generate an integrated image including first display regions where at least a part of a plurality of identification images for distinguishing a plurality of external devices connected to the image display device from one another are displayed as a list and a second display region where a display image, which is an image displayed by one external device selected out of the plurality of external devices, is displayed and an image display unit configured to cause a user of the image display device to visually recognize the integrated image.
-
Citations
12 Claims
-
1. A head-mounted display device comprising:
-
a camera that picks up an outside scene image; a transmissive-type display configured to display virtual imagery while allowing real world scenery to be seen through the transmissive-type display; and a processor or application specific integrated circuit (ASIC) configured to; establish connections between the head-mounted display device and a plurality of external devices, respectively, the plurality of external devices being provided respective markers; for each one of the plurality of external devices that a connection is established for; acquire, from the one of the plurality of external devices that the connection is established for, information identifying the one of the plurality of external devices that the connection is established for; generate, based on the information identifying the one of the plurality of external devices that the connection is established for, an identification image for distinguishing the one of the plurality of external devices that the connection is established for from the other plurality of external devices connected to the head-mounted display device, wherein the identification image comprises a frame image of a screen including multiple contents for operating the one of the plurality of external devices displayed by the one of the plurality of external devices; and cut the connection between the head-mounted display device and the one of the plurality of external devices that the connection was established for; generate a first integrated image including a first display region including the identification images generated for each of the plurality of external devices that were connected to the head-mounted display device organized as a list, each identification image identifying one of the plurality of external devices that were connected to the head-mounted display device; cause the transmissive-type display to display the first integrated image; detect one of the markers in the outside scene image captured by the camera; make a selection of one of the plurality of external devices based on the detected marker; generate a second integrated image including another first display region including another plurality of identification images organized as another list, and a second display region where a display image is displayed by; requesting the display image from the selected one of the plurality of external devices; receiving the display image, which is a frame image obtained by the selected one of the plurality of external devices by rendering an image of a display screen of the selected one of the plurality of external devices that is currently displayed, wherein the respective identification images are superimposed on the display image in the second integrated image; and cause the transmissive-type display to display the second integrated image. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A method of controlling a head-mounted display device including a camera that picks up an outside scene image, the method comprising:
-
establishing connections between the head-mounted display device and a plurality of external devices, respectively, the plurality of external devices being provided respective markers; for each one of the plurality of external devices that a connection is established for; acquiring, from the one of the plurality of external devices that the connection is established for, information identifying the one of the plurality of external devices that the connection is established for; generating, based on the information identifying the one of the plurality of external devices that the connection is established for, an identification image for distinguishing the one of the plurality of external devices that the connection is established for from the other plurality of external devices connected to the head-mounted display device, wherein the identification image comprises a frame image of a screen including multiple contents for operating the one of the plurality of external devices displayed by the one of the plurality of external devices; and cutting the connection between the head-mounted display device and the one of the plurality of external devices that the connection was established for; generating a first integrated image including a first display region including the identification images generated for each of the plurality of external devices that were connected to the head-mounted display device organized as a list, each identification image identifying one of the plurality of external devices that were connected to the head-mounted display device; causing the transmissive-type display to display the first integrated image; detecting one of the markers in the outside scene image captured by the camera; making a selection of one of the plurality of external devices based on the detected marker; generating a second integrated image including another first display region including another plurality of identification images organized as another list, and a second display region where a display image is displayed by; requesting the display image from the selected one of the plurality of external devices; receiving the display image, which is a frame image obtained by the selected one of the plurality of external devices by rendering an image of a display screen of the selected one of the plurality of external devices that is currently displayed, wherein the respective identification images are superimposed on the display image in the second integrated image; and causing the transmissive-type display to display the second integrated image.
-
-
11. A non-transitory computer readable medium comprising computer-executable instructions that, when executed by a computer, cause the computer to:
-
establish connections between a head-mounted display device and a plurality of external devices, respectively, the plurality of external devices being provided respective markers; for each one of the plurality of external devices that a connection is established for; acquire, from the one of the plurality of external devices that the connection is established for, information identifying the one of the plurality of external devices that the connection is established for; generate, based on the information identifying the one of the plurality of external devices that the connection is established for, an identification image for distinguishing the one of the plurality of external devices that the connection is established for from the other plurality of external devices connected to the head-mounted display device, wherein the identification image comprises a frame image of a screen including multiple contents for operating the one of the plurality of external devices displayed by the one of the plurality of external devices; and cut the connection between the head-mounted display device and the one of the plurality of external devices that the connection was established for; generate a first integrated image including a first display region including the identification images generated for each of the plurality of external devices that were connected to the head-mounted display device organized as a list, each identification image identifying one of the plurality of external devices that were connected to the head-mounted display device; cause the transmissive-type display to display the first integrated image; detect one of the markers in an outside scene image captured by a camera of the head-mounted display device; make a selection of one of the plurality of external devices based on the detected marker; generate a second integrated image including another first display region including another plurality of identification images organized as another list, and a second display region where a display image is displayed by; requesting the display image from the selected one of the plurality of external devices; receiving the display image, which is a frame image obtained by the selected one of the plurality of external devices by rendering an image of a display screen of the selected one of the plurality of external devices that is currently displayed, wherein the respective identification images are superimposed on the display image in the second integrated image; and cause the transmissive-type display to display the second integrated image.
-
-
12. A head-mounted display system comprising:
-
an information processing device; a head-mounted display device connected to the information processing device, the head-mounted display device comprising a transmissive-type display configured to display virtual imagery while allowing real world scenery to be seen through the transmissive-type display, and including a camera that picks up an outside scene image; and a plurality of external devices connected to the information processing device, wherein the information processing device includes; a processor or application specific integrated circuit (ASIC) configured to; establish connections between the head-mounted display device and the plurality of external devices, respectively, the plurality of external devices being provided respective markers; for each one of the plurality of external devices that a connection is established for;
acquire, from the one of the plurality of external devices that the connection is established for, information identifying the one of the plurality of external devices that the connection is established for;
generate, based on the information identifying the one of the plurality of external devices that the connection is established for, an identification image for distinguishing the one of the plurality of external devices that the connection is established for from the other plurality of external devices connected to the head-mounted display device, wherein the identification image comprises a frame image of a screen including multiple contents for operating the one of the plurality of external devices displayed by the one of the plurality of external devices; and
cut the connection between the head-mounted display device and the one of the plurality of external devices that the connection was established for;generate a first integrated image including a first display region including the identification images generated for each of the plurality of external devices that were connected to the head-mounted display device organized as a list, each identification image identifying one of the plurality of external devices that were connected to the head-mounted display device; cause the transmissive-type display to display the first integrated image; detect one of the markers in the outside scene image captured by the camera; make a selection of one of the plurality of external devices based on the detected marker; generate a second integrated image including another first display region including another plurality of identification images organized as another list, and a second display region where a display image is displayed by;
requesting the display image from the selected one of the plurality of external devices;
receiving the display image, which is a frame image obtained by the selected one of the plurality of external devices by rendering an image of a display screen of the selected on of the plurality of external devices that is currently displayed, wherein the respective identification images are superimposed on the display image in the second integrated image; and
cause the transmissive-type display to display the second integrated image.
-
Specification