Image display system, image display apparatus, and image display method
First Claim
1. An image display system for superimposing a virtual space image onto a real world image and displaying the resultant composite image on an image display apparatus that is of a hand-held type,the image display apparatus including:
- a housing;
a stereoscopic display screen which is provided on a front surface of the housing and is capable of providing an image that is stereoscopically visible by naked eyes; and
a first camera and a second camera provided on a back surface of the housing, andthe image display system that comprises a processing system that includes at least one hardware processor, the processing system configured to;
automatically detect an object that is present in a real world image shot by at least one of the first camera and the second camera;
determine and update positions and orientations of a pair of virtual cameras including a first virtual camera and a second virtual camera in a virtual space, based on detection of the object in the real world image;
generate, based on the first virtual camera, a first virtual space image of the virtual space;
generate, based on the second virtual camera, a second virtual space image of the virtual space; and
a cause an image that is stereoscopically visible by naked eyes to be displayed on the stereoscopic display screen, the image based on a first composite image obtained by superimposing the first virtual space image onto a first real world image shot by the first camera, and on a second composite image obtained by superimposing the second virtual space image onto a second real world image shot by the second camera.
0 Assignments
0 Petitions
Accused Products
Abstract
A hand-held image display apparatus includes a touch panel, a stereoscopic display apparatus, a first imaging section, and a second imaging section. The hand-held image display apparatus detects a marker from a real world image shot by at least one of the first imaging section and the second imaging section, and determines the relative positions of a virtual object and a pair of virtual cameras with respect to each other in a virtual space, based on the result of the detection. Then, the hand-held image display apparatus superimposes virtual space images drawn based on the first virtual camera and the second virtual camera, onto the real world images shot by the first imaging section and the second imaging section, and displays images that are stereoscopically visible by naked eyes, on the stereoscopic display apparatus.
146 Citations
14 Claims
-
1. An image display system for superimposing a virtual space image onto a real world image and displaying the resultant composite image on an image display apparatus that is of a hand-held type,
the image display apparatus including: -
a housing; a stereoscopic display screen which is provided on a front surface of the housing and is capable of providing an image that is stereoscopically visible by naked eyes; and a first camera and a second camera provided on a back surface of the housing, and the image display system that comprises a processing system that includes at least one hardware processor, the processing system configured to; automatically detect an object that is present in a real world image shot by at least one of the first camera and the second camera; determine and update positions and orientations of a pair of virtual cameras including a first virtual camera and a second virtual camera in a virtual space, based on detection of the object in the real world image; generate, based on the first virtual camera, a first virtual space image of the virtual space; generate, based on the second virtual camera, a second virtual space image of the virtual space; and a cause an image that is stereoscopically visible by naked eyes to be displayed on the stereoscopic display screen, the image based on a first composite image obtained by superimposing the first virtual space image onto a first real world image shot by the first camera, and on a second composite image obtained by superimposing the second virtual space image onto a second real world image shot by the second camera. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. An image display apparatus that is of a hand-held type, the image display apparatus comprising:
-
a housing; a stereoscopic display device provided on a front surface of the housing and configured to provide an image that is stereoscopically visible by naked eyes; first and second optics provided on a back surface of the housing; a processing system that includes at least one processor coupled to a memory, the processing system configured to; detect a particular object placed in a real world from a real world image acquired by using at least one of the first and second optics; determine and update, based on detection of the particular object in the real world, pose information for a first virtual camera and a second virtual camera located in a virtual space; generate, based on the first virtual camera, a first image of the virtual space; generate, based on the second virtual camera, a second image of the virtual space; and display, via the stereoscopic display device, an image that is stereoscopically visible by naked eyes, the displayed image based on (1) a first composite image obtained by superimposing the first image onto a first real world image acquired via the first optics, and (2) a second composite image obtained by superimposing the second image onto a second real world image acquired via the second optics.
-
-
13. A non-transitory computer-readable non-transitory storage medium having stored therein an image display program which causes a computer included in an image display system for superimposing a virtual space image onto a real world image and displaying the resultant composite image on an image display apparatus that is of a hand-held type, to execute:
-
automatically detecting an object that is located in a real world image shot by at least one of a first camera and a second camera provided on a back surface of a housing of the image display apparatus; determining and updating positions and orientations of a pair of virtual cameras including a first virtual camera and a second virtual camera in a virtual space, based on the detected particular object in the real world image; generating a first virtual space image by drawing the virtual space, based on the first virtual camera; generating a second virtual space image by drawing the virtual space, based on the second virtual camera; and displaying an image that is stereoscopically visible by naked eyes on a stereoscopic display which is provided on a front surface of the housing of the image display apparatus and is capable of providing an image that is stereoscopically visible by naked eyes, based on a first composite image obtained by superimposing the first virtual space image onto a first real world image shot by the first camera, and on a second composite image obtained by superimposing the second virtual space image onto a second real world image shot by the second camera.
-
-
14. An image display method for superimposing a virtual space image onto a real world image and displaying the resultant composite image on an image display apparatus that is of a hand-held type, the image display method comprising:
-
automatically detecting a predetermined object that is present in a real world image acquired by at least one of a first camera and a second camera that are both provided on a back surface of a housing of the image display apparatus; determining and updating positions and orientations of a pair of virtual cameras including a first virtual camera and a second virtual camera in a virtual space, based on the detected particular object in the real world image; generating a first virtual space image by drawing the virtual space, based on the first virtual camera; generating a second virtual space image by drawing the virtual space, based on the second virtual camera; and displaying an image that is stereoscopically visible by naked eyes on a stereoscopic display which is provided on a front surface of the housing of the image display apparatus and is capable of providing an image that is stereoscopically visible by naked eyes, based on a first composite image obtained by superimposing the first virtual space image onto a first real world image shot by the first camera, and on a second composite image obtained by superimposing the second virtual space image onto a second real world image shot by the second camera.
-
Specification