VIRTUAL IMAGE GENERATING APPARATUS, VIRTUAL IMAGE GENERATING METHOD, AND RECORDING MEDIUM STORING VIRTUAL IMAGE GENERATING PROGRAM

• US 20090195650A1
• Filed: 02/03/2009
• Published: 08/06/2009
• Est. Priority Date: 02/05/2008
• Status: Active Grant

• Current Assignee: OM Digital Solutions Corporation
• Original Assignee: Olympus Imaging Corporation (Olympus Corporation)
• Inventors: Hanai, Takako, Nonaka, Osamu
• Granted Patent: US 8,717,411 B2
• Time in Patent Office: Days
• US Class Current: 348/143
• CPC Class Codes: G06F 16/583 using metadata automatically derived from the content
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 15/205 Image-based rendering
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 3/10 Selection of transformation methods according to the characteristics of the input images
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04N 21/00 Selective content distribution, e.g. interactive television or video on demand [VOD] real-time bi-directional transmission of motion video data H04N7/14 ; broadcast or conference over packet switching networks H04L12/18
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

A virtual image generation apparatus includes an image recording unit configured to record a plurality of images, each containing photography position data. An image selection unit selects, from the images recorded, an image from which to generate a virtual image. A map-image acquiring unit acquires an image corresponding to a map image containing the photography position data contained in the image selected A virtual scene image generation unit generates, from the image corresponding to the map image, a virtual image showing the image selected or showing a scene related to the photography position data contained in the image selected. An output unit outputs the virtual image data, thereby to display the scene represented by the virtual image generated.

Claims

1. A virtual image generation apparatus comprising:

an image recording unit configured to record a plurality of images, each containing photography position data;

an image selection unit configured to select, from the images recorded, an image from which to generate a virtual image;

a map-image acquiring unit configured to acquire an image corresponding to a map image containing the photography position data contained in the image selected;

a virtual scene image generation unit configured to generate, from the image corresponding to the map image, a virtual image showing the image selected or showing a scene related to the photography position data contained in the image selected; and

an output unit configured to output the virtual image data, thereby to display the scene represented by the virtual image generated.

2. The virtual image generation apparatus according to claim 1, wherein the image selection unit has a selection unit configured to select, from the images recorded, at least two images that differ in terms of photography position data;

and the virtual scene image generation unit determines a travel route between two photography positions of the at least two images, from the photography position data items contained in the at least two images, and generates a virtual image showing a scene that could be at the travel route.

3. The virtual image generation apparatus according to claim 2, further comprising a view point input unit configured to input a view point located in the travel route,

wherein the virtual scene image generation unit generates a virtual scene image showing a scene that accords with the view point input by the view point input unit.

4. The virtual image generation apparatus according to claim 1, wherein the virtual scene image generation unit generates, from an image corresponding to the map image, a virtual image that shows the scene seen in a direction opposite to the direction in which an object in the image selected faces, in accordance with the image selected and with the photography position data contained in the image selected.

5. The virtual image generation apparatus according to claim 4, further comprising a photographer image recording unit configured to record images related to photographers of a plurality of images each containing photography position data,

wherein the virtual scene image generation unit includes:

a direction detection unit configured to detect directions in the map image; and

an image synthesis unit configured to generate a virtual image showing a scene seen in a direction in which an object in the image selected faces and to synthesize the image, thus generated, with an image related to the photographer of the image selected.

6. The virtual image generation apparatus according to claim 5, wherein the direction detection unit includes:

a direction detection unit configured to detect the direction in which the image selected has been photographed, from the photography position data contained in the image selected and from the scene image in the image selected; and

an opposite direction detection unit configured to detect a direction opposite to the direction detected by the direction detection unit, as direction opposite to the direction in which an object in the image selected faces.

7. A virtual image generation method comprising:

selecting an image from which to generate a virtual image, from a plurality of images each containing photography position data;

acquiring an image corresponding to a map image containing the photography position data contained in the image selected;

generating, from the image corresponding to the map image, a virtual image showing the image selected or showing a scene related to the photography position data contained in the image selected; and

outputting the virtual image data, thereby to display the scene represented by the virtual image generated.

8. A recording medium storing a virtual image generation program executable by a computer to generate a virtual image related to an image photographed, the virtual image generation program enabling the computer to perform:

a function of selecting an image from which to generate a virtual image, from a plurality of images each containing photography position data;

a function of acquiring an image corresponding to a map image containing the photography position data contained in the image selected;

a function of generating, from the image corresponding to the map image, a virtual image showing the image selected or showing a scene related to the photography position data contained in the image selected; and

a function of outputting the virtual image data, thereby to display the scene represented by the virtual image generated.