VIRTUAL SPACE IMAGE DISPLAY METHOD, APPARATUS, VIRTUAL SPACE IMAGE DISPLAY PROGRAM, AND RECORDING MEDIUM

• US 20070103461A1
• Filed: 11/03/2006
• Published: 05/10/2007
• Est. Priority Date: 11/08/2005
• Status: Abandoned Application

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Koda, Natsuo, Ito, Junpei, Okuda, Shizue, Suzuno, Satoshi
• Application Number:
  US11/556,312
• Publication Number:
  US 20070103461A1
• Time in Patent Office: Days
• US Class Current: 345/419
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 17/05 Geographic models
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics

Abstract

Three-dimensional map data of drawing objects in respective division areas and distant view images in respective directions on map data, which are obtained when viewing is made from insides of the respective division areas, are held in a recording medium, three-dimensional map data of a drawing object for a near view positioned in a sight line direction at a point of interest is retrieved from the three-dimensional map data based on position information of the point of interest and sight line direction information, and is converted into a map image based on a perspective drawing method. A distant view image obtained in the sight line direction is retrieved from the distant view images held in the recording medium based on the position information of the point of interest and the sight line direction information, and the retrieved distant view image is overwritten with the map image for the near view to combine them.

Claims

1. A virtual space image display method in which when viewing is made in an arbitrary direction from a point of interest on map data, a drawing object on the map data positioned in the direction is drawn and displayed on the basis of three-dimensional map data of the drawing object as a map image based on a perspective drawing method, the virtual space image display method comprising the steps of:

holding three-dimensional map data of drawing objects in respective division areas, which are obtained by dividing the map data into specified areas, in a recording medium for the respective division areas;

holding distant view images of drawing objects for a distant view in respective directions on the map data, which are obtained when surroundings are viewed from an inside of the division area, in the recording medium while the distant view images are made to correspond to the division area and the directions;

acquiring, by point-of-interest acquisition means, position information of the point of interest and sight line direction information concerning a sight line direction or a traveling direction at the point of interest;

retrieving, by neighboring map data retrieval means, three-dimensional map data of a drawing object for a near view positioned in the sight line direction or the traveling direction, including a drawing object in the division area where the point of interest exists, from the three-dimensional map data held in the recording medium on the basis of the acquired position information of the point of interest and the sight line direction information;

performing, by real-time rendering means, a rendering processing on the retrieved three-dimensional map data to convert the drawing object for the near view positioned in the sight line direction or the traveling direction into a map image based on the perspective drawing method;

retrieving, by distant view data retrieval means, a distant view image obtained when viewing is made in the sight line direction or the traveling direction from the inside of the division area where the point of interest exists, from the distant view images held in the recording medium on the basis of the acquired position information of the point of interest and the sight line direction information; and

overwriting, by combining means, the retrieved distant view image with the drawing object for the near view converted into the map image based on the perspective drawing method to combine them, and drawing and displaying them as a map image based on the perspective drawing method in the sight line direction or the traveling direction at the point of interest.

2. The virtual space image display method according to claim 1, wherein with respect to the distant view images of the drawing objects for the distant view held in the recording medium for the respective division areas, the distant view images of the drawing objects for the distant view in the respective directions on the map data, which are obtained when the surroundings are seen from the inside of the division area and have sizes corresponding to distances between the division area and the drawing objects for the distant view, are held in the recording medium for the respective division areas.

3. The virtual space image display method according to claim 1, wherein the division areas are rectangles obtained by dividing a map mesh of the Geographical Survey Institute.

4. The virtual space image display method according to claim 1, wherein the division areas are hexagons obtained by dividing a map mesh of the Geographical Survey Institute.

5. The virtual space image display method according to claim 1, wherein the point-of-interest acquisition means acquires the position information of the point of interest as a present position of a vehicle and the sight line direction information at the point of interest based on a GPS signal sent from a GPS satellite and received by a GPS receiver, an output signal of a vehicle speed sensor, and an output signal of a gyro.

6. The virtual space image display method according to claim 1, wherein the point-of-interest acquisition means acquires the position information of the point of interest and the sight line direction information at the point of interest based on a signal inputted when an input device is operated by a user.

7. The virtual space image display method according to claim 1, wherein the distant view images of the drawing objects for the distant view are downloaded to the recording medium from an external server system through communication means before the point of interest enters the inside of the division area.

8. The virtual space image display method according to claim 1, wherein the distant view images of the drawing objects for the distant view have been previously subjected to the rendering processing.

9. A virtual space image display apparatus in which when viewing is made in an arbitrary direction from a point of interest on map data, a drawing object on the map data positioned in the direction is drawn and displayed on the basis of three-dimensional map data of the drawing object as a map image based on a perspective drawing method, the virtual space image display apparatus comprising:

a recording medium that holds three-dimensional map data of drawing objects in respective division areas which are obtained by dividing the map data into specified areas, and distant view images of drawing objects for a distant view in respective directions on the map data, which are obtained when surroundings are viewed from an inside of the division area, for the respective division areas;

point-of-interest acquisition means for acquiring position information of the point of interest and sight line direction information concerning a sight line direction or a traveling direction at the point of interest;

neighboring map data retrieval means for retrieving three-dimensional map data of a drawing object for a near view positioned in the sight line direction or the traveling direction, including a drawing object in the division area where the point of interest exists, from the three-dimensional map data held in the recording medium on the basis of the acquired position information of the point of interest and the sight line direction information;

real-time rendering means for performing a rendering processing on the retrieved three-dimensional map data to convert the drawing object for the near view positioned in the sight line direction or the traveling direction into a map image based on the perspective drawing method;

distant view data retrieval means for retrieving a distant view image obtained when viewing is made in the sight line direction or the traveling direction from the inside of the division area where the point of interest exists, from the distant view images held in the recording medium on the basis of the acquired position information of the point of interest and the sight line direction information; and

combining means for overwriting the retrieved distant view image with the drawing object for the near view converted into the map image based on the perspective drawing method to combine them, and for drawing and displaying them as a map image based on the perspective drawing method in the sight line direction or the traveling direction at the point of interest.

10. The virtual space image display apparatus according to claim 9, wherein with respect to the distant view images of the drawing objects for the distant view held in the recording medium for the respective division areas, the distant view images of the drawing objects for the distant view in the respective directions on the map data, which are obtained when the surroundings are seen from the inside of the division area and have sizes corresponding to distances between the division area and the drawing objects for the distant view, are held in the recording medium for the respective division areas.

11. The virtual space image display apparatus according to claim 9, further comprising:

a GPS receiver,

a vehicle speed sensor, and

a gyro,

wherein the point-of-interest acquisition means acquires the position information of the point of interest as a present position of a vehicle and the sight line direction information at the point of interest based on a GPS signal sent from a GPS satellite and received by the GPS receiver, an output signal of the vehicle speed sensor, and an output signal of the gyro.

12. The virtual space image display apparatus according to claim 9, further comprising an input device including a keyboard, a mouse or an operation pad,

wherein the point-of-interest acquisition means acquires the position information of the point of interest and the sight line direction information at the point of interest based on a signal inputted when the input device is operated by a user.

13. The virtual space image display apparatus according to claim 9, further comprising communication means for receiving the distant view images of the drawing objects for the distant view from an external server system,

wherein the communication means downloads the distant view images of the drawing objects for the distant view to the recording medium from the external server system before the point of interest enters the inside of the division area.

14. The virtual space image display apparatus according to claim 9, wherein the distant view images of the drawing objects for the distant view have been previously subjected to the rendering processing.

15. A computer readable recording medium recording a virtual space image display program in which when viewing is made in an arbitrary direction from a point of interest on map data, a drawing object on the map data positioned in the direction is drawn and displayed on the basis of three-dimensional map data of the drawing object as a map image based on a perspective drawing method, the computer-readable recording medium recording the virtual space image display program for causing a computer to execute the processes of:

holding three-dimensional map data of drawing objects in respective division areas, which are obtained by dividing the map data into specified areas, in a recording medium for the respective division areas;

holding distant view images of drawing objects for a distant view in respective directions on the map data, which are obtained when surroundings are viewed from an inside of the division area, in the recording medium while the distant view images are made to correspond to the division area and the directions;

acquiring, by point-of-interest acquisition means, position information of the point of interest and sight line direction information concerning a sight line direction or a traveling direction at the point of interest;

retrieving, by neighboring map data retrieval means, three-dimensional map data of a drawing object for a near view positioned in the sight line direction or the traveling direction, including a drawing object in the division area where the point of interest exists, from the three-dimensional map data held in the recording medium on the basis of the acquired position information of the point of interest and the sight line direction information;

performing, by real-time rendering means, a rendering processing on the retrieved three-dimensional map data to convert the drawing object for the near view positioned in the sight line direction or the traveling direction into a map image based on the perspective drawing method;

retrieving, by distant view data retrieval means, a distant view image obtained when viewing is made in the sight line direction or the traveling direction from the inside of the division area where the point of interest exists, from the distant view images held in the recording medium on the basis of the acquired position information of the point of interest and the sight line direction information; and

overwriting, by combining means, the retrieved distant view image with the drawing object for the near view converted into the map image based on the perspective drawing method to combine them, and drawing and displaying them as a map image based on the perspective drawing method in the sight line direction or the traveling direction at the point of interest.

16. The recording medium according to claim 15, wherein with respect to the distant view images of the drawing objects for the distant view held in the recording medium, the distant view images of the drawing objects for the distant view in the respective directions on the map data, which are obtained when the surroundings are seen from the inside of the division area and have sizes corresponding to distances between the division area and the drawing objects for the distant view, are held in the recording medium for the respective division areas and the respective directions.

17. A virtual space image display apparatus in which when viewing is made in an arbitrary direction from a point of interest on map data, a drawing object on the map data positioned in the direction is drawn and displayed on the basis of three-dimensional map data of the drawing object as a map image based on a perspective drawing method, the virtual space image display apparatus comprising:

a recording medium that holds three-dimensional map data of drawing objects in respective division areas which are obtained by dividing the map data into specified areas, and distant view images of drawing objects for a distant view in respective directions on the map data, which are obtained when surroundings are viewed from an inside of the division area, for the respective division areas;

a point-of-interest acquisition unit configured to acquire position information of the point of interest and sight line direction information concerning a sight line direction or a traveling direction at the point of interest;

a neighboring map data retrieval unit configured to retrieve three-dimensional map data of a drawing object for a near view positioned in the sight line direction or the traveling direction, including a drawing object in the division area where the point of interest exists, from the three-dimensional map data held in the recording medium on the basis of the acquired position information of the point of interest and the sight line direction information;

a real-time rendering unit configured to perform a rendering processing on the retrieved three-dimensional map data to convert the drawing object for the near view positioned in the sight line direction or the traveling direction into a map image based on the perspective drawing method;

a distant view data retrieval unit configured to retrieve a distant view image obtained when viewing is made in the sight line direction or the traveling direction from the inside of the division area where the point of interest exists, from the distant view images held in the recording medium on the basis of the acquired position information of the point of interest and the sight line direction information; and

a combining unit configured to overwrite the retrieved distant view image with the drawing object for the near view converted into the map image based on the perspective drawing method to combine them, and to draw and display them as a map image based on the perspective drawing method in the sight line direction or the traveling direction at the point of interest.