Storage medium having stored thereon image processing program and image processing apparatus

• US 8,259,107 B2
• Filed: 06/23/2008
• Issued: 09/04/2012
• Est. Priority Date: 04/01/2008
• Status: Active Grant

• Current Assignee: Nintendo Company Limited
• Original Assignee: Nintendo Company Limited
• Inventors: Dohta, Takuhiro
• Primary Examiner(s): Washburn, Daniel
• Assistant Examiner(s): Zhai, Kyle
• Application Number:
  US12/213,658
• Publication Number:
  US 20090244063A1
• Time in Patent Office: 1,534 Days
• Field of Search: 345/428, 345/423, 345/426, 382/242, 707/920, 463/31
• US Class Current: 345/423
• CPC Class Codes: A63F 13/52 involving aspects of the displayed game scene
• CPC Class Codes: A63F 13/95 Storage media specially adapted for storing game information, e.g. video game cartridges
• CPC Class Codes: A63F 2300/206 Game information storage, e.g. cartridges, CD ROM's, DVD's, smart cards
• CPC Class Codes: A63F 2300/66 for rendering three dimensional images
• CPC Class Codes: A63F 2300/6615 using models with different levels of detail [LOD]
• CPC Class Codes: G06T 17/05 Geographic models
• CPC Class Codes: G06T 17/20 Finite element generation, e.g. wire-frame surface description, tesselation
• CPC Class Codes: G06T 2210/36 Level of detail

Abstract

A virtual plane surface PL is divided into a plurality of square regions such that the closer distance to a virtual camera VP a square region is located at, the smaller areas the square region is divided into. Distance information 41 indicative of distances of respective vertices composing each of the square regions from the virtual plane surface PL is read from the internal main memory 11e. Further, coordinate points of positions, which are distanced from respective vertices, which compose polygonal shape regions included in each of the square regions, by distances indicated by the read distance information in a direction perpendicular to the virtual plane surface PL, are used as polygon vertices, which define polygons, whereby the polygons corresponding to the curved surface SF are generated. From each of the square regions, substantially a common number of polygons are generated. In this manner, appropriate polygon information of the curved surface SF which is capable of securing a drawing quality can be generated.

Claims

1. A non-transitory computer readable storage medium having stored thereon an image processing program for drawing an image of a curved surface as viewed from a virtual camera situated in a virtual three-dimensional space, an undulation of the curved surface being defined by a distance from a virtual plane surface arranged in the virtual three-dimensional space, the image processing program causing a computer to execute instructions comprising:

dividing the virtual plane surface into a plurality of polygonal shape regions such that the closer a region is to the virtual camera, the smaller areas the region is divided into;

calculating a size evaluation value indicative of a size of an image of each of the plurality of the polygonal shape regions based on a distance of the virtual camera with respect to each of the plurality of the polygonal shape regions;

dividing each of the plurality of the polygonal shape regions such that the calculated size evaluation value becomes equal to or lower than a predetermined threshold value;

reading, from a storage unit, distance information indicative of distance from the virtual plane surface, with respect to respective vertices of the plurality of polygonal shape regions;

calculating coordinate points of position which are respectively distanced from the vertices composing the plurality of polygonal shape regions by distances indicated by the distance information in a direction perpendicular to the virtual plane surface;

generating polygons by using the calculated coordinate points as polygon vertices which define the polygons, the number of the polygons being substantially constant in each of the plurality of the polygonal shape regions; and

drawing an image of the generated polygons, the image drawn as being viewed from the virtual camera.

2. The non-transitory computer readable storage medium having stored thereon the image processing program according to claim 1, wherein the size evaluation value is calculated as an area of an image of a sphere having a great circle which is inscribed in or circumscribed around each of the plurality of polygonal shape regions, the area of the image as being viewed from the virtual camera.

3. The non-transitory computer readable storage medium having stored thereon the image processing program according to claim 1, further comprising:

dividing the virtual plane surface into a first predetermined number of regions;

determining, with respect to each of the first predetermined number of regions, whether or not the calculated size evaluation value is equal to or lower than the threshold value; and

further dividing a region, among the first predetermined number of regions, whose size evaluation value is determined not to be equal to or lower than the threshold value, into the first predetermined number of regions,

determining, with respect to further divided respective regions, whether or not the size evaluation value thereof calculated is equal to or lower than the threshold value, and

repeatedly executing the further dividing the region and the determining, with respect to the further divided respective regions, until the size evaluation value of all the generated regions become equal to or lower than the threshold value.

4. The non-transitory computer readable storage medium having stored thereon the image processing program according to claim 3, wherein

the virtual plane surface is equally divided into the first predetermined number of regions, and

the region, among the first predetermined number of regions, whose the size evaluation value is determined not to be equal to or lower than the threshold value, is equally divided into the first predetermined number of regions.

5. The non-transitory computer readable storage medium having stored thereon the image processing program according to claim 4, wherein

the virtual plane surface is a quadrangular plane surface,

the polygonal shape is of a quadrangular shape,

the quadrangular virtual plane surface is divided into quarters by two straight lines which are each formed by connecting middle points of two facing sides of the quadrangular virtual place surface, and

the quadrangular region, whose size evaluation value is determined not to be equal to or lower than the threshold value, is divided into quarters by two straight lines which are each formed by connecting middle points of two facing sides of the quadrangular region.

6. The non-transitory computer readable storage medium having stored thereon the image processing program according to claim 5, wherein two triangle polygons are generated corresponding to two triangle regions obtained by dividing each of the quadrangular regions by a diagonal line therethrough.

7. The non-transitory computer readable storage medium having stored thereon the image processing program according to claim 5, further comprising:

dividing each of the generated plurality of polygonal shape regions into a second predetermined number of small regions which are each of a quadrangular shape;

reading the distance information of respective vertices composing each of the quadrangular small regions from the storage unit;

calculating coordinate points of positions which are respectively distanced from of the vertices composing each of the generated quadrangular small regions by distances indicated by the distance information in a direction perpendicular to the virtual plane surface; and

generating polygons respectively having the calculated coordinate points as the polygon vertices.

8. The non-transitory computer readable storage medium having stored thereon the image processing program according to claim 7, further comprising:

generating two triangle polygons corresponding to two triangle regions which are obtained by dividing each of the quadrangular small regions by a diagonal line therethrough.

9. The non-transitory computer readable storage medium having stored thereon the image processing program according to claim 8, further comprising:

dividing each of the generated quadrangular regions into an even number of small regions, respectively, in two directions along the adjacent sides of each of the quadrangular region;

extracting outer-circumference small regions, from among the second predetermined number of small regions, which each includes a part of sides composing each of the generated quadrangular regions as at least one of sides composing each of the small regions; and

selecting, with respect to outer-circumference small regions, among the extracted outer-circumference small regions, which include vertices composing each of the generated quadrangular regions, diagonal lines including the vertices as diagonal lines for dividing the quadrangular outer-circumference small regions, and also of selecting, with respect to outer-circumference small regions, among the extracted outer-circumference small regions, which do not include the vertices composing each of the generated quadrangular regions, the diagonal lines for dividing the quadrangular outer-circumference small regions such that the diagonal lines of the outer-circumference small regions adjoining respectively are approximately perpendicular to each other.

10. The non-transitory computer readable storage medium having stored thereon the image processing program according to claim 1, further comprising:

determining whether or not each of the generated polygonal shape regions is in an out-of-view region, which is not included in the image as viewed from the virtual camera; and

excluding a region, among the generated polygonal shape regions, which is determined to be in the out-of-view region, from target regions which are subject to processing.

11. The non-transitory computer readable storage medium having stored thereon the image processing program according to claim 1, further comprising:

setting points on the virtual plane surface, the points being interrelated to the distance information and stored in the storage medium, as reference points with respect to which normal vector information is generated;

setting, on the virtual plane surface, two points which are distanced from each reference point by a predetermined unit distance in a predetermined first direction, and of setting another two points which are distanced from each reference point by the unit distance in a second direction which is perpendicular to the first direction;

reading, from the storage medium, the distance information on each set reference point and on the set four points;

calculating coordinate points of positions which are respectively distanced from each reference point and the four points by distances indicated by the distance information in a direction perpendicular to the virtual plane surface;

calculating normal vectors of four triangle polygons, which each includes as vertices thereof, a point corresponding to each reference point, a point corresponding to either of the two points which are distanced from each reference point in the first direction, and a point corresponding to either of the two points which are distanced from each reference point in the second direction, among the calculated five coordinate points; and

calculating an average value of the calculated four normal vectors, and of interrelating the average value to information indicative of the position of each reference point on the virtual plane surface so as to be stored in the storage medium;

reading a normal vector from the storage medium and setting the normal vector to each of the polygon vertices.

12. The non-transitory computer readable storage medium having stored thereon the image processing program according to claim 1, further comprising:

reading, from the storage medium, normal vector information indicative of a tilt of the curved surface at each of the calculated coordinate points; and

setting the read normal vector information as the normal vector information of each of the polygon vertices corresponding to each of the coordinate points.

13. The non-transitory computer readable storage medium having stored thereon the image processing program according to claim 12, wherein, in the storage unit, the normal vector information is stored as image information such that positions and colors composing the image correspond to respective positions and normal vectors on the curved surface, respectively.

14. The non-transitory computer readable storage medium having stored thereon the image processing program according to claim 1, wherein, in the storage unit, the distance information is stored as image information such that positions and colors composing the image correspond to respective positions on the curved surface and distances from the virtual plane surface, respectively.

15. The non-transitory computer readable storage medium having stored thereon the image processing program according to claim 1, wherein the curved surface is a landform arranged in the virtual three-dimensional space.

16. An image processing apparatus for drawing an image of a curved surface as viewed from a virtual camera situated in a virtual three-dimensional space, an undulation of the curved surface being defined by a distance from a virtual plane surface arranged in the virtual three-dimensional space, the image processing apparatus having one or more processors and comprising:

a plane surface division unit for dividing the virtual plane surface into a plurality of polygonal shape regions such that the closer a region is to the virtual camera, the smaller areas the region is divided into, calculating a size evaluation value indicative of a size of an image of each of the plurality of the polygonal shape regions based on a distance of the virtual camera with respect to each of the plurality of the polygonal shape regions, and dividing each of the plurality of the polygonal shape regions such that the calculated size evaluation value becomes equal to or lower than a predetermined threshold value;

a first distance reading unit for reading, from a storage unit, distance information indicative of the distance from the virtual plane surface, with respect to respective vertices of the plurality of polygonal shape regions;

a first coordinate point calculation unit for calculating coordinate points of positions which are respectively distanced from each of the vertices composing the polygons corresponding to the plurality of polygonal shape regions by distances indicated by the distance information read by the first distance reading unit in a direction perpendicular to the virtual plane surface;

a polygon generation unit for generating polygons by using the coordinate points calculated by the first coordinate point calculation unit as polygon vertices defining each of the polygons, the number of the polygons being substantially constant in each of the plurality of the polygonal shape regions; and

a drawing unit for drawing an image of the polygons which are generated by the polygon generation unit, the image as being viewed from the virtual camera.

17. A method for drawing an image of a curved surface as viewed from a virtual camera situated in a virtual three-dimensional space, an undulation of the curved surface being defined by a distance from a virtual plane surface arranged in the virtual three-dimensional space, the method being executed using a computer having one or more processors, the method comprising:

dividing the virtual plane surface into a plurality of polygonal shape regions such that the closer a region is to the virtual camera, the smaller areas the region is divided into;

calculating a size evaluation value indicative of a size of an image of each of the plurality of the polygonal shape regions based on a distance of the virtual camera with respect to each of the plurality of the polygonal shape regions;

dividing each of the plurality of the polygonal shape regions such that the calculated size evaluation value becomes equal to or lower than a predetermined threshold value;

reading, from a storage unit, distance information indicative of distance from the virtual plane surface, with respect to respective vertices of the plurality of polygonal shape regions;

calculating coordinate points of position which are respectively distanced from the vertices composing the plurality of polygonal shape regions by distances indicated by the distance information in a direction perpendicular to the virtual plane surface;

generating polygons by using the calculated coordinate points as polygon vertices which define the polygons, the number of the polygons being substantially constant in each of the plurality of the polygonal shape regions; and

drawing an image of the generated polygons, the image drawn as being viewed from the virtual camera.

18. An image processing system, comprising:

a display device configured to display image data; and

an image processing apparatus for drawing an image of a curved surface

as viewed from a virtual camera situated in a virtual three-dimensional space on the display device, an undulation of the curved surface being defined by a distance from a virtual plane surface arranged in the virtual three-dimensional space, the image processing apparatus having one or more processors and comprising;

a plane surface division unit for dividing the virtual plane surface into a plurality of polygonal shape regions such that the closer a region is to the virtual camera, the smaller areas the region is divided into, calculating a size evaluation value indicative of a size of an image of each of the plurality of the polygonal shape regions based on a distance of the virtual camera with respect to each of the plurality of the polygonal shape regions, and dividing each of the plurality of the polygonal shape regions such that the calculated size evaluation value becomes equal to or lower than a predetermined threshold value;

a first distance reading unit for reading, from a storage unit, distance information indicative of the distance from the virtual plane surface, with respect to respective vertices of the plurality of polygonal shape regions;

a first coordinate point calculation unit for calculating coordinate points of positions which are respectively distanced from each of the vertices composing the polygons corresponding to the plurality of polygonal shape regions by distances indicated by the distance information read by the first distance reading unit in a direction perpendicular to the virtual plane surface;

a polygon generation unit for generating polygons by using the coordinate points calculated by the first coordinate point calculation unit as polygon vertices defining each of the polygons, the number of the polygons being substantially constant in each of the plurality of the polygonal shape regions; and

a drawing unit for drawing an image of the polygons which are generated by the polygon generation unit, the image as being viewed from the virtual camera.