Three-dimensional graphic system with an editor for generating a textrue mapping image

• US 5,680,525 A
• Filed: 08/10/1992
• Issued: 10/21/1997
• Est. Priority Date: 08/08/1991
• Status: Expired due to Fees

• Current Assignee: Hitachi, Ltd.
• Original Assignee: Hitachi, Ltd.
• Inventors: Watanabe, Norito, Sakamoto, Akihiro, Kawabata, Atsushi, Sakai, Toshio, Tomita, Tsugio
• Primary Examiner(s): Jankus, Almis R.
• Application Number:
  US07/926,518
• Time in Patent Office: 1,898 Days
• Field of Search: 395/125, 395/126, 395/129-132, 395/141-143, 395/121, 395/122, 395/119, 395/120, 395/150, 395/151, 395/133, 395/135, 395/167, 395/171
• US Class Current: 345/585
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 15/04 Texture mapping

Abstract

A three-dimensional graphic system includes a scene origination equipment, a rendering apparatus and a display device. The user interface unit of the scene origination equipment displays on the display screen of the display device. The user interface unit of the scene origination equipment displays on the display screen of the display device a graph which represents the relationship between a distance from a point generated with a cursor and the density of the generated point. The setting of the shape of the displayed graph is accepted on the display screen, and the relationship between the distance from the generated point of the cursor and the density of the generated point is determined in accordance with the accepted setting of the shape of the graph. The image generation unit of the scene origination equipment displays the cursor on the display screen, and generates an image in which the point generated with the cursor and points vicinal to the generated point are drawn at densities conforming to the determined relationship. The rendering apparatus generates a video graphic in which the generated image is mapped on an object and displays the video graphic on the display screen.

Claims

1. An image generating method, wherein a cursor is displayed on a display screen to generate an image in which a first point is located by the displayed cursor and points vicinal to the first point are drawn, comprising the steps of:

(a) determining a relationship between densities each representing a gray level to be used for a drawing and distances from the first point respectively; and

(b) generating an image in which said first point and each of said points vicinal to said first point are drawn at the gray level represented by the densities related to the distances between said first point and each of said points vicinal to said first point respectively by the determined relationship.

2. An image generation method wherein a cursor is displayed on a display screen to generate an image in which a first point is located by the displayed cursor and points vicinal to the first point are drawn, comprising the steps of:

(a) determining a relationship between a density representing gray level and a distance of said vicinal points from the first point; and

(b) generating an image in which said first point and said points vicinal to said first point are drawn at the density representing gray level conforming to the determined relationship;

wherein step (a) comprises the steps of;

displaying on said display screen a graph which represents a relationship between a distance from the first point of said cursor and a density representing gray level of said first point,

accepting a setting of a shape of the displayed graph on said display screens, and

determining said relationship between said distance from said first point of said cursor and said density representing gray level of said first point, in accordance with the accepted setting of said shape of said graph.

3. An image generating method, wherein an image is formed by generating a recurrent pattern of tiles, comprising the steps of:

accepting as parameters, at least one of settings of a width and a height of each of said tiles, a shift of a reference position in an arrangement of said tiles, a thickness of an edge line of said each tile, recurrence numbers of said tiles in vertical and lateral directions, recurring colors of said tiles, and a color of said edge line;

accepting variant magnitudes for at least one of the respective parameters; and

forming said image by generating the recurrent pattern of said tiles in which the set parameters are varied, for the individual tiles, by the corresponding variant magnitudes varied using random numbers for the individual tiles.

4. An environmental mapping method, wherein a two-dimensional image is mapped on a three-dimensional object arranged in a three-dimensional space, in such a manner that a scene around the three-dimensional object in the three-dimensional space is generated, comprising the steps of:

generating six tetragonal images which are obtained in six directions viewed forwards and backwards, rightwards and leftwards, and upwards and downwards from a center position of said three-dimensional object within said three-dimensional space said forwards direction corresponding to a predetermined direction set on said three-dimensional space;

laterally arraying four of the generated images, the forward, backward, rightward and leftward images in either of an order of said forward, rightward, backward and leftward images or an order of said leftward, rearward, rightward and forward images;

converting each of two of said generated images into four triangular images partitioned by two diagonal lines;

transforming each of the resulting eight triangular images into a tetragonal image one line of which corresponds to one line of the tetragonal image before the conversion, two opposing lines of which correspond to two lines constituting said diagonal lines, and a remaining line of which corresponds to an intersection point of said diagonal lines;

generating a single image in which the eight tetragonal images resulting from said eight triangular images are respectively arranged over and under said four images of said forward, backward, rightward and leftward images laterally arrayed, so that corresponding lines in a hexahedron composed of said six tetragonal images of said forward, backward, rightward, leftward, upward and downward images may come into agreement; and

mapping the single generated image on said three-dimensional object.

5. An environmental mapping method as defined in claim 4, further comprising the step of subjecting said four images of said forward, backward, rightward and leftward images and the four upper and four lower triangular images an elongation processes.

6. A three-dimensional graphic generation method, wherein a two-dimensional image is mapped on a surface of a three-dimensional object, and an image of the three-dimensional object with the two-dimensional image mapped thereon, the three-dimensional image being formed on an assumed camera screen, is generated comprising the steps of:

determining a resolution of said two-dimensional image to-be-mapped in accordance with a positional relationship between said assumed camera screen and said three-dimensional object;

accepting vector representation data which stipulate an image pattern of two dimensions;

generating the two-dimensional image of the determined resolution from said image pattern which is stipulated by the accepted vector representation data;

mapping the generated two-dimensional image on said surface of said three-dimensional object; and

generating said image of said three-dimensional object with said two-dimensional image mapped thereon, said three-dimensional image being formed on said assumed camera screen.

7. A three-dimensional graphic generation method as defined in claim 6, wherein said step of determining a resolution of said image includes:

finding a projected image of said three-dimensional object on said assumed camera screen in accordance with said positional relationship between said assumed camera screen and said three-dimensional object;

calculating a size of the found projected image of said three-dimensional object; and

obtaining a resolution of the calculated projected image, and determining a resolution equal to the obtained resolution of said projected image as said resolution of said two-dimensional image to-be-mapped.

8. A texture mapping method, wherein a two-dimensional image is mapped on a surface of a three-dimensional object, comprising the steps of:

determining a plurality of directions as mapping directions in which said two-dimensional image is to be mapped on said three-dimensional object;

calculating a direction normal to said surface of said three-dimensional object on which said two-dimensional image is to be mapped;

selecting a direction which is most closely aligned with the calculated normal direction of said surface of said three-dimensional object, from among the plurality of predetermined mapping directions; and

mapping said two-dimensional image on said surface of said three-dimensional object in the selected mapping direction.

9. A three-dimensional graphic generation method, wherein an image of a three-dimensional object which is arranged in an assumed three-dimensional space and which is stipulated by a definition of the three-dimensional object as well as definitions of optical characteristics, the image being formed on an assumed camera screen arranged in the three-dimensional space, is generated, comprising the steps of:

determining depths of respective points on surfaces of said three-dimensional objects relative to said camera screen from the definitions of shapes of said three-dimensional objects, thereby obtaining those points of said surface of said three-dimensional object which are to be formed on said camera screen; and

determining colors only of the obtained points of said surface of said three-dimensional object to be formed on said camera screen, with ray tracing.

10. A three-dimensional graphic generation method, wherein an image is generated, the generated image is mapped on a surface of a three-dimensional object, and an image of the three-dimensional object formed on an assumed camera screen is generated, comprising the step of:

generating a two-dimensional image wherein a cursor is displayed on a display screen to generate an image in which a first point is located by the displayed cursor and points vicinal to the first point are drawn;

said generating a two-dimensional shape step comprising the steps of;

determining a relationship between a density and a distance of said vicinal points from the first point, and

generating an image in which said first point and said points vicinal to said first point are drawn at the density conforming to the determined relationship;

mapping the generated two-dimensional image on said surface of said three-dimensional object;

varying either normal lines or positions of points of said surface of said three-dimensional object in accordance with densities of those points on said two-dimensional image which have been mapped on said points of said surface; and

generating the image of the resulting three-dimensional object formed on said assumed camera screen.

11. A rendering apparatus which generates an image of a three-dimensional object formed on an assumed camera screen comprising:

texture data memory for storing therein vector representation data which stipulate image patterns of two dimensions;

three-dimensional scene data memory for storing therein shape data which stipulate shapes of three-dimensional objects;

input unit for accepting a designation of a positional relationship between said camera screen and a subject;

texture supply means for determining a resolution of a two-dimensional image in accordance with the shape data fetched from said three-dimensional scene data memory and said positional relationship accepted by said input, and for generating said two-dimensional image of the determined resolution from the vector representation data stored in said texture data memory; and

texture mapping unit for generating the image of the three-dimensional object with the generated two-dimensional image mapped thereon, said image being formed on said assumed camera screen.

12. A rendering apparatus as defined in claim 11, wherein:

said input accepts a texture generation procedure which contains a designation of the two-dimensional image pattern to be used, and designations of attributes of said two-dimensional image pattern to be generated; and

said texture supply unit fetches from said texture data memory the vector representation data which stipulate said image pattern designated by said texture generation procedure accepted by said input, and generates said two-dimensional image in accordance with said attributes designated by said texture generation procedure.

13. A rendering apparatus as defined in claim 12, wherein the plurality of image patterns stored by said texture data memory are character fonts of a plurality of characters, and said designation of said image pattern to be used in said mapping, by said texture generation procedure is a designation using a character code of the font to be used as said image pattern in said mapping.

14. A rendering apparatus as defined in claim 11, wherein said texture supply unit includes:

projection image calculator for finding a projected image of said subject on said camera screen, in accordance with said shape data stored in said three-dimensional scene data memory and said positional relationship accepted by said input;

projection image resolution calculator for calculating a size of said projected image found by said projection image calculator, thereby obtaining a resolution of said projected image; and

texture generation unit for generating said two-dimensional image of the resolution equal to said resolution of said projected image obtained by said projection image resolution calculator, from said vector representation data stored in said texture data memory.

15. A rendering apparatus which generates an image of a three-dimensional object arranged in an assumed three-dimensional space, the image being formed on an assumed camera screen arranged in the three-dimensional space comprising:

three-dimensional scene data memory for storing therein shape data defining shapes of three-dimensional objects, and optical data defining optical characteristics of the three-dimensional objects;

hidden-surface removal unit for deciding depths of respective points on surfaces of said three-dimensional objects relative to said camera screen from the shape data stored in said three-dimensional scene data memory, thereby obtaining those points of said surface of the three-dimensional object which are to be formed on said camera screen;

ray tracing unit for obtaining intersection points between said three-dimensional objects and either/both of reflected light rays and refracted light rays at those obtained points of said surface of said three-dimensional object which are to be formed on said camera screen;

shading unit for finding colors of said points of said surface of said three-dimensional object to be formed on said camera screen, by the use of the optical data stored in said three-dimensional scene data memory for said points to-be-formed and those points of said surfaces of said three-dimensional objects which intersect with either/both of said reflected light rays and said refracted light rays at said points to-be-formed; and

image generator in which said colors found by said shading unit are formed on those points of said surface of said three-dimensional object to be formed on said camera screen which have been obtained by said hidden-surface removal unit.

16. A rendering apparatus as defined in claim 15, wherein said hidden-surface removal unit projects said surfaces of said three-dimensional objects on said camera screen, and sets points of the smallest depths relative to said camera screen among those points of said surfaces of said three-dimensional objects which are projected on points existing within the projected image, as said those points of said surface of said three-dimensional object which are to be formed on said camera screen.

17. A rendering apparatus as defined in claim 15, wherein said hidden-surface removal unit rearranges said respective points of said surfaces of said three-dimensional objects so as to be arrayed in succession relative to said camera screen, and sets foremost points among said points of individual camera screens, as points of said surface of said three-dimensional object which are to be formed on said camera screen.

18. In a three-dimensional graphic system having scene origination equipment which generates shape data stipulating a shape of a three-dimensional object, a rendering apparatus which generates an image of the three-dimensional object arranged in an assumed three-dimensional space by the use of the shape data, the image being formed on an assumed camera screen arranged in the three-dimensional space, and a display device which displays the image of the three-dimensional object, comprising

said scene origination equipment includes:

means for displaying a cursor on a display screen of said display device;

means for displaying on said display screen of said display device a graph which represents a relationship between a distance from a located point of said cursor and a density representing gray level of said located point;

means for accepting a setting of a shape of the displayed graph on said display screen of said display device;

means for determining said relationship between said distance from said located point of said cursor and said density representing gray level of said located point, in accordance with the accepted setting of said shape of said graph; and

means for generating a two-dimensional image in which said generated point are formed at the density representing gray level conforming to the determined relationship; and

said rendering apparatus includes;

texture mapping means for mapping said two-dimensional image generated by said scene origination equipment, onto said three-dimensional object in said shape stipulated by said shape data generated by said scene origination equipment, and

means for generating said image of the three-dimensional object with said two-dimensional image mapped thereon, said three-dimensional object image being formed on said assumed camera screen, and for displaying the generated image on said display screen on said display device.

19. A three-dimensional graphic system as defined in claim 18, wherein:

said rendering apparatus further includes;

texture data memory means for storing therein vector representation data which stipulate image patterns of two dimensions;

three-dimensional scene data memory means for storing therein the shape data;

input means for accepting a designation of a positional relationship between said camera screen and the subject; and

texture supply means for determining a resolution of a two-dimensional image in accordance with the shape data fetched from said three-dimensional scene data memory means and said positional relationship accepted by said input means, and for generating said two-dimensional image of the determined resolution from the vector representation data stored in said texture data memory means; and

said texture mapping means has a function of mapping said two-dimensional image generated by said texture supply means, onto said three-dimensional object.

20. A three-dimensional graphic system as defined in claim 18, wherein said rendering apparatus further includes:

means for generating optical data defining optical characteristics of said three-dimensional object on which said texture mapping means has mapped said two-dimensional image;

three-dimensional scene data memory means for storing therein the shape data and the optical data;

hidden-surface removal means for deciding depths of respective points on surfaces of the three-dimensional objects relative to said camera screen from said shape data stored in said three-dimensional scene data memory means, thereby obtaining points of a surface of said three-dimensional object which are to be formed on said camera screen;

ray tracing means for obtaining intersection points between said three-dimensional objects and either/both of reflected light rays and refracted light rays at those obtained points of said surface of said three-dimensional object which are to be formed on said camera screen;

shading means for finding colors of said points of said surface of said three-dimensional object to be formed on said camera screen, by the use of said optical data stored in said three-dimensional scene data memory means for said points to-be-formed and those points of said surfaces of said three-dimensional objects which intersect with either/both of said reflected light rays and said refracted light rays at said points to-be-formed; and

means for generating the image in which said colors found by said shading means are formed on those points of said surface of said three-dimensional object to be formed on said camera screen which have been obtained by said hidden-surface removal means.

21. In a three-dimensional graphic system having a scene origination equipment which generates shape data stipulating a shape of a three-dimensional object, a rendering apparatus which generates an image of the three-dimensional object arranged in an assumed three-dimensional space by using the shape data, the image being formed on an assumed camera screen arranged in the three-dimensional space, and a display device which displays the image of the three-dimensional object, comprising

said scene origination equipment includes:

means for accepting as parameters, at least one of settings of a width and a height of each of tiles, a shift of a reference position in an arrangement of said tiles, a thickness of an edge line of said each tile, recurrence numbers of said tiles in vertical and lateral directions, recurring colors of said tiles, and a color of said edge line;

means for accepting variant magnitudes for at least one of the respective parameters; and

means for generating that image of the recurrent pattern of said tiles in which the set parameters are varied, for the individual tiles, by the corresponding variant magnitudes varied using random numbers for the individual tiles; and

said rendering apparatus includes;

means for mapping said image generated by said scene origination equipment, onto said three-dimensional object in said shape defined by said scene origination equipment; and

means for generating said image of the three-dimensional object with said image mapped thereon, said image being formed on said assumed camera screen, and for displaying the generated image on said display screen on said display device.

22. A three-dimensional graphic system as defined in claim 21, wherein:

said rendering apparatus further includes;

texture data memory means for storing therein vector representation data which stipulate image patterns of two dimensions;

three-dimensional scene data memory means for storing therein the shape data;

input means for accepting a designation of a positional relationship between said camera screen and the subject; and

texture supply means for determining a resolution of a two-dimensional image in accordance with the shape data fetched from said three-dimensional scene data memory means and said positional relationship accepted by said input means, and for generating said two-dimensional image of the determined resolution from the vector representation data stored in said texture data memory means; and

said texture mapping means has a function of mapping said two-dimensional image generated by said texture supply means, onto said three-dimensional object.

23. A three-dimensional graphic system as defined in claim 21, wherein said rendering apparatus further includes:

means for generating optical data defining optical characteristics of said three-dimensional object on which said texture mapping means has mapped said two-dimensional image;

three-dimensional scene data memory means for storing therein the shape data and the optical data;

hidden-surface removal means for deciding depths of respective points on surfaces of the three-dimensional objects relative to said camera screen from said shape data stored in said three-dimensional scene data memory means, thereby obtaining those points of a surface of said three-dimensional object which are to be formed on said camera screen;

ray tracing means for obtaining intersection points between said three-dimensional objects and either/both of reflected light rays and refracted light rays at those points of said surface of said three-dimensional object which are to be formed on said camera screen;

shading means for finding colors of said points of said surface of said three-dimensional objects to be formed on said camera screen, by the use of said optical data stored in said three-dimensional scene data memory means for said points to-be-formed and those points of said surfaces of said three-dimensional objects which intersect with either/both of said reflected light rays and said refracted light rays at said points to-be-formed; and

means for generating the image in which said colors found by said shading means are formed on those points of said surface of said three-dimensional object to be formed on said camera screen which have been obtained by said hidden-surface removal means.

24. A three-dimensional graphic system comprising:

a scene origination equipment;

a rendering apparatus which generates an image of a three-dimensional object formed on an assumed camera screen;

said rendering apparatus comprising;

texture data memory for storing therein vector representation data which stipulate image patterns of two dimensions,

three-dimensional scene data memory for storing therein shape data which stimulate shapes of three-dimensional objects,

an input for accepting a designation of a positional relationship between said camera screen and a subject,

texture supply unit for determining a resolution of a two-dimensional image in accordance with the shape data fetched from said three-dimensional scene data memory and said positional relationship accepted by said input, and for generating said two-dimensional image of the determined resolution from the vector representation data stored in said texture data memory, and

texture mapping unit for generating the image of the three-dimensional object with the generated two-dimensional image mapped thereon, said image being formed on said assumed camera screen; and

a display device;

said scene origination equipment includes;

user interface control means for interactually accepting a designation of an image pattern of two dimensions to be used as a texture, and designations of attributes of said texture to be generated, and

procedure origination means for originating a texture generation procedure which contains said designation of the texture pattern and said designations of the texture attributes accepted by said user interface control means;

said input means of said rendering apparatus accepts said texture generation procedure originated by said procedure origination means of said scene origination equipment;

said texture supply means fetches from said texture data memory the vector representation data which stipulate the two-dimensional image pattern designated by said texture generation procedure, and generates said two-dimensional image in accordance with said attributes designated by said texture generation procedure; and

said display device displays said image of said subject generated by said texture mapping unit of said rendering apparatus.

25. A three-dimensional graphic system as defined in claim 24, wherein:

said user interface control means of said scene origination equipment interactually accepts said designation of said positional relationship between said camera screen and said subject and a designation of a three-dimensional shape of said subject, in addition to said designation of said image pattern to be used as said texture and said designations of said attributes of said texture to be generated;

said procedure origination means originates a three-dimensional scene generation procedure which contains the originated texture generation procedure, and said designation of said positional relationship between said camera screen and said subject and said designation of said three-dimensional shape of said subject, the designations having been accepted by said user interface control means;

said input means of said rendering apparatus accepts said three-dimensional scene generation procedure originated by said procedure origination means of said scene origination equipment; and

said texture supply means fetches the subject data from said three-dimensional scene data memory means in accordance with said designation of said three-dimensional shape contained in said three-dimensional scene generation procedure accepted by said input means, so as to determine said resolution of said two-dimensional image in accordance with the fetched subject data and said designation of said positional relationship between said camera screen and said subject contained in said three-dimensional scene generation procedure, and it fetches the vector representation data designated by said texture generation procedure, from said texture data memory so as to generate said two-dimensional image of the determined resolution in accordance with said attributes designated by said texture generation procedure.

26. A three-dimensional graphic system as defined in claim 24, wherein:

the plurality of two-dimensional image patterns stored in said texture data memory are character fonts of a plurality of characters; and

said user interface control means of said scene origination equipment accepts the designation of the character font to be used as said texture, in compliance with a designation of the character.

27. A three-dimensional graphic system as defined in claim 24, wherein said rendering apparatus executes in real time the generation and display of said two-dimensional image based on the designations accepted by said user interface control means of said scene origination equipment.