Method and system for generating a stereoscopic image of a garment

• US 6,310,627 B1
• Filed: 01/14/1999
• Issued: 10/30/2001
• Est. Priority Date: 01/20/1998
• Status: Expired due to Term

• Current Assignee: Digital Fashion Ltd.
• Original Assignee: Toyoda Gosei Company Limited (Toyota Motor Corporation)
• Inventors: Sakaguchi, Yoshiyuki
• Primary Examiner(s): Nguyen, Phu K.
• Application Number:
  US09/231,188
• Time in Patent Office: 1,020 Days
• Field of Search: 345/435, 345/419, 345/420, 345/423, 345/428, 345/473
• US Class Current: 345/630
• CPC Class Codes: A41H 3/007 Methods of drafting or marking-out patterns using computers computer-aided design G06F30/00
• CPC Class Codes: A63F 2300/695 Imported photos, e.g. of the player
• CPC Class Codes: G06F 2113/12 Cloth
• CPC Class Codes: G06T 15/00 3D [Three Dimensional] image rendering

Abstract

A 3D image of an object model and images of patterns of a garment are generated. The images of the respective patterns are three-dimensionally deformed by arranging them in corresponding portions of the 3D image of the object model in an image space, and calculating collision deformations caused when the respective patterns are pressed against the corresponding portions based on an externally inputted information on the garment. A stereoscopic image of the garment is generated by connecting the deformed 3D images of the respective patterns based on the information on the garment. Since the pattern images of the garment are so deformed as to be put on the object model in a virtual space of the computer graphics and the stereoscopic image of the garment is generated by connecting the deformed pattern images of the garment, there can be generated a stereoscopic image of the garment realistically representing a state of the garment when the garment is actually put on the object.

Claims

1. A garment stereoscopic image generating method for generating a 3D image representing a stereoscopic shape of a garment when the garment is put on an object, comprising:

(a) a first step of generating a 3D image of an object model corresponding to the object;

(b) a second step of generating images of patterns for the garment;

(c) a third step of inputting information on the garment; and

(d) a fourth step of arranging the images of the respective patterns of the garment in corresponding portions of the 3D image of the object model, three-dimensionally deforming the images of the respective patterns by calculating collisional deformations when the respective patterns are pressed against the corresponding portions based on the information on the garment, and generating a stereoscopic image of the garment by connecting the deformed 3D images of the respective patterns based on the information on the garment.

2. A garment stereoscopic image generating method according to claim 1, wherein the information on the garment comprises at least information on properties of a material of the garment and a sewing method of the garment;

the collisional deformations are calculated based on the properties of the material of the garment; and

the 3D images of the respective patterns are connected based on the information on the sewing method of the garment.

3. A garment stereoscopic image generating method according to claim 1, wherein the 3D image of the object model is a 3D model image having a figure of the object.

4. A garment stereoscopic image generating method according to claim 3, wherein the 3D image of the object model is generated using a measurement data obtained by actually measuring the surface shape of the object.

5. A garment stereoscopic image generating method according to claim 1, wherein the 3D image of the object model is a 3D model image having a standard figure in a figure class to which the object belongs when figures of objects are classified into a plurality of figure classes.

6. A garment stereoscopic image generating method according to claim 5, wherein:

the first step (a) comprises;

(a1) a first subordinate step of storing in advance the 3D image of the standard figure model having a standard figure for each figure class in a storage means;

(a2) a second subordinate step of inputting information on the figure of the object; and

(a3) a third subordinate step of reading the 3D image of the standard figure model of the corresponding figure class as the 3D image of the object model from the storage means based on the information on the figure of the object; and

the fourth step (d) is performed to generate the stereoscopic image of a standard garment having a size suited to the standard figure model.

7. A garment stereoscopic image generating method according to claim 6, further comprising:

(e) a fifth step of inputting information on dimensions of a main portion of the object;

(f) a sixth step of generating a 3D image of the object model having the figure of the object by deforming the 3D image of the standard figure model based on the information on the dimensions of the main portion of the object;

(g) a seventh step of generating a 3D clothes image representing a state where the object model is wearing the standard garment by combining the 3D image of the object model having the figure of the object and the stereoscopic image of the standard garment; and

(h) an eighth step of displaying the 3D clothed image representing the state where the object model having the figure of the object is wearing the standard garment in a display means.

8. A garment stereoscopic image generating method according to claim 7, further comprising:

(i) a ninth step of picking up an entire image of the object;

(j) a tenth step of deforming the 3D image of the object model so that the posture of the object model having the figure of the object substantially agrees with that of the entire image of the object, and deforming the stereoscopic image of the standard garment according to the deformation of the object model;

(k) an eleventh step of generating a simulated try-on image representing a try-on state when the object tries the standard garment on by combining the deformed stereoscopic image of the garment and the entire image of the object; and

(l) a twelfth step of displaying the simulated try-on image in the display means.

9. A garment stereoscopic image generating method according to claim 8, wherein the information on the garment comprises information on the color/pattern of the garment and the eleventh step (k) comprises:

(k1) a first subordinate step of calculating a main color component of the image of the standard garment based on the information on the color/pattern of the garment;

(k2) a second subordinate step of setting a color having a complementary relation to the main color component; and

(k3) a third subordinate step of combining the image of the standard garment and the entire image of the object by the chroma key combination method using the color having the complementary relation as a key color.

10. A garment stereoscopic image generating method according to the claim 8, wherein the ninth step (i) is performed by picking up the image of the object by means of an image pickup device.

11. A garment stereoscopic image generating method according to claim 8, wherein the ninth step (i) is performed by reading a full-length picture of the object by an image reader.

12. A garment stereoscopic image generating method according to claim 9, wherein the second subordinate step (k2) is performed by calculating a distance of the main color component from blue in a color space, assuming blue as the color having the complementary relation if the distance is larger than a predetermined threshold value while assuming a complementary color of the main color component as the color having the complementary relation if the distance is equal to or shorter than the predetermined threshold value.

13. A garment stereoscopic image generating method according to claim 8, further comprising:

(m) a thirteenth step of generating a private catalogue by collecting a plurality of simulated try-on images.

14. A garment stereoscopic image generating method according to claim 13, wherein the private catalogue is a printed matter obtained by printing the plurality of simulated try-on images on sheets of paper.

15. A garment stereoscopic image generating method according to claim 13, wherein the private catalogue is an external storage medium in which data of the plurality simulated try-on images are stored.

16. A garment stereoscopic image generating method according to claim 7, further comprising:

(n) a fourteenth step of calculating a first projection function representing a correspondence between the 3D image of the standard figure model and the stereoscopic image of the standard garment;

(o) a fifteenth step of calculating a second projection function representing a correspondence between the 3D image of the standard figure model and the 3D image of the object model having the figure of the object;

(p) a sixteenth step of generating a stereoscopic image of the garment having a size suited to the object model having the figure of the object by deforming the stereoscopic image of the standard garment using the first and second projection functions; and

(q) a seventeenth step of generating images of patterns constituting the garment having the size suited to the object model having the figure of the object using the stereoscopic image of such a garment.

17. A garment stereoscopic image generating method according to claim 16, wherein the images of the patterns constituting the garment are generated using a two-dimensional image obtained by transforming the stereoscopic image of the garment having the size suited to the object model having the figure of the object under restricting conditions of symmetry, partial linearity and partial curving of the patterns.

18. A garment stereoscopic image generating method according to claim 1, further comprising:

(r) an eighteenth step of inputting a motion data in order to move the 3D image of the object model in a specific manner;

(s) a nineteenth step of generating 3D animation images of the object model by deforming the 3D image of the object model based on the motion data;

(t) a twentieth step of generating 3D animation images of the garment during the movement of the object model by calculating a collisional state of the garment with the object model and a collisional state of the garment with itself based on the movement of the object model; and

(u) a twenty-first step of generating 3D animation images representing a state where the object model wearing the garment is moving in the specific manner by combining the 3D animation images of the object model and those of the garment.

19. A garment stereoscopic image generating method according to claim 18, wherein the motion data is generated based on image data obtained by picking up images of a moving body in its specific movement.

20. A garment stereoscopic image generating system for generating a 3D image representing a stereoscopic shape of a garment when the garment is put on an object, comprising:

(A) a model image generating means for generating a 3D image of an object model corresponding to the object;

(B) a pattern image generating means for generating images of patterns of the garment;

(C) a garment information input means for inputting information on the garment; and

(D) a garment image generating means for arranging the images of the respective patterns of the garment in corresponding portions of the 3D image of the object model, three-dimensionally deforming the images of the respective patterns by calculating collisional deformations when the respective patterns are pressed against the corresponding portions based on the information on the garment, and generating a stereoscopic image of the garment by connecting the deformed 3D images of the respective patterns based on the information on the garment.

21. A garment stereoscopic image generating system according to claim 20, wherein the information on the garment comprises at least information on properties of a material of the garment and a sewing method of the garment, and the garment image generating means (D) calculates the collisional deformations when the respective patterns are pressed against the corresponding portions of the object model based on the properties of the material of the garment and connects the 3D images of the respective patterns on the information on the sewing method of the garment.

22. A garment stereoscopic image generating system according to claim 20, wherein the 3D image of the object model is a 3D model image having a figure of the object.

23. A garment stereoscopic image generating system according to claim 22, wherein the model image generating means (A) comprises a shape measuring means for actually measuring the surface shape of the object, and an image generating means for generating a 3D image of an object model having the figure of the object using an actual measurement data obtained by the shape measuring means.

24. A garment stereoscopic image generating system according to claim 20, wherein the 3D image of the object model is a 3D model image having a standard figure in a figure class to which the object belongs when figures of objects are classified into a plurality of figure classes.

25. A garment stereoscopic image generating system according to claim 24, wherein:

the model image generating means (A) comprises;

(A1) a storage means for storing the 3D images of standard figure models having standard figures, which are generated by classifying figures of objects into the plurality of figure classes, for each class;

(A2) a figure information input means for inputting information on the figure of the object; and

(A3) an image reading means for reading the 3D image of the standard figure model in the corresponding figure class as the 3D image of the object model from the storage means (A1) based on the information on the figure of the object; and

the garment image generating means (D) generates a stereoscopic image of a standard garment having a size suited to the standard figure model.

26. A garment stereoscopic image generating system according to claim 25, further comprising:

(E) a dimension input means for inputting information on the dimensions of a main portion of the object;

(F) a model image generating means for generating a 3D image of the object model having the figure of the object by deforming the 3D image of the standard figure model based on the information on the dimensions of the main portion of the object;

(G) a clothed image generating means for generating a 3D clothed image representing a state where the object model is wearing the standard garment by combining the 3D image of the object model having the figure of the object and the stereoscopic image of the standard garment; and

(H) a display means for displaying the 3D clothed image representing the state where the object model having the figure of the object is wearing the standard garment.

27. A garment stereoscopic image generating system according to claim 26, further comprising:

(I) an image pickup means for picking up an entire image of the object;

(J) an image deforming means for deforming the 3D image of the object model so that the posture of the object model having the figure of the object substantially agrees with that of the entire image of the object, and deforming the stereoscopic image of the standard garment according to the deformation of the object model;

(K) a simulated try-on image generating means for generating a simulated try-on image representing a try-on state when the object tries the standard garment on by combining the deformed stereoscopic image of the garment and the entire image of the object; and

(L) a display means for displaying the simulated try-on image.

28. A garment stereoscopic image generating system according to claim 27, wherein the information on the garment comprises information on the color/pattern of the garment and the simulated try-on image generating means (K) comprises:

.

(K1) a main color component calculating means for calculating a main color component of the image of the standard garment based on the information on the color/pattern of the garment;

(K2) a color setting means for setting a color having a complementary relation to the main color component; and

(K3) an image combining means for combining the image of the standard garment and the entire image of the object by the chroma key combination method using the color having the complementary relation as a key color.

29. A garment stereoscopic image generating system according to the claim 27, wherein the image pickup means (I) is an image sensing means.

30. A garment stereoscopic image generating system according to claim 27, wherein the image pickup means (I) is an image reading means for reading a full-size picture of the object.

31. A garment stereoscopic image generating system according to claim 28, wherein the color setting means (K2) comprises:

(K2-1) a calculating means for calculating a distance of the main color component from blue in a color space;

(K2-2) a comparing means for comparing the calculated distance with a predetermined threshold value; and

(K2-3) a setting means for setting blue as the color having the complementary relation when the distance is larger than the predetermined threshold value while setting a color complementary to the main color component as the color having the complementary relation when the distance is equal to or smaller than the predetermined threshold value.

32. A garment stereoscopic image generating system according to claim 27, further comprising:

(M) a catalogue producing means for producing a private catalogue by collecting a plurality of simulated try-on images.

33. A garment stereoscopic image generating system according to claim 32, wherein the catalogue producing means (M) comprising:

(M1) a printed matter producing means for producing a printed matter by printing the plurality of simulated try-on images on sheets of paper; and

(M2) a binding means for binding the printed matter into a book.

34. A garment stereoscopic image generating system according to claim 32, wherein the catalogue producing means (M) is a storage medium producing means for producing an external storage medium in which data of the plurality of simulated try-on images are so stored as to be readable.

35. A garment stereoscopic image generating system according to claim 25, further comprising:

(N) a first projection function calculating means for calculating a first projection function representing a correspondence between the 3D image of the standard figure model and the stereoscopic image of the standard garment;

(O) a second projection function calculating means for calculating a second projection function representing a correspondence between the 3D image of the standard figure model and the 3D image of the object model having the figure of the object;

(P) a garment image generating means for generating a stereoscopic image of the garment having a size suited to the object model having the figure of the object by deforming the stereoscopic image of the standard garment using the first and second projection functions; and

(Q) a pattern image generating means for generating images of patterns constituting the garment having the size suited to the object model having the figure of the object using the stereoscopic image of such a garment.

36. A garment stereoscopic image generating system according to claim 35, wherein the pattern image generating means (Q) generates the images of the patterns for the garment using a two-dimensional image obtained by transforming the stereoscopic image of the garment having the size suited to the object model having the figure of the object under restricting conditions of symmetry, partial linearity and partial curving of the patterns.

37. A garment stereoscopic image generating system according to claim 20, further comprising:

(R) an input means for inputting a motion data in order to move the 3D image of the object model in a specific manner;

(S) a first animation image generating means for generating 3D animation images of the object model by deforming the 3D image of the object model based on the motion data;

(T) a second animation generating means for generating 3D animation images of the garment while the object model is in motion by calculating a collisional state of the garment with the object model and a collisional state of the garment with itself based on the movement of the object model; and

(U) a third animation image generating means for generating 3D animation images representing a state where the object model wearing the garment is moving in the specific manner by combining the 3D animation images of the object model and those of the garment.

38. A garment stereoscopic image generating system according to claim 37, wherein the first animation image generating means (S) generates the 3D animation images of the object model based on an image data obtained by picking up images of a moving body in a specified movement.

39. A try-on image generating system for generating a try-on image representing a state where a client tries a garment on, comprising:

(X) a data terminal unit for permitting a client to input information on the garment, information on the figure of the client and an image of the client;

(Y) a server for generating a try-on image representing a state where the client tries the garment on based on the information on the garment, the information on the figure of the client and the image of the client, and providing the client with the generated try-on image;

(Z) a communication network for connecting the server and the data terminal unit so as to enable a communication therebetween.

40. A try-on image generating system according to claim 39, wherein the data terminal unit (X) comprises:

(X3-1) an image pickup means for picking up the image of the client;

(X3-2) information input means for inputting the information on the garment and the information on the figure of the client;

(X3-3) a client side communication means for transmitting the information on the garment, the information on the figure of the client and the image of the client to the server and receiving the try-on image representing the state where the client tries the garment on which are transmitted from the server; and

(X3-4) a display means for displaying the try-on image.

41. A try-on image generating system according to claim 39, wherein the server (Y) comprises:

(Y1) a server side communication means for receiving the information on the garment, the information on the figure of the client and the image of the client which are transmitted from the client and transmitting to the client the try-on image representing the state where the client tries the garment on;

(Y2) an image generating means for generating an image of the garment based on the information on the garment and the information on the figure of the client;

(Y3) a try-on image generating means for generating the try-on image representing the state where the client tries the garment on by combining the image of the garment and the image of the client.

42. A try-on image generating system according to claim 41, wherein the image generating means (Y2) comprises:

(Y2-1) a model image storage means for classifying human figures into a plurality of figure classes and storing in advance the 3D image of a standard figure model having a standard figure for each figure class;

(Y2-2) a pattern image storage means for storing images of patterns of garments having standard sizes generated in advance for the respective figure classes;

(Y2-3) an image reading means for reading the 3D image of the standard figure model of the corresponding figure class from the model image storage means (Y2-1) based on the information on the figure of the client and the images of the patterns of the standard garment of the corresponding figure class from the pattern image storage means (Y2-2); and

(Y2-4) a garment image generating means for arranging the images of the respective patterns of the standard garment in corresponding portions of the 3D image of the standard figure model, three-dimensionally deforming the images of the respective patterns by calculating collisional deformations when the respective patterns are pressed against the corresponding portions based on the information on the garment, and generating a stereoscopic image of the standard garment by connecting the deformed 3D images of the respective patterns based on the information on the garment.

43. A try-on image generating system according to claim 41, wherein the try-on image generating means (Y3) comprises:

(Y3-1) a model image generating means for generating a 3D image of a client figure model having the figure of the client by deforming the 3D image of the standard figure model based on the information on the figure of the client;

(Y3-2) a clothed image generating means for generating a 3D clothed image representing a state where the client figure model is wearing the standard garment by combining the 3D image of the client figure model and the stereoscopic image of the standard garment;

(Y3-3) an image deforming means for deforming the 3D image of the client figure model having the figure of the client so that the posture of the client figure model substantially agrees with that of the image of the client, and deforming the stereoscopic image of the standard garment according to the deformation of the client figure model; and

(Y3-4) an image combining means for generating a try-on image representing a state where the client tries the standard garment on by combining the deformed stereoscopic image of the garment and the image of the client by the chroma key combination method.

44. A system according to claim 41, wherein the server (Y) comprises:

(Y4) a catalogue producing means for producing a private catalogue of the client by collecting a plurality of try-on images generated by the try-on image generating means (Y3); and

(Y5) a transmitting means for transmitting the private catalogue to the client.

45. A pattern preparing system for generating a try-on image representing a state where a client tries a garment on, correcting the garment using the try-on image, and preparing patterns of the garment based on an image of the corrected garment, comprising:

(X) a data terminal unit for permitting a client to input information on the garment and information on the figure of the client;

(Y) a server for generating a try-on image representing a state where the client tries the garment on based on the information on the garment, the information on the figure of the client and the image of the client, correcting the garment using the generated try-on image, generating information on the patterns of the garment based on an image of the corrected garment and providing the client with the generated try-on image, and providing the client with the information on the patterns; and

(Z) a communication network for connecting the server and the data terminal unit so as to enable a communication therebetween.

46. A pattern preparing system according to claim 45, wherein the data terminal unit (X) comprises:

(X3-1) information input means for inputting the information on the garment and the information on the figure of the client; and

(X3-2) a client side communication means for transmitting the information on the garment, the information on the figure of the client to the server and receiving the try-on image representing the state where the client tries the garment on which are transmitted from the server.

47. A pattern preparing system according to claim 45, wherein the server (Y) comprises:

(Y1) a server side communication means for receiving the information on the garment and the information on the figure of the client which are transmitted from the client and transmitting to the client the information of the patterns of the garment generated based on the received pieces of information;

(Y2) a model image storage means for classifying human figures into a plurality of figure classes and storing in advance the 3D image of a standard figure model having a standard figure for each figure class;

(Y3) a pattern image storage means for storing images of patterns of garments having standard sizes generated in advance for the respective figure classes;

(Y4) an image reading means for reading the 3D image of the standard figure model of the corresponding figure class from the model image storage means (Y2) based on the information on the figure of the client and the images of the patterns of the standard garment of the corresponding figure class from the pattern image storage means (Y3);

(Y5) a first garment image generating means for arranging the images of the respective patterns of the standard garment in corresponding portions of the 3D image of the standard figure model, three-dimensionally deforming the images of the respective patterns by calculating collisional deformations when the respective patterns are pressed against the corresponding portions based on the information on the garment, and generating a stereoscopic image of the standard garment by connecting the deformed 3D images of the respective patterns based on the information on the garment;

(Y6) a model image generating means for generating a 3D image of the client figure model having the figure of the client by deforming the 3D image of the standard figure model based on the information on the figure of the client;

(Y7) a first projection function calculating means for calculating a first projection function representing a correspondence between the 3D image of the standard figure model and the stereoscopic image of the standard garment;

(Y8) a second projection function calculating means for calculating a second projection function representing a correspondence between the 3D image of the standard figure model and the 3D image of the object model having the figure of the object;

(Y9) a second garment image generating means for generating a stereoscopic image of the garment having a size suited to the client figure model by deforming the stereoscopic image of the standard garment using the first and second projection functions; and

(Y10) a pattern preparing means for preparing patterns of the garment having the size suited to the client figure model using the stereoscopic image of the garment.