COMPUTER IMPLEMENTED METHODS AND SYSTEMS FOR GENERATING VIRTUAL BODY MODELS FOR GARMENT FIT VISUALISATION

• US 20160284018A1
• Filed: 05/27/2016
• Published: 09/29/2016
• Est. Priority Date: 02/17/2011
• Status: Abandoned Application

• Current Assignee: Metail Limited
• Original Assignee: Metail Limited
• Inventors: ADEYOOLA, Tom, BROWN, Nick, TROTT, Nikki, HERBERT, Edward, ROBERTSON, Duncan, DOWNING, Jim, DAY, Nick, BOLAND, Robert, BOUCHER, Tom, TOWNSEND, Joe, CLAY, Edward, WARREN, Tom, UNADKAT, Anoop, CHEN, Yu
• Application Number:
  US15/166,893
• Publication Number:
  US 20160284018A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/248 Presentation of query results
• CPC Class Codes: G06F 16/54 Browsing; Visualisation therefor
• CPC Class Codes: G06F 16/5854 using shape and object relationship
• CPC Class Codes: G06F 16/5866 using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06Q 10/087 Inventory or stock management, e.g. order filling, procurement or balancing against orders
• CPC Class Codes: G06Q 30/0605 Supply or demand aggregation
• CPC Class Codes: G06Q 30/0625 Directed, with specific intent or strategy
• CPC Class Codes: G06Q 30/0629 for generating comparisons
• CPC Class Codes: G06Q 30/0631 Item recommendations
• CPC Class Codes: G06Q 30/0643 Graphical representation of items or shoppers
• CPC Class Codes: G06Q 50/01 Social networking
• CPC Class Codes: G06T 11/001 : Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 13/20 : 3D [Three Dimensional] animation
• CPC Class Codes: G06T 13/40 : of characters, e.g. humans, animals or virtual beings
• CPC Class Codes: G06T 13/80 : 2D [Two Dimensional] animation, e.g. using sprites
• CPC Class Codes: G06T 15/205 : Image-based rendering
• CPC Class Codes: G06T 17/00 : Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: G06T 17/20 : Finite element generation, e.g. wire-frame surface description, tesselation
• CPC Class Codes: G06T 19/006 : Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2200/04 : involving 3D image data
• CPC Class Codes: G06T 2200/24 : involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 2207/10012 : Stereo images
• CPC Class Codes: G06T 2207/10028 : Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2207/20212 : Image combination
• CPC Class Codes: G06T 2207/30196 : Human being; Person
• CPC Class Codes: G06T 2210/16 : Cloth
• CPC Class Codes: G06T 7/11 : Region-based segmentation
• CPC Class Codes: G06T 7/194 : involving foreground-background segmentation
• CPC Class Codes: H04N 13/204 : using stereoscopic image cameras stereoscopic photography G03B35/00
• CPC Class Codes: H04N 13/207 : using a single 2D image sensor
• CPC Class Codes: H04N 13/271 : wherein the generated image signals comprise depth maps or disparity maps
• CPC Class Codes: H04N 13/282 : for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
• CPC Class Codes: H04N 5/33 : Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20
• CPC Class Codes: H05K 999/99 : dummy group

Abstract

Methods for generating and sharing a virtual body model of a person, created with a small number of measurements and a single photograph, combined with one or more images of garments. The virtual body model represents a realistic representation of the users body and is used for visualizing photo-realistic fit visualizations of garments, hairstyles, make-up, and/or other accessories. The virtual garments are created from layers based on photographs of real garment from multiple angles. Furthermore the virtual body model is used in multiple embodiments of manual and automatic garment, make-up, and, hairstyle recommendations, such as, from channels, friends, and fashion entities. The virtual body model is sharable for, as example, visualization and comments on looks. Furthermore it is also used for enabling users to buy garments that fit other users, suitable for gifts or similar. The implementation can also be used in peer-to-peer online sales where garments can be bought with the knowledge that the seller has a similar body shape and size as the user.

Claims

1. A method of visualizing garments on a virtual body model, comprising the steps of (a) storing digital images of multiple garments;

(b) storing a virtual body model of a user based on user data;

(c) displaying the virtual body model on a touch screen device, together with a sequence or array of multiple garments;

(d) combining the virtual body model with the image of at least one garment;

(e) using a touch action or gesture received at the touch screen to cause the array of garments to move to the left or to the right.

2. The method of claim 1, in which the virtual body model is a 3D virtual body model.

3. The method of claim 1, in which the garment array is a linear array and the user can with a flick to the left or to the right or other gesture cause the array of garments to move to the left or to the right, with the particular garment that would occupy a given position behind or over the virtual body model being automatically combined with the virtual body model.

4. The method of claim 1, in which a drag and drop action is used to cause a specific garment to be dragged to and dropped on and hence combined with the virtual body model.

5. The method of claim 1, in which physics-based animations are applied to the moving garments.

6. The method of claim 1, in which the user, when viewing the array of multiple garments showing together with the virtual body model on the touch screen device, indicates that the garment is to be visualised on his or her 3D virtual body model by touching the image of the garment shown on the touch screen display.

7. The method of claim 1, in which the display device includes a button, icon or function that, if selected by a viewer, automatically sends a signal from the device to a server to indicate that the viewer wishes to purchase a selected garment.

8. The method of claim 7, in which the signal authorises automatic payment for the garment by the viewer.

9. The method of claim 1, in which the garment combined with the virtual body model is displayed on a garment retail web site that the user has logged on-to.

10. The method of claim 1, in which a computer implemented system has access to a database of images of many different garments and selects which garment to choose by applying criteria based on factors including one or more of:

age of the user, size and/or shape of the user, location of the user, income of the user, hobbies of the user, purchasing history of the user, browsing history of the user, preferences stated by the user.

11. The method of claim 1, in which the user can select what type of garment he or she would like to flick through to try out on the body model.

12. The method of claim 1, in which the user can select one of the garments to stay on the body model.

13. The method of claim 1, in which the user can select to flick through whole outfits of garments to be tried on to the body model.

14. The method of claim 1, in which the flow of garments can be flicked through in any horizontal direction for different garments.

15. The method of claim 1, in which a browsing tool allows the user to flick vertically to change the set of garments to flick through.

16. The method of claim 1, in which, when using a touch action or gesture to cause the array of garments to move, the garment pane can be slowed down and a garment selected and the body model as displayed is dressed in that garment.

17. The method of claim 1, in which using a touch action or gesture received at the touch screen, a different garment is automatically combined with the virtual body model in place of a previously displayed garment.

18. The method of claim 1, in which the user can select to continue to flick through alternative garments to replace a selected garment.

19. The method of claim 1, in which the user can select to flick through alternative garments to be worn together with a selected garment.

20. The method of claim 1, in which the user can select and filter depending on their location.

21. The method of claim 20, in which the user filters on the location or if he or she selected a garment the user can see where the closest location supplying that garment would be.

22. The method of claim 1, in which the user can receive specific targeted adverts based on the garments they are viewing and can be provided with that information from the retailer or third parties.

23. The method of claim 22, in which the adverts can be linked to location.

24. A system adapted or operable for visualizing garments on a virtual body model, in which the system (a) stores digital images of multiple garments;

(b) stores a virtual body model of a user based on user data;

(c) displays the virtual body model on a touch screen device, together with a sequence or array of multiple garments;

(d) combines the virtual body model with the image of at least one garment;

(e) uses a touch action or gesture received at the touch screen to cause the array of garments to move to the left or to the right.

25. Computer program product embodied on a non-transitory storage medium, the computer program product executable on a portable touch screen display device to perform a method of visualizing garments on a virtual body model, in which:

(a) the program accesses stored digital images of multiple garments;

(b) the program accesses a 3D virtual body model of a user based on user data;

(c) the program displays the virtual body model on the touch screen device, together with a sequence or array of multiple garments;

(d) the program requests and receives from a remote server a combination of the virtual body model with the image of at least one garment;

(e) the program responds to a touch action or gesture received at the touch screen to cause the displayed array of garments to move to the left or to the right.