Method system and medium for generating virtual contexts from three dimensional models

• US 10,475,113 B2
• Filed: 12/23/2014
• Issued: 11/12/2019
• Est. Priority Date: 12/23/2014
• Status: Active Grant

• Current Assignee: eBay Inc.
• Original Assignee: eBay Inc.
• Inventors: Naware, Mihir, Chhugani, Jatin, Su, Jonathan
• Primary Examiner(s): Smith, Jeffrey A.
• Assistant Examiner(s): Duraisamygurusamy, Lalith M
• Application Number:
  US14/581,351
• Publication Number:
  US 20160180449A1
• Time in Patent Office: 1,785 Days
• Field of Search: 705 272
• CPC Class Codes: G06F 2113/12 Cloth
• CPC Class Codes: G06F 30/23 using finite element methods [FEM] or finite difference methods [FDM]
• CPC Class Codes: G06Q 30/0643 Graphical representation of items or shoppers
• CPC Class Codes: G06T 13/40 of characters, e.g. humans, animals or virtual beings

Abstract

Techniques for generated and presenting images of items within user selected context images are presented herein. In an example embodiment, an access module can be configured to receive a first environment model and a first wearable item model. A simulation module coupled to the access module may process the environment model to identify placement volumes within the environment model and to place a clothed body model within the placement volume to generate a context model. A rendering module may then generate a context image from the context model. In various embodiments, the environment model used for the context, the wearable item positioned within the environment model, and rendering values used to generate context images may be changed in response to user inputs to generate new context images that are displayed to a user.

Claims

1. A system comprising:

a computing device comprising one or more processors and a memory coupled to the one or more processors;

an access module implemented using the one or more processors of the computing device configured to;

access, based on user input and from memory of the computing device, a set of context data, the set of context data comprising a first environment model of a first environment in which to view a wearable item;

access, based on user input and from memory of the computing device, a three-dimensional wearable item model of the wearable item, the three-dimensional wearable item model including a group of vertices associated with wearable item points that represent a tesselated surface of the wearable item; and

access, based on user input that provides a plurality of body measurements, a three-dimensional body model comprising a three dimensional digital representation of a body, at least a portion of the three-dimensional body model being configured to be placed inside the wearable item points of the three-dimensional wearable item model;

a simulation module coupled to the access module and configured to;

determine at least a first placement volume and a first perspective of the first placement volume within the first environment model based on a first set of placement cues, the first perspective being determined based on a score-based approach in which a score is computed for a plurality of placement points as a function of visibility characteristics associated with placement cues distributed around the first placement volume, and said first perspective is determined based on selection of a placement point based on the selected placement point'"'"'s score; and

position at least a portion of the generated three-dimensional body model inside the wearable item points to generate a clothed body model by iteratively solving a system of force-based equations that simulate forces that act upon the wearable item points, wherein the force-based equations consider position and one or more variables of the vertices to produce a defined state of the wearable item; and

position the clothed body model within first placement volume of the model of the environment to generate a first context model; and

a rendering module configured to generate a first context image using the first context model and the first perspective associated with the first placement volume.

2. The system of claim 1 wherein configuration of the simulation module to determine at least the first placement volume comprises configuration to:

identify a plurality of unobstructed portions of a first ground area;

for each of the plurality of unobstructed portions of the first ground area, determine an unobstructed distance from the unobstructed portion toward a ceiling segment;

identify a plurality of placement volumes comprising the first placement volume from the plurality of unobstructed portions of the first ground area and the associated unobstructed distance toward the ceiling segment for each unobstructed portions;

select the first placement volume from plurality of placement volumes based at least in part on a proximity of the placement volume to a set of obstruction objects and a set of relevant context objects of the context model.

3. The system of claim 1 further comprising:

a server computer comprising at least one processor and a memory coupled to the at least one processor, wherein the server computer further comprises a server portion of the access module, the simulation module, and the rendering module; and

wherein the computing device is communicatively coupled to the server computer.

4. The system of claim 1 further comprising a display module coupled to the rendering module, wherein the display module is configured to output the first context image on a display of the computing device.

5. The system of claim 4 wherein the computing device further comprises a user interface module configured to:

receive a first user input selecting the wearable item from a virtual marketplace interface of the user interface module; and

receive a second user input selecting a second wearable item from the virtual marketplace interface of the user interface module.

6. The system of claim 5, wherein the access module is further configured to:

receive the three-dimensional wearable item model from a network; and

receive a second wearable item model from the network, wherein the second wearable item image represents the second wearable item, and wherein the second wearable item is different than the wearable item.

7. The system of claim 6 wherein the simulation module is further configured to, in response to the second user input:

position at least a portion of the generated three-dimensional body model inside second wearable item points of the second wearable item model to generate a second clothed body model; and

position the clothed body model within first placement volume of the model of the environment to generate a second context model.

8. The system of claim 7 wherein the rendering module is further configured to, in response to the second user input, generate a second context image using the second context model and the first perspective associated with the first placement volume.

9. The system of claim 1, wherein:

the computing device comprises the rendering module and a display module that outputs the first context image to a display of the computing device;

a server computer communicatively coupled to the computing device via a network, the server computer comprising the access module and the simulation module.

10. The system of claim 9 wherein the set of context data further comprises a second environment model depicting a second environment different than the first environment;

wherein the simulation module is further configured to determine at least a second placement volume and a second perspective of the second placement volume within the first environment model based on a first set of placement cues.

11. The system of claim 10 wherein the computing device further comprises a user interface module configured to:

receive a first user input selecting the first environment, wherein the first context image is generated and displayed on the display in response to the first user input; and

receive a second user input, following display of the first context image, selecting the second environment, wherein in response to the second user input;

the simulation module is configured to position the clothed body model within the second placement volume of the second environment model to generate a second context model; and

the rendering module is configured to generate a second context image from the second environment model and the second perspective; and

the display module is configured to output the second context image to replace the first context image on the display.

12. The system of claim 1, wherein at least one of the forces comprises a gravitational force, an elastic force, a friction force, or an aerodynamic force.

13. A computing device implemented method for generating information, the method comprising:

capturing, using a camera device of the computing device coupled to one or more processors of the computing device, a first environment image;

generating, by a simulation module, a first environment model from the first environment image;

selecting, by an access module, the first environment model based on an analysis of the first environment image;

accessing, based on user input and from memory of the computing device by an access module of the computing device, a set of context data, the set of context data comprising the first environment model of a first environment in which to view a wearable item;

accessing, based on user input and from memory of the computing device, a three-dimensional wearable item model of the wearable item, the three-dimensional wearable item model including a group of vertices associated with wearable item points that represent a tesselated surface of the wearable item; and

accessing, based on user input that provides a plurality of body measurements, a three-dimensional body model comprising a three dimensional digital representation of a body, at least a portion of the three-dimensional body model being configured to be placed inside the wearable item points of the three-dimensional wearable item model;

determining, by a simulation module, at least a first placement volume and a first perspective of the first placement volume within the first environment model based on a first set of placement cues, the first perspective being determined based on a score-based approach in which a score is computed for a plurality of placement points as a function of visibility characteristics associated with placement cues distributed around the first placement volume, and said first perspective is determined based on selection of a placement point based on the selected placement point'"'"'s score; and

positioning at least a portion of the generated three-dimensional body model inside the wearable item points to generate a clothed body model by iteratively solving a system of force-based equations that simulate forces that act upon the wearable item points, wherein the force-based equations consider position and one or more variables of the vertices to produce a defined state of the wearable item; and

positioning the clothed body model within first placement volume of the model of the environment to generate a first context model; and

generating, by a rendering module, a first context image using the first context model and the first perspective associated with the first placement volume.

14. The method of claim 13 wherein determining at least the first placement volume comprises:

identifying a plurality of unobstructed portions of the first ground area in the first environment model;

determining an unobstructed distance from the unobstructed portion toward a ceiling segment for ground area of the plurality of unobstructed portions of the first ground area;

identifying a plurality of placement volumes comprising the first placement volume from the plurality of unobstructed portions of the first ground area and the associated unobstructed distance toward the ceiling segment for each unobstructed portions;

selecting the first placement volume from plurality of placement volumes based at least in part on a proximity of the placement volume to a set of obstruction objects and a set of relevant context objects of the first environment model.

15. The method of claim 14 further comprising:

selecting a second placement volume from the plurality of placement volumes based at least in part on a proximity of the second placement volume to a second set of obstruction objects and a second set of relevant context objects of the first environment model,

receiving, via a user input of the device, a placement selection input;

in response to the placement selection input, re positioning the clothed body model from the first placement volume to the second placement volume of the model of the environment to generate a second context model, and generating, a second context image using the first context model and the second perspective associated with the second placement volume.

16. The method of claim 14 further comprising:

setting a first set of rendering values, wherein the first context image is rendered from the first context model using the first set of rendering values;

receiving from a user input, a rendering value selection identifying a second set of rendering values; and

in response to the rendering value selection, generating a second context image using the first context model, the first perspective associated with the first placement volume, and the second set of rendering values.

17. The method of claim 16 wherein the set of rendering values comprises a lighting value and a shadow strength value.

18. The method of claim 13, wherein at least one of the forces comprises a gravitational force, an elastic force, a friction force, or an aerodynamic force.

19. A non-transitory computer readable medium comprising instructions that, when executed by at least one processor of a device, cause the device to:

capture, using a camera device of the device coupled to one or more processors of the device, a first environment image;

generate, by a simulation module, a first environment model from the first environment image;

select, by an access module, the first environment model based on an analysis of the first environment image;

access, based on user input and from memory of the device by the access module of the device implemented using the at least one processor, a set of context data, the set of context data comprising a first environment model of a first environment in which to view a wearable item;

access, based on user input and from memory of the computing device, a three-dimensional wearable item model of the wearable item, the three-dimensional wearable item model including a group of vertices associated with wearable item points that represent a tesselated surface of the wearable item; and

access, based on user input that provides a plurality of body measurements, a three-dimensional body model comprising a three dimensional digital representation of a body, at least a portion of the three-dimensional body model being configured to be placed inside the wearable item points of the three-dimensional wearable item model;

determine, by the simulation module, at least a first placement volume and a first perspective of the first placement volume within the first environment model based on a first set of placement cues, the first perspective being determined based on a score-based approach in which a score is computed for a plurality of placement points as a function of visibility characteristics associated with placement cues distributed around the first placement volume, and said first perspective is determined based on selection of a placement point based on the selected placement point'"'"'s score; and

position at least a portion of the generated three-dimensional body model inside the wearable item points to generate a clothed body model by iteratively solving a system of force-based equations that simulate forces that act upon the wearable item points, wherein the force-based equations consider position and one or more variables of the vertices to produce a defined state of the wearable item; and

position the clothed body model within first placement volume of the model of the environment to generate a first context model; and

generate, by a rendering module, a first context image using the first context model and the first perspective associated with the first placement volume; and

store the first context image in the memory of the device.

20. The non-transitory computer readable medium of claim 19 wherein the instructions further cause the device to:

receive a user input at a touchscreen interface of device selecting a first merchant virtual store;

display a first virtual store user interface; and

receive at the touchscreen interface a first environment selection for the first environment and a first wearable item selection for the first wearable item prior to accessing the set of context data;

wherein the first placement volume is determined by the simulation module prior to receipt of the user input, and wherein the clothed body model is positioned within the environment model to generate the first context model in response to the user input.