Virtual dressing room

• US 9,898,742 B2
• Filed: 11/16/2012
• Issued: 02/20/2018
• Est. Priority Date: 08/03/2012
• Status: Active Grant

• Current Assignee: eBay Inc.
• Original Assignee: eBay Inc.
• Inventors: Higgins, Krystal Rose, Farraro, Eric J., Tapley, John, Manickavelu, Kumaresan, Mukherjee, Saurav
• Primary Examiner(s): Le, Sarah
• Application Number:
  US13/679,498
• Publication Number:
  US 20140035913A1
• Time in Patent Office: 1,922 Days
• Field of Search: None
• CPC Class Codes: G06Q 30/00 Commerce
• CPC Class Codes: G06Q 30/0641 Shopping interfaces
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 2210/16 Cloth

Abstract

A method and system are provided to facilitate recognition of gestures representing commands to initiate actions within an electronic marketplace on behalf of a user. Spatial data about an environment external to a depth sensor may be received by an action machine. The action machine may generate a first model of a body of the user based on a first set of spatial data received at a first time. The action machine may then generate a second model of the body of the user based on a second set of spatial data received at a second time. The action machine may further determine that a detected difference between the first and second models corresponds to a gesture by the user, and that this gesture represents a command by the user to initiate an action within the electronic marketplace on behalf of the user.

Claims

1. A system comprising:

one or more hardware processors and executable instructions accessible on a computer-readable medium that, when executed, cause the one or more hardware processors to perform operations comprising;

generating a first model based on a first set of spatial data received at a first time, the first model being representative of a user of an electronic marketplace;

generating a second model based on a second set of spatial data received at a second time, the second model being representative of the user;

detecting a difference between the first and second models;

determining that the difference between the first and second models corresponds to a gesture by the user, the gesture identifying a physical object other than a display screen in an environment of the user, the gesture representing a command to initiate an action with respect to the physical object identified by the gesture in the environment of the user, the action with respect to the physical object identified in the environment of the user including listing the physical object identified in the environment of the user for sale on the electronic marketplace on behalf of the user making the gesture; and

generating a listing for a sale of the physical object identified by the gesture in the environment of the user on the electronic marketplace, the generating of the listing being based on a determination that the command to initiate the action with respect to the physical object identified by the gesture in the environment of the user includes a command to list the physical object for sale on the electronic marketplace on behalf of the user making the gesture, the determination being performed based on a data record mapping the gesture by the user to the action including listing the physical object identified in the environment of the user for sale on the electronic marketplace on behalf of the user making the gesture.

2. The system of claim 1, wherein the operations further comprise:

prompting the user to confirm the gesture; and

initiating the action within the electronic marketplace on behalf of the user;

the initiating being based on the user confirming the gesture.

3. A method comprising:

generating a first model based on a first set of spatial data received at a first time, the first model being representative of a user of an electronic marketplace;

generating a second model based on a second set of spatial data received at a second time, the second model being representative of the user;

detecting, using a hardware processor, a difference between the first and second models;

determining that the difference between the first and second models corresponds to a gesture by the user, the gesture identifying a physical object other than a display screen in an environment of the user the gesture representing a command to initiate an action with respect to the physical object identified by the gesture in the environment of the user, the action with respect to the physical object identified in the environment of the user including listing the physical object identified in the environment of the user for sale on the electronic marketplace on behalf of the user making the gesture; and

generating a listing for a sale of the physical object identified by the gesture in the environment of the user on the electronic marketplace, the generating of the listing being based on a determination that the command to initiate the action with respect to the physical object identified by the gesture in the environment of the user includes a command to list the physical object for sale on the electronic marketplace on behalf of the user making the gesture, the determination being performed based on a data record mapping the gesture by the user to the action including listing the physical object identified in the environment of the user for sale on the electronic marketplace on behalf of the user making the gesture.

4. The method of claim 3, wherein the first and second models are two-dimensional silhouettes of a body of the user.

5. The method of claim 3, wherein the first and second models are three-dimensional representations of a body of the user.

6. The method of claim 3;

further comprising;

prompting the user to confirm that the gesture represents the command; and

initiating the action within the electronic marketplace on behalf of the user;

the initiating being based on the user confirming that the gesture represents the command.

7. The method of claim 6, further comprising:

detecting that the user made a different gesture in response to the prompting.

8. The method of claim 7, wherein the detecting includes receiving a voice command by the user in response to the prompting.

9. The method of claim 6, further comprising:

detecting that the user repeated the gesture in response to the prompting.

10. The method of claim 9;

wherein the detecting that the user repeated the gesture in response to the prompting includes receiving a voice command by be user in response to the prompting.

11. The method of claim 3, further comprising:

accessing the data record at a database based on determining that the difference between the first and second models corresponds to the gesture by the user.

12. The method of claim 3, wherein the action includes:

generating a representation of the physical object based on at least one of the first set of spatial data or the second set of spatial data.

13. The method of claim 3, wherein the listing includes a three-dimensional representation of the physical object.

14. The method of claim 3, further comprising:

determining a characteristic of the physical object based on the at least one of the first set of spatial data or the second set of spatial data; and

including a description of the characteristic in the listing for the sale of the physical object on the electronic marketplace.

15. The method of claim 14, wherein the characteristic is a spatial dimension of the physical object, and the description quantifies the spatial dimension.

16. The method of claim 3, wherein the physical object is an item of clothing, the method further comprising:

creating a three-dimensional representation of the item of clothing, the creating being based on at least one of the first set of spatial data or second set of spatial data;

sizing the three-dimensional representation of the item of clothing to a measurement of a body of the user, the measurement being based on at least one of the first set of spatial data or second set of spatial data; and

displaying the three-dimensional representation of the item of clothing being mapped to an image of the user.

17. The method of claim 3, wherein the gesture is a first gesture, the command is a first command, the action is a first action, and the physical object is a first item, the method further comprising:

detecting a second gesture representing a second command to initiate a second action, the second gesture indiacting a second item available for sale on the elctronic marketplace, the second action including initiating an order to buy the second item.

18. A non-transitory machine readable medium comprising instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

generating a first model based on a first set of spatial data received at a first time, the first model being representative of a user of an electronic marketplace;

generating a second model based on a second set of spatial data received at a second time, the second model being representative of the user;

detecting a difference between the first and second models; and

determining that the difference between the first and second models corresponds to a gesture by the user, the gesture identifying a physical object other than a display screen in an environment of the user, the gesture representing a command to initiate an action with respect to the physical object identified by the gesture in the environment of the user, the action with respect to the physical object identified in the environment of the user including listing the physical object identified in the environment of the user for sale on the electronic marketplace on behalf of the user making the gesture; and

generating a listing for a sale of the physical object identified by the gesture in the environment of the user on the electronic marketplace, the generating of the listing being based on a determination that the command to initiate the action with respect to the physical object identified by the gesture in the environment of the user includes a command to list the physical object for sale on the electronic marketplace on behalf of the user making the gesture, the determination being performed based on a data record mapping the gesture by the user to the action including listing the physical object identified in the environment of the user for sale on the electronic marketplace on behalf of the user making the gesture.