Using gestures and expressions to assist users
First Claim
Patent Images
1. A system, comprising:
- a plurality of cameras positioned within a materials handling facility and remote from a user, each camera of the plurality of cameras configured to generate images of objects located within the materials handling facility;
one or more processors; and
a memory coupled to the one or more processors and storing program instructions that when executed by the one or more processors cause the one or more processors to at least;
identify the user located within a materials handling facility;
receive from a camera of the plurality of cameras, an image of the user;
process, by an inventory management system, the image to identify an expression presented by the user, wherein the expression is at least one of a gesture, a macroexpression or a microexpression;
determine that the user is in a searching mode, wherein the searching mode is determined based at least in part on an area of movement of the user within the materials handling facility;
determine that an expression count associated with the user exceeds an interaction threshold, wherein the expression count corresponds with a number of times the expression has been presented by the user; and
initiate an interaction to provide assistance to the user, based at least in part on the determination that the expression count exceeds an interaction threshold.
1 Assignment
0 Petitions
Accused Products
Abstract
This disclosure describes a system for assisting users in locating items from inventory locations and/or obtaining additional information about items. In some instances, a user may experience difficulty in locating an inventory item in a materials handling facility. By detecting one or more expressions presented by the user, an inventory management system may determine that assistance is to be provided to the user, determine and provide the appropriate assistance to the user.
69 Citations
24 Claims
-
1. A system, comprising:
-
a plurality of cameras positioned within a materials handling facility and remote from a user, each camera of the plurality of cameras configured to generate images of objects located within the materials handling facility; one or more processors; and a memory coupled to the one or more processors and storing program instructions that when executed by the one or more processors cause the one or more processors to at least; identify the user located within a materials handling facility; receive from a camera of the plurality of cameras, an image of the user; process, by an inventory management system, the image to identify an expression presented by the user, wherein the expression is at least one of a gesture, a macroexpression or a microexpression; determine that the user is in a searching mode, wherein the searching mode is determined based at least in part on an area of movement of the user within the materials handling facility; determine that an expression count associated with the user exceeds an interaction threshold, wherein the expression count corresponds with a number of times the expression has been presented by the user; and initiate an interaction to provide assistance to the user, based at least in part on the determination that the expression count exceeds an interaction threshold. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A computer-implemented method for providing assistance to users within a materials handling facility, comprising:
-
under control of one or more computing systems configured with executable instructions, identifying a user within the materials handling facility; receiving from a camera of a plurality of cameras positioned within the materials handling facility and remote from the user, an image of the user; processing, by an inventory management system, the image to identify an expression presented by the user; increasing an expression count associated with the user; determining that the expression count exceeds an interaction threshold; based at least in part on the expression and the determination that the expression count exceeds the interaction threshold, determining that assistance is to be provided to the user; and causing assistance to be provided to the user. - View Dependent Claims (7, 8, 9, 10, 11, 12, 13, 14, 15)
-
-
16. A system, comprising:
-
a plurality of cameras positioned within a materials handling facility and remote from a user, each camera of the plurality of cameras configured to generate images of objects located within the materials handling facility; one or more processors; and a memory coupled to the one or more processors and storing program instructions that when executed by the one or more processors cause the one or more processors to at least; receive from a camera of the plurality of cameras, an image of the user; process, by an inventory management system, the image to identify an expression presented by the user; increase an expression count associated with the user; determine that the expression count exceeds an interaction threshold; based at least in part on the determination that the expression count exceeds the interaction threshold, determine that assistance is to be provided to the user; and cause assistance to be provided to the user. - View Dependent Claims (17, 18, 19, 20, 21)
-
-
22. A system, comprising:
-
a plurality of cameras positioned within a materials handling facility and remote from a user, each camera of the plurality of cameras configured to generate images of objects located within the materials handling facility; one or more processors; and a memory coupled to the one or more processors and storing program instructions that when executed by the one or more processors cause the one or more processors to at least; identify the user located within a materials handling facility; receive from a camera of the plurality of cameras, an image of the user; process the image to identify an expression presented by the user; determine, based at least in part on the expression, that an expression count associated with the user exceeds an interaction threshold, wherein the expression count corresponds with a number of times the expression has been presented by the user; and initiate the interaction to provide assistance to the user, based at least in part on the determination that the expression count exceeds an interaction threshold. - View Dependent Claims (23, 24)
-
Specification