Image-based item location identification
First Claim
1. A computer-implemented method comprising:
- as implemented by a user computing device comprising one or more hardware processors and configured with specific computer-executable instructions,obtaining a continuous stream of images that depict at least a plurality of items located within a physical area, wherein the continuous stream of images are obtained from an image capturing device configured to capture the continuous stream of images;
identifying the plurality of items depicted in the continuous stream of images;
generating an interactive user interface element comprising a representation of the plurality of items that differs from a presentation of the plurality of items within the continuous stream of images and differs from a presentation of the plurality of items within the physical area;
outputting for display to a user the continuous stream of images and the interactive user interface element;
receiving, in response to interaction by a user with a portion of the interactive user interface element, a selection of a representation of an item from the plurality of items included in the representation of the plurality of items; and
for at least a subset of images of the continuous stream of images output for display, animating at least a portion of each of the subset of images, the portion including a depiction of an item corresponding to the representation of the item selected from the interactive user interface element.
0 Assignments
0 Petitions
Accused Products
Abstract
Systems and methods are provided for augmenting or annotating image data to help a user locate an item among a number of items in a physical environment. The systems disclosed herein can access an image of a location that includes a number of items. The systems may then identify the items and the location of the items within the image. Further, the systems may create an interactive alternative visualization of the identified items to facilitate a user locating a particular item. For example, the alternative visualization may include presenting an ordered set of thumbnails corresponding to the items. The user can select the desired item using the alternative visualization and the systems can annotate a location within the image where the item can be located, thereby enabling the user to locate the item in the physical environment.
-
Citations
20 Claims
-
1. A computer-implemented method comprising:
as implemented by a user computing device comprising one or more hardware processors and configured with specific computer-executable instructions, obtaining a continuous stream of images that depict at least a plurality of items located within a physical area, wherein the continuous stream of images are obtained from an image capturing device configured to capture the continuous stream of images; identifying the plurality of items depicted in the continuous stream of images; generating an interactive user interface element comprising a representation of the plurality of items that differs from a presentation of the plurality of items within the continuous stream of images and differs from a presentation of the plurality of items within the physical area; outputting for display to a user the continuous stream of images and the interactive user interface element; receiving, in response to interaction by a user with a portion of the interactive user interface element, a selection of a representation of an item from the plurality of items included in the representation of the plurality of items; and for at least a subset of images of the continuous stream of images output for display, animating at least a portion of each of the subset of images, the portion including a depiction of an item corresponding to the representation of the item selected from the interactive user interface element. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
9. A system comprising:
-
an electronic data store configured to at least store specific computer-executable instructions; an image capturing device configured to capture a continuous stream of images; and a computing device comprising computer hardware in communication with the electronic data store and the image capturing device, the computing device configured to execute the specific computer-executable instructions to at least; obtain the continuous stream of images from the image capturing device, the continuous stream of images depicting at least a plurality of items located within a physical area; identify the plurality of items depicted in the continuous stream of images; generate an interactive user interface element comprising a representation of the plurality of items that differs from a presentation of the plurality of items within the continuous stream of images and differs from a presentation of the plurality of items within the physical area; output for display the continuous stream of images and the interactive user interface element; receive, in response to interaction with the interactive user interface element, a selection of a representation of an item from the plurality of items included in the representation of the plurality of items; and for at least a subset of images of the continuous stream of images output for display, animate at least a portion of each of the subset of images, the portion including a depiction of an item corresponding to the representation of the item selected from the interactive user interface element. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16)
-
-
17. A computer-readable, non-transitory storage medium storing computer executable instructions that, when executed by one or more computing devices, configure the one or more computing devices to perform operations comprising:
-
receiving a continuous stream of images from an image capturing device, the continuous stream of images depicting at least a plurality of items located within a physical area; identifying the plurality of items depicted in the continuous stream of images; generating an interactive user interface element comprising a representation of the plurality of items that differs from a presentation of the plurality of items within the continuous stream of images; outputting for display the continuous stream of images and the interactive user interface element; receiving, in response to interaction with the interactive user interface element, a selection of a representation of an item from the plurality of items included in the representation of the plurality of items; and for at least a subset of images of the continuous stream of images output for display, animating at least a portion of each of the subset of images, the portion including a depiction of an item corresponding to the representation of the item selected from the interactive user interface element. - View Dependent Claims (18, 19, 20)
-
Specification