Shopping experience using multiple computing devices

• US 10,424,009 B1
• Filed: 02/27/2013
• Issued: 09/24/2019
• Est. Priority Date: 02/27/2013
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Paton, Christopher Henry, Eakins, Harry James Lewis, Spencer, Simon Lloyd, Thubron, Geoffrey Benjamin
• Primary Examiner(s): Dunham, Jason B
• Assistant Examiner(s): Bargeon, Brittany E
• Application Number:
  US13/778,846
• Time in Patent Office: 2,400 Days
• Field of Search: 705 272
• CPC Class Codes: G06Q 30/0643 Graphical representation of items or shoppers

Abstract

Disclosed are various embodiments for facilitating a shopping experience that spans multiple display devices of multiple computing devices. Image data for a selected item is obtained from an item catalog. The selected item corresponds to a user selection made via a first computing device. An image of the user is obtained. An image of the selected item is rendered relative to the image of the user on a display of a second computing device. The image of the selected item is generated from the image data.

Claims

1. A non-transitory computer-readable medium embodying server instructions executable by a server computing device, wherein when executed the server instructions cause the server computing device to at least:

generate a first user interface that is rendered upon a display of a mobile device, wherein the first user interface provides a first portion of a shopping experience comprising browsing a product catalog;

receive from the mobile device a selection of a product to be virtually tried on by a user, wherein the product is selected from the product catalog;

transmit, from the server computing device to the television system, data that transfers the shopping experience from the mobile device to a television system that is distinct from the mobile device by causing a second portion of the shopping experience comprising a second user interface comprising the product to be rendered upon a television display of the television system, wherein the mobile device is a mobile phone device or a laptop device;

capture a video of the user via a camera device of the television system;

transmit image data for the product from a network source, wherein the image data includes a first image of the product from a first viewing angle and a second image of the product from a second viewing angle, wherein the first image and the second image are still images of the product;

generate, in a first area of the second user interface, a video signal showing the first image of the product from the first viewing angle being composited upon the video of the user, and in a second area of the second user interface, a zoomed view of the product, wherein the first image of the product is transformed based at least in part on a user position in the video of the user being captured via the camera device;

render the video signal in the second user interface;

update the video signal in the second user interface to replace the first image from the first viewing angle with the second image of the product from the second viewing angle based at least in part on another user position in the video of the user being captured via the camera device, wherein the second image is further transformed based at least in part on the another user position;

identify, from the video of the user, a gesture to transfer the shopping experience from the television system to the mobile device to perform at least one action in association with the product; and

transfer the shopping experience to the mobile device by transmitting a directive to the mobile device that causes the mobile device to update the first user interface to perform at least one action in association with the product.

2. The non-transitory computer-readable medium of claim 1, wherein the mobile device is configured to update the first user interface to display a shopping list in response to the directive, wherein the product is added to the shopping list.

3. The non-transitory computer-readable medium of claim 1, wherein the television system comprises a console device.

4. A system, comprising:

a television device comprising a first processor;

a television display in communication with the television device;

a mobile device comprising a second processor and a display, wherein the mobile device is a mobile phone device or a laptop device and the mobile device is distinct from the television device; and

a server device comprising a third processor that executes server instructions, which when executed cause the server device to at least;

generate a first user interface that is rendered upon the display of the mobile device, wherein the first user interface provides a first portion of a shopping experience comprising browsing a catalog;

receive from the mobile device a user selection of an item to be virtually tried on by a user, wherein the item is selected from the catalog;

transmit, from the server computing device to the television system, data that transfers the shopping experience from the mobile device to the television device by causing a second portion of the shopping experience comprising a second user interface to be rendered on the television display, wherein the second user interface renders, in a first area of the second user interface, a first image from a first viewing angle of the item composited with a video of the user on the television display, and replaces the first image with a second image from a second view of the item based at least in part on a movement of the user within the video of the user, the second image being composited with the video of the user on the television display, and in a second area of the second user interface, a zoomed view of the product;

identify a gesture to transfer the shopping experience from the television device to the mobile device to perform a user command in association with the item; and

transfer the shopping experience to the mobile device by a directive transmitted to the mobile device that causes the mobile device to update the first user interface to implement the user command.

5. The system of claim 4, wherein when executed the server instructions further cause the server device to at least determine a suggested item to recommend to the user based at least in part on the video of the user.

6. The system of claim 4, wherein rendering the first image of the item on the television display with the video of the user further comprises applying a transformation to the first image of the item.

7. The system of claim 4, wherein the user command is implemented by sending the directive, and in response to the directive, the first user interface of the mobile device is updated to render for display at least a description of the item.

8. The system of claim 4, wherein when executed the server instructions further cause the server device to at least receive data encoding the user selection from the mobile device via a network.

9. The system of claim 4, wherein the user command is a command to transform the first image of the item and a transformation is implemented based at least in part on the command to transform the first image of the item.

10. The system of claim 4, wherein obtaining the user command comprises determining that the video of the user has changed.

11. The system of claim 4, wherein the user selection specifies an option associated with the item, and the first image of the item depicts the option being applied to the item.

12. The system of claim 4, wherein the user command requests an order of the item, and the order of the item is initiated in response to the user command.

13. The system of claim 4, wherein the user command requests an order of the item, and the second user interface is updated to request additional user input to consummate the order.

14. The system of claim 4, wherein the television device includes a camera device, and the video of the user is obtained via the camera device.

15. The system of claim 4, wherein the video of the user is obtained from a camera device of the mobile device.

16. The system of claim 4, wherein when executed the server instructions further cause the server device to at least process the video of the user to identify the gesture to transfer the shopping experience from the television device to the mobile device.

17. The system of claim 4, wherein when executed the server instructions further cause the server device to at least:

obtain audio via a microphone of the television device; and

process the audio to identify a voice command.

18. A method, comprising:

generating, using a server device, a first user interface and causing the first user interface to be rendered upon a display of a mobile device, wherein the first user interface provides a first portion of a shopping experience comprising browsing a catalog;

receiving, using the server device, a selection of an item to be virtually tried on by a user, wherein the item is selected from the catalog using the mobile device;

transmitting, using the server device, data that transfers the shopping experience from the mobile device to a television system that is distinct from the mobile device by causing a second portion of the shopping experience comprising a second user interface comprising the item to be rendered upon a television display of the television system, wherein the mobile device is a mobile phone device or a laptop device;

capturing, by a camera device of the television system, a video stream of a user wherein the second user interface renders, in a first area of the second user interface, a first image from a first viewing angle of the item composited with a video stream of the user on the display, and replaces the first image with a second image from a second view of the item based at least in part on a movement of the user within the video stream of the user, the second image being composited with the video stream of the user on the television display, and in a second area of the second user interface, a zoomed view of the product;

identifying, using the server device, a gesture to transfer the shopping experience from the television system to the mobile device to perform at least one action in association with the item; and

transferring, using the server device, the shopping experience to the mobile device by transmitting a directive to the mobile device that causes the mobile device to implement a user action.

19. The method of claim 18, wherein the user action is identified by processing the video stream using the server device.

20. The method of claim 18, wherein the user action is selected from a group consisting of:

initiating an order of the item and adding the item to a shopping list.

21. The method of claim 18, wherein another user action is identified by receiving a voice command.

22. The method of claim 18, wherein the first user interface is updated to render network content obtained from a third computing device in response to the user action.

23. The method of claim 18, wherein the second user interface implements another user action by applying a transformation to the first image.

24. The method of claim 18, wherein the second user interface implements another user action by applying a transformation to the second image.

25. The method of claim 18, further comprising updating the second user interface by automatically applying a transformation to the first image of the item.