OBJECT CUSTOMIZATION AND ACCESSORIZATION IN VIDEO CONTENT

• US 20150262402A1
• Filed: 06/27/2014
• Published: 09/17/2015
• Est. Priority Date: 03/11/2014
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: HEINZ, GERALD JOSEPH II, PESCE, MICHAEL SCHLEIF, DAVIS, COLLIN CHARLES, FRAZZINI, MICHAEL ANTHONY, ALKARMI, ASHRAF, GEORGE, MICHAEL MARTIN, LIMP, DAVID A., CARR, WILLIAM DUGALD Jr.
• Granted Patent: US 9,747,727 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: H04N 21/44224 Monitoring of user activity on external systems, e.g. Internet browsing
• CPC Class Codes: H04N 21/6582 Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number arrangements where receivers interact with the broadcast H04H20/38

Abstract

A real-time video exploration (RVE) system that allows users to pause, step into, move through, and explore 2D or 3D modeled worlds of scenes in a video. The RVE system may allow users to select and manipulate objects within a scene, and to modify an object by adding or removing accessories from the object or otherwise customizing the object according to the user'"'"'s preferences or desires. The RVE system may also provide an interface or interfaces via which the user can obtain additional information for the object, customize the object, be given a price or price(s) for the object as customized, and purchase the object as specified if desired.

Claims

1. A system, comprising;

one or more computing devices configured to implement a real-time video exploration (RVE) system comprising;

a playback module configured to begin playback of at least a portion of a pre-recorded video to a client device; and

a graphics processing and rendering module configured to;

receive input specifying one or more modifications to be applied to a selected object in a scene of the video;

modify a model of the object according to the one or more modifications to generate a modified model of the object;

render new video of the scene including the modified model of the object; and

stream the new video of the scene including the object as modified to the client device.

2. The system as recited in claim 1, wherein the input specifies one or more customizations to be applied to the selected object, wherein a customization changes at least one feature of the selected object, and wherein the new video shows the selected object as customized.

3. The system as recited in claim 1, wherein, to modify a model of the object according to the one or more modifications to generate a modified model of the object, the graphics processing and rendering module is configured to:

obtain graphics data for the object from one or more sources; and

generate the modified model of the of the object according to the obtained graphics data for the object.

4. The system as recited in claim 1, wherein the RVE system further comprises an interface component configured to:

receive input from the client device requesting information about the selected object;

obtain information about the selected object from one or more sources; and

send at least a portion of the obtained information about the selected object to the client device for display.

5. The system as recited in claim 4, wherein the information sent to the client device includes information for ordering a version of the selected object, wherein the version of the selected object comprises a virtual representation or physical version of the selected object.

6. The system as recited in claim 5, wherein the interface component is further configured to:

receive additional input from the client device ordering a version of the selected object as modified; and

facilitate generation of an order for the version of the selected object as modified according to the additional input.

7. The system as recited in claim 1, wherein the one or more computing devices that implement the RVE system are on a provider network, and wherein the graphics processing and rendering module is configured to leverage one or more computing resources of the provider network to perform said rendering in real time in response to input modifying the selected object.

8. The system as recited in claim 1, wherein the input is received from the client device according to an application programming interface (API) of the RVE system.

9. The system as recited in claim 1, wherein the selected object is a three-dimensional (3D) object, wherein the graphics data is 3D graphics data, and wherein the model of the object is a 3D model.

10. A method, comprising:

performing, by a real-time video exploration (RVE) system implemented on one or more computing devices;

sending at least a portion of a pre-recorded video to a client device;

receiving input indicating one or more modifications to be applied to a selected object in a scene of the video;

modifying a model of the object according to the one or more modifications to generate a modified model of the object;

rendering new video of the scene including the modified model of the object; and

sending the new video of the scene including the object as modified to the client device.

11. The method as recited in claim 10, wherein sending comprises streaming.

12. The method as recited in claim 10, wherein the input comprises an indication of a preference of a user of the client device.

13. The method as recited in claim 12, wherein the input is received from a seller of a physical version of the rendered object.

14. The method as recited in claim 10, wherein modifying a model of the object according to the one or more modifications to generate a modified model of the object comprises:

obtaining graphics data for the object from one or more sources; and

generating the modified model of the of the object according to the obtained graphics data for the object.

15. The method as recited in claim 10, further comprising:

receiving input from the client device requesting information about the selected object;

obtaining information about the selected object from one or more sources; and

sending at least a portion of the obtained information about the selected object to the client device for display.

16. The method as recited in claim 15, wherein the information sent to the client device includes information for ordering a version of the selected object, wherein the version of the selected object comprises a virtual representation or physical version of the selected object.

17. The method as recited in claim 16, further comprising:

receiving additional input from the client device ordering a version of the selected object as modified; and

generating an order for the version of the selected object as modified according to the additional input.

18. The method as recited in claim 10, wherein the selected object is a three-dimensional (3D) object, wherein the graphics data is 3D graphics data, and wherein the model of the object is a 3D model.

19. A non-transitory computer-readable storage medium storing program instructions that when executed on one or more computers cause the one or more computers to implement a real-time video exploration (RVE) system configured to:

send at least a portion of a pre-recorded video to a client device;

receive input indicating one or more modifications to be applied to a selected object in the scene;

modify a model of the object according to the one or more modifications to generate a modified model of the object;

render new video of the scene including the modified model of the object; and

send at least a portion of the new video of the scene including the object as modified to the client device.

20. The non-transitory computer-readable storage medium as recited in claim 19, wherein the RVE system is further configured to:

send additional information about the selected object to the client device for display, wherein the additional information includes information for ordering a physical version of the selected object; and

receive input from the client device ordering the selected object as modified.

21. The non-transitory computer-readable storage medium as recited in claim 19, wherein the selected object is a three-dimensional (3D) object, wherein the graphics data is 3D graphics data, and wherein the model of the object is a 3D model.