OBJECT CUSTOMIZATION AND ACCESSORIZATION IN VIDEO CONTENT

• US 20170358145A1
• Filed: 08/28/2017
• Published: 12/14/2017
• Est. Priority Date: 03/11/2014
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Heinz, II, Gerard Joseph, Pesce, Michael Schleif, Davis, Collin Charles, Frazzini, Michael Anthony, Alkarmi, Ashraf, George, Michael Martin, Limp, David A., Carr, JR., William Dugald
• Granted Patent: US 11,222,479 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: H04N 21/44224 Monitoring of user activity on external systems, e.g. Internet browsing
• CPC Class Codes: H04N 21/6582 Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number arrangements where receivers interact with the broadcast H04H20/38

Abstract

A real-time video exploration (RVE) system that allows users to pause, step into, move through, and explore 2D or 3D modeled worlds of scenes in a video. The RVE system may allow users to select and manipulate objects within a scene, and to modify an object by adding or removing accessories from the object or otherwise customizing the object according to the user'"'"'s preferences or desires. The RVE system may also provide an interface or interfaces via which the user can obtain additional information for the object, customize the object, be given a price or price(s) for the object as customized, and purchase the object as specified if desired.

Claims

1-21. -21. (canceled)

22. A method, comprising:

sending at least a portion of a pre-recorded video to a client device;

receiving input indicating one or more modifications to be applied to an object in a scene of the pre-recorded video;

causing the pre-recorded video to be paused responsive to the input;

modifying a model of the object in the pre-recorded video according to the one or more modifications to generate a modified model of the object;

rendering new video of the scene including the modified model of the object; and

causing playback of the pre-recorded video to be resumed to the client device in response to resume input from the client device, wherein said causing playback to be resumed comprises sending the new video of the scene including the first object as modified to the client device.

23. The method of claim 22, further comprising receiving viewpoint input from the client device based on interactions from a viewer of the client device exploring the scene of the pre-recorded video.

24. The method of claim 23, wherein the viewpoint input indicates a change of viewing angle, a viewpoint movement, or both.

25. The method of claim 22, wherein the one or more modifications to be applied to the object specify one or more customizations to be applied to the object, wherein a customization changes at least one feature of the object.

26. The method of claim 22, further comprising:

obtaining graphics data for the object from one or more sources, wherein the graphics data comprises three-dimensional (3D) graphics data; and

generating the modified model of the object according to the obtained graphics data for the object.

27. The method of claim 22, wherein the object comprises a 3D object, wherein the model of the object comprises a 3D model.

28. The method of claim 22, further comprising:

receiving, from the client device, a request for information regarding the object;

obtaining the information regarding the object from one or more sources; and

sending at least a portion of the obtained information regarding the object to the client device.

29. The method of claim 22, further comprising rendering and streaming the new video to other client devices.

30. A system, comprising:

one or more computing devices comprising one or more processors and one or more memories storing instructions executable by the one or more processors to cause the one or more processors to;

send at least a portion of a pre-recorded video to a client device;

receive input indicating one or more modifications to be applied to an object in a scene of the pre-recorded video;

cause the pre-recorded video to be paused responsive to the input;

modify a model of the object in the pre-recorded video according to the one or more modifications to generate a modified model of the object;

render new video of the scene including the modified model of the object; and

in response to resume input from the client device, cause playback of the pre-recorded video to be resumed to the client device and send the new video of the scene including the first object as modified to the client device.

31. The system of claim 30, wherein the instructions further cause the one or more processors to generate a user interface to be displayed at the client device.

32. The system of claim 31, wherein the user interface is configured to:

receive the input indicating the one or more modifications to the object;

display a second user interface corresponding to the object;

receive object input manipulating the object via the second user interface.

33. The system of claim 32, wherein the instructions further cause the one or more processors to manipulate the second user interface based on the object input.

34. The system of claim 30, wherein the new video is rendered in real-time or near-real-time in response to the input.

35. The system of claim 30, wherein the input indicating the one or more modifications is received from the client device according to an application programming interface (API) of the RVE system.

36. The system of claim 32, wherein the instructions further cause the one or more processors to render and stream the new video to multiple other client devices.

37. A non-transitory, computer-readable storage medium storing instructions that, when executed on one or more processors, cause the one or more processors to perform:

sending at least a portion of a pre-recorded video to a client device;

receiving input indicating one or more modifications to be applied to an object in a scene of the pre-recorded video;

causing the pre-recorded video to be paused responsive to the input;

modifying a model of the object in the pre-recorded video according to the one or more modifications to generate a modified model of the object;

rendering new video of the scene including the modified model of the object; and

causing playback of the pre-recorded video to be resumed to the client device in response to resume input from the client device, wherein said causing playback to be resumed comprises sending the new video of the scene including the object as modified to the client device.

38. The non-transitory, computer-readable storage medium of claim 37, wherein receiving the input occurs during sending the at least the portion of the pre-recorded video.

39. The non-transitory, computer-readable storage medium of claim 37, wherein the instructions further cause the one or more processors to perform:

receiving additional input indicating one or more additional modifications to be applied to the object from one or more other client devices; and

further modifying the model of the object according to the one or more additional modifications.

40. The non-transitory, computer-readable storage medium of claim 39, wherein the instructions further cause the one or more processors to perform:

rendering another new video of the scene included the modified model of the object according to the input and the additional input; and

sending the other new video of the scene including the object as modified to the client device and the one or more other client devices.

41. The non-transitory, computer-readable storage medium of claim 37, wherein the instructions further cause the one or more processors to perform:

receiving a request for a physical version of the object as modified by the input; and

sending the request for the physical version to one or more external sources for ordering the physical version.