Repository service for managing digital assets

• US 10,506,003 B1
• Filed: 09/29/2014
• Issued: 12/10/2019
• Est. Priority Date: 08/08/2014
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Cabanero, Christian Robert, Van Gorder, Matthew James, Leonard, Thomas Richard, Nylund, Eric Stephen, MacDonald, Adam C. F., Alkarmi, Ashraf, Davis, Collin Charles, Frazzini, Michael Anthony, Heinz, II, Gerard Joseph, Pesce, Michael Schleif
• Primary Examiner(s): Abedin, Normin
• Application Number:
  US14/500,619
• Time in Patent Office: 1,898 Days
• CPC Class Codes: A63F 13/63 by the player, e.g. authoring using a level editor
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 16/13 File access structures, e.g. distributed indices arrangements of input from, or output to, record carriers G06F3/06
• CPC Class Codes: G06F 16/444 Spatial browsing, e.g. 2D maps, 3D or virtual spaces
• CPC Class Codes: G06F 3/01 Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06Q 30/0601 Electronic shopping [e-shopping]
• CPC Class Codes: G06T 1/60 Memory management
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2219/20 Indexing scheme for editing of 3D models
• CPC Class Codes: H04L 41/22 comprising specially adapted graphical user interfaces [GUI]
• CPC Class Codes: H04L 65/60 Network streaming of media packets
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04N 21/23412 for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects
• CPC Class Codes: H04N 21/44012 involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
• CPC Class Codes: H04N 21/816 involving special video data, e.g 3D video

Abstract

A media universe system may provide digital media content to clients via methods and apparatus that provide interactive and immersive viewing experiences to the clients. A repository service may store digital assets for the media universe and maintain an asset tracking database that may track how the digital assets of the media universe relate to one another over time within a world encompassed by the media universe. The repository service may also maintain mappings between the digital assets and other content of the media universe. The repository service may serve as a centralized continuity database for the world and the media universe. Providing an accessible, scalable, network-based location for the continuity database may enable developers to build interactive experiences for users to explore the world of the media universe, both spatially and temporally.

Claims

1. A system, comprising:

one or more computing devices configured to implement a media universe (MU) system comprising;

a repository service comprising;

a digital asset repository configured to store a plurality of digital assets related to a world of a media universe; and

an asset tracking database configured to track relationships of the digital assets to each other and to other content of the media universe; and

a graphics processing and rendering module configured to;

obtain digital media related to the world of the media universe from a digital media source;

query the repository service specifying one or more media universe content items included in the digital media to obtain one or more digital assets from the repository service based at least in part on the relationships tracked by the asset tracking database, wherein the one or more digital assets are to be inserted into the digital media;

determine one or more locations in the digital media for inserting the one or more digital assets;

render digital media content including renderings of the one or more digital assets inserted at the determined locations in the digital media; and

stream the digital media content to one or more client devices.

2. The system as recited in claim 1, wherein the repository service is further configured to maintain mappings between the digital assets and other content of the media universe, wherein particular digital assets are mapped to particular media universe content, wherein the mappings identify other characters, objects, locations, storylines, or any combination thereof, within the media universe that have the relationships with the digital assets.

3. The system as recited in claim 2,

wherein the repository service is configured to:

receive, from the graphics processing and rendering module, input indicating one or more client interactions with digital media content on a client device;

determine a particular digital asset in the repository according to the indicated one or more client interactions with the digital media content;

determine particular media universe content related to the determined digital asset according to the mappings; and

provide the determined media universe content to the graphics processing and rendering module;

wherein the graphics processing and rendering module is further configured to render additional digital media content including the determined media universe content related to the determined digital asset and stream the additional digital media content to the client device.

4. The system as recited in claim 1,

wherein, to obtain the one or more digital assets from the repository service, the graphics processing and rendering module is configured to:

receive, from a client device, input indicating one or more client interactions with digital media content on the client device; and

provide input to the repository service indicating the one or more client interactions;

wherein the repository service is configured to determine the one or more digital assets in the repository according to the indicated client interactions and provide the one or more digital assets to the graphics processing and rendering module.

5. The system as recited in claim 1, wherein, to obtain the one or more digital assets from the repository service, the repository service is configured to:

identify a particular client or group of clients associated with the one or more client devices;

determine the one or more digital assets to be inserted into the digital media content according to the identified client or group of clients; and

provide the one or more digital assets to the graphics processing and rendering module, wherein the one or more digital assets include at least one digital asset that is targeted at the particular client or group of clients according to one or more of identities, profiles, or preferences associated with the client or group.

6. The system as recited in claim 1, wherein, to obtain the one or more digital assets from the repository service, the repository service is configured to:

identify a particular client associated with one of the one or more client devices;

determine the one or more digital assets to be inserted into the digital media content according to the identified client; and

provide the one or more digital assets to the graphics processing and rendering module;

wherein the one or more digital assets include at least one digital asset that was customized or created by the client.

7. The system as recited in claim 1, wherein the digital assets include two-dimensional (2D) or three-dimensional (3D) models of characters or objects of the world of the media universe.

8. The system as recited in claim 1, wherein the one or more computing devices that implement the MU system are on a provider network, wherein the one or more client devices are configured to access the MU system on the provider network via an intermediate network, and wherein the MU system is configured to leverage one or more computing resources of the provider network to iteratively perform said obtaining digital media content, said obtaining one or more digital assets, said determining, said rendering, and said streaming in real-time in response to client input received from the one or more client devices.

9. A method, comprising:

performing, by a repository service implemented on one or more computing devices;

storing a plurality of digital assets related to a world of a media universe and asset tracking information indicating relationships of the digital assets to each other and to the world of a media universe;

receiving input indicating one or more user interactions with digital media content on a client device associated with a user;

determining a particular digital asset according to the indicated user interactions with the digital media content;

querying the asset tracking information with the particular digital asset to determine relationships between the particular digital asset and other media universe content;

selecting particular media universe content for the user according to the determined relationships between the particular digital asset and the other media universe content and according to profile information associated with the user or with a group of users; and

providing the particular media universe content to the user via the client device.

10. The method as recited in claim 9, wherein said providing the particular media universe content to the user via the client device comprises:

providing the determined media universe content to a graphics processing and rendering module implemented on one or more computing devices;

rendering, by the graphics processing and rendering module, new digital media content including the determined media universe content; and

streaming the new digital media content to the client device.

11. The method as recited in claim 10, further comprising:

providing, by the repository service, the particular digital asset to the graphics processing and rendering module;

rendering, by the graphics processing and rendering module, the particular digital asset to generate additional digital media content including a rendering of the particular digital asset; and

merging the additional media content with the new digital media content including the determined media universe content related to the determined digital asset.

12. The method as recited in claim 10, wherein the repository service and the graphics processing and rendering module are components of a media universe (MU) system implemented on a provider network, wherein the MU system is configured to leverage computing resources of the provider network to iteratively perform said providing, said rendering, and said streaming in real-time to a plurality of client devices in response to client interactions exploring or manipulating digital media content streamed to the client devices.

13. The method as recited in claim 9, wherein the digital assets include two-dimensional (2D) or three-dimensional (3D) models of characters or objects, wherein the media universe content includes content related to the characters or objects modeled by the 2D or 3D models.

14. The method as recited in claim 9, wherein the digital assets include three-dimensional (3D) models of characters or objects configured to be digitally rendered to generate digital video content including two-dimensional (2D) representations of the 3D models.

15. The method as recited in claim 14, wherein at least one of the 3D models is further configured to be physically rendered to generate a physical rendering or reproduction of the corresponding character or object.

16. The method as recited in claim 9, further comprising:

receiving, by the repository service from an enterprise system, input specifying one or more digital assets of the media universe;

providing, by the repository service to the enterprise system, two or more digital models corresponding to the specified one or more digital assets; and

producing, by the enterprise, at least one physical rendering according to a combination of the two or more digital models.

17. The method as recited in claim 9, further comprising:

receiving, by the repository service from an enterprise system, input specifying at least one digital asset corresponding to a character or object of the world of the media universe;

providing, by the repository service in response to the input specifying at least one digital asset, one or more digital models of the character or object to the enterprise system; and

producing, by the enterprise, at least one physical rendering or reproduction of the respective character or object according to the provided one or more digital models.

18. A non-transitory computer-readable storage medium storing program instructions that when executed on one or more computers cause the one or more computers to implement a repository service for a media universe (MU) system, the repository service configured to:

store a plurality of digital assets related to a world of the media universe and asset tracking information indicating relationships of the digital assets to each other and to the world of the media universe;

determine relationships between the digital assets and other content of the media universe at least in part according to the asset tracking information;

receive input indicating client interactions exploring or manipulating digital media content streamed to a plurality of client devices

determine particular digital assets in the repository according to the indicated client interactions with the digital media content;

querying the asset tracking information with the determined digital assets to determine media universe content related to the determined digital assets at least in part according to the determined relationships between the digital assets and the other content of the media universe; and

provide the determined media universe content to a graphics processing and rendering module of the MU system.

19. The non-transitory computer-readable storage medium as recited in claim 18, wherein the graphics processing and rendering module is configured to render new digital media content including the determined media universe content and stream the new digital media content to one or more of the client devices.

20. The non-transitory computer-readable storage medium as recited in claim 19, wherein the repository service is further configured to provide the determined digital assets to the graphics processing and rendering module, wherein the graphics processing and rendering module is further configured to render the digital assets and include the rendered digital assets in the new digital media content streamed to the one or more client devices.

21. The non-transitory computer-readable storage medium as recited in claim 18, wherein the digital assets include two-dimensional (2D) or three-dimensional (3D) models of characters or objects, wherein the media universe content includes content related to the characters or objects modeled by the 2D or 3D models.