Integrated architecture and network for arrangement and delivery of media

• US 9,934,225 B2
• Filed: 01/30/2017
• Issued: 04/03/2018
• Est. Priority Date: 04/27/2015
• Status: Active Grant

• Current Assignee: Living Media, LLC
• Original Assignee: Living Media, LLC
• Inventors: Dauderman, Nicholas J., Matuchniak, Tadeusz Peter, Marks, Jeffrey S., Lazaris, Spyros J., Duvernois, Clifford
• Primary Examiner(s): Raab, Christopher J
• Application Number:
  US15/419,547
• Publication Number:
  US 20170139915A1
• Time in Patent Office: 428 Days
• Field of Search: None
• CPC Class Codes: G06F 16/437 Administration of user profiles, e.g. generation, initialisation, adaptation, distribution
• CPC Class Codes: G06F 16/447 Temporal browsing, e.g. timeline
• CPC Class Codes: G06F 16/907 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/908 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques

Abstract

A media management framework comprises an integrated architecture and online networking service for aggregating a user'"'"'s various media files to enable a customized distribution of those media files. User media files are processed, archived, aggregated, and distributed for display in customized story streams. Additional media files are pulled from other sources, such as social media feeds and the public domain, to create a customized distribution and a comprehensive user experience centered on a user'"'"'s media files based on specified user preferences. The customized distribution also includes modifying story streams based on learning of additional user preferences from continued user interaction and continuously grouping inference associations from one or more of activities, people, objects, times, dates, and locations.

Claims

1. A method of dynamic, user-directed arrangement and delivery of media, comprising:

within a computing environment comprised of at least one computer processor, and at least one computer-readable storage medium operably coupled to the at least one computer processor, the at least one computer processor operable to execute a plurality of program instructions to perform the steps of;

receiving

     1) one or more media files designated by at least one user, at the direction of the at least one user, or from another user associated with the at least one user, and

     2) additional content that includes one or more third-party media files and inferences derived from external data sources associated with the at least one user or an account of the at least one user, into a disparately-maintained content library and an interactive index that are continually updated at least as the one or more media files are designated or as the additional content is received;

applying one or more artificial intelligence techniques to adaptively relate the one or more media files and the additional content in the interactive index, by

     1) developing a user profile by identifying and continually updating the interactive index from characteristics learned from a) interaction via an interface to collect user-specified media preferences, b) recipient-specified media preferences, and c) inferences obtained from the disparately-maintained content library, and

     2) developing a set of content rules for framing a content boundary, the user profile and the set of content rules providing the at least one user with direct control over arrangement and delivery of the one or more media files and the additional content in at least one media stream to one or more devices associated with credentials assigned by the at least one user, and the user profile and the set of content rules are continually updated by the interactive index to dynamically modify the at least one media stream in real time;

relating the at least one media stream with one or more of a) a user interaction and a recipient interaction with the at least one media stream, b) additional inferences obtained from the additional content, and c) data obtained from one or more personal computing devices associated with a user or a recipient within a specified proximity of the at least one media stream, to dynamically influence the interactive index and further adaptively relate the one or more media files and the additional content, so that the at least one media stream is further dynamically modified in a real-time response to the one or more of a user interaction and a recipient interaction with the at least one media stream and the characteristics learned, for continued direct control by the at least one user as the at least one media stream is provided and as the one or more media files, the additional content the further media files and further content is received; and

delivering the at least one media stream to the one or more devices designated by credentials assigned by the at least one user.

2. The method of claim 1, wherein the additional content includes variables representing data and media associated with and obtained from user social media accounts, interaction with media stream interfaces in a display environment, the one or more personal computing devices associated with a user or a recipient within a specified proximity of the display environment, user contacts, networked personal computing devices associated with the at least one user or an account of the at least one user, external servers, and web sources that include one or more of Internet-based services, information media resources, and other networked services.

3. The method of claim 1, further comprising initiating the delivery of the at least one media stream, to the one or more devices designated by the credentials assigned by the user, based on adaptively relating the one or more media files and the additional content in the interactive index.

4. The method of claim 1, further comprising assigning specific content from the adaptively-related one or more media files and the additional content to at least one specific device in the one or more devices associated with credentials assigned by the at least one user, or to a specific location of a device in the one or more devices associated with credentials assigned by the at least one user.

5. The method of claim 1, further comprising applying a template to frame an initial content boundary for the at least one media stream.

6. The method of claim 1, further comprising identifying at least one of a geo-location of the least one user to retrieve the additional content that is relative to the geo-location of the at least one user, and a geo-location of at least one device associated with credentials assigned by the at least one user to retrieve the additional content that is relative to the geo-location of the at least one device.

7. The method of claim 1, further comprising assigning one or more media tags to the one or more media files and the additional content based on the user profile and the set of content rules, from data extracted from the one or more media files and the additional content, and from a recognition analysis applied to the one or more media files and the additional content to identify activities, people, objects, times, dates, and locations within the one or more media files and the additional content, building a plurality of inferences from the one or more media tags by associating specific data points to each user media file, constructing a set of sequences from the plurality of inferences by associating inference groupings based on the specific data points, the user profile, and the set of content rules, and modifying the set of sequences with additional user characteristics learned by the one or more artificial intelligence techniques.

8. The method of claim 1, wherein the receiving the one or more user media files further comprises identifying and uploading the one or more user media files from one or more of computer-based files of the at least one user, mobile device-based files of the at least one user, an account of the at least one user with an online file storage service, and the another user associated with the at least one user.

9. The method of claim 1, wherein the one or more devices designated by credentials assigned by the at least one user is an internet-enabled display device.

10. The method of claim 9, wherein the internet-enabled display device is one or more of a television, a computer, a screen, a mobile telephony device, a picture frame, or a networked device configured to receive data over a network.

11. A system of dynamic, user-directed arrangement and delivery of media comprising:

a computing environment including at least one non-transitory computer-readable storage medium having program instructions stored therein and at least one computer processor operable to execute the program instructions to execute a plurality of data processing modules, the plurality of data processing modules including;

a media import module embodied in at least one processor, specifically configured to receive

     1) one or more media files designated by at least one user, at the direction of the at least one user, or from another user associated with the at least one user, and

     2) additional content that includes one or more third-party media files and inferences derived from external data sources associated with the at least one user or an account of the at least one user, into a disparately-maintained content library and an interactive index that are continually updated at least as the one or more media files are designated;

an artificial intelligence module embodied in at least one processor, specifically configured to apply one or more artificial intelligence techniques to adaptively relate the one or more media files and the additional content in the interactive index, by

     1) developing a user profile by identifying and continually updating the interactive index from characteristics learned from a) interaction via an interface to collect user-specified media preferences, b) recipient-specified media preferences, and c) inferences obtained from the disparately-maintained content library,

     2) developing a set of content rules for framing a content boundary, the user profile and the set of content rules providing the at least one user with direct control over arrangement and delivery of the one or more media files and the additional content in at least one media stream to one or more devices associated with credentials assigned by the at least one user, and the user profile and the set of content rules are continually updated by the interactive index to dynamically modify the at least one media stream in real time, and

     3) relating the at least one media stream with one or more of a) a user interaction and a recipient interaction with the at least one media stream, b) additional inferences obtained from the additional content, and c) data obtained from one or more personal computing devices associated with a user or a recipient within a specified proximity of the at least one media stream, to dynamically influence the interactive index and further adaptively relate the one or more media files and the additional content, so that the at least one media stream is further dynamically modified in a real-time response to the one or more of a user interaction and a recipient interaction with the at least one media stream and the characteristics learned, for continued direct control by the at least one user as the at least one media stream is provided and as the one or more media files, the additional content the further media files and further content is received; and

a stream delivery module embodied in at least one processor, specifically configured to initiate delivery of the at least one media stream to the one or more devices designated by credentials assigned by the at least one user, based on inferences learned from the adaptively relating the one or more media files and the additional content in the interactive index.

12. The system of claim 11, wherein the additional content includes variables representing data and media associated with and obtained from user social media accounts, interaction with media stream interfaces in a display environment, the one or more personal computing devices associated with a user or a recipient within a specified proximity of the display environment, user contacts, networked personal computing devices associated with the at least one user or an account of the at least one user, external servers, and web sources that include one or more of Internet-based services, information media resources, and other networked services.

13. The system of claim 11, wherein specific content from the adaptively-related one or more media files and the additional content is assigned to at least one specific device in the one or more devices associated with credentials assigned by the at least one user, or to a specific location of a device in the one or more devices associated with credentials assigned by the at least one user.

14. The system of claim 11, further comprising a stream generation module embodied in at least one processor, specifically configured to assign one or more media tags to the one or more media files and the additional content based on the user profile and the set of content rules, from data extracted from the one or more media files and the additional content, and from a recognition analysis applied to the one or more media files and the additional content to identify activities, people, objects, times, dates, and locations within the one or more media files and the additional content, build a plurality of inferences from the one or more media tags by associating specific data points to each user media file, construct a set of sequences from the plurality of inferences by associating inference groupings based on the specific data points, the user profile, and the set of content rules, and modify the set of sequences with additional user characteristics learned by the one or more artificial intelligence techniques.

15. The system of claim 14, wherein the stream generation module is further configured to apply a data file analysis to identify file metadata.

16. The system of claim 14, wherein the stream generation module is further configured to apply a template to frame an initial content boundary for the at least one media stream.

17. The system of claim 14, wherein the stream generation module is further configured to identify at least one of a geo-location of the least one user to retrieve the additional content that is relative to the geo-location of the at least one user, and a geo-location of at least one device associated with credentials assigned by the at least one user to retrieve the additional content that is relative to the geo-location of the at least one device.

18. The system of claim 11, wherein the one or more user media files are identified and uploaded from one or more of computer-based files of the at least one user, mobile device-based files of the at least one user, an account of the at least one user with an online file storage service, and the another user associated with the at least one user.

19. The system of claim 11, wherein the one or more user-designated devices is an internet-enabled display device.

20. The system of claim 19, wherein the internet-enabled display device is one or more of a television, a computer, a mobile telephony device, a picture frame, or a networked device configured to receive data over a network.

21. A method of dynamic, user-directed arrangement and delivery of media, comprising:

arranging one or more media files designated by at least one user, at the direction of the at least one user, or from another user associated with the at least one user, and additional content that includes one or more third-party media files and inferences derived from external data sources associated with the at least one user or an account of the at least one user, for delivery in at least one media stream, by;

adaptively relating the one or more media files and the additional content in an interactive index using one or more artificial intelligence techniques to

     1) develop a user profile by identifying and continually updating the interactive index from characteristics learned from a) interaction via an interface to collect user-specified media preferences, b) recipient-specified media preferences, and c) inferences obtained from a disparately-maintained content library of the one or more media files and the additional content,

     2) develop a set of content rules for framing a content boundary, and

     3) relate the at least one media stream with one or more of a) user interaction and a recipient interaction with the at least one media stream b) additional inferences obtained from the additional content, and c) data obtained from one or more personal computing devices associated with a user or a recipient within a specified proximity of the at least one media stream, to dynamically influence the interactive index and further adaptively relate the one or more media files and the additional content, wherein the user profile and the set of content rules are continually updated to dynamically modify the at least one media stream in real time and provide the at least one user with direct control over arrangement and delivery of the one or more media files and the additional content in the at least one media stream, and the at least one media stream is further dynamically modified in a real-time response to the one or more of a user interaction and a recipient interaction with the at least one media stream and the characteristics learned, for continued direct control by the at least one user as the at least one media stream is provided and as the one or more media files, the additional content the further media files and further content is received; and

initiating a delivery of the at least one media stream to one or more devices designated by credentials assigned by the at least one user, based on inferences learned from the adaptively relating the one or more media files and the additional content in the interactive index.

22. The method of claim 21, further comprising ingesting the one or more media files and the additional content into the disparately-maintained content library.

23. The method of claim 21, wherein the additional content includes variables representing data and media associated with and obtained from user social media accounts, interaction with media stream interfaces in a display environment, the one or more personal computing devices associated with a user or a recipient within a specified proximity of the display environment, user contacts, networked personal computing devices associated with the at least one user or an account of the at least one user, external servers, and web sources that include one or more of Internet-based services, information media resources, and other networked services.

24. The method of claim 21, further comprising assigning specific content from the adaptively-related one or more media files and the additional content to at least one specific device in the one or more devices associated with credentials assigned by the at least one user, or to a specific location of a device in the one or more devices associated with credentials assigned by the at least one user.

25. The method of claim 21, further comprising applying a template to frame an initial content boundary for the at least one media stream.

26. The method of claim 21, further comprising identifying at least one of a geo-location of the least one user to retrieve the additional content that is relative to the geo-location of the at least one user, and a geo-location of at least one device associated with credentials assigned by the at least one user to retrieve the additional content that is relative to the geo-location of the at least one device.

27. The method of claim 21, further comprising assigning one or more media tags to the one or more media files and the additional content based on the user profile and the set of content rules, from data extracted from the one or more media files and the additional content, and from a recognition analysis applied to the one or more media files and the additional content to identify activities, people, objects, times, dates, and locations within the one or more media files and the additional content, building a plurality of inferences from the one or more media tags by associating specific data points to each user media file, constructing a set of sequences from the plurality of inferences by associating inference groupings based on the specific data points, the user profile, and the set of content rules, and modifying the set of sequences with additional user characteristics learned by the one or more artificial intelligence techniques.

28. The method of claim 21, wherein the receiving the one or more user media files further comprises identifying and uploading the one or more user media files from one or more of computer-based files of the at least one user, mobile device-based files of the at least one user, an account of the at least one user with an online file storage service, and the another user associated with the at least one user.

29. The method of claim 21, wherein the one or more devices designated by credentials assigned by the at least one user is an internet-enabled display device.

30. The method of claim 29, wherein the internet-enabled display device is one or more of a television, a computer, a screen, a mobile telephony device, a picture frame, or a networked device configured to receive data over a network.