System and method for creating customized, multi-platform video programming

• US 10,158,901 B2
• Filed: 08/10/2016
• Issued: 12/18/2018
• Est. Priority Date: 11/19/2012
• Status: Active Grant

• Current Assignee: Arthur H. Muir, John D. Steinberg
• Original Assignee: Arthur H. Muir, John D. Steinberg
• Inventors: Steinberg, John D., Muir, Arthur H.
• Primary Examiner(s): Kumar, Pankaj
• Assistant Examiner(s): Newlin, Timothy R
• Application Number:
  US15/233,336
• Publication Number:
  US 20170041654A1
• Time in Patent Office: 860 Days
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 21/23424 involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
• CPC Class Codes: H04N 21/2387 Stream processing in response to a playback request from an end-user, e.g. for trick-play
• CPC Class Codes: H04N 21/25891 being end-user preferences retrieval of video data in a video database based on user preferences G06F16/739; arrangements for recognizing users' preferences H04H60/46; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/2668 Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063
• CPC Class Codes: H04N 21/6125 involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/8352 involving content or source identification data, e.g. Unique Material Identifier [UMID]
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73

Abstract

Systems and methods for representing video and audio media files as workflows are disclosed. In some cases, the systems and methods combine segments of the media files into larger compilations in the workflows, and using the workflows to individually optimize both the viewing experience for and the advertising presented to viewers based upon the circumstances of each viewer and parameters described with the workflow.

Claims

1. A method that uses a workflow file on a first computer to determine playback of audio and video content on a second computer, wherein said audio and video content is combined with advertisements that are to be viewed by a user over a network on said second computer capable of playing such audio and video content, said method comprising:

storing, at a first computer, a workflow file comprising at least a plurality of source identifiers for a plurality of media files, said workflow file further comprising a plurality of playback parameters associated with said playback, wherein said playback parameters are defined by a media aggregator and comprise;

at least starting points and ending points within portions of said plurality of media files, layering information, advertisement auction information, and time information defining when to send source indicators to a second computer;

storing a rule book in association with said workflow file that defines resolution of conflicts in said plurality of playback parameters and resolving conflicts in said plurality of playback parameters associated with said plurality of media files based on said rule book;

representing at least a first source identifier of at least a first media file comprising both audio and video stored on at least a computer other than said first computer and said second computer, said first media file accessed over the network, wherein said first source identifier comprises as at least a first uniform resource indicator corresponding to a location of said first media file on said network;

representing at least a second source identifier of at least a second media file comprising both audio and video stored on at least a computer other than said first computer and said second computer, said second media file accessed over the network, wherein said second source identifier comprises at least a second uniform resource indicator corresponding to a location of said second media file on said network;

representing at least a third source identifier of at least a third media file comprising a first advertisement stored on at least a computer other than said first computer and said second computer, said third media file accessed over the network, wherein said third source identifier comprises at least a third uniform resource indicator corresponding to the location of said third media file on said network, where a viewer of said first advertisement can click on or otherwise select said first advertisement;

representing at least a fourth source identifier of at least a fourth media file comprising a second advertisement stored on at least a computer other than said first computer and said second computer, said fourth source identifier accessed over the network as at least a uniform resource indicator corresponding to the location of said fourth media file on said network;

evaluating attributes of at least said first media file relating to restrictions on attributes of advertisements that can be associated with said first media file;

accessing personalization data stored on said second computer, said personalization data comprising each of;

at least a portion of the browsing and viewing history of said user of said second computer, information about paid content previously purchased or subscribed to by said user, location-related information about said second computer, the language preferences of said user, and information about said second computer;

capturing at least an image of one or more users of said second computer, and determining at least a captured image characteristic of said one or more users, where said captured image characteristic comprises at least one of the group consisting of;

a number of said one or more users, a gender of said one or more users, and whether said one or more users are adults or children;

determining substantially contemporaneously with the viewing of the audio and video content on said first second computer or other device, based at least in part on said captured image characteristic of said user or users, based at least in part on said personalization data, and based at least in part on said attributes of said first media file relating to restrictions on the attributes of advertisements that can be associated with said first media file and whether to play back at least first advertisement and said second advertisement or whether to play back only said first advertisement;

conducting based on said advertisement auction information in said workflow file, an advertisement bid auction with a plurality of advertisers to provide said first or second advertisements prior to a time said first or second advertisements will be viewed;

based at least in part on monitoring with said first computer, said status of said playback of said first media file and based at least in part on said time information in said workflow file, defining when to send said second source indicator from said first computer to said second computer to direct playback of said second media file; and

playing back substantially all of said first media file between the starting and ending points of said first media file defined in said playback parameters in said workflow file, substantially all of said first advertisement, and at least a portion of said second media file between said starting and ending points of said second media file as defined in said playback parameters in said workflow file, such that playback of said first advertisement or said second advertisement any portion thereof may not be skipped by a viewer.

2. The method of claim 1 in which said plurality of media files are located on a plurality of servers.

3. The method of claim 1 in which said network is the Internet.

4. The method of claim 1 in which said second computer is a mobile device.

5. The method of claim 1 in which said second computer is a television.

6. The method of claim 1 in which said second computer is a personal computer.

7. The method of claim 1 in which said first advertisement comprises audio and video content.

8. The method of claim 1 in which said first advertisement comprises only video content.

9. The method of claim 1 in which said personalization data comprises metadata.

10. The method of claim 1 in which said location-related information comprises location data derived from a satellite-based global positioning system regarding said second computer.

11. A system that uses a workflow file on a first computer to determine playback of audio and video content on a second computer, wherein said audio and video content is combined with advertisements that are to be viewed by a user over a network on a said second computer or other device capable of playing such audio and video content, said system comprising:

a workflow file stored on a first computer comprising computer hardware, wherein said first computer is in communication with a network, the workflow file comprising at least a plurality of source identifiers for a plurality of media files, said workflow file further comprising a plurality of playback parameters associated with said playback, wherein said playback parameters are defined by a media aggregator and comprise;

at least starting points and ending points within portions of said plurality of media files, layering information, advertisement auction information, and time information defining when to send source indicators to a second computer;

a rule book stored in association with said workflow file that defines resolution of conflicts in said plurality of playback parameters wherein the firstu computer resolves conflicts in said plurality of playback parameters associated with said plurality of media files based on said rule book;

wherein at least a first source identifier in said workflow files references at least a first media file comprising both audio and video stored on at least a computer other than said first computer and said second computer, said first media file accessed over the network, wherein said first source identifier comprises at least a first uniform resource indicator corresponding to a location of said first media file on said network;

wherein at least a second source identifier in said workflow file references of at least a second media file comprising both audio and video stored on at least a computer other than said first computer and said second computer, said second media file accessed over the network, wherein said second source identifier comprises at least a second uniform resource indicator corresponding to the location of said second media file on said network;

wherein at least a third source identifier of at least a third media file comprising a first advertisement stored on at least a computer other than said first computer and said second computer, said third media file accessed over the network, wherein said third source identifier comprises at least a third uniform resource indicator corresponding to the location of said third media file on said network;

wherein at least a fourth source identifier of at least a fourth media file comprising a second advertisement stored on at least a computer other than said first computer and said second computer, said fourth media file accessed over the network, wherein the fourth source identifier comprises at least a fourth uniform resource indicator corresponding to the location of said fourth media file on said network;

an application executing on one or more computer processors, said application configured to evaluate attributes of at least said first media file relating to restrictions on attributes of advertisements that can be associated with said first media file;

wherein said application accesses personalization data stored on said second computer, said personalization data comprising each of at least a portion of the browsing and viewing history of said user of said second computer, information about paid content previously purchased or subscribed to by said user, location-related information about said second computer, the language preferences of said user, and information said second computer;

wherein said application is in communication with an image capture device, said image capture device configured to capture at least an image of one or more users of said second computer, and determine at least a captured image characteristic of said one or more users, where said captured image characteristic comprises at least one of the group consisting of;

a number of said one or more users, a gender of said one or more users, and whether said one or more users are adults or children;

wherein said application determines substantially contemporaneously with the viewing of the audio and video content on said second computer, based at least in part on said captured image characteristic of said user or users, based at least in part on said personalization data, and based at least in part on said attributes of said first media file relating to restrictions on the attributes of advertisements that can be associated with said first media file and whether to play back said at least first advertisement and said second advertisement or whether to play back only said first advertisement;

wherein the application conducts based on said advertisement auction information in said workflow file, an advertisement bid auction with a plurality of advertisers to provide said first or second advertisements prior to a time said first or second advertisements will be viewed;

based at least in part on monitoring with said first computer, said status of said playback of said first media file and based at least in part on said time information in said workflow file, defining when to send said second source indicator from said first computer to said second computer to direct playback of said second media file; and

wherein said application plays back substantially all of said first media file between the starting and ending points of said first media file defined in said playback parameters in said workflow file, substantially all of said first advertisement, and at least a portion of said second media file between the starting and ending points of said second media file as defined in said playback parameters in said workflow file, such that playback of said first advertisement or any portion thereof may not be skipped by a viewer.

12. The system of claim 11 in which said plurality of media files are located on a plurality of servers.

13. The system of claim 11 in which said network is the Internet.

14. The system of claim 11 in which said second computer is a mobile device.

15. The system of claim 11 in which said second computer is a television.

16. The system of claim 11 in which said second computer is a personal computer.

17. The system of claim 11 in which said first advertisement comprises audio and video content.

18. The system of claim 11 in which said first advertisement comprises only video content.

19. The system of claim 11 in which said personalization data comprises metadata.

20. The system of claim 11 in which said location-related information comprises location data derived from a satellite-based global positioning system regarding said second computer.