Embedding content of personal media in a portion of a frame of streaming media indicated by a frame identifier

• US 9,219,945 B1
• Filed: 06/16/2011
• Issued: 12/22/2015
• Est. Priority Date: 06/16/2011
• Status: Active Grant

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Velummylum, Piragash, Olson, Johanna S., Smith, Korwin J., Wood, James H.
• Primary Examiner(s): Murray, Daniel C
• Application Number:
  US13/161,774
• Time in Patent Office: 1,650 Days
• Field of Search: 709/217, 709/225, 725/32, 725/34
• US Class Current: 1/1
• CPC Class Codes: G11B 27/036 Insert-editing
• CPC Class Codes: H04H 20/10 Arrangements for replacing or switching information during the broadcast or the distribution
• CPC Class Codes: H04H 60/20 on secondary editing information
• CPC Class Codes: H04H 60/47 for recognising genres
• CPC Class Codes: H04N 21/23412 for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/23424 involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/2668 Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/458 Scheduling content for creating a personalised stream, e.g. by combining a locally stored advertisement with an incoming stream; Updating operations, e.g. for OS modules ; time-related management operations arrangements for replacing or switching information during the broadcast or during the distribution H04H20/10
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/472 End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content end-user interfaces for retrieving video data from a database G06F16/739; network services for supporting unicast streaming H04L65/612
• CPC Class Codes: H04N 21/6581 Reference data, e.g. a movie identifier for ordering a movie or a product identifier in a home shopping application
• CPC Class Codes: H04N 21/8126 involving additional data, e.g. news, sports, stocks, weather forecasts
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73

Abstract

Disclosed are various embodiments for generating personalized streaming media based on a streaming media received from a broadcast source. In one embodiment, a media service receives a request to generate the personalized streaming media from a client. In response to the request, the media service application determines the content of the streaming media and identifies files in a file system of a user that include content related to the streaming media. Upon identifying the related files, the media service application embeds the content of the related files in a relevant portion of the streaming media to generate the personalized streaming media. The media service application then transmits the personalized streaming media to the client.

Claims

1. A non-transitory computer-readable medium embodying a program executable in a computing device, the program comprising:

code that receives a request from a requesting service to generate personalized streaming media based on content of streaming media broadcast from a broadcast source, wherein the streaming media comprises a plurality of frames, a frame identifier that specifies a frame for which content can be embedded, and a media type indicator that designates a type of media file that is eligible to be embedded within the frame indicated by the frame identifier;

code that determines media content information of the streaming media, the media content information comprising at least one of a media name of the streaming media, a media summary of a subject matter of the streaming media, an audio transcription of the streaming media, or a plurality of frame descriptions for the plurality of frames of the streaming media;

code that identifies a plurality of related files in at least one file system of a user that are related to the media content information;

code that embeds the content of the plurality of related files in a relevant portion of the streaming media to generate the personalized streaming media, wherein one or more pieces of content for the plurality of related files are embedded in a portion of the frame of the streaming media indicated by the frame identifier and being of a same type of media file designated by the media type indicator for the frame indicated by the frame identifier with a remaining portion of the frame containing native content of the streaming media, wherein the embedded content of the plurality of related files is renderable for presentation as part of the personalized streaming media; and

code that transmits the personalized streaming media having the embedded content to the requesting service.

2. The non-transitory computer-readable medium of claim 1, wherein the media content information is determined based at least in part from metadata encoded in a header of the streaming media.

3. The non-transitory computer-readable medium of claim 1, wherein the at least one file system is accessible through a network page and is associated with a file service account of the user on a client.

4. A system, comprising:

at least one computing device; and

a media service executable in the at least one computing device, the media service comprising;

logic that obtains media content information associated with a portion of streaming media in response to a request from a client to consume the streaming media, wherein the streaming media comprises a plurality of frames, a frame identifier that specifies a frame for which content can be embedded, and a media type indicator that designates a type of media file that is eligible to be embedded within the frame indicated by the frame identifier;

logic that identifies a plurality of files in a file system that are related to the media content information; and

logic that generates personalized streaming media by including content of at least one of the plurality of files in the frame of the streaming media indicated by the frame identifier and being of a same type of media file designated by the media type indicator for the frame indicated by the frame identifier, wherein the content of the at least one of the plurality of files is embedded in a portion of the frame of the streaming media with a remaining portion of the frame containing native content of the streaming media, wherein the embedded content of the at least one of the plurality of files is renderable for presentation as part of the personalized streaming media.

5. The system of claim 4, further comprising logic that stores the media content information in a data store accessible to the at least one computing device.

6. The system of claim 4, further comprising logic that stores identifying information of the plurality of files in a data store accessible to the at least one computing device.

7. The system of claim 4, wherein consuming the streaming media comprises at least one of viewing the streaming media, recording the streaming media, purchasing the streaming media, or renting the streaming media.

8. The system of claim 4, wherein the media content information comprises at least one of a media name of the streaming media, a media summary of a subject matter of the streaming media, an audio transcription of the streaming media, or a plurality of frame descriptions for a plurality of frames of the streaming media.

9. The system of claim 4, wherein the media content information is included in a metadata associated with the streaming media.

10. The system of claim 4, further comprising logic that provides the personalized streaming media to the client.

11. The system of claim 4, wherein the file system is accessible through a network page.

12. The system of claim 4, wherein the file system is associated with a file service account of a user on the client.

13. A method, comprising:

obtaining media content information associated with a portion of streaming media in response to a request from a client to consume the streaming media;

obtaining a plurality of files in a file system that are related to the media content information;

obtaining a frame identifier that specifies a frame of the streaming media for which content can be embedded, and a media type indicator that designates a type of media file that is eligible to be embedded within the frame indicated by the frame identifier; and

generating personalized streaming media by including content of at least one of the plurality of files in the frame of the streaming media indicated by the frame identifier and being of a same type of media file designated by the media type indicator for the frame, wherein one or more pieces of content for the plurality of files are embedded in a portion of the frame of the streaming media with a remaining portion of the frame containing native content of the streaming media, wherein the embedded one or more pieces of content for the plurality of files are renderable for presentation as part of the personalized streaming media.

14. The method of claim 13, wherein the media content information comprises at least one of a media name of the streaming media, a media summary of a subject matter of the streaming media, an audio transcription of the streaming media, or a plurality of frame descriptions a plurality of frames of the streaming media.

15. The method of claim 13, further comprising transmitting the personalized streaming media having the embedded content to the client.

16. The method of claim 13, further comprising accessing the file system through a network page, wherein the file system is associated with a file service account of a user on the client.

17. The method of claim 13, wherein the streaming media comprises a plurality of frames.

18. The method of claim 13, wherein the media content information comprises a closed-caption portion of the streaming media.

19. The method of claim 13, wherein the plurality of files include an audio file related to the media content information, the method further comprising overlaying the audio file as an audio portion of the streaming media.