Media enrichment system and method

• US 9,349,129 B2
• Filed: 10/17/2011
• Issued: 05/24/2016
• Est. Priority Date: 10/17/2011
• Status: Active Grant

• Current Assignee: Yahoo AD Tech LLC
• Original Assignee: Yahoo! Inc. (Apollo Global Management, Inc.)
• Inventors: Zwol, Roelof van, Pueyo, Lluis Garcia, Kennedy, Lyndon, Dayal, Yash, Muralidharan, Mridul, Gulik, Thomas, Kasturi, Tejaswi
• Primary Examiner(s): Fan, Hua
• Assistant Examiner(s): Abedin, Normin
• Application Number:
  US13/274,812
• Publication Number:
  US 20130097285A1
• Time in Patent Office: 1,681 Days
• Field of Search: 709/219, 709/220, 709/203, 709/204, 709/206
• US Class Current: 1/1
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 30/0255 based on user history
• CPC Class Codes: G06Q 30/0261 based on user location
• CPC Class Codes: G06Q 30/0269 based on user profile or attribute
• CPC Class Codes: G06Q 50/01 Social networking
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/306 User profiles
• CPC Class Codes: H04L 67/52 specially adapted for the location of the user terminal
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34

Abstract

Disclosed herein are aspects associated with contextual, or related, media enrichment presentation item of a media object served via the internet. A request to annotate a media object in connection with the media object'"'"'s presentation is received, and a media object identifier and a profile identifier are obtained. The media object'"'"'s information is retrieved using the media object identifier, and a profile is retrieved using the profile identifier. A response including one or more references to one or more media enrichment presentation items is transmitted, each reference to a media enrichment presentation item comprising information for use in retrieving the media enrichment presentation item for presentation in connection with presentation of the media object.

Claims

1. A method comprising:

transmitting, via at least one processing unit, embedded code in connection with a media object to be presented in connection with a web page, the embedded code to generate a request to enrich the media object'"'"'s presentation;

receiving, via the at least one processing unit, the request to enrich the media object'"'"'s presentation, the request comprising a media object identifier identifying the media object and a profile identifier identifying a media enrichment profile that identifies a number of content items to be presented as media enrichment presentation items to enrich the media object'"'"'s presentation and specifies a manner of presentation for each of the one or more media enrichment presentation items at a user computer, the number of content items identified by the media enrichment profile comprising at least one advertisement;

retrieving, via the at least one processing unit, the media object'"'"'s information using the media object identifier;

retrieving, via the at least one processing unit and from a profile store, the media enrichment profile using the profile identifier;

retrieving, via the at least one processing unit and from the media enrichment profile, information identifying each type of media enrichment presentation item to be presented in connection with the media object'"'"'s presentation and a number of each type of media enrichment presentation item;

accessing, via the at least one processing unit, one or more media enrichment presentation item sources and identifying a reference for each of the one or more media enrichment presentation items in accordance with the number of each type of media enrichment presentation item indicated by the media enrichment profile; and

transmitting, via at least one processing unit, a response to the request, the response including a reference to each media enrichment presentation item, each reference to a media enrichment presentation item comprising information for use in retrieving the media enrichment presentation item for presentation in connection with the media object'"'"'s presentation.

2. The method of claim 1, accessing one or more media enrichment presentation item stores further comprising:

accessing, via the at least one processing unit, at least one advertisement source where the media enrichment profile indicates one or more advertisements for presentation in connection with the media object'"'"'s presentation;

accessing, via the at least one processing unit, at least one product offer source where the media enrichment profile indicates one or more product offers for presentation in connection with the media object'"'"'s presentation; and

accessing, via the at least one processing unit, at least one contextual information source where the media enrichment profile indicates one or more contextual information boxes for presentation in connection with the media object'"'"'s presentation.

3. The method of claim 1, wherein the embedded code is embedded in the web page.

4. The method of claim 1, wherein the embedded code is embedded in the media object.

5. The method of claim 1, the retrieving the media object'"'"'s information using the media object identifier further comprising:

accessing, via the at least one processing unit, a media object repository using the media object identifier to retrieve the media object'"'"'s information;

invoking, via the at least one processing unit, at least one automated media object enrichment tool to collect the media object'"'"'s information where the media object'"'"'s information is not found in the media object repository.

6. The method of claim 5, the method further comprising;

if the media object'"'"'s information is not found in the media object repository, providing a user interface for human editors to validate the media object'"'"'s information collected from the at least one automated media object enrichment tool and to input at least a portion of the media object'"'"'s information.

7. The method of claim 5, the at least one automated media object enrichment tool comprising a crowd sourcing internet market place to engage a plurality of internet users to identify at least a portion of the media object'"'"'s information.

8. The method of claim 5, the invoking at least one automated media object enrichment tool further comprising:

accessing, via the at least one processing unit, at least one metadata source to retrieve the media object'"'"'s metadata, the metadata including a title, description and category; and

accessing, via the at least one processing unit, an advertisement classifier to determine at least one advertising category using at least a portion of the retrieved metadata, the media object'"'"'s information comprising the at least one advertising category.

9. The method of claim 5, the invoking at least one automated media object enrichment tool further comprising:

invoking, via the at least one processing unit, a visual analyzer to identify at least one object in the media object, the media object'"'"'s information comprising information identifying the at least one object in the media object, the information identifying the at least one object for use in identifying at least one product offer for presentation in connection with the media object'"'"'s presentation.

10. The method of claim 5, the invoking at least one automated media object enrichment tool further comprising:

invoking, via the at least one processing unit, a visual analyzer to identify at least one object in the media object, the media object'"'"'s information comprising information for the at least one object contained in the media object, the information for the at least one object for use in identifying a contextual information item for presentation in connection with the media object'"'"'s presentation.

11. A system comprising:

at least one computing device comprising one or more processors and a storage medium for tangibly storing thereon program logic for execution by the one or more processors, the stored program logic comprising;

transmitting logic executed by the one or more processors for transmitting embedded code in connection with a media object to be presented in connection with a web page, the embedded code to generate a request to enrich the media object in connection with the media object'"'"'s presentation;

receiving logic executed by the one or more processors for receiving the request to enrich the media object, the request comprising a media object identifier identifying the media object and a profile identifier identifying a media enrichment profile media enrichment profile that identifies a number of content items to be presented as media enrichment presentation items to enrich the media object'"'"'s presentation and specifies a manner of presentation for each of the one or more media enrichment presentation items at a user computer, the number of content items identified by the media enrichment profile comprising at least one advertisement;

retrieving logic executed by the one or more processors for retrieving the media object'"'"'s information using the media object identifier;

retrieving logic executed by the one or more processors for retrieving, from a profile store, the media enrichment profile using the profile identifier;

retrieving logic executed by the processor for retrieving, from the media enrichment profile, information identifying each type of media enrichment presentation item to be presented in connection with the media object'"'"'s presentation and a number of each type of media enrichment presentation item;

accessing logic executed by the processor for accessing one or more media enrichment presentation item sources and identifying a reference for each of the one or more media enrichment presentation items in accordance with the number of each type of media enrichment presentation item indicated by the media enrichment profile; and

transmitting logic executed by the one or more processors for transmitting a response to the request, the response including a reference to each media enrichment presentation item, each reference to a media enrichment presentation item comprising information for use in retrieving the media enrichment presentation item for presentation in connection with the media object'"'"'s presentation.

12. The system of claim 11, the accessing logic executed by the one or more processors for accessing one or more media enrichment presentation item stores further comprising:

accessing logic executed by the one or more processors for accessing at least one advertisement source where the media enrichment profile indicates one or more advertisements for presentation in connection with the media object'"'"'s presentation;

accessing logic executed by the one or more processors for accessing at least one product offer source where the media enrichment profile indicates one or more product offers for presentation in connection with the media object'"'"'s presentation; and

accessing logic executed by the one or more processors for accessing at least one contextual information source where the media enrichment profile indicates one or more contextual information boxes for presentation in connection with the media object'"'"'s presentation.

13. The system of claim 11, wherein the embedded code is embedded in the web page.

14. The system of claim 11, wherein the embedded code is embedded in the media object.

15. The system of claim 11, the retrieving logic for execution by the one or more processors for retrieving the media object'"'"'s information using the media object identifier further comprising:

accessing logic executed by the one or more processors for accessing a media object repository using the media object identifier to retrieve the media object'"'"'s information;

invoking logic executed by the one or more processors for invoking at least one automated media object enrichment tool to collect the media object'"'"'s information where the media object'"'"'s information is not found in the media object repository.

16. The system of claim 15, the program logic further comprising:

providing logic executed by the one or more processors for providing, if the media object'"'"'s information is not found in the media object repository, a user interface for human editors to validate the media object'"'"'s information collected from the at least one automated media object enrichment tool and to input at least a portion of the media object'"'"'s information.

17. The system of claim 15, the at least one automated media object enrichment tool comprising a crowd sourcing internet market place to engage a plurality of internet users to identify at least a portion of the media object'"'"'s information.

18. The system of claim 15, the invoking logic executed by the one or more processors for invoking at least one automated media object enrichment tool further comprising:

accessing logic for execution by the one or more processors for accessing at least one metadata source to retrieve the media object'"'"'s metadata, the metadata including a title, description and category; and

accessing logic for execution by the one or more processors for accessing an advertisement classifier to determine at least one advertising category using at least a portion of the retrieved metadata, the media object'"'"'s information comprising the at least one advertising category.

19. The system of claim 15, the invoking logic for execution by the one or more processors for invoking at least one automated media object enrichment tool further comprising:

invoking logic for execution by the one or more processors for invoking a visual analyzer to identify at least one object in the media object, the media object'"'"'s information comprises information identifying the at least one object in the media object, the information identifying the at least one object for use in identifying at least one product offer for presentation in connection with the media object'"'"'s presentation.

20. The system of claim 15, the invoking logic executed by the one or more processors for invoking at least one automated media object enrichment tool further comprising:

invoking logic executed by the one or more processors for invoking a visual analyzer to identify at least one object in the media object, the media object'"'"'s information comprising information for the at least one object contained in the media object, the information for the at least one object for use in identifying a contextual information item for presentation in connection with the media object'"'"'s presentation.

21. A computer readable non-transitory storage medium for tangibly storing thereon computer readable instructions that when executed cause at least one processor to:

transmit embedded code in connection with a media object to be presented in connection with a web page, the embedded code to generate a request to enrich the media object'"'"'s presentation;

receive the request to enrich the media object'"'"'s presentation, the request comprising a media object identifier identifying the media object and a profile identifier identifying a media enrichment profile media enrichment profile that identifies a number of content items to be presented as media enrichment presentation items to enrich the media object'"'"'s presentation and specifies a manner of presentation for each of the one or more media enrichment presentation items at a user computer, the number of content items identified by the media enrichment profile comprising at least one advertisement;

retrieve the media object'"'"'s information using the media object identifier;

retrieve, from a profile store, the media enrichment profile using the profile identifier;

retrieve, from the media enrichment profile, information identifying each type of media enrichment presentation item to be presented in connection with the media object'"'"'s presentation and a number of each type of media enrichment presentation item;

access one or more media enrichment presentation item sources and identifying a reference for each of the one or more media enrichment presentation items in accordance with the number of each type of media enrichment presentation item indicated by the media enrichment profile; and

transmit a response to the request, the response including a reference to each media enrichment presentation item, each reference to a media enrichment presentation item comprising information for use in retrieving the media enrichment presentation item for presentation in connection with the media object'"'"'s presentation.

22. The medium of claim 21, the computer readable instructions that when executed further cause at least one processor to access one or more media enrichment presentation item stores further comprising instructions to:

access at least one advertisement source where the media enrichment profile indicates one or more advertisements for presentation in connection with the media object'"'"'s presentation;

access at least one product offer source where the media enrichment profile indicates one or more product offers for presentation in connection with the media object'"'"'s presentation; and

access at least one contextual information source where the media enrichment profile indicates one or more contextual information boxes for presentation in connection with the media object'"'"'s presentation.

23. The medium of claim 21, wherein the embedded code is embedded in the web page.

24. The medium of claim 21, wherein the embedded code is embedded in the media object.

25. The medium of claim 21, the computer readable instructions that when executed cause at least one processor to retrieve the media object'"'"'s information using the media object identifier further comprising instructions to:

access a media object repository using the media object identifier to retrieve the media object'"'"'s information;

invoke at least one automated media object enrichment tool to collect the media object'"'"'s information where the media object'"'"'s information is not found in the media object repository.

26. The medium of claim 25, the computer readable instructions further comprising instructions that when executed cause at least one processor to:

provide, if the media object'"'"'s information is not found in the media object repository, a user interface for human editors to validate the media object'"'"'s information collected from the at least one automated media object enrichment tool and to input at least a portion of the media object'"'"'s information.

27. The medium of claim 25, the at least one automated media object enrichment tool comprising a crowd sourcing internet market place to engage a plurality of internet users to identify at least a portion of the media object'"'"'s information.

28. The medium of claim 25, the computer readable instructions to cause at least one processor to invoke at least one automated media object enrichment tool further comprising instructions to:

access at least one metadata source to retrieve the media object'"'"'s metadata, the metadata including a title, description and category; and

access an advertisement classifier to determine at least one advertising category using at least a portion of the retrieved metadata, the media object'"'"'s information comprising the at least one advertising category.

29. The medium of claim 25, the computer readable instructions to cause at least one processor to invoke at least one automated media object enrichment tool further comprising instructions to:

invoke a visual analyzer to identify at least one object in the media object, the media object'"'"'s information comprising information identifying the at least one object in the media object, the information identifying the at least one object for use in identifying at least one product offer for presentation in connection with the media object'"'"'s presentation.

30. The medium of claim 25, computer readable instructions to cause at least one processor to invoke at least one automated media object enrichment tool further comprising instructions to:

invoke a visual analyzer to identify at least one object in the media object, the media object'"'"'s information comprising information for the at least one object contained in the media object, the information for the at least one object for use in identifying a contextual information item for presentation in connection with the media object'"'"'s presentation.