SYSTEMS AND METHODS FOR MATCHING AN ADVERTISEMENT TO A VIDEO

• US 20110251896A1
• Filed: 04/09/2010
• Published: 10/13/2011
• Est. Priority Date: 04/09/2010
• Status: Abandoned Application

• Current Assignee: Conversant, LLC (Publicis Groupe SA)
• Original Assignee: SET Media, Inc. (Alliance Data Systems Corporation)
• Inventors: Zandifar, Ali, Sullivan, Michael G., Impollonia, Robert P.
• Application Number:
  US12/757,276
• Publication Number:
  US 20110251896A1
• Time in Patent Office: Days
• US Class Current: 705/14.55
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 30/0257 User requested
• CPC Class Codes: G06Q 30/0275 Auctions
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: G11B 27/322 used signal is digitally coded
• CPC Class Codes: H04H 60/46 for recognising users' preferences
• CPC Class Codes: H04H 60/59 of video recognising characters or patterns in general G06F18/00, G06V20/00
• CPC Class Codes: H04H 60/74 using programme related information, e.g. title, composer or interpreter
• CPC Class Codes: H04N 21/26603 for automatically generating descriptors from content, e.g. when it is not made available by its provider, using content analysis techniques
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73

Abstract

Systems and methods for automatically matching in real-time an advertisement with a video desired to be viewed by a user are provided. A database is created that stores one or more attributes (e.g., visual metadata relating to objects, faces, scene classifications, pornography detection, scene segmentation, production quality, fingerprinting) associated with a plurality of videos. Supervised machine learning can be used to create signatures that uniquely identify particular attributes of interest, which can then be used to generate the attributes associated with the plurality of videos. When a user requests to view an on-line video having associated with it an advertisement, an advertisement can be selected for display with the video based on matching an advertiser'"'"'s requirements or campaign parameters with the stored attributes associated with the requested video, with the user'"'"'s information, or a combination thereof. The displayed advertisement can function as a hyperlink that allows a user to select to receive additional information about the advertisement. The performance or effectiveness of the selected advertisements can be measured and recorded.

Claims

1. A method for automatically matching in real-time at least one of a plurality of advertisements with a video desired to be viewed by a user, the method comprising:

maintaining a database that stores visual metadata associated with each of a plurality of videos;

storing advertiser requirements associated with each of the plurality of advertisements;

receiving in real-time information regarding the video desired to be viewed by the user;

processing the visual metadata stored in the database for the video desired to be viewed by the user with the advertiser requirements to determine which of the plurality of advertisements has requirements that meet the visual metadata of the video desired to be viewed by the user; and

selecting an advertisement from the plurality of advertisements based on the processing, wherein the advertisement has requirements that most closely meet the visual metadata of the video desired to be viewed by the user.

2. The method of claim 1 wherein the visual metadata associated with each of a plurality of videos comprises at least one of objects, faces, scene types, scene segmentations, pornography, production quality, and fingerprinting detected for each of the plurality of videos.

3. The method of claim 1 wherein the maintaining comprises, for each of the plurality of videos:

downloading the video from a publisher;

decoding and decompressing the video into a plurality of frames;

processing the plurality of frames to identify at least one of an object, a face, or a scene type;

generating visual metadata based on the processed plurality of frames; and

storing the generated visual metadata associated with the video in the database.

4. The method of claim 1 wherein the storing comprises storing at least one of:

the type of visual metadata from the plurality of videos with which each of the plurality of advertisements desires to be associated; and

a bid to place for each of the plurality of advertisements.

5. The method of claim 1 further comprising maintaining a second database that stores information about a plurality of users.

6. The method of claim 5 further comprising processing the information stored in the second database about the user with the advertiser requirements to determine which of the plurality of advertisements has requirements that meet the information about the user.

7. The method of claim 1 further comprising receiving a request from the user to view additional information about the advertisement.

8. The method of claim 1 further comprising maintaining a second database that stores information about the selected advertisement based on the video desired to be viewed by the user.

9. A system for automatically matching in real-time at least one of a plurality of advertisements with a video desired to be viewed by a user, the system comprising:

a first database that stores visual metadata associated with each of a plurality of videos;

a second database that stores the plurality of advertisements and advertiser requirements associated with each of the plurality of advertisements; and

a server computer coupled to the first database and the second database, and operative to;

receive in real-time information regarding the video desired to be viewed by the user,

process the visual metadata stored in the first database for the video desired to be viewed by the user with the advertiser requirements stored in the second database to determine which of the plurality of advertisements has requirements that meet the visual metadata of the video desired to be viewed by the user, and

select an advertisement from the plurality of advertisements stored in the second database based on the processing, wherein the advertisement has requirements that most closely meet the visual metadata of the video desired to be viewed by the user.

10. The system of claim 9 wherein the visual metadata associated with each of a plurality of videos comprises at least one of objects, faces, scene types, scene segmentations, pornography, production quality, and fingerprinting detected for each of the plurality of videos.

11. The system of claim 9 wherein the server computer is further operative to, for each of the plurality of videos:

download the video from a publisher;

decode and decompress the video into a plurality of frames;

process the plurality of frames to identify at least one of an object, a face, or a scene type;

generate visual metadata based on the processed plurality of frames; and

store the generated visual metadata associated with the video in the first database.

12. The system of claim 9 wherein the second database stores at least one of:

the type of visual metadata from the plurality of videos with which each of the plurality of advertisements desires to be associated; and

a bid to place for each of the plurality of advertisements.

13. The system of claim 9 further comprising a third database coupled to the server computer that stores information about a plurality of users.

14. The system of claim 13 wherein the server computer is further operative to process the information stored in the third database about the user with the advertiser requirements stored in the second database to determine which of the plurality of advertisements has requirements that meet the information about the user.

15. The system of claim 9 wherein the server computer is further operative to receive a request from the user to view additional information about the advertisement.

16. The system of claim 9 further comprising a third database coupled to the server computer that stores information about the selected advertisement based on the video desired to be viewed by the user.

17. A method for automatically matching in real-time at least one of a plurality of advertisements with a video desired to be viewed by a user, the method comprising:

processing each of a plurality of videos using at least one of object detection, face recognition, and scene classification to generate attributes associated with each of the plurality of videos;

maintaining a database that stores the attributes associated with each of the plurality of videos;

storing advertiser requirements associated with each of the plurality of advertisements;

receiving in real-time information regarding the video desired to be viewed by the user;

processing the attributes stored in the database for the video desired to be viewed by the user with the advertiser requirements to determine which of the plurality of advertisements have requirements that meet the attributes of the video desired to be viewed by the user; and

selecting an advertisement from the plurality of advertisements based on the processing, wherein the advertisement has requirements that most closely meet the attributes of the video desired to be viewed by the user.

18. The method of claim 17 further comprising processing each of the plurality of videos using at least one of scene segmentation, pornography detection, production quality, and fingerprinting to generate additional attributes associated with each of the plurality of videos.

19. The method of claim 17 wherein the maintaining comprises, for each of the plurality of videos:

downloading the video from a publisher;

decoding and decompressing the video into a plurality of frames;

processing the plurality of frames to identify at least one of an object, a face, or a scene type;

generating attributes based on the processed plurality of frames; and

storing the generated attributes associated with the video in the database.

20. The method of claim 17 wherein the storing comprises storing at least one of

the type of attributes from the plurality of videos with which each of the plurality of advertisements desires to be associated;

and

a bid to place for each of the plurality of advertisements.

21. The method of claim 17 further comprising maintaining a second database that stores information about a plurality of users.

22. The method of claim 21 further comprising processing the information stored in the second database about the user with the advertiser requirements to determine which of the plurality of advertisements has requirements that meet the information about the user.

23. The method of claim 17 further comprising receiving a request from the user to view additional information about the advertisement.

24. The method of claim 17 further comprising maintaining a second database that stores information about the selected advertisement based on the video desired to be viewed by the user.

25. A system for automatically matching in real-time at least one of a plurality of advertisements with a video desired to be viewed by a user, the system comprising:

a sever computer operative to process each of a plurality of videos using at least one of object detection, face recognition, and scene classification to generate attributes associated with each of the plurality of videos;

a first database that stores the attributes associated with each of the plurality of videos; and

a second database that stores the plurality of advertisements and advertiser requirements associated with each of the plurality of advertisements,

wherein the server computer is coupled to the first database and the second database, and is further operative to;

receive in real-time information regarding the video desired to be viewed by the user,

process the attributes stored in the first database for the video desired to be viewed by the user with the advertiser requirements stored in the second database to determine which of the plurality of advertisements have requirements that meet the attributes of the video desired to be viewed by the user, and

select an advertisement from the plurality of advertisements based on the processing, wherein the advertisement has requirements that most closely meet the attributes of the video desired to be viewed by the user.

26. The system of claim 25 wherein the server computer is further operative to processing each of the plurality of videos using at least one of scene segmentation, pornography detection, production quality, and fingerprinting to generate additional attributes associated with each of the plurality of videos.

27. The system of claim 25 wherein the server computer is further operative to, for each of the plurality of videos:

download the video from a publisher;

decode and decompress the video into a plurality of frames;

process the plurality of frames to identify at least one of an object, a face, or a scene type;

generate visual metadata based on the processed plurality of frames; and

store the generated visual metadata associated with the video in the first database.

28. The system of claim 25 wherein the second database stores at least one of:

the type of visual metadata from the plurality of videos with which each of the plurality of advertisements desires to be associated; and

a bid to place for each of the plurality of advertisements.

29. The system of claim 25 further comprising a third database coupled to the server computer that stores information about a plurality of users.

30. The system of claim 29 wherein the server computer is further operative to process the information stored in the third database about the user with the advertiser requirements stored in the second database to determine which of the plurality of advertisements has requirements that meet the information about the user.

31. The system of claim 25 wherein the server computer is further operative to receive a request from the user to view additional information about the advertisement.

32. The system of claim 25 further comprising a third database coupled to the server computer that stores information about the selected advertisement based on the video desired to be viewed by the user.

33. A method for automatically maintaining a database that stores attributes associated with each of a plurality of videos for use in matching in real-time at least one of a plurality of advertisements with a video desired to be viewed by a user, the method comprising:

selecting at least one of a plurality of videos;

processing the video to generate attributes associated with the video, wherein the processing further comprises downloading the video, decoding and decompressing the video into a plurality of frames, and processing data from at least one of the plurality of frames based on at least one of object detection, face recognition, and scene classification to generate the attributes associated with the video; and

storing the attributes associated with the video in the database, wherein upon receiving in real-time information regarding the video that is desired to be viewed by the user, the method further comprises processing the attributes stored in the database for the video with advertiser requirements associated with each of the plurality of advertisements to determine which of the plurality of advertisements have requirements that meet the attributes of the video desired to be viewed by the user.

34. The method of claim 33 wherein the processing data from at least one of the plurality of frames based on the object detection comprises:

identifying from the plurality of frames at least one object;

comparing the identified object to a library of known objects;

when the identified object matches a known object in the library of known objects, generating an attribute indicative of the known object that is associated with the video; and

storing the attribute indicative of the known object.

35. The method of claim 33 wherein the processing data from at least one of the plurality of frames based on the face recognition comprises:

identifying from the plurality of frames at least one face;

comparing the identified object to a library of known faces;

when the identified face matches a known face in the library of known face, generating an attribute indicative of the known face that is associated with the video; and

storing the attribute indicative of the known face.

36. The method of claim 33 wherein the processing data from at least one of the plurality of frames based on the scene classification comprises:

identifying from the plurality of frames at least one scene type;

comparing the identified scene type to a library of known scene types;

when the identified scene type matches a known scene type in the library of known scene types, generating an attribute indicative of the known scene type that is associated with the video; and

storing the attribute indicative of the known scene type.

37. The method of claim 33 wherein the processing further comprises processing data from at least one of the plurality of frames based on at least one of scene segmentation, pornography detection, production quality, and fingerprinting to generate additional attributes associated with the video.

38. The method of claim 33 wherein the storing comprises storing at least one of:

the type of attributes from the plurality of videos with which each of the plurality of advertisements desires to be associated; and

a bid to place for each of the plurality of advertisements.

39. The method of claim 33 further comprising maintaining a second database that stores information about a plurality of users.

40. The method of claim 39 further comprising processing the information stored in the second database about the user with the advertiser requirements to determine which of the plurality of advertisements has requirements that meet the information about the user.

41. The method of claim 33 further comprising receiving a request from the user to view additional information about the advertisement.

42. The method of claim 33 further comprising maintaining a second database that stores information about the selected advertisement based on the video desired to be viewed by the user.

43. A system for automatically maintaining a database that stores attributes associated with each of a plurality of videos for use in matching in real-time at least one of a plurality of advertisements with a video desired to be viewed by a user, the system comprising:

a database; and

a server computer coupled to the database and operative to;

select at least one of a plurality of videos,

process the video to generate attributes associated with the video, which comprises downloading the video, decoding and decompressing the video into a plurality of frames, and processing data from at least one of the plurality of frames based on at least one of object detection, face recognition, and scene classification to generate the attributes associated with the video, and

store the attributes associated with the video in the database, wherein upon receiving in real-time information regarding the video that is desired to be viewed by the user, the server computer is further operative to process the attributes stored in the database for the video with advertiser requirements associated with each of the plurality of advertisements to determine which of the plurality of advertisements have requirements that meet the attributes of the video desired to be viewed by the user.

44. The system of claim 43 wherein the server computer is further operative to, for object detection:

identify from the plurality of frames at least one object;

compare the identified object to a library of known objects;

when the identified object matches a known object in the library of known objects, generate an attribute indicative of the known object that is associated with the video; and

store the attribute indicative of the known object.

45. The system of claim 43 wherein the server computer is further operative to, for face recognition:

identify from the plurality of frames at least one face;

compare the identified object to a library of known faces;

when the identified face matches a known face in the library of known face, generate an attribute indicative of the known face that is associated with the video; and

store the attribute indicative of the known face.

46. The system of claim 43 wherein the server computer is further operative to, for scene classification:

identify from the plurality of frames at least one scene type;

compare the identified scene type to a library of known scene types;

when the identified scene type matches a known scene type in the library of known scene types, generate an attribute indicative of the known scene type that is associated with the video; and

store the attribute indicative of the known scene type.

47. The system of claim 43 wherein the server computer is further operative to process data from at least one of the plurality of frames based on at least one of scene segmentation, pornography detection, production quality, and fingerprinting to generate additional attributes associated with the video.

48. The system of claim 43 wherein the server computer is further operative to store at least one of:

the type of attributes from the plurality of videos with which each of the plurality of advertisements desires to be associated; and

a bid to place for each of the plurality of advertisements.

49. The system of claim 43 further comprising a second database that stores information about a plurality of users.

50. The system of claim 49 wherein the server computer is further operative to process the information stored in the second database about the user with the advertiser requirements to determine which of the plurality of advertisements has requirements that meet the information about the user.

51. The system of claim 43 wherein the server computer is further operative to receive a request from the user to view additional information about the advertisement.

52. The system of claim 43 further comprising a second database that stores information about the selected advertisement based on the video desired to be viewed by the user.