BRAND DETECTION IN AUDIOVISUAL MEDIA

• US 20140007155A1
• Filed: 06/28/2012
• Published: 01/02/2014
• Est. Priority Date: 06/28/2012
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Vemparala, Praveen Kumar, Prologo, Richard D., de la Garza, Enrique, Sathe, Saleel, Lucero, Michael G., White, Jason S., Alles, David S., Musante, Virginia M., Sharon, Eitan
• Granted Patent: US 8,645,994 B2
• Time in Patent Office: Days
• US Class Current: 725/32
• CPC Class Codes: G06Q 30/0251 Targeted advertisements
• CPC Class Codes: G06V 2201/09 Recognition of logos
• CPC Class Codes: H04N 21/26603 for automatically generating descriptors from content, e.g. when it is not made available by its provider, using content analysis techniques
• CPC Class Codes: H04N 21/2668 Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/442 Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk arrangements for monitoring broadcast services or broadcast-related services H04H60/29; arrangements for identifying or recognising characteristics with a direct linkage to broadcast information H04H60/35; monitoring of user activities for profile generation for accessing a video database G06F16/739; monitoring in wireless networks H04W24/00
• CPC Class Codes: H04N 21/4532 involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/4668 for recommending content, e.g. movies
• CPC Class Codes: H04N 21/4826 using recommendation lists, e.g. of programs or channels sorted out according to their score
• CPC Class Codes: H04N 21/80 Generation or processing of content or additional data by content creator independently of the distribution process; Content per se arrangements for generating broadcast information H04H60/02
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/8358 involving watermark protecting executable software by watermarking G06F21/16; image watermarking in general G06T1/0021; watermarks inserted in still images for transmission purposes H04N1/32144; inserting watermarks during video coding H04N19/467
• CPC Class Codes: H04N 21/8405 represented by keywords

Abstract

This document describes techniques and apparatuses enabling brand detection in audiovisual media. The techniques detect a brand exposed within audiovisual media, such as a name or logo for a product or service, and based on this brand, present a brand advertisement or enable selection of an interactive experience that is associated with the brand. By so doing, marketers enable viewers to quickly and easily learn more about the product or service.

Claims

1. A computer-implemented method comprising:

detecting a brand within an audiovisual media that has or is going to be broadcast, the detecting comprising;

recognizing an audio or visual aspect within the audiovisual media; and

identifying the brand from one or more brands by comparing the audio or visual aspect to audio or visual fingerprints associated with the one or more brands; and

presenting, on a display in which the audiovisual media is being presented, an advertisement associated with the brand or an indication of a selectable interactive experience associated with the brand.

2. A computer-implemented method as described in claim 1, wherein detecting the brand within the audiovisual media is performed in real-time, at a computing device associated with the display, and immediately after receiving the audiovisual media broadcast from a remote entity and at the computing device.

3. A computer-implemented method as described in claim 1, wherein detecting the brand within the audiovisual media is performed at an entity remote from the display and prior to the audiovisual media being broadcast, and wherein presenting the advertisement or the indication broadcasts the advertisement or the indication to a computing device associated with the display.

4. A computer-implemented method as described in claim 1, wherein the audiovisual media is broadcast through radio, satellite, or wired cable.

5. A computer-implemented method as described in claim 1, wherein the brand is a symbol, logo, trademark, or jingle associated with a product or service.

6. A computer-implemented method as described in claim 1, wherein recognizing the audio or visual aspect recognizes a person using facial recognition and presenting the advertisement or the indication presents the advertisement associated with the person or, responsive to selection of the indication, presents the selectable interactive experience associated with the person.

7. A computer-implemented method as described in claim 1, wherein detecting the brand uses voice-recognition to recognize the audio aspect within the audiovisual media.

8. A computer-implemented method as described in claim 1, wherein detecting the brand includes performing object recognition to recognize the visual aspect within the audiovisual media.

9. A computer-implemented method as described in claim 8, wherein performing object recognition is performed over multiple frames in the audiovisual media.

10. A computer-implemented method as described in claim 8, wherein performing the object recognition:

determines that some visual aspects recognized in the audiovisual media have a low probability of being identified as one the visual fingerprints; and

forgoes comparing the low-probability visual aspects.

11. A computer-implemented method as described in claim 1, further comprising determining that the brand is within an advertisement associated with the brand and wherein presenting the advertisement or the indication presents the indication responsive to determining that the brand is within the advertisement associated with the brand.

12. A computer-implemented method as described in claim 1, wherein presenting the advertisement associated with the brand or the indication presents the indication and further comprising:

receiving selection of the selectable interactive experience; and

responsive to receiving the selection, presenting an interactive experience associated with the brand.

13. A computer-implemented method as described in claim 1, wherein the brand is determined to be within an advertisement associated with the brand and further comprising storing the visual fingerprint associated with the advertisement effective to more-quickly determine the brand when receiving the advertisement.

14. A computer-implemented method comprising:

receiving an advertisement that is within an audiovisual media program;

detecting an audio or visual fingerprint in the advertisement, the audio or visual fingerprint based on a brand detected within a previous iteration of the advertisement;

presenting, on a display in which the audiovisual media is being presented, an indication of a selectable interactive experience based on the audio or visual fingerprint associated with the brand;

receiving selection of the selectable interactive experience; and

presenting the interactive experience.

15. A computer-implemented method as described in claim 14, wherein the advertisement is received via streaming or from stored content.

16. A computer-implemented method as described in claim 14, wherein detecting the audio or visual fingerprint is performed by comparing audio or visual aspects of the advertisement with a database of audio and visual fingerprints, the fingerprints associated with brands and indicating associated interactive experiences.

17. A computer-implemented method as described in claim 14, wherein presenting the interactive experience pauses the audiovisual media and, when the interactive experience is complete, restarts the audiovisual media at or prior to a point at which the audiovisual media was paused.

18. A computer-implemented method comprising:

detecting a brand within an audiovisual media program using voice or object recognition of audio or visual aspects in the audiovisual media, the detecting including identifying the brand from one or more brands by comparing the audio or visual aspect to audio or visual fingerprints associated with the one or more brands;

causing presentation, at a point of the audiovisual media program allocated for presentation of advertisements, of an advertisement associated with the brand and an indication that an interactive experience associated with the brand can be selected; and

responsive to selection of the interactive experience, causing presentation of the interactive experience associated with the brand.

19. A computer-implemented method as described in claim 18, wherein detecting the brand is performed at a computing device associated with a display and causing presentation presents the advertisement and the indication on the display associated with the computing device.

20. A computer-implemented method as described in claim 18, wherein detecting the brand is performed at a remote computing device remote from a display on which the audiovisual media program is caused to be presented and wherein causing presentation broadcasts the advertisement within a broadcast of the audiovisual media program.