Intelligent augmentation of media content

• US 9,128,909 B2
• Filed: 05/05/2014
• Issued: 09/08/2015
• Est. Priority Date: 11/09/2007
• Status: Active Grant

• Current Assignee: Vibrant Media Incorporated
• Original Assignee: Vibrant Media Incorporated
• Inventors: Brindley, Richard
• Primary Examiner(s): Woo, Isaac M
• Application Number:
  US14/269,839
• Publication Number:
  US 20140245193A1
• Time in Patent Office: 491 Days
• Field of Search: 707600-899
• US Class Current: 1/1
• CPC Class Codes: G06F 16/2457 with adaptation to user needs
• CPC Class Codes: G06F 16/48 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/958 Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: G06F 40/117 Tagging; Marking up details of markup languages G06F40/143; Designating a block; Setting of attributes style sheets, e.g. eXtensible Stylesheet Language Transformation [XSLT], G06F40/154
• CPC Class Codes: G06Q 30/0256 User search

Abstract

Embodiments of the present disclosure include methods (and corresponding systems and computer program products) that augment visual elements in documents with rich media content and provide the rich media content based on user interaction with the augmented visual elements in the documents. The disclosed embodiments analyze a document for qualified visual elements. The disclosed embodiments determine keywords associated with the visual element, generate an association of the visual element and the keywords, and embed the association in a corresponding augmented document. When a user reviews the augmented document in a client system and moves a pointer over the augmented visual element, a piece of rich media content related to the keywords are transmitted to the client system to be displayed as an overlay in close proximity to the visual element where the mouse-over occurred.

Claims

1. A method for augmenting web pages with search related content, the method comprising:

(a) identifying, by code executing on a client, for an image on a web page being displayed on the client, one or more keywords from the web page;

(b) determining, by a server, a context and a subject for the image from the one or more keywords;

(c) generating, by the server, an augmentation tag for the image based on the context and the subject;

(d) receiving, by the server, a request from the augmentation tag responsive to a mouse-over of the image for which the augmentation tag is generated; and

(e) transmitting, by the server to the client responsive to the request, an overlay for augmenting the image on the web page, the server selecting the overlay based on the context and the subject.

2. The method of claim 1, wherein (a) further comprises identifying, by the server, the one or more keywords from text on the web page.

3. The method of claim 1, wherein (a) further comprises identifying, by the code executing on the client, the one or more keywords from text on the web page.

4. The method of claim 1, wherein (a) further comprises identifying the image as a qualified image that meets a predefined width and height criteria.

5. The method of claim 1, wherein (b) further comprises determining at least one of the context or subject matter from a content provider of the web page.

6. The method of claim 1, wherein (b) further comprises determining the context by analyzing content of the web page.

7. The method of claim 1, wherein (b) further comprises determining the subject by analyzing one or more tags associated with the image.

8. The method of claim 1, wherein (b) further comprises determining the subject by analyzing one or more nearby text nodes.

9. The method of claim 1, wherein (b) further comprises augmenting the image on the web page by providing the augmentation tag as an image tag associated with the image.

10. The method of claim 1, wherein (c) further comprising generating, by the server, the augmentation tag to include one or more of the following:

one or more subject keywords, one or more context keywords and an image identifier.

11. The method of claim 1, wherein (c) further comprising generating, by the server, the augmentation tag to comprise information about rich media content to be associated with the image and whether the image is clickable.

12. The method of claim 1, wherein (d) further comprises receiving, by the server, from the request of the augmentation tag, an identifier of the image.

13. The method of claim 12, further comprising retrieving, by the server, stored context and subject information of the image.

14. The method of claim 13, further comprising searching an advertising database for one of a related advertisement or rich media content.

15. The method of claim 14, further comprising transmitting one of a related advertisement or a rich media content as the overlay to the client.

16. The method of claim 1, further comprising displaying, by the client responsive to the detection of the mouse-over, the overlay.

17. A system for augmenting web pages with search related content, the system comprising:

circuitry of a server configured to implement an augmentation module, the augmentation module configured to;

receive, from code executing on a client, one or more keywords for an image on a web page being displayed on the client;

determine a context and a subject for the image from the one or more keywords;

generate an augmentation tag for the image based on the context and the subject;

receive a request from the augmentation tag responsive to a mouse-over of the image for which the augmentation tag is generated; and

transmit, to the client responsive to the request, an overlay for augmenting the image on the web page, the server selecting the overlay based on the context and the subject.

18. The system of claim 17, wherein the augmentation module determines at least one of the context or subject matter from a content provider of the web page.

19. The system of claim 17, wherein the augmentation module determines the context by analyzing content of the web page.

20. The system of claim 17, wherein the augmentation module determines the subject by analyzing one or more tags associated with the image.

21. The system of claim 17, wherein the augmentation module determines the subject by analyzing one or more nearby text nodes.

22. The system of claim 17, wherein the augmentation module augments the image on the web page by providing the augmentation tag as an image tag associated with the image.

23. The system of claim 17, wherein the augmentation module generates the augmentation tag to include one or more of the following:

one or more subject keywords, one or more context keywords and an image identifier.

24. The system of claim 17, wherein the augmentation module generates the augmentation tag to include information about rich media content to be associated with the image and whether the image is clickable.

25. The system of claim 17, wherein the augmentation module receives from the request of the augmentation tag, an identifier of the image.

26. The method of claim 17, wherein the augmentation module searches an advertising database for one of a related advertisement or rich media content as the overlay.