CONTEXTUAL QUERIES FOR AUGMENTING VIDEO DISPLAY

• US 20140304753A1
• Filed: 04/05/2013
• Published: 10/09/2014
• Est. Priority Date: 04/05/2013
• Status: Active Application

• Current Assignee: Lenovo PC International Limited (Lenovo Group Ltd.)
• Original Assignee: Lenovo Singapore Pte Limited (Lenovo Group Ltd.)
• Inventors: Waltermann, Rod D., Holt, Jefferson Logan
• Granted Patent: US 10,277,945 B2
• Time in Patent Office: Days
• US Class Current: 725/109
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/4722 for requesting additional data associated with the content
• CPC Class Codes: H04N 21/4828 for searching program descriptors retrieval of video data G06F16/739
• CPC Class Codes: H04N 21/80 Generation or processing of content or additional data by content creator independently of the distribution process; Content per se arrangements for generating broadcast information H04H60/02
• CPC Class Codes: H04N 21/8133 specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/8405 represented by keywords

Abstract

An embodiment provides a method, including: deriving text data from an input of audiovisual data; analyzing the text data to form one or more key words; selecting the one or more key words to obtain one or more relevant key words, wherein selecting comprises selection based on text data from user specific data sources; forming the one or more relevant key words into a query for obtaining relevant content; and issuing one or more queries to obtain related content from a network connected device. Other aspects are described and claimed.

Claims

1. A method, comprising:

deriving text data from an input of audiovisual data;

analyzing the text data to form one or more key words;

selecting the one or more key words to obtain one or more relevant key words, wherein selecting comprises selection based on text data from user specific data sources;

forming the one or more relevant key words into a query for obtaining relevant content; and

issuing one or more queries to obtain related content from a network connected device.

2. The method of claim 1, wherein the input of audiovisual data comprises one or more of displayable video data, audio data, and closed caption data.

3. The method of claim 1, wherein the user specific data sources comprise one or more of social media content, email content, documents, purchase history, and user input.

4. The method of claim 1, wherein the analyzing comprises tokenizing the text data to form one or more key words comprises performing a language analysis to identify one or more key words from a string of text data.

5. The method of claim 4, wherein selecting the one or more key words to obtain one or more relevant key words comprises selection based upon conducting a frequency analysis to identify one or more frequency used key words.

6. The method of claim 1, wherein issuing one or more queries to obtain related content from a network connected device comprises issuing a query to a search engine.

7. The method of claim 1, wherein issuing one or more queries to obtain related content from a network connected device comprises issuing a query to a knowledge based search service.

8. The method of claim 1, wherein issuing one or more queries to obtain related content from a network connected device comprises issuing a query to a database having predefined contents stored therein.

9. The method of claim 1, further comprising inviting user interaction after obtaining the related content.

10. The method of claim 8, wherein inviting user interaction after obtaining the related content comprises providing one or more of audio and visual output to a viewer inviting interaction with one or more links to the related content.

11. An information handling device, comprising:

one or more processors;

a data input connection;

a network connection; and

a memory device storing instructions accessible to the one or more processors, the instruction being executable by the one or more processors to perform acts comprising;

deriving text data from an input of audiovisual data;

analyzing the text data to form one or more key words;

selecting the one or more key words to obtain one or more relevant key words, wherein selecting comprises selection based on text data from user specific data sources;

forming the one or more relevant key words into a query for obtaining relevant content; and

issuing one or more queries to obtain related content from a network connected device.

12. The information handling device of claim 11, wherein the input of audiovisual data comprises one or more of displayable video data, audio data, and closed caption data.

13. The information handling device of claim 11, wherein the user specific data sources comprise one or more of social media content, email content, documents, purchase history, and user input.

14. The information handling device of claim 11, wherein the analyzing comprises tokenizing the text data to form one or more key words comprises performing a language analysis to identify one or more key words from a string of text data.

15. The information handling device of claim 14, wherein selecting the one or more key words to obtain one or more relevant key words comprises selection based upon conducting a frequency analysis to identify one or more frequency used key words.

16. The information handling device of claim 11, wherein issuing one or more queries to obtain related content from a network connected device comprises issuing a query to a search engine.

17. The information handling device of claim 11, wherein issuing one or more queries to obtain related content from a network connected device comprises issuing a query to a knowledge based search service.

18. The information handling device of claim 11, wherein issuing one or more queries to obtain related content from a network connected device comprises issuing a query to a custom database having predefined contents stored therein.

19. The information handling device of claim 11, wherein the acts further comprise inviting user interaction after obtaining the related content.

20. The information handling device of claim 19, wherein inviting user interaction after obtaining the related content comprises providing one or more of audio and visual output to a viewer inviting interaction with one or more links to the related content.

21. A computer program product, comprising:

a storage medium having computer readable program code embodied therewith, the computer readable program code comprising;

computer readable program code configured to derive text data from an input of audiovisual data;

computer readable program code configured to analyze the text data to form one or more key words;

computer readable program code configured to select the one or more key words to obtain one or more relevant key words, wherein selecting comprises selection based on text data from user specific data sources;

computer readable program code configured to form the one or more relevant key words into a query for obtaining relevant content; and

computer readable program code configured to issue one or more queries to obtain related content from a network connected device.