Contextual queries for augmenting video display

• US 10,277,945 B2
• Filed: 04/05/2013
• Issued: 04/30/2019
• Est. Priority Date: 04/05/2013
• Status: Active Grant

• Current Assignee: Lenovo PC International Limited (Lenovo Group Ltd.)
• Original Assignee: Lenovo Singapore Pte Limited (Lenovo Group Ltd.)
• Inventors: Waltermann, Rod D., Holt, Jefferson Logan
• Primary Examiner(s): Chin, Ricky
• Application Number:
  US13/857,562
• Publication Number:
  US 20140304753A1
• Time in Patent Office: 2,216 Days
• Field of Search: None
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/4722 for requesting additional data associated with the content
• CPC Class Codes: H04N 21/4828 for searching program descriptors retrieval of video data G06F16/739
• CPC Class Codes: H04N 21/80 Generation or processing of content or additional data by content creator independently of the distribution process; Content per se arrangements for generating broadcast information H04H60/02
• CPC Class Codes: H04N 21/8133 specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/8405 represented by keywords

Abstract

An embodiment provides a method, including: deriving text data from an input of audiovisual data; analyzing the text data to form one or more key words; selecting the one or more key words to obtain one or more relevant key words, wherein selecting comprises selection based on text data from user specific data sources; forming the one or more relevant key words into a query for obtaining relevant content; and issuing one or more queries to obtain related content from a network connected device. Other aspects are described and claimed.

Claims

1. A method, comprising:

deriving text data from an input of audiovisual data;

analyzing the text data to form one or more key words;

deriving additional text data from at least one user specific data source, wherein the at least one user specific data source is associated with prior user inputs and is irrespective of content provided in the audiovisual data;

analyzing the additional text data to form additional one or more key words;

selecting, from the one or more key words and the additional one or more key words, one or more relevant key words, wherein the one or more relevant key words are associated with frequently used words in the one or more key words and the additional one or more key words;

receiving social media data from at least one social media source;

analyzing the social media data to identify user interest data;

identifying an intersection between the one or more relevant key words and the user interest data, the intersection comprising at least one query word;

forming the at least one query word into a query for obtaining relevant content; and

automatically issuing one or more queries to obtain related content from a network connected device.

2. The method of claim 1, wherein the input of audiovisual data comprises one or more of displayable video data, audio data, and closed caption data.

3. The method of claim 1, wherein the at least one user specific data source comprises one or more of social media content, email content, documents, purchase history, and user input.

4. The method of claim 1, wherein the analyzing comprises tokenizing the text data to form one or more key words comprises performing a language analysis to identify one or more key words from a string of text data.

5. The method of claim 4, wherein the selecting comprises selection based upon conducting a frequency analysis to identify one or more frequently used key words.

6. The method of claim 1, wherein issuing one or more queries to obtain related content from a network connected device comprises issuing a query to a search engine.

7. The method of claim 1, wherein issuing one or more queries to obtain related content from a network connected device comprises issuing a query to a knowledge based search service.

8. The method of claim 1, wherein issuing one or more queries to obtain related content from a network connected device comprises issuing a query to a database having predefined contents stored therein.

9. The method of claim 1, further comprising inviting user interaction after obtaining the related content.

10. The method of claim 9, wherein inviting user interaction after obtaining the related content comprises providing one or more of audio and visual output to a viewer inviting interaction with one or more links to the related content.

11. An information handling device, comprising:

one or more processors;

a data input connection;

a network connection; and

a memory device storing instructions accessible to the one or more processors, the instruction being executable by the one or more processors to perform acts comprising;

deriving text data from an input of audiovisual data;

analyzing the text data to form one or more key words;

deriving additional text data from at least one user specific data source, wherein the at least one user specific data source is associated with prior user inputs and is irrespective of content provided in the audiovisual data;

analyzing the additional text data to form additional one or more key words;

selecting, from the one or more key words and the additional one or more key words, one or more relevant key words, wherein the one or more relevant key words are associated with frequently used words in the one or more key words and the additional one or more key words;

receiving social media data from at least one social media source;

analyzing the social media data to identify user interest data;

identifying an intersection between the one or more relevant key words and the user interest data, the intersection comprising at least one query word;

forming the at least one query word into a query for obtaining relevant content; and

automatically issuing one or more queries to obtain related content from a network connected device.

12. The information handling device of claim 11, wherein the input of audiovisual data comprises one or more of displayable video data, audio data, and closed caption data.

13. The information handling device of claim 11, wherein the at least one user specific data source comprises one or more of social media content, email content, documents, purchase history, and user input.

14. The information handling device of claim 11, wherein the analyzing comprises tokenizing the text data to form one or more key words comprises performing a language analysis to identify one or more key words from a string of text data.

15. The information handling device of claim 14, wherein the selecting comprises selection based upon conducting a frequency analysis to identify one or more frequently used key words.

16. The information handling device of claim 11, wherein issuing one or more queries to obtain related content from a network connected device comprises issuing a query to a search engine.

17. The information handling device of claim 11, wherein issuing one or more queries to obtain related content from a network connected device comprises issuing a query to a knowledge based search service.

18. The information handling device of claim 11, wherein issuing one or more queries to obtain related content from a network connected device comprises issuing a query to a custom database having predefined contents stored therein.

19. The information handling device of claim 11, wherein the acts further comprise inviting user interaction after obtaining the related content.

20. The information handling device of claim 19, wherein inviting user interaction after obtaining the related content comprises providing one or more of audio and visual output to a viewer inviting interaction with one or more links to the related content.

21. A computer program product, comprising:

a storage device having computer readable program code embodied therewith, the computer readable program code comprising;

computer readable program code that derives text data from an input of audiovisual data;

computer readable program code that analyzes the text data to form one or more key words;

computer readable program code that derives additional text data from at least one user specific data source, wherein the at least one user specific data source is associated with prior user inputs and is irrespective of content provided in the audiovisual data;

computer readable program code that analyzes the additional text data to form additional one or more key words;

computer readable program code that selects, from the one or more key words and the additional one or more key words, one or more relevant key words, wherein the one or more relevant key words are associated with frequently used words in the one or more key words and the additional one or more key words;

computer readable program code that receives social media data from at least one social media source;

computer readable program code that analyzes the social media data to identify user interest data;

computer readable program code that identifies an intersection between the one or more relevant key words and the user interest data, the intersection comprising at least one query word;

computer readable program code that forms the at least one query word into a query for obtaining relevant content; and

computer readable program code that automatically issues one or more queries to obtain related content from a network connected device.