Facilitation of hypervideo by automatic IR techniques utilizing text extracted from multimedia document in response to user requests

• US 20050022107A1
• Filed: 03/26/2004
• Published: 01/27/2005
• Est. Priority Date: 10/29/1999
• Status: Active Grant

• Current Assignee: Jayanta Kumar Dey, Jay Michael Ponte
• Original Assignee: Jayanta Kumar Dey, Jay Michael Ponte
• Inventors: Dey, Jayanta Kumar, Ponte, Jay Michael
• Granted Patent: US 7,765,462 B2
• Time in Patent Office: Days
• US Class Current: 715/202
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99934 Query formulation, input preparation, or translation
• CPC Class Codes: Y10S 707/99936 Pattern matching access

Abstract

Disclosed is a method and device for selecting documents, such as Web pages or sites, for presentation to a user, in response to a user expression of interest, during the course of presentation to the user of a document, such as a video or audio selection, whose content varies with time. The method takes advantage of information retrieval techniques to select documents related to the portion of the temporal document in which the user has expressed interest. The method generates the search query to use to select documents by reference to text associated with the portion of the temporal document in which the user has expressed interest, as by using the closed caption test associated with the video, or by using speech recognition techniques.

Claims

1. A method for finding documents which relate to a portion of a temporal document, comprising:

(a) in response to a signal of interest at a particular time during the temporal document, identifying a portion of the temporal document for which related documents are to be found;

(b) selecting text associated with the portion of the temporal document identified;

(c) finding the related documents by use of information retrieval techniques as applied to the selected text,

wherein the related documents are selected from a collection of documents according to scores associated with the documents, said scores based on a ratio between the number of documents in the collection and, for a term in the selected text, the number of documents in the collection containing the term.

2. The method of claim 1, wherein the temporal document is video or audio material.

3. The method of claim 2, wherein the video material is stored on a video server.

4. The method of claim 2, wherein the selected text is determined by application of speech recognition techniques to the audio component of the portion of the temporal document identified.

5. The method of claim 2, wherein the selected text is the closed-captioned text associated with the portion of the temporal document identified.

6. The method of claim 1, wherein the temporal document includes text.

7. The method of claim 6, wherein the document text appearing to the user varies with time and the selected text is that portion of the temporal document identified.

8. The method of claim 7, wherein the document text includes news bulletins, weather, sports scores or stock transaction or pricing information.

9. The method of claim 2, wherein the related documents are accessed through the Internet.

10. The method of claim 9, further including selecting the related documents from among a collection of documents which may be accessed through the Internet, by utilizing databases comprising information about the collection.

11. The method of claim 10, wherein a predetermined number of documents, 1000, are selected.

12. The method of claim 10, wherein evaluating documents in the collection includes accessing compressed document surrogates.

13. The method of claim 10, wherein related documents are selected from the collection by a server which is distinct from the server which receives the signal of interest.

14. A device for finding documents which relate to a portion of a temporal document, comprising:

(a) means for identifying a portion of the temporal document for which related documents are to be found, in response to a signal of interest at a particular time during the temporal document;

(b) means for selecting text associated with the portion of the temporal document identified;

(c) means for finding the related documents by use of information retrieval techniques as applied to the selected text,

wherein the related documents are selected from a collection of documents according to scores associated with the documents, said scores based on a ratio between the number of documents in the collection and, for a term in the selected text, the number of documents in the collection containing the term.

15. The device of claim 14, wherein the temporal document is video or audio material.

16. The device of claim 15, wherein the video material is stored on a video server.

17. The device of claim 15, wherein the selected text is determined by application of speech recognition techniques to the audio component of the portion of the temporal document identified.

18. The device of claim 15, wherein the selected text is the closed-captioned text associated with the portion of the temporal document identified.

19. The device of claim 14, wherein the temporal document includes text.

20. The device of claim 19, wherein the document text appearing to the user varies with time and the selected text is that portion of the temporal document identified.

21. The device of claim 20, wherein the document text includes news bulletins, weather, sports scores or stock transaction or pricing information.

22. The device of claim 15, wherein the related documents are accessed through the Internet.

23. The device of claim 22, further including means for selecting the related documents from among a collection of documents which may be accessed through the Internet, by utilizing databases comprising information about the collection.

24. The device of claim 23, wherein a predetermined number of documents, 1000, are selected.

25. The device of claim 23, wherein evaluating documents in the collection includes accessing compressed document surrogates.

26. The device of claim 23, wherein related documents are selected from the collection by a server which is distinct from the server which receives the signal of interest.