Facilitation of hypervideo by automatic IR techniques utilizing text extracted from multimedia document in response to user requests

• US 7,765,462 B2
• Filed: 03/26/2004
• Issued: 07/27/2010
• Est. Priority Date: 10/29/1999
• Status: Expired due to Fees

• Current Assignee: Verizon Laboratories Incorporated (Verizon Communications Inc.)
• Original Assignee: Verizon Laboratories Incorporated (Verizon Communications Inc.)
• Inventors: Dey, Jayanta Kumar, Ponte, Jay Michael
• Primary Examiner(s): Ries; Laurie
• Assistant Examiner(s): NGUYEN, CHAU T
• Application Number:
  US10/810,964
• Publication Number:
  US 20050022107A1
• Time in Patent Office: 2,314 Days
• Field of Search: 715/501.1, 715/200, 715/201, 715/205, 715/206, 715/243, 715/246, 715/247, 715/254, 715/267, 715/202, 707/4, 707/6, 707/101, 707/102
• US Class Current: 715/201
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99934 Query formulation, input preparation, or translation
• CPC Class Codes: Y10S 707/99936 Pattern matching access

Abstract

Disclosed is a method and device for selecting documents, such as Web pages or sites, for presentation to a user, in response to a user expression of interest, during the course of presentation to the user of a document, such as a video or audio selection, whose content varies with time. The method takes advantage of information retrieval techniques to select documents related to the portion of the temporal document in which the user has expressed interest. The method generates the search query to use to select documents by reference to text associated with the portion of the temporal document in which the user has expressed interest, as by using the closed caption test associated with the video, or by using speech recognition techniques.

Claims

1. A method for finding documents which relate to a portion of a temporal document, comprising:

(a) in response to a signal of interest at a particular time during the temporal document, identifying a temporal range of the temporal document for which related documents are to be found, the signal of interest indicating interest in a sequence of material presented over the temporal range;

(b) selecting text associated with the sequence of material presented over the temporal range of the temporal document;

(c) finding the related documents by use of information retrieval techniques as applied to the selected text,

wherein the related documents are selected from a collection of documents according to scores associated with the documents, said scores for each document based on a summation of term scores for at least a subset of the terms of the selected text, the term score of a term is weighted according to a temporal position of the term within the temporal range.

2. The method of claim 1, wherein the temporal document is video or audio material.

3. The method of claim 2, wherein the video material is stored on a video server.

4. The method of claim 2, wherein the selected text is determined by application of speech recognition techniques to the audio component of the temporal range of the temporal document.

5. The method of claim 2, wherein the selected text is the closed-captioned text associated with the temporal range of the temporal document.

6. The method of claim 2, wherein the related documents are accessed through a network.

7. The method of claim 6, further including selecting the related documents from among a collection of documents which may be accessed through the network, by utilizing databases comprising information about the collection.

8. The method of claim 7, wherein evaluating documents in the collection includes accessing compressed document surrogates.

9. The method of claim 7, wherein related documents are selected from the collection by a server which is distinct from the server which receives the signal of interest.

10. The method of claim 1, wherein the temporal document includes text.

11. The method of claim 10, wherein the document text appearing to the user varies with time and the selected text is included within the temporal range of the temporal document.

12. The method of claim 11, wherein the document text includes news bulletins, weather, sports scores or stock transaction or pricing information.

13. The method of claim 1, wherein the temporal range precedes the particular time of the signal of interest.

14. The method of claim 1, wherein each temporal position within the temporal range is weighted equally.

15. The method of claim 1, wherein the weight of each temporal position within the temporal range increases from a beginning point of the range to a second point of the range, is weighted equally from the second point of the range to a third point of the range, and decreases from the third point of the range to an end point of the range.

16. The method of claim 1, wherein each temporal position within the temporal range is weighted according to a discrete two stage exponential function.

17. The device of claim 1, wherein the temporal range is defined by the particular time of the signal of interest and a second time that is different from the particular time.

18. A device for finding documents which relate to a portion of a temporal document, comprising:

a computer system having a storage medium containing instructions for controlling the computer system to;

(a) identify a temporal range of the temporal document for which related documents are to be found, in response to a signal of interest at a particular time during the temporal document, the signal of interest indicating interest in a sequence of material presented over the temporal range;

(b) select text associated with the sequence of material presented over the temporal range of the temporal document;

(c) find the related documents by use of information retrieval techniques as applied to the selected text,

wherein the related documents are selected from a collection of documents according to scores associated with the documents, said scores for each document based on a summation of term scores for at least a subset of the terms of the selected text, the term score of a term is weighted according to a temporal position of the term within the temporal range.

19. The device of claim 18, wherein the temporal document is video or audio material.

20. The device of claim 19, wherein the video material is stored on a video server.

21. The device of claim 19, wherein the selected text is determined by application of speech recognition techniques to the audio component of the temporal range of the temporal document.

22. The device of claim 19, wherein the selected text is the closed-captioned text associated with the temporal range of the temporal document.

23. The device of claim 19, wherein the related documents are accessed through a network.

24. The device of claim 23, the storage medium further including additional instructions for controlling the computer system to select the related documents from among a collection of documents which may be accessed through the network, by utilizing databases comprising information about the collection.

25. The device of claim 24, wherein evaluating documents in the collection includes accessing compressed document surrogates.

26. The device of claim 24, wherein related documents are selected from the collection by a server which is distinct from the server which receives the signal of interest.

27. The device of claim 18, wherein the temporal document includes text.

28. The device of claim 27, wherein the document text appearing to the user varies with time and the selected text is included within the temporal range of the temporal document.

29. The device of claim 28, wherein the document text includes news bulletins, weather, sports scores or stock transaction or pricing information.

30. The device of claim 18, wherein the temporal range precedes the particular time of the signal of interest.

31. The device of claim 18, wherein each temporal position within the temporal range is weighted equally.

32. The device of claim 18, wherein the weight of each temporal position within the temporal range increases from a beginning point of the range to a second point of the range, is weighted equally from the second point of the range to a third point of the range, and decreases from the third point of the range to an end point of the range.

33. The device of claim 18, wherein each temporal position within the temporal range is weighted according to a discrete two stage exponential function.

34. The device of claim 18, wherein the temporal range is defined by the particular time of the signal of interest and a second time that is different from the particular time.