System and method for previewing relevance of streaming data

• US 8,438,157 B2
• Filed: 06/28/2004
• Issued: 05/07/2013
• Est. Priority Date: 06/28/2004
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Adams, Hugh William Jr.
• Primary Examiner(s): Phillips, III, Albert
• Application Number:
  US10/878,508
• Publication Number:
  US 20050289142A1
• Time in Patent Office: 3,235 Days
• Field of Search: 715/200, 707/725, 707/913
• US Class Current: 707/725
• CPC Class Codes: G06F 16/447 Temporal browsing, e.g. timeline
• CPC Class Codes: G06F 16/738 Presentation of query results
• CPC Class Codes: G06F 16/7867 using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
• CPC Class Codes: H04H 60/73 using meta-information

Abstract

System and methods are provided, which include a presentation device that presents one or more data streams of information to one or more users. Each of the data streams has one or more samples that are arranged a temporal order. A relevancy display has two or more relevance indications, and each of the relevance indications is uniquely associated with one of the samples. The relevance indications are ordered on the relevancy display in the temporal order that corresponds to the order of the samples in the data stream.

Claims

1. A method, comprising:

presenting a query to a computer, the query including search criteria;

submitting the query to a query engine by the computer;

searching, by the query engine, an index database of streaming data files, the index database including a list of streaming data sources and annotation metadata, and the streaming data files including samples arranged in a temporal order;

returning search results by matching the streaming data files with the search criteria;

ranking the search results based upon a confidence of satisfying the query;

reporting the ranking and the confidence to the computer;

receiving the annotation metadata associated with a matching one of the streaming data files in the search results as metadata entries that match the search criteria;

requesting, by the query engine, to stream the matching one of the streaming data files at a given point;

rendering the matching one of the streaming data files by decoding the matching one of the streaming data files and displaying the matching one of the streaming data files to the user;

providing to a relevance display, by a metadata parser, a time stamp of the metadata entries that match the search criteria along with relevance values of the metadata entries that match the search criteria;

displaying the relevance display;

querying, by the relevance display, a current position of the streaming data file that is being rendered;

formatting the relevance display starting at the current position using the relevance values;

formatting the relevance display using a future, not rendered position and relevance value for the future position; and

increasing the future position and displaying relevance of the future position until the end of a relevance bar.

2. The method as recited in claim 1, wherein the data stream includes at least one of a video data stream and an audio data stream.

3. The method as recited in claim 1, wherein the relevancy display indicates relevancy of future samples in streaming data prior to their output.

4. The method as recited in claim 1, wherein the relevance display includes the relevancy bar, which indicates the relevancy of current and future samples and further comprising the step of scrolling through relevancy values to display a sample.

5. The method as recited in claim 1, wherein the relevancy bar includes an indicator which shows a relevancy in the bar corresponding to a current sample.

6. The method as recited in claim 1, wherein the relevancy bar includes a scroll bar having at least one of colors, letters or numbers, which indicate the relevance values of each sample.

7. The method as recited in claim 1, wherein the relevance values are derived from data by a mathematical fusion function.

8. A non-transitory program storage device readable by machine, tangibly embodying a program of instructions executable by the machine to perform method steps for providing relevancy information for a data stream, as recited in claim 1.

9. A system, comprising:

an index database of streaming data files stored in a memory device, said index database including a list of streaming data sources and annotation metadata, and the streaming data files including samples arranged in a temporal order;

a query engine having a processor for receiving a query that includes search criteria, searching said index database of streaming data files, and returning search results by matching the streaming data files with the search criteria, ranking the search results based upon a confidence of satisfying the query, reporting the ranking and the confidence to a computer, requesting to stream a matching one of the streaming data files in the search results at a given point;

a metadata parser for receiving the annotation metadata associated with the matching one of the streaming data files as metadata entries that match the search criteria, and providing to a relevance display a time stamp of the metadata entries that match the search criteria along with relevance values of the metadata entries that match the search criteria;

a rendering device for rendering the matching one of the streaming data files by decoding the matching one of the streaming data files and displaying the matching one of the streaming data files to a user along with the relevance display, the relevance display querying a current position of the matching one of the streaming data files that is being rendered,

wherein the rendering device formats the relevance display starting at the current position using the relevance values, formats the relevance display using a future, not rendered position and relevance value for the future position, and increases the future position and displaying relevance of the future position until the end of a relevance bar.

10. The system as recited in claim 9, wherein the data stream includes a video data stream and the samples include frames.

11. The system as recited in claim 9, wherein the data stream includes an audio data stream and the sample includes an audio signal.

12. The system as recited in claim 9, wherein the relevancy display indicates relevancy of future samples in streaming data prior to their output.

13. The system as recited in claim 9, wherein the relevance values are derived from one or more metadata about the data stream.

14. The system as recited in claim 9, wherein the relevance display includes the relevancy bar, which indicates the relevancy of current and future samples.

15. The system as recited in claim 9, wherein the relevancy bar includes a scroll bar, which moves in conjunction with displaying of the samples.

16. The system as recited in claim 9, wherein the relevancy bar includes an indicator which shows a relevancy in the bar corresponding to a current sample.

17. The system as recited in claim 9, wherein the relevancy bar includes a scroll bar having at least one of colors, letters or numbers, which indicate relevancy of each sample.

18. The system as recited in claim 9, wherein the relevance values are derived from data by a mathematical fusion function.