SEARCH ENGINE FOR AUDIO DATA

• US 20080033986A1
• Filed: 07/09/2007
• Published: 02/07/2008
• Est. Priority Date: 07/07/2006
• Status: Abandoned Application

• Current Assignee: Redlasso Corporation
• Original Assignee: Phonetic Search, Inc.
• Inventors: McCusker, James, Regovich, Timothy
• Application Number:
  US11/774,655
• Publication Number:
  US 20080033986A1
• Time in Patent Office: Days
• US Class Current: 707/102
• CPC Class Codes: G06F 16/61 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/64 Browsing; Visualisation therefor generation of a list or set of audio data G06F16/638
• CPC Class Codes: G06F 16/68 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/685 using automatically derived transcript of audio data, e.g. lyrics speech recognition G10L15/00
• CPC Class Codes: G10L 2015/025 Phonemes, fenemes or fenones being the recognition units

Abstract

Audio streams are captured and simultaneously indexed in real time from a plurality of audio sources. The captured audio streams and index data of the captured audio streams from the plurality of audio sources are then stored. The storing process operates by temporarily storing the most recently captured audio streams, temporarily storing index data of the most recently captured audio streams, and then periodically loading the temporarily stored audio streams into permanently stored audio streams and periodically loading the temporarily stored index data into the permanently stored index data. A search and media distribution system is connected to the temporarily stored audio streams and the temporarily stored index data for allowing real time search and retrieval access to the captured audio streams.

Claims

1. A computer-implemented method of capturing and indexing audio streams in real time, the method comprising:

(a) capturing and simultaneously indexing audio streams from a plurality of audio sources in real time; and

(b) simultaneously storing in real time

(i) the captured audio streams from the plurality of audio sources, and

(ii) index data of the captured audio streams from the plurality of audio sources.

2. The method of claim 1 wherein step (b) further comprises:

(i) temporarily storing the most recently captured audio streams,

(ii) temporarily storing index data of the most recently captured audio streams,

(iii) permanently storing the captured audio streams,

(iv) permanently storing the index data of the captured audio streams, and

(v) periodically loading the temporarily stored audio streams into permanently stored audio streams and periodically loading the temporarily stored index data into the permanently stored index data.

3. The method of claim 2 wherein step (b)(v) occurs after a predetermined amount of time has passed.

4. The method of claim 2 wherein step (b)(v) occurs after a predetermined amount of data bytes has accumulated in the media buffer or the index buffer.

5. The method of claim 2 further comprising:

(c) providing a search and media distribution system connected to the temporarily stored audio streams and the temporarily stored index data for allowing real time search and retrieval access to the captured audio streams.

6. The method of claim 2 wherein the index data is phonetic index data.

7. The method of claim 2 wherein the most recently captured audio streams exactly correspond to the most recently indexed audio streams.

8. The method of claim 1 wherein the audio streams include audio portions of an audio-visual stream.

9. The method of claim 1 wherein the audio streams include broadcasted audio streams.

10. The method of claim 1 wherein the audio streams include on-air, terrestrial broadcasted audio streams.

11. A computer-implemented apparatus for capturing and indexing audio streams in real time, the apparatus comprising:

(a) an audio capture system that captures and simultaneously indexes audio streams from a plurality of audio sources in real time; and

(b) a media storage and index storage system that simultaneously stores in real time

(i) the captured audio streams from the plurality of audio sources, and

(ii) index data of the captured audio streams from the plurality of audio sources.

12. The apparatus of claim 11 wherein the media storage and index system includes:

(i) a media buffer that temporarily stores the most recently captured audio streams,

(ii) an index buffer that temporarily stores index data of the most recently captured audio streams,

(iii) a media store that permanently stores the captured audio streams,

(iv) an index store that permanently stores the index data of the captured audio streams, and

(v) an archiver that periodically loads contents of the media buffer and the index buffer into the media store and the index store.

13. The apparatus of claim 12 further comprising:

(c) a search and media distribution system connected to the media buffer and the index buffer, thereby allowing for real time search and retrieval access to the captured audio streams.

14. The apparatus of claim 12 wherein the most recently captured audio streams in the media buffer exactly correspond to the most recently indexed audio streams in the index buffer.

15. The apparatus of claim 12 wherein the index data is phonetic index data.

16. The apparatus of claim 11 wherein the audio streams include audio portions of an audio-visual stream.

17. The apparatus of claim 11 wherein the audio streams include broadcasted audio streams.

18. The apparatus of claim 11 wherein the audio streams include on-air, terrestrial broadcasted audio streams.

19. A computer-implemented method of grouping search results by:

(a) identifying instances of search results in an audio stream, each instance having a time stamp;

(b) identifying a first grouping of the instances of the search results by;

(i) identifying a first instance of the search result,

(ii) identifying a subsequent instance of the search result that occurs within a specific time interval after the first instance of the search result,

(iii) identifying another subsequent instance of the search result that occurs within the same specific time interval after the initial subsequent instance of the search result,

(iv) repeating step (iii) for all subsequent instances of the search result; and

(c) identifying subsequent grouping of the instances of the search results by;

(i) identifying another first instance of the search result that occurs more than the specific time interval after the last identified instance in step (b), and

(ii) repeating steps (b)(ii)-(b)(iv),

wherein the time stamps of the instances are used in determining whether or not subsequent instances occur within the specific time interval.

20. The method of claim 19 wherein the audio stream includes audio portions of an audio-visual stream.

21. The method of claim 19 wherein the specific time period is about 30 seconds to about four minutes.

22. The method of claim 19 further comprising:

(d) replaying portions of the audio stream defined by the groupings by starting the replay at the first instance of each of the groupings.

23. The method of claim 19 wherein a plurality of groupings of instances of search results are identified, the method further comprising:

(d) ranking the plurality of groupings based on the relevance of the instances of the search results.

24. An actionable Uniform Resource Identifier (URI) comprising:

(a) a media source; and

(b) a starting point within the media source that is based on an index of the media source.

25. The URI of claim 24 wherein the media source is an audio or audio-visual file.

26. The URI of claim 24 wherein the index to the starting point within the media source is a time offset from a predefined starting time in the media source.

27. The URI of claim 24 wherein the starting point within the media source is a predetermined amount of time prior to a point of interest within the media source.

28. The URI of claim 24 wherein the index to the starting point within the media source is a byte position within the media source.

29. The URI of claim 24 wherein the starting point within the media source is a predetermined number of bytes prior to a point of interest within the media source.

30. An actionable Uniform Resource Identifier (URI) comprising a key, the key being associated with:

(a) a media source; and

(b) a starting point within the media source that is based on an index of the media source.

31. The URI of claim 30 wherein the media source is an audio or audio-visual file.

32. The URI of claim 30 wherein the index to the starting point within the media source is a time offset from a predefined starting time in the media source.

33. The URI of claim 30 wherein the starting point within the media source is a predetermined amount of time prior to a point of interest within the media source.

34. The URI of claim 30 wherein the index to the starting point within the media source is a byte position within the media source.

35. The URI of claim 30 wherein the starting point within the media source is a predetermined number of bytes prior to a point of interest within the media source.

36. A method of assembling an actionable Uniform Resource Identifier, the method comprising:

(a) identifying a media source of interest and a location in the media source of interest; and

(b) assembling a URI that identifies;

(i) the media source, and

(ii) a starting point within the media source that is based on an index of the media source,

wherein the starting point within the media source is associated with the location within the media source of interest.

37. A method of assembling an actionable Uniform Resource Identifier, the method comprising:

(a) identifying a media source of interest and a location in the media source of interest; and

(b) assembling a URI that identifies a key associated with;

(i) the media source, and

(ii) a starting point within the media source that is based on an index of the media source,

wherein the starting point within the media source is associated with the location within the media source of interest.

38. A computer-implemented method for allowing a client machine that includes a media player to retrieve a portion of a media source, the method comprising:

(a) a client machine receiving a Uniform Resource Identifier (URI) that identifies;

(i) the media source, and

(ii) a starting point within the media source that is based on an index of the media source; and

(b) the client machine initiating a request for the media source identified by the URI, the request including the starting point within the media source; and

(c) the client machine receiving the media source and playing the media source with the media player at the starting point within the media source.

39. The method of claim 38 wherein step (c) occurs in response to only a single action being performed by the client machine.

40. The method of claim 39 wherein the single action is a click of link of a resource identified by the URI associated with the media source.

41. The method of claim 39 wherein the single action is clicking a mouse button when a cursor is positioned over a predefined area of displayed information that is related to the media source identified by the URI.

42. The method of claim 39 wherein the single action is selection of a displayed indication.

43. The method of claim 39 wherein the client machine includes a browser for use in performing steps (a)-(c).

44. The method of claim 38 wherein the client machine initiates requests and receives the media source from a remote location via an electronic network.

45. A computer-implemented method for allowing a client machine that includes a media player to retrieve a portion of a media source, the method comprising:

(a) a client machine receiving a Uniform Resource Identifier (URI) that identifies a key associated with;

(i) the media source, and

(ii) a starting point within the media source that is based on an index of the media source; and

(b) the client machine initiating a request for the media source identified by the URI, the request including the key associated with the media source and the starting point within the media source; and

(c) the client machine receiving the media source and playing the media source with the media player at the starting point within the media source.

46. The method of claim 45 wherein step (c) occurs in response to only a single action being performed by the client machine.

47. The method of claim 46 wherein the single action is a click of link of a resource identified by the URI associated with the media source.

48. The method of claim 46 wherein the single action is clicking a mouse button when a cursor is positioned over a predefined area of displayed information that is related to the media source identified by the URI.

49. The method of claim 46 wherein the single action is selection of a displayed indication.

50. The method of claim 46 wherein the client machine includes a browser for use in performing steps (a)-(c).

51. The method of claim 45 wherein the client machine initiates requests and receives the media source from a remote location via an electronic network.

52. A computer-implemented method of ranking the relevance of different sets of content to a search query, the method comprising:

(a) storing a plurality of category taxonomies, each category taxonomy being a set of terms that closely correlate to a given categorization;

(b) receiving a search query and a category taxonomy identifier;

(c) identifying terms in a plurality of different sets of content that belong to the identified category taxonomy; and

(d) ranking the relevance of the different sets of content based at least in part on the number of terms identified in each set of content.

53. The method of claim 52 wherein the terms are words and phrases.

54. The method of claim 52 wherein the sets of content are blocks of related text.

55. The method of claim 52 wherein the sets of content are blocks of transcribed audio.

56. The method of claim 52 wherein each term in a set of terms has a defined relevance weight, and step (d) further comprises weighting the relevance of an identified term based on the relevance weight during the ranking.

57. The method of claim 52 further comprising:

(e) responding to the search query by electronically communicating a plurality of links to the different sets of content in ranked order of relevance to the requester of the search query.