SYSTEM AND METHOD FOR SEARCHING BASED ON AUDIO SEARCH CRITERIA

• US 20080059170A1
• Filed: 01/17/2007
• Published: 03/06/2008
• Est. Priority Date: 08/31/2006
• Status: Abandoned Application

• Current Assignee: Sony Ericsson Mobile Communications AB (Sony Group Corp.)
• Original Assignee: Sony Ericsson Mobile Communications AB (Sony Group Corp.)
• Inventors: Bloebaum, L. Scott, Kokes, Mark G.
• Application Number:
  US11/623,876
• Publication Number:
  US 20080059170A1
• Time in Patent Office: Days
• US Class Current: 704/233
• CPC Class Codes: G06F 16/634 Query by example, e.g. query by humming
• CPC Class Codes: G06F 16/68 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/685 using automatically derived transcript of audio data, e.g. lyrics speech recognition G10L15/00

Abstract

A method of processing a sound signal in preparation for conducting an audio-based search on a portion of the sound signal where the portion of the sound signal has an initial starting point and an initial ending point includes identifying speech features that have a relationship to the portion of the sound signal. The initial starting point and/or the initial ending point may be adjusted. In one adjustment, at least one of the initial starting point or the initial ending point are adjusted so that the portion of the sound signal includes a speech feature that at least partially occurs before the initial starting point or at least partially occurs after the initial ending point. In another adjustment, the initial starting point is adjusted to remove non-speech sound from the portion of the sound signal that occurs before a first speech feature of the portion of the sound signal and/or the initial ending point is adjusted to remove non-speech sound from the portion of the sound signal that occurs after a last speech feature of the portion of the sound signal.

Claims

1. A method of processing a sound signal in preparation for conducting an audio-based search on a portion of the sound signal, the portion of the sound signal having an initial starting point and an initial ending point, comprising:

identifying speech features that have a relationship to the portion of the sound signal; and

adjusting at least one of the initial starting point or the initial ending point so that the portion of the sound signal includes a speech feature that at least partially occurs before the initial starting point or at least partially occurs after the initial ending point.

2. The method of claim 1, wherein the identifying of the speech features is carried out using voice activity detection.

3. The method of claim 1, wherein the speech features are phonemes.

4. The method of claim 1, further comprising windowing the adjusted portion of the sound signal with a windowing function.

5. The method of claim 4, further comprising coding the adjusted portion of the sound signal for transmission to a remote server for execution of a search.

6. The method of claim 1, wherein the identifying of the speech features and the adjusting of at least one of the initial starting point or the initial ending point are carried out by a client device and the adjusted sound signal is transmitted to a remote server for execution of a search.

7. The method of claim 6, wherein the client device is a mobile telephone.

8. The method of claim 1, wherein the adjusted portion of the sound signal represents search criteria for a search.

9. The method of claim 8, wherein the initial starting point and the initial ending point correspond to user selected points in the sound signal that tag spoken search criteria.

10. The method of claim 9, further comprising windowing the adjusted portion of the sound signal with a windowing function.

11. The method of claim 9, further comprising coding the adjusted portion of the sound signal for transmission to a remote server for execution of a search.

12. The method of claim 9, further comprising conducting a search based on the spoken search criteria.

13. The method of claim 1, further comprising conducting speech recognition on the adjusted portion of the sound signal.

14. The method of claim 1, further comprising at least one of adjusting the initial starting point to remove non-speech sound from the portion of the sound signal that occurs before a first speech feature of the portion of the sound signal or adjusting the initial ending point to remove non-speech sound from the portion of the sound signal that occurs after a last speech feature of the portion of the sound signal.

15. The method of claim 1, further comprising buffering a rolling audio sample and, before the adjusting, prepending the content of the buffer to the portion of the sound signal defined by the initial starting point and the initial ending point.

16. The method of claim 15, further comprising buffering an audio sample that follows the initial ending point and, before the adjusting, appending the content of the buffer to the portion of the sound signal defined by the initial starting point and the initial ending point.

17. A method of processing a sound signal in preparation for conducting an audio-based search on a portion of the sound signal, the portion of the sound signal having an initial starting point and an initial ending point, comprising:

identifying speech features that have a relationship to the portion of the sound signal; and

adjusting at least one of the initial starting point to remove non-speech sound from the portion of the sound signal that occurs before a first speech feature of the portion of the sound signal or the initial ending point to remove non-speech sound from the portion of the sound signal that occurs after a last speech feature of the portion of the sound signal.

18. The method of claim 17, wherein the identifying of the speech features and the adjusting of at least one of the initial starting point or the initial ending point are carried out by a client device and the adjusted sound signal is transmitted to a remote server for execution of a search.

19. The method of claim 17, wherein the adjusted portion of the sound signal represents search criteria for a search.

20. The method of claim 19, wherein the initial starting point and the initial ending point correspond to user selected points in the sound signal that tag spoken search criteria.

21. The method of claim 20, further comprising windowing the adjusted portion of the sound signal with a windowing function.

22. The method of claim 20, further comprising coding the adjusted portion of the sound signal for transmission to a remote server for execution of a search.

23. The method of claim 20, further comprising conducting a search based on the spoken search criteria.

24. The method of claim 17, further comprising conducting speech recognition on the adjusted portion of the sound signal.