Method and apparatus for distributed voice searching

• US 7,818,170 B2
• Filed: 04/10/2007
• Issued: 10/19/2010
• Est. Priority Date: 04/10/2007
• Status: Active Grant

• Current Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Original Assignee: Motorola, Inc. (Motorola Solutions, Inc.)
• Inventors: Cheng, Yan Ming
• Primary Examiner(s): Vo; Huyen X.
• Application Number:
  US11/733,306
• Publication Number:
  US 20080256033A1
• Time in Patent Office: 1,288 Days
• Field of Search: 704/257, 704/1, 704/3, 704/4, 704/7, 704/9, 704/231, 704/235, 704/270, 704/275, 704/270.1, 704/249, 704/251, 704/254
• US Class Current: 704/249
• CPC Class Codes: G06F 16/433 using audio data
• CPC Class Codes: G06F 16/957 Browsing optimisation, e.g. caching or content distillation
• CPC Class Codes: G10L 15/08 Speech classification or search
• CPC Class Codes: G10L 15/30 Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
• CPC Class Codes: G10L 2015/025 Phonemes, fenemes or fenones being the recognition units
• CPC Class Codes: G10L 2015/221 Announcement of recognition results
• CPC Class Codes: H04M 1/72445 for supporting Internet browser applications
• CPC Class Codes: H04M 2250/74 with voice recognition means voice activated dialling H04M1/271; voice recognition algorithms G10L15/00

Abstract

A method for distributed voice searching may include receiving a search query from a user of the mobile communication device, generating a lattice of coarse linguistic representations from speech parts in the search query, extracting query features from the generated lattice of coarse linguistic representations, generating coarse search feature vectors based on the extracted query features, performing a coarse search using the generated coarse search feature vectors and transmitting the generated coarse search feature vectors to a remote voice search processing unit, receiving remote resultant web indices from the remote voice search processing unit, generating a lattice of fine linguistic representations from speech parts in the search query, generating fine search feature vectors from the lattice of fine linguistic representations, performing a fine search using the coarse search results, the remote resultant web indices and the generated fine search feature vectors, and displaying the fine search results to the user.

Claims

1. A mobile communication device comprising:

a voice search engine that receives a search query from a user of the mobile communication device, converts speech parts in the search query into linguistic representations, generates a search phoneme lattice based on the linguistic representations, extracts query features from the generated search phoneme lattice, generates coarse search feature vectors based on the extracted query features, and performs a coarse search using the generated coarse search feature vectors;

a transceiver that transmits the generated coarse search feature vectors to a remote voice search processing unit and receives web indices from the remote voice search processing unit based on the generated coarse search feature vectors;

wherein the voice search engine performs a fine search using the results of the coarse search, the remote web indices, and fine search feature vectors, the fine search feature vectors generated from a word lattice based on the search query, the coarse search results, and the remote web indices; and

a display that displays the fine search results to the user.

2. The mobile communication device of claim 1 wherein the linguistic representations are at least one of words, morphemes, syllables, and phonemes of at least one language.

3. The mobile communication device of claim 1 further comprising:

a metadata database that stores metadata;

wherein the coarse search feature vectors and the fine search feature vectors are generated using metadata from the metadata database, the metadata being at least one of audio files, audio recordings, voice mails, recorded conversations, notes, messages, text messages, and annotations.

4. The mobile communication device of claim 1 wherein the web indices are the results of at least one search conducted by at least one web search engine.

5. The mobile communication device of claim 1 wherein the coarse search results and the web indices contain a plurality of candidate selections based on the coarse search feature vectors.

6. The mobile communication device of claim 1 wherein the fine search results contain a best candidate out of the coarse search results and the web indices.

7. The mobile communication device of claim 6 wherein the transceiver transmits the best candidate to the remote voice search processing unit and receives information specific to the best candidate from the remote voice search processing unit.

8. The mobile communication device of claim 1 wherein the fine search results contain a plurality of best candidates out of the coarse search results and the web indices, and wherein the display displays the plurality of candidates to the user.

9. The mobile communication device of claim 8 wherein the voice search engine receives a selection of at least one of the plurality of best candidates from the user, and wherein the transceiver transmits the user'"'"'s selection to the remote voice search processing unit and receives information specific to the best candidate from the remote voice search processing unit.

10. The mobile communication device of claim 1 wherein the mobile communication device is one of a mobile telephone, cellular telephone, a wireless radio, a portable computer, a laptop, an MP3 player, satellite radio, and a satellite television.