Systems and methods for voice based search

• US 8,121,586 B2
• Filed: 09/16/2008
• Issued: 02/21/2012
• Est. Priority Date: 09/16/2008
• Status: Active Grant

• Current Assignee: Thryv, Inc. (Mudrick Capital Management LP)
• Original Assignee: YellowPages.com LLC (Mudrick Capital Management LP)
• Inventors: Araradian, Araz, Thakur, Arbind, Tang, Benson
• Primary Examiner(s): LE, DANH C
• Application Number:
  US12/211,365
• Publication Number:
  US 20100069123A1
• Time in Patent Office: 1,253 Days
• Field of Search: 455/418, 455/550.1, 455/556.1, 345/173
• US Class Current: 455/418
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: H04M 1/72445 for supporting Internet browser applications
• CPC Class Codes: H04M 2250/22 including a touch pad, a touch sensor or a touch detector
• CPC Class Codes: H04M 2250/74 with voice recognition means

Abstract

Systems and methods are provided to facilitate voice-based search of information. For example, a portable device may be in a first orientation to present a display of a graphical user interface, such as a search interface presented within a web browser of the portable device. When the portable device is in a second orientation different from the first orientation, the portable device records a voice input for the graphical user interface. When the portable device is back to the first orientation, the portable device applies the voice input to the graphical user interface. When the user shakes the portable device, the portable device re-initializes the graphical user interface for a subsequent input.

Claims

1. A portable device, comprising:

a computing device configured to detect a first change in orientation of the portable device;

wherein the computing device is configured to record a voice input from the user in response to the detection of the first change in orientation of the portable device;

wherein the computing device is configured to detect a second change in orientation of the portable device;

wherein the computing device is configured to stop recording in response to the detection of the second change in orientation of the portable device;

wherein the computing device is configured to submit the voice input from the portable device to a first server over a data communication channel;

wherein the computing device is configured to receive text recognized from the voice input from the first server;

wherein the computing device is configured to submit a search request generated based on the text from the portable device to a second server over the data communication channel;

wherein the computing device is configured to receive a search result responsive to the search request from the second server; and

wherein the computing device is configured to display the search result on the portable device.

2. A method comprising:

detecting, via a computing device, a first change in orientation of a portable device;

in response to detection of the first change in orientation of the portable device, recording, via the computing device, a voice input from the user;

detecting, via the computing device, a second change in orientation of the portable device;

in response to detection of the second change in orientation of the portable device, stopping, via the computing device, the recording;

submitting, via the computing device, the voice input from the portable device to a first server over a data communication channel;

receiving, via the computing device, text recognized from the voice input from the first server;

submitting, via the computing device, a search request generated based on the text from the portable device to a second server over the data communication channel;

receiving, via the computing device, a search result responsive to the search request from the second server; and

displaying, via the computing device, the search result on the portable device.

3. The method of claim 2, wherein the first and second changes in orientation of the portable device are detected using an accelerometer integrated in the portable device.

4. The method of claim 3, further comprising:

measuring a direction of gravity relative to the portable device to determine an orientation of the portable device.

5. The method of claim 2, further comprising:

submitting, via the computing device, a search request from the portable device to retrieve a search result in response to the detection of the second change in orientation of the portable device, the search request being based on content of the voice input; and

displaying the search result on the portable device.

6. The method of claim 5, wherein the first change in orientation of the portable device includes tilting the portable device from a first position to a second position;

and the second change in orientation of the portable device includes moving the portable device from the second position back to the first position.

7. The method of claim 6, wherein in the first position a longitudinal axis of the portable device points to a direction of the force of gravity;

and in the second position the longitudinal axis of the portable device points to a direction generally perpendicular to the direction of the force of gravity.

8. The method of claim 5, wherein the portable device comprises a cellular phone having a display screen;

the first change in orientation of the portable device includes changing from a first position to view the display screen in front of a user to a second position to talk on the cellular phone; and

the second change in orientation of the portable device includes changing from the second position back to the first position.

9. The method of claim 5, further comprising:

detecting, via the computing device, a shaking of the portable device after the search result is displayed on the portable device;

in response to detecting the shaking of the portable device, removing, via the computing device, a display of the search result from the portable device.

10. The method of claim 5, further comprising:

detecting, via the computing device, a shaking of the portable device after the search result is displayed on the portable device; and

in response to detecting the first change in orientation of the portable device, after detecting the shaking of the portable device, recording, via the computing device, a second voice input from the user.

11. The method of claim 5, wherein shaking of the portable device comprises shaking the portable device from side to side.

12. The method of claim 2, further comprising:

streaming, via the computing device, the voice input from the portable device to a server over a data communication channel to formulate a search request;

prompting, via the computing device, the user using voice for the search request; and

receiving, via the computing device, a search result from the server for the search request.

13. The method of claim 2, wherein the search result comprises a list of businesses.

14. The method of claim 13, wherein the list of businesses includes telephone numbers of the businesses.

15. A tangible machine readable medium storing instructions that, when executed by a computing device, embedded in a portable device, cause the computing device to perform a method, the method comprising:

detecting a first change in orientation of the portable device;

in response to detection of the first change in orientation of the portable device, recording a voice input from the user;

detecting a second change in orientation of the portable device;

in response to detection of the second change in orientation of the portable device, stopping the recording;

submitting the voice input from the portable device to a first server over a data communication channel;

receiving text recognized from the voice input from the first server;

submitting a search request generated based on the text from the portable device to a second server over the data communication channel;

receiving a search result responsive to the search request from the second server; and

displaying the search result on the portable device.