COLLECTION AND USE OF SIDE INFORMATION IN VOICE-MEDIATED MOBILE SEARCH
First Claim
1. A method of performing a search originating from a mobile device, the method comprising:
- receiving a signal from the mobile device that includes a representation of an utterance from a user of the mobile device, wherein the utterance includes a search request;
using speech recognition software to convert the search request into a text search request;
extracting side information contained within the received signal, wherein the side information is represented implicitly within the received signal;
using the extracted side information to assign the user of the mobile device to a user category;
sending the text search request and the user category to one or more content providers;
receiving from the one or more content providers content that is responsive to the text search request and the user category; and
sending search results to the mobile device, wherein the search results are based on the received content from the one or more content providers.
5 Assignments
0 Petitions

Accused Products

Abstract
Methods and systems for providing voice-mediated search capability to a mobile communications device involve receiving a signal from the mobile device that includes a representation of a spoken search request from a user of the mobile device, using speech recognition software to convert the search request into a text search request, extracting side information contained implicitly within the received signal, using the extracted side information to assign the user to a category, sending the text search request and the user category to content providers, receiving from the content providers content that is responsive to the text search request and the user category, and sending to the mobile device search results that are based on content from content providers. The methods and systems further involve sending searches and user categories to advertising providers, and sending advertisements returned by the advertising providers to the mobile device along with the search results.
291 Citations
COMBINATION AND FEDERATION OF LOCAL AND REMOTE SPEECH RECOGNITION | ||
Patent #
US 20110015928A1
Filed 07/15/2009
|
Current Assignee
Microsoft Technology Licensing LLC
|
Original Assignee
Microsoft Corporation
|
Flexible billing architecture | ||
Patent #
US 8,010,082 B2
Filed 10/19/2005
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Managing user-to-user contact with inferred presence information | ||
Patent #
US 8,069,166 B2
Filed 02/27/2006
|
Current Assignee
Seven Networks LLC
|
Original Assignee
Seven Networks Inc
|
Multiple data store authentication | ||
Patent #
US 8,064,583 B1
Filed 09/21/2006
|
Current Assignee
Seven Networks LLC
|
Original Assignee
Seven Networks Inc
|
Voice Activated Application Service Architecture and Delivery | ||
Patent #
US 20100042413A1
Filed 08/12/2009
|
Current Assignee
Ditech Networks Inc.
|
Original Assignee
Ditech Networks Inc.
|
Service Oriented Speech Recognition for In-Vehicle Automated Interaction and In-Vehicle User Interfaces Requiring Minimal Cognitive Driver Processing for Same | ||
Patent #
US 20100250243A1
Filed 03/23/2010
|
Current Assignee
Sirius Xm Connected Vehicle Services Inc.
|
Original Assignee
Sirius Xm Connected Vehicle Services Inc.
|
ENABLING ACCESS TO INFORMATION ON A WEB PAGE | ||
Patent #
US 20100185648A1
Filed 01/14/2009
|
Current Assignee
International Business Machines Corporation
|
Original Assignee
International Business Machines Corporation
|
Apparatus and Method of Semantic Service Correlation System | ||
Patent #
US 20100010974A1
Filed 07/09/2008
|
Current Assignee
International Business Machines Corporation
|
Original Assignee
International Business Machines Corporation
|
Multisensory Speech Detection | ||
Patent #
US 20100121636A1
Filed 11/10/2009
|
Current Assignee
Google Inc.
|
Original Assignee
Google Inc.
|
EFFICIENT CONVERSION OF VOICE MESSAGES INTO TEXT | ||
Patent #
US 20090052636A1
Filed 10/29/2008
|
Current Assignee
Intellisist Inc. dba Spoken Communications
|
Original Assignee
GotVoice Incorporated
|
Adaptive multi-channel content selection with behavior-aware query analysis | ||
Patent #
US 20090265325A1
Filed 04/16/2008
|
Current Assignee
IAC Search Media Incorporated
|
Original Assignee
IAC Search Media Incorporated
|
SYSTEMS AND METHODS FOR INTERACTIVELY ACCESSING NETWORKED SERVICES USING VOICE COMMUNICATIONS | ||
Patent #
US 20080095331A1
Filed 10/18/2006
|
Current Assignee
Futurion 1 SA
|
Original Assignee
Futurion 1 SA
|
SYSTEMS, APPARATUSES, AND METHODS FOR INTERACTIVELY ACCESSING NETWORKED SERVICES USING VOICE COMMUNICATIONS | ||
Patent #
US 20080095327A1
Filed 10/18/2006
|
Current Assignee
Futurion 1 SA
|
Original Assignee
Futurion 1 SA
|
Effecting Functions On A Multimodal Telephony Device | ||
Patent #
US 20080208594A1
Filed 02/27/2007
|
Current Assignee
Nuance Communications Inc.
|
Original Assignee
Nuance Communications Inc.
|
METHOD AND SYSTEM FOR RETRIEVING INFORMATION | ||
Patent #
US 20070249406A1
Filed 04/20/2006
|
Current Assignee
Sony Ericsson Mobile Communications USA Incorporated
|
Original Assignee
Sony Ericsson Mobile Communications USA Incorporated
|
Secure end-to-end transport through intermediary nodes | ||
Patent #
US 8,127,342 B2
Filed 09/23/2010
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Provisioning applications for a mobile device | ||
Patent #
US 8,078,158 B2
Filed 06/26/2008
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Provisioning of e-mail settings for a mobile terminal | ||
Patent #
US 8,116,214 B2
Filed 11/30/2005
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Mobile virtual network operator | ||
Patent #
US 8,107,921 B2
Filed 01/11/2008
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Application and network-based long poll request detection and cacheability assessment therefor | ||
Patent #
US 8,166,164 B1
Filed 10/14/2011
|
Current Assignee
Seven Networks LLC
|
Original Assignee
Seven Networks Inc
|
Cache defeat detection and caching of content addressed by identifiers intended to defeat cache | ||
Patent #
US 8,190,701 B2
Filed 11/01/2011
|
Current Assignee
Seven Networks LLC
|
Original Assignee
Seven Networks Inc
|
CONFIGURABLE SPEECH RECOGNITION SYSTEM USING MULTIPLE RECOGNIZERS | ||
Patent #
US 20120179457A1
Filed 01/06/2012
|
Current Assignee
Nuance Communications Inc.
|
Original Assignee
Nuance Communications Inc.
|
Efficient conversion of voice messages into text | ||
Patent #
US 8,239,197 B2
Filed 10/29/2008
|
Current Assignee
Intellisist Inc. dba Spoken Communications
|
Original Assignee
Intellisist Inc. dba Spoken Communications
|
Application and network-based long poll request detection and cacheability assessment therefor | ||
Patent #
US 8,291,076 B2
Filed 03/05/2012
|
Current Assignee
Seven Networks LLC
|
Original Assignee
Seven Networks Inc
|
Voice activated application service architecture and delivery | ||
Patent #
US 8,301,452 B2
Filed 08/12/2009
|
Current Assignee
Ditech Networks Inc.
|
Original Assignee
Ditech Networks Inc.
|
Social caching for device resource sharing and management | ||
Patent #
US 8,316,098 B2
Filed 04/19/2012
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Distributed management of keep-alive message signaling for mobile network resource conservation and optimization | ||
Patent #
US 8,326,985 B2
Filed 11/01/2011
|
Current Assignee
Seven Networks LLC
|
Original Assignee
Seven Networks Inc
|
SYSTEM FOR DETECTING SPEECH INTERVAL AND RECOGNIZING CONTINOUS SPEECH IN A NOISY ENVIRONMENT THROUGH REAL-TIME RECOGNITION OF CALL COMMANDS | ||
Patent #
US 20120316879A1
Filed 08/22/2012
|
Current Assignee
Koreapowervoice Company Limited
|
Original Assignee
Koreapowervoice Company Limited
|
System and method for a mobile device to use physical storage of another device for caching | ||
Patent #
US 8,356,080 B2
Filed 07/20/2012
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Electronic-mail filtering for mobile devices | ||
Patent #
US 8,364,181 B2
Filed 12/10/2007
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Context aware data presentation | ||
Patent #
US 8,412,675 B2
Filed 02/24/2006
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Aligning data transfer to optimize connections established for transmission over a wireless network | ||
Patent #
US 8,417,823 B2
Filed 11/18/2011
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks LLC
|
Flexible real-time inbox access | ||
Patent #
US 8,438,633 B1
Filed 12/18/2006
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Publishing data in an information community | ||
Patent #
US 8,468,126 B2
Filed 12/14/2005
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Distributed caching in a wireless network of content delivered for a mobile application over a long-held request | ||
Patent #
US 8,484,314 B2
Filed 10/14/2011
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Provisioning applications for a mobile device | ||
Patent #
US 8,494,510 B2
Filed 12/06/2011
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Mobile network background traffic data management with optimized polling intervals | ||
Patent #
US 8,539,040 B2
Filed 02/28/2012
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Secure end-to-end transport through intermediary nodes | ||
Patent #
US 8,549,587 B2
Filed 02/14/2012
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Apparatus and method of semantic service correlation system | ||
Patent #
US 8,560,563 B2
Filed 07/09/2008
|
Current Assignee
International Business Machines Corporation
|
Original Assignee
International Business Machines Corporation
|
System and method for executing commands that are non-native to the native environment of a mobile device | ||
Patent #
US 8,561,086 B2
Filed 05/17/2012
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
System and method for efficiently transcribing verbal messages to text | ||
Patent #
US 8,583,433 B2
Filed 08/06/2012
|
Current Assignee
Bruce J. Peterson, Mike O. Webb, Janet S. Kaseda, Intellisist Inc. dba Spoken Communications
|
Original Assignee
Intellisist Inc. dba Spoken Communications
|
Apparatus and Method of Semantic Service Correlation System | ||
Patent #
US 20130332448A1
Filed 07/26/2013
|
Current Assignee
International Business Machines Corporation
|
Original Assignee
International Business Machines Corporation
|
Detecting and preserving state for satisfying application requests in a distributed proxy and cache system | ||
Patent #
US 8,621,075 B2
Filed 04/27/2012
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks LLC
|
Speaker and call characteristic sensitive open voice search | ||
Patent #
US 8,630,860 B1
Filed 03/03/2011
|
Current Assignee
Nuance Communications Inc.
|
Original Assignee
Nuance Communications Inc.
|
Cache state management on a mobile device to preserve user experience | ||
Patent #
US 8,635,339 B2
Filed 08/22/2012
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Polling | ||
Patent #
US 8,693,494 B2
Filed 03/31/2008
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Cache defeat detection and caching of content addressed by identifiers intended to defeat cache | ||
Patent #
US 8,700,728 B2
Filed 05/17/2012
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Cross-platform event engine | ||
Patent #
US 8,209,709 B2
Filed 07/05/2010
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Distributed system for cache defeat detection and caching of content addressed by identifiers intended to defeat cache | ||
Patent #
US 8,204,953 B2
Filed 11/01/2011
|
Current Assignee
Seven Networks LLC
|
Original Assignee
Seven Networks Inc
|
SPEAKER AND CALL CHARACTERISTIC SENSITIVE OPEN VOICE SEARCH | ||
Patent #
US 20140129220A1
Filed 01/10/2014
|
Current Assignee
Nuance Communications Inc.
|
Original Assignee
William F. Ganong III, Qin Shi, Jian Chen, Yong Qin, Sheng Hua Bao, Zhong Su, Zhiwei Shuang, Wen Liu, Shilei Zhang
|
Electronic-mail filtering for mobile devices | ||
Patent #
US 8,738,050 B2
Filed 01/07/2013
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Mobile device equipped with mobile network congestion recognition to make intelligent decisions regarding connecting to an operator network | ||
Patent #
US 8,750,123 B1
Filed 07/31/2013
|
Current Assignee
Seven Networks LLC
|
Original Assignee
Seven Networks Inc
|
Adaptive multi-channel content selection with behavior-aware query analysis | ||
Patent #
US 8,751,481 B2
Filed 04/16/2008
|
Current Assignee
IAC Search Media Incorporated
|
Original Assignee
IAC Search Media Incorporated
|
Maintaining an IP connection in a mobile network | ||
Patent #
US 8,761,756 B2
Filed 09/13/2012
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks International Oy
|
INTENT MINING VIA ANALYSIS OF UTTERANCES | ||
Patent #
US 20140180692A1
Filed 02/19/2014
|
Current Assignee
Nuance Communications Inc.
|
Original Assignee
Nuance Communications Inc.
|
Integrated messaging | ||
Patent #
US 8,774,844 B2
Filed 04/08/2011
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Dynamic bandwidth adjustment for browsing or streaming activity in a wireless network based on prediction of user behavior when interacting with mobile applications | ||
Patent #
US 8,775,631 B2
Filed 02/25/2013
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Proxying search requests for files to a search engine | ||
Patent #
US 8,782,028 B1
Filed 04/12/2012
|
Current Assignee
NetApp Inc.
|
Original Assignee
NetApp Inc.
|
Timing of keep-alive messages used in a system for mobile network resource conservation and optimization | ||
Patent #
US 8,782,222 B2
Filed 09/05/2012
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks LLC
|
Application discovery on mobile devices | ||
Patent #
US 8,787,947 B2
Filed 06/18/2008
|
Current Assignee
Seven Networks LLC
|
Original Assignee
Seven Networks Inc
|
Content delivery to a mobile device from a content service | ||
Patent #
US 8,793,305 B2
Filed 12/13/2007
|
Current Assignee
Seven Networks LLC
|
Original Assignee
Seven Networks Inc
|
System and method of a relay server for managing communications and notification between a mobile device and a web access server | ||
Patent #
US 8,799,410 B2
Filed 04/13/2011
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Maintaining mobile terminal information for secure communications | ||
Patent #
US 8,805,334 B2
Filed 09/05/2008
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Integrated messaging | ||
Patent #
US 8,805,425 B2
Filed 01/28/2009
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Mobile device power management in data synchronization over a mobile network with or without a trigger notification | ||
Patent #
US 8,811,952 B2
Filed 05/05/2011
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Method and system for management of a virtual network connection without heartbeat messages | ||
Patent #
US 8,812,695 B2
Filed 04/03/2013
|
Current Assignee
Seven Networks LLC
|
Original Assignee
Seven Networks Inc
|
METHOD FOR COMBINING VOICE SIGNALS TO FORM A CONTINUOUS CONVERSATION IN PERFORMING A VOICE SEARCH | ||
Patent #
US 20140244686A1
Filed 03/15/2013
|
Current Assignee
The DIRECTV Group Inc.
|
Original Assignee
The DIRECTV Group Inc.
|
System and method for tracking billing events in a mobile wireless network for a network operator | ||
Patent #
US 8,831,561 B2
Filed 04/28/2011
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
System and method for making requests on behalf of a mobile device based on atomic processes for mobile network traffic relief | ||
Patent #
US 8,832,228 B2
Filed 04/26/2012
|
Current Assignee
Seven Networks LLC
|
Original Assignee
Seven Networks Inc
|
Distributed caching for resource and mobile network traffic management | ||
Patent #
US 8,838,783 B2
Filed 07/05/2011
|
Current Assignee
Seven Networks LLC
|
Original Assignee
Seven Networks Inc
|
Flexible real-time inbox access | ||
Patent #
US 8,839,412 B1
Filed 09/13/2012
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Web-based access to data objects | ||
Patent #
US 8,838,744 B2
Filed 01/28/2009
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Mobile traffic categorization and policy for network use optimization while preserving user experience | ||
Patent #
US 8,843,153 B2
Filed 11/01/2011
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
System for providing policy based content service in a mobile network | ||
Patent #
US 8,849,902 B2
Filed 06/24/2011
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Hierarchies and categories for management and deployment of policies for distributed wireless traffic optimization | ||
Patent #
US 8,861,354 B2
Filed 12/14/2012
|
Current Assignee
Seven Networks LLC
|
Original Assignee
Seven Networks Inc
|
Multisensory speech detection | ||
Patent #
US 8,862,474 B2
Filed 09/14/2012
|
Current Assignee
Google Inc.
|
Original Assignee
Google Inc.
|
Policy based content service | ||
Patent #
US 8,862,657 B2
Filed 01/25/2008
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
System of redundantly clustered machines to provide failover mechanisms for mobile traffic management and network resource conservation | ||
Patent #
US 8,868,753 B2
Filed 12/06/2012
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Provisioning of e-mail settings for a mobile terminal | ||
Patent #
US 8,873,411 B2
Filed 01/12/2012
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Signaling optimization in a wireless network for traffic utilizing proprietary and non-proprietary protocols | ||
Patent #
US 8,874,761 B2
Filed 03/15/2013
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Mobile application traffic optimization | ||
Patent #
US 8,886,176 B2
Filed 07/22/2011
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Combination and federation of local and remote speech recognition | ||
Patent #
US 8,892,439 B2
Filed 07/15/2009
|
Current Assignee
Microsoft Technology Licensing LLC
|
Original Assignee
Microsoft Corporation
|
Optimization of resource polling intervals to satisfy mobile device requests | ||
Patent #
US 8,903,954 B2
Filed 11/22/2011
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Mobile virtual network operator | ||
Patent #
US 8,909,192 B2
Filed 08/11/2011
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Bandwidth measurement | ||
Patent #
US 8,909,759 B2
Filed 10/12/2009
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Detection and management of user interactions with foreground applications on a mobile device in distributed caching | ||
Patent #
US 8,909,202 B2
Filed 01/07/2013
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
System and method for providing a network service in a distributed fashion to a mobile device | ||
Patent #
US 8,914,002 B2
Filed 08/11/2011
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Speech recognition with hierarchical networks | ||
Patent #
US 8,914,286 B1
Filed 03/29/2012
|
Current Assignee
Amazon Technologies
|
Original Assignee
Canyon IP Holdings LLC
|
Optimization of mobile traffic directed to private networks and operator configurability thereof | ||
Patent #
US 8,918,503 B2
Filed 08/28/2012
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
System for detecting speech interval and recognizing continuous speech in a noisy environment through real-time recognition of call commands | ||
Patent #
US 8,930,196 B2
Filed 08/22/2012
|
Current Assignee
Koreapowervoice Company Limited
|
Original Assignee
Koreapowervoice Company Limited
|
Method and apparatus for intercepting events in a communication system | ||
Patent #
US RE45,348 E1
Filed 03/16/2012
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
METHOD AND SYSTEM FOR INFORMATION QUERYING | ||
Patent #
US 20150052119A1
Filed 10/31/2014
|
Current Assignee
ATT Intellectual Property I LP
|
Original Assignee
ATT Intellectual Property I LP
|
Application and network-based long poll request detection and cacheability assessment therefor | ||
Patent #
US 8,966,066 B2
Filed 10/12/2012
|
Current Assignee
Seven Networks LLC
|
Original Assignee
Seven Networks Inc
|
Mobile device and method to utilize the failover mechanism for fault tolerance provided for mobile traffic management and network/device resource conservation | ||
Patent #
US 8,977,755 B2
Filed 12/06/2012
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Monitoring mobile application activities for malicious traffic on a mobile device | ||
Patent #
US 8,984,581 B2
Filed 07/11/2012
|
Current Assignee
Seven Networks LLC
|
Original Assignee
Seven Networks Inc
|
Connection architecture for a mobile network | ||
Patent #
US 8,989,728 B2
Filed 09/07/2006
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Predictive content delivery | ||
Patent #
US 9,002,828 B2
Filed 01/02/2009
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Flexible and dynamic integration schemas of a traffic management system with various network operators for network traffic alleviation | ||
Patent #
US 9,009,250 B2
Filed 12/07/2012
|
Current Assignee
Seven Networks LLC
|
Original Assignee
Seven Networks Inc
|
Multisensory speech detection | ||
Patent #
US 9,009,053 B2
Filed 11/10/2009
|
Current Assignee
Google Inc.
|
Original Assignee
Google Inc.
|
Mobile network reporting and usage analytics system and method aggregated using a distributed traffic optimization system | ||
Patent #
US 9,021,021 B2
Filed 12/10/2012
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
3D mobile user interface with configurable workspace management | ||
Patent #
US 9,043,731 B2
Filed 03/30/2011
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Mobile network traffic coordination across multiple applications | ||
Patent #
US 9,043,433 B2
Filed 05/25/2011
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Manner of pronunciation-influenced search results | ||
Patent #
US 9,043,199 B1
Filed 04/05/2013
|
Current Assignee
Google LLC
|
Original Assignee
Google Inc.
|
Intelligent rendering of information in a limited display environment | ||
Patent #
US 9,047,142 B2
Filed 12/16/2010
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Mobile network traffic coordination across multiple applications | ||
Patent #
US 9,049,179 B2
Filed 01/20/2012
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Location-based operations and messaging | ||
Patent #
US 9,055,102 B2
Filed 08/02/2010
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Selective data compression by a distributed traffic management system to reduce mobile data traffic and signaling traffic | ||
Patent #
US 9,060,032 B2
Filed 05/09/2012
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Proxy server associated with a mobile carrier for enhancing mobile traffic management in a mobile network | ||
Patent #
US 9,065,765 B2
Filed 10/08/2013
|
Current Assignee
Seven Networks LLC
|
Original Assignee
Seven Networks Inc
|
Distributed implementation of dynamic wireless traffic policy | ||
Patent #
US 9,077,630 B2
Filed 07/08/2011
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Device resources sharing for network resource conservation | ||
Patent #
US 9,084,105 B2
Filed 04/19/2012
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Incorporating an Exogenous Large-Vocabulary Model into Rule-Based Speech Recognition | ||
Patent #
US 20150206528A1
Filed 01/17/2014
|
Current Assignee
Microsoft Technology Licensing LLC
|
Original Assignee
Microsoft Corporation
|
Speech recognition with hierarchical networks | ||
Patent #
US 9,093,061 B1
Filed 03/29/2012
|
Current Assignee
Amazon Technologies
|
Original Assignee
Canyon IP Holdings LLC
|
Mobile network background traffic data management | ||
Patent #
US 9,100,873 B2
Filed 09/14/2012
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Speaker and call characteristic sensitive open voice search | ||
Patent #
US 9,099,092 B2
Filed 01/10/2014
|
Current Assignee
Nuance Communications Inc.
|
Original Assignee
Nuance Communications Inc.
|
Managing cache to prevent overloading of a wireless network due to user activity | ||
Patent #
US 9,131,397 B2
Filed 06/06/2013
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Optimized and selective management of policy deployment to mobile clients in a congested network to prevent further aggravation of network congestion | ||
Patent #
US 9,161,258 B2
Filed 03/15/2013
|
Current Assignee
Seven Networks LLC
|
Original Assignee
Seven Networks LLC
|
Speaker and Call Characteristic Sensitive Open Voice Search | ||
Patent #
US 20150294669A1
Filed 06/25/2015
|
Current Assignee
Nuance Communications Inc.
|
Original Assignee
Nuance Communications Inc.
|
Radio-awareness of mobile device for sending server-side control signals using a wireless network optimized transport protocol | ||
Patent #
US 9,173,128 B2
Filed 03/06/2013
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks LLC
|
Dynamic categorization of applications for network access in a mobile network | ||
Patent #
US 9,203,864 B2
Filed 02/04/2013
|
Current Assignee
Seven Networks LLC
|
Original Assignee
Seven Networks LLC
|
Mobile device having content caching mechanisms integrated with a network operator for traffic alleviation in a wireless network and methods therefor | ||
Patent #
US 9,208,123 B2
Filed 12/07/2012
|
Current Assignee
Seven Networks LLC
|
Original Assignee
Seven Networks LLC
|
Service oriented speech recognition for in-vehicle automated interaction and in-vehicle user interfaces requiring minimal cognitive driver processing for same | ||
Patent #
US 9,224,394 B2
Filed 03/23/2010
|
Current Assignee
Sirius Xm Connected Vehicle Services Inc.
|
Original Assignee
Sirius Xm Connected Vehicle Services Inc.
|
Mobile device with application or context aware fast dormancy | ||
Patent #
US 9,241,314 B2
Filed 03/15/2013
|
Current Assignee
Seven Networks LLC
|
Original Assignee
Seven Networks LLC
|
Automatic generation and distribution of policy information regarding malicious mobile traffic in a wireless network | ||
Patent #
US 9,239,800 B2
Filed 07/11/2012
|
Current Assignee
Seven Networks LLC
|
Original Assignee
Seven Networks LLC
|
Extending user relationships | ||
Patent #
US 9,251,193 B2
Filed 10/28/2007
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks LLC
|
Application or context aware fast dormancy | ||
Patent #
US 9,271,238 B2
Filed 03/15/2013
|
Current Assignee
Seven Networks LLC
|
Original Assignee
Seven Networks LLC
|
Request and response characteristics based adaptation of distributed caching in a mobile network | ||
Patent #
US 9,275,163 B2
Filed 10/17/2011
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks LLC
|
Radio-awareness of mobile device for sending server-side control signals using a wireless network optimized transport protocol | ||
Patent #
US 9,277,443 B2
Filed 12/07/2012
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks LLC
|
System and method for a mobile device to use physical storage of another device for caching | ||
Patent #
US 9,300,719 B2
Filed 01/14/2013
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks Inc
|
Keyword-based conversational searching using voice commands | ||
Patent #
US 9,305,064 B1
Filed 05/24/2013
|
Current Assignee
Google LLC
|
Original Assignee
Google Inc.
|
Systems and methods for application management of mobile device radio state promotion and demotion | ||
Patent #
US 9,307,493 B2
Filed 03/15/2013
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks LLC
|
VOICE SEARCHING METADATA THROUGH MEDIA CONTENT | ||
Patent #
US 20160098998A1
Filed 12/11/2014
|
Current Assignee
Disney Enterprises Incorporated
|
Original Assignee
Disney Enterprises Incorporated
|
System and method for reduction of mobile network traffic used for domain name system (DNS) queries | ||
Patent #
US 9,325,662 B2
Filed 01/09/2012
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks LLC
|
User as an end point for profiling and optimizing the delivery of content and data in a wireless network | ||
Patent #
US 9,326,189 B2
Filed 02/04/2013
|
Current Assignee
Seven Networks LLC
|
Original Assignee
Seven Networks LLC
|
Wireless traffic management system cache optimization using http headers | ||
Patent #
US 9,330,196 B2
Filed 06/14/2012
|
Current Assignee
Seven Networks LLC
|
Original Assignee
Seven Networks LLC
|
Retrieval and management of spoken language understanding personalization data | ||
Patent #
US 9,361,289 B1
Filed 08/30/2013
|
Current Assignee
Amazon Technologies
|
Original Assignee
Amazon Technologies
|
Mobile application traffic optimization | ||
Patent #
US 9,407,713 B2
Filed 01/16/2012
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks LLC
|
Method for combining voice signals to form a continuous conversation in performing a voice search | ||
Patent #
US 9,414,004 B2
Filed 03/15/2013
|
Current Assignee
The DIRECTV Group Inc.
|
Original Assignee
The DIRECTV Group Inc.
|
Computer-implemented system and method for transcribing verbal messages | ||
Patent #
US 9,418,659 B2
Filed 11/07/2013
|
Current Assignee
Intellisist Inc. dba Spoken Communications
|
Original Assignee
Intellisist Inc. dba Spoken Communications
|
Method and system for improving responsiveness of a voice recognition system | ||
Patent #
US 9,538,114 B2
Filed 03/15/2013
|
Current Assignee
The DIRECTV Group Inc.
|
Original Assignee
The DIRECTV Group Inc.
|
Apparatus and method of semantic service correlation system | ||
Patent #
US 9,552,389 B2
Filed 07/26/2013
|
Current Assignee
International Business Machines Corporation
|
Original Assignee
International Business Machines Corporation
|
Service oriented speech recognition for in-vehicle automated interaction and in-vehicle user interfaces requiring minimal cognitive driver processing for same | ||
Patent #
US 9,558,745 B2
Filed 11/13/2015
|
Current Assignee
Sirius Xm Connected Vehicle Services Inc.
|
Original Assignee
Sirius Xm Connected Vehicle Services Inc.
|
Multisensory speech detection | ||
Patent #
US 9,570,094 B2
Filed 06/29/2015
|
Current Assignee
Google Inc.
|
Original Assignee
Google Inc.
|
Continuous speech transcription performance indication | ||
Patent #
US 9,583,107 B2
Filed 10/17/2014
|
Current Assignee
Amazon Technologies
|
Original Assignee
Amazon Technologies
|
Incorporating an exogenous large-vocabulary model into rule-based speech recognition | ||
Patent #
US 9,601,108 B2
Filed 01/17/2014
|
Current Assignee
Microsoft Technology Licensing LLC
|
Original Assignee
Microsoft Technology Licensing LLC
|
Performing machine actions in response to voice input | ||
Patent #
US 9,684,721 B2
Filed 02/23/2015
|
Current Assignee
Wolfram Alpha LLC
|
Original Assignee
Wolfram Alpha LLC
|
Mobile device configured for communicating with another mobile device associated with an associated user | ||
Patent #
US 9,712,986 B2
Filed 03/22/2012
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks LLC
|
System and method for providing network coordinated conversational services | ||
Patent #
US 9,761,241 B2
Filed 07/31/2014
|
Current Assignee
Nuance Communications Inc.
|
Original Assignee
Nuance Communications Inc.
|
Operation modes for mobile traffic optimization and concurrent management of optimized and non-optimized traffic | ||
Patent #
US 9,832,095 B2
Filed 12/14/2012
|
Current Assignee
Seven Networks LLC
|
Original Assignee
Seven Networks LLC
|
Programming in a precise syntax using natural language | ||
Patent #
US 9,851,950 B2
Filed 11/15/2012
|
Current Assignee
Wolfram Alpha LLC
|
Original Assignee
Wolfram Alpha LLC
|
Systems and methods for automatically enabling subtitles based on detecting an accent | ||
Patent #
US 9,854,324 B1
Filed 01/30/2017
|
Current Assignee
Rovi Guides Inc.
|
Original Assignee
Rovi Guides Inc.
|
SYSTEMS AND METHODS FOR AUTOMATIC REPAIR OF SPEECH RECOGNITION ENGINE OUTPUT | ||
Patent #
US 20180018960A1
Filed 07/13/2017
|
Current Assignee
AA RD LLC
|
Original Assignee
TATA Consultancy Services Limited
|
Hybrid controller for ASR | ||
Patent #
US 9,886,944 B2
Filed 10/04/2012
|
Current Assignee
Nuance Communications Inc.
|
Original Assignee
Nuance Communications Inc.
|
Method and system for controlling a user receiving device using voice commands | ||
Patent #
US 9,894,312 B2
Filed 03/15/2013
|
Current Assignee
The DIRECTV Group Inc.
|
Original Assignee
The DIRECTV Group Inc.
|
Providing data service options using voice recognition | ||
Patent #
US 9,900,743 B2
Filed 02/28/2014
|
Current Assignee
Microsoft Technology Licensing LLC
|
Original Assignee
Microsoft Technology Licensing LLC
|
Predictive content delivery | ||
Patent #
US 9,928,307 B2
Filed 04/14/2016
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks LLC
|
Configurable speech recognition system using multiple recognizers | ||
Patent #
US 9,953,653 B2
Filed 01/06/2012
|
Current Assignee
Nuance Communications Inc.
|
Original Assignee
Nuance Communications Inc.
|
Methods and systems for dynamically updating web service profile information by parsing transcribed message strings | ||
Patent #
US 9,973,450 B2
Filed 09/17/2008
|
Current Assignee
Amazon Technologies
|
Original Assignee
Amazon Technologies
|
Flexible telematics system and method for providing telematics to a vehicle | ||
Patent #
US 9,973,608 B2
Filed 03/06/2017
|
Current Assignee
Sirius Xm Connected Vehicle Services Inc.
|
Original Assignee
Sirius Xm Connected Vehicle Services Inc.
|
Multisensory speech detection | ||
Patent #
US 10,020,009 B1
Filed 12/28/2016
|
Current Assignee
Google Inc.
|
Original Assignee
Google LLC
|
Multisensory speech detection | ||
Patent #
US 10,026,419 B2
Filed 03/12/2015
|
Current Assignee
Google Inc.
|
Original Assignee
Google LLC
|
Follow-up voice query prediction | ||
Patent #
US 10,026,398 B2
Filed 07/08/2016
|
Current Assignee
Google LLC
|
Original Assignee
Google LLC
|
Speaker and call characteristic sensitive open voice search | ||
Patent #
US 10,032,454 B2
Filed 06/25/2015
|
Current Assignee
Nuance Communications Inc.
|
Original Assignee
Nuance Communications Inc.
|
Configurable speech recognition system using a pronunciation alignment between multiple recognizers | ||
Patent #
US 10,032,455 B2
Filed 01/06/2012
|
Current Assignee
Nuance Communications Inc.
|
Original Assignee
Nuance Communications Inc.
|
Configurable speech recognition system using multiple recognizers | ||
Patent #
US 10,049,669 B2
Filed 01/06/2012
|
Current Assignee
Nuance Communications Inc.
|
Original Assignee
Nuance Communications Inc.
|
Method and system for generating dynamic text responses for display after a search | ||
Patent #
US 10,067,934 B1
Filed 03/15/2013
|
Current Assignee
The DIRECTV Group Inc.
|
Original Assignee
The DIRECTV Group Inc.
|
Method and system for providing answers to queries | ||
Patent #
US 10,068,016 B2
Filed 10/17/2014
|
Current Assignee
Wolfram Alpha LLC
|
Original Assignee
Wolfram Alpha LLC
|
Method and apparatus for converting natural language to machine actions | ||
Patent #
US 10,095,691 B2
Filed 03/22/2016
|
Current Assignee
Wolfram Research Incorporated
|
Original Assignee
Wolfram Research Incorporated
|
Efficient generation of personalized spoken language understanding models | ||
Patent #
US 10,109,273 B1
Filed 08/29/2013
|
Current Assignee
Amazon Technologies
|
Original Assignee
Amazon Technologies
|
Method and system for information querying | ||
Patent #
US 10,114,893 B2
Filed 10/31/2014
|
Current Assignee
ATT Intellectual Property I LP
|
Original Assignee
ATT Intellectual Property I LP
|
Providing data service options using voice recognition | ||
Patent #
US 10,149,102 B2
Filed 02/19/2018
|
Current Assignee
Microsoft Technology Licensing LLC
|
Original Assignee
Microsoft Technology Licensing LLC
|
Systems and methods for automatically enabling subtitles based on detecting an accent | ||
Patent #
US 10,182,266 B2
Filed 11/17/2017
|
Current Assignee
Rovi Guides Inc.
|
Original Assignee
Rovi Guides Inc.
|
Flexible telematics system and method for providing telematics to a vehicle | ||
Patent #
US 10,200,520 B2
Filed 04/06/2018
|
Current Assignee
Sirius Xm Connected Vehicle Services Inc.
|
Original Assignee
Sirius Xm Connected Vehicle Services Inc.
|
Programming in a precise syntax using natural language | ||
Patent #
US 10,248,388 B2
Filed 12/22/2017
|
Current Assignee
Wolfram Alpha LLC
|
Original Assignee
Wolfram Alpha LLC
|
Enhanced customer service for mobile carriers using real-time and historical mobile application and traffic or optimization data associated with mobile devices in a mobile network | ||
Patent #
US 10,263,899 B2
Filed 04/10/2013
|
Current Assignee
Seven Networks Inc
|
Original Assignee
Seven Networks LLC
|
Incorporating an exogenous large-vocabulary model into rule-based speech recognition | ||
Patent #
US 10,311,878 B2
Filed 02/07/2017
|
Current Assignee
Microsoft Technology Licensing LLC
|
Original Assignee
Microsoft Technology Licensing LLC
|
Method and system for determining an answer to a query | ||
Patent #
US 10,380,201 B2
Filed 06/16/2017
|
Current Assignee
Wolfram Alpha LLC
|
Original Assignee
Wolfram Alpha LLC
|
Methods and systems for providing context-based recommendations | ||
Patent #
US 10,380,208 B1
Filed 12/28/2015
|
Current Assignee
Amazon Technologies
|
Original Assignee
Amazon Technologies
|
Systems and methods for automatic repair of speech recognition engine output using a sliding window mechanism | ||
Patent #
US 10,410,622 B2
Filed 07/13/2017
|
Current Assignee
AA RD LLC
|
Original Assignee
TATA Consultancy Services Limited
|
Systems and methods for recognizing and performing voice commands during advertisement | ||
Patent #
US 10,522,146 B1
Filed 07/09/2019
|
Current Assignee
Instreamatic Inc.
|
Original Assignee
Instreamatic Inc.
|
Method and system of bookmarking content in a mobile device | ||
Patent #
US 10,585,568 B1
Filed 03/15/2013
|
Current Assignee
The DIRECTV Group Inc.
|
Original Assignee
The DIRECTV Group Inc.
|
Methods and systems for providing multi-user recommendations | ||
Patent #
US 10,599,390 B1
Filed 12/28/2015
|
Current Assignee
Amazon Technologies
|
Original Assignee
Amazon Technologies
|
Programming in a precise syntax using natural language | ||
Patent #
US 10,606,563 B2
Filed 03/29/2019
|
Current Assignee
Wolfram Alpha LLC
|
Original Assignee
Wolfram Alpha LLC
|
Methods and devices for clarifying audible video content | ||
Patent #
US 10,638,203 B2
Filed 01/04/2019
|
Current Assignee
Google LLC
|
Original Assignee
Google LLC
|
Artificial intelligence voice recognition apparatus and voice recognition | ||
Patent #
US 10,657,953 B2
Filed 04/23/2018
|
Current Assignee
LG Electronics Inc.
|
Original Assignee
LG Electronics Inc.
|
Displaying information related to content playing on a device | ||
Patent #
US 10,659,850 B2
Filed 11/29/2017
|
Current Assignee
Google LLC
|
Original Assignee
Google LLC
|
Multisensory speech detection | ||
Patent #
US 10,714,120 B2
Filed 06/25/2018
|
Current Assignee
Google Inc.
|
Original Assignee
Google LLC
|
Multisensory speech detection | ||
Patent #
US 10,720,176 B2
Filed 08/22/2018
|
Current Assignee
Google Inc.
|
Original Assignee
Google LLC
|
Hybrid client/server architecture for parallel processing | ||
Patent #
US 10,749,989 B2
Filed 09/08/2014
|
Current Assignee
Microsoft Corporation
|
Original Assignee
Microsoft Technology Licensing LLC
|
Displaying a summary of media content items | ||
Patent #
US 10,762,152 B2
Filed 10/06/2017
|
Current Assignee
Google LLC
|
Original Assignee
Google LLC
|
Reminders of media content referenced in other media content | ||
Patent #
US 10,841,657 B2
Filed 07/09/2019
|
Current Assignee
Google LLC
|
Original Assignee
Google LLC
|
Method and system for generating dynamic text responses for display after a search | ||
Patent #
US 10,878,200 B2
Filed 07/30/2018
|
Current Assignee
The DIRECTV Group Inc.
|
Original Assignee
The DIRECTV Group Inc.
|
Speech recognition using phoneme matching | ||
Patent #
US 10,885,918 B2
Filed 09/18/2014
|
Current Assignee
Microsoft Technology Licensing LLC
|
Original Assignee
Microsoft Technology Licensing LLC
|
Routing call failures in a location-based services system | ||
Patent #
US 7,412,260 B2
Filed 04/26/2002
|
Current Assignee
Accenture Global Services Limited
|
Original Assignee
Accenture LLP
|
System and method for the creation and automatic deployment of personalized, dynamic and interactive inbound and outbound voice services, with real-time interactive voice database queries | ||
Patent #
US 6,885,734 B1
Filed 09/13/2000
|
Current Assignee
Microstrategy Incorporated
|
Original Assignee
Microstrategy Incorporated
|
Wireless centrex call return | ||
Patent #
US 6,711,401 B1
Filed 12/13/1999
|
Current Assignee
ATT Inc.
|
Original Assignee
ATT Inc.
|
Mobile communication and computing system and method | ||
Patent #
US 6,401,085 B1
Filed 03/05/1999
|
Current Assignee
Accenture Global Services Limited
|
Original Assignee
Accenture LLP
|
Voice-activated call placement systems and methods | ||
Patent #
US 7,127,046 B1
Filed 03/22/2002
|
Current Assignee
Google LLC
|
Original Assignee
Verizon Laboratories Incorporated, GTE Intelligent Network Services Incorporated
|
Intelligent query engine for processing voice based queries | ||
Patent #
US 6,615,172 B1
Filed 11/12/1999
|
Current Assignee
Nuance Communications Inc.
|
Original Assignee
Phoenix Solutions Incorporated
|
System and method for the creation and automatic deployment of personalized, dynamic and interactive voice services including module for generating and formatting voice services | ||
Patent #
US 6,940,953 B1
Filed 09/13/2000
|
Current Assignee
Microstrategy Incorporated
|
Original Assignee
Microstrategy Incorporated
|
Communication system for wireless communication of content to users | ||
Patent #
US 6,714,794 B1
Filed 10/30/2000
|
Current Assignee
Google Technology Holdings LLC
|
Original Assignee
Motorola Inc.
|
System and method for generating voice pages with included audio files for use in a voice page delivery system | ||
Patent #
US 6,895,084 B1
Filed 09/14/2001
|
Current Assignee
Genesys Telecommunications Laboratories Incorporated
|
Original Assignee
Microstrategy Incorporated
|
Apparatus and methods for conveying telephone numbers and other information via communication devices | ||
Patent #
US 5,651,056 A
Filed 07/13/1995
|
Current Assignee
Leon Eting, Yair Gelfer
|
Original Assignee
Leon Eting, Yair Gelfer
|
Voice control of a user interface to service applications | ||
Patent #
US 6,185,535 B1
Filed 10/16/1998
|
Current Assignee
Telefonaktiebolaget LM Ericsson
|
Original Assignee
Telefonaktiebolaget LM Ericsson
|
Methods and apparatus for activating telephone services in response to speech | ||
Patent #
US 5,719,921 A
Filed 02/29/1996
|
Current Assignee
Google LLC
|
Original Assignee
Nynex Science Technology
|
System and method for distributed real-time search | ||
Patent #
US 7,099,871 B2
Filed 03/26/2002
|
Current Assignee
Oracle America Inc.
|
Original Assignee
Sun Microsystems Incorporated
|
Method and apparatus for controlling voice controlled devices | ||
Patent #
US 6,584,439 B1
Filed 05/21/1999
|
Current Assignee
Winbond Electronics Corporation Of America
|
Original Assignee
Winbond Electronics Corporation Of America
|
Voice interface for a search engine | ||
Patent #
US 7,027,987 B1
Filed 02/07/2001
|
Current Assignee
Google LLC
|
Original Assignee
Google Inc.
|
Distributed realtime speech recognition system | ||
Patent #
US 6,633,846 B1
Filed 11/12/1999
|
Current Assignee
Nuance Communications Inc.
|
Original Assignee
Phoenix Solutions Incorporated
|
Communication devices, methods, and computer program products for transmitting information using voice activated signaling to perform in-call functions | ||
Patent #
US 6,370,506 B1
Filed 10/04/1999
|
Current Assignee
Telefonaktiebolaget LM Ericsson
|
Original Assignee
Telefonaktiebolaget LM Ericsson
|
Method of using speech recognition to initiate a wireless application protocol (WAP) session | ||
Patent #
US 7,103,550 B2
Filed 06/29/2001
|
Current Assignee
Facebook Inc.
|
Original Assignee
Mitel Networks Corporation
|
Telephone and toll-free initiated messaging business method, system and method of conducting business | ||
Patent #
US 20060004641A1
Filed 07/01/2005
|
Current Assignee
Ian Eisenberg
|
Original Assignee
Ian Eisenberg
|
System, method and technique for searching structured databases | ||
Patent #
US 20060004721A1
Filed 04/25/2005
|
Current Assignee
Apple Inc.
|
Original Assignee
Novauris Technologies Ltd.
|
Conversational networking via transport, coding and control conversational protocols | ||
Patent #
US 20060041431A1
Filed 08/18/2005
|
Current Assignee
International Business Machines Corporation
|
Original Assignee
Stephane H. Maes
|
System and method for third party specified generation of web server content | ||
Patent #
US 20060031428A1
Filed 08/06/2004
|
Current Assignee
Google LLC
|
Original Assignee
Nokia Technologies Oy
|
Information retrieval system including voice browser and data conversion server | ||
Patent #
US 20060064499A1
Filed 10/31/2005
|
Current Assignee
xAd Inc
|
Original Assignee
xAd Inc
|
Method and apparatus for providing speech recognition resolution on an application server | ||
Patent #
US 7,016,845 B2
Filed 05/30/2003
|
Current Assignee
Oracle International Corporation
|
Original Assignee
Oracle International Corporation
|
System and methods for improving accuracy of speech recognition | ||
Patent #
US 20060074671A1
Filed 10/05/2004
|
Current Assignee
iNAGO Corporation
|
Original Assignee
iNAGO Corporation
|
System for semantically disambiguating text information | ||
Patent #
US 20060074980A1
Filed 09/29/2004
|
Current Assignee
Sarkar PTE. LTD.
|
Original Assignee
Sarkar PTE. LTD.
|
Techniques for retrieving documents using an image capture device | ||
Patent #
US 20060085477A1
Filed 10/01/2004
|
Current Assignee
Ricoh Company Limited
|
Original Assignee
Ricoh Company Limited
|
User interface system and method for implementation on multiple types of clients | ||
Patent #
US 20060077941A1
Filed 06/13/2005
|
Current Assignee
Trilibis Inc.
|
Original Assignee
Trilibis Inc.
|
Apparatus, systems and methods for compensating broadcast sources | ||
Patent #
US 20060089914A1
Filed 08/30/2005
|
Current Assignee
Connor Ryan, Colm Dunphy, John Shiel
|
Original Assignee
Connor Ryan, Colm Dunphy, John Shiel
|
System and method for providing network coordinated conversational services | ||
Patent #
US 20060111909A1
Filed 12/16/2005
|
Current Assignee
Nuance Communications Inc.
|
Original Assignee
Nuance Communications Inc.
|
Reverse billing in online search | ||
Patent #
US 20060106711A1
Filed 04/01/2005
|
Current Assignee
Q tech Systems LLC
|
Original Assignee
Q tech Systems LLC
|
Multi-modal information retrieval system | ||
Patent #
US 7,054,818 B2
Filed 01/14/2004
|
Current Assignee
xAd Inc
|
Original Assignee
V-ENABLO INC.
|
Vendor-driven, social-network enabled review collection system | ||
Patent #
US 20060143068A1
Filed 12/23/2004
|
Current Assignee
Chemtron Research LLC
|
Original Assignee
Diamond Review Incorporated
|
Method and system for globally sharing and transacting contents in local area | ||
Patent #
US 20060129578A1
Filed 12/13/2005
|
Current Assignee
Samsung Electronics Co. Ltd.
|
Original Assignee
Samsung Electronics Co. Ltd.
|
Predictive information retrieval | ||
Patent #
US 20060122976A1
Filed 12/03/2004
|
Current Assignee
Google Inc.
|
Original Assignee
Google Inc.
|
Ranking Internet Search Results Based on Number of Mobile Device Visits to Physical Locations Related to the Search Results | ||
Patent #
US 20060123014A1
Filed 12/07/2004
|
Current Assignee
David Ng
|
Original Assignee
David Ng
|
Personalized content processing and delivery system and media | ||
Patent #
US 20060123053A1
Filed 12/01/2005
|
Current Assignee
Insignio Technologies Incorporated
|
Original Assignee
Insignio Technologies Incorporated
|
Systems and methods for selecting digital advertisements | ||
Patent #
US 20060123001A1
Filed 11/09/2005
|
Current Assignee
Copernic Technologies Inc.
|
Original Assignee
Copernic Technologies Inc.
|
User interaction with voice information services | ||
Patent #
US 20060143007A1
Filed 10/31/2005
|
Current Assignee
Microsoft Technology Licensing LLC
|
Original Assignee
Microsoft Technology Licensing LLC
|
Content management interface | ||
Patent #
US 20060165104A1
Filed 11/10/2004
|
Current Assignee
Elazar Moshe Kaye
|
Original Assignee
Elazar Moshe Kaye
|
Method and apparatus for distributed speech applications | ||
Patent #
US 20060146728A1
Filed 12/30/2004
|
Current Assignee
Google Technology Holdings LLC
|
Original Assignee
Motorola Inc.
|
Method and apparatus for selective distributed speech recognition | ||
Patent #
US 7,076,428 B2
Filed 12/30/2002
|
Current Assignee
Google Technology Holdings LLC
|
Original Assignee
Motorola Inc.
|
Multi-modal information delivery system | ||
Patent #
US 20060168095A1
Filed 01/22/2003
|
Current Assignee
xAd Inc
|
Original Assignee
xAd Inc
|
Systems and methods for contextual transaction proposals | ||
Patent #
US 20060167857A1
Filed 05/12/2005
|
Current Assignee
Excalibur IP LLC
|
Original Assignee
Yahoo Inc.
|
Methods and apparatus for automatically extending the voice vocabulary of mobile communications devices | ||
Patent #
US 20060173683A1
Filed 02/03/2006
|
Current Assignee
Volce Signal Technologies Incorporated
|
Original Assignee
Voice Signal Technologies Incorporated
|
System and method to merge pay-for-performance advertising models | ||
Patent #
US 20060184417A1
Filed 03/09/2005
|
Current Assignee
Thryv Inc.
|
Original Assignee
YellowPages.com LLC
|
Dynamic bidding, acquisition and tracking of e-commerce procurement channels for advertising and promotional spaces on wireless electronic devices | ||
Patent #
US 20060190385A1
Filed 03/17/2006
|
Current Assignee
Scott Dresden
|
Original Assignee
Scott Dresden
|
System and method for aggregating, delivering and sharing audio content | ||
Patent #
US 20060190616A1
Filed 02/03/2006
|
Current Assignee
VOICEINDIGO INC.
|
Original Assignee
VOICEINDIGO INC.
|
Content searching and configuration of search results | ||
Patent #
US 20060184512A1
Filed 02/17/2005
|
Current Assignee
Microsoft Technology Licensing LLC
|
Original Assignee
Microsoft Corporation
|
Method and apparatus utilizing voice input to resolve ambiguous manually entered text input | ||
Patent #
US 20060190256A1
Filed 02/07/2006
|
Current Assignee
Cerence Inc.
|
Original Assignee
Tegic Communications Inc.
|
Dynamic learning for navigation systems | ||
Patent #
US 20060200442A1
Filed 02/24/2006
|
Current Assignee
Hitel Technologies LLC
|
Original Assignee
Prashant Parikh
|
Methods and apparatuses for sorting lists for presentation | ||
Patent #
US 20060200380A1
Filed 03/03/2005
|
Current Assignee
Thryv Inc.
|
Original Assignee
UTBK Inc.
|
Systems and methods for advertising payments | ||
Patent #
US 20060242007A1
Filed 04/20/2005
|
Current Assignee
Kian Fai Leong, Joseph Park, Jason Liu
|
Original Assignee
Kian Fai Leong, Joseph Park, Jason Liu
|
Method and system for active ranking of browser search engine results | ||
Patent #
US 20060242129A1
Filed 03/09/2006
|
Current Assignee
HERE Global B.V.
|
Original Assignee
Medio Systems Inc.
|
Wireless device to access network-based voice-activated services using distributed speech recognition | ||
Patent #
US 20060235684A1
Filed 04/14/2005
|
Current Assignee
Sbc Knowledge Ventures L.P.
|
Original Assignee
Sbc Knowledge Ventures L.P.
|
Nonstandard locality-based text entry | ||
Patent #
US 20060230350A1
Filed 06/30/2005
|
Current Assignee
Google LLC
|
Original Assignee
Google Inc.
|
METHOD AND SYSTEM OF PROVIDING LOCATION SENSITIVE BUSINESS INFORMATION TO CUSTOMERS | ||
Patent #
US 20050015307A1
Filed 04/27/2004
|
Current Assignee
Call Genie Inc.
|
Original Assignee
Call Genie Inc.
|
Spoken language interface | ||
Patent #
US 20050033582A1
Filed 08/27/2003
|
Current Assignee
Vox Generation Ltd.
|
Original Assignee
Vox Generation Ltd.
|
System, method and computer program product for presenting directed advertising to a user via a network | ||
Patent #
US 20050033641A1
Filed 08/05/2004
|
Current Assignee
Google Inc.
|
Original Assignee
Google LLC
|
Mapping method and system | ||
Patent #
US 20050027705A1
Filed 05/19/2004
|
Current Assignee
Oath Inc.
|
Original Assignee
Oath Inc.
|
Method and apparatus for delivering personalized search results | ||
Patent #
US 20050076003A1
Filed 07/14/2004
|
Current Assignee
ADAPTIVE SEARCH LLC
|
Original Assignee
ADAPTIVE SEARCH LLC
|
Delivery, organization, and redemption of virtual offers from the internet, interactive-tv, wireless devices and other electronic means | ||
Patent #
US 20050075932A1
Filed 11/23/2004
|
Current Assignee
Jeffrey W. Mankoff
|
Original Assignee
Jeffrey W. Mankoff
|
Retrieving and formatting information | ||
Patent #
US 20050097003A1
Filed 10/05/2004
|
Current Assignee
Jon Jason Linker
|
Original Assignee
Jon Jason Linker
|
Passive mining of usage information in a location-based services system | ||
Patent #
US 20050102180A1
Filed 12/08/2004
|
Current Assignee
Accenture Global Services Limited
|
Original Assignee
Accenture LLP
|
Method and apparatus to compensate demand partners in a pay-per-call performance based advertising system | ||
Patent #
US 20050165666A1
Filed 12/23/2004
|
Current Assignee
Thryv Inc.
|
Original Assignee
UTBK Inc.
|
Transferring data between devices | ||
Patent #
US 20050190269A1
Filed 06/18/2004
|
Current Assignee
Nokia Corporation
|
Original Assignee
Nokia Corporation
|
Method and system for arbitrating between a local engine and a network-based engine in a mobile communication network | ||
Patent #
US 20050215260A1
Filed 03/23/2004
|
Current Assignee
Motorola Inc.
|
Original Assignee
Motorola Inc.
|
System and method for compounded marketing | ||
Patent #
US 20050203800A1
Filed 01/07/2005
|
Current Assignee
Sharenet Inc.
|
Original Assignee
Sharenet Inc.
|
System and method for comprehensive service translation | ||
Patent #
US 20050220139A1
Filed 03/30/2004
|
Current Assignee
III Holdings 3 LLC
|
Original Assignee
Nokia Corporation
|
Methods and apparatuses for geographic area selections in pay-per-call advertisement | ||
Patent #
US 20050222908A1
Filed 03/30/2005
|
Current Assignee
Thryv Inc.
|
Original Assignee
UTBK LLC
|
Configurable browser for adapting content to diverse display types | ||
Patent #
US 20040012627A1
Filed 07/17/2002
|
Current Assignee
Nokia Corporation
|
Original Assignee
Nokia Corporation
|
Broadcast content over cellular telephones | ||
Patent #
US 20040043770A1
Filed 08/14/2003
|
Current Assignee
VIVEN LTD.
|
Original Assignee
VIVEN LTD.
|
Methods and apparatus for serving relevant advertisements | ||
Patent #
US 20040059708A1
Filed 12/06/2002
|
Current Assignee
Google LLC
|
Original Assignee
Google Inc.
|
Visual content browsing using rasterized representations | ||
Patent #
US 6,704,024 B2
Filed 11/29/2000
|
Current Assignee
DigiMedia Tech LLC
|
Original Assignee
Zframe Inc.
|
Apparatus and method for accessing services via a mobile terminal | ||
Patent #
US 20040075675A1
Filed 10/17/2002
|
Current Assignee
Nokia Corporation
|
Original Assignee
Nokia Corporation
|
Method and device for interfacing a driver information system using a voice portal server | ||
Patent #
US 6,721,633 B2
Filed 03/01/2002
|
Current Assignee
Robert Bosch GmbH
|
Original Assignee
Robert Bosch GmbH
|
Method and apparatus for selective distributed speech recognition | ||
Patent #
US 20040128135A1
Filed 12/30/2002
|
Current Assignee
Google Technology Holdings LLC
|
Original Assignee
Motorola Inc.
|
Content distribution system | ||
Patent #
US 20040143667A1
Filed 01/17/2003
|
Current Assignee
RELEVANT MEDIA PHO LLC
|
Original Assignee
Relevant Media LLC
|
Methods and systems for search indexing | ||
Patent #
US 20040133564A1
Filed 09/03/2003
|
Current Assignee
Future Search Holdings Incorporated
|
Original Assignee
X1 Technologies Incorporated
|
Speech recognition conversation selection device, speech recognition conversation system, speech recognition conversation selection method, and program | ||
Patent #
US 20040162731A1
Filed 11/04/2003
|
Current Assignee
NEC Corporation
|
Original Assignee
NEC Corporation
|
Phonetically based speech recognition system and method | ||
Patent #
US 20040193408A1
Filed 03/31/2003
|
Current Assignee
Apple Inc.
|
Original Assignee
Aurilab LLC
|
Mobile systems and methods for responding to natural language speech utterance | ||
Patent #
US 20040193420A1
Filed 07/15/2003
|
Current Assignee
Nuance Communications Inc.
|
Original Assignee
VoiceBox Technologies Corporation
|
System and method for multimodal short-cuts to digital sevices | ||
Patent #
US 20040176958A1
Filed 02/04/2002
|
Current Assignee
Nokia Technologies Oy
|
Original Assignee
Nokia Technologies Oy
|
Automatic control of simultaneous multimodality and controlled multimodality on thin wireless devices | ||
Patent #
US 20040214555A1
Filed 02/25/2004
|
Current Assignee
xAd Inc
|
Original Assignee
xAd Inc
|
Population of directory search results into a wireless mobile phone | ||
Patent #
US 20040203642A1
Filed 05/31/2002
|
Current Assignee
Wildseed Ltd.
|
Original Assignee
Wildseed Ltd.
|
Selective enablement of speech recognition grammars | ||
Patent #
US 20030046074A1
Filed 06/15/2001
|
Current Assignee
Nuance Communications Inc.
|
Original Assignee
International Business Machines Corporation
|
System for automatically generating queries | ||
Patent #
US 20030069877A1
Filed 12/05/2001
|
Current Assignee
III Holdings 6 LLC
|
Original Assignee
Xerox Corporation
|
Method of organizing information into topical, temporal, and location associations for organizing, selecting, and distributing information | ||
Patent #
US 20030200192A1
Filed 04/18/2002
|
Current Assignee
Global Science Technology Incorporated
|
Original Assignee
Global Science Technology Incorporated
|
System and method for attaching an advertisement to an SMS message for wireless transmission | ||
Patent #
US 6,381,465 B1
Filed 09/20/1999
|
Current Assignee
Intel Corporation
|
Original Assignee
Leap Wireless International Incorporated
|
Apparatus and methods for intelligently providing applications and data on a mobile device system | ||
Patent #
US 20020078209A1
Filed 12/15/2000
|
Current Assignee
Qualcomm Inc.
|
Original Assignee
InnoPath Software Inc.
|
Detection of characteristics of human-machine interactions for dialog customization and analysis | ||
Patent #
US 20020095295A1
Filed 01/11/2002
|
Current Assignee
Nuance Communications Inc.
|
Original Assignee
Nuance Communications Inc.
|
Voice control system with multiple voice recognition engines | ||
Patent #
US 20020091518A1
Filed 12/07/2001
|
Current Assignee
Art Advancec Recognition Technologies Inc.
|
Original Assignee
Art Advancec Recognition Technologies Inc.
|
Methods, systems, and computer program products for generating and providing access to end-user-definable voice portals | ||
Patent #
US 20020146015A1
Filed 03/06/2001
|
Current Assignee
Topic Radio Incorporated
|
Original Assignee
Topic Radio Incorporated
|
Method for maintaining remotely accessible information on personal digital devices | ||
Patent #
US 20020174110A1
Filed 05/16/2001
|
Current Assignee
MediaTek Inc.
|
Original Assignee
International Business Machines Corporation
|
Methods and apparatus for providing speech recognition services to communication system users | ||
Patent #
US 20010036255A1
Filed 05/07/2001
|
Current Assignee
Google LLC
|
Original Assignee
Hitachi America Limited
|
TTS and prosody based authoring system | ||
Patent #
US 6,081,780 A
Filed 04/28/1998
|
Current Assignee
International Business Machines Corporation
|
Original Assignee
International Business Machines Corporation
|
Data acquisition and error correcting speech recognition system | ||
Patent #
US 6,154,526 A
Filed 12/03/1997
|
Current Assignee
Voicecom Telecommunications LLC
|
Original Assignee
Intellivoice Communications Incorporated
|
Distributed voice recognition system | ||
Patent #
US 5,956,683 A
Filed 04/04/1996
|
Current Assignee
Qualcomm Inc.
|
Original Assignee
Qualcomm Inc.
|
Apparatus for generating text data on the basis of speech data input from terminal | ||
Patent #
US 5,956,681 A
Filed 11/06/1997
|
Current Assignee
Vlingo Corporation
|
Original Assignee
Casio Computer Company Limited
|
20 Claims
-
1. A method of performing a search originating from a mobile device, the method comprising:
-
receiving a signal from the mobile device that includes a representation of an utterance from a user of the mobile device, wherein the utterance includes a search request; using speech recognition software to convert the search request into a text search request; extracting side information contained within the received signal, wherein the side information is represented implicitly within the received signal; using the extracted side information to assign the user of the mobile device to a user category; sending the text search request and the user category to one or more content providers; receiving from the one or more content providers content that is responsive to the text search request and the user category; and sending search results to the mobile device, wherein the search results are based on the received content from the one or more content providers. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13)
-
-
14. A method of performing a search originating from a mobile device, the method comprising:
-
receiving a signal from the mobile device that includes a representation of an utterance from a user of the mobile device, wherein the utterance includes a search request; using speech recognition software to convert the spoken search request into a text search request; extracting side information contained within the received signal, wherein the side information is represented implicitly within the received signal; using the extracted side information to assign the user of the mobile device to a user category; sending the text search request to one or more content providers; sending the text search request and the user category to one or more advertising providers; receiving from the one or more content providers search results, the search results including a plurality of items that are responsive to the text search request; receiving from the one or more advertising providers one or more advertisements that are based at least in part on the text search request and on the user category; and sending at least one of the plurality of items and at least one of the advertisements to the mobile device.
-
-
15. A server system comprising a processor system and a memory system, the memory system including instructions which, when executed on the processor system cause the server system to:
-
receive a signal from a mobile device that includes a representation of an utterance from a user of the mobile device, wherein the utterance includes a search request; recognize the search request within the utterance; convert the recognized search request into a text search request; extract side information contained within the received signal, wherein the side information is represented implicitly within the received signal; use the extracted side information to assign the user of the mobile device to a user category; send the text search request and the user category to one or more content providers; receive from the one or more content providers content that is responsive to the text search request and the user category; and send search results to the mobile device, wherein the search results are based on the received content from the one or more content providers. - View Dependent Claims (16, 17, 18, 19)
-
-
20. A server system comprising a processor system and a memory system, the memory system including instructions which, when executed on the processor system cause the server system to:
-
receive a signal from a mobile device that includes a representation of an utterance from a user of the mobile device, wherein the utterance includes a search request; recognize the search request within the utterance; convert the recognized search request into a text search request; extract side information contained within the received signal, wherein the side information is represented implicitly within the received signal; use the extracted side information to assign the user of the mobile device to a user category; send the text search request to one or more content providers; send the text search request and the user category to one or more advertising providers; receive from the one or more content providers search results, the search results including a plurality of items that are responsive to the text search request; receive from the one or more advertising providers one or more advertisements that are based at least in part on the text search request and on the user category; and send at least one of the plurality of items and at least one of the advertisements to the mobile device.
-
1 Specification
This application is a continuation of application Ser. No. 11/673,341, filed Feb. 9, 2007, and claims the benefit of U.S. Provisional Application No. 60/877,146, filed Dec. 26, 2006, both of which are incorporated herein by reference.
This invention relates generally to wireless communication devices with speech recognition capabilities.
In addition to serving as wireless telephones for making phone calls, wireless communication devices, such as cell phones, can enable users to obtain access to information. Typically, such phones offer the user access to a web browser to access the Internet. But accessing information using a cell phone can be awkward, unreliable, slow, and costly.
Most cell phones have small keypads that are principally designed for keying in phone numbers or short SMS messages. This makes it cumbersome for a user to enter a request for information. In addition, most cell phones have a small display, which constrains the quality and quantity of information that can be displayed. Furthermore, access to the World Wide Web (Web) usually involves navigating through menu hierarchies before the user can access the Web browser application on his phone.
Since cell phones access information via a mobile carrier network, reliability can become a problem when a user travels outside the range of their mobile carrier'"'"'s signal, such as in a tunnel or to a remote location. Slow response to information requests can also be frustrating for the user. Such slow responses stem, in part, from inherent data transmission latency associated with each menu choice. Cost can also be an issue because the user typically uses billed “air time” for the duration of the information access session.
The described embodiment extracts and uses side information included within a spoken search request to enhance a mobile search capability for a user of a mobile communications device. In general, in one aspect, the described embodiment includes performing a search originating from a mobile device, the search involving: receiving a signal from the mobile device that includes a representation of an utterance from a user of the mobile device, the utterance including a search request; using speech recognition software to convert the search request into a text search request; extracting side information contained within the received signal, the side information being represented implicitly within the received signal; using the extracted side information to assign the user of the mobile device to a user category; sending the text search request and the user category to content providers; receiving from the content providers content that is responsive to the text search request and the user category; and sending search results to the mobile device, the search results being based on the received content from the content providers.
The described embodiment may further include one or more of the following: sending the recognized text search request to advertising providers, receiving from the advertising providers advertisements that are based at least in part on the sent text search request, and sending at least one of the received advertisements to the mobile device; sending the user category to the advertising providers, and receiving from the advertising providers content that is based at least in part on the sent user category. The user category includes gender, age range, accent, dialect, and an emotional state of the user. The side information includes information about an environment in which the user is operating the mobile device, including the inside of a vehicle, a quiet location, a noisy location, and a shared workplace. The content received from the content providers includes a plurality of items and the embodiment further includes determining a degree of responsiveness of each of the items, the degree of responsiveness being based at least in part on the user category. The plurality of items are ranked, the rank of each item being based on its degree of responsiveness, and the search results include a ranked list of the plurality of items. A subset of the plurality of items is selected, the subset including items having a degree of responsiveness greater than a threshold degree of responsiveness, the search results including the subset of items.
In general, in another aspect, the described embodiment includes performing a search originating from a mobile device, the search involving: receiving a signal from the mobile device that includes a representation of an utterance from a user of the mobile device, the utterance including a search request; using speech recognition software to convert the spoken search request into a text search request; extracting side information contained within the received signal, the side information being represented implicitly within the received signal; using the extracted side information to assign the user of the mobile device to a user category; sending the text search request to content providers; sending the text search request and the user category to advertising providers; receiving from the content providers search results, the search results including a plurality of items that are responsive to the text search request; receiving from the advertising providers advertisements that are based at least in part on the text search request and on the user category; and sending at least one of the plurality of items and at least one of the advertisements to the mobile device.
In general, in further aspect, the described embodiment includes a server system comprising a processor system and a memory system, the memory system including instructions which, when executed on the processor system cause the server system to: receive a signal from a mobile device that includes a representation of an utterance from a user of the mobile device, the utterance including a search request; recognize the search request within the utterance; convert the recognized search request into a text search request; extract side information contained within the received signal, the side information being represented implicitly within the received signal; use the extracted side information to assign the user of the mobile device to a user category; send the text search request and the user category to one or more content providers; receive from the content providers content that is responsive to the text search request and the user category; and send search results to the mobile device, the search results being based on the received content from the one or more content providers.
The instructions further cause the server system to send the recognized text search request to advertising providers, receive from the advertising providers advertisements that are based at least in part on the sent text search request; and send at least one of the advertisements from the advertising providers to the mobile device. The stored instructions may further cause the server system to send the user category to the advertising providers and receive from the advertising providers content that is based at least in part on the sent user category. The categories include the user'"'"'s gender, age range, accent, dialect and emotional state. They also include information about the environment in which the user is operating the mobile device.
In another aspect, an embodiment includes a server system including a processor system and a memory system, the memory system including instructions which, when executed on the processor system cause the server system to: receive a signal from a mobile device that includes a representation of an utterance from a user of the mobile device, the utterance including a search request; recognize the search request within the utterance; convert the recognized search request into a text search request; extract side information contained within the received signal, the side information being represented implicitly within the received signal; use the extracted side information to assign the user of the mobile device to a user category; send the text search request to content providers; send the text search request and the user category to advertising providers; receive from the content providers search results, the search results including a plurality of items that are responsive to the text search request; receive from the one or more advertising providers one or more advertisements that are based at least in part on the text search request and on the user category; and send at least one of the plurality of items and at least one of the advertisements to the mobile device.
The described embodiment is a mobile device and server system that provides a user of the mobile device with voice-mediated access to a wide range of information, such as directory assistance, financial data, or to search the Web. In general, this information is not stored on the device itself, but is stored on any server or other device to which the mobile device has access either via predetermined relationship, or via a public access network, such as the Internet. The system allows the user to activate this functionality in a single step by pressing a button that launches voice-mediated search application software on the device or, alternatively, by using other input means supported by the mobile device. Execution of the voice-mediated search application software causes the device to display a main voice command menu that includes voice-mediated search commands along with voice command and control commands. The user invokes the device'"'"'s search functionality by uttering a search command, such as, for example “Directory Assistance.” The device recognizes the command, and, for certain search commands, elicits further information from the user. In the directory assistance example, it asks “What city and state?” and “What listing?” The search application then opens a wireless data connection to a transaction server, and sends it a representation of the user'"'"'s spoken answers. The transaction server receives the audio from the device, and forwards it to a speech recognizer, which converts the audio into text and returns it to the transaction server. The transaction server then forwards the user'"'"'s information request, now in text form, to an appropriately selected content provider. The content provider searches for and retrieves the requested information, and sends its search results back to the transaction server. The transaction server then processes the search results and sends the results along with the user'"'"'s search request and information about the user to one or more advertising providers. These providers offer advertisements back to the transaction server, which selects optimally targeted advertisements to combine with the search results. The transaction server then sends search results and advertisements to the mobile device. The device'"'"'s voice-mediated search software displays the results to the user as text, graphics, and video and, optionally as audio output of synthesized speech, sounds, or music.
The block diagram and information flows shown in
Mobile device 102 (
Device 102 includes voice application software that, when invoked, confers voice activation capability on the device. When the device is powered on, it displays an “idle screen,” that includes date, time, and a means of reaching a command menu. At this point, the device has no voice recognition capability. From the idle screen, the user invokes the voice application software by pressing dedicated voice activation button 104, or by using one or more of the keys on a device that lacks a dedicated button. The device and the voice application are designed so that the user can always voice-activate the device with a single press of button 104, or by other straightforward actions, such as by flipping open a clamshell phone, using one or more standard key presses, or via other input means supported by the mobile device.
When the user launches the voice application software, it causes device 102 to display main voice command menu 200 (
Main voice command menu 200 includes “command and control” commands 202 for controlling and operating device 102, such as commands for placing a phone call, sending an email, or sending a text message. Menu 200 also includes search commands 204. As shown in
VMSA 106 implements the mobile search functionality of device 106. This includes: determining what type of search the user is requesting; managing the search-related speech recognition on the device; opening an IP connection to a remote server, if needed, to fulfill the search request; processing and sending the search query over the connection to the server; maintaining a log of the user'"'"'s actions taken in response to received search results and advertisements; and receiving and displaying the search results. These functions are described in the paragraphs that follow.
When the user utters one of the search commands, device 102 performs the speech recognition for the command words listed on main voice command menu 200. For example, for search commands 204, the device recognizes the utterances “search ringtones,” “directory assistance,” and “search.” The voice application software on the device determines that the user is making a mobile search request, and activates VMSA 106. The subsequent actions that VMSA 106 takes depend on the type of search request that the user has made. The main voice command menu includes two types of voice search commands—guided search commands 206, such as “search ringtones” and “directory assistance,” and the open search command “search” 208. We describe each in turn next.
Guided search commands 206 uses voice and text prompts to guide the user through a directed dialog in order to elicit the information required in order to fulfill his search for information. For example, when the user says “search ringtones,” the device responds with a spoken and displayed prompt “what artist?” The user then speaks the name of the artist. The device captures the user'"'"'s spoken answer, transmits it to remote servers that recognize the speech and retrieve the available ring tones that correspond to the user'"'"'s selected artist. The servers return the results to device 102, which then displays one or more screens of ringtone choices. The user can select a ringtone, and the device then downloads his selection to the device.
When VMSA 106 recognizes that the user has requested one of guided search commands 106, the user has explicitly told the device what category of search he desires. The mobile search system exploits this knowledge in a number of ways in order to improve the quality of its response to the user'"'"'s request, and also to maximize monetization of the transaction. We describe these actions below in connection with the transaction server. The actions that take place on device 102 that are determined by the search category include the selection of a category-specific search grammar for guiding the search dialog, and special software to display and/or speak the results of the search. In addition to the two commands 206 referred to above, other examples of guided searches include searches for sports results, weather conditions and forecasts, and news headlines.
When mobile device 102 is shipped from the factory, it is provisioned with a factory set of guided search commands. In the example shown in
Should the user wish to prune his list of gate search commands, he can delete one or more such commands from the device'"'"'s main voice command menu 200. Removal of gate commands can also be performed by the mobile search provider as part of a service agreement of the kind mentioned above. Removal of obsolete gate commands can help simplify the user'"'"'s voice-mediated search menu and help the user to access the most up-to-date search functionality on his mobile device.
In contrast to the guided search commands, open search command 208 is invoked when the user speaks a single, continuous utterance starting with the word “search.” Device 102 recognizes the word “search” and sends the utterance that follows to one or more remote servers for speech recognition and further handling of the search query. Unlike guided search, open search does not prompt the user with a dialog requesting further search information. As such, the open search command serves as an “expert” search mode, where the user already knows what information the system needs in order to return the desired result. For such a user, being able to complete a search request with a single utterance is convenient and fast because there is no need to pause for guided dialog prompts, or suffer any delays or system latencies associated with the multiple steps of the guided dialog.
Open search command 208 also serves to offer almost unlimited search capability to the device user. Rather than being tied to the information searches that are targeted by guided search commands 206, open search allows the user to utter any search request without restriction. As discussed in detail below, a remote automatic speech recognition server checks an open search command utterance to see if it can classify it as one of the categories represented by a guided search, or as any one of a number of search categories known to a remote server. If it is unable to identify the user'"'"'s open search request as belonging to a known category, the remote servers default to a true open search procedure, which invokes a large vocabulary speech recognizer located on a remote automatic speech recognition server to generate text that the system forwards to a general-purpose content provider.
Within each mobile search dialog, VMSA 106 running on device 102 performs some of the speech recognition task locally, and passes on the remainder to a remote server. As mentioned above, the device recognizes the gate search commands locally without the need for any external assistance. In addition, the VMSA has the capacity to recognize whether the user of the device repeats the same voice search queries frequently, and to train itself so as to recognize such queries locally. The number of such locally recognizable voice queries increases as a function of the processing power and memory capacity of device 102. VMSA 106 also has the ability to add to its speech recognition capability by receiving from a remote server speech recognition information that enables it to perform local speech recognition of complete search requests or of parts of spoken search requests. As described below in the section on Personal Yellow Pages, it receives such capability for certain frequent search requests.
Although the speech recognizer on mobile device 102 cannot match the vocabulary, accuracy, and speed of a dedicated large vocabulary automatic speech recognition server, it functions in an environment where it is often possible to simplify the speech recognition task either by limiting the number of allowed utterances or by making predictions based on the way the user has used his device in the past. In general, it is desirable to perform as much speech recognition as possible on device 102 without invoking the assistance of a remote recognition server. There are two main reasons for this. First, speech that is recognized locally is not subject to delays that occur when the device sends speech over a wireless connection to one or more remote servers for processing, and receives the recognized text back over the wireless connection. Second, local speech recognition reduces the computational load placed on remote recognition servers, and takes advantage of local processing power on the mobile device. With hundreds of millions of mobile devices, each with its own processing capacity, there is a considerable saving in the required server speech recognition capacity for each increment in locally performed speech recognition.
When VMSA 106 determines that it needs a data connection to a remote server in order to fulfill a mobile voice search command, it causes device 102 to send a message via the wireless carrier to open connection 108 using the TCP/IP protocol to transaction server 110 (See
Although data connection 108 is a wireless connection when the device is not connected by other means to transaction server 110 or to other remote resources, the connection can be a wired or fixed connection when such connections are available to the mobile device. For example, when the user is at home or in an office, he can physically connect mobile device 102 to a data connection, such as a local area network, and achieve higher connection speeds than those typically offered by wireless carriers.
When VMSA 106 determines that the device needs to transmit audio information to transaction server 110 in order to fulfill a mobile search request, it performs signal-processing functions on the audio captured by device 102 to extract speech features that are a compact representation of the user'"'"'s search utterance. The representation includes any of the speech representations that are well known in the field of speech recognition, such as, for example, the mel frequency cepstrum coefficients and linear predictive coding. It also collects other information relating to the device and the user, which we refer to as metadata, and transmits both the speech features and the metadata over data connection 108 to transaction server 110.
Metadata is of two types: explicit and implicit. Explicit metadata includes data such as: the make and model of device 102; a unique identifier of the user of the device; and the geographical location of the device, if that is available from built-in GPS functionality. Implicit metadata, which we refer to as side information, is contained within the audio captured by the phone. Side information constitutes aspects of the captured audio stream that are not essential to speech recognition. Examples of side information contained within the audio stream include information that corresponds to the user'"'"'s gender, age range, accent, dialect, and emotional state. The side information also includes information about the environment in which the user is operating the mobile device. For example, the user could be operating the phone inside a vehicle, in a quiet location such as in a home or a quiet office or in a noisy location. Noisy locations include offices with nearby coworkers or noise-producing machinery such as printers and conditioning systems, and public locations such as stores, shopping malls, railway stations, and airports. Side information is preserved when the device performs its signal-processing functions, and is therefore contained within the speech features that the mobile device transmits over connection 108 to transaction processor 110.
When transaction server 110 returns the voice search results and associated advertising content to mobile device 102, VMSA 106 receives the information and presents it to the user as text and graphics on the device'"'"'s display, and also, where appropriate, as an audio or a video message.
Transaction server 110 serves as the hub of the voice-mediated mobile search service. It communicates with one or more speech recognition servers 112 (
In general, search management software 118 running on transaction server 110 receives audio and metadata from mobile device 102 via connection 108, and passes the audio and metadata on to automatic speech recognizer (ASR) server 112 via connection 120. ASR Server 112 performs speech recognition on the audio, using the metadata when it can in order to improve recognition accuracy. ASR server optionally forwards the audio and metadata on to live (human) agents 122 via connection 124. Live agents return text and categories derived from side information to ASR server 112 via connection 128. ASR server 112 returns text and categories derived from side information to transaction server 110 via connection 126. Search management software 118 uses metadata and knowledge of the search category to select one or more content providers 114a, b, c to service the search request, and sends them the text search query and metadata over connection 130. Content providers 114a,b,c retrieve the requested content, and return the results to transaction server 110 over connection 132. The transaction server selects and prioritizes the received content by using the metadata and commerce information, such as special offers or time-sensitive opportunities. The transaction server also has the option to send search results, the search query, metadata, and user history information to one or more advertising providers 116a, b, c over connection 134. The advertising providers return potential advertisements and pricing information back to the transaction server over connection 136. The transaction server selects an advertisement, combines it with the search results in an appropriate format, and transmits the results and advertisement over connection 138 to mobile device 102. VMSA 106 then receives the results and presents them to the user. We now describe these steps in detail.
Although data connection 138 is a wireless connection when mobile device 102 is not connected by other means to transaction server 110 or to other remote resources, the connection can be a wired or fixed connection when such connections are available to the mobile device. For example, when the user is at home or in an office, he can physically connect mobile device 102 to a data connection, such as a local area network, and achieve higher connection speeds than those typically offered by wireless carriers.
As described above, when VMSA 106 needs to invoke resources outside the device itself in order to fulfill a voice-mediated search query, it opens data connection 108 and sends speech features and metadata to transaction server 110. It also lets the transaction server know which kind of voice search command it has recognized, i.e., whether it is one of guided search commands 206, or open search command 208. The transaction server forwards the voice search command type, as well as the speech features to ASR server 112.
When ASR server 112 receives audio and metadata associated with one of the guided search commands 208, it already knows the category of the search. This information specifies the guided dialog, and the database of allowed responses for each prompt. For example, the “SEARCH RINGTONES” command is followed by a “WHAT ARTIST?” prompt, and the subsequent speech is expected to be an artist name. If the user says “Madonna,” the ASR server attempts to recognize the received audio against its database of artists for which ringtones are available. The ASR server obtain a high recognition confidence measure because it only matches against a small vocabulary. Similarly, if the ASR receives audio associated with a guided dialog in a “DIRECTORY ASSISTANCE” command followed by a “WHAT STATE?” prompt, it searches for matches in its database of state names, and after the prompt “WHAT CITY” it uses a database of city names in the identified state.
Although ASR server 112 can usually achieve a high confidence measure when recognizing speech that is uttered in response to a guided search prompt, it can encounter difficulties in special circumstances. For example, the user may not speak clearly, or may have a strong accent. Background noise, such as passing airplane, might obscure the speech. In these situations, ASR server 112 may be able to improve the confidence measure of speech recognition by using the metadata. For example, explicit metadata that contains the home address of the user may bias recognition in favor of a listing near the city where he resides. If the ASR has access to the phone'"'"'s geographic location via GPS, it might also be able to use that information to improve recognition accuracy of a spoken city or state name.
When the user speaks a single utterance starting with the word “search,” he invokes open search command 208. ASR Server 112 receives the speech features corresponding to a continuous utterance corresponding to a complete spoken search request via transaction server 110. In contrast to guided search, the ASR server receives no explicit search category information.
In general, the open recognizer automatically attempts to determine whether an open search belongs to a predetermined search category. It does this because several important benefits accrue from knowing the search category. First, ASR Server 112 can use one of the guided search grammars, which improves its speech recognition accuracy over what it could achieve using a general purpose large vocabulary recognizer where it would not be able to search a limited database of allowed responses. Second, the ASR Server returns the search category to transaction server 110, which can then determine the one or more content providers that best suit that search category, as described in detail below. This helps to optimize the quality and responsiveness of the search results. Third, advertising providers 116 are better able to target their advertisements to a mobile device user when they know what category of search he has requested and what type of results he is going to receive. Fourth, knowledge of the search category allows transaction server 110 to perform category-specific extraction of results from selected content providers 114, and custom-format these results for rendering on mobile device 102.
Predetermined speech categories include, but are not limited to those categories that correspond to guided gate search commands 206. Transaction server 110 and ASR Server 112 are configured to handle up to about one hundred predetermined search categories. Each category is associated with a speech recognition grammar, one or more suitable content providers and advertising providers, and custom result extraction and rendering software on the transaction server, as described in the previous paragraph. Examples of predetermined categories include stock quotes, weather forecasts, and sports news. Predetermined search categories can be added or removed from the transaction server and ASR server without the need to communicate with mobile device 102. Thus the user'"'"'s ability to obtain quality results from automatic category detection in open searches can be enhanced remotely without the user being aware of the change and without the need for device 102 to download additional gate commands or search dialogs over the air.
In the described embodiment, the open recognizer 410 includes a vocabulary of about 50,000 words and uses a language model to help improve speech recognition accuracy. The open recognizer serves as a fall-back recognizer when none of the predetermined search categories produces a high enough score, or, in other words, when the search category is not recognized by the system. Searches will not be recognized by the system even if they pertain to one of the predetermined categories if users say a word that is not covered by the grammar. For example, if a user says “STOCKPRICE” instead of “STOCKQUOTE,” the category-specific grammar produces a low score, but large vocabulary recognizer 110 performs as an effective backup. Another situation in which a search whose category should be recognized but is missed arises when the user says words that are not included in the database of allowed responses. For example, if a user says “SEARCH BARS IN LAS VEGAS NEW MEXICO,” local business listings category grammar will produce a poor score because the database of cities in New Mexico does not include Las Vegas. However, large vocabulary recognizer 410 correctly recognizes the words and when the text is returned to the transaction server and passed to one of content providers 114a, such as Google, the appropriate results for this less well-known town will be returned. Large vocabulary recognizer 410 is also required when a search does not pertain to any of the predetermined categories.
The system also has the ability to forward poorly recognized open searches to live human agents 122 (
Users generally invoke voice-mediated mobile searches only for location-related or time-critical types of search requests because mobile devices have much more limited display capabilities than laptops or desktop computers. This narrower range of likely searches increases the probability that ASR Server 112 will be able to determine the category of an open search, and therefore that the system will be able to deliver high quality results to the user. Furthermore, the system can maintain statistics of the kinds of searches requested, and can continually add categories that correspond to the most commonly requested search types.
When performing open search command speech recognition, ASR 112 uses metadata to improve recognition accuracy. As described above for guided searches, explicit metadata that tells the system where device 102 is located, or that provides details about the user'"'"'s home or work address, or profession can serve to bias speech recognition results. For example, when ASR Server recognizes an utterance as “SEARCH BOSTON HOTELS” or “SEARCH AUSTIN HOTELS” with nearly equal scores, location metadata that indicates the user is in Boston can help the recognizer to make the more likely choice.
ASR Server 112 also includes software that extracts the side information contained within the signal it receives via transaction server 110 from mobile device 102. Side information is preserved when VMSA 106 running on mobile device 102 performs its signal-processing functions, and is therefore contained within the speech features that the mobile device transmits over connection 108 to transaction processor 110. ASR Server 112 uses the side information it extracts from the received signal to categorize the mobile device user and also, if the side information permits, to categorize the environment in which the user is operating the mobile device. We describe this in more detail in the following paragraphs.
The user categories include gender, an age range, accent, dialect, and the emotional state of the user. The speaker'"'"'s gender affects the spectral distribution within the received signal. Similarly, the voice characteristics of a young speaker are sufficiently different from those of an older speaker that ASR software can determine an age category that is at least able to distinguish a teenage or younger user from an older user. Accent categories refer to categories of user who are not using their native tongue, and whose speech retains an accent characteristic of the their native tongue. For example, such categories include users speaking English with a Spanish or a Japanese accent. Accent categories also include categories for regional speech variations for users even when they are speaking their native tongue. For example, an American Southerner speaking in English can be categorized as from the South of The United States, and a New Yorker speaking with a New York accent can be categorized as such.
Dialect categories refer to categories of user who speak their native tongue in a manner characteristic of their place of origin. Dialect categories can overlap with accent categories to reveal a place of origin, but they can also be indicative of a user'"'"'s social class. For example, in Britain, a user who speaks Oxford English can be placed in a category of a middle class user, while a user who speaks with a Cockney accent or other regional British accent is placed in a working class category.
As mentioned above, side information can sometimes permit the server to categorize the environment in which the user is operating the mobile device. One such category is the inside of a vehicle. For example, if the user is speaking while driving a car, the side information can contain information characteristic of engine, road, tire, and wind noise. Another such category is the ambient noise level. For example if there is little background noise in the received signal, the ASR server assigns the user to a quiet environment category, which can be indicative of an indoor location, such as a home or a quiet office. If the user is in a noisy environment and the side information includes characteristics of other voices, such as those from nearby coworkers, the ASR server assigns the user to an office environment category. Noise from office machinery, such as printers and telephones, also causes the ASR server to assign the user to an office environment. Other user environment categories to which ASR server can assign a mobile device user based on the side information include public locations such as stores, shopping malls, railway stations, and airports.
ASR Server 112 returns the text corresponding to the voice search request, and any categories it is able to extract from side information to transaction server 110 over connection 126.
Transaction server 110 selects one or more content providers 114a,b,c to service the search request. It uses the category of the search, if that is known, either explicitly via a guided gate search command, or from automatic category detection on ASR Server 112 to guide its selection. For example, if the search is for ringtones, the transaction server passes the request to a ringtone provider, such as a server of the wireless carrier. As another example, if the search is a sports news request, it passes the request to an ESPN server. When it receives text corresponding to an uncategorized search, it performs some editing on the search string, such as removing prepositions and articles, and transmits it to a general-purpose content provider, such as Google. Transaction server 110 can also use the metadata to affect its selection of content provider(s) to service the search request.
Transaction server 110 also can transmit some of the metadata to the content provider. The metadata helps the content provider to return results that are better targeted to the user. For example, if the user is searching for clothing stores, and the system has determined that the user is female, then the content provider uses this information to prioritize its results on women'"'"'s clothing stores. Since this information is determined implicitly from the audio stream without the need to ask the user any questions, it differentiates voice-mediated searches from text-mediated ones. As another example, the system can use its knowledge of the make and model of device 102 and the home residence of the user to make demographic inferences about the user. For example, if the user owns an expensive, high-end mobile device and lives in a wealthy neighborhood, he is probably of above average income. The content provider(s) can use such demographic inferences to better target responses to the mobile voice search request.
Content provider(s) 114a, b, c return search results via connection 132 to transaction server 110. The search results include items that are responsive to the search request. The returned items are also responsive to any metadata that transaction server 110 sent to the content providers along with the search request. The transaction server analyzes the content in an attempt to determine a category of search from the type of returned content. One method involves searching for key words in the results. If it is able to determine a category, it invokes special purpose software that formats the results in a manner that is appropriate to that content. Screen display 302 (
Even if transaction server is unable to determine a search category by inspecting a generic search result, it “scrapes” the results by extracting underlined or bolded portions of a result page and phone numbers. For results from generic content providers, such as Google, the transaction server displays a small number of the top-ranked results and as much text as can be presented legibly and attractively on the display of mobile device 102.
In some cases, the voice search provider has a business relationship with the content provider, and receives interface information that allows the transaction server to extract the appropriate user-requested information for display on the mobile device.
Transaction server 110 uses metadata, both explicit and implicit (side information) to select and prioritize the content it receives from content providers 114. If it sent no metadata to content provider(s) 114a,b,c, it receives the same results from the content providers that a normal text search would provide. In this case, the transaction server alone (and not the content providers) adds value to the search results by using the metadata to optimize the value of the results to the user. By combining knowledge derived from the search query text, the search result content, and the metadata, the transaction server can return highly sifted, targeted results to the user. If the user finds such results valuable, he will be more likely to use voice-mediated search frequently, which in turn provides a greater number of opportunities to transmit a revenue-producing advertisement to the user.
Transaction server 110 transmits the text of the search command, and optionally the search results and some or all of the metadata to one or more advertising providers 116a,b,c over connection 134. Advertisement providers respond by offering advertisements along with pricing information back to transaction server 110 over connection 136. The metadata provides advertisers with more information about the user than they are able to get from text-based searches. This information enables them to select advertisements that are more effectively targeted to the user than the advertisements they would select in the absence of the metadata. The voice search provider selects the advertising providers and specific advertisements based on a variety of factors, including the pricing information, any business relationships with advertisers, or other commercial information.
The transaction server maintains a log of the user'"'"'s query history, and of the user'"'"'s response to advertisements and to items contained within the search results. It can share this information with advertisers in order to provide more information upon which to base the selection of one or more advertisements to display along with subsequent search results that respond to subsequent search requests.
After transaction server receives search results from the content providers and any advertisements from the advertising providers, search management software 118 selects the items of information, including both search results and advertisements, that transaction server 110 sends over the wireless data channel 138 to mobile device 102. This selection is based on such factors as: the degree of responsiveness of items within the search results to the category of the search request and to the user category as determined from side information; the degree of targeting of the advertisements to the user category; and the relevance of the advertisements to the search request. One selection method involves limiting the selection sent to the mobile device only to those search result items that have a degree of responsiveness greater than a threshold degree of responsiveness. The search management software sets the threshold in order to limit the number of search result items to a number that can be legibly and attractively displayed on the mobile device. The user or the operator of the transaction server can also adjust the threshold manually.
Search management software 118 can also prioritize items within the search results according to the factors listed in the previous paragraph. For example, if the user category is female and the search is for clothes, the search management software assigns a higher priority to search result items relating to women'"'"'s clothes than to men'"'"'s clothes. It uses the degree of responsiveness of each search result item to the search request in light of the user category to rank order the results. It then tags each items among the search results that exceed the threshold degree of responsiveness with a rank number. The mobile device can then display the received search result items in rank order, with the most responsive result at the top of the list of displayed results.
After selecting items contained within the search results and one or more advertisements, transaction server 110 sends its selection to mobile device 102 via wireless data connection 138. It formats the display to make it as legible and/or presentable as possible for display on device 102. The results can be multimodal, i.e., include text, graphics audio, and video. Transaction server 110 transmits the combined search results and advertisements to the phone over connection 138 via the wireless carrier.
VMSA 106 on device 102 receives the results from the transaction server, and presents them to the user.
When the user of mobile device 102 receives search results and advertisements as a result of a search request, he may use one or more of the items among the search results to connect to a remote resource. He initiates such connections by clicking on a link contained within one of the received search results or advertisements, by placing a phone call to one of the resources identified in a search result or advertisement, or by using other input means provided on mobile device 102.
Device 102 maintains a log of the actions the user takes in response to receiving the search results. Among the items logged are all user actions that involve initiating a connection between mobile device 102 and a remote resource, whether or not such connections involve transaction server 110. Such connections can be achieved via wireless data connection 108, or over other wireless or fixed connections, such as Wi-Fi connections and telephone lines.
VMSA 106 sends the information contained within the log to transaction server 110, thus providing important feedback to the transaction server on how useful and responsive the search results are for the user. Receiving the log also provides valuable information on the effectiveness of the sent advertisements. In a typical mode of operation VMSA 106 stores the log on mobile device 102, and sends the log to the transaction server at regular intervals. Alternatively, VMSA 106 sends the contents of the log to the transaction server at a time triggered by one or more user connections to remote resources. The timing and frequency of sending the log to the transaction server is determined by VMSA 106, but this can be adjusted by the provider of mobile search services via search management software 118 using, for example, connection 138 from transaction server 110 to communicate with mobile device 102.
The transaction server uses the log information to gain a measure of how valuable particular items among the search results are to the user. It can use this measure to help improve its selection of search results when it responds to subsequent search requests from the user of the mobile device. Such improvements make the search results more responsive to the user, which encourages the user to perform further searches. If the log contains an indication that the user responded to one or more advertisements, the transaction server gains valuable information on the effectiveness of the advertisements. This information is used to help search management software 118 select effective advertisements from the set of advertisements it receives from advertising providers 116a,b,c. It also uses the logged information to determine the allocation of revenue/billing among the parties involved, such as the mobile search provider, the content provider, and the advertiser, as well as to rate the effectiveness of a particular advertisement.
When a user responds to an advertisement by making a phone call or selecting an internet link to an advertiser'"'"'s web page, VMSA 106 can connect device 102 directly to the advertiser. This connection does not involve any of content providers 114a,b,c that supplied the search result content to the transaction server and need not involve the transaction server. This process contrasts with the traditional advertisement click-through sequence in which the user is first transferred to the content provider, which then logs the click-through, and forwards the request on to the advertiser. VMSA 106 logs the user action and transmits it to transaction server 110 immediately or at a later time. The transaction server then allocates revenues and billing according to a commerce model that is based on the business relationship among the relevant parties.
VMSA 106 and/or voice search management software 118 can cause a phone number or link from an advertisement to be stored locally on device 102 at the user'"'"'s option. VMSA 106 stores the phone numbers in the user'"'"'s local phone book or as an entry in his personal yellow pages, which are described below. VMSA 106 stores links to advertiser-sponsored web pages in the user'"'"'s yellow pages, or in another data structure on device 102 set up by VMSA 106 for this purpose. VMSA 106 logs such actions, and later transmits the log to the transaction server. Voice search management software 118 can charge the advertiser a fee each time the user stores an advertised phone number or link in device 102.
As a user builds up a track record of searches with device 102, VMSA 106 recognizes searches that are made more than a predetermined number of times. For example, if the user frequently requests the phone number of his favorite Italian restaurant, device 102 retains the search string, the search results, and the recognized speech pattern locally. Next time the user requests the number, the phone is able to fulfill the search request locally. Voice searches that can be fulfilled just by using the device'"'"'s own speech recognizer and content stored on the device provide several advantages to the user. First, the response is faster because there is no latency associated with opening up a data connection and communicating with a remote server. Second, the user does not need to use wireless bandwidth, which is a scarce commodity for which he is billed. Third, locally stored information is available to the user even when there is no wireless phone service is available, as might occur in a tunnel or in a remote location.
VMSA 106 determines whether a particular search request has been received enough times and/or at sufficiently short intervals to warrant local storage of search results and, optionally, to store speech recognition information related to that search request on mobile device 102. Default criteria for determining when to store a search result locally are included with VMSA 106 when mobile device 102 is shipped from the factory. However, if desired, either the user or the provider of mobile search services can adjust the criteria. For example, the criteria for local storage can be relaxed when the amount of memory on the mobile device is increased, which places fewer constraints on the volume of data that can be stored on the device.
The user of the mobile device can instruct his device to store the results of any particular search request, even if the request has not been made previously. The user can also retrieve any locally stored search results by requesting the results using a keypad or soft keys on device 102, or using a graphical input device. Thus, although it may often be more convenient for the user to perform searches that can be fulfilled using locally stored search results using a spoken search request, other means that are not voice-mediated of inputting a search request are available to him.
In order to recognize search requests for which VMSA 106 stores results locally, the mobile device requests speech recognition information corresponding to such search requests from transaction server 110. Alternatively, search management software 118 recognizes that device 102 has sent certain search requests more than once, and it determines whether and when to send speech recognition information corresponding to these repeated requests. In either case, the result is that the mobile device becomes capable of recognizing such repeated requests without the need for an external connection.
The information corresponding to the locally stored search results is indexed by the search category uttered by the user. For example, if the user frequently asks his device to “SEARCH BOSTON HOTELS” the device stores the results under an index entry “Boston Hotels.”
VMSA 106 also indexes locally stored search results by geographical location, such as by country, state, and city. It can also index the local search results by the type of business to which it pertains. Thus locally stored information is analogous to a combination of personal yellow pages and business white pages additional indexing schemes, including a scheme corresponding to the user'"'"'s personal search terms. The user can access the information directly by requesting search results corresponding to any of the indices, i.e., by using his own previously used search term, the geographical location, or the type of business in any combination. Other indexing schemes can also be added, as appropriate, for various types of search and their corresponding search results.
Device 102 also recognizes past patterns of user searching to pre-load data that it may need to fulfill a future search request. For example, if the user often requests “SEARCH RED SOX SCORES,” the device 102 will regularly receive Red Sox scores from a sports content provider via transaction server 110. The wireless network carrier can provide this low bandwidth service at no additional cost by using off-peak transmissions to device 102. Preloading of data enables the mobile device to provide up-to-date search results without the need for an external connection when it receives the corresponding search request. This is especially valuable when the search requests time-sensitive information, such as weather conditions, traffic conditions, and sports results.
The user of device 102 may choose to share his locally stored yellow pages with users of other devices, and conversely, receive others'"'"' yellow pages. This feature is especially useful when the user travels to a new location and is not familiar with businesses and services in that location. If the user knows the other person, this “social networking” offers a convenient means of receiving information from a trusted source. Social networking may be pairwise, or involve groups who provide permission to each other to share personal yellow pages. Users can augment the entries in their locally stored yellow pages with reviews, ratings, and personal comments relating to the listed businesses. Users can choose to share this additional information as part of their social networking options.
A typical platform on which mobile communications device 102 can be implemented is illustrated in
The transmit and receive functions are implemented by an RF synthesizer 606 and an RF radio transceiver 608 followed by a power amplifier module 610 that handles the final-stage RF transmit duties through an antenna 612. An interface ASIC 614 and an audio CODEC 616 provide interfaces to a speaker, a microphone, and other input/output devices provided in the phone such as a numeric or alphanumeric keypad (not shown) for entering commands and information, and hardware (not shown) that supports a graphical user interface. The graphical user interface hardware includes input devices such as a touch screen or a track pad that is sensitive to a stylus or to a finger of a user of the mobile device. The graphical output hardware includes a display screen, such as a liquid crystal (LCD) display or a plasma display.
DSP 602 uses a flash memory 618 for code store. A Li—Ion (lithium-ion) battery 620 powers the phone and a power management module 622 coupled to DSP 602 manages power consumption within the device. The device has additional hardware components (not shown) to support specific functionalities. For example, an image processor and CCD sensor support a digital camera, and a GPS receiver supports a geolocation application.
Volatile and non-volatile memory for applications processor 614 is provided in the form of SDRAM 624 and flash memory 626, respectively. This arrangement of memory can be used to hold the code for the operating system, all relevant code for operating the device and for supporting its various functionality, including the code for the speech recognition system discussed above and for any applications software included in the device. It also stores the speech recognition data, search results, advertisements, user logs, personal yellow pages data, and collections of data associated with the applications supported by the device.
The visual display device for the device includes an LCD driver chip 628 that drives an LCD display 630. There is also a clock module 632 that provides the clock signals for the other devices within the phone and provides an indicator of real time. All of the above-described components are packaged within an appropriately designed housing 634.
Since the device described above is representative of the general internal structure of a number of different commercially available devices and since the internal circuit design of those devices is generally known to persons of ordinary skill in this art, further details about the components shown in
The servers mentioned herein can be implemented on commercially available servers that include single or multi-processor systems, conventional memory subsystems including, for example, disk storage devices, RAM, and ROM.
Other aspects, modifications, and embodiments are within the scope of the following claims.