Enabling voice click in a multimodal page
-
0Associated
Cases -
0Associated
Defendants -
0Accused
Products -
222Forward
Citations -
0
Petitions -
2
Assignments
First Claim
1. A method for enabling voice clicks in a multimodal page comprising the steps of:
- toggling a display of indicia binding selected user interface elements in the multimodal page to corresponding voice logic; and
, processing a selection of said selected user interface elements in the multimodal page through different selection modalities.
2 Assignments
0 Petitions
Accused Products
Abstract
A method, system and apparatus for enabling voice clicks in a multimodal page. In accordance with the present invention, a method for enabling voice clicks in a multimodal page can include toggling a display of indicia binding selected user interface elements in the multimodal page to corresponding voice logic; and, processing a selection of the selected user interface elements in the multimodal page through different selection modalities. In particular, the toggling step can include toggling a display of both indexing indicia for the selected user interface elements, and also a text display indicating that a voice selection of the selected user interface elements is supported.
241 Citations
| Synchronizing visual and speech events in a multimodal application | ||
|
Patent #
US 7,917,365 B2
Filed 06/16/2005
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Speech Enabled Media Sharing In A Multimodal Application | ||
|
Patent #
US 20110010180A1
Filed 07/09/2009
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Multimodal Teleconferencing | ||
|
Patent #
US 20110032845A1
Filed 08/05/2009
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Enabling dynamic voiceXML in an X+V page of a multimodal application | ||
|
Patent #
US 7,945,851 B2
Filed 03/14/2007
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Establishing a multimodal advertising personality for a sponsor of a multimodal application | ||
|
Patent #
US 7,957,976 B2
Filed 09/12/2006
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| ESTABLISHING A MULTIMODAL ADVERTISING PERSONALITY FOR A SPONSOR OF A MULTIMODAL APPLICATION | ||
|
Patent #
US 20110202349A1
Filed 04/27/2011
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Synchronizing visual and speech events in a multimodal application | ||
|
Patent #
US 8,055,504 B2
Filed 04/03/2008
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Dynamically creating multimodal markup documents | ||
|
Patent #
US 8,032,825 B2
Filed 06/16/2005
|
Current Assignee
International Business Machines Corporation
|
Sponsoring Entity
International Business Machines Corporation
|
| Dynamically defining a VoiceXML grammar in an X+V page of a multimodal application | ||
|
Patent #
US 8,069,047 B2
Filed 02/12/2007
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Document session replay for multimodal applications | ||
|
Patent #
US 7,801,728 B2
Filed 02/26/2007
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Oral modification of an ASR lexicon of an ASR engine | ||
|
Patent #
US 7,676,371 B2
Filed 06/13/2006
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| ENABLING GLOBAL GRAMMARS FOR A PARTICULAR MULTIMODAL APPLICATION | ||
|
Patent #
US 20100324889A1
Filed 08/31/2010
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Speech Capabilities Of A Multimodal Application | ||
|
Patent #
US 20100299146A1
Filed 05/19/2009
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Disambiguating a speech recognition grammar in a multimodal application | ||
|
Patent #
US 7,822,608 B2
Filed 02/27/2007
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Enabling global grammars for a particular multimodal application | ||
|
Patent #
US 7,809,575 B2
Filed 02/27/2007
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Enabling grammars in web page frames | ||
|
Patent #
US 7,827,033 B2
Filed 12/06/2006
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Ordering recognition results produced by an automatic speech recognition engine for a multimodal application | ||
|
Patent #
US 7,840,409 B2
Filed 02/27/2007
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| VOIP barge-in support for half-duplex DSR client on a full-duplex network | ||
|
Patent #
US 7,848,314 B2
Filed 05/10/2006
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Records Disambiguation In A Multimodal Application Operating On A Multimodal Device | ||
|
Patent #
US 20090271199A1
Filed 04/24/2008
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Dynamically Publishing Directory Information For A Plurality Of Interactive Voice Response Systems | ||
|
Patent #
US 20090268883A1
Filed 04/24/2008
|
Current Assignee
International Business Machines Corporation
|
Sponsoring Entity
International Business Machines Corporation
|
| Signaling Correspondence Between A Meeting Agenda And A Meeting Discussion | ||
|
Patent #
US 20090271438A1
Filed 04/24/2008
|
Current Assignee
International Business Machines Corporation
|
Sponsoring Entity
International Business Machines Corporation
|
| Testing A Grammar Used In Speech Recognition For Reliability In A Plurality Of Operating Environments Having Different Background Noise | ||
|
Patent #
US 20090271189A1
Filed 04/24/2008
|
Current Assignee
Cerence Inc.
|
Sponsoring Entity
Cerence Inc.
|
| Adjusting A Speech Engine For A Mobile Computing Device Based On Background Noise | ||
|
Patent #
US 20090271188A1
Filed 04/24/2008
|
Current Assignee
Cerence Inc.
|
Sponsoring Entity
Cerence Inc.
|
| Establishing a Multimodal Advertising Personality for a Sponsor of a Multimodal Application | ||
|
Patent #
US 20080065389A1
Filed 09/12/2006
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Establishing a Multimodal Personality for a Multimodal Application | ||
|
Patent #
US 20080065388A1
Filed 09/12/2006
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Establishing a Multimodal Personality for a Multimodal Application in Dependence Upon Attributes of User Interaction | ||
|
Patent #
US 20080065387A1
Filed 09/11/2006
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Establishing a Preferred Mode of Interaction Between a User and a Multimodal Application | ||
|
Patent #
US 20080065386A1
Filed 09/11/2006
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Synchronizing Visual And Speech Events In A Multimodal Application | ||
|
Patent #
US 20080177530A1
Filed 04/03/2008
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
-
|
| DYNAMICALLY DEFINING A VOICEXML GRAMMAR IN AN X+V PAGE OF A MULTIMODAL APPLICATION | ||
|
Patent #
US 20080195393A1
Filed 02/12/2007
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
-
|
| Altering Behavior Of A Multimodal Application Based On Location | ||
|
Patent #
US 20080208593A1
Filed 02/27/2007
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Configuring A Speech Engine For A Multimodal Application Based On Location | ||
|
Patent #
US 20080208592A1
Filed 02/27/2007
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Presenting Supplemental Content For Digital Media Using A Multimodal Application | ||
|
Patent #
US 20080208589A1
Filed 02/27/2007
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Enabling Global Grammars For A Particular Multimodal Application | ||
|
Patent #
US 20080208591A1
Filed 02/27/2007
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Invoking Tapered Prompts In A Multimodal Application | ||
|
Patent #
US 20080208588A1
Filed 02/26/2007
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Disambiguating A Speech Recognition Grammar In A Multimodal Application | ||
|
Patent #
US 20080208590A1
Filed 02/27/2007
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Enabling Natural Language Understanding In An X+V Page Of A Multimodal Application | ||
|
Patent #
US 20080208586A1
Filed 02/27/2007
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Ordering Recognition Results Produced By An Automatic Speech Recognition Engine For A Multimodal Application | ||
|
Patent #
US 20080208585A1
Filed 02/27/2007
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Pausing A VoiceXML Dialog Of A Multimodal Application | ||
|
Patent #
US 20080208584A1
Filed 02/27/2007
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Automatic Speech Recognition With Dynamic Grammar Rules | ||
|
Patent #
US 20080235022A1
Filed 03/20/2007
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Indexing Digitized Speech With Words Represented In The Digitized Speech | ||
|
Patent #
US 20080235021A1
Filed 03/20/2007
|
Current Assignee
Innovationsgesellschaft Technische Universitt mbH
|
Sponsoring Entity
Innovationsgesellschaft Technische Universitt mbH
|
| Speech-Enabled Predictive Text Selection For A Multimodal Application | ||
|
Patent #
US 20080235029A1
Filed 03/23/2007
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Supporting Multi-Lingual User Interaction With A Multimodal Application | ||
|
Patent #
US 20080235027A1
Filed 03/23/2007
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| SPEECH-CENTRIC MULTIMODAL USER INTERFACE DESIGN IN MOBILE TECHNOLOGY | ||
|
Patent #
US 20080228496A1
Filed 03/15/2007
|
Current Assignee
Microsoft Technology Licensing LLC
|
Sponsoring Entity
Microsoft Technology Licensing LLC
|
| Enabling Dynamic VoiceXML In An X+ V Page Of A Multimodal Application | ||
|
Patent #
US 20080228495A1
Filed 03/14/2007
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Speech-Enabled Content Navigation And Control Of A Distributed Multimodal Browser | ||
|
Patent #
US 20080255851A1
Filed 04/12/2007
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Providing Expressive User Interaction With A Multimodal Application | ||
|
Patent #
US 20080255850A1
Filed 04/12/2007
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Web Service Support For A Multimodal Client Processing A Multimodal Application | ||
|
Patent #
US 20080249782A1
Filed 04/04/2007
|
Current Assignee
International Business Machines Corporation
|
Sponsoring Entity
International Business Machines Corporation
|
| STREAMING AUDIO FROM A FULL-DUPLEX NETWORK THROUGH A HALF-DUPLEX DEVICE | ||
|
Patent #
US 20070274297A1
Filed 05/10/2006
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| VOIP BARGE-IN SUPPORT FOR HALF-DUPLEX DSR CLIENT ON A FULL-DUPLEX NETWORK | ||
|
Patent #
US 20070274296A1
Filed 05/10/2006
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| SYNCHRONIZING DISTRIBUTED SPEECH RECOGNITION | ||
|
Patent #
US 20070265851A1
Filed 05/10/2006
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Enabling voice selection of user preferences | ||
|
Patent #
US 20060136222A1
Filed 12/22/2004
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Establishing a multimodal application voice | ||
|
Patent #
US 20060287865A1
Filed 06/16/2005
|
Current Assignee
International Business Machines Corporation
|
Sponsoring Entity
International Business Machines Corporation
|
| Dynamically creating multimodal markup documents | ||
|
Patent #
US 20060288328A1
Filed 06/16/2005
|
Current Assignee
International Business Machines Corporation
|
Sponsoring Entity
International Business Machines Corporation
|
| Modifying a grammar of a hierarchical multimodal menu with keywords sold to customers | ||
|
Patent #
US 20060287858A1
Filed 06/16/2005
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Displaying available menu choices in a multimodal browser | ||
|
Patent #
US 20060288309A1
Filed 06/16/2005
|
Current Assignee
International Business Machines Corporation
|
Sponsoring Entity
International Business Machines Corporation
|
| ORAL MODIFICATION OF AN ASR LEXICON OF AN ASR ENGINE | ||
|
Patent #
US 20070288241A1
Filed 06/13/2006
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| CONTEXT-BASED GRAMMARS FOR AUTOMATED SPEECH RECOGNITION | ||
|
Patent #
US 20070294084A1
Filed 06/13/2006
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Dynamically generating a vocal help prompt in a multimodal application | ||
|
Patent #
US 8,086,463 B2
Filed 09/12/2006
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Enabling global grammars for a particular multimodal application | ||
|
Patent #
US 8,073,698 B2
Filed 08/31/2010
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Testing a grammar used in speech recognition for reliability in a plurality of operating environments having different background noise | ||
|
Patent #
US 8,082,148 B2
Filed 04/24/2008
|
Current Assignee
Cerence Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Establishing a multimodal personality for a multimodal application | ||
|
Patent #
US 8,073,697 B2
Filed 09/12/2006
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Modifying a grammar of a hierarchical multimodal menu in dependence upon speech command frequency | ||
|
Patent #
US 8,090,584 B2
Filed 06/16/2005
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Adjusting a speech engine for a mobile computing device based on background noise | ||
|
Patent #
US 8,121,837 B2
Filed 04/24/2008
|
Current Assignee
Cerence Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Invoking tapered prompts in a multimodal application | ||
|
Patent #
US 8,150,698 B2
Filed 02/26/2007
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Establishing a preferred mode of interaction between a user and a multimodal application | ||
|
Patent #
US 8,145,493 B2
Filed 09/11/2006
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Signaling correspondence between a meeting agenda and a meeting discussion | ||
|
Patent #
US 8,214,242 B2
Filed 04/24/2008
|
Current Assignee
International Business Machines Corporation
|
Sponsoring Entity
International Business Machines Corporation
|
| Speech-centric multimodal user interface design in mobile technology | ||
|
Patent #
US 8,219,406 B2
Filed 03/15/2007
|
Current Assignee
Microsoft Technology Licensing LLC
|
Sponsoring Entity
Microsoft Corporation
|
| Dynamically publishing directory information for a plurality of interactive voice response systems | ||
|
Patent #
US 8,229,081 B2
Filed 04/24/2008
|
Current Assignee
International Business Machines Corporation
|
Sponsoring Entity
International Business Machines Corporation
|
| Establishing a multimodal advertising personality for a sponsor of a multimodal application | ||
|
Patent #
US 8,239,205 B2
Filed 04/27/2011
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Dynamically extending the speech prompts of a multimodal application | ||
|
Patent #
US 8,290,780 B2
Filed 06/24/2009
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Context-based grammars for automated speech recognition | ||
|
Patent #
US 8,332,218 B2
Filed 06/13/2006
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Establishing a multimodal personality for a multimodal application in dependence upon attributes of user interaction | ||
|
Patent #
US 8,374,874 B2
Filed 09/11/2006
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Improving speech capabilities of a multimodal application | ||
|
Patent #
US 8,380,513 B2
Filed 05/19/2009
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Multimodal teleconferencing | ||
|
Patent #
US 8,416,714 B2
Filed 08/05/2009
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Establishing a preferred mode of interaction between a user and a multimodal application | ||
|
Patent #
US 8,494,858 B2
Filed 02/14/2012
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Establishing a multimodal advertising personality for a sponsor of multimodal application | ||
|
Patent #
US 8,498,873 B2
Filed 06/28/2012
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Speech enabled media sharing in a multimodal application | ||
|
Patent #
US 8,510,117 B2
Filed 07/09/2009
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Indexing digitized speech with words represented in the digitized speech | ||
|
Patent #
US 8,515,757 B2
Filed 03/20/2007
|
Current Assignee
Innovationsgesellschaft Technische Universitt mbH
|
Sponsoring Entity
Nuance Communications Inc.
|
| Dynamically extending the speech prompts of a multimodal application | ||
|
Patent #
US 8,521,534 B2
Filed 09/12/2012
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Speech interface system and method for control and interaction with applications on a computing system | ||
|
Patent #
US 8,543,407 B1
Filed 04/24/2012
|
Current Assignee
Samsung Electronics Co. Ltd.
|
Sponsoring Entity
Great Northern Research LLC
|
| Context-based grammars for automated speech recognition | ||
|
Patent #
US 8,566,087 B2
Filed 09/13/2012
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Synchronizing visual and speech events in a multimodal application | ||
|
Patent #
US 8,571,872 B2
Filed 09/30/2011
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Establishing a multimodal personality for a multimodal application in dependence upon attributes of user interaction | ||
|
Patent #
US 8,600,755 B2
Filed 01/23/2013
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Prioritizing selection criteria by automated assistant | ||
|
Patent #
US 8,660,849 B2
Filed 12/21/2012
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Automatic speech recognition with dynamic grammar rules | ||
|
Patent #
US 8,670,987 B2
Filed 03/20/2007
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Active input elicitation by intelligent automated assistant | ||
|
Patent #
US 8,670,979 B2
Filed 12/21/2012
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Method and apparatus for building an intelligent automated assistant | ||
|
Patent #
US 8,677,377 B2
Filed 09/08/2006
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Indexing digitized speech with words represented in the digitized speech | ||
|
Patent #
US 8,706,490 B2
Filed 08/07/2013
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Establishing a multimodal personality for a multimodal application | ||
|
Patent #
US 8,706,500 B2
Filed 11/01/2011
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Intent deduction based on previous user interactions with voice assistant | ||
|
Patent #
US 8,706,503 B2
Filed 12/21/2012
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Pausing a VoiceXML dialog of a multimodal application | ||
|
Patent #
US 8,713,542 B2
Filed 02/27/2007
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Providing expressive user interaction with a multimodal application | ||
|
Patent #
US 8,725,513 B2
Filed 04/12/2007
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Maintaining context information between user interactions with a voice assistant | ||
|
Patent #
US 8,731,942 B2
Filed 03/04/2013
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Invoking tapered prompts in a multimodal application | ||
|
Patent #
US 8,744,861 B2
Filed 03/01/2012
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Retrieval and presentation of network service results for mobile device using a multimodal browser | ||
|
Patent #
US 8,781,840 B2
Filed 01/31/2013
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Web service support for a multimodal client processing a multimodal application | ||
|
Patent #
US 8,788,620 B2
Filed 04/04/2007
|
Current Assignee
International Business Machines Corporation
|
Sponsoring Entity
International Business Machines Corporation
|
| Disambiguation based on active input elicitation by intelligent automated assistant | ||
|
Patent #
US 8,799,000 B2
Filed 12/21/2012
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Speech-enabled web content searching using a multimodal browser | ||
|
Patent #
US 8,843,376 B2
Filed 03/13/2007
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Establishing a multimodal advertising personality for a sponsor of a multimodal application | ||
|
Patent #
US 8,862,471 B2
Filed 07/29/2013
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Speech-enabled content navigation and control of a distributed multimodal browser | ||
|
Patent #
US 8,862,475 B2
Filed 04/12/2007
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Service orchestration for intelligent automated assistant | ||
|
Patent #
US 8,892,446 B2
Filed 12/21/2012
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Personalized vocabulary for digital assistant | ||
|
Patent #
US 8,903,716 B2
Filed 12/21/2012
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Supporting multi-lingual user interaction with a multimodal application | ||
|
Patent #
US 8,909,532 B2
Filed 03/23/2007
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Paraphrasing of user requests and results by automated digital assistant | ||
|
Patent #
US 8,930,191 B2
Filed 03/04/2013
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Configuring a speech engine for a multimodal application based on location | ||
|
Patent #
US 8,938,392 B2
Filed 02/27/2007
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Determining user intent based on ontologies of domains | ||
|
Patent #
US 8,942,986 B2
Filed 12/21/2012
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Displaying speech command input state information in a multimodal browser | ||
|
Patent #
US 8,965,772 B2
Filed 03/20/2014
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Method and system for operating a multi-function portable electronic device using voice-activation | ||
|
Patent #
US 8,977,255 B2
Filed 04/03/2007
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Adjusting a speech engine for a mobile computing device based on background noise | ||
|
Patent #
US 9,076,454 B2
Filed 01/25/2012
|
Current Assignee
Cerence Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Enabling voice selection of user preferences | ||
|
Patent #
US 9,083,798 B2
Filed 12/22/2004
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Using event alert text as input to an automated assistant | ||
|
Patent #
US 9,117,447 B2
Filed 12/21/2012
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Indexing digitized speech with words represented in the digitized speech | ||
|
Patent #
US 9,123,337 B2
Filed 03/11/2014
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| User profiling for voice input processing | ||
|
Patent #
US 9,190,062 B2
Filed 03/04/2014
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Synchronizing distributed speech recognition | ||
|
Patent #
US 9,208,785 B2
Filed 05/10/2006
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Altering behavior of a multimodal application based on location | ||
|
Patent #
US 9,208,783 B2
Filed 02/27/2007
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Device access using voice authentication | ||
|
Patent #
US 9,262,612 B2
Filed 03/21/2011
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Establishing a preferred mode of interaction between a user and a multimodal application | ||
|
Patent #
US 9,292,183 B2
Filed 06/20/2013
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| System and method for emergency calls initiated by voice command | ||
|
Patent #
US 9,300,784 B2
Filed 06/13/2014
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Intelligent automated assistant | ||
|
Patent #
US 9,318,108 B2
Filed 01/10/2011
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Methods and apparatus for altering audio output signals | ||
|
Patent #
US 9,330,720 B2
Filed 04/02/2008
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Intelligent automated assistant for TV user interactions | ||
|
Patent #
US 9,338,493 B2
Filed 09/26/2014
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Establishing a multimodal personality for a multimodal application in dependence upon attributes of user interaction | ||
|
Patent #
US 9,343,064 B2
Filed 11/26/2013
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Records disambiguation in a multimodal application operating on a multimodal device | ||
|
Patent #
US 9,349,367 B2
Filed 04/24/2008
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Context-sensitive handling of interruptions | ||
|
Patent #
US 9,368,114 B2
Filed 03/06/2014
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Testing a grammar used in speech recognition for reliability in a plurality of operating environments having different background noise | ||
|
Patent #
US 9,396,721 B2
Filed 11/04/2011
|
Current Assignee
Cerence Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Exemplar-based natural language processing | ||
|
Patent #
US 9,430,463 B2
Filed 09/30/2014
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Handling speech synthesis of content for multiple languages | ||
|
Patent #
US 9,483,461 B2
Filed 03/06/2012
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Device, method, and user interface for voice-activated navigation and browsing of a document | ||
|
Patent #
US 9,495,129 B2
Filed 03/12/2013
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Method and apparatus for building an intelligent automated assistant | ||
|
Patent #
US 9,501,741 B2
Filed 12/26/2013
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Method for supporting dynamic grammars in WFST-based ASR | ||
|
Patent #
US 9,502,031 B2
Filed 09/23/2014
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Dynamically extending the speech prompts of a multimodal application | ||
|
Patent #
US 9,530,411 B2
Filed 08/26/2013
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| Mobile device having human language translation capability with positional feedback | ||
|
Patent #
US 9,535,906 B2
Filed 06/17/2015
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Intelligent automated assistant | ||
|
Patent #
US 9,548,050 B2
Filed 06/09/2012
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Context-sensitive handling of interruptions by intelligent digital assistant | ||
|
Patent #
US 9,576,574 B2
Filed 09/09/2013
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Unified ranking with entropy-weighted information for phrase-based semantic auto-completion | ||
|
Patent #
US 9,582,608 B2
Filed 06/06/2014
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| System and method for user-specified pronunciation of words for speech synthesis and recognition | ||
|
Patent #
US 9,620,104 B2
Filed 06/06/2014
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Analyzing audio input for efficient speech and music recognition | ||
|
Patent #
US 9,620,105 B2
Filed 09/29/2014
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Intelligent text-to-speech conversion | ||
|
Patent #
US 9,626,955 B2
Filed 04/04/2016
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Better resolution when referencing to concepts | ||
|
Patent #
US 9,633,004 B2
Filed 09/29/2014
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| User profiling for voice input processing | ||
|
Patent #
US 9,633,660 B2
Filed 11/13/2015
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| System and method for detecting errors in interactions with a voice-based digital assistant | ||
|
Patent #
US 9,633,674 B2
Filed 06/05/2014
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Fast, language-independent method for user authentication by voice | ||
|
Patent #
US 9,646,614 B2
Filed 12/21/2015
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Caching apparatus for serving phonetic pronunciations | ||
|
Patent #
US 9,646,609 B2
Filed 08/25/2015
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Intelligent automated assistant for TV user interactions | ||
|
Patent #
US 9,668,024 B2
Filed 03/30/2016
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Social reminders | ||
|
Patent #
US 9,668,121 B2
Filed 08/25/2015
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| System and method for updating an adaptive speech recognition model | ||
|
Patent #
US 9,697,822 B1
Filed 04/28/2014
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Unit-selection text-to-speech synthesis using concatenation-sensitive neural networks | ||
|
Patent #
US 9,697,820 B2
Filed 12/07/2015
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Disambiguating heteronyms in speech synthesis | ||
|
Patent #
US 9,711,141 B2
Filed 12/12/2014
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Reducing the need for manual start/end-pointing and trigger phrases | ||
|
Patent #
US 9,715,875 B2
Filed 09/30/2014
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Competing devices responding to voice triggers | ||
|
Patent #
US 9,721,566 B2
Filed 08/31/2015
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Determining domain salience ranking from ambiguous words in natural speech | ||
|
Patent #
US 9,734,193 B2
Filed 09/18/2014
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Predictive text input | ||
|
Patent #
US 9,760,559 B2
Filed 05/22/2015
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Text prediction using combined word N-gram and unigram language models | ||
|
Patent #
US 9,785,630 B2
Filed 05/28/2015
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Text correction processing | ||
|
Patent #
US 9,798,393 B2
Filed 02/25/2015
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Method and apparatus for discovering trending terms in speech requests | ||
|
Patent #
US 9,818,400 B2
Filed 08/28/2015
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Parsimonious continuous-space phrase representations for natural language processing | ||
|
Patent #
US 9,842,105 B2
Filed 08/27/2015
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Predictive conversion of language input | ||
|
Patent #
US 9,842,101 B2
Filed 08/28/2015
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Using context information to facilitate processing of commands in a virtual assistant | ||
|
Patent #
US 9,858,925 B2
Filed 09/30/2011
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Intelligent text-to-speech conversion | ||
|
Patent #
US 9,865,248 B2
Filed 03/06/2017
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Structured dictation using intelligent automated assistants | ||
|
Patent #
US 9,865,280 B2
Filed 08/28/2015
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Parsimonious handling of word inflection via categorical stem + suffix N-gram language models | ||
|
Patent #
US 9,886,432 B2
Filed 08/28/2015
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Virtual assistant activation | ||
|
Patent #
US 9,886,953 B2
Filed 08/31/2015
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Systems and methods for structured stem and suffix language models | ||
|
Patent #
US 9,899,019 B2
Filed 08/31/2015
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Training an at least partial voice command system | ||
|
Patent #
US 9,922,642 B2
Filed 03/14/2014
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Unit-selection text-to-speech synthesis based on predicted concatenation parameters | ||
|
Patent #
US 9,934,775 B2
Filed 09/15/2016
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Crowd sourcing information to fulfill user requests | ||
|
Patent #
US 9,953,088 B2
Filed 03/07/2016
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Speech recognition involving a mobile device | ||
|
Patent #
US 9,959,870 B2
Filed 12/10/2009
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Multi-command single utterance input method | ||
|
Patent #
US 9,966,065 B2
Filed 05/28/2015
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| System and method for user-specified pronunciation of words for speech synthesis and recognition | ||
|
Patent #
US 9,966,060 B2
Filed 02/28/2017
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Interpreting and acting upon commands that involve sharing information with remote devices | ||
|
Patent #
US 9,966,068 B2
Filed 06/06/2014
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Privacy preserving distributed evaluation framework for embedded personalized systems | ||
|
Patent #
US 9,972,304 B2
Filed 09/15/2016
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Voice-based media searching | ||
|
Patent #
US 9,971,774 B2
Filed 12/19/2016
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Social reminders | ||
|
Patent #
US 9,986,419 B2
Filed 05/26/2017
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Method and apparatus for searching using an active ontology | ||
|
Patent #
US 10,002,189 B2
Filed 12/22/2008
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Intelligent automated assistant | ||
|
Patent #
US 10,043,516 B2
Filed 12/20/2016
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Intelligent automated assistant for media exploration | ||
|
Patent #
US 10,049,663 B2
Filed 09/15/2016
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| User profiling for voice input processing | ||
|
Patent #
US 10,049,675 B2
Filed 04/21/2017
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Applying neural network language models to weighted finite state transducers for automatic speech recognition | ||
|
Patent #
US 10,049,668 B2
Filed 05/16/2016
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Active transport based notifications | ||
|
Patent #
US 10,057,736 B2
Filed 12/28/2012
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Multilingual word prediction | ||
|
Patent #
US 10,067,938 B2
Filed 12/19/2016
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Providing an indication of the suitability of speech recognition | ||
|
Patent #
US 10,074,360 B2
Filed 08/24/2015
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Entropy-guided text prediction using combined word and character n-gram language models | ||
|
Patent #
US 10,078,631 B2
Filed 05/15/2015
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Name recognition system | ||
|
Patent #
US 10,079,014 B2
Filed 07/07/2017
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Device voice control for selecting a displayed affordance | ||
|
Patent #
US 10,083,688 B2
Filed 08/27/2015
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Better resolution when referencing to concepts | ||
|
Patent #
US 10,083,690 B2
Filed 03/14/2017
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Intelligent device arbitration and control | ||
|
Patent #
US 10,089,072 B2
Filed 09/16/2016
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Language input correction | ||
|
Patent #
US 10,101,822 B2
Filed 09/03/2015
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Device access using voice authentication | ||
|
Patent #
US 10,102,359 B2
Filed 01/04/2016
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Mobile device having human language translation capability with positional feedback | ||
|
Patent #
US 10,108,612 B2
Filed 11/14/2016
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Language identification from short strings | ||
|
Patent #
US 10,127,220 B2
Filed 09/03/2015
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Speaker identification and unsupervised speaker adaptation techniques | ||
|
Patent #
US 10,127,911 B2
Filed 08/25/2015
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Systems and methods for name pronunciation | ||
|
Patent #
US 10,134,385 B2
Filed 03/02/2012
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Exemplar-based natural language processing | ||
|
Patent #
US 10,169,329 B2
Filed 07/26/2016
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Intelligent assistant for home automation | ||
|
Patent #
US 10,170,123 B2
Filed 09/30/2014
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| System and method for inferring user intent from speech inputs | ||
|
Patent #
US 10,176,167 B2
Filed 06/06/2014
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Device, method, and graphical user interface for enabling conversation persistence across two or more instances of a digital assistant | ||
|
Patent #
US 10,185,542 B2
Filed 06/06/2014
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Context-based endpoint detection | ||
|
Patent #
US 10,186,254 B2
Filed 09/04/2015
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Digital assistant providing whispered speech | ||
|
Patent #
US 10,192,552 B2
Filed 09/15/2016
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Voice trigger for a digital assistant | ||
|
Patent #
US 10,199,051 B2
Filed 02/07/2014
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Proactive assistance based on dialog communication between devices | ||
|
Patent #
US 10,223,066 B2
Filed 05/31/2016
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Actionable reminder entries | ||
|
Patent #
US 10,241,644 B2
Filed 05/14/2013
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Interface for a virtual digital assistant | ||
|
Patent #
US 10,241,752 B2
Filed 10/04/2013
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Intelligent list reading | ||
|
Patent #
US 10,249,300 B2
Filed 09/21/2016
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Generating and processing task items that represent tasks to perform | ||
|
Patent #
US 10,255,566 B2
Filed 09/30/2011
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Automatic accent detection using acoustic models | ||
|
Patent #
US 10,255,907 B2
Filed 09/04/2015
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Intelligent task discovery | ||
|
Patent #
US 10,269,345 B2
Filed 09/19/2016
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Intelligent automated assistant | ||
|
Patent #
US 10,276,170 B2
Filed 06/07/2013
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Methods and apparatuses for automatic speech recognition | ||
|
Patent #
US 10,283,110 B2
Filed 07/07/2016
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Domain specific language for encoding assistant dialog | ||
|
Patent #
US 10,289,433 B2
Filed 09/30/2014
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Application integration with a digital assistant | ||
|
Patent #
US 10,297,253 B2
Filed 09/19/2016
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Competing devices responding to voice triggers | ||
|
Patent #
US 10,311,871 B2
Filed 06/12/2017
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Method and apparatus for building an intelligent automated assistant | ||
|
Patent #
US 10,318,871 B2
Filed 10/20/2016
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Intelligent automated assistant in a home environment | ||
|
Patent #
US 10,354,011 B2
Filed 09/23/2016
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Virtual assistant aided communication with 3rd party service in a communication session | ||
|
Patent #
US 10,356,243 B2
Filed 01/11/2017
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Efficient word encoding for recurrent neural network language models | ||
|
Patent #
US 10,366,158 B2
Filed 04/28/2016
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Methods and apparatus for altering audio output signals | ||
|
Patent #
US 10,381,016 B2
Filed 03/29/2016
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| User-specific acoustic models | ||
|
Patent #
US 10,410,637 B2
Filed 09/22/2017
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Method and apparatus for discovering trending terms in speech requests | ||
|
Patent #
US 10,431,204 B2
Filed 11/03/2017
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Identification of voice inputs providing credentials | ||
|
Patent #
US 10,446,143 B2
Filed 09/16/2016
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Automatic speech recognition based on user feedback | ||
|
Patent #
US 10,446,141 B2
Filed 01/07/2015
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Using context information to facilitate processing of commands in a virtual assistant | ||
|
Patent #
US 10,475,446 B2
Filed 06/12/2014
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Hierarchical belief states for digital assistants | ||
|
Patent #
US 10,482,874 B2
Filed 08/15/2017
|
Current Assignee
Apple Inc.
|
Sponsoring Entity
Apple Inc.
|
| Method and device for operating a user-input area on an electronic display device | ||
|
Patent #
US 7,584,429 B2
Filed 06/25/2004
|
Current Assignee
Conversant Wireless Licensing S..r.l. fka Core Wireless Licensing S.a.r.l.
|
Sponsoring Entity
Nokia Corporation
|
| Web-based voice dialog interface | ||
|
Patent #
US 6,604,075 B1
Filed 03/14/2000
|
Current Assignee
Alcatel-Lucent SA
|
Sponsoring Entity
Lucent Technologies Inc.
|
| Method and apparatus for providing an event-based “What-Can-I-Say?;” window | ||
|
Patent #
US 6,308,157 B1
Filed 06/08/1999
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
International Business Machines Corporation
|
| Speech recognition method for activating a hyperlink of an internet page | ||
|
Patent #
US 6,604,076 B1
Filed 11/09/2000
|
Current Assignee
Nuance Communications Austria Gmbh
|
Sponsoring Entity
Koninklijke Philips N.V.
|
| Audio interface for document based information resource navigation and method therefor | ||
|
Patent #
US 5,884,266 A
Filed 04/02/1997
|
Current Assignee
Google Technology Holdings LLC
|
Sponsoring Entity
-
|
| Method and apparatus for controlling ultrasound systems | ||
|
Patent #
US 7,052,459 B2
Filed 09/10/2003
|
Current Assignee
GE Medical Systems Global Technology Company LLC
|
Sponsoring Entity
GE Medical Systems Global Technology Company LLC
|
| Method and device for providing speech-enabled input in an electronic device having a user interface | ||
|
Patent #
US 20050027538A1
Filed 04/07/2004
|
Current Assignee
Nokia Technologies Oy
|
Sponsoring Entity
Nokia Technologies Oy
|
| Color as a visual cue in speech-enabled applications | ||
|
Patent #
US 20040030559A1
Filed 09/25/2001
|
Current Assignee
Intel Corporation
|
Sponsoring Entity
Intel Corporation
|
| A VOICE RECOGNITION SYSTEM FOR NAVIGATING ON THE INTERNET | ||
|
Patent #
US 20030023444A1
Filed 08/31/1999
|
Current Assignee
Accenture Global Services Limited
|
Sponsoring Entity
Accenture Global Services Limited
|
| Voice site personality setting | ||
|
Patent #
US 20030036906A1
Filed 07/02/2002
|
Current Assignee
ShoreTel Incorporated
|
Sponsoring Entity
ShoreTel Incorporated
|
| System and method for speech activated navigation | ||
|
Patent #
US 20030078781A1
Filed 10/24/2001
|
Current Assignee
Promptu Systems Corporation
|
Sponsoring Entity
Promptu Systems Corporation
|
| Method for facilitating internet access with vocal and aural navigation, selection and rendering of internet content | ||
|
Patent #
US 20030182124A1
Filed 03/22/2002
|
Current Assignee
S Aqua Semiconductor LLC
|
Sponsoring Entity
-
|
| Method and system for gathering information by voice input | ||
|
Patent #
US 20020062216A1
Filed 11/15/2001
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
Nuance Communications Inc.
|
| User interface for speech recognition system grammars | ||
|
Patent #
US 6,456,972 B1
Filed 09/30/1999
|
Current Assignee
Nuance Communications Inc.
|
Sponsoring Entity
ScanSoft Inc. nka Nuance Communications Inc.
|
| Method and apparatus for transmitting DTMF signals employing local speech recognition | ||
|
Patent #
US 6,493,670 B1
Filed 10/14/1999
|
Current Assignee
Telefonaktiebolaget LM Ericsson
|
Sponsoring Entity
Telefonaktiebolaget LM Ericsson
|
| Hypertext navigation system controlled by spoken words | ||
|
Patent #
US 20010002466A1
Filed 01/17/2001
|
Current Assignee
Tamiras Per Pte Ltd LLC
|
Sponsoring Entity
Tamiras Per Pte Ltd LLC
|
| Robust voice browser system and voice activated device controller | ||
|
Patent #
US 20010047262A1
Filed 02/05/2001
|
Current Assignee
Parus Holdings Inc.
|
Sponsoring Entity
Parus Holdings Inc.
|
| Data processing system and method for navigating a network using a voice command | ||
|
Patent #
US 6,101,472 A
Filed 04/16/1997
|
Current Assignee
International Business Machines Corporation
|
Sponsoring Entity
International Business Machines Corporation
|
| Information system having a speech interface | ||
|
Patent #
US 5,774,859 A
Filed 01/03/1995
|
Current Assignee
Cisco Technology Incorporated
|
Sponsoring Entity
Scientific-Atlanta Incorporated
|
16 Claims
- 1. A method for enabling voice clicks in a multimodal page comprising the steps of:
- toggling a display of indicia binding selected user interface elements in the multimodal page to corresponding voice logic; and
, processing a selection of said selected user interface elements in the multimodal page through different selection modalities. - View Dependent Claims (2, 3, 4, 5, 6)
- toggling a display of indicia binding selected user interface elements in the multimodal page to corresponding voice logic; and
- 7. A system for enabling voice clicks in a multimodal page comprising:
- script logic comprising both a toggle method programmed to toggle a display of indicia binding selected user interface elements in the multimodal page, and also a click method programmed to process a selection of said selected user interface elements in the multimodal page;
voice logic comprising both code programmed to call said toggle method in said script logic, and also code programmed to call said click method in said script logic; and
, visual markup coupled to said voice logic and script logic, said visual markup comprising attributes defining said selected user interface elements and marking said selected user interface elements for processing by said voice logic. - View Dependent Claims (8, 9, 10)
- script logic comprising both a toggle method programmed to toggle a display of indicia binding selected user interface elements in the multimodal page, and also a click method programmed to process a selection of said selected user interface elements in the multimodal page;
- 11. A machine readable storage having stored thereon a computer program for enabling voice clicks in a multimodal page, the computer program comprising a routine set of instructions which when executed by a machine causes the machine to perform the steps of:
- toggling a display of indicia binding selected user interface elements in the multimodal page to corresponding voice logic; and
, processing a selection of said selected user interface elements in the multimodal page through different selection modalities. - View Dependent Claims (12, 13, 14, 15, 16)
- toggling a display of indicia binding selected user interface elements in the multimodal page to corresponding voice logic; and
1 Specification
1. Statement of the Technical Field
The present invention relates to a user interface and more particularly to voice enabling a multimodal markup language defined user interface.
2. Description of the Related Art
The user interface of a computer program serves the function of receiving input from an end user for underlying program logic, and for providing output produced by the program logic. Initially a mere command prompt, the conventional user interface has evolved over time into the complex, graphical user interface familiar to most computing end users today. More recently, the graphical user interface has been rendered both portable and dynamic through the utilization of markup language and server page technologies, including the extensible hypertext markup language (XHTML).
Notwithstanding the tremendous advances in the visual user interface, the visual aspect can be appropriate in many circumstances. For instance, some applications are deployed in environments not conducive to the use of a keyboard and monitor. Examples include telephonic applications including interactive voice response systems and hands-free applications such as those deployed in an automobile, to name only a few. To accommodate these non-traditional environments, extensive use has been made of the audible user interface. In fact, whole technologies, including the voice extensible markup language (VoiceXML) have been developed to address this unique market segment.
Not all applications operate in an environment dominated by a particular modality of interaction. In fact, in some multi-modal environments, often both audio and visual interface cues can be appropriate. Previously, multimodal environments required a separately specified user interface for each modality of interaction, including for instance an audio user interface and a graphical user interface. To generate a separate user interface for each specified modality of interaction, however, can be costly in terms of development time, expertise and maintenance.
Multimodal applications are computing applications which provide multiple interface types to accommodate the needs of prospective end users. Importantly, multimodal applications do not require separate user interfaces to accommodate each separate modality of interaction. Rather, the content of a multimodal application can specify the presentations and interactions in both visual and voice modalities. In most cases, the end user can choose a desired, most efficient input method for interacting with the underlying logic of the application.
Notably, the XHTML+Voice (X+V) markup language represents one technical effort to produce a multimodal application development environment. In X+V, XHTML and VoiceXML can be mixed in a single document. The XHTML portion of the document can manage visual interactions with an end user, while the VoiceXML portion of the document can manage voice interactions with the end user. The Multimodal Toolkit for WebSphere® Studio manufactured by IBM Corporation of Armonk, N.Y., United States incorporates X+V support in developing multimodal applications.
In X+V, command, control and content navigation (C3N) can be enabled while simultaneously rendering multimodal content. The X+V profile specifies how to compute grammars based upon the visual hyperlinks present in a page. Nevertheless, in practice it can be difficult and ambiguous for the user to understand what vocabulary has been activated to enable the voice hyperlinks. Accordingly, a simplified methodology would be desirable for computing a grammar for navigating hyperlinks and activating elements that accept mouse input by voice.
SUMMARY OF THE INVENTIONThe present invention addresses the deficiencies of the art in respect to multimodal page processing and provides a novel and non-obvious method, system and apparatus for enabling voice clicks in a multimodal page. In accordance with the present invention, a method for enabling voice clicks in a multimodal page can include toggling a display of indicia binding selected user interface elements in the multimodal page to corresponding voice logic; and, processing a selection of the selected user interface elements in the multimodal page through different selection modalities. In particular, the toggling step can include toggling a display of both indexing indicia for the selected user interface elements, and also a text display indicating that a voice selection of the selected user interface elements is supported.
In a specific aspect of the invention, the toggling step can include catching a voice utterance matching a pre-specified toggle grammar; and, calling a toggle method in script logic to perform the toggling of the display of indicia. Moreover, the toggling step can include the step of performing one of showing and hiding of the indicia binding the selected user interface elements in the multimodal page. By comparison, the processing step can include processing voice clicks for the selected user interface elements in the multimodal page through a voice modality. Additionally, the processing step can include catching a voice utterance matching a pre-specified click grammar; and, calling a click method in script logic to perform the selection of a selected one of the user interface elements.
A system for enabling voice clicks in a multimodal page can include script logic including both a toggle method programmed to toggle a display of indicia binding selected user interface elements in the multimodal page, and also a click method programmed to process a selection of the selected user interface elements in the multimodal page. The system also can include voice logic including both code programmed to call the toggle method in the script logic, and also code programmed to call the click method in the script logic. Finally, the system can include visual markup coupled to the voice logic and script logic. The visual markup can include attributes defining the selected user interface elements and marking the selected user interface elements for processing by the voice logic.
Additional aspects of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. The aspects of the invention will be realized and attained by means of the elements and combinations particularly pointed out in the appended claims. It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the invention, as claimed.
BRIEF DESCRIPTION OF THE DRAWINGSThe accompanying drawings, which are incorporated in and constitute part of this specification, illustrate embodiments of the invention and together with the description, serve to explain the principles of the invention. The embodiments illustrated herein are presently preferred, it being understood, however, that the invention is not limited to the precise arrangements and instrumentalities shown, wherein:
FIGS. 1A and 1B, taken together, are a pictorial illustration of a multimodal user interface configured to enable voice click navigation;
FIG. 2 is a schematic illustration of a system for enabling voice click navigation in a multimodal user interface; and,
FIG. 3 is a flow chart illustrating a process for enabling voice click navigation in the multimodal user interface of FIG. 2.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTSThe present invention is a method, system and apparatus for enabling voice clicks in a multimodal page. In accordance with the present invention, a command and control grammar can be enabled for processing in conjunction with the rendering of a multimodal page. The command and control fragment can recognize and process voice commands for visually hiding and showing voice clickable elements in the multimodal page. Script logic further can be configured to toggle the display of the voice clickable elements, and to insert indicia adjacent to the voice clickable elements when not hidden so as to bind the voice clickable elements to the command and control grammar. In this way, voice clicks can be selectively enabled and disabled within a multimodal page without requiring the development of separate user interfaces to accommodate disparate modalities of interaction.
FIGS. 1A and 1B, taken together, are a pictorial illustration of a multimodal user interface configured to enable voice click navigation. Firstly referring to FIG. 1A, a multimodal content browser 110 can display markup language defined content which can include one or more user interface elements and textual, visual and audible content, to name a few. The user interface elements can include one or more buttons 130, 150 as well as one or more hyperlinks 140. Any of the buttons 130, 150 and hyperlinks 150 can be activated through a keyboard or pointing device selection of the buttons 130, 150 and hyperlinks 150. To guide a viewer in this regard, textual instructions 120 can be provided to bind the required action to the user interface elements.
Notably, the selection of the show/hide button 150 can incorporate a different modality of interaction into the content. Specifically, referring to FIG. 1B, responsive to the activation of the show/hide button 150, selected ones of the user interface elements can be annotated with visual indicia 170 indicating that the selected user interface elements can be activated through multiple modalities, such as by way of voice. Additionally, additional textual instructions 160 can be provided to bind the additional modality of interaction to the selected ones of the user interface elements.
To enable the multimodal operation of the content, a system can be arranged as shown in FIG. 2. Specifically, FIG. 2 is a schematic illustration of a system for enabling voice click navigation in a multimodal user interface. The system can include visual markup 210 which can include one or more attributes defining one or more user interface elements, including buttons, hyperlinks and the like. Additionally, the visual markup 210 can be configured to accommodate both visual attributes (not shown) and voice attributes 230. Specifically, selected ones of the user interface elements each can be labeled as a user interface element which can be activated through the voice modality. To that end, as an example, the visual markup 210 can conform to the V+C specification for integrating multimodal content elements in a single XHTML defined markup language document.
The voice attributes 230 can be operatively enabled by voice logic 250 which can include, for instance, VoiceXML specified grammars and logic. In this regard, the voice logic 250 can include program code defining the capturing of the voice commands “Hide”, “Show” and “Click”. Specifically, the voice logic 250 can include a toggle method 280 defining a responsive call to script logic 240 for a hide or show voice command. Also, the voice logic 250 can include a click method 290 defining a responsive call to script logic 240 for a click voice command.
The script logic 240 can include global program code which can be accessed either through the visual markup 210 or the voice logic 250. In particular, the script logic 240 can include a toggle method 260 and a click method 270. The click method 270 can accept an index as an input parameter to identify which indexed user interface element in the visual markup 210 is to be activated as if an end user had selected the indexed user interface element utilizing a traditional input method such as a pointing device or keyboard. The toggle method 260, by comparison, can toggle the hiding and showing of the voice bindings of selected user interface elements in the visual markup 210. As noted, the toggle method 260 can be activated either by the toggle method 280 in the voice logic 250, or through the direct selection of a visual toggle link 220 defined in the visual markup 210.
In more particular illustration of the operation of the toggle methodology, FIG. 3 is a flow chart illustrating a process for enabling voice click navigation in the multimodal user interface of FIG. 2. Beginning in block 310, an input event can be received in the markup language defined page. In decision block 320, it can be determined whether the event is a toggle event. If not, in decision block 390 it can be determined whether the event is a click event. If so, in block 400, a click can be applied to the specified user interface element.
If in decision block 320, it is determined that the event is a toggle event, in decision block 330 it can be determined whether to hide displayed ones of the multimodal user interface elements of the page, or whether to show hidden ones of the multimodal user interface elements. For a “show” event, in block 240 the voice links for each hidden multimodal user interface element can be added to the page and additional binding text can be added to the page as well in block 350. In contrast, for a “hide” event, in block 360 the voice links for each displayed multimodal user interface element can be removed from the page and the additional binding text can be removed from the page as well in block 370. In both cases, in block 380 the page can be re-rendered to effectuate the changes.
The present invention can be realized in hardware, software, or a combination of hardware and software. An implementation of the method and system of the present invention can be realized in a centralized fashion in one computer system, or in a distributed fashion where different elements are spread across several interconnected computer systems. Any kind of computer system, or other apparatus adapted for carrying out the methods described herein, is suited to perform the functions described herein.
A typical combination of hardware and software could be a general purpose computer system with a computer program that, when being loaded and executed, controls the computer system such that it carries out the methods described herein. The present invention can also be embedded in a computer program product, which comprises all the features enabling the implementation of the methods described herein, and which, when loaded in a computer system is able to carry out these methods.
Computer program or application in the present context means any expression, in any language, code or notation, of a set of instructions intended to cause a system having an information processing capability to perform a particular function either directly or after either or both of the following a) conversion to another language, code or notation; b) reproduction in a different material form. Significantly, this invention can be embodied in other specific forms without departing from the spirit or essential attributes thereof, and accordingly, reference should be had to the following claims, rather than to the foregoing specification, as indicating the scope of the invention.