Voice instructions during navigation

• US 10,718,625 B2
• Filed: 06/27/2018
• Issued: 07/21/2020
• Est. Priority Date: 06/05/2012
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: van Os, Marcel, Barbour, Sarah G., Law, Brady A., Moore, Bradford A.
• Primary Examiner(s): Tzeng, Feng-Tzer
• Application Number:
  US16/019,649
• Publication Number:
  US 20190145792A1
• Time in Patent Office: 755 Days
• CPC Class Codes: G01C 21/34 Route searching; Route guidance
• CPC Class Codes: G01C 21/3608 using speech input, e.g. using speech recognition
• CPC Class Codes: G01C 21/3617 using user history, behaviour, conditions or preferences, e.g. predicted or inferred from previous use or current movement
• CPC Class Codes: G01C 21/3629 Guidance using speech or audio output, e.g. text-to-speech text to speech systems per se G10L13/00
• CPC Class Codes: G01C 21/3632 Guidance using simplified or iconic instructions, e.g. using arrows G01C21/365 takes precedence
• CPC Class Codes: G01C 21/3638 including 3D objects and buildings three dimensional [3D] modelling, e.g. data description of 3D objects G06T17/00; geographic models G06T17/05
• CPC Class Codes: G01C 21/3664 Details of the user input interface, e.g. buttons, knobs or sliders, including those provided on a touch screen; remote controllers; input using gestures
• CPC Class Codes: G01C 21/3667 Display of a road map G01C21/3614 takes precedence; guidance using 3D or perspective road maps G01C21/3635
• CPC Class Codes: G01C 21/367 Details, e.g. road map scale, orientation, zooming, illumination, level of detail, scrolling of road map or positioning of current position marker
• CPC Class Codes: G01C 21/3676 Overview of the route on the road map
• CPC Class Codes: G06F 16/433 using audio data
• CPC Class Codes: G06F 16/444 Spatial browsing, e.g. 2D maps, 3D or virtual spaces
• CPC Class Codes: G06F 16/68 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 2203/04803 Split screen, i.e. subdividing the display area or the window area into separate subareas
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/08 : Speech classification or search
• CPC Class Codes: G10L 15/22 : Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 17/22 : Interactive procedures; Man-machine interfaces
• CPC Class Codes: G10L 2015/223 : Execution procedure of a spoken command
• CPC Class Codes: G10L 21/00 : Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility G10L19/00 takes precedence
• CPC Class Codes: H04R 2430/01 : Aspects of volume control, not necessarily automatic, in sound systems
• CPC Class Codes: H04R 2499/13 : Acoustic transducers and sound field adaptation in vehicles
• CPC Class Codes: H04R 5/00 : Stereophonic arrangements stereophonic pick-ups H04R9/16, H04R11/12, H04R17/08, H04R19/10
• CPC Class Codes: H04R 5/04 : Circuit arrangements, e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments combinations of amplifiers H03F3/68; stereophonic systems H04S
• CPC Class Codes: Y02D 30/70 : in wireless communication networks

Abstract

A method of providing navigation on an electronic device when the display screen is locked. The method receives a verbal request to start navigation while the display is locked. The method identifies a route from a current location to a destination based on the received verbal request. While the display screen is locked, the method provides navigational directions on the electronic device from the current location of the electronic device to the destination. Some embodiments provide a method for processing a verbal search request. The method receives a navigation-related verbal search request and prepares a sequential list of the search results based on the received request. The method then provides audible information to present a search result from the sequential list. The method presents the search results in a batch form until the user selects a search result, the user terminates the search, or the search items are exhausted.

Claims

1. A method of providing navigational audio announcements on an electronic device traveling a route, comprising:

receiving, by a voice-activated service, a navigation audio item from a navigation application for a navigational audio announcement corresponding to the route;

detecting that a user verbal request is currently being provided to the voice-activated service;

determining that the electronic device has reached within a threshold distance of an upcoming maneuver that corresponds to the navigational audio announcement;

generating, by the voice-activated service, a voice-activated service output in response to the user verbal request;

responsive to the determination, generating, by the voice-activated service, a composite output that combines the navigation audio item and the voice-activated service output to the user verbal request; and

outputting, by the voice-activated service, the composite output.

2. The method of claim 1, further comprising:

receiving, by the voice-activated service, a navigation text item from the navigation application for the navigational audio announcement corresponding to the route;

converting, using a voice synthesizer, the navigation text item to a navigation voice response; and

generating, by the voice-activated service, the composite output, the composite output incorporating the navigation voice response into the voice-activated service output.

3. The method of claim 1, wherein the voice-activated service output acknowledges the user verbal request without providing a full response to the user verbal request.

4. The method of claim 1, further comprising:

determining that the electronic device has completed navigation of the upcoming maneuver; and

providing a full voice response to the user verbal request, the full voice response including a reply to a question included within the user verbal request.

5. The method of claim 1, further comprising:

providing, by the voice-activated service, a voice response to the user verbal request;

receiving, by the voice-activated service, the navigation audio item from the navigation application;

determining, by the voice-activated service, that the voice response can be interrupted; and

outputting, by the voice-activated service, the navigation audio item.

6. The method of claim 5, further comprising:

determining, by the voice-activated service, that the voice response cannot be interrupted;

saving the navigation audio item to a memory device;

determining that i) the voice response has been delivered, and a user verbal request is not currently being received; and

outputting the navigation audio item.

7. The method of claim 1, further comprising:

presenting, by the voice-activated service, a uniform audio interface to a user of the electronic device by using a same voice synthesizer as is used by the navigation application.

8. A non-transitory machine readable medium storing a program for providing navigational audio announcements on an electronic device, the program for execution by at least one processing unit, the program comprising sets of instructions for:

receiving, by a voice-activated service, a navigation audio item from a navigation application for a navigational audio announcement corresponding to the route;

detecting that a user verbal request is currently being provided to the voice-activated service;

determining that the electronic device has reached within a threshold distance of an upcoming maneuver that corresponds to the navigational audio announcement;

generating, by the voice-activated service, a voice-activated service output to the user verbal request;

responsive to the determination, generating, by the voice-activated service, a composite output that combines the navigation audio item and the voice-activated service output to the user verbal request; and

outputting, by the voice-activated service, the composite output.

9. The non-transitory machine readable medium of claim 8, wherein the program further comprises sets of instructions for:

receiving, by the voice-activated service, a navigation text item from the navigation application for the navigational audio announcement corresponding to the route;

converting, using a voice synthesizer, the navigation text item to a navigation voice response; and

generating, by the voice-activated service, the composite output, the composite output incorporating the navigation voice response into the voice-activated service output.

10. The non-transitory machine readable medium of claim 8, wherein the voice-activated service output acknowledges the user verbal request without providing a full response to the user verbal request.

11. The non-transitory machine readable medium of claim 8, wherein the program further comprises sets of instructions for:

determining that the electronic device has completed navigation of the upcoming maneuver; and

providing a full voice response to the user verbal request, the full voice response including a reply to a question included within the user verbal request.

12. The non-transitory machine readable medium of claim 8, wherein the program further comprises sets of instructions for:

providing, by the voice-activated service, a voice response to the user verbal request;

receiving, by the voice-activated service, the navigation audio item from the navigation application;

determining, by the voice-activated service, that the voice response can be interrupted; and

outputting, by the voice-activated service, the navigation audio item.

13. The non-transitory machine readable medium of claim 12, wherein the program further comprises sets of instructions for:

determining, by the voice-activated service, that the voice response cannot be interrupted;

saving the navigation audio item to a memory device;

determining that i) the voice response has been delivered, and ii) a user verbal request is not currently being received; and

outputting the navigation audio item.

14. The non-transitory machine readable medium of claim 8, wherein the program further comprises sets of instructions for:

presenting, by the voice-activated service, a uniform audio interface to a user of the electronic device by using a same voice synthesizer as is used by the navigation application.

15. A mobile device comprising:

a set of processing units for processing sets of instructions;

a non transitory machine readable medium storing a program, which when executed by at least one processing unit of the mobile device, provides navigational audio announcements on the mobile device, the program comprising sets of instructions for;

receiving, by a voice-activated service, a navigation audio item from a navigation application for a navigational audio announcement corresponding to the route;

detecting that a user verbal request is currently being provided to the voice-activated service;

determining that the electronic device has reached within a threshold distance of an upcoming maneuver that corresponds to the navigational audio announcement;

generating, by the voice-activated service, a voice-activated service output in response to the user verbal request;

responsive to the determination, generating, by the voice-activated service, a composite output that combines the navigation audio item and the voice-activated service output to the user verbal request; and

outputting, by the voice-activated service, the composite output.

16. The mobile device of claim 15, wherein the program further comprises sets of instructions for:

receiving, by the voice-activated service, a navigation text item from the navigation application for the navigational audio announcement corresponding to the route;

converting, using a voice synthesizer, the navigation text item to a navigation voice response; and

generating, by the voice-activated service, the composite output, the composite output incorporating the navigation voice response into the voice-activated service output.

17. The mobile device of claim 15, wherein the program further comprises sets of instructions for:

determining that the electronic device has completed navigation of the upcoming maneuver; and

providing a full voice response to the user verbal request, the full voice response including a reply to a question included within the user verbal request.

18. The mobile device of claim 15, wherein the program further comprises sets of instructions for:

providing, by the voice-activated service, a voice response to the user verbal request;

receiving, by the voice-activated service, the navigation audio item from the navigation application;

determining, by the voice-activated service, that the voice response can be interrupted; and

outputting, by the voice-activated service, the navigation audio item.

19. The mobile device of claim 18, wherein the program further comprises sets of instructions for:

determining, by the voice-activated service, that the voice response cannot be interrupted;

saving the navigation audio item to a memory device;

determining that i) the voice response has been delivered, and a user verbal request is not currently being received; and

outputting the navigation audio item.

20. The mobile device of claim 15, wherein the program further comprises sets of instructions for:

presenting, by the voice-activated service, a uniform audio interface to a user of the electronic device by using a same voice synthesizer as is used by the navigation application.