Voice instructions during navigation

• US 10,732,003 B2
• Filed: 06/27/2018
• Issued: 08/04/2020
• Est. Priority Date: 06/05/2012
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: van Os, Marcel, Barbour, Sarah G., Law, Brady A., Moore, Bradford A.
• Primary Examiner(s): Tzeng, Feng-Tzer
• Application Number:
  US16/019,646
• Publication Number:
  US 20190137293A1
• Time in Patent Office: 769 Days
• CPC Class Codes: G01C 21/34 Route searching; Route guidance
• CPC Class Codes: G01C 21/3608 using speech input, e.g. using speech recognition
• CPC Class Codes: G01C 21/3617 using user history, behaviour, conditions or preferences, e.g. predicted or inferred from previous use or current movement
• CPC Class Codes: G01C 21/3629 Guidance using speech or audio output, e.g. text-to-speech text to speech systems per se G10L13/00
• CPC Class Codes: G01C 21/3632 Guidance using simplified or iconic instructions, e.g. using arrows G01C21/365 takes precedence
• CPC Class Codes: G01C 21/3638 including 3D objects and buildings three dimensional [3D] modelling, e.g. data description of 3D objects G06T17/00; geographic models G06T17/05
• CPC Class Codes: G01C 21/3664 Details of the user input interface, e.g. buttons, knobs or sliders, including those provided on a touch screen; remote controllers; input using gestures
• CPC Class Codes: G01C 21/3667 Display of a road map G01C21/3614 takes precedence; guidance using 3D or perspective road maps G01C21/3635
• CPC Class Codes: G01C 21/367 Details, e.g. road map scale, orientation, zooming, illumination, level of detail, scrolling of road map or positioning of current position marker
• CPC Class Codes: G01C 21/3676 Overview of the route on the road map
• CPC Class Codes: G06F 16/433 using audio data
• CPC Class Codes: G06F 16/444 Spatial browsing, e.g. 2D maps, 3D or virtual spaces
• CPC Class Codes: G06F 16/68 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 2203/04803 Split screen, i.e. subdividing the display area or the window area into separate subareas
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/08 : Speech classification or search
• CPC Class Codes: G10L 15/22 : Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 17/22 : Interactive procedures; Man-machine interfaces
• CPC Class Codes: G10L 2015/223 : Execution procedure of a spoken command
• CPC Class Codes: G10L 21/00 : Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility G10L19/00 takes precedence
• CPC Class Codes: H04R 2430/01 : Aspects of volume control, not necessarily automatic, in sound systems
• CPC Class Codes: H04R 2499/13 : Acoustic transducers and sound field adaptation in vehicles
• CPC Class Codes: H04R 5/00 : Stereophonic arrangements stereophonic pick-ups H04R9/16, H04R11/12, H04R17/08, H04R19/10
• CPC Class Codes: H04R 5/04 : Circuit arrangements, e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments combinations of amplifiers H03F3/68; stereophonic systems H04S
• CPC Class Codes: Y02D 30/70 : in wireless communication networks

Abstract

A method of providing navigation on an electronic device when the display screen is locked. The method receives a verbal request to start navigation while the display is locked. The method identifies a route from a current location to a destination based on the received verbal request. While the display screen is locked, the method provides navigational directions on the electronic device from the current location of the electronic device to the destination. Some embodiments provide a method for processing a verbal search request. The method receives a navigation-related verbal search request and prepares a sequential list of the search results based on the received request. The method then provides audible information to present a search result from the sequential list. The method presents the search results in a batch form until the user selects a search result, the user terminates the search, or the search items are exhausted.

Claims

1. A method of providing navigational directions on an electronic device, the method comprising:

receiving a verbal navigation request for directions to a destination;

providing audible information to present navigational directions to the destination;

initiating a navigation route to the destination according to the navigational directions;

detecting an upcoming maneuver at a navigation point on the navigation route;

identifying a current presentation context in which to present the upcoming maneuver;

based on the current presentation context, adaptively generating a directional graphical indicator corresponding to the upcoming maneuver based on a size of a display space associated with the current presentation context; and

presenting the directional graphical indicator when the electronic device reaches a threshold distance from the navigation point.

2. The method of claim 1, wherein the directional graphical indicator comprises a textured image that is textured using one or more of an image captured with a flyover camera and a computer-generated image.

3. The method of claim 1, wherein the directional graphical indicator is an arrow indicator.

4. The method of claim 1, further comprising:

detecting that the upcoming maneuver occurs at a T-junction;

adaptively generating the directional graphical indicator, further comprising rendering the directional graphical indicator using a first size and a first brightness over a first segment of the T-junction that corresponds to a direction of the upcoming maneuver; and

rendering a second segment of the T-junction that does not correspond to the direction of the upcoming maneuver in a deemphasized manner.

5. The method of claim 4, wherein rendering the second segment of the T-junction in a deemphasized manner comprises:

rendering the second segment at a second size and a second brightness, wherein the first size is greater than the second size and the first brightness is higher than the second brightness.

6. The method of claim 1, wherein the upcoming maneuver is a U-turn, further comprising:

displaying a stored U-turn directional graphical indicator.

7. A non-transitory machine readable medium storing a program for providing navigational directions on an electronic device, the program for execution by at least one processing unit, the program comprising sets of instructions for:

receiving a verbal navigation request for directions to a destination;

providing audible information to present navigational directions to the destination;

initiating a navigation route to the destination according to the navigational directions;

detecting an upcoming maneuver at a navigation point on the navigation route;

determining a current presentation context in which the upcoming maneuver will be displayed;

based on the current presentation context, adaptively generating a directional graphical indicator corresponding to the upcoming maneuver based on a size of a display space associated with the current presentation context; and

displaying the directional graphical indicator when the electronic device reaches a threshold distance from the navigation point.

8. The non-transitory machine readable medium of claim 7, wherein the directional graphical indicator comprises a textured image that is textured using one or more of an image captured with a flyover camera and a computer-generated image.

9. The non-transitory machine readable medium of claim 7, wherein the directional graphical indicator is an arrow indicator.

10. The non-transitory machine readable medium of claim 7, wherein the program further comprises sets of instructions for:

detecting that the upcoming maneuver occurs at a T-junction;

adaptively generating the directional graphical indicator, further comprising rendering the directional graphical indicator using a first size and a first brightness over a first segment of the T-junction that corresponds to a direction of the upcoming maneuver; and

rendering a second segment of the T-junction that does not correspond to the direction of the upcoming maneuver in a deemphasized manner.

11. The non-transitory machine readable medium of claim 10, wherein the set of instructions for rendering the second segment of the T-junction in a deemphasized manner comprises sets of instructions for:

rendering the second segment at a second size and a second brightness, wherein the first size is greater than the second size and the first brightness is higher than the second brightness.

12. The non-transitory machine readable medium of claim 7, wherein the upcoming maneuver is a U-turn, and wherein the program further comprises sets of instructions for:

displaying a stored U-turn directional graphical indicator.

13. A mobile device comprising:

A set of processing units for processing sets of instructions;

A non transitory machine readable medium storing a program, which when executing by at least one processing unit of the mobile device, provides navigational directions on a display screen of the mobile device, the program comprising sets of instructions for;

receiving a verbal navigation request for directions to a destination;

providing audible information to present navigational directions to the destination;

initiating a navigation route to the destination according to the navigational directions;

detecting an upcoming maneuver at a navigation point on the navigation route;

determining a current presentation context in which the upcoming maneuver will be displayed;

based on the current presentation context, adaptively generating a directional graphical indicator corresponding to the upcoming maneuver based on a size of a display space associated with the current presentation context; and

displaying the directional graphical indicator when the electronic device reaches a threshold distance from the navigation point.

14. The mobile device of claim 13, wherein the directional graphical indicator comprises a textured image that is textured using one or more of an image captured with a flyover camera and a computer-generated image.

15. The mobile device of claim 13, wherein the program further comprises sets of instructions for:

detecting that the upcoming maneuver occurs at a T-junction;

adaptively generating the directional graphical indicator, further comprising rendering the directional graphical indicator using a first size and a first brightness over a first segment of the T-junction that corresponds to a direction of the upcoming maneuver; and

rendering a second segment of the T-junction that does not correspond to the direction of the upcoming maneuver in a deemphasized manner.

16. The mobile device of claim 15, wherein the set of instructions for rendering the second segment of the T-junction in a deemphasized manner further comprises sets of instructions for:

rendering the second segment at a second size and a second brightness, wherein the first size is greater than the second size and the first brightness is higher than the second brightness.

17. The mobile device of claim 13, wherein the upcoming maneuver is a U-turn, and wherein the program further comprises sets of instructions for:

displaying a stored U-turn directional graphical indicator.