VOICE AND TOUCH USER INTERFACE

• US 20140278072A1
• Filed: 03/13/2014
• Published: 09/18/2014
• Est. Priority Date: 03/15/2013
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Chaudhri, Imran, Herz, Scott M., Santamaria, Justin E., Pitschel, Donald W., FINO, Jorge S.
• Granted Patent: US 9,719,797 B2
• Time in Patent Office: Days
• US Class Current: 701/465
• CPC Class Codes: G01C 21/36 Input/output arrangements for on-board computers
• CPC Class Codes: G01C 21/362 received from an external device or application, e.g. PDA, mobile phone or calendar application
• CPC Class Codes: G01C 21/3697 Output of additional, non-guidance related information, e.g. low fuel level G01C21/3679 takes precedence

Abstract

Various examples are directed to an electronic device capable of touch input through a touch-sensitive surface and/or voice input through a microphone. In some examples, the electronic device may be used in an automobile. For example, some or all of the electronic device may be mounted in a dashboard for use while driving. The electronic device may provide informational content, entertainment content, navigation, and communication features in such a manner that user interaction may be minimized, thus providing a safe driving experience. This can be accomplished by performing tasks and presenting content automatically, without the need for user input, and by allowing user input through voice controls, touch screen controls, and/or physical controls mounted on the dashboard or steering wheel, among other possibilities.

Claims

1. A computer-implemented method, comprising:

at an electronic device including one or more processors and a memory;

determining a current location;

receiving a destination location;

determining a route from the current location to the destination location;

calculating a route duration based on the route;

selecting a plurality of audio clips based on a comparison of the combined duration of the audio clips and the route duration; and

creating an audio program based on the selected plurality of audio clips.

2. The method of claim 1, wherein the current location is determined based on at least one of GPS, correlations from known access points, radio tower triangulation, and cell tower triangulation.

3. The method of claim 1, further comprising:

updating the current location;

calculating a remaining route duration from the updated current location; and

editing the audio program based on a comparison of the remaining duration of the audio program and the remaining route duration.

4. The method of claim 3, wherein updating the current location includes a determining a new location.

5. The method of claim 1, wherein selecting the plurality of audio clips further comprises:

selecting text content;

generating an audio clip based on the text content; and

selecting the generated audio clip.

6. The method of claim 1, further comprising:

monitoring route information, including one or both of traffic information and a current location;

updating an arrival time based on the route information;

comparing the updated arrival time to an appointment time associated with an appointment;

based on the comparison, determining that the arrival time is later than the appointment time; and

sending a message to one or more contacts associated with the appointment.

7. The method of claim 6, wherein the route information is monitored periodically.

8. The method claim 6, further comprising:

calculating a difference between the arrival time and the appointment time, wherein the text of the message includes the difference between the arrival time and the appointment time.

9. The method of claim 1, further comprising:

generating a first playlist and a second playlist, each associated with a plurality of audio clips;

displaying a first user interface object associated with the first playlist and a second user interface object associated with the second playlist; and

in response to activation of a seek mode;

automatically playing an excerpt of a first audio clip of the first playlist;

displaying an indication of the first playlist while the first audio clip is playing;

after playing the excerpt of the first audio clip, automatically playing an excerpt of a second audio clip of the second playlist; and

displaying an indication of the second playlist while the second audio clip is playing.

10. The method of claim 1, further comprising:

determining a first location associated with a contact of a message in a messaging application;

determining a second location associated with a search result in a web browsing application;

determining a third location associated with a route in a navigating application; and

displaying a list of recent locations comprising a user interface object for each of the first, second, and third locations.

11. The method of claim 1, further comprising:

determining a list of contacts associated with one or more messages received;

determining a location for each of the contacts in the list of contacts; and

displaying one or more of the locations in a list of recent locations.

12. The method of claim 1, further comprising:

determining that an automobile is in motion; and

based on the determination that the automobile is in motion, operating in a limited input mode, wherein operating in the limited input mode comprises;

in response to an operation requesting text entry, displaying an indication that voice input is requested and receiving voice input from a user; and

processing the voice input to generate text for the requested text entry.

13. An electronic device, comprising:

one or more processors;

memory; and

one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for;

determining a current location;

receiving a destination location;

determining a route from the current location to the destination location;

calculating a route duration based on the route;

selecting a plurality of audio clips based on a comparison of the combined duration of the audio clips and the route duration; and

creating an audio program based on the selected plurality of audio clips.

14. The electronic device of claim 13, wherein the current location is determined based on at least one of GPS, correlations from known access points, radio tower triangulation, and cell tower triangulation.

15. The electronic device of claim 13, the one or more programs further including instructions for:

updating the current location;

calculating a remaining route duration from the updated current location; and

editing the audio program based on a comparison of the remaining duration of the audio program and the remaining route duration.

16. The electronic device of claim 15, wherein updating the current location includes a determining a new location.

17. The electronic device of claim 13, wherein selecting the plurality of audio clips further comprises:

selecting text content;

generating an audio clip based on the text content; and

selecting the generated audio clip.

18. The electronic device of claim 13, the one or more programs further including instructions for:

monitoring route information, including one or both of traffic information and a current location;

updating an arrival time based on the route information;

comparing the updated arrival time to an appointment time associated with an appointment;

based on the comparison, determining that the arrival time is later than the appointment time; and

sending a message to one or more contacts associated with the appointment.

19. The electronic device of claim 18, wherein the route information is monitored periodically.

20. The electronic device claim 18, the one or more programs further including instructions for:

calculating a difference between the arrival time and the appointment time, wherein the text of the message includes the difference between the arrival time and the appointment time.

21. The electronic device of claim 13, the one or more programs further including instructions for:

generating a first playlist and a second playlist, each associated with a plurality of audio clips;

displaying a first user interface object associated with the first playlist and a second user interface object associated with the second playlist; and

in response to activation of a seek mode;

automatically playing an excerpt of a first audio clip of the first playlist;

displaying an indication of the first playlist while the first audio clip is playing;

after playing the excerpt of the first audio clip, automatically playing an excerpt of a second audio clip of the second playlist; and

displaying an indication of the second playlist while the second audio clip is playing.

22. The electronic device of claim 13, the one or more programs further including instructions for:

determining a first location associated with a contact of a message in a messaging application;

determining a second location associated with a search result in a web browsing application;

determining a third location associated with a route in a navigating application; and

displaying a list of recent locations comprising a user interface object for each of the first, second, and third locations.

23. The electronic device of claim 13, the one or more programs further including instructions for:

determining a list of contacts associated with one or more messages received;

determining a location for each of the contacts in the list of contacts; and

displaying one or more of the locations in a list of recent locations.

24. The electronic device of claim 13, the one or more programs further including instructions for:

determining that an automobile is in motion; and

based on the determination that the automobile is in motion, operating in a limited input mode, wherein operating in the limited input mode comprises;

in response to an operation requesting text entry, displaying an indication that voice input is requested and receiving voice input from a user; and

processing the voice input to generate text for the requested text entry.

25. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by an electronic device, cause the device to perform a method comprising:

determining a current location;

receiving a destination location;

determining a route from the current location to the destination location;

calculating a route duration based on the route;

selecting a plurality of audio clips based on a comparison of the combined duration of the audio clips and the route duration; and

creating an audio program based on the selected plurality of audio clips.

26. The non-transitory computer readable storage medium of claim 25, wherein the current location is determined based on at least one of GPS, correlations from known access points, radio tower triangulation, and cell tower triangulation.

27. The non-transitory computer readable storage medium of claim 25, the method further comprising:

updating the current location;

calculating a remaining route duration from the updated current location; and

editing the audio program based on a comparison of the remaining duration of the audio program and the remaining route duration.

28. The non-transitory computer readable storage medium of claim 27, wherein updating the current location includes a determining a new location.

29. The non-transitory computer readable storage medium of claim 25, wherein selecting the plurality of audio clips further comprises:

selecting text content;

generating an audio clip based on the text content; and

selecting the generated audio clip.

30. The non-transitory computer readable storage medium of claim 25, the method further comprising:

monitoring route information, including one or both of traffic information and a current location;

updating an arrival time based on the route information;

comparing the updated arrival time to an appointment time associated with an appointment;

based on the comparison, determining that the arrival time is later than the appointment time; and

sending a message to one or more contacts associated with the appointment.

31. The non-transitory computer readable storage medium of claim 30, wherein the route information is monitored periodically.

32. The non-transitory computer readable storage medium claim 30, the method further comprising:

calculating a difference between the arrival time and the appointment time, wherein the text of the message includes the difference between the arrival time and the appointment time.

33. The non-transitory computer readable storage medium of claim 25, the method further comprising:

generating a first playlist and a second playlist, each associated with a plurality of audio clips;

displaying a first user interface object associated with the first playlist and a second user interface object associated with the second playlist; and

in response to activation of a seek mode;

automatically playing an excerpt of a first audio clip of the first playlist;

displaying an indication of the first playlist while the first audio clip is playing;

after playing the excerpt of the first audio clip, automatically playing an excerpt of a second audio clip of the second playlist; and

displaying an indication of the second playlist while the second audio clip is playing.

34. The non-transitory computer readable storage medium of claim 25, the method further comprising:

determining a first location associated with a contact of a message in a messaging application;

determining a second location associated with a search result in a web browsing application;

determining a third location associated with a route in a navigating application; and

displaying a list of recent locations comprising a user interface object for each of the first, second, and third locations.

35. The non-transitory computer readable storage medium of claim 25, the method further comprising:

determining a list of contacts associated with one or more messages received;

determining a location for each of the contacts in the list of contacts; and

displaying one or more of the locations in a list of recent locations.

36. The non-transitory computer readable storage medium of claim 25, the method further comprising:

determining that an automobile is in motion; and

based on the determination that the automobile is in motion, operating in a limited input mode, wherein operating in the limited input mode comprises;

in response to an operation requesting text entry, displaying an indication that voice input is requested and receiving voice input from a user; and

processing the voice input to generate text for the requested text entry.