Event-triggered hands-free multitasking for media playback

• US 9,530,409 B2
• Filed: 01/23/2013
• Issued: 12/27/2016
• Est. Priority Date: 01/23/2013
• Status: Active Grant

• Current Assignee: Malikie Innovations Limited (Key Patent Innovations Limited)
• Original Assignee: Blackberry Limited
• Inventors: Bartnik, Grant Henry Robert
• Primary Examiner(s): ALBERTALLI, BRIAN LOUIS
• Application Number:
  US13/747,978
• Publication Number:
  US 20140207468A1
• Time in Patent Office: 1,434 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 2015/228 of application context

Abstract

A system and method are provided for hands-free operation of a device based on a context of an event. An example system configured to practice the method can detect an event during playback of media content to a user, and optionally output a first audible indication of the event. Based on the event, the system can activate a speech recognition application using a custom speech recognition grammar for recognizing a set of speech commands associated with the event. Then the system can optionally output a second audible indication of readiness to process speech in association with the event. The system can monitor, for a predetermined duration of time after the second audible indication, audio input received via the microphone to recognize a command via the speech recognition application, and execute the command.

Claims

1. A method operable on an electronic device, comprising:

during media playback, detecting an event;

initiating output of a first indication of the event, wherein the first indication is a first audio overlay on top of the media playback and indicates that speech recognition is available for a predefined period of time;

determining an event type from a plurality of event types, wherein each of the plurality of event types is associated with a set of speech commands;

determining a set of speech commands associated with the event type;

executing a speech recognition application to process speech commands associated with the event and to provide options to the user for controlling the electronic device, wherein executing the speech recognition application includes initiating a speech recognition engine using the set of speech commands associated with the event type;

initiating output of a second indication of a state of readiness to process speech commands in association with the event, wherein the second indication is an audio overlay on top of the media playback;

identifying a recognized speech command from a set of expected speech commands using custom speech recognition grammar based on the event; and

in response to identifying the recognized speech command;

pausing the media playback; and

executing the recognized speech command.

2. The method of claim 1, further comprising:

after executing the recognized speech command, resuming the paused media playback.

3. The method of claim 1, wherein the indication of the event is at least one of a visible indication, a tactile indication, or an audible indication.

4. The method of claim 1, wherein a style of the second indication is based on a type of the event.

5. The method of claim 1, wherein a style of the indication is based on an event type.

6. The method of claim 1, wherein the speech commands are based on the event and a user activity when the event occurred.

7. The method of claim 1, wherein the speech recognition application processes speech commands within an established time period, and wherein the established time period is based on an event type.

8. The method of claim 7, wherein the established time period starts after the event ends.

9. The method of claim 1, wherein the indication of the event comprises a synthetic spoken prompt describing the event.

10. The method of claim 1, wherein the indication of the event indicates at least one of the speech commands.

11. The method of claim 1, wherein the event comprises at least one of an incoming message, an incoming call, a user-initiated event, a calendar event, or a reminder.

12. An electronic device comprising:

a microphone;

a processor that communicates with a computer-readable storage medium having instructions stored thereon that, when executed by the processor, cause the processor to;

during playback of media content to a user in a hands-free operation mode, detect an event;

initiate output of a first indication of the event, wherein the first indication is a first audio overlay on top of the media playback and indicates that speech recognition is available for a predefined period of time;

determine an event type from a plurality of event types, wherein each of the plurality of event types is associated with a set of speech commands;

determine a set of speech commands associated with the event type;

based on the event, execute a speech recognition application to process speech commands associated with the event, wherein executing the speech recognition application includes initiating a speech recognition engine using the set of speech commands associated with the event type;

initiate output of an indication of readiness to process speech commands in association with the event, wherein the indication is an audio overlay on top of the playback of media content;

monitor, for a predetermined duration of time after the event, audio input received via the microphone to recognize a command via the speech recognition application; and

in response to recognizing the command;

pause the playback of the media content; and

execute the command.

13. The electronic device of claim 12, wherein the instructions, when executed by the processor, further cause the processor to:

after executing the command, resume the paused playback of the media content.

14. The electronic device of claim 12, wherein the hands-free operation mode is entered based on sensor input other than an explicit user command.

15. A non-transitory computer-readable storage medium for transferring control of media playback between electronic devices, the non-transitory computer-readable storage medium comprising instructions that, when executed by an electronic device, cause the electronic device to:

during playback of media content to a user, detect an event;

initiate output of a first audible indication of the event wherein the first audible indication is a first audio overlay on top of the media playback and indicates that speech recognition is available for a predefined period of time;

determine an event type from a plurality of event types, wherein each of the plurality of event types is associated with a set of speech commands;

determine a set of speech commands associated with the event type;

based on the event, execute a speech recognition application to process speech commands associated with the event, wherein executing the speech recognition application includes initiating a speech recognition engine using the set of speech commands associated with the event type;

initiate output of a second audible indication of readiness to process speech commands in association with the event, wherein the second audible indication is an audio overlay on top of the playback of media content;

monitor, for a predetermined duration of time after the second audible indication, audio input received via the microphone to recognize a command via the speech recognition application; and

in response to recognizing the command;

pause the playback of the media content; and

execute the command.

16. The non-transitory computer-readable storage medium of claim 15, wherein at least one of style or content of the first audible indication is based on a type of the event.

17. The non-transitory computer-readable storage medium of claim 15, wherein the computer-readable storage medium stores further instructions that, when executed by the electronic device, cause the computing device to:

after executing the command, resume the paused playback of the media content.