Automatic and selective context-based gating of a speech-output function of an electronic digital assistant

• US 10,248,379 B2
• Filed: 07/27/2017
• Issued: 04/02/2019
• Est. Priority Date: 07/27/2017
• Status: Active Grant

• Current Assignee: Motorola Solutions, Inc.
• Original Assignee: Motorola Solutions, Inc.
• Inventors: Steinberg, Paul D.
• Primary Examiner(s): Elbin, Jesse A
• Application Number:
  US15/661,209
• Publication Number:
  US 20190034157A1
• Time in Patent Office: 614 Days
• Field of Search: 700 94, 704232, 704274, 704275, 715727, 715728
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G06Q 50/40 Business processes related to the transportation industry shipping G06Q10/083
• CPC Class Codes: G10L 15/20 Speech recognition techniques specially adapted for robustness in adverse environments, e.g. in noise, of stress induced speech G10L21/02 takes precedence
• CPC Class Codes: G10L 21/16 Transforming into a non-visible representation devices or methods enabling ear patients to replace direct auditory perception by another kind of perception A61F11/04

Abstract

A process at an electronic computing device (device) for automatic and selective context-based gating of an electronic digital assistant speech-output function includes detecting, via a sensor communicatively coupled to the device or via a notification received at the device, an event associated with a need to reduce a cognitive load on the user. Responsively, temporarily gating a portion of an electronic digital assistant speech-output function to prevent reproduction to the user of one or more first speech-output events generated during a first period of time associated with the event. Subsequently, and after detecting that the event has ended, ending the temporary gating to allow reproduction of one or more second speech-output events generated during a second period of time after the event has ended.

Claims

1. A method at an electronic computing device for automatic and selective context-based gating of an electronic digital assistant speech-output function during detected high cognitive load events, the method comprising:

detecting, by an electronic computing device associated with a user and via sensor content information from one or more sensors communicatively coupled to the electronic computing device or via notification content information in a notification received at the electronic computing device from another computing device, that the user is or is likely currently experiencing an event associated with a need to reduce a cognitive load on the user;

responsive to detecting the event, temporarily gating, by the electronic computing device, a portion of an electronic digital assistant speech-output function to prevent reproduction to the user of one or more first speech-output events generated during a first period of time associated with the event; and

subsequently, and after detecting, by the electronic computing device associated with the user that the event has ended, ending, by the electronic computing device, the temporary gating of the portion of the electronic digital assistant speech-output function to allow reproduction of one or more second speech-output events generated during a second period of time after the event has ended;

wherein the one or more sensors include a microphone, and the sensor content includes a captured voice of the user; and

wherein the detecting the event includes detecting, via the audio analytics applied to the captured voice contents from the microphone, that the user'"'"'s stress level is high and that there is a need to reduce a cognitive load on the user.

2. The method of claim 1, further comprising:

during the first period of time, queuing the one or more generated first speech-output events and, after detecting that the event has ended, playing back, by the electronic computing device, at least one of the queued one or more generated first speech-output events.

3. The method of claim 2, wherein a prompt is displayed at a display element of one of a mobile and a portable computing device associated with the user indicating that the queued one or more generated first speech-output events are now available for reproduction, and responsive to detecting a user input operation associated with playing back the queued one or more generated first speech-output events, playing back the queued one or more generated first speech-output events at the one of the mobile and portable computing device.

4. The method of claim 2, wherein a plurality of generated first speech-output events are generated and queued during the first period of time, the method further comprising, after detecting, via second sensor content information from the one or more sensors communicatively coupled to the electronic computing device or via a second notification received at the electronic computing device from another computing device, that the event has ended, playing back, by the electronic computing device, the queued plurality of generated first speech-output events in a priority order that is different from an order in which they were generated.

5. The method of claim 2, wherein a plurality of generated first speech-output events are at least initially queued and not reproduced during the first period, and the method further comprising, after detecting that the event has ended, via second sensor content information from the one or more sensors communicatively coupled to the electronic computing device or via a second notification received at the electronic computing device from another computing device, removing from the queue or refraining from playing back, at least one of the plurality of generated first speech-output events determined to be duplicative or no longer relevant.

6. The method of claim 2, wherein a plurality of generated first speech-output events are at least initially queued and not reproduced during the first period, and the method further comprising, after detecting that the event has ended, via second sensor content information from the one or more sensors communicatively coupled to the electronic computing device or via a second notification received at the electronic computing device from another computing device, condensing the plurality of generated first speech-output events into a summary description of the plurality of generated first speech-output events and playing back, by the electronic computing device, the summary description of the plurality of generated first speech-output events.

7. The method of claim 1, wherein detecting, by the electronic computing device associated with the user, that the event has ended comprises detecting, via second sensor content information from the one or more sensors communicatively coupled to the electronic computing device or via a second notification received at the electronic computing device from another computing device, that the event has ended.

8. The method of claim 1, further comprising, during the first time period, the electronic digital assistant allowing immediate reproduction of electronic digital assistant speech-output functions associated with higher priority public-safety-related events while preventing reproduction of electronic digital assistant speech-output functions associated with lower priority public-safety-related events;

wherein the higher priority public-safety-related events include one or more selected from a shots fired event, an officer down event, a person detected approaching the user from one or more visual blind spots associated with the user event, an evacuate structure event, and a backup arrived on scene event; and

wherein the lower priority public-safety-related events include one or more selected from a calendar notification event, a patrol-related or jurisdictional boundary related notification event, a nearby available task related notification event, an e-mail reception notification event from an unknown or low priority source, a text message reception notification event from an unknown or low priority source, and a phone call reception notification event from an unknown or low priority source.

9. A method at an electronic computing device for automatic and selective context-based gating of an electronic digital assistant speech-output function during detected high cognitive load events, the method comprising:

detecting, by an electronic computing device associated with a user and via sensor content information from one or more sensors communicatively coupled to the electronic computing device or via notification content information in a notification received at the electronic computing device from another computing device, that the user is or is likely currently experiencing an event associated with a need to reduce a cognitive load on the user;

responsive to detecting the event, temporarily gating, by the electronic computing device, a portion of an electronic digital assistant speech-output function to prevent reproduction to the user of one or more first speech-output events generated during a first period of time associated with the event; and

subsequently, and after detecting, by the electronic computing device associated with the user that the event has ended, ending, by the electronic computing device, the temporary gating of the portion of the electronic digital assistant speech-output function to allow reproduction of one or more second speech-output events generated during a second period of time after the event has ended;

wherein detecting the event associated with the need to reduce the cognitive load on the user comprises detecting, via the sensor content information from the one or more sensors communicatively coupled to the electronic computing device, acceleration information indication an acceleration of one of the user and a vehicle associated with the user beyond a threshold minimum level.

10. A method at an electronic computing device for automatic and selective context-based gating of an electronic digital assistant speech-output function during detected high cognitive load events, the method comprising:

detecting, by an electronic computing device associated with a user and via sensor content information from one or more sensors communicatively coupled to the electronic computing device or via notification content information in a notification received at the electronic computing device from another computing device, that the user is or is likely currently experiencing an event associated with a need to reduce a cognitive load on the user;

responsive to detecting the event, temporarily gating, by the electronic computing device, a portion of an electronic digital assistant speech-output function to prevent reproduction to the user of one or more first speech-output events generated during a first period of time associated with the event;

subsequently, and after detecting, by the electronic computing device associated with the user that the event has ended, ending, by the electronic computing device, the temporary gating of the portion of the electronic digital assistant speech-output function to allow reproduction of one or more second speech-output events generated during a second period of time after the event has ended; and

during the first time period, the electronic digital assistant allowing immediate reproduction of electronic digital assistant speech-output functions associated with higher priority retail-related events while preventing reproduction of electronic digital assistant speech-output functions associated with lower priority retail-related events;

wherein the higher priority retail-related events include one or more selected from a liquid spill notification event, a customer needs assistance notification event, a current store manager or store security identity update notification event, an approaching customer notification event, and a fire notification event; and

wherein the lower priority retail-related events include one or more selected from a calendar notification event, a customer visibility route for a retail department or functional area related notification event, a nearby available task related notification event, an e-mail reception notification event from an unknown or low priority source, a text message reception notification event from an unknown or low priority source, and a phone call reception notification event from an unknown or low priority source.

11. A method at an electronic computing device for automatic and selective context-based gating of an electronic digital assistant speech-output function during detected high cognitive load events, the method comprising:

detecting, by an electronic computing device associated with a user and via sensor content information from one or more sensors communicatively coupled to the electronic computing device or via notification content information in a notification received at the electronic computing device from another computing device, that the user is or is likely currently experiencing an event associated with a need to reduce a cognitive load on the user;

responsive to detecting the event, temporarily gating, by the electronic computing device, a portion of an electronic digital assistant speech-output function to prevent reproduction to the user of one or more first speech-output events generated during a first period of time associated with the event;

subsequently, and after detecting, by the electronic computing device associated with the user that the event has ended, ending, by the electronic computing device, the temporary gating of the portion of the electronic digital assistant speech-output function to allow reproduction of one or more second speech-output events generated during a second period of time after the event has ended; and

during the first time period, the electronic digital assistant allowing immediate reproduction of electronic digital assistant speech-output functions associated with higher priority energy or mining related events while preventing reproduction of electronic digital assistant speech-output functions associated with lower priority energy or mining related events;

wherein the higher priority energy or mining related events include one or more selected from a secure blast zone notification event, a lost power notification event, a gas level notification event, an unexpected person in restricted area notification event, a notification of a current location of the user in a restricted area notification event, and a detected blast or fire notification event; and

wherein the lower priority energy or mining related events include one or more selected from a calendar notification event, a co-worker entry or exit of same work area notification event, a nearby available task related notification event, an e-mail reception notification event from an unknown or low priority source, a text message reception notification event from an unknown or low priority source, and a phone call reception notification event from an unknown or low priority source.