Detection of unauthorized user assistance of an electronic device based on the detection of spoken words

• US 10,528,712 B2
• Filed: 12/28/2016
• Issued: 01/07/2020
• Est. Priority Date: 12/28/2016
• Status: Active Grant

• Current Assignee: Motorola Solutions, Inc.
• Original Assignee: Motorola Solutions, Inc.
• Inventors: Lim, Bing Qin, Hooi, Boon Kheng, Lee, Wai Mun, Tham, Mun Yew
• Primary Examiner(s): Ho, Dao Q
• Application Number:
  US15/393,136
• Publication Number:
  US 20180181732A1
• Time in Patent Office: 1,105 Days
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 21/6245 Protecting personal data, e.g. for financial or medical purposes
• CPC Class Codes: G06F 2221/2139 Recurrent verification
• CPC Class Codes: G06F 2221/2149 Restricted operating environment
• CPC Class Codes: H04L 63/0861 using biometrical features, e.g. fingerprint, retina-scan cryptographic mechanisms or cryptographic arrangements for entity authentication using biological data H04L9/3231

Abstract

Methods and systems are provided in this disclosure for operating an electronic device. The electronic device includes a user interface, a microphone, and an electronic processor. The electronic processor determines whether a user assistance restriction is established for a current functional operation of the electronic device. The microphone captures an audio stream and the electronic processor analyzing the audio stream to identify spoken words captured by the microphone. The electronic processor detects a violation of the user assistance restriction for the current functional operation of the electronic device based at least in part on a correlation between one or more of the identified spoken words captured by the microphone and a current functional operation of the electronic device. The electronic processor adjusts one or more operations of the electronic device in response to detecting the violation of the user assistance restriction.

Claims

1. A method of operating an electronic device, the electronic device including a user interface, a microphone, and an electronic processor, the method comprising:

determining, by the electronic processor, whether a user assistance restriction is established for a current functional operation of the electronic device;

capturing, by the microphone, an audio stream;

analyzing, by the electronic processor, the audio stream to identify specific words spoken in the audio stream captured by the microphone;

accessing a stored list of keywords associated with the current functional operation of the electronic device,

wherein the stored list of keywords includes a predefined list of function keywords and a predefined list of action keywords, wherein the function keywords relate to a function performed by the electronic device, wherein the action keywords relate to an action performed by a user of the electronic device;

detecting, by the electronic processor, a violation of the user assistance restriction for the current functional operation of the electronic device by detecting both at least one function keyword and at least one action in the identified spoken words from the audio stream; and

adjusting, by the electronic processor, one or more operations of the electronic device in response to detecting the violation of the user assistance restriction.

2. The method of claim 1, wherein the current functional operation includes opening of a software application in response to receiving an input through the user interface, and

wherein detecting the violation of the user assistance restriction for the current functional operation of the electronic device includes detecting one or more keywords in the identified spoken words from the audio stream within a predefined period of time prior to receiving the input through the user interface.

3. The method of claim 1, wherein adjusting the one or more operations of the electronic device includes transmitting an alert signal to a remote computer system in response to detecting the violation of the user assistance restriction.

4. The method of claim 1, wherein adjusting the one or more operations of the electronic device includes storing a data record logging the violation in response to detection the violation of the user assistance restriction.

5. The method of claim 1, wherein adjusting the one or more operations of the electronic device includes adjusting a displayed output to display a warning message or to black out the displayed output in response to detecting the violation of the user assistance restriction.

6. The method of claim 1, further comprising calculating a value indicative of a probability of unauthorized user assistance based at least in part on the analysis of the audio stream, and

wherein detecting the violation of the user assistance restriction includes detecting when the value is greater than a predefined threshold.

7. The method of claim 1, wherein determining whether a user assistance restriction is established for a current functional operation of the electronic device includes

identifying a software application with which a user of the electronic device is currently interacting, and

accessing a look-up table stored to memory to determine whether any user assistance restrictions are established for the identified software application.

8. An electronic device comprising:

a user interface;

a microphone; and

an electronic processor configured to

determine whether a user assistance restriction is established for a current functional operation of the electronic device,

analyze an audio stream captured by the microphone to identify specific words spoken in the audio stream captured by the microphone,

access a stored list of keywords associated with the current functional operation of the electronic device, wherein the stored list of keywords includes a predefined list of function keywords and a predefined list of action keywords, wherein the function keywords relate to a function performed by the electronic device, wherein the action keywords relate to an action performed by a user of the electronic device,

detect a violation of the user assistance restriction for the current functional operation of the electronic device by detecting both at least one function keyword and at least one action keyword in the identified spoken words from the audio stream, and

adjust one or more operations of the electronic device in response to detecting the violation of the user assistance restriction.

9. The electronic device of claim 8, wherein the current functional operation includes opening of a software application in response to receiving an input through the user interface, and

wherein the electronic processor is configured to detect the violation of the user assistance restriction for the current functional operation of the electronic device by detecting one or more keywords in the identified spoken words from the audio stream within a predefined period of time prior to receiving the input through the user interface.

10. The electronic device of claim 8, wherein the electronic processor is configured to adjust the one or more operations of the electronic device by transmitting an alert signal to a remote computer system in response to detecting the violation of the user assistance restriction.

11. The electronic device of claim 8, wherein the electronic processor is configured to adjust the one or more operations of the electronic device by storing a data record logging the violation in response to detection the violation of the user assistance restriction.

12. The electronic device of claim 8, wherein the electronic processor is configured to adjust the one or more operations of the electronic device by adjusting a displayed output to display a warning message or to black out the displayed output in response to detecting the violation of the user assistance restriction.

13. The electronic device of claim 8, wherein the electronic processor is further configured to calculate a value indicative of a probability of unauthorized user assistance based at least in part on the analysis of the audio stream, and

wherein the electronic processor is configured to detect the violation of the user assistance restriction by detecting when the value is greater than a predefined threshold.