USER INPUT PROCESSING RESTRICTION IN A SPEECH PROCESSING SYSTEM

• US 20190235831A1
• Filed: 01/31/2018
• Published: 08/01/2019
• Est. Priority Date: 01/31/2018
• Status: Active Application

• Current Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Original Assignee: Amazon Technologies, Inc. (Amazon.com, Inc.)
• Inventors: Bao, Yu
• Application Number:
  US15/884,907
• Publication Number:
  US 20190235831A1
• Time in Patent Office: Days
• CPC Class Codes: G06F 21/31 User authentication
• CPC Class Codes: G06F 21/629 to features or functions of an application
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06F 40/30 Semantic analysis
• CPC Class Codes: G10L 15/18 using natural language modelling
• CPC Class Codes: G10L 15/19 Grammatical context, e.g. disambiguation of the recognition hypotheses based on word sequence rules
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 17/00 Speaker identification or verification techniques
• CPC Class Codes: H04L 12/2829 involving user profiles according to which the execution of a home appliance functionality is automatically triggered

Abstract

Techniques for restricting content, available to a speech processing system, from certain users of the system are described. The system may include child devices. When a user (e.g., an adult user or a child user) provides input to a child device, the system may process the input to determine child appropriate content based on the invoked device being a child device. In addition to including child devices, the system may also include child profiles. When a user provides input to a device, the system may identify the user, determine an age of the user, and process the input to determine content appropriate for the user'"'"'s age. The system may be configured such that child user may be restricted to invoking certain intents, speechlets, skills, and the like. The system may include restrictions that apply uniformly to each child user and/or child device. In addition, the system may include restrictions that are unique to a specific child user and/or device.

Claims

1. A method, comprising:

receiving, from a first device, first audio data corresponding to a first utterance;

receiving first data representing a first device identifier (ID) associated with the first device;

performing automatic speech recognition (ASR) processing on the first audio data to generate first text data;

performing natural language understanding (NLU) processing on the first text data to generate first NLU results data including first intent data;

after performing NLU processing on the first text data, identifying first access policy data associated with the first device ID in an access policy storage component, the first access policy data representing at least one intent that is to be restricted from being sent to a speechlet component;

determining the first intent data is represented in the first access policy data;

after determining the first intent data is represented in the first access policy data, generating second text data representing the first utterance is restricted from being further processed;

performing text-to-speech (TTS) processing on the second text data to generate second audio data corresponding to the second text data; and

causing the first device to output first audio corresponding to the second audio data.

2. The computer-implemented method of claim 1, further comprising:

receiving, from the first device, second audio data corresponding to a second utterance;

receiving second data representing the first device ID;

performing ASR processing on the second audio data to generate second text data;

performing NLU processing on the second text data to generate second NLU results data including second intent data;

after performing NLU processing on the second text data, identifying the first access policy data associated with the first device ID in the access policy storage component;

determining the first access policy data permits sending the second NLU results data to a first speechlet component;

after the first access policy data permits sending the second NLU results data to a first speechlet component, sending the second NLU results data to the first speechlet component; and

receiving, from the first speechlet component, first output data.

3. The computer-implemented method of claim 1, further comprising:

receiving, from the first device, third audio data corresponding to a second utterance;

receiving second data representing the first device ID;

performing ASR processing on the third audio data to generate third text data;

performing NLU processing on the third text data to generate second NLU results data including third data representing a first speechlet component associated with the second utterance;

after performing NLU processing on the second text data, identifying the first access policy data associated with the first device ID in the access policy storage component, the first access policy data further representing at least one speechlet component that is restricted from receiving NLU results data;

determining the first speechlet component is represented in the first access policy data;

after determining the first speechlet component is represented in the first access policy data, generating fourth audio data representing the second utterance is restricted from being further processed; and

causing the first device to output second audio corresponding to the fourth audio data.

4. The computer-implemented method of claim 1, further comprising:

receiving, from the first device, third audio data corresponding to a second utterance;

performing ASR processing on the third audio data to generate third text data;

performing NLU processing on the third text data to determine the second utterance corresponds to an indication to send the first NLU results data to a first speechlet associated with the first NLU results data;

determining audio characteristics representing the second audio data;

determining the audio characteristics correspond to stored audio characteristics associated with a user ID;

determining the user ID corresponds to an adult user; and

based on the second utterance corresponding to the indication and the user ID corresponding to an adult user, sending the first NLU results data to the first speechlet.

5. A system, comprising:

at least one processor; and

at least one memory comprising instructions that, when executed by the at least one processor, cause the system to;

receive, from a first device, first data representing first user input in natural language;

receive second data associated with a first identifier (ID) associated with the first user input;

determine first intent data representing a meaning of the natural language of the first user input;

identify first access policy data based at least in part on the first ID in an access policy storage component;

determine the first access policy data represents the first intent data is unauthorized for the first ID; and

after determining the first access policy data represents the first intent data is unauthorized for the first ID, cause the first device to output first content representing the first user input is restricted from being further processed.

6. The system of claim 5, wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to:

receive, from the first device, third data representing second user input;

receive fourth data associated with the first ID;

determine second intent data representing the second user input;

determine the first access policy data represents the second intent data is authorized for the first ID; and

after determining the first access policy data represents the second intent data is authorized for the first ID, execute with respect to the second intent data.

7. The system of claim 5, wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to:

receive, from the first device, third data corresponding to a second user input;

determine the second user input corresponds to an indication to send the first intent data to a first speechlet associated with the first intent data;

determine characteristics representing the second user input;

determine the characteristics correspond to stored characteristics associated with a user ID;

determine the user ID corresponds to an adult user; and

based on the indication and the user ID corresponding to an adult user, send the first intent data to the first speechlet.

8. The system of claim 5, wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to:

receive, from a second device, third data representing a second user input;

determine second intent data representing the second user input;

determine characteristics representing the third data;

determine the characteristics correspond to stored characteristics associated with a user ID;

identify second access policy data associated with the user ID in the access policy storage component;

determine the second access policy data represents the second intent data is unauthorized for the user ID; and

after determining the second access policy data represents the second intent data is unauthorized for the user ID, cause the second device to output second content representing the second user input is restricted from being further processed.

9. The system of claim 5, wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to:

receive, from the first device, third data representing a second user input;

receive fourth data associated with the first ID;

determine a speechlet component associated with the second user input;

determine second intent data representing the second user input;

determine the first access policy data represents the speechlet component is authorized to process with respect to user input received from the first device; and

after determining the second access policy data represents the speechlet component is unauthorized to process with respect to user input received from the first device, send the second intent data to the speechlet component.

10. The system of claim 5, wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to:

receive, from a second device, third data representing a second user input;

determine characteristics representing the third data;

determine the characteristics correspond to stored characteristics associated with a first user ID;

determine the first user ID is an adult user ID;

determine the adult user ID is associated with a second user ID;

determine the second user ID is a child user ID;

determine the third data indicates an intent; and

generate second access policy data representing the intent is unauthorized for the second user ID.

11. The system of claim 5, wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to:

receive, from a second device, third data representing a second user input;

determine second intent data representing the second user input;

determine characteristics representing the third data;

determine the characteristics correspond to stored characteristics associated with a user age range;

identify second access policy data associated with the user age range in the access policy storage component;

determine the second access policy data represents the second intent data is authorized for the user age range; and

after determining the second access policy data represents the second intent data is authorized for the user age range, execute with respect to the second intent data.

12. The system of claim 5, wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to:

receive, from the first device, third data representing a second user input;

receive fourth data associated with the first ID;

determine second intent data representing the second user input, the second intent data being associated with a first confidence score;

determine third intent data representing the second user input, the third intent data being associated with a second confidence score, the second confidence score being less than the first confidence score;

based at least in part on the first confidence score being greater than the second confidence score, determine the first access policy data represents the second intent data is unauthorized for the first ID;

after determining the first access policy data represents the second intent data is unauthorized for the first ID, determine the second confidence score satisfies a confidence score threshold; and

after determining the second confidence score satisfies the confidence score threshold, determine the first access policy data represents the third intent data is authorized for the first ID.

13. The system of claim 5, wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to:

receive, from the first device, third data representing a second user input;

receive fourth data associated with the first ID;

determine second intent data representing the second user input;

determine the first access policy data represents the second intent data is unauthorized for the first ID;

after determining the first access policy data represents the second intent data is unauthorized for the first ID, determine third intent data associated with the second intent data;

determine the first access policy data represents the third intent data is authorized for the first ID;

generate fifth data representing the third intent data; and

cause the first device to output second content corresponding to the fifth data.

14. The system of claim 5, wherein the at least one memory further comprises instructions that, when executed by the at least one processor, further cause the system to:

receive, from a second device, third data representing a second user input;

determine second intent data representing the second user input;

determine characteristics representing the third data;

determine the characteristics correspond to stored characteristics associated with a user ID;

determine, in user profile data associated with the user ID, fourth data representing an age of a user; and

send to a speechlet component associated with the second user input;

the second intent data, and

fifth data representing the age.

15. A method, comprising:

receiving, from a first device, first data representing first user input in natural language;

receiving second data associated with a first identifier (ID) associated with the first user input;

determining first intent data representing a meaning of the natural language of the first user input;

identifying first access policy data based at least in part on the first ID in an access policy storage component;

determining the first access policy data represents the first intent data is unauthorized for the first ID; and

after determining the first access policy data represents the first intent data is unauthorized for the first ID, causing the first device to output first content representing the first user input is restricted from being further processed.

16. The method of claim 15, further comprising:

receiving, from the first device, third data representing second user input;

receiving fourth data associated with the first ID;

determining second intent data representing the second user input;

determining the first access policy data represents the second intent data is authorized for the first ID; and

after determining the first access policy data represents the second intent data is authorized for the first ID, executing with respect to the second intent data.

17. The method of claim 15, further comprising:

receiving, from the first device, third data corresponding to a second user input;

determining the second user input corresponds to an indication to send the first intent data to a first speechlet associated with the first intent data;

determining characteristics representing the second user input;

determining the characteristics correspond to stored characteristics associated with a user ID;

determining the user ID corresponds to an adult user; and

based on the indication and the user ID corresponding to an adult user, sending the first intent data to the first speechlet.

18. The method of claim 15, further comprising:

receiving, from a second device, third data representing a second user input;

determining second intent data representing the second user input;

determining characteristics representing the third data;

determining the characteristics correspond to stored characteristics associated with a user ID;

identifying second access policy data associated with the user ID in the access policy storage component;

determining the second access policy data represents the second intent data is unauthorized for the user ID; and

after determining the second access policy data represents the second intent data is unauthorized for the user ID, causing the second device to output second content representing the second user input is restricted from being further processed.

19. The method of claim 15, further comprising:

receiving, from the first device, third data representing a second user input;

receiving fourth data associated with the first ID;

determining second intent data representing the second user input;

determining the first access policy data represents the second intent data is unauthorized for the first ID;

after determining the first access policy data represents the second intent data is unauthorized for the first ID, determining third intent data associated with the second intent data;

determining the first access policy data represents the third intent data is authorized for the first ID;

generating fifth data representing the third intent data; and

causing the first device to output second content corresponding to the fifth data.

20. The method of claim 15, further comprising:

receiving, from a second device, third data representing a second user input;

determining second intent data representing the second user input;

determining characteristics representing the third data;

determining the characteristics correspond to stored characteristics associated with a user ID;

determining, in user profile data associated with the user ID, fourth data representing an age of a user; and

sending to a speechlet component associated with the second user input;

the second intent data, and

fifth data representing the age.