DATA DRIVEN NATURAL LANGUAGE EVENT DETECTION AND CLASSIFICATION

• US 20170357716A1
• Filed: 09/19/2016
• Published: 12/14/2017
• Est. Priority Date: 06/11/2016
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: BELLEGARDA, Jerome R., MARTEL, Mathieu Jean, CARLHIAN, Alexandre, VINEL, Antoine, DOLFING, Jannes G., REKIK, Sabrine, BERGET, Markus, ARRAS, Hafid
• Granted Patent: US 10,521,466 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/3329 Natural language query formulation or dialogue systems
• CPC Class Codes: G06F 16/335 Filtering based on additional data, e.g. user or group profiles filtering in web context G06F16/9535, G06F16/9536
• CPC Class Codes: G06F 16/345 Summarisation for human users
• CPC Class Codes: G06F 16/358 Browsing; Visualisation therefor
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L

Abstract

Systems and processes for operating a digital assistant are provided. In accordance with one or more examples, a method includes, at a user device with one or more processors and memory, receiving unstructured natural language information from at least one user. The method also includes, in response to receiving the unstructured natural language information, determining whether event information is present in the unstructured natural language information. The method further includes, in accordance with a determination that event information is present within the unstructured natural language information, determining whether an agreement on an event is present in the unstructured natural language information. The method further includes, in accordance with a determination that an agreement on an event is present, determining an event type of the event and providing an event description based on the event type.

Claims

1. A method, comprising:

at an electronic device including at least one processor

receiving unstructured natural language information from at least one user;

in response to receiving the unstructured natural language information, determining whether event information is present in the unstructured natural language information;

in accordance with a determination that event information is present within the unstructured natural language information, determining whether an agreement on an event is present in the unstructured natural language information; and

in accordance with a determination that an agreement on an event is present, determining an event type of the event; and

providing an event description based on the event type.

2. The method of claim 1, wherein the unstructured natural language information comprises one or more messages.

3. The method of claim 1, wherein determining whether event information is present in the unstructured natural language information comprises:

determining one or more polarities associated with the unstructured natural language information; and

determining whether event information is present based on the one or more polarities.

4. The method of claim 3, wherein determining one or more polarities associated with the unstructured natural language information comprises:

generating an input layer based on the unstructured natural language information, wherein the input layer comprises a plurality of input units and a plurality of preceding first-context units;

generating a hidden layer based on the input layer, wherein the hidden layer comprises a plurality of current first-context units; and

generating an output layer based on the hidden layer, wherein the output layer includes one or more output label units representing the one or more polarities of at least a portion of the unstructured natural language information.

5. The method of claim 4, wherein generating the input layer based on the unstructured natural language information comprises:

obtaining a word sequence based on the unstructured natural language information;

obtaining a plurality of tokens based on the unstructured natural language information; and

generating the input layer using at least one of the word sequence and the plurality of tokens.

6. The method of claim 4, wherein generating the hidden layer based on the input layer comprises:

weighting a current input unit using a first weight matrix;

weighting a preceding first-context unit using a second weight matrix; and

determining a current first-context unit based on the weighting of the current input unit and the weighting of the preceding first-context unit.

7. The method of claim 4, wherein the hidden layer further comprises a plurality of second-context units.

8. The method of claim 7, wherein generating the hidden layer based on the input layer comprises:

weighting a current input unit using a third weight matrix;

weighting a following second-context unit using a fourth weight matrix; and

determining a current second-context unit based on the weighting of the current input unit and the weighting of the following second-context unit.

9. The method of claim 4, wherein the output layer comprises a plurality of output label units, each output label unit has an 1-of-K encoding, wherein the K represents a number of polarities of a pre-determined polarity set.

10. The method of claim 9, wherein the pre-determined polarity set comprises a proposal, a rejection, an acceptance, and a no-event.

11. The method of claim 4, wherein generating the output layer based on the hidden layer comprises:

weighting a current first-context unit using a fifth weight matrix; and

determining a current output label unit based on the weighting of the current first-context unit.

12. The method of claim 4, wherein generating an output layer based on the hidden layer further comprises:

obtaining a current state based on a current first-context unit and a current second-context unit;

weighting the current state using a sixth weight matrix; and

determining a current output label unit based on the weighting of the current state.

13. The method of claim 3, wherein determining whether event information is present based on the one or more polarities comprises:

determining whether the one or more polarities include at least one of a proposal, a rejection, or an acceptance;

in accordance with a determination that the one or more polarities include at least one of a proposal, a rejection, or an acceptance, determining a probability associated with the at least one of a proposal, a rejection, or an acceptance;

determining whether the probability satisfies a first probability threshold; and

in accordance with a determination that the probability satisfies the first probability threshold, determining that event information is present in the unstructured natural language information.

14. The method of claim 3, in accordance with a determination that event information is present within the unstructured natural language information, determining whether an agreement on an event is present in the unstructured natural language information comprises:

determining whether the one or more polarities include an acceptance;

in accordance with a determination that the one or more polarities include an acceptance, determining a probability associated with the acceptance;

determining whether the probability satisfies a second probability threshold; and

in accordance with a determination that probability satisfies the second probability threshold, determining that an agreement on an event is present.

15. The method of claim 1, wherein determining the event type is based on a hierarchical classification using a natural language event ontology.

16. The method of claim 15, wherein the natural language event ontology comprises one or more levels, each level including one or more event type nodes.

17. The method of claim 16, wherein at least one event type node is associated with a priority rule, the priority rule indicating a relative priority of the at least one event type node with respect to another event type node.

18. The method of claim 1, wherein determining the event type of the event comprises:

determining a first-level event type associated with the event; and

determining the event type of the event based on the first-level event type.

19. The method of claim 18, wherein determining the first-level event type comprises determining a first-level event type output of an output layer, wherein the first-level event type output has an 1-of-L encoding, wherein the L represents a number of first-level event type nodes of the natural language event ontology.

20. The method of claim 19, wherein determining the first-level event type output comprises:

weighting a trailing first-context unit of a hidden layer; and

determining the first-level event type output based on the weighting of the trailing first-context unit.

21. The method of claim 19, wherein determining the first-level event type output comprises:

concatenating a trailing first-context unit and a leading second-context unit;

weighting the concatenation of the trailing first-context unit and the leading second-context unit; and

determining the first-level event type output based on the weighting of the concatenation of the trailing first-context unit and the leading second-context unit.

22. The method of claim 19, wherein determining the first-level event type output comprises applying an activation function.

23. The method of claim 18, wherein determining the event type of the event based on the first-level event type comprises:

determining, for each second-level event type node, a number of correlations between the second-level event type node and the unstructured natural language information, wherein each second-level event type node is a child node of a first-level event type node representing the first-level event type; and

determining a second-level event type based on the number of correlations of each second-level event type node.

24. The method of claim 23, wherein determining the second-level event type comprises:

determining, based on the number of correlations of each second-level event type node, the maximum number of correlations; and

determining the second-level event type based on the maximum number of correlations.

25. The method of claim 24, further comprising:

determining whether at least two second-level event type nodes correspond to the maximum number of correlations; and

in accordance with the determination that at least two second-level event type nodes correspond to the maximum number of correlations, determining the second-level event type based on one or more priority rules.

26. The method of claim 1, wherein providing the event description based on the event type of the event comprises providing at least one of:

an event title, a starting time of the event, an ending time of the event, and a duration of the event, wherein the event title includes a subject of a corresponding event type node.

27. The method of claim 1, further comprising:

generating a calendar entry based on the event description;

displaying the calendar entry; and

providing one or more affordances, wherein the one or more affordances enable receiving one or more user inputs with respect to the calendar entry.

28. A non-transitory computer-readable storage medium comprising one or more programs for execution by one or more processors of an electronic device, the one or more programs including instructions which, when executed by the one or more processors, cause the electronic device to perform the method of:

receiving unstructured natural language information from at least one user;

in response to receiving the unstructured natural language information, determining whether event information is present in the unstructured natural language information;

in accordance with a determination that event information is present within the unstructured natural language information, determining whether an agreement on an event is present in the unstructured natural language information; and

in accordance with a determination that an agreement on an event is present, determining an event type of the event; and

providing an event description based on the event type.

29. A system, comprising:

one or more processors;

memory; and

one or more programs stored in memory, the one or more programs including instructions for

receiving unstructured natural language information from at least one user;

in response to receiving the unstructured natural language information, determining whether event information is present in the unstructured natural language information;

in accordance with a determination that event information is present within the unstructured natural language information, determining whether an agreement on an event is present in the unstructured natural language information; and

in accordance with a determination that an agreement on an event is present, determining an event type of the event; and

providing an event description based on the event type.