System and method for a media intelligence platform

• US 10,467,665 B2
• Filed: 09/19/2017
• Issued: 11/05/2019
• Est. Priority Date: 02/03/2015
• Status: Active Grant

• Current Assignee: Twilio, Inc.
• Original Assignee: Twilio, Inc.
• Inventors: Lawson, Jeffrey
• Primary Examiner(s): Eskandarnia, Arvin
• Application Number:
  US15/708,845
• Publication Number:
  US 20180005283A1
• Time in Patent Office: 777 Days
• Field of Search: 709224
• CPC Class Codes: G06Q 30/04 Billing or invoicing
• CPC Class Codes: H04L 12/1403 Architecture for metering, charging or billing
• CPC Class Codes: H04L 41/147 for predicting network behaviour
• CPC Class Codes: H04L 43/50 Testing arrangements
• CPC Class Codes: H04L 67/104 Peer-to-peer [P2P] networks
• CPC Class Codes: H04M 15/41 Billing record details, i.e. parameters, identifiers, structure of call data record [CDR]
• CPC Class Codes: H04M 15/765 Linked or grouped accounts, e.g. of users or devices
• CPC Class Codes: H04M 15/7652 shared by users
• CPC Class Codes: H04M 15/7655 shared by technologies
• CPC Class Codes: H04M 15/8066 According to the number of recipients
• CPC Class Codes: H04M 15/8228 Session based
• CPC Class Codes: H04W 4/24 Accounting or billing

Abstract

A multi-tenant media processing platform system and method. At least a first media analysis service of a plurality of media analysis services is activated for at least a portion of an active communication session of an entity in the platform system. The first activated media analysis service performs a first media analysis on media of the active communication session that is collected by the platform system. The first activated media analysis service performs the first media analysis on the collected media while the communication session is active to generate a first media analysis result. During the active communication session, at least one media analysis result is applied.

Claims

1. A method comprising:

collecting, by a multi-tenant media processing platform system, media transmitted as part of an active asynchronous message conversation facilitated by the multi-tenant media processing platform system, the active asynchronous message conversation being associated with a first account of the multi-tenant media processing platform system;

determining, based on the media transmitted as part of the active asynchronous message conversation, that a first configuration setting has been satisfied, the first configuration setting being included in a set of configuration settings associated with the first account of the multi-tenant media processing platform system and the first configuration setting corresponding to a first media analysis service of a plurality of media analysis services provided by the multi-tenant media processing platform system;

in response to determining that the first configuration setting has been satisfied, using the first media analysis service to perform a first media analysis on the media while the active asynchronous message conversation is active, yielding a first media analysis result; and

during the active asynchronous message conversation, initiating a programmatic event based on the first media analysis result.

2. The method of claim 1, wherein the active asynchronous message conversation is a time ordered sequence of messages.

3. The method of claim 1, wherein the first media analysis service is a sentiment and emotion detection service.

4. The method of claim 1, wherein the first media analysis service is an intent detection service.

5. The method of claim 1, further comprising:

after determining that the first configuration setting has been satisfied, determining that a second configuration setting included in the set of configuration settings associated with the first account of the multi-tenant media processing platform system has been satisfied, the second configuration setting corresponding to disabling the first media analysis service; and

in response to determining that the second configuration setting has been satisfied, de-activating the first media analysis service; and

generating billing information for the first account of the multi-tenant media processing platform system based on use of the first media analysis service.

6. The method of claim 1, further comprising:

training the first media analysis service based on the first media analysis result and user feedback provided by an external system via a feedback Application Programming Interface (API) of the multi-tenant media processing platform system.

7. The method of claim 1, further comprising:

receiving, from an external system associated with the first user account, a request for communication records;

in response to receiving the request, providing the external system with communication records that match media analysis result properties specified in the request, the provided communication records including information for a plurality of asynchronous message conversations associated with the first user account, the plurality for asynchronous message conversations including the active asynchronous message conversation for which the first media analysis was performed, the information including the first media analysis result.

8. A multi-tenant media processing platform system comprising:

one or more computer processors; and

one or more computer-readable mediums storing instructions that, when executed by the one or more computer processors, cause the multi-tenant media processing platform system to perform operations comprising;

collecting media transmitted as part of an active asynchronous message conversation facilitated by the multi-tenant media processing platform system, the active asynchronous message conversation being associated with a first account of the multi-tenant media processing platform system;

determining, based on the media transmitted as part of the active asynchronous message conversation;

that a first configuration setting has been satisfied, the first configuration setting being included in a set of configuration settings associated with the first account of the multi-tenant media processing platform system and the first configuration setting corresponding to a first media analysis service of a plurality of media analysis services provided by the multi-tenant media processing platform system;

in response to determining that the first configuration setting has been satisfied, using the first media analysis service to perform a first media analysis on the media while the active asynchronous message conversation is active, yielding a first media analysis result; and

during the active asynchronous message conversation, initiating a programmatic event based on the first media analysis result.

9. The multi-tenant media processing platform system of claim 8, wherein the active asynchronous message conversation is a time ordered sequence of messages.

10. The multi-tenant media processing platform system of claim 8, wherein the first media analysis service is a sentiment and emotion detection service.

11. The multi-tenant media processing platform system of claim 8, wherein the first media analysis service is an intent detection service.

12. The multi-tenant media processing platform system of claim 8, the operations further comprising:

after determining that the first configuration setting has been satisfied, determining that a second configuration setting included in the set of configuration settings associated with the first account of the multi-tenant media processing platform system has been satisfied, the second configuration setting corresponding to disabling the first media analysis service; and

in response to determining that the second configuration setting has been satisfied, de-activating the first media analysis service; and

generating billing information for the first account of the multi-tenant media processing platform system based on use of the first media analysis service.

13. The multi-tenant media processing platform system of claim 8, the operations further comprising:

training the first media analysis service based on the first media analysis result and user feedback provided by an external system via a feedback Application Programming Interface (API) of the multi-tenant media processing platform system.

14. The multi-tenant media processing platform system of claim 8, the operations further comprising:

receiving, from an external system associated with the first user account, a request for communication records;

in response to receiving the request, providing the external system with communication records that match media analysis result properties specified in the request, the provided communication records including information for a plurality of asynchronous message conversations associated with the first user account, the plurality for asynchronous message conversations including the active asynchronous message conversation for which the first media analysis was performed, the information including the first media analysis result.

15. A non-transitory computer-readable medium storing instructions that, when executed by one or more computer processors of a multi-tenant media processing platform system, cause the multi-tenant media processing platform system to perform operations comprising:

collecting media transmitted as part of an active asynchronous message conversation facilitated by the multi-tenant media processing platform system, the active asynchronous message conversation being associated with a first account of the multi-tenant media processing platform system;

determining, based on the media transmitted as part of the active asynchronous message conversation, that a first configuration setting has been satisfied, the first configuration setting being included in a set of configuration settings associated with the first account of the multitenant media processing platform system and the first configuration setting corresponding to a first media analysis service of a plurality of media analysis services provided by the multi-tenant media processing platform system;

in response to determining that the first configuration setting has been satisfied;

using the first media analysis service to perform a first media analysis on the media while the active asynchronous message conversation is active, yielding a first media analysis result; and

during the active asynchronous message conversation, initiating a programmatic event based on the first media analysis result.

16. The non-transitory computer-readable medium of claim 15, wherein the active asynchronous message conversation is a time ordered sequence of messages.

17. The non-transitory computer-readable medium of claim 15, wherein the first media analysis service is a sentiment and emotion detection service.

18. The non-transitory computer-readable medium of claim 15, wherein the first media analysis service is an intent detection service.

19. Non-transitory computer-readable medium of claim 15, the operations further comprising:

after determining that the first configuration setting has been satisfied, determining that a second configuration setting included in the set of configuration settings associated with the first account of the multi-tenant media processing platform system has been satisfied, the second configuration setting corresponding to disabling the first media analysis service; and

in response to determining that the second configuration setting has been satisfied, de-activating the first media analysis service; and

generating billing information for the first account of the multi-tenant media processing platform system based on use of the first media analysis service.

20. The non-transitory computer-readable medium of claim 15, the operations further comprising:

training the first media analysis service based on the first media analysis result and user feedback provided by an external system via a feedback Application Programming Interface (API) of the multi-tenant media processing platform system.