Cross Device Companion Application For Phone

• US 20170195495A1
• Filed: 01/05/2016
• Published: 07/06/2017
• Est. Priority Date: 01/05/2016
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Deora, Gautam, Verma, Vikas, Chandra, Saumya, Lalavat, Manoj, Singh, Sonia, Ravikumar, Badhri, Bansal, Anushree, Peddi, Snehita
• Granted Patent: US 10,002,607 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 3/002 Specific input/output arrangements not covered by G06F3/01 - G06F3/16 other optical apparatus G02B27/00
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: G06Q 10/101 Collaborative creation, e.g. joint development of products or services
• CPC Class Codes: G06Q 10/107 Computer-aided management of electronic mailing [e-mailing]
• CPC Class Codes: G06Q 10/109 Time management, e.g. calendars, reminders, meetings or time accounting
• CPC Class Codes: G10L 15/00 Speech recognition G10L17/00 takes precedence
• CPC Class Codes: G10L 15/065 Adaptation
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: H04L 67/306 User profiles
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34
• CPC Class Codes: H04M 1/2757 by data transmission, e.g. downloading
• CPC Class Codes: H04M 1/56 Arrangements for indicating or recording the called number at the calling subscriber's set
• CPC Class Codes: H04M 1/575 Means for retrieving and displaying personal data about calling party
• CPC Class Codes: H04M 1/72403 with means for local support of applications that increase the functionality
• CPC Class Codes: H04M 1/72469 for operating the device by selecting functions from two or more displayed items, e.g. menus or icons
• CPC Class Codes: H04M 1/72484 wherein functions are triggered by incoming communication events
• CPC Class Codes: H04M 2201/40 using speech recognition speech recognition per se G10L15/00
• CPC Class Codes: H04M 2203/2011 Service processing based on information specified by a party before or during a call, e.g. information, tone or routing selection
• CPC Class Codes: H04M 2203/2038 : Call context notifications
• CPC Class Codes: H04M 2250/60 : logging of communication history, e.g. outgoing or incoming calls, missed calls, messages or URLs logging of telephone numbers H04M1/56, H04M1/57
• CPC Class Codes: H04M 2250/68 : with means for recording information, e.g. telephone number during a conversation recording of telephone conversations H04M1/656
• CPC Class Codes: H04M 3/42042 : Notifying the called party of information on the calling party details within substation equipment H04M1/57, signalling details H04Q3/72
• CPC Class Codes: H04M 3/42221 : Conversation recording systems at the subscriber's set H04M1/656
• CPC Class Codes: H04M 3/4365 : based on information specified by the calling party, e.g. priority or subject
• CPC Class Codes: H04M 7/0024 : Services and arrangements where telephone services are combined with data services arrangements which combine a telephonic equipment and a computer H04M7/0012
• CPC Class Codes: H04M 7/0036 : where the data service is an information service
• CPC Class Codes: H04W 76/10 : Connection setup
• CPC Class Codes: H04W 8/26 : Network addressing or numbering for mobility support
• CPC Class Codes: H04W 88/02 : Terminal devices

Abstract

Example apparatus and methods concern establishing context for a phone call. A computing device is controlled to display content and applications that are relevant for the call during the call. A party on the call is identified using data received from a phone used by the party. The relevant content and the relevant application are identified using actions (e.g., purchase to make, call to make) and intentions (e.g., family matter, business matter) identified in text provided in a text-based transcript of the call. The text-based transcript is provided in real time by a natural language processing (NLP) service during the call. The devices are controlled to selectively present the relevant content and the relevant application to make the call more automated and more productive. A to-do list is automatically generated based on the intentions, the actions, and on subject matter or content discussed or accessed during the call.

Claims

1-21. -21. (canceled)

22. A method of providing context to a phone call, comprising:

receiving the phone call;

receiving first data that describes an intention associated with the phone call, the intention being learned from tracking data associated with one or more previous phone calls, and the tracking data comprising a first application used during one or more of the previous phone calls;

receiving second data that describes an action associated with the phone call, the action being learned from the tracking data associated with the previous phone calls;

selecting a second computer application that is relevant to the phone call based on the first data and the second data; and

presenting the second computer application on one or more available devices.

23. The method of claim 22, comprising producing and storing the tracking data associated with the previous phone calls, wherein the tracking data associated with the previous phone calls describes at least one previous intention and at least one previous action.

24. The method of claim 23, wherein the tracking data associated with the previous phone calls describes at least one previous application, at least one previous application used during the previous phone calls, at least one content referenced during the previous phone calls, at least one search performed during the previous phone calls, and at least one note taken during the previous phone calls.

25. The method of claim 22, comprising receiving an identifier of a caller that initiates the phone call.

26. The method of claim 25, wherein the identifier of the caller comprises an email address of the caller.

27. The method of claim 25, wherein the identifier comprises a social media identifier of the caller.

28. The method of claim 22, wherein the intention comprises one of a social communication, a work communication, a travel communication, an informational communication, a family communication, an emergency communication, and a commercial communication.

29. The method of claim 22, where the action comprises one of a purchase, a payment, an appointment to be made, an appointment to keep, a communication to make, an edit to a document, and an edit to a presentation.

30. The method of claim 29, where the communication to make comprises a social media post.

31. The method of claim 22, wherein the tracking data comprises a text-based transcript of the phone call.

32. The method of claim 31, wherein the text-based transcript is produced by a natural language processing (NLP) service.

33. The method of claim 22, comprising selecting one or more devices associated with a recipient of the phone call to run the second computer application.

34. The method of claim 33, wherein the one or more devices are selected based on one or more of a workload of the devices, a proximity of the devices to the recipient of the phone call, and the second computer application.

35. The method of claim 22, where the one or more devices include a phone of the recipient, a tablet computer of the recipient, a laptop computer of the recipient, a desktop computer of the recipient, or a vehicle-based computer of the recipient.

36. A computer-readable storage device storing computer-executable instructions that when executed by a computer processor, cause the computer processor to:

receive a phone call;

receive first data that describes an intention associated with the phone call, the intention being learned from tracking data associated with one or more previous phone calls, and the tracking data comprising a first application used during one or more of the previous phone calls, at least one previous intention, and at least one previous action;

receive second data that describes an action associated with the phone call, the action being learned from the tracking data associated with the previous phone calls;

select a second computer application that is relevant to the phone call based on the first data and the second data; and

present the second computer application on one or more available devices.

37. The computer-readable storage device of claim 36, wherein the computer-executable instructions cause the computer processor to receive an identifier of a caller that initiates the phone call, wherein the identifier of the caller comprises a social media identifier of the caller.

38. The computer-readable storage device of claim 36, wherein the action comprises a communication to make, where the communication to make comprises a text message.

39. The computer-readable storage device of claim 36, wherein the tracking data comprises a text-based transcript of the phone call, and wherein the text-based transcript is produced by a natural language processing (NLP) service.

40. An apparatus, comprising:

a processing unit;

a memory comprising computer-executable code that, when executed by the processing unit, cause the processing unit to;

receive a phone call;

receive first data that describes an intention associated with the phone call, the intention being learned from tracking data associated with one or more previous phone calls, and the tracking data comprising a first application used during one or more of the previous phone calls, at least one previous intention, at least one previous action, and a text-based transcript of the phone call, wherein the text-based transcript is produced by a natural language processing (NLP) service;

receive second data that describes an action associated with the phone call, the action being learned from the tracking data associated with the previous phone calls;

select a second computer application that is relevant to the phone call based on the first data and the second data; and

present the second computer application on one or more available devices.

41. The apparatus of claim 40, wherein the computer-executable code cause the processing unit to receive an identifier of a caller that initiates the phone call, wherein the identifier of the caller comprises an email address of the caller.