Conversation assistance system

• US 9,635,167 B2
• Filed: 09/29/2015
• Issued: 04/25/2017
• Est. Priority Date: 09/29/2015
• Status: Active Grant

• Current Assignee: PayPal, Inc. (PayPal Holdings, Inc.)
• Original Assignee: PayPal, Inc. (PayPal Holdings, Inc.)
• Inventors: Todasco, Michael Charles
• Primary Examiner(s): TRAN, MONG-THUY THI
• Application Number:
  US14/869,558
• Publication Number:
  US 20170094047A1
• Time in Patent Office: 574 Days
• Field of Search: 4554142, 4554141, 455415, 4555501, 4555561, 4555562
• CPC Class Codes: G10L 15/005 Language recognition
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 25/48 specially adapted for particular use
• CPC Class Codes: H04M 1/72454 according to context-related or environment-related conditions
• CPC Class Codes: H04M 2201/40 using speech recognition
• CPC Class Codes: H04M 2201/60 Medium conversion
• CPC Class Codes: H04M 2242/12 Language recognition, selection or translation arrangements
• CPC Class Codes: H04M 2250/12 including a sensor for measuring a physical value, e.g. temperature or motion
• CPC Class Codes: H04M 2250/60 logging of communication history, e.g. outgoing or incoming calls, missed calls, messages or URLs
• CPC Class Codes: H04M 3/42 Systems providing special services or facilities to subscribers specially adapted for wireless communication networks H04W4/00
• CPC Class Codes: H04M 3/4217 Managing service interactions
• CPC Class Codes: H04M 3/493 Interactive information services, e.g. directory enquiries ; Arrangements therefor, e.g. interactive voice response [IVR] systems or voice portals
• CPC Class Codes: H04W 4/20 Services signaling; Auxiliary data signalling, i.e. transmitting data via a non-traffic channel
• CPC Class Codes: H04W 4/21 for social networking applications

Abstract

Systems and methods for providing conversation assistance include receiving from at least one user device of a user, conversation information and determining that the conversation information is associated with a conversation involving the user and a first person that is associated with first conversation assistance information in a non-transitory memory. Body measurement data of the user is retrieved from the at least first user device. A need for conversation assistance in the conversation involving the user and the first person is detected using the body measurement data. First conversation assistance information associated with the first person is retrieved from the non-transitory memory. The first conversation assistance information associated with the first person is provided through the at least one user device.

Claims

1. A conversation assistance system, comprising:

one or more processors, and one or more computer-readable memories with program instructions stored on the one or more computer-readable memories, the one or more processors configured to execute the program instructions via at least one of the one or more computer-readable memories to cause the system to;

responsive to receiving conversation information from at least one user device of a user, determine that the conversation information is associated with a conversation involving the user and a first person that is associated with first conversation assistance information;

determine a communication medium from a plurality of communication mediums for providing a first conversation assistance information based on determining that the at least one user device has a required functionality for the communication medium, wherein the first conversation assistance information corresponds to the first person; and

provide the first conversation assistance information via the determined communication medium.

2. The system of claim 1, wherein the communication medium is further determined based on determining that a first configuration of a plurality of configurations is enabled, wherein the first configuration corresponds to the communication medium.

3. The system of claim 1, wherein the one or more processors are configured to cause the system to further:

retrieve, from the at least one user device, body measurement data associated with the user; and

determine, based on the body measurement data, a need for the first conversation assistance information to be provided to the at least one user device.

4. The system of claim 1, wherein the communication medium is selected from a group consisting of an auditory communication medium, a visual communication medium, and a haptic communication medium.

5. The system of claim 1, wherein the conversation information includes gesture information corresponding to a gesture of the user.

6. The system of claim 1, wherein the one or more processors are configured to cause the system to further:

retrieve conversation history information collected from at least one previous conversation between the user and the first person; and

determine the first conversation assistance information using the conversation history information.

7. The system of claim 1, wherein the conversation information includes audio information of a statement by the user, and wherein the one or more processors are configured to cause the system to:

analyze the statement of the user to determine the audio information is conversation information associated with the conversation involving the user and the first person.

8. A method for providing conversation assistance, comprising:

receiving, from at least one user device of a user, conversation information, wherein the conversation information includes gesture information corresponding to a gesture of the user;

determining that the conversation information is associated with a conversation involving the user and a first person, wherein the first person is associated with a first conversation assistance information in a database, and wherein the first conversation assistance information includes a first portion and a second portion;

determining, using at least the gesture information, that the first portion of the first conversation assistance information is needed by the user;

determining a communication medium from a plurality of communication mediums for providing the first portion of the first conversation assistance information based on determining that the at least one user device has a required functionality for the communication medium; and

providing, on the at least one user device, the first portion of the first conversation assistance information via the determined communication medium.

9. The method of claim 8, further comprising:

retrieving, from the at least one user device, body measurement data of the user, wherein the body measurement data of the user include at least one of heart rate data, temperature data, and perspiration rate data; and

determining, using at least the body measurement data, a need for conversation assistance in the conversation involving the user and the first person.

10. The method of claim 8, wherein the communication medium is further determined based on determining that a first configuration of a plurality of configurations is enabled, wherein the first configuration corresponds to the communication medium.

11. The method of claim 8, the communication medium is selected from a group consisting of an auditory communication medium, a visual communication medium, and a haptic communication medium.

12. The method of claim 8, wherein the communication medium provides for vibrating the at least one user device in a code corresponding to the first portion.

13. The method of claim 8, further comprising:

retrieving, from a database, conversation history information collected from at least one previous conversation between the user and the first person; and

determining the first conversation assistance information using the conversation history information.

14. The method of claim 8, wherein the conversation information includes audio information of a statement by the user, and wherein the method further comprises:

analyzing the statement of the user to determine the audio information is conversation information associated with the conversation involving the user and the first person.

15. A non-transitory machine-readable medium comprising instructions that, when executed by one or more processors, are adapted to cause a machine to perform operations comprising:

receiving conversation information from at least one user device;

determining that the conversation information is associated with a conversation involving a user and a first person, wherein the first person is associated with first conversation assistance information in a database;

determining, using the conversation information, a need for conversation assistance in the conversation involving the user and the first person;

determining a communication medium from a plurality of communication mediums for providing the first conversation assistance information, based on determining that the at least one user device has a required functionality for the communication medium;

providing the first conversation assistance information to the at least one user device via the communication medium.

16. The non-transitory machine-readable medium of claim 15, wherein the operations further comprises:

retrieving body measurement data of the user from the at least one user device; and

wherein the determining the need for conversation assistance in the conversation involving the user and the first person is further based on the body measurement data.

17. The non-transitory machine-readable medium of claim 15, wherein the communication medium is selected from a group consisting of an auditory communication medium, a visual communication medium, and a haptic communication medium.

18. The non-transitory machine-readable medium of claim 15, wherein the communication medium provides for display of an image that is associated with a name of the first person.

19. The non-transitory machine-readable medium of claim 15, wherein the conversation information includes gesture information corresponding to a gesture of the user.

20. The non-transitory machine-readable medium of claim 15, further comprising:

retrieving conversation history information collected from at least one previous conversation between the user and the first person; and

determining the first conversation assistance information using the conversation history information.