Audio call analysis

• US 10,701,198 B2
• Filed: 03/30/2018
• Issued: 06/30/2020
• Est. Priority Date: 03/30/2018
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Singh, Avinash Kumar, Ravikanti, Vinay Kumar, Nedunoori, Anuraag, Aiyappa, Krithi
• Primary Examiner(s): Jain, Ankur
• Application Number:
  US15/942,161
• Publication Number:
  US 20190306299A1
• Time in Patent Office: 823 Days
• CPC Class Codes: G06Q 20/24 Credit schemes, i.e. "pay after"
• CPC Class Codes: G06Q 20/26 Debit schemes, e.g. "pay now"
• CPC Class Codes: G06Q 20/322 Aspects of commerce using mobile devices [M-devices]
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 25/51 for comparison or discrimination
• CPC Class Codes: H04M 1/271 controlled by voice recognition
• CPC Class Codes: H04M 1/2745 using static electronic memories, e.g. chips
• CPC Class Codes: H04M 1/27457 Management thereof, e.g. manual editing of data
• CPC Class Codes: H04M 1/656 for recording conversations
• CPC Class Codes: H04M 1/72403 with means for local support of applications that increase the functionality
• CPC Class Codes: H04M 2250/68 with means for recording information, e.g. telephone number during a conversation recording of telephone conversations H04M1/656
• CPC Class Codes: H04M 2250/74 with voice recognition means voice activated dialling H04M1/271; voice recognition algorithms G10L15/00

Abstract

A device includes a communication interface, an input interface, and a processor. The communication interface is configured to receive an audio signal associated with an audio call. The input interface is configured to receive user input during the audio call. The processor is configured to generate an audio recording of the audio signal in response to receiving the user input. The processor is also configured to generate text by performing speech-to-text conversion of the audio recording. The processor is further configured to perform a comparison of the text to a pattern. The processor is also configured to identify, based on the comparison, a portion of the text that matches the pattern. The processor is further configured to provide the portion of the text and an option to a display. The option is selectable to initiate performance of an action corresponding to the pattern.

Claims

1. A device comprising:

a communication interface configured to receive an audio signal associated with an audio call;

one or more input interfaces configured to receive user input during the audio call; and

a processor configured to;

generate an audio recording of the audio signal in response to receiving first user input via the one or more input interfaces;

generate text by performing speech-to-text conversion of the audio recording;

perform a comparison of the text to a pattern;

identify, based on the comparison, a portion of the text that matches the pattern; and

provide, to a display, a graphical user interface that includes;

the portion of the text in an editable field;

an option that is selectable to initiate performance of an action corresponding to the pattern and based on content in the editable field of the graphical user interface;

receive second user input via the one or more input interfaces, the second user input indicating an updated value of the editable field; and

in response to receipt of selection of the option, perform the action based on the updated value of the editable field, the updated value distinct from the portion of the text.

2. The device of claim 1, wherein the pattern includes a telephone number pattern, a physical address pattern, an e-mail address pattern, a bank account number pattern, or a credit card number pattern.

3. The device of claim 1, further comprising a memory configured to store contact information, wherein the action includes updating the contact information to include the portion of the text.

4. The device of claim 3, wherein the pattern includes a telephone number pattern.

5. The device of claim 3, wherein the processor is further configured to determine that a second portion of the text indicates a contact name, wherein the contact information is updated based at least in part on determining that the contact information is associated with the contact name.

6. The device of claim 5, wherein the contact information is updated based on determining that the second portion of the text is within a threshold number of characters from the portion of the text.

7. The device of claim 1, wherein the pattern includes a physical address pattern, wherein the action includes using a map application to display a location in a map, and wherein the location is based on a physical address represented by the portion of the text.

8. The device of claim 1, wherein the pattern includes a credit card number pattern, wherein the action includes using an online purchase application to initiate a purchase based on a credit card number, and wherein the credit card number is represented by the portion of the text.

9. The device of claim 1, wherein the pattern includes a bank account number pattern, wherein the action includes using an online purchase application to initiate a purchase based on a bank account number, and wherein the bank account number is represented by the portion of the text.

10. The device of claim 1, wherein the one or more input interfaces are configured to receive the user input from a microphone, a touchscreen, a button, a mouse, or a keyboard.

11. The device of claim 1, further comprising:

an antenna; and

a receiver coupled to the antenna and configured to receive the audio signal, wherein the communication interface includes the receiver.

12. The device of claim 11, wherein the antenna, the communication interface, the one or more input interfaces, and the processor are integrated into a mobile device.

13. The device of claim 11, wherein the antenna, the communication interface, the one or more input interfaces, and the processor are integrated into a base station.

14. The device of claim 1, wherein the pattern includes an e-mail address pattern, wherein the action includes using an e-mail application to display a draft of an e-mail that includes an e-mail address in a recipient field, and wherein the e-mail address is represented by the portion of the text.

15. The device of claim 1, wherein the processor is a component of a tablet computer, a laptop computer, or a desktop computer.

16. A method comprising:

receiving, at a device, an audio signal associated with an audio call;

receiving, at the device, user input during the audio call;

generating, at the device, an audio recording of the audio signal in response to receiving the user input;

generating, at the device, text by performing speech-to-text conversion of the audio recording;

performing, at the device, a comparison of the text to a pattern;

identifying, based on the comparison, a portion of the text that matches the pattern;

providing, from the device to a display;

the portion of the text in an editable field; and

an option that is selectable to initiate performance of an action corresponding to the pattern and based on content in the editable field;

receiving, at the device, second user input indicating an updated value of the editable field; and

in response to receiving a selection of the option, performing the action based on the updated value of the editable field, wherein the updated value is distinct from the portion of the text.

17. The method of claim 16, further comprising:

prior to the audio call, receiving third user input indicating that the pattern corresponds to the action; and

generating, based on the third user input, pattern-to-action mapping data to indicate that the pattern corresponds to the action; and

selecting the action to provide to the display in response to determining that the pattern-to-action mapping data indicates that the pattern corresponds to the action.

18. The method of claim 16, wherein the portion of the text and the option are included in a graphical user interface (GUI) provided to the display, and wherein the portion of the text is displayed during the audio call.

19. The method of claim 16, wherein the pattern corresponds to a physical address pattern, and wherein the action corresponds to use of a map application to display a location corresponding to the updated value in a map.

20. The method of claim 16, wherein the device comprises a mobile device.

21. A computer-readable storage device storing instructions that, when executed by a processor, cause the processor to perform operations comprising:

receiving an audio signal associated with an audio call;

receiving user input during the audio call;

generating an audio recording of the audio signal in response to receiving the user input;

generating text by performing speech-to-text conversion of the audio recording;

performing a comparison of the text to a pattern;

identifying, based on the comparison, a portion of the text that matches the pattern; and

providing, to a display, a graphical user interface that includes;

the portion of the text in an editable field;

an option that is selectable to initiate performance of an action corresponding to the pattern and based on content in the editable field of the graphical user interface;

receiving second user input indicating an updated value of the editable field; and

in response to receiving a selection of the option, performing the action based on the updated value of the editable field, the updated value distinct from the portion of the text.

22. The computer-readable storage device of claim 21, wherein the operations further comprise providing a plurality of options to the display, the plurality of options selectable to initiate performance of a plurality of actions based on the content in the editable field of the graphical user interface, wherein the plurality of actions include the action.

23. The computer-readable storage device of claim 22, wherein the operations further comprise, in response to receiving a selection of one or more options of the plurality of options, initiating performance of one or more corresponding actions.

24. The computer-readable storage device of claim 21, wherein the pattern corresponds to a physical address pattern, wherein the action includes using a map application to display a location in a map, and wherein the location is based on a physical address represented by the portion of the text.

25. The computer-readable storage device of claim 24, wherein the operations further comprise:

providing a second option to the display, the second option selectable to initiate performance of a second action corresponding to the pattern, wherein the second action includes updating contact information to include the physical address; and

in response to receiving second user input indicating that each of the option and the second option is selected, initiating performance of the action and the second action.

26. The computer-readable storage device of claim 21, wherein the operations further comprise:

determining that a second portion of the text indicates a contact name; and

providing the contact name to the display in a second editable field of the graphical user interface.

27. The computer-readable storage device of claim 26, wherein the action comprises:

selecting a contact corresponding to a value of the second editable field;

selecting contact information corresponding to the contact; and

updating the contact information to indicate the portion of the text.

28. The computer-readable storage device of claim 26, wherein the action comprises, in response to determining that a value of the second editable field does not correspond to an existing contact, generating a contact having contact information that indicates the portion of the text.

29. An apparatus comprising:

means for receiving an audio signal associated with an audio call;

means for receiving user input during the audio call;

means for generating an audio recording of the audio signal and identifying a portion of text that matches a pattern, the audio recording generated in response to receiving first user input via the means for receiving user input, wherein the text is generated by performing speech-to-text conversion of the audio recording;

means for displaying the portion of the text in an editable field of a graphical user interface and an option that is selectable to initiate performance of an action, the action corresponding to the pattern and based on content in the editable field of the graphical user interface; and

means for performing the action, the means for performing the action configured to perform the action in response to receipt of second user input and a selection of the option via the means for receiving user input, wherein the second user input indicates an updated value of the editable field distinct from the portion of the text, and wherein the action is performed based on the updated value of the editable field.

30. The apparatus of claim 29, wherein the means for receiving the audio signal, the means for receiving the user input, the means for generating the audio recording and identifying the portion of the text, and the means for displaying the portion of the text and the option are integrated into a communication device, a personal digital assistant (PDA), a computer, a music player, a video player, an entertainment unit, a navigation device, a mobile device, a fixed location data unit, or a set top box.