Electronic call assistant based on a caller-status and a callee-status

• US 10,397,400 B2
• Filed: 11/03/2017
• Issued: 08/27/2019
• Est. Priority Date: 11/03/2017
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Gupta, Rashmi, Singh, Avneet
• Primary Examiner(s): Teshale, Akelaw
• Application Number:
  US15/802,695
• Publication Number:
  US 20190141190A1
• Time in Patent Office: 662 Days
• Field of Search: 37920702, 37926502, 379 52, 379 8801
• CPC Class Codes: A61B 5/024 Detecting, measuring or recording pulse rate or heart rate A61B5/0205, A61B5/021 take precedence
• CPC Class Codes: A61B 5/1112 Global tracking of patients, e.g. by using GPS
• CPC Class Codes: A61B 5/6802 Sensor mounted on worn items
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 17/00 Speaker identification or verification techniques
• CPC Class Codes: G10L 17/14 Use of phonemic categorisation or speech recognition prior to speaker recognition or verification
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: G10L 2015/227 of the speaker; Human-factor methodology
• CPC Class Codes: G10L 25/63 for estimating an emotional state
• CPC Class Codes: H04M 2201/405 involving speaker-dependent recognition adaptation to speaker for speech recognition G10L15/07
• CPC Class Codes: H04M 2203/6054 Biometric subscriber identification
• CPC Class Codes: H04M 3/493 Interactive information services, e.g. directory enquiries ; Arrangements therefor, e.g. interactive voice response [IVR] systems or voice portals
• CPC Class Codes: H04M 3/4936 Speech interaction details speech recognition per se G10L15/00

Abstract

An electronic call assistant based on a callee-status and a caller-status, comprises one or more sensors, a memory, and a circuitry. The memory in the first electronic device may be configured to store a plurality of applications. The circuitry in the first electronic device is configured to determine an identity of a caller of a voice call received by the first electronic device from a second electronic device. A current callee-status of a callee associated with the first electronic device, is detected. The circuitry is configured to extract a text query from a speech signal in the received voice call. The circuitry is further configured to communicate a custom audio response to the second electronic device based on the extracted text query, the determined identity of the caller, current callee-status of the callee, and the level of access associated with the determined identity.

Claims

1. An electronic call assistant system, comprising:

at least one sensor in a first electronic device;

a memory, in the first electronic device, configured to store a plurality of applications; and

circuitry, in the first electronic device, configured to;

determine an identity of a caller of a voice call received by the first electronic device from a second electronic device;

acquire content from the plurality of applications and the at least one sensor of the first electronic device, based on the determined identity of the caller and a level of access associated with the determined identity of the caller;

determine a current callee-status of a callee associated with the first electronic device based on the acquired content;

extract a text query from a speech signal in the received voice call;

determine a current caller-status of the caller associated with the second electronic device based on a voice stress level of the speech signal in the received voice call;

allow, for the caller, access to the content, based on the level of access associated with the determined identity of the caller and a privacy level associated with an application of the plurality of applications,

wherein the privacy level is indicative of confirmation of the callee that the application of the plurality of applications is a user-analyzable application;

communicate a custom audio response to the second electronic device based on the extracted text query, the determined identity of the caller, the determined current callee-status of the callee, the determined current caller-status of the caller, and the level of access associated with the determined identity; and

generate a gist indicative of an intent of the received voice call based on the extracted text query, the level of access associated with the determined identity of the caller, and learned information from a plurality of voice calls previously received by the first electronic device from the caller.

2. The electronic call assistant system according to claim 1,

wherein the current callee-status of the callee corresponds to at least one of an emotional status of the callee, a health status of the callee, a social media status of the callee, or a user availability status.

3. The electronic call assistant system according to claim 1,

wherein the circuitry is further configured to:

acquire the current caller-status of the caller based on metadata in the speech signal in the received voice call, and

wherein the metadata is embedded by the second electronic device in the received voice call as an inaudible signal that is inaudible to the callee.

4. The electronic call assistant system according to claim 1,

wherein the circuitry is further configured to establish a voice call session between the second electronic device of the caller and the first electronic device of the callee, and

wherein the custom audio response is communicated in the established voice call session.

5. The electronic call assistant system according to claim 1,

wherein the circuitry is further configured to capture at least one of an image or voice of the callee by the at least one sensor for the determination of the current callee-status of the callee.

6. The electronic call assistant system according to claim 1,

wherein the circuitry is further configured to determine the current caller-status of the caller associated with the second electronic device based on the extracted text query.

7. The electronic call assistant system according to claim 6,

wherein the circuitry is further configured to determine an urgency level for the caller to communicate with the callee based on the determined current caller-status of the caller.

8. The electronic call assistant system according to claim 7, wherein the circuitry is further configured to modify the level of access associated with the determined identity based on the determined urgency level for the caller to communicate with the callee.

9. The electronic call assistant system according to claim 1,

wherein the circuitry is further configured to:

detect a third electronic device currently associated with the callee; and

re-direct information received from the first electronic device to the detected third electronic device of the callee, via a personal wireless network,

wherein the received information from the first electronic device corresponds to at least one of the voice call, a text message, or a custom notification.

10. The electronic call assistant system according to claim 1,

wherein the circuitry is further configured to generate the custom audio response based on an analysis of the extracted text query, the determined identity of the caller, the determined current callee-status of the callee, and the level of access associated with the determined identity.

11. The electronic call assistant system according to claim 1,

wherein the circuitry is further configured to identify a relationship of the caller with respect to the callee based on the determined identity of the caller.

12. The electronic call assistant system according to claim 1,

wherein the circuitry is further configured to determine a communication pattern and an emotional pattern of the caller based on historical data extracted from the plurality of voice calls previously received by the first electronic device from the second electronic device of the caller.

13. The electronic call assistant system according to claim 1,

wherein the circuitry is further configured to control display of a custom notification at the first electronic device, and

wherein the custom notification comprises a missed call indication from the caller along with the gist indicative of the intent of the received voice call.

14. The electronic call assistant system according to claim 13,

wherein the circuitry is further configured to communicate the custom notification from the first electronic device to a third electronic device currently associated with the callee, based on an absence of the callee in a defined physical area in which the first electronic device is located.

15. A method, comprising:

in a first electronic device comprising a memory and circuitry,

storing, by the circuitry, a plurality of applications in the memory;

determining, by the circuitry, an identity of a caller of a voice call received at the first electronic device from a second electronic device;

acquiring, by the circuitry, content from the plurality of applications and from at least one sensor of the first electronic device, based on the determined identity of the caller and a level of access associated with the determined identity of the caller;

determining, by the circuitry, a current callee-status of a callee associated with the first electronic device based on the acquired content;

extracting, by the circuitry, a text query from a speech signal in the received voice call;

allowing, for the caller, access to the content, based on the level of access associated with the determined identity of the caller and a privacy level associated with an application of the plurality of applications,

wherein the privacy level is indicative of confirmation of the callee that the application of the plurality of applications is a user-analyzable application;

communicating, by the circuitry, a custom audio response to the second electronic device based on the extracted text query, the determined identity of the caller, the determined current callee-status of the callee, a determined current caller-status of the caller, and the level of access associated with the determined identity; and

generating, by the circuitry, a gist indicative of an intent of the received voice call based on the extracted text query, the level of access associated with the determined identity of the caller, and learned information from a plurality of voice calls previously received by the first electronic device from the caller.

16. The method according to claim 15,

wherein the current callee-status of the callee corresponds to at least one of an emotional status, a health status, a social media status, or a user availability status.

17. The method according to claim 15, further comprising establishing, by the circuitry, a voice call session between the second electronic device of the caller and the first electronic device of the callee, wherein the custom audio response is communicated in the established voice call session.

18. The method according to claim 15, further comprising capturing, by the circuitry, at least one of an image, voice, or health parameters of the callee by the at least one sensor for the determination of the current callee-status of the callee.

19. The method according to claim 15, further comprising controlling, by the circuitry, display of a custom notification at the first electronic device, wherein the custom notification comprises a missed call indication for the voice call from the caller along with the gist indicative of the intent of the received voice call.

20. The method according to claim 19, further comprising communicating, by the circuitry, the custom notification from the first electronic device to a third electronic device currently associated with the callee, based on an absence of the callee in a defined physical area in which the first electronic device is located.