Adaptive digital assistant and spoken genome

• US 10,607,608 B2
• Filed: 09/18/2018
• Issued: 03/31/2020
• Est. Priority Date: 04/26/2017
• Status: Active Grant

• Current Assignee: Beijing Zitiao Network Technology Company Limited (ByteDance Ltd.)
• Original Assignee: International Business Machines Corporation
• Inventors: Hardee, Christopher J., Joroff, Steve, Nesbitt, Pamela A., Schneider, Scott E.
• Primary Examiner(s): Godbold, Douglas
• Application Number:
  US16/134,101
• Publication Number:
  US 20190019499A1
• Time in Patent Office: 560 Days
• CPC Class Codes: G06F 16/41 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/433 using audio data
• CPC Class Codes: G06F 16/435 Filtering based on additional data, e.g. user or group profiles
• CPC Class Codes: G10L 13/027 Concept to speech synthesisers; Generation of natural phrases from machine-based concepts generation of parameters for speech synthesis out of text G10L13/08
• CPC Class Codes: G10L 13/0335 Pitch control
• CPC Class Codes: G10L 13/047 Architecture of speech synthesisers
• CPC Class Codes: G10L 13/08 Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: G10L 25/63 for estimating an emotional state

Abstract

Embodiments of the invention include a context sensitive adaptive digital assistant for personalized interaction. Embodiments of the invention also include a spoken genome for characterization and analysis of human voice. Aspects of the invention include selecting a starter vocabulary, receiving voice communications from a user, and modifying the starter vocabulary to generate a personalized lexicon. Aspects of the invention also include analyzing and categorizing human voice according to a plurality of characteristics, and creating a spoken genome database.

Claims

1. A processing system for characterization and analysis of human voice comprising:

a processor in communication with one or more types of memory, the processor configured to;

receive a first reference voice sampling, wherein the first reference voice sampling comprises a plurality of reference voices corresponding to a first known reference quality;

analyze the first reference voice sampling to determine a spoken genome property corresponding to the first known reference quality;

receive a target voice input corresponding to a candidate;

determine a spoken genome property of the target voice input;

compare the spoken genome property of the target voice to the spoken genome property corresponding to the first known reference quality;

determine whether the candidate corresponds to the first known reference quality; and

output the determination of whether the candidate corresponds to the first known reference quality to a display.

2. The processing system of claim 1, wherein the processor is configured to output the spoken genome property corresponding to the first known reference quality.

3. The processing system of claim 1, wherein the processor is configured to receive a second reference voice sampling.

4. The processing system of claim 3, wherein the second reference voice sampling comprises a plurality of reference voices corresponding to a second known reference quality.

5. The processing system of claim 4, wherein the processor is further configured to analyze the second voice sampling to determine a spoken genome property corresponding to the second known reference quality.

6. The processing system of claim 5, wherein the processor is further configured to generate a spoken genome database.

7. The processing system of claim 6, wherein the spoken genome database comprises a first bin comprising the first known reference quality and the spoken genome property corresponding to the first known reference quality.

8. The processing system of claim 7, wherein the spoken genome database further comprises a second bin comprising the second known reference quality and the spoken genome property corresponding to the second known reference quality.

9. The processing system of claim 1, wherein the spoken genome property is pitch.

10. The processing system of claim 1, wherein the spoken genome property is cadence.

11. The processing system of claim 1, wherein the spoken genome property is tonality.

12. The processing system of claim 1, wherein the spoken genome property is rhythm.

13. The processing system of claim 1, wherein the spoken genome property is timing.

14. The processing system of claim 1, wherein the spoken genome property is elocution.

15. The processing system of claim 1, wherein the spoken genome property is accent.