Adaptive digital assistant and spoken genome

• US 10,665,237 B2
• Filed: 09/18/2018
• Issued: 05/26/2020
• Est. Priority Date: 04/26/2017
• Status: Active Grant

• Current Assignee: Beijing Zitiao Network Technology Company Limited (ByteDance Ltd.)
• Original Assignee: International Business Machines Corporation
• Inventors: Hardee, Christopher J., Joroff, Steve, Nesbitt, Pamela A., Schneider, Scott E.
• Primary Examiner(s): Godbold, Douglas
• Application Number:
  US16/134,083
• Publication Number:
  US 20190019498A1
• Time in Patent Office: 616 Days
• CPC Class Codes: G06F 16/41 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/433 using audio data
• CPC Class Codes: G06F 16/435 Filtering based on additional data, e.g. user or group profiles
• CPC Class Codes: G10L 13/027 Concept to speech synthesisers; Generation of natural phrases from machine-based concepts generation of parameters for speech synthesis out of text G10L13/08
• CPC Class Codes: G10L 13/0335 Pitch control
• CPC Class Codes: G10L 13/047 Architecture of speech synthesisers
• CPC Class Codes: G10L 13/08 Text analysis or generation of parameters for speech synthesis out of text, e.g. grapheme to phoneme translation, prosody generation or stress or intonation determination
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: G10L 25/63 for estimating an emotional state

Abstract

Embodiments of the invention include a context sensitive adaptive digital assistant for personalized interaction. Embodiments of the invention also include a spoken genome for characterization and analysis of human voice. Aspects of the invention include selecting a starter vocabulary, receiving voice communications from a user, and modifying the starter vocabulary to generate a personalized lexicon. Aspects of the invention also include analyzing and categorizing human voice according to a plurality of characteristics, and creating a spoken genome database.

Claims

1. A computer program product for characterization and analysis of human voice, wherein the computer program product comprises:

a computer readable storage medium readable by a processing circuit and storing program instructions for execution by the processing circuit for performing a method comprising;

receiving a plurality of media files, wherein the plurality of media files comprise spoken words;

categorizing the plurality of media files according to spoken genome properties of voices within the media files to create a categorized spoken genome database;

receiving, from a demographic group, a user media preference for the spoken genome properties of the voices in the categorized spoken genome database;

determining, for the demographic group, a user media profile based at least in part on the user media preference, wherein the user media profile comprises a preferred spoken genome property; and

providing a media recommendation based at least in part on the user media profile and the categorized spoken genome database.

2. The computer program product of claim 1, wherein the spoken genome property is gender.

3. The computer program product of claim 1, wherein the spoken genome property is pitch.

4. The computer program product of claim 1, wherein the spoken genome property is cadence.

5. The computer program product of claim 1, wherein the spoken genome property is tonality.

6. The computer program product of claim 1, wherein the spoken genome property is rhythm.

7. The computer program product of claim 1, wherein the spoken genome property is accent.

8. The computer program product of claim 1, wherein the spoken genome property is timing.

9. The computer program product of claim 1, wherein the spoken genome property is slurring.

10. The computer program product of claim 1, wherein the spoken genome property is elocution.

11. The computer program product of claim 1, wherein the media recommendation comprises a recommended television program.

12. The computer program product of claim 1, wherein the media recommendation comprises a recommended movie.

13. The computer program product of claim 1, wherein the media recommendation is a recommended audio book.

14. The computer program product of claim 1, wherein the media recommendation is internet content.

15. The computer program product of claim 1, wherein the spoken genome property is a characteristic that affects how a listener perceives a speaker.

16. The computer program product of claim 1, wherein the spoken genome property is a characteristic that affects how a listener pays attention to a speaker.

17. The computer program product of claim 1, wherein the plurality of media files includes telephone calls.

18. The computer program product of claim 1, wherein the plurality of media files includes social media posts.