METHOD AND APPARATUS OF SPEECH ANALYSIS FOR REAL-TIME MEASUREMENT OF STRESS, FATIGUE, AND UNCERTAINTY

• US 20130311190A1
• Filed: 05/21/2013
• Published: 11/21/2013
• Est. Priority Date: 05/21/2012
• Status: Active Grant

• Current Assignee: Bruce Reiner
• Original Assignee: Bruce Reiner
• Inventors: Reiner, Bruce
• Granted Patent: US 9,251,809 B2
• Time in Patent Office: Days
• US Class Current: 704/270
• CPC Class Codes: G06Q 10/0633 Workflow analysis
• CPC Class Codes: G06Q 10/0639 Performance analysis of employees; Performance analysis of enterprise or organisation operations
• CPC Class Codes: G06Q 30/0201 Market modelling; Market analysis; Collecting market data
• CPC Class Codes: G10L 25/48 specially adapted for particular use
• CPC Class Codes: G16H 10/20 for electronic clinical trials or questionnaires
• CPC Class Codes: G16H 40/63 for local operation

Abstract

The present invention utilizes speech analysis to provide real-time measurement of end-user stress, fatigue, and uncertainty in decision-making. The present invention monitors “technology-induced” stressors by increasing the inherent functionality of individual monitoring technologies, so as to perform multiple applications in a single setting. In addition to the continued use of speech recognition technology for computerized report transcription, the present invention simultaneously measures and analyzes occupational stress and fatigue in real-time, specific to the unique profile of each individual end-user and context of the task being performed. The derived user-specific stress/fatigue analytics may be used in the creation of a number of workflow and quality enhancing deliverables, including customizable intervention strategies for stress/fatigue reduction, creation of automated workflow templates, and targeted quality assurance and peer review.

Claims

1. A computer-implemented method of measuring speech for stress, fatigue and uncertainty, by a user of a computer system, comprising:

obtaining biometrics data from a user, using a biometrics system;

selecting random text from a database, and providing it to a user to speak said text, such that a user-specific identification is established in conjunction with said biometrics data;

providing a questionnaire to said user, to obtain data to establish a user-specific profile, and storing the provided data in said database;

providing a preliminary user-specific profile to said user based on said questionnaire;

providing targeted speech as a series of randomly selected text strings from said database, to the user, for the user to speak for speech analysis identification and authentication using a speech analysis device, and storing said speech data in said database for analysis;

validating said speech data from said speech analysis identification and authentication, with said biometrics data; and

confirming said validation to the user.

2. The method according to claim 1, further comprising:

providing a standardized questionnaire to the user to identify one of the presence or absence of stress modulators; and

storing said data from said standardized questionnaire, in said database.

3. The method according to claim 2, further comprising:

calculating a baseline stress modulator score to analyze and quantify a degree of expected baseline stress of the user.

4. The method according to claim 3, further comprising:

correlating said baseline stress modulator score with a user-specific historical stress profile to identify changes above or below a baseline stress measure.

5. The method according to claim 4, further comprising:

detecting a deviation from said baseline stress measure; and

requesting additional information related to stress modulators from the user for clarification and correlation with actual stress measurements.

6. The method according to claim 5, further comprising:

calculating a stress score in based upon said analysis of the targeted speech after completion of said speech analysis for end-user identification and authentication.

7. The method according to claim 6, further comprising:

correlating said stress score with data in said user-specific historical stress profile, and when said stress score differs beyond a predetermined threshold,

invoking work restrictions or data access restrictions on the user in accordance with predetermined institutional and departmental policy.

8. The method according to claim 7, wherein based upon said work restrictions or data access restrictions, receiving instructions from the user to one of repeat the baseline stress analysis, temporarily discontinue use pending user stress reduction, cancel work, or accept said work or data access restrictions.

9. The method according to claim 8, further comprising:

recording continuous stress measurements, in real-time, to the database from a stress measurement device and speech analysis device during work by the user; and

correlating said stress measurements with task complexity scores.

10. The method according to claim 9, further comprising:

continuously updating said real-time stress scores, and presenting the user said updated stress scores based upon user pre-defined preferences for data presentation.

11. The method according to claim 10, further comprising:

issuing an automated prompt by electronic means, to alert the user when said stress scores excess a pre-defined threshold; and

providing the user with intervention options.

12. The method according to claim 11, further comprising:

obtaining intermittent task-related stress measurements through real-time speech analysis to identify periodic fluctuations in stress related to uncertainty and confidence in user task performance.

13. The method according to claim 12, wherein when an elevated stress measure is recorded to said database, relative to said baseline stress measure at that particular time,

issuing an automated prompt to the user informing of said elevated stress measure and the specific related task being performed.

14. The method according to claim 13, wherein when a high task-specific stress score, relative to said baseline stress measure, is determined,

presenting the user with intervention options.

15. The method according to claim 14, wherein said intervention options include a request for a formal consultation, use of computerized decision support, request for additional data, or request to release said task and defer to another party.

16. The method according to claim 15, wherein when said elevated stress scores are associated with predetermined unacceptable outcomes, restrictions are placed on task complexity for the user, or mandatory stress interventions or remedial education/training is instituted for the user.

17. The method according to claim 16, wherein at one of completion of work, log-off of the computer system, or closing of said task,

providing the user with selected text from said database for said targeted speech for re-evaluation of stress;

and

correlating said re-evaluated stress scores with recent stress levels measured in task performance using continuous speech, to determine user stress, fatigue, and uncertainty.

18. A computer-readable medium containing executable code for measuring speech for stress, fatigue and uncertainty, comprising:

obtaining biometrics data from a user, using a biometrics system;

selecting random text from a database, and providing it to a user to speak said text, such that a user-specific identification is established in conjunction with said biometrics data;

providing a questionnaire to said user, to obtain data to establish a user-specific profile, and storing the provided data in said database;

providing a preliminary user-specific profile to said user based on said questionnaire;

providing targeted speech as a series of randomly selected text strings from said database, to the user, for the user to speak for speech analysis identification and authentication using a speech analysis device, and storing said speech data in said database for analysis;

validating said speech data from said speech analysis identification and authentication, with said biometrics data; and

confirming said validation to the user.

19. A computer system for measuring speech for stress, fatigue and uncertainty, comprising:

at least one memory which contains at least one program which comprises the steps of;

obtaining biometrics data from a user, using a biometrics system;

selecting random text from a database, and providing it to a user to speak said text, such that a user-specific identification is established in conjunction with said biometrics data;

providing a questionnaire to said user, to obtain data to establish a user-specific profile, and storing the provided data in said database;

providing a preliminary user-specific profile to said user based on said questionnaire;

providing targeted speech as a series of randomly selected text strings from said database, to the user, for the user to speak for speech analysis identification and authentication using a speech analysis device, and storing said speech data in said database for analysis;

validating said speech data from said speech analysis identification and authentication, with said biometrics data; and

confirming said validation to the user; and

at least one processor for executing the program.