DETERMINING TREATMENT COMPLIANCE USING SPEECH PATTERNS PASSIVELY CAPTURED FROM A PATIENT ENVIRONMENT

• US 20160135735A1
• Filed: 11/17/2014
• Published: 05/19/2016
• Est. Priority Date: 11/17/2014
• Status: Active Grant

• Current Assignee: The Invention Science Fund II, L.L.C. (Intellectual Ventures LLC)
• Original Assignee: Elwha LLC (Intellectual Ventures LLC)
• Inventors: Bowers, Jeffrey A., Duesterhoft, Paul, Hawkins, Daniel, Hyde, Roderick A., Jung, Edward K.Y., Kare, Jordin T., Leuthardt, Eric C., Myhrvold, Nathan P., Smith, Michael A., Sweeney, Elizabeth A., Tegreene, Clarence T., Wood, Lowell L. Jr.
• Granted Patent: US 9,585,616 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: A61B 5/0022 Monitoring a patient using a global network, e.g. telephone networks, internet
• CPC Class Codes: A61B 5/165 Evaluating the state of mind, e.g. depression, anxiety
• CPC Class Codes: A61B 5/4076 Diagnosing or monitoring particular conditions of the nervous system A61B5/4821, A61B5/4824 take precedence
• CPC Class Codes: A61B 5/4803 Speech analysis specially adapted for diagnostic purposes
• CPC Class Codes: A61B 5/4833 Assessment of subject's compliance to treatment
• CPC Class Codes: A61B 5/7465 Arrangements for interactive communication between patient and care services, e.g. by using a telephone network telemetry of measured physiological signal A61B5/0002
• CPC Class Codes: G10L 25/66 for extracting parameters related to health condition detecting or measuring for diagnostic purposes A61B5/00
• CPC Class Codes: G16H 10/20 for electronic clinical trials or questionnaires
• CPC Class Codes: G16H 15/00 ICT specially adapted for medical reports, e.g. generation or transmission thereof
• CPC Class Codes: G16H 20/70 relating to mental therapies, e.g. psychological therapy or autogenous training

Abstract

Methods and systems are described for monitoring patient speech to determine compliance of the patient with a prescribed regimen for treating for a brain-related disorder. Patient speech is detected with an audio sensor at the patient location, and speech data is transmitted to a monitoring location. The audio sensor and other components at the patient location may be incorporated into, or associated with, a cell phone, computing system, or stand-alone microprocessor-based device, for example. Patient speech is processed at the patient location and/or monitoring location to identify speech parameters and/or patterns that indicate whether the patient has complied with the prescribed treatment regimen. Patient identity may be determined through biometric identification or other authentication techniques. The system may provide a report to an interested party, for example a medical care provider, based on whether (and/or the extent to which) the patient has complied with the prescribed treatment regimen.

Claims

1. A system comprising:

at least one audio sensor for sensing at least one audio signal including spontaneous speech from a patient at a patient location, the patient having a brain-related disorder and a prescribed treatment regimen for treating at least one aspect of the brain-related disorder;

signal processing circuitry for detecting the spontaneous speech in the at least one audio signal and generating speech data including data indicative of whether the patient has complied with the prescribed treatment regimen based upon the detected spontaneous speech; and

at least one transmitting device for transmitting a speech data signal containing the speech data including data indicative of whether the patient has complied with the prescribed treatment regimen from the patient location to a receiving device at a monitoring location.

2. The system of claim 1, wherein the signal processing circuitry includes:

patient identification circuitry configured to determine a presence of the patient from at least one identity signal sensed at the patient location;

wherein the signal processing circuitry is configured to detect the spontaneous speech from the patient based at least in part on the determination of the presence of the patient by the patient identification circuitry.

4. The system of claim 2, wherein the at least one identity signal includes at least a portion of the at least one audio signal, wherein the patient identification circuitry is configured to analyze the at least one audio signal to determine the presence of the patient by identifying at least a portion of the at least one audio signal that resembles known speech of the patient, and wherein the signal processing circuitry is configured to detect the spontaneous speech from the patient by identifying speech data corresponding to presence of the patient detected from the at least one audio signal.

5. The system of claim 2, wherein the at least one identity signal includes an image signal received from an imaging device at the patient location, wherein the patient identification circuitry is configured to analyze the image signal to determine the presence of the patient, and wherein the signal processing circuitry is configured to detect the spontaneous speech from the patient by identifying speech data corresponding to presence of the patient detected from the image signal.

8. The system of claim 2, wherein the at least one identity signal includes a biometric signal from at least one biometric sensor at the patient location, wherein the patient identification circuitry is configured to analyze the biometric signal to determine the presence of the patient, and wherein the signal processing circuitry is configured to detect the spontaneous speech from the patient by identifying the speech data corresponding to the presence of the patient as determined from the biometric signal.

20. The system of claim 1, wherein the signal processing circuitry includes a speech processor.

130. The system of claim 1, further comprising at least one of control circuitry for controlling at least one of the at least one audio sensor, the signal processing circuitry, and the at least one transmitting device;

a data storage device; and

notification circuitry for generating a notification.

131. The system of claim 5, wherein the patient identification circuitry is configured to analyze the image signal to determine the presence of the patient through at least one of facial recognition and gait analysis.

132. The system claim 2, wherein the at least one identity signal includes at least one of an authentication factor, a cell phone identification code, and an RFID signal.

133. The system of claim 1, wherein the at least one audio sensor, the signal processing circuitry, and the at least one transmitting device are components of a at least one of a cell phone configured with application software, a computing system or device, a data streaming device, and a stand-alone microprocessor-based system.

134. The system of claim 20, wherein the speech processor is configured to process the at least one audio signal to identify at least one portion of the at least one audio signal containing the spontaneous speech of the patient, exclude at least one portion of the at least one audio signal that does not contain spontaneous speech of the patient, determine at least one speech pattern of the patient, or determine at least one speech parameter indicative of whether the patient has complied with the prescribed treatment regimen.

135. The system of claim 134, wherein the speech data includes at least one of at least one section of the at least one audio signal containing the spontaneous speech of the patient, at least one speech pattern of the patient, and at least one speech parameter.

136. The system of claim 135, wherein the signal processing circuitry includes at least one of a comparator for comparing the at least one speech pattern of the patient with at least one characteristic speech pattern to determine whether the patient has complied with the prescribed treatment regimen and a comparator for comparing the at least one speech parameter of the patient with at least one characteristic speech parameter to determine whether the patient has complied with the prescribed treatment regimen.

137. The system of claim 136, wherein the at least one comparator is configured to compare the at least one speech parameter of the patient with a plurality of characteristic speech parameters to determine at least one of whether the patient has complied with the prescribed treatment regimen and a level of compliance of the patient with the prescribed treatment regimen.

138. The system of claim 1, wherein the signal processing circuitry is configured to determine at least one of that the patient has failed to comply with the prescribed treatment regimen and that the patient has complied with the prescribed treatment regimen.

139. The system of claim 1, wherein the at least one transmitting device includes at least one of a wireless transmitter, a computer network connection, and a USB port.

140. system of claim 1, further comprising notification circuitry for generating a notification, wherein the notification circuitry includes at least one of circuitry for generating an email notification, circuitry for generating a notification to be transmitted to a wireless device, and circuitry for storing a notification in a data storage device.

3. (canceled)

6-7. -7. (canceled)

9-19. -19. (canceled)

21-42. -42. (canceled)

43. A method comprising:

sensing at least one audio signal including spontaneous speech from a patient with at least one audio sensor at a patient location, the patient having a brain-related disorder and a prescribed treatment regimen for treating at least one aspect of the brain-related disorder;

detecting the spontaneous speech of the patient in the at least one audio signal with signal processing circuitry at the patient location;

generating with the signal processing circuitry speech data including data indicative of whether the patient has complied with the prescribed treatment regimen; and

transmitting a speech data signal containing the speech data including data indicative of whether the patient has complied with the prescribed treatment regimen to a receiving device at a monitoring location with at least one transmitting device at the patient location.

44. The method of claim 43, further comprising:

receiving a signal indicative of initiation of treatment of the patient according to the prescribed treatment regimen and beginning to sense the at least one audio signal responsive to receipt of the signal indicative of initiation of treatment of the patient.

48. The method of claim 43, further comprising:

determining a presence of the patient with patient identification circuitry based on at least one identity signal sensed at the patient location;

wherein detecting the spontaneous speech of the patient in the at least one audio signal with the signal processing circuitry at the patient location includes detecting speech from the patient based at least in part on the determination of the presence of the patient by the patient identification circuitry.

53. The method of claim 48, further comprising:

beginning detecting the spontaneous speech of the patient in the at least one audio signal in response to determining the presence of the patient with the patient identification circuitry.

66. The method of claim 43, further comprising:

identifying at least one section of the at least one audio signal containing spontaneous speech of the patient.

70. The method of claim 43, further comprising:

processing at least one section of the at least one audio signal to determine at least one speech pattern of the patient.

81. The method of claim 70, further comprising:

comparing the at least one speech pattern with at least one previous speech pattern of the patient to determine whether the patient has complied with the prescribed treatment regimen.

86. The method of claim 70, further comprising:

comparing the at least one speech pattern with a plurality of speech patterns; and

determining which of the plurality of speech patterns best matches the at least one speech pattern.

141. The method of claim 43, further comprising performing, substantially continuously, intermittently, or according to a schedule, at least one of sensing the at least one audio signal, detecting the spontaneous speech of the patient, generating the speech data, and transmitting the speech data signal.

142. The method of claim 48, wherein the at least one identity signal includes at least one of the at least one audio signal, includes an image signal, a biometric signal, and an RFID signal.

143. The method of claim 43, further comprising at least one of receiving a signal representing the prescribed treatment regimen from the monitoring location, receiving an instruction from the monitoring location, generating a notification with notification circuitry at the patient location, storing the at least one audio signal in a data storage device, sending the notification via email, transmitting the notification to a wireless device, storing the notification in a data storage device, storing the speech data in a data storage device, transmitting time data representing a time at which the spontaneous speech was detected to the receiving device with the at least one transmitting device at the patient location, and transmitting the speech data signal to the receiving device at the monitoring location with the at least one transmitting device at the patient location if the speech data is indicative of the patient not complying with the prescribed treatment regimen.

144. The method of claim 43, wherein transmitting the speech data signal includes at least one of transmitting a wireless signal, transmitting a signal via the internet, and storing the speech data on a USB device.

145. The method of claim 66, further comprising at least one of including the at least one section of the at least one audio signal containing spontaneous speech of the patient in the speech data, and processing the at least one audio signal to exclude at least one portion of the at least one audio signal that does not contain the spontaneous speech of the patient.

146. The method of claim 70, further comprising comparing the at least one speech pattern with at least one characteristic speech pattern to determine whether the patient has complied with the prescribed treatment regime;

wherein the speech data includes the at least one speech pattern of the patient.

147. The method of claim 43, further comprising determining at least one speech parameter indicative of whether the patient has complied with the prescribed treatment regimen, wherein the speech data includes the at least one speech parameter;

and comparing the at least one speech parameter with at least one characteristic speech parameter to determine whether the patient has complied with the prescribed treatment regimen.

148. The method of claim 43, wherein the brain-related disorder includes at least one of schizophrenia, Parkinson'"'"'s disease, an Autism Spectrum Disorder, dementia, Bipolar Disorder, and depression.

149. The method of claim 81, wherein the at least one previous speech pattern is representative of at least one of a speech pattern of the patient prior to initiation of treatment of the brain-related disorder, a speech pattern of the patient after initiation of treatment of the brain-related disorder, a speech pattern of the patient during known compliance of the patient with a treatment of the brain-related disorder, and a speech pattern of the patient during treatment with a specified treatment regimen.

150. The method of claim 86, wherein the plurality of speech patterns includes at least one of stored prior speech patterns of the patient representative of speech patterns of the patient with different treatment regimens and stored population speech patterns representative of speech patterns of populations of patients.

151. The method of claim 86, wherein the plurality of speech patterns includes a plurality of population speech patterns including at least one of a population speech pattern representative of speech patterns of a population of patients without a brain-related disorder, a population speech pattern of a population of patients having an untreated brain-related disorder, a population speech pattern representative of speech patterns of a population of patients having a brain-related disorder stabilized by treatment, and speech patterns representative of populations of patients undergoing different treatment regimens for the brain-related disorder.

45-47. -47. (canceled)

49-52. -52. (canceled)

54-65. -65. (canceled)

67-69. -69. (canceled)

71-80. -80. (canceled)

82-85. -85. (canceled)

87-92. -92. (canceled)

93. A computer program product comprising:

a non-transitory signal-bearing medium bearing;

one or more instructions for sensing at least one audio signal including spontaneous speech from a patient with at least one audio sensor at a patient location, the patient having a brain-related disorder and a prescribed treatment regimen for treating at least one aspect of the brain-related disorder;

one or more instructions for detecting the spontaneous speech of the patient in the at least one audio signal with signal processing circuitry at the patient location;

one or more instructions for generating with the signal processing circuitry speech data including data indicative of whether the patient has complied with the prescribed treatment regimen; and

one or more instructions for transmitting a speech data signal containing the speech data including data indicative of whether speech data including data indicative of whether the patient has complied with the prescribed treatment regimen to a receiving device at a monitoring location with at least one transmitting device at the patient location.

94-128. -128. (canceled)

129. A system comprising:

a computing device;

and instructions that when executed on the computing device cause the computing device to;

sense at least one audio signal including spontaneous speech from a patient with at least one audio sensor at a patient location, the patient having a brain-related disorder and a prescribed treatment regimen for treating at least one aspect of the brain-related disorder;

detect the spontaneous speech of the patient in the at least one audio signal with signal processing circuitry at the patient location;

generate with the signal processing circuitry speech data including data indicative whether the patient has complied with the prescribed treatment regimen; and

transmit a speech data signal containing the speech data including data indicative of whether the patient has complied with the prescribed treatment regimen to a receiving device at a monitoring location with at least one transmitting device at the patient location.