DETERMINING TREATMENT COMPLIANCE USING SPEECH PATTERNS CAPTURED DURING USE OF A COMMUNICATION SYSTEM

• US 20160135737A1
• Filed: 06/03/2015
• Published: 05/19/2016
• Est. Priority Date: 11/17/2014
• Status: Abandoned Application

• Current Assignee: The Invention Science Fund II, L.L.C. (Intellectual Ventures LLC)
• Original Assignee: Elwha LLC (Intellectual Ventures LLC)
• Inventors: Bowers, Jeffrey A., Duesterhoft, Paul, Hawkins, Daniel, Hyde, Roderick A., Jung, Edward K.Y., Kare, Jordin T., Leuthardt, Eric C., Myhrvold, Nathan P., Smith, Michael A., Sweeney, Elizabeth A., Tegreene, Clarence T., Wood, Lowell L. Jr.
• Application Number:
  US14/729,322
• Publication Number:
  US 20160135737A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: A61B 5/0022 Monitoring a patient using a global network, e.g. telephone networks, internet
• CPC Class Codes: A61B 5/165 Evaluating the state of mind, e.g. depression, anxiety
• CPC Class Codes: A61B 5/4076 Diagnosing or monitoring particular conditions of the nervous system A61B5/4821, A61B5/4824 take precedence
• CPC Class Codes: A61B 5/4803 Speech analysis specially adapted for diagnostic purposes
• CPC Class Codes: A61B 5/4833 Assessment of subject's compliance to treatment
• CPC Class Codes: A61B 5/7465 Arrangements for interactive communication between patient and care services, e.g. by using a telephone network telemetry of measured physiological signal A61B5/0002
• CPC Class Codes: G10L 25/66 for extracting parameters related to health condition detecting or measuring for diagnostic purposes A61B5/00
• CPC Class Codes: G16H 15/00 ICT specially adapted for medical reports, e.g. generation or transmission thereof
• CPC Class Codes: G16H 40/67 for remote operation

Abstract

Methods and systems for monitoring compliance of a patient with a prescribed treatment regimen are described. Compliance is determined based upon analysis of the patient'"'"'s speech detected during use of a communication system such as a mobile telephone by the patient. Methods and systems as described herein can be used for monitoring patient compliance with a treatment for a brain-related disorder, for example. Identity of the patient as user of the communication system is determined through the use of e.g., biometric or authentication techniques. Speech data indicative of whether the patient has complied with the prescribed treatment regimen is transmitted from a circuitry-based system at the patient location to a monitoring location, where it may be reviewed by a medical caregiver or other party, for example. Patient speech may be analyzed at the patient location and/or subjected to analysis at the monitoring location.

Claims

1. A communication system comprising:

at least one audio sensor for sensing at least one audio signal including patient speech during use of the communication system by a patient at a patient location, the patient having a brain-related disorder and a prescribed treatment regimen for treating at least one aspect of the brain-related disorder;

patient identification circuitry configured to determine a presence of the patient from at least one identity signal sensed at the patient location;

speech detection circuitry in the communication system for processing the at least one audio signal to identify at least one section of the at least one audio signal containing speech of the patient, wherein the speech detection circuitry is configured to identify the at least one section of the at least one audio signal containing speech of the patient based at least in part on the determination of the presence of the patient by the patient identification circuitry;

speech analysis circuitry in the communication system for analyzing the at least one section of the at least one audio signal to generate speech data including data indicative of whether the patient has complied with the prescribed treatment regimen; and

at least one transmitting device at the patient location for transmitting a speech data signal containing the speech data including data indicative of whether the patient has complied with the prescribed treatment regimen from the patient location to a receiving device at a monitoring location.

2. The system of claim 1, wherein the at least one identity signal includes at least a portion of the at least one audio signal, wherein the patient identification circuitry is configured to analyze the at least one audio signal to determine the presence of the patient by identifying at least a portion of the at least one audio signal that resembles known speech of the patient, and wherein the speech detection circuitry is configured to identify the at least one section of the at least one audio signal containing speech of the patient by identifying speech in the at least one audio signal corresponding to presence of the patient detected from the at least one audio signal.

24. The system of claim 1, including a data storage device.

26. The system of claim 1, wherein the speech analysis circuitry includes a speech processor for processing at least one section of the at least one audio signal to determine at least one speech pattern of the patient.

28. The system of claim 26, wherein the speech processor includes a speech analyzer for assessing the at least one speech pattern to determine at least one speech parameter indicative of whether the patient has complied with the prescribed treatment regimen, wherein the speech data includes the at least one speech parameter.

29. The system of claim 26, wherein the speech analysis circuitry includes a comparator for comparing the at least one speech pattern with at least one characteristic speech pattern to determine whether the patient has complied with the prescribed treatment regimen.

37. The system of claim 1, including notification circuitry for generating a notification.

109. The system of claim 1, further including at least one sensor, the at least one sensor including at least one of a biometric sensor, an audio sensor, an imaging device, an RFID sensor, and a user input device.

110. The system of claim 1, wherein the at least one identity signal includes at least one of an authentication factor, a cell phone identification code, and an RFID signal.

111. The system of claim 1, wherein the patient identification circuitry is configured to determine the presence of the patient by at least one of distinguishing the presence of the patient from the presence of another individual, distinguishing the presence of the patient from the absence of the patient, and determining that information contained in the identity signal matches patient information associated with the patient.

112. The system of claim 1, wherein the at least one audio sensor, the patient identification circuitry, the speech detection circuitry, the speech analysis circuitry, and the at least one transmitting device are components of at least one of a cell phone configured with application software, a computing system or device, an intercommunication system, and a microprocessor-based system.

113. The system of claim 1, wherein the transmitting device includes at least one of a wireless transmitter, a computer network connection, and a computer communication port.

114. The system of claim 37, wherein the notification circuitry includes at least one of circuitry for generating an email notification, circuitry for generating a notification to be transmitted to a wireless device, and circuitry for storing a notification in a data storage device.

3-23. -23. (canceled)

25. (canceled)

27. (canceled)

30-36. -36. (canceled)

38-40. -40. (canceled)

41. A method comprising:

sensing at least one audio signal including patient speech from a patient with at least one audio sensor of a communication system at a patient location during use of the communication system by the patient, the patient having a brain-related disorder and a prescribed treatment regimen for treating at least one aspect of the brain-related disorder;

determining a presence of the patient with patient identification circuitry from at least one identity signal sensed at the patient location;

processing the at least one audio signal with a speech detection circuitry in the communication system to identify at least one section of the at least one audio signal containing speech of the patient, including identifying speech from the patient based at least in part on the determination of the presence of the patient by the patient identification circuitry;

analyzing the at least one section of the at least one audio signal with speech analysis circuitry in the communication system to generate speech data including data indicative of whether the patient has complied with the prescribed treatment regimen; and

transmitting a speech data signal containing the speech data including data indicative of whether the patient has complied with the prescribed treatment regimen to a receiving device at a monitoring location with at least one transmitting device at the patient location.

45. The method of claim 41, including receiving a signal indicative of initiation of treatment of the patient according to the prescribed treatment regimen and beginning to sense the at least one audio signal responsive to receipt of the signal indicative of initiation of treatment of the patient.

55. The method of claim 41, including transmitting time data to the receiving device with the at least one transmitting device at the patient location, the time data representing a time at which the at least one section of the at least one audio signal was sensed.

57. The method of claim 41, including processing the at least one section of the at least one audio signal to determine at least one speech pattern of the patient.

58. The method of claim 57, wherein the speech data includes the at least one speech pattern of the patient.

59. The method of claim 41, including determining at least one speech parameter indicative of whether the patient has complied with the prescribed treatment regimen, wherein the speech data includes the at least one speech parameter.

60. The method of claim 57, including comparing the at least one speech pattern of the patient with at least one characteristic speech pattern to determine whether the patient has complied with the prescribed treatment regimen.

67. The method of claim 57, including comparing the at least one speech pattern of the patient with at least one previous speech pattern of the patient to determine whether the patient has complied with the prescribed treatment regimen.

72. The method of claim 57, including comparing the at least one speech pattern of the patient with a plurality of speech patterns and determining which of the plurality of speech patterns best matches the at least one speech pattern of the patient.

115. The method of claim 41, wherein determining the presence of the patient includes at least one of distinguishing the presence of the patient from the presence of another individual, distinguishing the presence of the patient from the absence of the patient, and determining that information contained in the identity signal matches patient information associated with the patient.

116. The method of claim 41, including performing at least one of sensing the at least one audio signal, determining the presence of the patient, processing the at least one audio signal, analyzing the at least one section of the at least one audio signal, and transmitting the speech data signal;

wherein the performing is done substantially continuously, intermittently, or according to a schedule.

117. The method of claim 41, including receiving at least one of at least one instruction and a signal representing the prescribed treatment regimen from the monitoring location.

118. The method of claim 41, wherein transmitting the speech data signal to the receiving device at the monitoring location includes at least one of transmitting a wireless signal and transmitting a signal via a computer network connection.

119. The method of claim 41, including at least one of storing the at least one audio signal in a data storage device and storing the speech data in a data storage device.

120. The method of claim 41, wherein the brain-related disorder includes at least one of schizophrenia, Parkinson'"'"'s disease, Autism Spectrum Disorder, dementia, Bipolar Disorder, and depression.

121. The method of claim 67, wherein the at least one previous speech pattern is representative of at least one of a speech pattern of the patient prior to initiation of treatment of the brain-related disorder, a speech pattern of the patient after initiation of treatment of the brain-related disorder, a speech pattern of the patient during known compliance of the patient with a treatment of the brain-related disorder, and a speech pattern of the patient during treatment with a specified treatment regimen.

122. The method of claim 72, wherein the plurality of speech patterns are selected from stored population speech patterns representative of speech patterns of populations of subjects and stored prior speech patterns of the patient representative of speech patterns of the patient with different treatment regimens.

123. The method of claim 122, wherein the plurality of speech patterns are the stored population speech patterns, and wherein at least one of the population speech patterns is representative of at least one of speech patterns of a population of subjects without the brain-related disorder, speech patterns of a population of untreated subjects having the brain-related disorder, speech patterns of a population of subjects having the brain-related disorder stabilized by treatment, and speech patterns of a population of subjects undergoing different treatment regimens for the brain-related disorder.

42-44. -44. (canceled)

46-54. -54. (canceled)

56. (canceled)

61-66. -66. (canceled)

68-71. -71. (canceled)

73-78. -78. (canceled)

79. A computer program product comprising:

a non-transitory signal-bearing medium bearing;

one or more instructions for sensing at least one audio signal including patient speech from a patient with at least one audio sensor of a communication system at a patient location during use of the communication system by the patient, the patient having a brain-related disorder and a prescribed treatment regimen for treating at least one aspect of the brain-related disorder;

one or more instructions for determining a presence of the patient with patient identification circuitry from at least one identity signal sensed at the patient location;

one or more instructions for processing the at least one audio signal with a speech detection circuitry in the communication system to identify at least one section of the at least one audio signal containing speech of a patient, including identifying speech from the patient based at least in part on the determination of the presence of the patient by the patient identification circuitry;

one or more instructions for analyzing the at least one section of the at least one audio signal with speech analysis circuitry in the communication system to generate speech data including data indicative of whether the patient has complied with the prescribed treatment regimen; and

one or more instructions for transmitting a speech data signal containing the speech data including data indicative of whether the patient has complied with the prescribed treatment regimen to a receiving device at a monitoring location with at least one transmitting device at the patient location.

83. The computer program product of claim 79, wherein the non-transitory signal-bearing medium bears one or more instructions for receiving a signal indicative of initiation of treatment of the patient according to the prescribed treatment regimen and beginning to sense the at least one audio signal responsive to receipt of the signal indicative of initiation of treatment of the patient.

94. The computer program product of claim 79, wherein the non-transitory signal-bearing medium bears one or more instructions for transmitting time data to the receiving device with the at least one transmitting device at the patient location, the time data representing a time at which the at least one section of the at least one audio signal was sensed.

95. The computer program product of claim 79, wherein the non-transitory signal-bearing medium bears one or more instructions for processing the at least one audio signal to exclude at least one portion of the at least one audio signal that does not contain speech of the patient.

96. The computer program product of claim 79, wherein the non-transitory signal-bearing medium bears one or more instructions for processing the at least one section of the at least one audio signal to determine at least one speech pattern of the patient.

97. The computer program product of claim 96, wherein the one or more instructions for analyzing the at least one section of the at least one audio signal with speech analysis circuitry in the communication system to generate speech data including data indicative of whether the patient has complied with the prescribed treatment regimen include the one or more instructions for processing the at least one section of the at least one audio signal to determine the at least one speech pattern of the patient.

98. The computer program product of claim 79, wherein the non-transitory signal-bearing medium bears one or more instructions for determining at least one speech parameter indicative of whether the patient has complied with the prescribed treatment regimen, wherein the speech data includes the at least one speech parameter.

105. The computer program product of claim 96, wherein the non-transitory signal bearing medium bears one or more instructions for comparing the at least one speech pattern of the patient with a plurality of speech patterns and determining which of the plurality of speech patterns best matches the at least one speech pattern of the patient.

124. The computer program product of claim 79, wherein the one or more instructions for determining the presence of the patient include one or more instructions for at least one of distinguishing the presence of the patient from the presence of another individual, distinguishing the presence of the patient from the absence of the patient, and determining that information contained in the identity signal matches patient information associated with the patient.

125. The computer program product of claim 79, wherein the non-transitory signal-bearing medium bears one or more instructions for performing, substantially continuously, intermittently, or according to a schedule, at least one of sensing the at least one audio signal, determining the presence of the patient, processing the at least one audio signal, analyzing the at least one section of the at least one audio signal, and transmitting the speech data signal.

126. The computer program product of claim 79, wherein the non-transitory signal-bearing medium bears one or more instructions for at least one of receiving at least one instruction from the monitoring location and receiving a signal representing the prescribed treatment regimen from the monitoring location.

127. The computer program product of claim 96, wherein the non-transitory signal-bearing medium bears one or more instructions for at least one of comparing the at least one speech pattern of the patient with at least one characteristic speech pattern to determine whether the patient has complied with the prescribed treatment regimen and comparing the at least one speech pattern of the patient with at least one previous speech pattern of the patient to determine whether the patient has complied with the prescribed treatment regimen.

80-82. -82. (canceled)

84-93. -93. (canceled)

99-104. -104. (canceled)

106-108. -108. (canceled)