Systems, environment and methods for evaluation and management of autism spectrum disorder using a wearable data collection device

• US 10,405,786 B2
• Filed: 10/09/2014
• Issued: 09/10/2019
• Est. Priority Date: 10/09/2013
• Status: Active Grant

• Current Assignee: Nedim T. Sahin
• Original Assignee: Nedim T. Sahin
• Inventors: Sahin, Nedim T.
• Primary Examiner(s): Downey, John R
• Application Number:
  US14/511,039
• Publication Number:
  US 20150099946A1
• Time in Patent Office: 1,797 Days
• CPC Class Codes: A61B 2560/0242 adapted to measure environmental factors, e.g. temperature, pollution
• CPC Class Codes: A61B 5/0004 characterised by the type of physiological signal transmitted
• CPC Class Codes: A61B 5/1123 Discriminating type of movement, e.g. walking or running A61B5/1116, A61B5/112 take precedence
• CPC Class Codes: A61B 5/16 Devices for psychotechnics using teaching or educational appliances G09B1/00 - G09B7/00; Testing reaction times ; Devices for evaluating the psychological state
• CPC Class Codes: A61B 5/165 Evaluating the state of mind, e.g. depression, anxiety
• CPC Class Codes: A61B 5/6803 Head-worn items, e.g. helmets, masks, headphones or goggles
• CPC Class Codes: A61B 7/04 Electric stethoscopes microphones, acoustic transducers therefor H04R
• CPC Class Codes: G16H 10/65 stored on portable record carriers, e.g. on smartcards, RFID tags or CD
• CPC Class Codes: G16H 20/40 relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• CPC Class Codes: G16H 20/70 relating to mental therapies, e.g. psychological therapy or autogenous training
• CPC Class Codes: G16H 40/67 for remote operation
• CPC Class Codes: G16H 50/20 for computer-aided diagnosis, e.g. based on medical expert systems

Abstract

The systems, environment, and methods, described herein support evaluation of an individual for ASD while in the home environment. Through data collected by a wearable data collection device donned by the individual, eye contact with the caregiver, verbal interaction, and repetitive verbalizations and motions of the head and body may be tracked and objectively quantified during evaluation. Further, the wearable data collection device may support monitoring of brain activity and other physiology which, in turn, may be analyzed by the systems and environment described herein during evaluation to recognize patterns that predict evaluation outcome and other clinical features. Various software modules and tools supported by the wearable data collection device provide training, ongoing progress tracking, and management solutions for individuals living with ASD.

Claims

1. A system for providing monitoring of and analysis related to a wearer of a wearable data collection device, the system comprising:

a wearable data collection device comprising

processing circuitry, and

a non-transitory computer readable medium having instructions stored thereon; and

one or more input capture elements connected to and/or in communication with the wearable data collection device;

wherein the instructions, when executed by the processing circuitry of the wearable data collection device, cause the processing circuitry to;

collect, via at least one of the one or more input capture elements, sensor data, wherein the sensor data includes at least one of image data, audio data, and motion data,

analyze the sensor data to identify at least one socially relevant behavior of the wearer that is responsive to at least one socially relevant event involving an interaction between the wearer and at least one other participant, wherein

the at least one socially relevant behavior includes a gesture of the wearer, and

identifying the at least one socially relevant behavior comprises determining a threshold difference between the at least one socially relevant behavior of the wearer and a conventional response to the at least one socially relevant event, wherein

the at least one socially relevant event occurs prior to or concurrently with the at least one socially relevant behavior,

using the threshold difference, identify whether the behavior of the wearer varies from the conventional response,

store, upon a non-transitory computer readable storage device, information related to the at least one socially relevant behavior,

responsive to identifying that the behavior of the wearer varies from the conventional response,

present, to the wearer via one or more output features of the wearable data collection device, feedback directed to modifying the socially relevant behavior,

analyze sensor data captured subsequently to a timeframe of presenting the feedback to identify a subsequent gesture of the wearer responsive to the feedback,

determine whether the subsequent gesture more closely matches the conventional response, and

present, via at least one output feature of the one or more output features of the wearable data collection device, subsequent feedback to the wearer, wherein the subsequent feedback comprises at least one of i) indication of success or failure in performing the conventional response, and ii) progress feedback comprising at least one of a) an ongoing score, b) a comparative score comparing a prior session to a present session, c) a competitive score comparing a score of the wearer to a score of one or more additional individuals, and d) a level completion status.

2. The system of claim 1, wherein the information related to the at least one socially relevant behavior comprises at least one of a verbal repetition count and a movement repetition count.

3. The system of claim 1, wherein the conventional response is based at least in part upon statistical analysis of at least one of i) a spectrum of historical responses identified as being common to the wearer, and ii) a personality assessment of the wearer.

4. The system of claim 1, wherein the instructions, when executed by the processing circuitry, cause the processing circuitry to:

determine the conventional response based at least in part on one or more mitigating factors.

5. The system of claim 1, wherein the instructions, when executed by the processing circuitry, cause the processing circuitry to provide, to a third party computing device, feedback related to the socially relevant behavior, wherein:

providing feedback to the third party computing device comprises transmitting, via a wired or wireless transmission link, a data transmission to the third party computing device identifying the socially relevant behavior.

6. The system of claim 1, wherein:

providing feedback to the wearer comprises providing coaching feedback to the wearer for modifying the behavior of the wearer to more closely match the conventional response; and

the conventional response comprises at least one of i) suppression of the gesture, and ii) calming of an emotional state of the wearer.

7. The system of claim 5, wherein providing feedback to the third party computing device comprises forwarding, to the third party computing device, at least one of a) a portion of the sensor data, and b) data derived from analyzing the sensor data for review by an evaluator.

8. The system of claim 1, wherein providing feedback to the wearer comprises providing, via at least one output feature of the one or more output features of the wearable data collection device, at least one of an audible cue and a visual cue directing the wearer to perform the conventional response.

9. The system of claim 1, further comprising a remote processing system accessible to the wearable data collection device via a network, wherein analyzing the sensor data comprises:

providing, via the network to the remote processing system, at least a portion of the sensor data contemporaneous with a timeframe of the socially relevant behavior as context data; and

receiving, via the network from the remote processing system, an indication of the at least one socially relevant behavior varying from the conventional response.

10. The system of claim 1, wherein:

the sensor data comprises physiological motion data; and

a physiological state of the wearer is identified based upon at least one of heart dynamics and breathing dynamics.

11. The system of claim 1, wherein:

the conventional response comprises direction of gaze of the wearer towards a first participant of the at least one participant; and

the instructions, when executed by the processing circuitry, cause the processing circuitry to present, upon a heads up display of the wearable data collection device, an augmented version of a real-time video stream, wherein

presenting the feedback directed to modifying the socially relevant behavior comprises visually augmenting the real-time video stream in an area upon and/or surrounding a face region of the first participant to draw attention to the face region of the first participant responsive to the at least one socially relevant behavior including failure to direct gaze toward the first participant.

12. The system of claim 11, wherein:

analyzing the sensor data captured subsequently to the timeframe of presenting the feedback comprises obtaining, from the sensor data, data indicative of a direction of gaze of the wearer; and

determining whether the subsequent gesture more closely matches the conventional response comprises determining, using the data indicative of the direction of gaze of the wearer, co-registration between the direction of gaze of the wearer and the face region of the first participant.

13. The system of claim 1, further comprising, responsive to determining whether the subsequent reaction more closely matches the conventional response:

gauging effectiveness of the feedback based at least in part on relative change in behavior of the wearer toward the conventional response; and

storing, within a non-transitory computer readable medium connected to or in communication with the wearable data collection device, an indication of the effectiveness of the feedback, wherein

providing the feedback comprises providing one or more types of feedback having a respective indication of effectiveness indicative of being previously effective in obtaining the conventional response from the wearer.

14. The system of claim 13, wherein the instructions, when executed by the processing circuitry of the wearable data collection device, cause the processing circuitry to, prior to presenting the feedback:

select, from a plurality of feedback options based at least in part upon respective archival indications of effectiveness associated with one or more feedback options of the plurality of feedback options, the feedback.

15. The system of claim 4, wherein the one or more mitigating factors include at least one of an emotional state of the participant prior to the socially relevant event, and a physiological state of the wearer prior to the socially relevant event.

17. The system of claim 1, wherein providing feedback to the wearer comprises providing, via at least one output feature of one or more output features of the wearable data collection device, at least one of visual, audible, haptic, and neural stimulation feedback to the wearer.

18. The system of claim 5, wherein providing feedback comprises identifying one or more recommended measures for at least one of the wearer and a third party to take to prevent, redirect, and/or minimize the socially relevant behavior.

16. A method for assisting a wearer of a wearable data collection device in responding to socially relevant events, the system comprising:

collecting, via at least one of one or more input capture elements connected to and/or in communication with the wearable data collection device, sensor data, wherein

the sensor data includes at least one of image data, audio data, and motion data;

analyzing, via processing circuitry, the sensor data to identify a gesture made by the wearer in response to at least one socially relevant event involving an interaction between the wearer and at least one other participant, wherein

the at least one socially relevant event occurs prior to or concurrently with the gesture;

identifying, by the processing circuitry, at least one conventional response to the at least one socially relevant event;

determining, by the processing circuitry, a measured difference between the gesture and the at least one conventional response;

using the measured difference, determining, by the processing circuitry, whether the gesture of the wearer varies from the conventional response by at least a threshold amount;

storing, upon a non-transitory computer readable storage device, information related to the gesture;

responsive to determining that the gesture of the wearer varies from the conventional response by at least a threshold amount,

selecting, by the processing circuitry based at least in part on the gesture, feedback directed to modifying or encouraging a socially relevant behavior of the wearer to produce a subsequent conventional response,

presenting, to the wearer via one or more output features of the wearable data collection device, the feedback,

analyzing, by the processing circuitry, sensor data captured subsequently to a timeframe of presenting the feedback to identify a subsequent gesture of the wearer responsive to the feedback,

determining, by the processing circuitry, whether the subsequent gesture corresponds to the subsequent conventional response, and

presenting, via at least one output feature of the one or more output features of the wearable data collection device, subsequent feedback to the wearer, wherein the subsequent feedback comprises at least one of i) indication of success or failure in performing the subsequent conventional response, and ii) progress feedback comprising at least one of a) an ongoing score, b) a comparative score comparing a prior session to a present session, c) a competitive score comparing a score of the wearer to a score of one or more additional individuals, and d) a level completion status.