Methods and systems for treating autism

• US 10,311,645 B1
• Filed: 10/12/2017
• Issued: 06/04/2019
• Est. Priority Date: 10/14/2016
• Status: Active Grant

• Current Assignee: Floreo, Inc.
• Original Assignee: Floreo, Inc.
• Inventors: Ravindran, Vijay, Sazawal, Vibha, Moeeny, Ali, Solorzano, Rita, Turnacioglu, Sinan
• Primary Examiner(s): Craddock, Robert J
• Application Number:
  US15/782,216
• Time in Patent Office: 600 Days
• Field of Search: None
• CPC Class Codes: A61B 5/163 by tracking eye movement, gaze, or pupil change
• CPC Class Codes: A61B 5/168 Evaluating attention deficit, hyperactivity
• CPC Class Codes: A61B 5/4848 Monitoring or testing the effects of treatment, e.g. of medication
• CPC Class Codes: A61B 5/742 using visual displays A61B5/339 takes precedence
• CPC Class Codes: A61H 39/007 Stimulation by mechanical vibrations, e.g. ultrasonic
• CPC Class Codes: A61M 2021/0022 by the tactile sense, e.g. vibrations
• CPC Class Codes: A61M 2021/0027 by the hearing sense
• CPC Class Codes: A61M 2021/005 images, e.g. video
• CPC Class Codes: A61M 21/00 Other devices or methods to cause a change in the state of consciousness; Devices for producing or ending sleep by mechanical, optical, or acoustical means, e.g. for hypnosis
• CPC Class Codes: A61M 2205/3306 Optical measuring means
• CPC Class Codes: A61M 2205/332 Force measuring means
• CPC Class Codes: A61M 2205/3368 Temperature
• CPC Class Codes: A61M 2205/3375 Acoustical, e.g. ultrasonic, measuring means
• CPC Class Codes: A61M 2205/507 Head Mounted Displays [HMD]
• CPC Class Codes: A61N 1/36025 for treating a mental or cerebral condition
• CPC Class Codes: G01N 2800/28 Neurological disorders
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06V 20/20 : in augmented reality scenes
• CPC Class Codes: G06V 40/174 : Facial expression recognition
• CPC Class Codes: G06V 40/193 : Preprocessing; Feature extraction
• CPC Class Codes: G06V 40/28 : Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113

Abstract

A method for treating autism is provided. The method includes presenting to affected subjects therapeutic content in the form of images or video in a virtual or augmented reality system and monitoring in real time the behaviors and responses of the subject to the therapy. The virtual or augmented reality system may further include audio, and the monitoring of the therapy may be achieved using one or more tracking sensors, such as a camera.

Claims

1. A method for treating or supplementing treatment of a subject with mental or developmental conditions, comprising:

(a) placing the subject in a virtual world using a virtual or augmented reality device that provides visual, auditory, or haptic stimulation;

(b) presenting one or more images or video of the subject'"'"'s virtual or augmented reality experience on a display external to the virtual or augmented reality device, wherein the one or more images or video of the subject'"'"'s virtual or augmented reality experience correspond to one or more images or video presented to the subject in the virtual world;

(c) generating, via one or more sensors operatively coupled to the virtual or augmented reality device, sensory data of the subject in response to the visual, auditory, or haptic stimulation, wherein the sensory data is indicative of the subject'"'"'s progress toward one or more therapeutic goals; and

(d) evaluating at least the subject'"'"'s virtual or augmented reality experience presented on the display and the sensory data to determine the subject'"'"'s progress toward the one or more therapeutic goals.

2. The method of claim 1, wherein the subject is capable of interacting with the virtual world using eye movement, head movement, or one or more controllers attached to a body and/or limb of the subject.

3. The method of claim 1, wherein the subject is capable of interacting with a therapist, parent, or peer to progress toward the one or more therapeutic goals.

4. The method of claim 3, further comprising prescribing the one or more therapeutic goals to the subject.

5. The method of claim 3, wherein the therapist, parent, or peer is located remote from the subject.

6. The method of claim 3, wherein the visual, auditory, or haptic stimulation is provided by the therapist, parent or peer.

7. The method of claim 1, wherein the method is performed without direct supervision of the subject.

8. A method for treating a subject for autism, wherein the subject is or is suspected of being autistic, comprising:

(a) selecting, from a plurality of learning modules, a learning module based at least in part on one or more therapeutic goals for the subject, wherein each of the plurality of learning modules is associated with a respective set of one or more therapeutic goals, and wherein the learning module is configured to present one or more images or video to the subject in a virtual or augmented reality experience;

(b) presenting the virtual or augmented reality experience to the subject using a virtual or augmented reality system, wherein the virtual or augmented reality system comprises a first display screen for presenting the one or more images or video to the subject;

(c) generating, via one or more sensors operatively coupled to the virtual or augmented reality system, sensory data of the subject in response to the one or more images or video, wherein the sensory data is indicative of the subject'"'"'s progress toward the one or more therapeutic goals; and

(d) evaluating at least the sensory data to determine the subject'"'"'s progress toward the one or more therapeutic goals.

9. The method of claim 8, wherein the subject is further presented with audio using the virtual or augmented reality system.

10. The method of claim 8, wherein the one or more sensors comprise at least one of a group consisting of cameras, microphones, motion sensors, heat sensors, inertial sensors, and touch sensors.

11. The method of claim 8, wherein the subject is capable of interacting with the one or more images or video using eye movement, head movement, or one or more controllers attached to a body and/or limb of the subject.

12. The method of claim 8, wherein the subject is capable of interacting with a therapist, parent, or peer to progress toward the one or more therapeutic goals.

13. The method of claim 12, wherein the therapist, parent, or peer is located remote from the subject.

14. The method of claim 12, wherein the one or more images or video is presented by the therapist, parent or peer.

15. The method of claim 8, wherein the evaluating comprises comparing the sensory data to expected data for the one or more therapeutic goals.