Identification and analysis of movement using sensor devices

• US 11,030,918 B2
• Filed: 10/13/2015
• Issued: 06/08/2021
• Est. Priority Date: 09/10/2015
• Status: Active Grant

• Current Assignee: Kinetic Telemetry, LLC
• Original Assignee: Kinetic Telemetry, LLC
• Inventors: Wallach, David Alan, Welcher, Brian E., Gantt, Miles, Carnahan, Kyle
• Primary Examiner(s): Thai, Xuan M
• Assistant Examiner(s): Zaman, Sadaruz
• Application Number:
  US14/881,499
• Publication Number:
  US 20170076619A1
• Time in Patent Office: 2,065 Days
• Field of Search: 434247
• CPC Class Codes: A63B 24/0003 Analysing the course of a movement or motion sequences during an exercise or trainings sequence, e.g. swing for golf or tennis
• CPC Class Codes: G09B 19/0038 Sports

Abstract

Disclosed are various embodiments for using sensor devices that include accelerometers and gyroscopes to detect and monitor movement of a body. The sensor devices may be coupled to a body in a predefined arrangement, where a sensor device is positioned on a particular portion of the body in accordance with the predefined arrangement. The sensor devices measure a position of the portion of the body to which the band is secured during movement and communicate the position to a client device to be used in generating and updating a three-dimensional reconstruction of the movement performed in near-real-time. Further, the client device may determine whether the movement performed conforms to a predefined movement and, in response to the movement not conforming to the predefined movement, a suggested change in the movement is identified that, if performed, would conform to the predefined movement.

Claims

1. A system for telemedicine between a patient and a remotely-located medical professional, comprising:

a plurality of sensor devices in data communication with a client device, the client device comprising at least one hardware processor, wherein individual ones of the sensor devices comprise;

a band to secure a respective one of the sensor devices to a portion of a body of a patient, the respective one of the sensor devices being secured to the portion of the body of the patient based at least in part on a predefined arrangement of sensor devices stored in a memory of the client device;

circuitry comprising an accelerometer and a gyroscope that measures a position of the portion of the body of the patient to which the band is secured during a movement performed by the portion of the body of the patient; and

the client device; and

an application executed in the client device, the application comprising program instructions that, when executed, direct the client device to;

establish a telemedicine session between the client device and a remote computing device operated by a medical professional located remotely from the patient;

render a first three-dimensional graphical model of the body of the patient for viewing in a display accessible to the client device;

receive from the remote computing device an indication of a movement to be performed, the movement to be performed being assigned by the medical professional;

access sensor data measured by the plurality of sensor devices, the sensor data comprising the position of the portion of the body of the patient during the movement;

update the first three-dimensional graphical model of the body of the patient in the display using the sensor data to further comprise the movement;

receive, from the remote computing device, ideal sensor data comprising a position of a portion of a body of the medical professional during an ideal body movement performed by the portion of the body of the medical professional, the ideal sensor data being generated by at least one sensor device secured to the portion of the body of the medical professional during the ideal body movement and stored in a data store of the remote computing device;

render a second three-dimensional graphical model of the body of the medical professional in the display based at least in part on the ideal sensor data, the second three-dimensional graphical model comprising the ideal body movement;

determine whether the movement conforms to the ideal body movement based at least in part on a difference between a position of at least one sensor device of the plurality of sensor devices from the sensor data and a position of the at least one sensor device secured to the portion of the body of the medical professional from the ideal sensor data at a given time exceeding a predefined threshold;

in response to the movement not conforming to the ideal body movement, identify a suggested change in the movement that conforms to the ideal body movement;

send a communication to the remote computing device, the communication comprising an indication that the movement does not conform to the ideal body movement; and

render an indication of the suggested change in the movement in the display.

2. The system of claim 1, wherein the circuitry that measures the position of the portion of the body of the patient to which the band is secured further comprises a magnetometer.

3. The system of claim 2, wherein at least one of the sensor devices comprises a master sensor device and other ones of the sensor devices comprise a plurality of slave sensor devices, the master sensor device being configured to obtain the sensor data from the slave sensor devices and communicate the sensor data to the client device via a communication module.

4. The system of claim 1, wherein the program instructions, when executed, further direct the client device to communicate the sensor data to a server computing device over a network for remote processing.

5. The system of claim 1, wherein the sensor devices are configured to communicate the sensor data to the client device asynchronously.

19. The system of claim 1, wherein the first three-dimensional graphical model of the body of the patient and the second three-dimensional graphical model of the body of the medical professional are rendered side-by-side in the display.

20. The system of claim 1, wherein the second three-dimensional graphical model of the body of the medical professional is rendered as an overlay on the first three-dimensional graphical model of the body of the patient in the display.

6. A system for telemedicine between a patient and a remotely-located medical professional comprising:

a plurality of sensor devices in data communication with a client device, the client device comprising at least one hardware processor, wherein individual ones of the sensor devices comprise;

a band to secure a respective one of the sensor devices to a portion of a body of a patient, the respective one of the sensor devices being secured to the portion of the body of the patient based at least in part on a predefined arrangement of sensor devices stored in a memory of the client device;

circuitry comprising an accelerometer and a gyroscope that measures a position of the portion of the body of the patient to which the band is secured during a movement performed by the portion of the body of the patient; and

an application executed in a remote computing device in data communication with the client device over a network, the application comprising logic that;

establishes a telemedicine session between the client device and a remote computing device operated by a medical professional located remotely from the patient;

generates a first three-dimensional graphical model of the body of the patient;

accesses sensor data measured by the plurality of sensor devices received from the client device over the network, the sensor data comprising the position of the portion of the body of the patient during the movement;

updates the first three-dimensional graphical model of the body of the patient using the sensor data to further comprise the movement;

receives, from the remote computing device operated by the medical professional, ideal sensor data comprising a position of a portion of a body of the medical professional during an ideal body movement, the ideal sensor data being generated by at least one sensor device secured to the portion of the body of the medical professional and stored in a data store of the remote computing device;

generates a second three-dimensional graphical model of the body of the medical professional based at least in part on the ideal sensor data, the second three-dimensional graphical model comprising the ideal body movement;

determines whether the movement conforms to the ideal body movement based at least in part on a difference between a position of at least one sensor device of the plurality of sensor devices from the sensor data and a position of the at least one sensor device secured to the portion of the body of the medical professional from the ideal sensor data at a given time exceeding a predefined threshold;

in response to the movement not conforming to the ideal body movement, identifies a suggested change in the movement that conforms to the ideal body movement;

sends a communication to the remote computing device, the communication comprising an indication that the movement does not conform to the ideal body movement; and

causes transmission of the first three-dimensional graphical model of the body of the patient, the second three-dimensional graphical model, and the suggested change in the movement to the remote computing device for rendering in a display.

7. The system of claim 6, wherein the circuitry that measures the position of the portion of the body of the patient to which the band is secured further comprises a magnetometer.

8. The system of claim 6, wherein at least one of the sensor devices comprises a master sensor device and other ones of the sensor devices comprising a plurality of slave sensor devices, the master sensor device being configured to obtain the sensor data from the slave sensor devices and communicate the sensor data to the client device via a communication module.

9. The system of claim 6, wherein the application further comprises logic that communicates the sensor data to a server computing device over a network for remote processing.

10. The system of claim 6, wherein the sensor devices are configured to communicate the sensor data to the client device asynchronously.

17. The system of claim 6, wherein the accelerometer is a first accelerometer, and the circuitry that measures the position of the portion of the body of the patient to which the band is secured further comprises a second accelerometer and a third accelerometer.

18. The system of claim 6, wherein the gyroscope is a first gyroscope, and the circuitry that measures the position of the portion of the body of the patient to which the band is secured further comprises a second gyroscope and a third gyroscope.

11. A computer-implemented method for telemedicine between a patient and a remotely-located medical professional, comprising:

establishing, by at least one computing device comprising at least one hardware processor, a telemedicine session between the at least one computing device and a remote computing device operated by a medical professional located remotely from a patient operating the at least one computing device;

generating, by the at least one computing device, a first three-dimensional graphical model of a body of the patient;

receiving, by the at least one computing device, an indication of a movement to be performed from the remote computing device, the movement to be performed being assigned by the medical professional;

accessing, by the at least one computing device, sensor data obtained by a plurality of sensor devices, wherein individual ones of the sensor devices comprise;

a band to secure a respective one of the sensor devices to a portion of a body of the patient, the respective one of the sensor devices being secured to the portion of the body of the patient based at least in part on a predefined arrangement of sensor devices stored in a memory of the at least one computing device; and

circuitry comprising an accelerometer and a gyroscope that measures a position of the portion of the body of the patient to which the band is secured during a movement performed by the portion of the body of the patient;

updating, by the at least one computing device, the first three-dimensional graphical model of the body of the patient using the sensor data to further comprise the movement performed;

receiving, by the at least one computing device, predefined sensor data from the remote computing device, ideal sensor data comprising a position of a portion of a body of the medical professional during an ideal body movement performed by the portion of the body of the medical professional, the predefined sensor data being generated by at least one sensor device secured to the portion of the body of the medical professional and stored in a data store of the remote computing device;

generating, by the at least one computing device, a second three-dimensional graphical model of the body of the medical professional based at least in part on the ideal sensor data, the second three-dimensional graphical model comprising the ideal body movement;

determining whether the movement conforms to the ideal body movement based at least in part on a difference between a position of at least one sensor device of the plurality of sensor devices from the sensor data and a position of the at least one sensor device secured to the portion of the body of the medical professional from the predefined sensor data at a given time exceeding a predefined threshold;

in response to the movement not conforming to the ideal body movement, identifying a suggested change in the movement that conforms to the ideal body movement;

sending, by the at least one computing device, a communication to the remote computing device, the communication comprising an indication that the movement does not conform to the ideal body movement; and

causing the first three-dimensional graphical model of the body, the second three-dimensional graphical model, and the suggested change in the movement to be rendered in a display.

12. The method of claim 11, wherein the circuitry that measures the position of the portion of the body of the patient to which the band is secured further comprises a magnetometer.

13. The method of claim 12, wherein at least one of the sensor devices comprises a master sensor device and other ones of the sensor devices comprising a plurality of slave sensor devices, the master sensor device being configured to obtain the sensor data from the slave sensor devices and communicate the sensor data to a client device via a communication module.

14. The method of claim 13, wherein the communication module further comprises a BLUETOOTH®

module, a BLUETOOTH®

low-energy module, a ZIGBEE®

module, or a near field communication (NFC) module.

15. The method of claim 11, further comprising causing, by the at least one computing device, transmission of the sensor data to a server computing device over a network for remote processing.

16. The method of claim 11, wherein the predefined arrangement further comprises:

a first one of the sensor devices being located at a first shoulder of the body;

a second one of the sensor devices being located at a second shoulder of the body;

a third one of the sensor devices being located at a first elbow of the body;

a fourth one of the sensor devices being located at a second elbow of the body;

a fifth one of the sensor devices being located at a first wrist of the body;

a sixth one of the sensor devices being located at a second wrist of the body;

a seventh one of the sensor devices being located at a first knee of the body;

an eighth one of the sensor devices being located at a second knee of the body;

a ninth one of the sensor devices being located at a first ankle of the body;

a tenth one of the sensor devices being located at a second ankle of the body;

an eleventh one of the sensor devices being located at a first side of hips of the body; and

a twelfth one of the sensor devices being located at a second side of hips of the body.