MOBILE VIDEO-BASED THERAPY

• US 20140007009A1
• Filed: 08/30/2013
• Published: 01/02/2014
• Est. Priority Date: 04/30/2007
• Status: Abandoned Application

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Robinson, Scott, Kulusky, Ronald L. Jr.
• Application Number:
  US14/015,847
• Publication Number:
  US 20140007009A1
• Time in Patent Office: Days
• US Class Current: 715/810
• CPC Class Codes: A61B 2576/00 Medical imaging apparatus involving image processing or analysis A61B1/00009, A61B6/52 and A61B8/52 take precedence; image processing per se G06T; details of algorithms for analysing medical images G06T7/0012
• CPC Class Codes: A61B 5/0077 Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61H 2201/0142 Beds
• CPC Class Codes: A61H 2201/501 connected to external computer devices or networks
• CPC Class Codes: A61H 2201/5043 Displays
• CPC Class Codes: A61H 2201/5048 Audio interfaces, e.g. voice or music controlled
• CPC Class Codes: A61H 2230/62 Posture
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: G16H 20/30 relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
• CPC Class Codes: G16H 20/70 relating to mental therapies, e.g. psychological therapy or autogenous training
• CPC Class Codes: G16H 30/20 for handling medical images, e.g. DICOM, HL7 or PACS

Abstract

Mobile video-based therapy, using a portable therapy device that includes a camera, a therapy application database, a processor, and a display. The camera is configured to generate images of a user, and the therapy application database is configured to store therapy applications. The processor is configured to select, from the therapy application database, a therapy application appropriate for assisting in physical or cognitive rehabilitation or therapy of the user, to invoke the therapy application, to recognize a gesture of the user from the generated images, and to control the invoked therapy application based on the recognized gesture. The display is configured to display an output of the controlled therapy application.

Claims

1-47. -47. (canceled)

48. A method comprising:

determining, by a computing device, a medical condition of a user;

selecting an application based on the determined medical condition;

wherein determining a medical condition of the user includes;

determining an identity of the user based on performing facial detection and recognition in a captured image from a capture device; and

querying a database that correlates users with medical conditions, using the determined identity.

49. The method of claim 48, further comprising:

recognizing, by the computing device, whether the user possesses a controller based on information from the capture device,

wherein the selecting the application is further based on whether the user possesses the controller.

50. The method of claim 49, wherein selecting the application comprises selecting an application that does not require possession of the controller, if it is not recognized that the user possesses the controller.

51. The method of claim 48, wherein the capture device comprises a camera.

52. The method of claim 48, wherein the application is a therapy application appropriate for assisting in physical or cognitive rehabilitation of the user.

53. The method of claim 48 further comprising:

recognizing a gesture of the user based on the information; and

controlling the application based on the recognized gesture.

54. The method of claim 48, wherein determining a medical condition of the user further includes:

identifying a medical chart, a label, or a medical appliance in the captured image.

55. The method of claim 48, wherein selecting an application includes:

accessing a matrix correlating applications with medical conditions and therapeutic effects;

inputting the determined medical condition or a desired therapeutic effect remedying the determined medical condition into the matrix;

accessing, as an output of the matrix, a set of applications correlating to the determined medical condition or the desired therapeutic effect; and

selecting the application from the accessed set of applications.

56. The method of claim 48, wherein selecting the application includes:

displaying a plurality of icons, each icon representing a candidate application, adjacent to an avatar;

recognizing a gesture of the user based at least in part on the captured image;

controlling the avatar based on the recognized gesture; and

outputting, as the selected application, one of the candidate applications, wherein an icon corresponding to the one candidate application is manipulated by the controlled avatar.

57. The method of claim 56, wherein the plurality of icons correlate to the determined medical condition.

58. A non-transitory computer-readable medium storing instructions that, when executed, cause a computing device to:

determine an identity of a user based on performing facial detection and recognition in a captured image from a capture device;

query a database that correlates users with medical conditions, using the determined identity; and

select an application for the user based on a result of the query.

59. The non-transitory computer-readable medium of claim 58, having additional instructions stored thereon that, when executed, further cause the computing device to:

recognize whether the user possesses a controller based on information from the capture device, wherein the instructions cause the computing device to select the application based further on whether the user possesses the controller.

60. The non-transitory computer-readable medium of claim 59, having additional instructions stored thereon that, when executed, further cause the computing device to:

61. The non-transitory computer-readable medium of claim 58, wherein the capture device comprises a camera.

62. The non-transitory computer-readable medium of claim 58, wherein the application is a therapy application appropriate for assisting in physical or cognitive rehabilitation of the user.

select an application that does not require possession of the controller, if it is not recognized that the user possesses the controller.

63. The non-transitory computer-readable medium of claim 58, having additional instructions stored thereon that, when executed, further cause the computing device to:

recognize a gesture of the user based on the information; and

control the application based on the recognized gesture.

64. An apparatus comprising:

at least one processor; and

memory storing computer-readable instructions that, when executed by the at least one processor, cause the apparatus to;

determine an identity of a user based on performing facial detection and recognition in a captured image from a capture device;

query a database using the determined identity to determine a medical condition of the user, the database correlating users with medical conditions; and

select an application based on the determined medical condition.

65. The apparatus of claim 64, wherein the memory stores additional computer-readable instructions that, when executed by the at least one processor, further cause the apparatus to:

recognize whether the user possesses a controller based on information from the capture device,

wherein the instructions cause the computing device to select the application further based on whether the user possesses the controller.

66. The apparatus of claim 65, wherein the memory stores additional computer-readable instructions that, when executed by the at least one processor, further cause the apparatus to:

select an application that does not require possession of the controller, if it is not recognized that the user possesses the controller.

67. The apparatus of claim 64, wherein the capture device comprises a camera.

68. The apparatus of claim 64, wherein the application is a therapy application appropriate for assisting in physical or cognitive rehabilitation of the user.

69. The apparatus of claim 64 wherein the memory stores additional computer-readable instructions that, when executed by the at least one processor, further cause the apparatus to:

recognize a gesture of the user based on the information; and

control the application based on the recognized gesture.

70. A system comprising:

means for determining a medical condition of a user;

means for selecting an application based on the determined medical condition;

wherein the means for determining a medical condition of the user comprises;

means for determining an identity of the user based on means for performing facial detection and recognition in a captured image from a capture device; and

means for querying a database that correlates users with medical conditions, using the determined identity.

71. The system of claim 70, wherein the capture device comprises a camera.

72. The system of claim 70, wherein the application is a therapy application appropriate for assisting in physical or cognitive rehabilitation of the user.

73. The system of claim 70, further comprising:

means for recognizing a gesture of the user based on information from the capture device; and

means for controlling the application based on the recognized gesture.

74. A system comprising:

means for determining an identity of a user based on performing facial detection and recognition in a captured image from a capture device;

means for querying a database that correlates users with medical conditions, using the determined identity; and

means for selecting an application for the user based on a result of the query.