Interactive virtual characters for training including medical diagnosis training
First Claim
1. An interactive training system, comprising:
- computer vision including at least one video camera for obtaining trainee image data;
a processor providing pattern recognition and image understanding algorithms to recognize features present in said trainee image data to detect gestures of said trainee;
graphics coupled to a display device for rendering images of at least one virtual individual, said display device viewable by said trainee, and a computer receiving said trainee image data or said gestures of said trainee, said computer implementing an interaction algorithm, an output of said interaction algorithm providing data to said graphics, said output data moving said virtual individual to provide dynamically alterable images of said virtual individual responsive to said trainee image data or said gestures of said trainee.
1 Assignment
0 Petitions
Accused Products
Abstract
An interactive training system includes computer vision provided by at least one video camera for obtaining trainee image data, and pattern recognition and image understanding algorithms to recognize features present in the trainee image data to detect gestures of the trainee. Graphics coupled to a display device is provide for rendering images of at least one virtual individual. The display device is viewable by the trainee. A computer receives the trainee image data or gestures of the trainee, and optionally the voice of the trainee, and implements an interaction algorithm. An output of the interaction algorithm provides data to the graphics and moves the virtual character to provide dynamically alterable images of the virtual character, as well as well as an optional virtual voice. The virtual individual can be a medical patient, where the trainee practices diagnosis on the patient.
97 Citations
15 Claims
-
1. An interactive training system, comprising:
-
computer vision including at least one video camera for obtaining trainee image data;
a processor providing pattern recognition and image understanding algorithms to recognize features present in said trainee image data to detect gestures of said trainee;
graphics coupled to a display device for rendering images of at least one virtual individual, said display device viewable by said trainee, and a computer receiving said trainee image data or said gestures of said trainee, said computer implementing an interaction algorithm, an output of said interaction algorithm providing data to said graphics, said output data moving said virtual individual to provide dynamically alterable images of said virtual individual responsive to said trainee image data or said gestures of said trainee. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A method of interactive training, comprising the steps of:
-
obtaining trainee image data of a trainee using computer vision and trainee speech data from said trainee using speech recognition, recognizing features present in said trainee image data to detect gestures of said trainee, and rendering dynamically alterable images of at least one virtual individual, said dynamically alterable images viewable by said trainee, wherein said dynamically alterable images are rendered responsive to said trainee speech and said trainee image data or said gestures of said trainee. - View Dependent Claims (10, 11, 12, 13, 14, 15)
-
Specification