×

Communication and skills training using interactive virtual humans

  • US 9,978,288 B2
  • Filed: 02/11/2010
  • Issued: 05/22/2018
  • Est. Priority Date: 02/13/2009
  • Status: Active Grant
First Claim
Patent Images

1. A training system for providing a virtual human for training a user, the virtual human comprising an image of a human exhibiting one or more actions, the system comprising:

  • a tangible interface comprising a model of at least a portion of a human and at least one sensor configured to sense a physical interaction between the user and the model;

    an imaging system directed towards the tangible interface and configured to capture images of the user interacting with the tangible interface;

    a tracking system tracking at least one position of the user;

    a microphone capturing speech from the user;

    a simulation system receiving inputs from the tangible interface indicating the sensed physical interaction, the imaging system, the tracking system, and the microphone, wherein the simulation system is configured to process an input from the microphone as communication from the user to the virtual human and generate an output representing one or more actions of the virtual human responding to an interaction as indicated by the communication from the user to the virtual human in combination with the sensed physical interaction such that the output of the simulation system is based on both the sensed physical interaction with the model and the communication representing physical and vocal interaction with a human represented by the virtual human; and

    a display coupled to the simulation system configured to receive the output and display to the user the virtual human exhibiting the one or more actions based on the output, whereby a mixed reality environment is provided.

View all claims
  • 5 Assignments
Timeline View
Assignment View
    ×
    ×