HEAD-MOUNTED DISPLAY BASED EDUCATION AND INSTRUCTION

• US 20130137076A1
• Filed: 11/30/2011
• Published: 05/30/2013
• Est. Priority Date: 11/30/2011
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Perez, Kathryn Stone, Geisner, Kevin A., Sugden, Ben J., McCulloch, Daniel J., Clavin, John
• Application Number:
  US13/308,218
• Publication Number:
  US 20130137076A1
• Time in Patent Office: Days
• US Class Current: 434/308
• CPC Class Codes: G09B 5/06 with both visual and audible presentation of the material to be studied
• CPC Class Codes: G09B 5/067 Combinations of audio and projected visual presentation, e.g. film, slides
• CPC Class Codes: G09B 5/08 providing for individual presentation of information to a plurality of student stations
• CPC Class Codes: G09B 5/14 with provision for individual teacher-student communication
• CPC Class Codes: G09B 9/307 by helmet-mounted projector or display G09B9/36 takes precedence; optical parts of head-up displays G02B27/01

Abstract

Technology disclosed herein provides for use of HMDs in a classroom setting. Technology disclosed herein provides for HMD use for holographic instruction. In one embodiment, the HMD is used for social coaching. User profile information may be used to tailor instruction to a specific user based on known skills, learning styles, and/or characteristics. One or more individuals may be monitored based on sensor data. The sensor data may come from an HMD. The monitoring may be analyzed to determine how to enhance an experience. The experience may be enhanced by presenting an image in at least one head mounted display worn by the one or more individuals.

Claims

1. A method comprising:

monitoring one or more individuals engaged in an experience, the monitoring is based on sensor data from one or more sensors;

analyzing the monitoring to determine how to enhance the experience; and

enhancing the experience based on the analyzing, the enhancing includes presenting a signal to at least one see-through head mounted display worn by the one or more individuals.

2. The method of claim 1, wherein the monitoring, the analyzing, and the enhancing include:

detecting an eye gaze of a teacher using at least one of the sensors, the at least one sensor is part of a see-through HMD worn by the teacher;

determining which of the one or more individuals the teacher is gazing at;

determining information regarding the individual the teacher is gazing at; and

providing the information to a see-through HMD worn by the teacher.

3. The method of claim 2, wherein the monitoring, the analyzing, and the providing include:

collecting biometric information about the individual the teacher is gazing at using at least one of the sensors;

determining success, comprehension and/or attention of the individual the teacher is gazing at based on the biometric information; and

reporting the success, comprehension and/or the attention of individual the teacher is gazing in the see-through HMD worn by the teacher.

4. The method of claim 1, wherein the monitoring, analyzing and the enhancing include:

tracking a first of the individual'"'"'s efforts to solve a problem;

determining correctness of the individual'"'"'s efforts to solve the problem; and

providing one more images in a see-through HMD that is worn by the first individual to provide assistance in solving the problem.

5. The method of claim 1, wherein the monitoring, the analyzing, and the enhancing include:

tracking a first of the individual'"'"'s efforts to perform a task or process;

determining feedback to improve performance of the task or process; and

providing the feedback to a see-through HMD that is worn by the first individual.

6. The method of claim 5, wherein the feedback is a holographic image.

7. The method of claim 1, wherein the monitoring, the analyzing, and the enhancing include:

monitoring a first of the individual'"'"'s performance;

analyzing the performance based on a set of instructions or a model; and

providing holographic instructions in a see-through HMD worn by the first individual to improve the individual'"'"'s performance.

8. The method of claim 1, further comprising:

accessing a profile for a first of the one or more individuals from a data store, the enhancing includes tailoring educational instruction to the first individual based on the profile.

9. The method of claim 1, wherein the monitoring, the analyzing, and the enhancing include:

tracking interactions of a first of the one or more individuals with others;

determining a suitable prompt for the first individual to enhance social interaction; and

displaying the prompt on a see-through HMD worn by the first individual.

10. A system for enhancing education or instruction, the system comprising:

a processor; and

a processor readable storage device coupled to the processor, the processor readable storage device having stored thereon instructions which, when executed on the processor cause the processor to;

receive sensor data from at least one head mounted display;

monitor one or more individuals based on the sensor data;

analyze the monitoring to determine how to enhance an educational or instructional experience engaged in by the one or more individuals; and

provide a signal to enhance the educational or instructional experience based on the analyzing.

11. The system of claim 10, wherein the instructions that cause the processor to monitor, analyze, and provide cause the processor to:

detect an eye gaze of the teacher based on the sensor data, the sensor data includes sensor data from a see-through HMD worn by the teacher;

determine which of the one or more individuals the teacher is gazing at;

determine information regarding the individual the teacher is gazing at; and

provide the information to the see-through HMD worn by the teacher.

12. The system of claim 10, wherein the instructions that cause the processor to monitor, analyze, and provide cause the processor to:

monitor a first of the individual'"'"'s performance;

analyze the performance based on a set of instructions or a model; and

provide holographic instructions in a see-through HMD worn by the first individual to improve the first individual'"'"'s performance.

13. The system of claim 10, further comprising:

a see-through head mounted display, the processor provides images to the see-through head mounted display to enhance the educational or instructional experience.

14. The system of claim 10, wherein the instructions that cause the processor to monitor, analyze, and provide cause the processor to:

track interactions of a first of the one or more individuals with others;

determine a suitable prompt for the first individual to enhance social interaction; and

provide the prompt to a see-through HMD worn by the first individual.

15. A processor readable storage device having stored thereon instructions which, when executed on a processor cause the processor to perform the steps of:

accessing sensor data;

processing the sensor data to determine information indicative of performance of an individual;

analyzing the information indicative of performance of the individual to determine how to instruct the individual; and

providing a signal in a see-through head mounted display worn by the individual to instruct the individual.

16. The processor readable storage device of claim 15, wherein the analyzing and the providing include:

determining correctness of a solution to a problem being solved by the individual; and

providing one more images in the see-through HMD that is worn by the individual to provide assistance in solving the problem.

17. The processor readable storage device of claim 15, wherein the analyzing includes analyzing emotions on the individual'"'"'s face to determine a level of comprehension.

18. The processor readable storage device of claim 15, further comprising:

building a record based on the individual'"'"'s past performance, the analyzing to determine how to instruct the individual is based on the information indicative of performance of the individual and the record.

19. The processor readable storage device of claim 15, further comprising:

accessing a set of instructions, solution, or model for performance, the analyzing to instruct the individual is based on the information indicative of performance of the individual and the set of instructions, solution, or model for performance.

20. The processor readable storage device of claim 15, wherein the providing an image in a see-through head mounted display worn by the individual to instruct the individual includes:

providing a holographic image that the individual can view from different perspectives by moving either a virtual object or moving their vantage point.