SYSTEM AND METHOD FOR THREE-DIMENSIONAL AUGMENTED REALITY GUIDANCE FOR USE OF EQUIPMENT
First Claim
Patent Images
1. A method for providing real-time, three-dimensional (3D) augmented reality (AR) feedback guidance to a user of an equipment system, the method comprising:
- receiving data from an equipment system during an equipment procedure performed by a user of the equipment system to achieve an equipment procedure outcome;
sensing real-time user positioning data relating to one or more of the three-dimensional movement, position, and orientation of at least a portion of the equipment system within a volume of the user'"'"'s environment during the equipment procedure performed by the user;
retrieving from a library at least one of
1) stored reference positioning data relating to one or more of the three-dimensional movement, position, and orientation of at least a portion of the equipment system during a reference equipment procedure, and
2) stored reference outcome data relating to an outcome of said reference equipment procedure;
comparing at least one of
1) the sensed real-time user positioning data to the retrieved reference positioning data, and
2) the data received from the equipment system during the equipment procedure performed by the user to the retrieved reference outcome data;
generating at least one of
1) real-time position-based 3D AR feedback based on the comparison of the sensed real-time user positioning data to the retrieved reference positioning data, and
2) real-time outcome-based 3D AR feedback based on the comparison of the data received from the equipment system during an equipment procedure performed by the user to the retrieved reference outcome data; and
providing at least one of the real-time position-based 3D AR feedback and the real-time outcome-based 3D AR feedback to the user via an augmented reality user interface (ARUI).
2 Assignments
0 Petitions
Accused Products
Abstract
Methods for providing real-time, three-dimensional (3D) augmented reality (AR) feedback guidance to a user of an equipment system to achieve improved diagnostic or treatment outcomes.
-
Citations
20 Claims
-
1. A method for providing real-time, three-dimensional (3D) augmented reality (AR) feedback guidance to a user of an equipment system, the method comprising:
-
receiving data from an equipment system during an equipment procedure performed by a user of the equipment system to achieve an equipment procedure outcome; sensing real-time user positioning data relating to one or more of the three-dimensional movement, position, and orientation of at least a portion of the equipment system within a volume of the user'"'"'s environment during the equipment procedure performed by the user; retrieving from a library at least one of
1) stored reference positioning data relating to one or more of the three-dimensional movement, position, and orientation of at least a portion of the equipment system during a reference equipment procedure, and
2) stored reference outcome data relating to an outcome of said reference equipment procedure;comparing at least one of
1) the sensed real-time user positioning data to the retrieved reference positioning data, and
2) the data received from the equipment system during the equipment procedure performed by the user to the retrieved reference outcome data;generating at least one of
1) real-time position-based 3D AR feedback based on the comparison of the sensed real-time user positioning data to the retrieved reference positioning data, and
2) real-time outcome-based 3D AR feedback based on the comparison of the data received from the equipment system during an equipment procedure performed by the user to the retrieved reference outcome data; andproviding at least one of the real-time position-based 3D AR feedback and the real-time outcome-based 3D AR feedback to the user via an augmented reality user interface (ARUI). - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A method for providing real-time, three-dimensional (3D) augmented reality (AR) feedback guidance to a user of an equipment system, the method comprising:
-
receiving data from an equipment system during an equipment procedure performed by a user of the equipment system to achieve an equipment procedure outcome; sensing real-time user positioning data relating to one or more of the three-dimensional movement, position, and orientation of at least a portion of the equipment system within a volume of the user'"'"'s environment during the equipment procedure performed by the user, wherein the sensing comprises sensing at least one of
1) a magnetic field generated by said at least a portion of the equipment system;
2) the movement of one or more passive visual markers coupled to one or more of the user and a portion of the equipment system; and
3) the movement of one or more active visual markers coupled to one or more of the user and a portion of the equipment system;retrieving from a library
1) stored reference positioning data relating to one or more of the three-dimensional movement, position, and orientation of at least a portion of the equipment system during a reference equipment procedure, and
2) stored reference outcome data relating to an outcome of said reference equipment procedure;comparing
1) the sensed real-time user positioning data to the retrieved reference positioning data, and
2) the data received from the equipment system during the equipment procedure performed by the user to the retrieved reference outcome data;generating real-time position-based 3D AR feedback based on the comparison of the sensed real-time user positioning data to the retrieved reference positioning data; generating real-time outcome-based 3D AR feedback based on the comparison of the data received from the equipment system during the equipment procedure performed by the user to the retrieved reference outcome data; and providing each of the real-time position-based 3D AR feedback and the real-time outcome-based 3D AR feedback to the user via an augmented reality user interface (ARUI), wherein providing at least one of the real-time position-based 3D AR feedback and the real-time outcome-based 3D AR feedback to the user comprises providing a feedback selected from
1) a virtual prompt indicating a movement correction to be performed by the user;
2) a virtual image or video instructing the user to change the orientation of the at least a portion of the equipment system to match a desired orientation;
3) a virtual image or video of a correct motion path to be taken by the user in performing the equipment procedure;
4) a color-coded image or video indicating one or more correct portions of the user'"'"'s motion in performing the equipment procedure;
5) a color-coded image or video indicating one or more incorrect portions of the user'"'"'s motion in performing the equipment procedure;
6) an auditory instruction, virtual image, or virtual video indicating a direction for the user to move at least a portion of the equipment system; and
7) tactile information. - View Dependent Claims (14, 15, 16, 17, 18)
-
-
19. A method for providing real-time, three-dimensional (3D) augmented reality (AR) feedback guidance to a user of an equipment system, the method comprising:
-
receiving data from an equipment system during an equipment procedure performed by a user of the equipment system to achieve an equipment system outcome; sensing real-time user positioning data relating to one or more of the three-dimensional movement, position, and orientation of at least a portion of the equipment system within a volume of the user'"'"'s environment during the equipment procedure performed by the user; retrieving from a library at least one of
1) stored reference positioning data relating to one or more of the three-dimensional movement, position, and orientation of at least a portion of the equipment system during a reference equipment procedure, and
2) stored reference outcome data relating to an outcome of said reference equipment procedure;comparing at least one of
1) the sensed real-time user positioning data to the retrieved reference positioning data, and
2) the data received from the equipment system during the equipment procedure performed by the user to the retrieved reference outcome data;generating real-time position-based 3D AR feedback based on the comparison of the sensed real-time user positioning data to the retrieved reference positioning data; generating real-time outcome-based 3D AR feedback based on the comparison of the data received from the equipment system during the equipment procedure performed by the user to the retrieved reference outcome data; and providing each of the real-time position-based 3D AR feedback and the real-time outcome-based 3D AR feedback to a head mounted display (HMD) worn by the user via an augmented reality user interface (ARUI). - View Dependent Claims (20)
-
Specification