Interactive exercise and training system and method
First Claim
1. A method of spatially projecting a real-world object into a three-dimensional (3D) virtual space, comprising:
- receiving a first control signal from a controller positioned on a user'"'"'s appendage, the controller having an associated virtual reality (VR) head-mounted display (HMD);
based on the first control signal, calibrating the controller to identify an endpoint position of the user'"'"'s appendage with respect to a reference frame in a VR environment;
using the controller as calibrated, receiving one or more second control signals mapping given points of the real-world object surface to points in the reference frame of the VR environment, the given points comprising a surface of the real-world object;
projecting the surface into the 3D virtual space rendered by the VR HMD; and
thereafter, and responsive to interaction between the controller endpoint position and the surface, tracking a user'"'"'s simulated interaction with the real-world object;
wherein the second control signals are generated by touching the controller with respect to first, second and third distinct points on the surface, and storing the location of each such distinct point.
2 Assignments
0 Petitions
Accused Products
Abstract
A virtual reality (VR) system comprising a head-mounted display (HMD) and handheld controller set is enhanced to provide a more realistic end user VR experience, e.g., for boxing or other interactive training. In this approach, and in lieu of simply establishing a boundary area for the VR experience, the user also maps a position of a real-world object into a reference frame of the VR environment. This mapping is facilitated using the handheld controller itself, e.g., as positioned in a backwards-facing manner on the user'"'"'s forearm. The real-world object is then simulated in the 3D VR environment as rendered by the VR HMD, and the user interacts with the real-world object (or its simulation) to provide a more enjoyable and useful interactive experience.
59 Citations
20 Claims
-
1. A method of spatially projecting a real-world object into a three-dimensional (3D) virtual space, comprising:
-
receiving a first control signal from a controller positioned on a user'"'"'s appendage, the controller having an associated virtual reality (VR) head-mounted display (HMD); based on the first control signal, calibrating the controller to identify an endpoint position of the user'"'"'s appendage with respect to a reference frame in a VR environment; using the controller as calibrated, receiving one or more second control signals mapping given points of the real-world object surface to points in the reference frame of the VR environment, the given points comprising a surface of the real-world object; projecting the surface into the 3D virtual space rendered by the VR HMD; and thereafter, and responsive to interaction between the controller endpoint position and the surface, tracking a user'"'"'s simulated interaction with the real-world object; wherein the second control signals are generated by touching the controller with respect to first, second and third distinct points on the surface, and storing the location of each such distinct point. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A method of spatially projecting a real-world object into a three-dimensional (3D) virtual space, comprising:
-
receiving a first control signal from a controller positioned on a user'"'"'s appendage, the controller having an associated virtual reality (VR) head-mounted display (HMD); based on the first control signal, calibrating the controller to identify an endpoint position of the user'"'"'s appendage with respect to a reference frame in a VR environment; using the controller as calibrated, receiving one or more second control signals mapping given points of the real-world object surface to points in the reference frame of the VR environment, the given points comprising a surface of the real-world object; projecting the surface into the 3D virtual space rendered by the VR HMD; and thereafter, and responsive to interaction between the controller endpoint position and the surface, tracking a user'"'"'s simulated interaction with the real-world object; wherein the real-world object is a punching surface or a wall. - View Dependent Claims (7, 8, 9, 10, 11)
-
-
12. A method of spatially projecting a real-world object into a three-dimensional (3D) virtual space, comprising:
-
receiving a first control signal from a controller positioned on a user'"'"'s appendage, the controller having an associated virtual reality (VR) head-mounted display (HMD); based on the first control signal, calibrating the controller to identify an endpoint position of the user'"'"'s appendage with respect to a reference frame in a VR environment; using the controller as calibrated, receiving one or more second control signals mapping given points of the real-world object surface to points in the reference frame of the VR environment, the given points comprising a surface of the real-world object; projecting the surface into the 3D virtual space rendered by the VR HMD; simulating a virtual opponent within the VR environment, the opponent holding an element configured for striking, the element aligned with the surface; and thereafter, and responsive to interaction between the controller endpoint position and the surface, tracking a user'"'"'s simulated interaction with the real-world object. - View Dependent Claims (13, 14, 15)
-
-
16. A method of spatially projecting a real-world object into a three-dimensional (3D) virtual space, comprising:
-
receiving a first control signal from a controller positioned on a user'"'"'s appendage, the controller having an associated virtual reality (VR) head-mounted display (HMD); based on the first control signal, calibrating the controller to identify an endpoint position of the user'"'"'s appendage with respect to a reference frame in a VR environment; receiving additional control signals defining a boundary area for the VR environment; using the controller as calibrated, receiving one or more second control signals mapping given points of the real-world object surface to points in the reference frame of the VR environment, the given points comprising a surface of the real-world object; projecting the surface into the 3D virtual space rendered by the VR HMD; and thereafter, and responsive to interaction between the controller endpoint position and the surface, tracking a user'"'"'s simulated interaction with the real-world object. - View Dependent Claims (17, 18, 19, 20)
-
Specification