PASSIVE OPTICAL AND INERTIAL TRACKING IN SLIM FORM-FACTOR
First Claim
1. In a virtual or augmented reality environment that includes a display and a main processor, a wireless hand-held controller for providing one or more user inputs to the main processor, the hand-held controller comprising:
- a stylus having a first end, a second end and an elongate middle portion between the first end and the second end, the stylus also including a first optically reflective marker at or proximate the first end and a second optically reflective marker at or proximate the second end; and
the elongate middle portion enclosing a microcontroller, an inertial measurement unit (IMU), a communications radio and one or more buttons configured and positioned for selective actuation with a finger or thumb of a user, the inertial measurement unit tracking orientation of the hand-held controller in three dimensional space relative to a predetermined frame of reference and providing orientation and acceleration data to the microcontroller, and the communications radio providing wireless communications between the microcontroller and the main processor so as to provide orientation data and user inputs derived from selective activation by the user of the one or more buttons.
1 Assignment
0 Petitions
Accused Products
Abstract
Apparatus and systems directed to a wireless hand-held inertial controller with passive optical and inertial tracking in a slim form-factor, for use with a head mounted virtual or augmented reality display device (HMD), that operates with six degrees of freedom by fusing (i) data related to the position of the controller derived from a forward-facing optical sensor located in the HMD with (ii) data relating to the orientation of the controller derived from an inertial measurement unit located in the controller.
51 Citations
20 Claims
-
1. In a virtual or augmented reality environment that includes a display and a main processor, a wireless hand-held controller for providing one or more user inputs to the main processor, the hand-held controller comprising:
-
a stylus having a first end, a second end and an elongate middle portion between the first end and the second end, the stylus also including a first optically reflective marker at or proximate the first end and a second optically reflective marker at or proximate the second end; and the elongate middle portion enclosing a microcontroller, an inertial measurement unit (IMU), a communications radio and one or more buttons configured and positioned for selective actuation with a finger or thumb of a user, the inertial measurement unit tracking orientation of the hand-held controller in three dimensional space relative to a predetermined frame of reference and providing orientation and acceleration data to the microcontroller, and the communications radio providing wireless communications between the microcontroller and the main processor so as to provide orientation data and user inputs derived from selective activation by the user of the one or more buttons. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. A system comprising:
-
a head mounted display (HMD) device having a processor; a wireless hand-held inertial controller configured to communicate with the processor to selectively provide one or more user inputs, the hand-held inertial controller comprising; a stylus having a first end, a second end and an elongate middle portion between the first end and the second end, the stylus also including a first optically reflective marker at or proximate the first end and a second optically reflective marker at or proximate the second end; the elongate middle portion enclosing a microcontroller, an inertial measurement unit (IMU), a communications radio and one or more buttons configured and positioned for selective actuation with a finger or thumb of a user, the inertial measurement unit tracking orientation of the hand-held inertial controller in three dimensional space relative to a predetermined frame of reference and providing orientation and acceleration data to the microcontroller, and the communications radio providing wireless communications so as to provide orientation data and user inputs to the processor; and an optical sensor located on the display for determining the position of each of the first and second optically reflective markers relative to the display and for providing position data to the processor, and wherein the processor uses the orientation data and the position data to track the hand-held inertial controller within three dimensional space with six degrees of freedom. - View Dependent Claims (8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20)
-
Specification