Gaming device with volumetric sensing
First Claim
1. A method for detecting a hand of a user relative to a pad device, comprising:
- sensing a disrupted portion of ultrasonic energy, when disrupted, by a plurality of ultrasonic sensors integrated within the pad device and arranged in an array, wherein the disrupted portion of ultrasonic energy is sensed when the hand of the user is placed proximate to the pad device, wherein the plurality of ultrasonic sensors that sense the disrupted portion of ultrasonic energy produce a plurality of electrical signals for identifying a current position and an orientation of the hand based on distances and angles in three-dimensions of the hand with respect to a reference co-ordinate system originating from the pad device;
repeating the sensing continuously to produce an additional plurality of electrical signals, the additional plurality of electrical signals produced for identifying changes in the position and the orientation of the hand while the sensing is being repeated; and
communicating the plurality of electrical signals and the additional plurality of electrical signals to a processor for processing each of the electrical signals to produce a model of the hand and movement of the model of the hand, wherein the movement of the model of the hand is based on the changes in the position and the orientation of the hand, wherein the model of the hand is at least partially rendered as a virtual hand in a virtual environment.
2 Assignments
0 Petitions
Accused Products
Abstract
A method for enhancing detection of a user'"'"'s hand relative to a head-mounted display (HMD) is described. The method includes sensing a disrupted portion of energy by sensors integrated within a pad device. The disrupted portion of the energy is generated when the hand of the user interferes with the energy. The plurality of sensors that sense the disrupted portion of the energy produce an energy image that mirrors a current position of the hand. The method includes repeating the sensing continuously to produce a stream of energy images. The method includes communicating the stream of energy images to a game console for processing each of the energy images to produce a model of the hand and movement of the model of the hand. The model of the hand is at least partially rendered as a virtual hand in a virtual environment that is displayed in the HMD.
-
Citations
23 Claims
-
1. A method for detecting a hand of a user relative to a pad device, comprising:
-
sensing a disrupted portion of ultrasonic energy, when disrupted, by a plurality of ultrasonic sensors integrated within the pad device and arranged in an array, wherein the disrupted portion of ultrasonic energy is sensed when the hand of the user is placed proximate to the pad device, wherein the plurality of ultrasonic sensors that sense the disrupted portion of ultrasonic energy produce a plurality of electrical signals for identifying a current position and an orientation of the hand based on distances and angles in three-dimensions of the hand with respect to a reference co-ordinate system originating from the pad device; repeating the sensing continuously to produce an additional plurality of electrical signals, the additional plurality of electrical signals produced for identifying changes in the position and the orientation of the hand while the sensing is being repeated; and communicating the plurality of electrical signals and the additional plurality of electrical signals to a processor for processing each of the electrical signals to produce a model of the hand and movement of the model of the hand, wherein the movement of the model of the hand is based on the changes in the position and the orientation of the hand, wherein the model of the hand is at least partially rendered as a virtual hand in a virtual environment. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18)
-
-
19. A pad device for enhancing detection of a hand of a user relative to a display device, comprising:
-
a plurality of ultrasonic emitters configured to emit ultrasonic energy, the ultrasonic emitters integrated within the pad device; a plurality of ultrasonic sensors for sensing a disrupted portion of the ultrasonic energy, the ultrasonic sensors arranged in an array on a surface of the pad device, wherein the disrupted portion of the ultrasonic energy is sensed when the hand of the user is placed proximate to the pad device, wherein the ultrasonic sensors are configured to sense the disrupted portion of the ultrasonic energy for producing a plurality of electrical signals for identifying a current position and an orientation of the hand based on distances and angles in three-dimensions of the hand with respect to a reference co-ordinate system originating from the pad device, wherein the ultrasonic sensors are further configured to sense continuously to produce an additional plurality of electrical signals, the additional plurality of electrical signals produced for identifying changes in the position and the orientation of the hand while the sensing is performed continuously; and a communication device coupled to the ultrasonic sensors, the communication device for communicating the plurality of electrical signals and the additional plurality of electrical signals to a processor for processing each of the electrical signals to produce a model of the hand and movement of the model of the hand, wherein the movement of the model of the hand is based on the changes in the position and the orientation of the hand, wherein the model of the hand is at least partially rendered as a virtual hand in a virtual environment that is displayed on the display device. - View Dependent Claims (20)
-
-
21. A system comprising:
-
a pad device including; a plurality of infrared light sensors located on a surface of the pad device for receiving an infrared light portion upon interaction of a body part with the infrared light that is emitted, wherein the sensors are configured to generate a plurality of electrical signals from the infrared light portion by sensing the infrared light portion when the body part is at a current position, wherein the infrared light sensors are further configured to repeat the sensing continuously to produce an additional plurality of electrical signals, the additional plurality of electrical signals showing changes of the current position of the body part while the sensing is being repeated; a pad communication device coupled to the infrared light sensors for communicating the plurality of electrical signals and the additional plurality of electrical signals; a game console coupled to the pad device, the game console including; a game communication device coupled to the pad communication device for receiving the plurality of electrical signals and the additional plurality of electrical signals from the pad communication device; a game processor coupled to the game communication device for determining a movement of the body part based on the plurality of electrical signals and the additional plurality of electrical signals, wherein the game processor is for determining a state of a virtual object in a virtual environment based on the movement of the body part, wherein the game communication device is for sending data regarding the state of the virtual object; and a head-mounted display (HMD) coupled to the game console, the HMD comprising; an HMD communication device coupled to the game communication device for receiving the data regarding the state of the virtual object from the game communication device; a processor coupled to the HMD communication device for displaying the virtual object having the state in an image. - View Dependent Claims (22, 23)
-
Specification