Method and system for making a selection in 3D virtual environment
First Claim
1. A system for a user to select a portion of a 3D virtual environment being displayed, the system comprising:
- a controller including a plurality of inertia sensors providing sensor signals sufficient to derive changes in motion of the controller in six degrees of freedom;
a processing unit, receiving the sensor signals, configured to derive position and orientation of the controller from the sensor signals, and generate a ray originating from the controller to an interaction of a screen provided to display the 3D virtual environment, wherein the ray is further projected into the 3D virtual environment by a ray tracing technique; and
a video capturing system including at least one camera, disposed in front or in vicinity of the user to capture the motion of the controller being held by the user, wherein the processing unit receives images from the video capturing system, the controller is used to calibrate a relationship with the screen used to display the 3D virtual environment to estimate size and location of the screen with respect to the camera so as to find absolute position and orientation of the controller in a physical world.
3 Assignments
0 Petitions
Accused Products
Abstract
Techniques for selecting a portion of a 3D virtual environment are disclosed, where the portion of the 3D virtual environment may be one or more objects in the 3D virtual environment or one of scenes in the 3D virtual environment. A motion sensitive device (controller) is used. The controller generates sensor data sufficient to derive position and orientation of the controller in six degrees of freedom. In one embodiment, when selecting the portion of the 3D virtual environment, the controller generates a ray to an interaction of a display screen provided to display the 3D virtual environment, wherein the ray is further projected into the 3D virtual environment by a ray tracing technique as if the user had a real laser pointer that crosses from the physical world into the 3D virtual environment being displayed. Further a user is optionally to use a secondary input device to select one or more points or objects in a 3D space to control a distance along the ray being used.
-
Citations
23 Claims
-
1. A system for a user to select a portion of a 3D virtual environment being displayed, the system comprising:
-
a controller including a plurality of inertia sensors providing sensor signals sufficient to derive changes in motion of the controller in six degrees of freedom; a processing unit, receiving the sensor signals, configured to derive position and orientation of the controller from the sensor signals, and generate a ray originating from the controller to an interaction of a screen provided to display the 3D virtual environment, wherein the ray is further projected into the 3D virtual environment by a ray tracing technique; and a video capturing system including at least one camera, disposed in front or in vicinity of the user to capture the motion of the controller being held by the user, wherein the processing unit receives images from the video capturing system, the controller is used to calibrate a relationship with the screen used to display the 3D virtual environment to estimate size and location of the screen with respect to the camera so as to find absolute position and orientation of the controller in a physical world. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13)
-
-
14. A method for a user to select a portion of a 3D virtual environment being displayed, the method comprising:
-
receiving sensor signals from a controller sufficient to derive motion of the controller in six degrees of freedom, wherein the controller includes a plurality of inertia sensors that generate the sensor signals when being manipulated by the user; deriving in a processing unit the motion of the controller from the sensor signals; and determining an orientation of the controller by ray originating from the controller to a display screen provided to display the 3D virtual environment, wherein the ray is further projected into the 3D virtual environment by a ray tracing technique; generating images from a video capturing system disposed in front or in vicinity of the user to capture movements of the controller by the user, wherein said determining an orientation of the controller comprises calibrating a relationship of the controller with the display screen to find an actual size and location of the display screen with respect to the video capturing system so as to find absolute position and orientation of the controller. - View Dependent Claims (15, 16, 17, 18, 19, 20, 21, 22, 23)
-
Specification