Systems and methods for operating a virtual reality environment using colored marker lights attached to game objects
First Claim
1. A system for operating a virtual reality environment including at least one space, the system comprising:
- at least one color camera configured to view the at least one space;
at least one object, wherein the at least one object comprises at least one of a player, a controller and a device related to the virtual reality;
at least one colored light attached to each of the at least one object configured to be used as a tracking marker;
at least one server configured to track movements of the at least one object during the virtual reality;
a memory containing machine readable medium comprising machine executable code having stored thereon instructions for tracking the movements of the at least one object; and
a control system comprising a processor or processors coupled to the memory, the control system configured to execute the machine executable code to cause the control system to;
assign a color choice to each of the at least one colored light, wherein the assignment of the first color to the first colored light from among the at least one colored light is based on a spatial proximity of the first colored light to other colored lights in the at least one space;
wherein during the virtual reality, if a second colored light, from among the at least one colored light, having the first color comes within a specified distance of the first colored light, the control system is further configured to change the assignment of color of one of the first colored light or the second colored lights to a color different than the first color.
1 Assignment
0 Petitions
Accused Products
Abstract
Systems and methods are disclosed for operating, calibrating, and dynamically optimizing a system for a virtual reality environment where colored marker lights are attached to objects, the objects including players, controllers, and devices related to the game. One or more color cameras are used to view one or more spaces, and track positions and orientations of players and other objects according to the attached marker lights. A hierarchical system of servers may be used to process positions and orientations of objects and provide controls as necessary for the system. A method for color assignment is described as well as a calibration process, and a dynamic optimization process. A synchronization process is also described that ensures that a plurality of cameras and attached servers are properly coordinated. Head-mounted devices may also be used in conjunction with marker lights to provide information regarding players.
82 Citations
22 Claims
-
1. A system for operating a virtual reality environment including at least one space, the system comprising:
-
at least one color camera configured to view the at least one space; at least one object, wherein the at least one object comprises at least one of a player, a controller and a device related to the virtual reality; at least one colored light attached to each of the at least one object configured to be used as a tracking marker; at least one server configured to track movements of the at least one object during the virtual reality; a memory containing machine readable medium comprising machine executable code having stored thereon instructions for tracking the movements of the at least one object; and a control system comprising a processor or processors coupled to the memory, the control system configured to execute the machine executable code to cause the control system to; assign a color choice to each of the at least one colored light, wherein the assignment of the first color to the first colored light from among the at least one colored light is based on a spatial proximity of the first colored light to other colored lights in the at least one space; wherein during the virtual reality, if a second colored light, from among the at least one colored light, having the first color comes within a specified distance of the first colored light, the control system is further configured to change the assignment of color of one of the first colored light or the second colored lights to a color different than the first color. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. A method for operating a virtual reality environment including at least one space, at least one color camera, at least one object, at least one colored light attached to each of the at least one object, at least one processor, and at least one server, the method comprising:
-
viewing, using at least one of the at least one color camera, the at least one space; assigning, using at least one of said at least one processor, a first color to a first colored light from among the at least one colored light, within the at least one space based on a spatial proximity of the first colored light to other colored lights in the at least one space; tracking, using at least one of said at least one server, movements of the at least one object; and changing, using at least one of said at least one processor, if a second colored light, from among the at least one colored light, having the first color comes within a specified distance of the first colored light, the assignment of color of one of the first colored light or the second colored lights to a color different than the first color, wherein the at least one object comprises at least one of a player, a controller and a device related to the virtual reality. - View Dependent Claims (8, 9, 10, 11, 12)
-
-
13. A system for operating a virtual reality environment including at least one space, the system comprising:
-
at least one color camera configured to view the at least one space; at least one object, wherein the at least one object comprises at least one of a player, a controller and a device related to the virtual reality; at least one colored light attached to each of the at least one object configured to be used as at least one tracking marker; a communication link; at least one server, comprising a hierarchy of at least one slave server and a master server, configured to track movements of the at least one object during the virtual reality; a memory containing machine readable medium comprising machine executable code having stored thereon instructions for tracking the movements of the at least one object; and a control system comprising a processor or processors coupled to the memory, the control system configured to execute the machine executable code to cause the control system to; locate, using the at least one slave servers, the position of the at least one tracking marker within view of the at least one color camera; transmit, via the communication link, position of the at least one tracking marker to the master server; create, using the master server, a list of all intersection points where a position of a first tracking marker, from among the at least one tracking marker, seen by one of the at least one color camera matches a position of a second tracking marker, from among the at least one tracking marker, seen by another of the at least one color camera; and average, for each intersection point, the positions of the first tracking marker and the second tracking marker to create a processed position for the intersection point that represents a position of a composite tracking marker corresponding to both the first tracking marker and the second tracking markers.
-
-
14. A method for operating a virtual reality environment including at least one space, at least one color camera, a communication link, at least one object, at least one colored light attached to each of the at least one object configured to be used as at least one tracking marker, at least one processor, and at least one server comprising a hierarchy of at least one slave server and a master server, the method comprising:
-
viewing, using at least one of the at least one color camera, the at least one space; tracking, using at least one of said at least one server, movements of the at least one object; locating, using the at least one slave servers, the position of the at least one tracking marker within view of the at least one color camera; transmitting, via the communication link, position of the at least one tracking marker to the master server; creating, using the master server, a list of all intersection points where a position of a first tracking marker, from among the at least one tracking marker, seen by one of the at least one color camera matches a position of a second tracking marker, from among the at least one tracking marker, seen by another of the at least one color camera; and averaging, using at least one of said at least one processor, for each intersection point, the positions of the first tracking marker and the second tracking marker to create a processed position for the intersection point that represents a position of a composite tracking marker corresponding to both the first tracking marker and the second tracking markers, wherein the at least one object comprises at least one of a player, a controller and a device related to the virtual reality.
-
-
15. A system for operating a virtual reality environment including at least one space, the system comprising:
-
at least one color camera configured to view the at least one space; at least one object, wherein the at least one object comprises at least one of a player, a controller and a device related to the virtual reality; at least one colored light attached to each of the at least one object configured to be used as at least one tracking marker; at least one server configured to track movements of the at least one object during the virtual reality; a memory containing machine readable medium comprising machine executable code having stored thereon instructions for tracking the movements of the at least one object; and a control system comprising a processor or processors coupled to the memory, the control system configured to execute the machine executable code to cause the control system to; detect a calibration object placed in a space visible to each of the at least one color camera, wherein the calibration object comprises at least three colored calibration marker lights mounted in specified positions on the calibration object, and wherein the calibration object is placed in the space in a specified orientation relative to the at least one colored camera; determine in a captured image at each of the at least one color camera, a position of each of the at least three calibration marker lights; convert each of the determined positions to vectors relative to a zero origin; analyze the vectors to determine a best fit for a position of each calibration marker light; and convert the detected orientation of the calibration object into a position and orientation respective to at each of the at least one color camera for use thenceforth in operation of the virtual reality. - View Dependent Claims (16, 17, 18)
-
-
19. A method for operating a virtual reality environment including at least one space, at least one color camera, at least one object, at least one colored light attached to each of the at least one object, at least one processor, and at least one server, the method comprising:
-
viewing, using at least one of the at least one color camera, the at least one space; tracking, using at least one of said at least one server, movements of the at least one object; detecting, using at least one of said at least one processor, a calibration object placed in a space visible to each of the at least one color camera, wherein the calibration object comprises at least three colored calibration marker lights mounted in specified positions on the calibration object, and wherein the calibration object is placed in the space in a specified orientation relative to the at least one colored camera; determining, using at least one of said at least one processor, in a captured image at each of the at least one color camera, a position of each of the at least three calibration marker lights; converting, using at least one of said at least one processor, each of the determined positions to vectors relative to a zero origin; analyzing, using at least one of said at least one processor, the vectors to determine a best fit for a position of each calibration marker light; and converting, using at least one of said at least one processor, the detected orientation of the calibration object into a position and orientation respective to at each of the at least one color camera for use thenceforth in operation of the virtual reality, wherein the at least one object comprises at least one of a player, a controller and a device related to the virtual reality. - View Dependent Claims (20, 21, 22)
-
Specification