PERSPECTIVE TRACKING SYSTEM

• US 20150355730A1
• Filed: 05/08/2015
• Published: 12/10/2015
• Est. Priority Date: 12/19/2005
• Status: Active Grant

• Current Assignee: Raydon 2, LLC
• Original Assignee: Raydon Corporation (By Light Professional IT Services, LLC)
• Inventors: Page, David
• Granted Patent: US 9,671,876 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: F41A 33/00 Adaptations for training adaptations of barrels for recoil reinforcement F41A21/26; Gun simulators teaching or practice apparatus for gun-aiming or gun-laying F41G3/26 ; shooting games A63F9/02; military simulation G09B9/003
• CPC Class Codes: F41G 3/26 Teaching or practice apparatus for gun-aiming or gun-laying shooting games A63F9/02; light- or radiation-emitting guns F41A33/02; targets therefor F41J; responders, transponders for radar, sonar, lidar G01S13/767, G01S15/74, G01S17/74
• CPC Class Codes: F41G 3/2605 using a view recording device cosighted with the gun F41G3/2616 takes precedence
• CPC Class Codes: F41G 3/2661 in which the light beam is sent from the target to the weapon F41G3/2638 takes precedence
• CPC Class Codes: F41J 5/02 Photo-electric hit-detector systems comprising a light-emitting device for simulating the firing of a gun F41G3/2622; detecting by optical means G01V8/10
• CPC Class Codes: F41J 9/00 Moving targets, i.e. moving when fired at F41J2/00 takes precedence
• CPC Class Codes: F41J 9/08 Airborne targets, e.g. drones, kites, balloons aircraft for towing targets B64D3/02
• CPC Class Codes: G01B 11/14 for measuring distance or clearance between spaced objects or spaced apertures G01B11/26 takes precedence; rangefinders G01C3/00
• CPC Class Codes: G01B 21/042 Calibration or calibration artifacts G01B3/30, G01B9/02072 take precedence
• CPC Class Codes: G01S 5/163 Determination of attitude using inertial means G01C9/00; control of attitude G05D1/49
• CPC Class Codes: G06F 16/7328 Query by example, e.g. a complete video frame or video sequence graphical querying G06F16/7335
• CPC Class Codes: G06F 16/7335 Graphical querying, e.g. query-by-region, query-by-sketch, query-by-trajectory, GUIs for designating a person/face/object as a query predicate end-user interface involving hot spots associated with the video H04N21/4725; end-user interface for selecting a Region of Interest H04N21/4728
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30204 Marker
• CPC Class Codes: G06T 7/74 involving reference images or patches
• CPC Class Codes: G06T 7/80 Analysis of captured images to determine intrinsic or extrinsic camera parameters, i.e. camera calibration
• CPC Class Codes: G09B 19/00 Teaching not covered by other main groups of this subclass teaching or practice apparatus for gun-aiming or gun-laying F41G3/26
• CPC Class Codes: G09B 9/00 Simulators for teaching or training purposes for the use of weapons F41; computing aspects G06; protocols for games, networked simulations or virtual reality H04L67/131
• CPC Class Codes: G09B 9/003 for military purposes and tactics
• CPC Class Codes: G09B 9/006 : for locating or ranging of objects
• CPC Class Codes: G09B 9/04 : for teaching control of land vehicles
• CPC Class Codes: G09B 9/08 : for teaching control of aircraft, e.g. Link trainer
• CPC Class Codes: G09B 9/301 : by computer-processed or -generated image
• CPC Class Codes: G09B 9/307 : by helmet-mounted projector or display G09B9/36 takes precedence; optical parts of head-up displays G02B27/01

Abstract

Resolution of perspective in three dimensions is necessary for intermeshing real players into simulated environments during virtual training exercises. With the advent of high resolution image sensors the ability to sense position and orientation using image capture devices is possible. The combination of small sized sensors and image recognition tracking algorithms allows the tracking element to be placed directly on the device whose perspective is desired. This provides a solution to determining perspective as it provides a direct measurement from the center axis of the observer. This invention employs a perspective tracking device to determine a point-of-gaze or a point-of-aim in a three-dimensional space to a high degree of accuracy. Point-of-gaze may be used to determine views for head mounted displays and aim-points for weapons. The invention may operate in an unconstrained space allowing simulation participants to operate in a larger, open environment. Areas of interest in the environment are bounded by area of interest markers which identify the region and its physical constraints.

Claims

1. A perspective tracking system comprising:

a computer-based perspective tracking device; and

an array of emitters configured to define at least one area of interest based on emitted signals from at least two emitters in the array of emitters;

wherein the computer-based perspective tracking device is configured to determine a spatial position, orientation, and size of the area of interest based on the emitted signals from the array of emitters; and

wherein the computer-based perspective tracking system is configured to measure a light intensity of each of the at least two emitters in the array of emitters over a detection threshold and generate a correction equation to the light intensity measurement that yields temperature-based offsets.

2. The system of claim 1 wherein at least one emitter in the array of emitters comprises a light emitter.

3. The system of claim 2 wherein said at least one emitter in the array of emitters is configured to modulate the light to output an identification of said light emitter.

4. The system of claim 3 wherein said identification comprises one or more of:

an identification sequence;

an error correction; and

a validation sequence.

5. The system of claim 1 wherein said at least one area of interest comprises an n-sided polygon defined by said array of emitters.

6. The system of claim 1 wherein said spatial position, orientation, and size comprise:

point of gaze;

or

point of aim.

7. A perspective tracking method comprising:

capturing, using a computer-based system, an image frame wherein said image frame includes a location of an emitter and a location of a second emitter;

determining, using the computer-based system, an area of interest based on the location of the first emitter and the location of the second emitter;

determining, based on the locations of the first and second emitters, a spatial position, an orientation, and a size of the area of interest;

wherein the capture of the image frame comprises measuring a light intensity of each of the first and second emitters over a detection threshold and applying a correction equation to the light intensity measurement that yields temperature-based offsets.

8. The method of claim 7, wherein the capture of the image frame further comprises

calculating a centroid of the light intensity of each of the first and second emitters.

9. A computer program product comprising a non-transitory computer usable medium having control logic stored therein for causing a computer to track a perspective of an array of emitters, the control logic comprising:

first computer readable program code for causing the computer to capture an image frame wherein said image frame includes a location of a first emitter and a location of a second emitter;

second computer readable program code for causing the computer to determine an area of interest based on the location of the first emitter and the location of the second emitter;

third computer readable program code for causing the computer to determine, based on the locations of the first and second emitters, a spatial position, an orientation, and a size of the area of interest;

wherein the first computer readable program code further comprises;

computer readable program code for causing the computer to measure a light intensity of each of the first and second emitters over a detection threshold; and

computer readable program code for causing the computer to generate a correction equation to the light intensity measurement that yields temperature-based offsets.

10. The computer program product of claim 9, wherein the first computer readable program code further comprises:

computer readable program code for causing the computer to calculate a centroid of the light intensity of each of the first and second emitters.

11. The computer program product of claim 9, wherein said correction equation yields an optical error correction.