Tracking dynamic on-stage objects

• US 9,921,058 B2
• Filed: 05/19/2014
• Issued: 03/20/2018
• Est. Priority Date: 05/19/2014
• Status: Active Grant

• Current Assignee: STMicroelectronics International N.V. (STMicroelectronics NV)
• Original Assignee: STMicroelectronics International N.V. (STMicroelectronics NV)
• Inventors: Sinha, Vikas Kumar, Omar, Nishant
• Primary Examiner(s): Betsch, Regis
• Application Number:
  US14/281,273
• Publication Number:
  US 20150330778A1
• Time in Patent Office: 1,401 Days
• CPC Class Codes: G01B 21/00 Measuring arrangements or details thereof, where the measuring technique is not covered by the other groups of this subclass, unspecified or not relevant
• CPC Class Codes: G06V 40/25 Recognition of walking or running movements, e.g. gait recognition
• CPC Class Codes: H05B 47/155 Coordinated control of two or more light sources

Abstract

Methods and systems for dynamic tracking of on-stage objects using microelectromechanical systems (MEMS) presented herein do not require illumination to track a randomly moving object and are easily configurable for various stage sizes and for stages movable relative to the ground. In some instances, a tracking method includes determining an initial state of an MEMS motion tracker carried on a dynamic object, such as a performer. Acceleration and orientation information gathered by the motion tracker is monitored. A change of state in response to the monitored acceleration and orientation information is then determined. An instant state is calculated using the change of state and the initial state. Actuation signals based on the calculated instant state are generated for actuating a gimbal. The gimbal faces a device supported thereby toward the dynamic object.

Claims

1. A method, comprising:

determining an initial state of a motion tracker carried on a performer during a calibration, the performer moving in a manner representable using a two dimensional plane, wherein the two dimensional plane is quantifiable with a motion unit in terms of a fixed dimension of the performer and the fixed dimension is statically measured during the calibration of the motion tracker and a driving controller;

monitoring acceleration and orientation information gathered by the motion tracker;

determining a change of state in response to the monitored acceleration and orientation information;

calculating an instant state using the change of state and the initial state; and

generating by the driving controller of actuation signals based on the calculated instant state to control actuation of a gimbal supporting a device to cause the device to face the device toward the performer.

2. The method of claim 1, further comprising calibrating the motion tracker and the driving controller and setting known parameters corresponding to the initial state in the motion tracker when the performer is at an initial reference location.

3. The method of claim 1, wherein determining the initial state of the motion tracker further comprises calculating the initial state using data collected from one of an accelerometer, a gyroscope, or a magnetometer within the motion tracker.

4. The method of claim 1, wherein determining the initial state of the motion tracker further comprises calculating the initial state using data collected from a combination of an accelerometer, a gyroscope and a magnetometer within the motion tracker.

5. The method of claim 1, wherein calculating the instant state further comprises determining a present velocity and a present acceleration of the performer.

6. The method of claim 5, further comprising generating data regarding quaternions, heading, pitch, roll, yaw, linear acceleration, and gravity.

7. The method of claim 1, wherein determining the change of state further comprises sampling data about acceleration and orientation of the motion tracker at a constant frequency.

8. The method of claim 1, wherein calculating the instant state comprises superpositioning the change of state to the initial state wherein the superpositioning includes accumulating the change of state in a period of time onto the initial state for determining a change of location relative to a known location.

9. The method of claim 1, wherein the motion tracker is wearable by a human.

10. The method of claim 1, wherein the motion tracker is a microelectromechanical system including one of an accelerometer, a gyroscope and a magnetometer.

11. The method of claim 1, wherein the device comprises one of a photon emitter, a photon receiver, or a sound wave emitter.

12. The method of claim 1, further comprising transmitting signals about the calculated instant state via a wireless transceiver to a driving controller of the gimbal.

13. The method of claim 1, wherein the actuation signals include parameters for controlling the device to generate a field of projection or to obtain a field of view having an error tolerance about three to five times of the motion unit.

14. The method of claim 13, wherein the parameters for controlling the device for controlling the device to generate the field of projection or the field of view control a zoom of the device.

15. The method of claim 1, wherein the fixed dimension is measured at an entrance from the shoulder width of the performer.

16. The method of claim 15, wherein the shoulder width of the performer is substantially similar to the foot to foot distance of the performer when the performer stands at the entrance.

17. A system for tracking a moving dynamic object, the system comprising:

a motion tracker carried on a dynamic object, the motion tracker being set at an initial state and operable to gather data of acceleration and orientation for calculation of an instant state, the instant state being determined from a change of state;

a wireless transceiver transmitting signals to a driving controller, the signals representing the gathered data or the instant state;

a gimbal controlled by the driving controller generating driving signals from the instant state; and

a device supported by the gimbal,

wherein the driving signals generated by the driving controller cause the gimbal to operate to orient the device to face the dynamic object, and

wherein the dynamic object moves in a manner representable using a two dimensional plane quantifiable using a fixed dimension of a performer carrying the dynamic object, the fixed dimension is statically measured from the performer during the calibration and used as a motion unit to quantify the two dimensional plane.

18. The system of claim 17, wherein the motion tracker and the driving controller are calibrated by setting known parameters corresponding to the initial state when the dynamic object is at an initial reference location.

19. The system of claim 17, wherein the motion tracker comprises one of an accelerometer, a gyroscope, and a magnetometer for gathering the data of acceleration and orientation.

20. The system of claim 17, further comprising a microcontroller operable using the gathered data to calculate the instant state by superpositioning the change of state to the initial state to determine a present velocity and a present acceleration of the dynamic object, wherein the change of state is sampled about acceleration and orientation of the motion tracker at a constant frequency.

21. The system of claim 17, wherein the driving controller is configured to process the gathered data to calculate the instant state by superpositioning the change of state to the initial state to determine a present velocity and a present acceleration of the dynamic object, wherein the change of state is sampled about acceleration and orientation of the motion tracker at a constant frequency.

22. The system of claim 17, wherein the dynamic object is a human performer and the motion tracker is moving in a non-predicted pattern.

23. The system of claim 17, wherein the driving controller, using the driving signals, controls the device generate a field of projection or to obtain a field of view having an error tolerance about three to five times of the fixed dimension of the performer.

24. The system of claim 23, wherein the driving signals cause the device to generate the field of projection or the field of view by controlling a zoom of the device.

25. A stage tracking system comprising:

a wearable motion tracker carried by a human performer moving in a manner representable in a two dimensional plane of a finite size, the wearable motion tracker including a microelectromechanical system for gathering data to calculate an instant state of the wearable motion tracker; and

a driving controller configured to receive motion signals from the wearable motion tracker and generate control signals which control operation of a gimbal that supports a directional device to cause the directional device to face towards the human performer, the motion signals representing the gathered data or the instant state, wherein the two dimensional plane is quantifiable using a fixed dimension of the human performer and the fixed dimension is statically measured from the performer during the calibration.

26. The stage tracking system of claim 25, wherein the microelectromechanical system further comprises:

an accelerometer, a gyroscope, and a magnetometer for sampling data to calculate the instant state, wherein calculation of the instant state is based on an initial state and a change of state regarding acceleration and orientation; and

a transceiver for transmitting the gathered data to the driving controller via a wireless connection to actuate the directional device to follow the moving performer using projection or reception.

27. The stage tracking system of claim 25, wherein the driving controller, using the driving signals, controls the device generate a field of projection or to obtain a field of view having an error tolerance about three to five times of the fixed dimension of the performer.

28. The system of claim 27, wherein the driving signals cause the device to generate the field of projection or the field of view by controlling a zoom of the device.