Compact, rugged, intelligent tracking apparatus and method

• US 9,699,365 B2
• Filed: 10/03/2013
• Issued: 07/04/2017
• Est. Priority Date: 10/04/2012
• Status: Expired due to Fees

• Current Assignee: Jigabot, LLC
• Original Assignee: Jigabot, LLC
• Inventors: Johnson, Kyle K., Engh, Cameron, Shelley, Kevin J., Stout, Richard F.
• Primary Examiner(s): Mikeska, Neil
• Assistant Examiner(s): Matt, Marnie
• Application Number:
  US14/045,445
• Publication Number:
  US 20140098241A1
• Time in Patent Office: 1,370 Days
• CPC Class Codes: H04N 23/66 Remote control of cameras or camera parts, e.g. by remote control devices
• CPC Class Codes: H04N 5/222 Studio circuitry; Studio devices; Studio equipment cameras or camera modules comprising electronic image sensors, or control thereof H04N23/00

Abstract

In a video recording environment, a compact, rugged, intelligent tracking apparatus and method enables the automation of labor-intensive operating of cameras, lights, microphones and other devices. Auto-framing of a tracked object within the viewfinder of a supported camera is possible. The device can sense more than one object at once, and includes multiple ways to easy way to switch from one object to another. The methods show how the auto-framing device can be “predictive” of movements, intelligently smooth the tilt and swivel motions so that the end effect is a professional looking picture or video. It is designed to be uniquely small yet rugged and waterproof. And it can accept configuration input from users via a smartphone or extreme-sports camera over wi-fi or bluetooth, including user-programmable scripts that automate the device functionality in easy to use ways.

Claims

1. A method of independent, cinematic control of devices, the method comprising:

providing a system comprising an emitter, a tracker, a mounted device, and at least one processor operably connected to process data corresponding thereto;

configuring the emitter to be uniquely identifiable by the at least one processor;

configuring, by the at least one processor, the tracker to recognize the emitter;

receiving, from a user, a graphical plot, in two or three dimensions, of a general expected motion path of the emitter, wherein the graphical plot comprises a visual representation of the general expected motion path of the emitter;

sensing, by an imaging device within the tracker, the emitter;

determining, by the at least one processor, a physical extent of a subject that is associated with the emitter;

creating, by the at least one processor, a record based on the sensing and a plotting, by the tracker, of a location of the emitter and the physical extent of the subject;

configuring and providing to the tracker, by the at least one processor, based on the graphical plot, a relationship defining at least one of a relative motion and a relative position between the subject and the mounted device;

directing, by the tracker, the mounted device to interact with the subject within the space, based on the sensing and the relationship;

executing, by the at least one processor at least one of predicting a future position of the subject, smoothing motion of the mounted device by providing smoothing data to the tracker, and positioning the mounted device based on at least one of predicting, smoothing, and tracking;

receiving, from the user, expected distances, velocities, curves, and vectors associated with the emitter with respect to the tracker; and

communicating a script, based on user inputs, the script comprising;

a first condition operating as a triggering condition,

an action to be conducted by the tracker based on the first condition and a configuration corresponding to configuration settings of at least one of the tracker, the emitter, and the mounted device, and

a second condition, operating as a terminating condition based upon which the tracker ceases the action;

wherein;

the mounted device is selected to include at least one of a camera, a light, and a microphone.

2. The method of claim 1, wherein:

the mounted device is mechanically coupled to the tracker to move in rigid body motion with a coupler constituting a portion of the tracker and movable thereby; and

the at least one processor is programmed to send and receive device data corresponding to at least one of the tracker and the mounted device.

3. The method of claim 2, wherein the device data is selected from control commands to at least one of the tracker and the mounted device, feedback of condition data corresponding to at least one of the tracker and the mounted device, and content generated by at least one of the tracker and the mounted device.

4. The method of claim 1, wherein communicating the script further comprises at least one of:

sending the script to a new user other than a creator thereof; and

receiving by the new user the script from the creator thereof.

5. The method of claim 1, wherein the first condition is selected from:

an existence of more than one emitter visible to the tracker;

the emitter being visible to the tracker;

the emitter being not visible to the tracker;

the tracker detecting more than a single emitter having a same identifier;

the emitter changing a direction of motion while being tracked;

the tracker remaining stationary for a pre-selected period of time;

the emitter remaining stationary for the pre-selected period of time;

the tracker is not tracking the emitter; and

a pre-selected period of time has passed since a datum in time.

6. The method of claim 1, wherein the configuration of the tracker represents at least one of:

a diagram comprising representations of positions of the subjects;

a path comprising a route to be taken by the subject corresponding to the emitter and moving with respect to the tracker;

an activity comprising a set comprising at least one curve defining a motion that is not monotonic, where monotonic represents a single direction not reversed; and

an offset corresponding to at least one of a direction and a distance by which aiming of the mounted device differs from a line between the emitter and the tracker.

7. A computer system for independent, cinematic control of devices, the system comprising:

one or more processors; and

one or more computer-readable media having stored thereon executable instructions that when executed by the one or more processors configure the computer system to perform at least the following;

provide a system comprising an emitter, a tracker, a mounted device, and at least one processor operably connected to process data corresponding thereto;

configure the emitter to be uniquely identifiable by the at least one processor;

configure, by the at least one processor, the tracker to recognize the emitter;

receive, from a user, a graphical plot, in two or three dimensions, of a general expected motion path of the emitter, wherein the graphical plot comprises a visual representation of the general expected motion path of the emitter;

sense, by an imaging device within the tracker, the emitter;

determine, by the at least one processor, a physical extent of a subject that is associated with the emitter;

create, by the at least one processor, a record based on the sensing and a plotting, by the tracker, of a location of the emitter and the physical extent of the subject;

configure and providing to the tracker, by the at least one processor, based on the graphical plot, a relationship defining at least one of a relative motion and a relative position between the subject and the mounted device;

direct, by the tracker, the mounted device to interact with the subject within the space, based on the sensing and the relationship;

execute, by the at least one processor at least one of predicting a future position of the subject, smoothing motion of the mounted device by providing smoothing data to the tracker, and positioning the mounted device based on at least one of predicting, smoothing, and tracking;

receive, from the user, expected distances, velocities, curves, and vectors associated with the emitter with respect to the tracker; and

communicate a script, based on user inputs, the script comprising;

a first condition operating as a triggering condition,

an action to be conducted by the tracker based on the first condition and a configuration corresponding to configuration settings of at least one of the tracker, the emitter, and the mounted device, and

a second condition, operating as a terminating condition based upon which the tracker ceases the action;

wherein;

the mounted device is selected to include at least one of a camera, a light, and a microphone.