×

Vision based real-time object tracking system for robotic gimbal control

  • US 10,095,942 B2
  • Filed: 12/14/2015
  • Issued: 10/09/2018
  • Est. Priority Date: 12/15/2014
  • Status: Active Grant
First Claim
Patent Images

1. A real-time interactive display system for dynamic object selection and tracking, the system comprising:

  • a pivoting device, wherein the pivoting device includes a roll motor, pitch motor, and yaw motor, wherein actuating the roll motor, pitch motor, and yaw motor causes the pivoting device to be operable with at least three degrees of freedom;

    a computer vision camera, wherein the computer vision camera is mounted on the pivoting device;

    a stabilizing controller device coupled to the pivoting device, wherein the stabilizing controller device can actuate the roll, pitch, and yaw motors of the pivoting device; and

    a computing device connected to the stabilizing controller device, wherein the computing device comprises a processing system having one or more cores, the processing system configured to;

    periodically receive a frame from the computer vision camera;

    receive information about a Region Of Interest (ROI) within the frame, wherein the ROI includes a target subject that is tracked in real-time by the computer vision camera, wherein the information includes at least one parameter that can be used to set one or more polygonal boundaries within the frame relative to the target subject, each of the one or more polygonal boundaries defining a region within the frame having an accuracy mode with which the target subject is tracked;

    compute a location and size of the target subject based on the information;

    determine that the target subject is within a first threshold defined by a first polygonal boundary, out of the one or more polygonal boundaries, within the frame;

    in response to determining that the target subject is within the first threshold, set the accuracy mode to a first mode with which the target subject is tracked; and

    transmit instructions to the stabilizing controller device to control the pitch and yaw motors of the pivoting device to adjust the pivoting device based on the first mode such that the subject target is maintained within the frame of the computer vision camera,in response to determining that the target subject is outside of the first threshold defined by the first polygonal boundary, set the accuracy mode to a second mode with which target subject is tracked; and

    transmit instructions to the stabilizing controller device to control the pitch and yaw motors of the pivoting device to adjust the pivoting device based on the second mode such that the subject target is maintained within the frame of the computer vision camera, wherein the second mode instructs the stabilizing controller device to move more rapidly to track the movement of the target subject than in the first mode.

View all claims
  • 1 Assignment
Timeline View
Assignment View
    ×
    ×