Autonomous Tracking Based On Radius

• US 20190317531A1
• Filed: 04/29/2019
• Published: 10/17/2019
• Est. Priority Date: 02/28/2017
• Status: Active Grant

• Current Assignee: GoPro, Inc.
• Original Assignee: GoPro, Inc.
• Inventors: Tankersley, Benjamin
• Granted Patent: US 10,671,096 B2
• Time in Patent Office: Days
• CPC Class Codes: B64C 39/024 of the remote controlled vehicle type, i.e. RPV
• CPC Class Codes: B64U 10/10 Rotorcrafts
• CPC Class Codes: B64U 10/14 with four distinct rotor axes, e.g. quadcopters
• CPC Class Codes: B64U 20/87 Mounting of imaging devices, e.g. mounting of gimbals
• CPC Class Codes: B64U 2101/30 for imaging, photography or videography
• CPC Class Codes: B64U 2201/10 autonomous, i.e. by navigating independently from ground or air stations, e.g. by using inertial navigation systems [INS]
• CPC Class Codes: B64U 2201/20 Remote controls
• CPC Class Codes: B64U 30/20 Rotors; Rotor supports
• CPC Class Codes: B64U 50/19 using electrically powered motors
• CPC Class Codes: G05D 1/0094 involving pointing a payload, e.g. camera, weapon, sensor, towards a fixed or moving target
• CPC Class Codes: G05D 1/101 specially adapted for aircraft
• CPC Class Codes: G05D 1/12 Target-seeking control
• CPC Class Codes: G05D 1/46 Control of position or course in three dimensions
• CPC Class Codes: G05D 1/683 Intercepting moving targets docking at a base station G05D1/661
• CPC Class Codes: G05D 1/686 Maintaining a relative position with respect to moving targets, e.g. following animals or humans for pointing payloads towards targets G05D1/689; involving controlling the position or course of two or more vehicles G05D1/69
• CPC Class Codes: G05D 1/689 Pointing payloads towards fixed or moving targets positioning towed, pushed or suspended implements G05D1/672
• CPC Class Codes: H04N 23/695 Control of camera direction for changing a field of view, e.g. pan, tilt or based on tracking of objects
• CPC Class Codes: H04N 7/185 from a mobile camera, e.g. for remote control

Abstract

Disclosed is a configuration of an autonomous vehicle for autonomously following a moving subject based on a radius of a virtual sphere surrounding the autonomous vehicle. The autonomous vehicle may be an unmanned ground vehicle or an unmanned aerial vehicle, which autonomously follows the subject (e.g., a device, a live entity, or any object) based on the virtual sphere. The radius of the virtual sphere may be dynamically configured according to a velocity of the autonomous vehicle or configurations of a camera coupled to the autonomous vehicle. Accordingly, the autonomous vehicle can follow the subject along a smooth trajectory, and capture images of abrupt movements of the subject in a cinematically pleasing manner.

Claims

1-20. -20. (canceled)

21. A vehicle comprising:

a camera;

a radius tracking controller configured to;

determine a radius of a virtual sphere around the vehicle based on the camera, and

determine an updated target position of the vehicle based on a comparison between a vehicle position of the vehicle and a previous target position of the vehicle and based on the radius; and

a vehicle controller interface configured to move the vehicle towards the updated target position.

22. The vehicle of claim 21, wherein the radius of the virtual sphere is determined based on a configuration of the camera and a velocity of the vehicle.

23. The vehicle of claim 22, wherein the configuration of the camera includes any of orientation, field of view, frame rate, resolution, sensitivity to light, white balance, aperture, and exposure.

24. The vehicle of claim 21, wherein the radius tracking controller is further configured to:

set the previous target position to be the updated target position in response to determining that a distance between the vehicle position and the previous target position is larger than the radius.

25. The vehicle of claim 21, wherein the radius tracking controller is further configured to:

determine an intersection between a path between the previous target position and a subject position of an image captured by the camera; and

determine a surface of the virtual sphere around the vehicle in response to determining that a distance between the vehicle position and the previous target position of the vehicle is less than the radius.

26. The vehicle of claim 25, further comprising:

a subject position estimation subsystem configured to estimate the subject position and to provide the estimated subject position to the radius tracking controller.

27. The vehicle of claim 25, further comprising:

a communication subsystem configured to receive information describing the subject position and to provide the subject position to the radius tracking controller.

28. The vehicle of claim 21, further comprising:

a telemetric subsystem configured to determine the vehicle position and to provide the vehicle position to the radius tracking controller.

29. The vehicle of claim 21, wherein the radius tracking controller is further configured to:

determine a pitch and a heading of the camera to face an anticipated position of a subject of an image based on the updated target position, wherein the vehicle further comprises a gimbal controller securing the camera, the gimbal controller configured to situate the camera according to the pitch and the heading.

30. A method comprising:

determining a radius of a virtual sphere around a vehicle based on a camera;

determining an updated target position of the vehicle based on a comparison between a vehicle position of the vehicle and a previous target position of the vehicle and based on the radius; and

moving the vehicle towards the updated target position.

31. The method of claim 30, wherein the radius of the virtual sphere is determined based on a configuration of the camera and a velocity of the vehicle.

32. The method of claim 31, wherein the configuration of the camera includes any of orientation, field of view, frame rate, resolution, sensitivity to light, white balance, aperture, and exposure.

33. The method of claim 30, further comprising:

setting the previous target position to be the updated target position in response to determining that a distance between the vehicle position and the previous target position is larger than the radius.

34. The method of claim 30, further comprising:

determining an intersection between a path between the previous target position and a subject position of an image captured by the camera; and

determining a surface of the virtual sphere around the vehicle in response to determining that a distance between the vehicle position and the previous target position of the vehicle is less than the radius.

35. The method of claim 30, further comprising:

determining a pitch and a heading of the camera to face an anticipated position of a subject of an image captured by the camera based on the updated target position; and

situating the camera based on the determined pitch and the heading.

36. An aerial vehicle comprising:

a radius tracking controller configured to;

determine a radius of a virtual sphere around the aerial vehicle based on a velocity of the vehicle, and

determine an updated target position of the aerial vehicle based on the radius and a comparison between a position of the aerial vehicle and a previous target position of the aerial vehicle; and

a vehicle controller interface module configured to move the aerial vehicle towards the updated target position of the aerial vehicle.

37. The aerial vehicle of claim 36, further comprising:

a gimbal configured to secure a camera, wherein the radius is determined further based on a configuration of the camera.

38. The aerial vehicle of claim 37, wherein the configuration of the camera includes any of orientation, field of view, frame rate, resolution, sensitivity to light, white balance, aperture, and exposure.

39. The aerial vehicle of claim 37, wherein the radius tracking controller is further configured to:

determine an intersection between a path between the previous target position and a subject position of an image captured by the camera, and a surface of the virtual sphere around the aerial vehicle in response to a determination that a distance between the position of the aerial vehicle and the previous target position is less than the radius.

40. The aerial vehicle of claim 36, wherein the radius tracking controller is further configured to:

set the previous target position to be the updated target position of the aerial vehicle in response to a determination that a distance between the position of the aerial vehicle and the previous target position is larger than the radius.