APPARATUS AND METHODS FOR CONTEXT BASED VIDEO DATA COMPRESSION

• US 20170251169A1
• Filed: 07/15/2014
• Published: 08/31/2017
• Est. Priority Date: 06/03/2014
• Status: Abandoned Application

• Current Assignee: GoPro, Inc.
• Original Assignee: GoPro, Inc.
• Inventors: Meier, Philip, Polonichko, Vadim
• Application Number:
  US14/332,331
• Publication Number:
  US 20170251169A1
• Time in Patent Office: Days
• CPC Class Codes: B64C 39/024 of the remote controlled vehicle type, i.e. RPV
• CPC Class Codes: B64D 47/08 Arrangements of cameras
• CPC Class Codes: B64U 10/13 Flying platforms
• CPC Class Codes: B64U 10/14 with four distinct rotor axes, e.g. quadcopters
• CPC Class Codes: B64U 2101/30 for imaging, photography or videography
• CPC Class Codes: G05D 1/0094 involving pointing a payload, e.g. camera, weapon, sensor, towards a fixed or moving target
• CPC Class Codes: G06V 20/13 Satellite images
• CPC Class Codes: G06V 20/17 taken from planes or by drones
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/66 Remote control of cameras or camera parts, e.g. by remote control devices
• CPC Class Codes: H04N 23/662 by using master/slave camera arrangements for affecting the control of camera image capture, e.g. placing the camera in a desirable condition to capture a desired image
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 23/69 Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
• CPC Class Codes: H04N 5/77 between a recording apparatus and a television camera
• CPC Class Codes: H04N 7/188 Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position signal generation from motion picture films H04N5/253

Abstract

In some implementations, a camera may be disposed on an autonomous aerial platform. A user may operate a smart wearable device adapted to configured, and/or operate video data acquisition by the camera. The camera may be configured to produce a time stamp, and/or a video snippet based on receipt of an indication of interest from the user. The aerial platform may comprise a controller configured to navigate a target trajectory space. In some implementation, a data acquisition system may enable the user to obtain video footage of the user performing an action from the platform circling around the user.

Claims

1. A method of context based video acquisition by an autonomous mobile camera apparatus, the method comprising:

acquiring video of a visual scene at a first data rate using the mobile camera apparatus;

producing lower rate video from the video, the lower rate video characterized by a lower data rate compared to the first data rate;

transmitting the lower data rate video via a wireless communications interface;

detecting an indication of interest associated with the video scene; and

in response to detection of the indication, storing the video at the camera apparatus at the first data rate.

2. The method of claim 1, wherein:

the indication of interest is provided via a wearable apparatus of a user based on an occurrence of the context in the visual scene; and

the indication of interest is configured based on an activation of the wearable apparatus by the user.

3. The method of claim 1, wherein:

the visual scene comprises a subject of interest; and

the indication of interest is provided via a remote apparatus configured to determine an occurrence of the context in the visual scene, the context associated with at least one of a location and an action by the subject of interest.

4. The method of claim 1, wherein:

the autonomous mobile camera is configured to follow the subject of interest at a predetermined range; and

the autonomous mobile camera apparatus is configured to automatically adjust orientation of the camera so as to place the subject of interest at a target location within a video frame.

5. A mobile camera apparatus, comprising:

a camera sensor configured to provide video at a full data rate;

a circular memory buffer configured to store a portion of the video at the full data rate, the portion characterized by a first duration;

a nonvolatile storage configured to store video at a reduced data rate for a second duration, the second duration being greater than the first duration;

a communications interface configured to detect indications of interest associated with the video being acquired; and

a processing component configured to produce and store video snippets in response the detected indications of interest by, based on an individual indication of interest;

produce a video snippet, the video snippet characterized by the full resolution, the video snippet production comprising transferring the portion of video at the full resolution from the buffer to the nonvolatile storage; and

store a time tag in a table in the nonvolatile storage, the tag associated with the video snippet;

wherein;

the nonvolatile storage is configured to store video at the full data rate for a third duration, the third duration being greater than the first duration and smaller than the second duration; and

producing the video snippets enables the mobile camera apparatus to obtain video at the full resolution over a time period of at least the second duration.

6. The apparatus of claim 5, wherein:

acquisition of video is configured based on the mobile camera apparatus navigating a path around a subject of interest, the path characterized by a first distance and a second distance from the subject of interest; and

the logic is configured to maintain the mobile camera apparatus within a range between the first distance and the second distance.

7. The apparatus of claim 6, wherein:

when at a first location of the circular path, the camera orientation is characterized by a first direction

when at a second location of the circular path, the camera orientation is characterized by a second direction different from the first direction;

individual ones of the first and the second direction are configured to orient the camera at the subject of interest; and

during navigation of the circular path the logic is configured direct the camera orientation from the first direction to the second direction.

8. The apparatus of claim 7, wherein:

the video comprises a plurality of frames characterized by frame dimension; and

the transition of the camera orientation from the first direction to the second direction is characterized by a plurality of angular adjustments, individual ones of the plurality of angular adjustments configured to cause displacement of the subject of interest location between two consecutive frames of the plurality of frames that is not greater than 5% of the frame dimension.

9. The apparatus of claim 5, wherein:

the indication of interest is provided via a remote apparatus configured to determine an occurrence of the context associated with the subject of interest, the context determination configured based on at least one of a location and an action by the subject of interest.

10. The apparatus of claim 9, wherein:

the remote apparatus comprises a wearable device disposed on the subject of interest, the device comprising a user interface element; and

the indication of interest is being communicated by the a wearable device responsive to activation of the element by the subject of interest.

11. The apparatus of claim 10, wherein:

the apparatus is configured to communicate video at the reduced data rate to the wearable device.

12. The apparatus of claim 10, wherein:

the video snippet is characterized by a pre-event duration and a post-event duration, a combination of the pre-event duration and the post-event duration being smaller than the first duration;

the pre-event duration corresponding to video acquired prior to the indication;

the post-event duration corresponding to video acquired subsequent to the indication; and

an amount of time included in the pre-event duration and an amount of time included in the post-event duration are being configured via the wearable device.

13. The apparatus of claim 9, wherein:

the remote apparatus comprises a computerized device configured to determine location of the subject of interest and to communicate the indication based on the location being within a given bound.

14. The apparatus of claim 5, wherein the logic is configured to, based on detection of an object along the trajectory, to modify the trajectory so as to avoid a collision with the object while maintaining the platform within the range.

15. The apparatus of claim 5, wherein:

the trajectory is characterized by a first range and a second range from a subject of interest; and

during the trajectory navigation the controller is configured to;

navigate the platform along a path of a plurality of paths, individual ones of the plurality of paths being maintained within an extent no closer than the first range to the subject of interest and no farther than the second range from the subject of interest; and

select another path of the plurality of paths based on a path adaptation parameter.

16. The apparatus of claim 15, wherein the path adaptation parameter comprises one or more of a time interval and location of the apparatus.

17. The apparatus of claim 5, wherein:

the full data rate exceeds the reduced data rate by at least a factor of four; and

the indication is configured to cause video acquisition at the full data rate at least during a segment of the portion subsequent to the indication.

18. A mobile video acquisition apparatus, comprising:

a camera component to provide video of a user;

a nonvolatile storage capable to store the video for a first duration;

a communications interface configured to detect an indication of interest of a plurality of indication of interest associated with the video being provided; and

a logic configured to produce times stamps in response to detected indications of interest by, based on an individual indication of interest, produce a time stamp;

wherein;

the individual indication of interest is produced by a user wearable device based on an action of the user, the wearable device disposed remote from the video acquisition apparatus and in data communication with the video acquisition apparatus;

the individual time stamp enables automatic access to a respective video snippet of the video stored on the nonvolatile storage corresponding to the individual indication of interest;

the respective snippet being of a snippet duration; and

a combined duration of snippet durations for video snippets corresponding to the detected indications of interest is smaller than the first duration.

19. The mobile video apparatus of claim 18, wherein all of the video snippets have the same snippet duration.

20. The mobile video apparatus of claim 18, wherein at least one of the video snippets has a snippet duration that is different from a snippet duration of another one of the video snippets.