VIDEO CAPTURE WITH FRAME RATE BASED ON ESTIMATE OF MOTION PERIODICITY

• US 20170359549A1
• Filed: 06/09/2016
• Published: 12/14/2017
• Est. Priority Date: 06/09/2016
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Baran, Stanley J., Das, Barnan, Hicks, Richmond
• Granted Patent: US 10,165,222 B2
• Time in Patent Office: Days
• CPC Class Codes: H04N 21/00 Selective content distribution, e.g. interactive television or video on demand [VOD] real-time bi-directional transmission of motion video data H04N7/14 ; broadcast or conference over packet switching networks H04L12/18
• CPC Class Codes: H04N 23/6812 based on additional sensors, e.g. acceleration sensors
• CPC Class Codes: H04N 23/684 performed by controlling the image sensor readout, e.g. by controlling the integration time
• CPC Class Codes: H04N 25/531 by controlling rolling shutters in CMOS SSIS
• CPC Class Codes: H04N 5/772 the recording apparatus and the television camera being placed in the same enclosure

Abstract

Video capture is described in which the video frame rate is based on an estimate of motion periodicity. In one example, a period of motion of a moving object is determined at a sensor device. A frame capture rate of a video camera that is attached to the moving object is adjusted based on the period of motion. Video frames are captured at the adjusted frame rate, and the captured video frames are stored.

Claims

1. A method comprising

determining a period of motion of a moving object at a sensor device, wherein the moving object is moving relative to an inertial reference;

adjusting a frame capture rate of a video camera attached to the moving object bused on the period of motion;

capturing video frames of a scene in the field of view of the video camera that is not moving relative to the inertial reference at the adjusted frame rate; and

storing the captured video frames.

2. The method of claim 1, wherein determining a period of motion comprises:

collecting movement data from an inertial sensor connected to a video camera;

autocorrelating the movement data;

finding peaks in the auto-correlated movement data; and

determining a period for at least some of the peaks.

3. The method of claim 1, wherein determining a period of motion comprises:

estimating a motion using an inertial sensor;

estimating periodicity of the motion; and

estimating a period of motion using the periodicity.

4. The method of claim 1, wherein determining a period of motion comprises analyzing captured frames from the video camera using video motion estimation.

5. The method of claim 1, wherein the sensor device is attached to the camera device through the moving object.

6. The method of claim 5, wherein the moving object is a person.

7. The method of claim 1, further comprising performing a frame rate conversion on the captured video frames before storing.

8. The method of claim 7, wherein performing a frame rate conversion comprises converting the frame rate to a standardized and fixed frame rate.

9. The method of claim 1, further comprising encoding the captured video frames before storing.

10. The method of claim 1 wherein adjusting a frame capture rate comprises adjusting a blanking interval between frames.

11. The method of claim 1 wherein adjusting a frame capture rate comprises adjusting the frame rate without changing the frame capture duration of a rolling shutter.

12. An apparatus comprising:

a sensor device to determine a period of motion of a moving object, wherein the moving object is moving relative to an inertial reference;

a camera device attached to the moving object to capture video frames of a scene in the field of view of the video camera that is not moving relative to the inertial reference at a frame capture rate, the video camera being coupled to the sensor device to receive the period of motion and to adjust the frame capture rate based on the period of motion; and

a storage device to store the captured video frames.

13. The apparatus of claim 12, wherein the sensor device determines the period of motion by:

collecting movement data from an inertial sensor,

autocorrelating the movement data;

finding peaks in the auto-correlated movement data; and

determining a period for at least some of the peaks.

14. The apparatus of claim 12, wherein the sensor device determines a period of motion by:

estimating a motion using an inertial sensor;

estimating periodicity of the motion; and

estimating a period of motion using the periodicity.

15. The apparatus of claim 12, wherein the sensor device is coupled to camera device to receive captured frames and wherein the sensor device determines a period of motion by analyzing the captured frames received from the camera device using video motion estimation.

16. The apparatus of claim 12, wherein the camera device further performs a frame rate conversion on the captured video frames before storing.

17. The apparatus of claim 12 wherein adjusting a frame capture rate comprises adjusting a blanking interval between frames.

18. A portable video camera comprising:

a sensor device to determine a period of motion of a moving object to which the camera is attached, wherein the moving object is moving relative to an inertial reference;

a camera device to capture video frames of a scene in the field of view of the video camera that is not moving relative to the inertial reference at a frame capture rate, the camera device being coupled to the sensor device to receive the period of motion and to adjust the frame capture rate based on the period of motion; and

a storage device to store the captured video frames locally.

19. The camera of claim 18, wherein the camera further encodes the captured video frames before storing.

20. The camera of claim 18 wherein camera device adjusts the frame capture rate by adjusting the frame rate without changing the frame capture duration of a rolling shutter.