System and methods for time lapse video acquisition and compression

• US 9,992,443 B2
• Filed: 05/30/2014
• Issued: 06/05/2018
• Est. Priority Date: 05/30/2014
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Titi, Justin S., Brasket, Jeffrey A., Harris, Elliott B., Manzari, Johnnie, Clarke, Graham
• Primary Examiner(s): Tran, Thai
• Assistant Examiner(s): HASAN, SYED Y
• Application Number:
  US14/292,316
• Publication Number:
  US 20150350591A1
• Time in Patent Office: 1,467 Days
• Field of Search: 386226, 386233, 386248, 386329, 3482201, 3482221, 34823199
• CPC Class Codes: G08B 13/19665 Details related to the storage of video surveillance data television signal recording H04N5/76
• CPC Class Codes: H04N 23/60 Control of cameras or camera modules
• CPC Class Codes: H04N 25/50 Control of the SSIS exposure
• CPC Class Codes: H04N 5/7605 on discs or drums H04N5/781, H04N5/805, H04N5/83, H04N5/85 take precedence
• CPC Class Codes: H04N 5/765 Interface circuits between an apparatus for recording and another apparatus
• CPC Class Codes: H04N 5/772 the recording apparatus and the television camera being placed in the same enclosure
• CPC Class Codes: H04N 5/783 Adaptations for reproducing at a rate different from the recording rate
• CPC Class Codes: H04N 5/915 for field- or frame-skip recording or reproducing
• CPC Class Codes: H04N 9/8042 involving data reduction

Abstract

Techniques and devices for acquiring and compressing timelapse video are described. The techniques are adaptive, in that the acquisition frame rate is adapted and captured images are periodically deleted during filming. To implement the method, a user need not know ahead of time how long the source video will be acquired. Regardless of the acquisition time, the resulting video is automatically edited to provide a timelapse clip of a predefined length or of a length within a predefined range.

Claims

1. A non-transitory program storage device, readable by a programmable control device and comprising instructions stored thereon to cause one or more processing units to:

execute one or more iterations of an operation, each iteration comprising;

obtaining, by a first camera, a first plurality of images at a first capture frame rate;

storing the first plurality of images;

discarding a portion of the stored first plurality of images in response to a predefined critical number of images that were obtained at the first capture frame rate being stored;

selecting, in response to the discarding, a second capture frame rate, the second capture frame rate being lower than the first capture frame rate;

obtaining, by the first camera, a second plurality of images at the second capture frame rate;

storing the second plurality of images with the first plurality of images that were not discarded;

cease execution of the operation; and

encode the stored first plurality of images and the stored second plurality of images to produce a video, the video having a playback frame rate and a playback duration, wherein either the playback frame rate or the playback duration is predefined prior to the obtaining of the first plurality of images and the second plurality of images.

2. The non-transitory program storage device of claim 1, wherein discarding a portion of the stored first plurality of images comprises deleting half of the stored first plurality of images.

3. The non-transitory program storage device of claim 1, wherein the operation further comprises analyzing an attribute of the first plurality of images, and wherein discarding a portion of the stored first plurality of images is based on the analyzing.

4. The non-transitory program storage device of claim 1, wherein the predefined critical number of images is based on a range of playback durations at a predefined playback frame rate.

5. The non-transitory program storage device of claim 1, wherein the predefined critical number of images is based on a predefined playback duration.

6. The non-transitory program storage device of claim 1, wherein the playback duration is predefined and the playback frame rate is determined by the predefined playback duration.

7. The non-transitory program storage device of claim 1, wherein the encoding is according to a video compression format.

8. A computer-implemented method for producing a video, comprising:

executing one or more iterations of an operation, each iteration comprising;

obtaining, by a first camera, a first plurality of images at a first capture frame rate with an image sensor;

storing the first plurality of images;

discarding a portion of the stored first plurality of images in response to a predefined critical number of images that were obtained at the first capture frame rate being stored;

selecting, in response to the discarding, a second capture frame rate, the second capture frame rate being lower than the first capture frame rate;

obtaining, by the first camera, a second plurality of images at the second capture frame rate with the image sensor;

storing the second plurality of images with the first plurality of images that were not discarded;

ceasing execution of the operation; and

encoding the stored first plurality of images and the stored second plurality of images to produce a video, the video having a playback frame rate and a playback duration, wherein either the playback frame rate or the playback duration is predefined prior to the obtaining of the first plurality of images and the second plurality of images.

9. The method of claim 8, wherein discarding a portion of the stored first plurality of images comprises deleting half of the stored first plurality of images.

10. The method of claim 8, further comprising analyzing an attribute of the first plurality of images, and wherein discarding a portion of the stored first plurality of images is based on the analyzing.

11. The method of claim 8, wherein the predefined critical number of images is based on a range of playback durations at a predefined playback frame rate.

12. The method of claim 8, wherein the predefined critical number of images is based on a predefined playback duration.

13. The method of claim 8, wherein the playback duration is predefined and wherein the playback frame rate is determined by the predefined playback duration.

14. The method of claim 8, wherein the encoding is according to a video compression format.

15. The method of claim 14, wherein the video compression format is an MPEG format.

16. An electronic device comprising:

an image sensor,

a memory operatively coupled to the image sensor, and

at least one processor operatively coupled to the memory and the image sensor, wherein the at least one processor is programmed to;

cause the image sensor to acquire a first plurality of images separated by a first image capture time interval;

cause the memory to store the first plurality of images;

discard a portion of the stored first plurality of images that were obtained with the first image capture time interval in response to a predefined critical number of images being stored;

select, in response to the discarding, a second image capture time interval, the second image capture time interval being longer than the first image capture time interval;

cause the image sensor to obtain a second plurality of images separated by the second image capture time interval; and

cause the memory to store the second plurality of images with the first plurality of images that were not discarded.

17. The electronic device of claim 16, wherein the processor is further programmed to analyze an attribute of each image of the first plurality of images.

18. The electronic device of claim 17, wherein the attribute is selected from the group consisting of exposure value, motion parameters, sharpness, blur, and facial recognition.

19. The electronic device of claim 17, wherein discarding the portion of the stored first plurality of images is based on the analyzing an attribute of each image of the first plurality of images.

20. The electronic device of claim 16, further comprising a video codec, wherein the processor is programmed to cause the video codec to encode the stored first plurality of images and the stored second plurality of images to produce a video.