Rotation stabilization

• US 9,998,667 B2
• Filed: 12/01/2016
• Issued: 06/12/2018
• Est. Priority Date: 08/23/2012
• Status: Active Grant

• Current Assignee: AWES Me Incorporated
• Original Assignee: SmugMug Incorporated
• Inventors: Nichols, Samuel, Macaskill, Don
• Primary Examiner(s): Berhan, Ahmed A
• Application Number:
  US15/367,034
• Publication Number:
  US 20170085797A1
• Time in Patent Office: 558 Days
• CPC Class Codes: C07D 409/12 linked by a chain containing hetero atoms as chain links
• CPC Class Codes: G06T 2210/22 Cropping
• CPC Class Codes: G06T 3/60 Rotation of whole images or parts thereof
• CPC Class Codes: H04N 1/2112 using still video cameras
• CPC Class Codes: H04N 23/52 Elements optimising image sensor operation, e.g. for electromagnetic interference [EMI] protection or temperature control by heat transfer or cooling elements
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/635 Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/6812 based on additional sensors, e.g. acceleration sensors
• CPC Class Codes: H04N 23/683 performed by a processor, e.g. controlling the readout of an image memory
• CPC Class Codes: H04N 23/69 Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
• CPC Class Codes: H04N 23/80 Camera processing pipelines; Components thereof
• CPC Class Codes: H04N 5/2628 Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation

Abstract

Embodiments of the present invention include methods and apparatus for the rotational stabilization of images and video. Rotational stabilization of images includes determining an amount of degrees of cant or tilt of an image capturing device, and capturing an image. The captured image is rotated an angular distance equal to the amount of degrees of tilt of the image capturing device. The rotated image is then cropped. The determining, rotating, and cropping are generally performed automatically by the image capturing device without user action at the time of capturing the image.

Claims

1. A method of recording video, comprising:

receiving an instruction to capture a video with a video capture device;

in response to receiving the instruction, capturing the video in a first orientation;

detecting a change in orientation of the video capture device from the first orientation to a second orientation different than the first orientation;

capturing the video in the second orientation;

receiving an instruction to stop capturing the video; and

in response to receiving the instruction to stop capturing the video,

processing the captured video, wherein processing the captured video comprises;

orienting the video captured in the first orientation to the second orientation by determining a degree of cant between the first orientation and the second orientation for each frame of the video captured during the change in orientation;

rotating each frame of the video capture by the determined degree of cant; and

cropping each rotated frame.

2. The method of claim 1, further comprising adding black bars to each cropped frame so that videos captured in the first orientation have the same height or width as videos captured in the second orientation.

3. The method of claim 1, wherein the degree of cant is determined using one or more accelerometers.

4. The method of claim 3, wherein the determined degree of cant corresponding to each frame of the captured video is stored to a data storage while capturing the video in the first orientation, capturing the video in the second orientation, and capturing the video during the change in orientation.

5. The method of claim 1, further comprising storing the processed captured video to a data storage.

6. The method of claim 5, further comprising storing the video captured in the first orientation, the video captured in the second orientation, and the video captured during the change in orientation to the data storage.

7. A non-transitory computer readable medium having a sequence of instructions for recording a video, which when executed by a processing unit of a system, causes the system to:

receive an instruction to capture a video with a video capture device;

in response to receiving the instruction, capture the video in a first orientation;

detect a change in orientation of the video capture device from the first orientation to a second orientation different than the first orientation;

capture the video in the second orientation;

receive an instruction to stop capturing the video; and

in response to receiving the instruction to stop capturing the video, process the captured video, wherein processing the captured video comprises;

orienting the video captured in the first orientation to the second orientation by determining a degree of cant between the first orientation and the second orientation for each frame of the video captured during the change in orientation;

rotating each frame of the video capture by the determined degree of cant; and

cropping each rotated frame.

8. The non-transitory computer readable medium of claim 7, wherein the instructions further cause the system to add black bars to each cropped frame so that videos captured in the first orientation have the same height or width as videos captured in the second orientation.

9. The non-transitory computer readable medium of claim 7, wherein the degree of cant is determined using one or more accelerometers.

10. The non-transitory computer readable medium of claim 9, wherein the determined degree of cant corresponding to each frame of the captured video is stored to a data storage while capturing the video in the first orientation, capturing the video in the second orientation, and capturing the video during the change in orientation.

11. The non-transitory computer readable medium of claim 7, wherein the instruction further causes the system to store the processed captured video to a data storage.

12. The non-transitory computer readable medium of claim 11, wherein the instruction further causes the system to store the video captured in the first orientation and the video captured in the second orientation to the data storage.

13. A system, comprising:

a camera;

a processing unit;

one or more accelerometers; and

a non-transitory computer readable medium having a sequence of instructions for recording a video, which when executed by a processing unit of a system, causes the system to;

receive an instruction to capture a video with the camera;

in response to receiving the instruction, capture the video in a first orientation;

detect a change in orientation of the camera from the first orientation to a second orientation different than the first orientation;

capture the video in the second orientation;

receive an instruction to stop capturing the video; and

in response to receiving the instruction to stop capturing the video, process the captured video, wherein processing the captured video comprises;

orienting the video captured in the first orientation to the second orientation by determining a degree of cant between the first orientation and the second orientation for each frame of the video captured during the change in orientation;

rotating each frame of the video capture by the determined degree of cant; and

cropping each rotated frame.

14. The system of claim 13, wherein the instruction further causes the system to add black bars to each cropped frame so that videos captured in the first orientation and videos captured during the change in orientation have the same height or width videos captured in the second orientation.

15. The system of claim 13, wherein the degree of cant is determined using one or more accelerometers.

16. The system of claim 15, wherein the determined degree of cant corresponding to each frame of the captured video is stored to a data storage while capturing the video in the first orientation, capturing the video in the second orientation, and capturing the video during the change in orientation.

17. The system of claim 13, wherein the instruction further causes the system to store the processed captured video to a data storage.

18. The system of claim 17, wherein the instruction further causes the system to store the video captured in the first orientation, the video captured in the second orientation, and the video captured during the change in orientation to the data storage.

19. The system of claim 13, wherein the system is a smart phone.

20. The system of claim 13, wherein the system is a digital camera.