SYSTEM AND METHOD FOR ADJUSTING ORIENTATION OF CAPTURED VIDEO

• US 20140146205A1
• Filed: 11/27/2012
• Published: 05/29/2014
• Est. Priority Date: 11/27/2012
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Xu, Wentao, Qiu, Gang, Zhang, Xiaopeng, Zhou, Xiaoming, Qurashi, Farrukh
• Granted Patent: US 9,516,229 B2
• Time in Patent Office: Days
• US Class Current: 348/239
• CPC Class Codes: H04N 23/6812 based on additional sensors, e.g. acceleration sensors
• CPC Class Codes: H04N 23/683 performed by a processor, e.g. controlling the readout of an image memory

Abstract

Described herein is a system and method for adjusting the orientation of captured video utilizing the data received from a built-in inertial measurement unit such as an accelerometer. During video capture, the device may be held in a position that is not fully vertical or horizontal, and thus not match the true orientation of a scene. This can cause the captured video to appear rotated during playback at the same angle of rotation as the video capture device. The described system can adjust the playback orientation of the rotated video by utilizing sensor data captured during the same time as the video was captured.

Claims

1. A method of encoding a video captured on a video capture device, comprising:

reading orientation data from the video capture device as a video of a scene is being captured;

generating a rotation matrix based on the orientation data;

adjusting the orientation of the captured video to match the true orientation of the scene; and

encoding the adjusted captured video.

2. The method of claim 1, wherein the orientation data is inertial measurement data from an accelerometer or a gyroscope.

3. The method of claim 1, wherein the video capture device comprises a mobile phone or tablet.

4. The method of claim 1, wherein encoding the adjusted captured video comprises cropping the adjusted captured video.

5. The method of claim 1, further comprising storing the adjusted captured video to a memory in the video capture device.

6. The method of claim 1, wherein the rotated captured video is transmitted to another device with video display capability.

7. A system for encoding a video capture on a video capture device, comprising:

an image sensor configured to capture a video of a scene;

an inertial measurement unit configured to provide orientation data from the video capture device;

a rotation module configured to generate a rotation matrix based on the orientation data and adjust the orientation of the captured video to match a true orientation of the scene; and

an encoder configured to encode the adjusted captured video.

8. The system of claim 7, wherein the inertial measurement unit comprises an accelerometer or a gyroscope.

9. The system of claim 7, wherein the video capture device comprises a mobile phone or tablet.

10. The system of claim 7, wherein the rotation module is configured to crop the captured video.

11. The system of claim 7, further comprising a storage configured to store the adjusted captured video.

12. The system of claim 7, further comprising a transmitter for transmitting the adjusted captured video to a second device with video display capability.

13. A system of encoding a video captured on a video capture device, comprising:

means for reading orientation data from the video capture device as a video of a scene is being captured;

means for generating a rotation matrix based on the orientation data;

means for adjusting the orientation of the captured video to match the true orientation of the scene; and

means for encoding the adjusted captured video.

14. The system of claim 13, wherein the means for reading orientation data comprises an inertial measurement unit configured to provide orientation data.

15. The system of claim 13, wherein the means for generating a rotation matrix based on the inertial measurement unit data comprises a rotation module configured to be operated by a processor.

16. The system of claim 13, wherein the means for encoding the rotated captured video comprises a video encoder.

17. A non-transient computer readable medium configured to store instructions that when executed by a processor perform a method comprising:

reading orientation data from the video capture device as a video of a scene is being captured;

generating a rotation matrix based on the orientation data;

adjusting the orientation of the captured video to match the true orientation of the scene; and

encoding the adjusted captured video.

18. The computer readable medium of claim 17, wherein the orientation data is inertial measurement data from an accelerometer or a gyroscope.

19. The computer readable medium of claim 17, wherein the orientation data is accelerometer data.

20. The computer readable medium of claim 17, wherein encoding the adjusted captured video comprises cropping the adjusted captured video.