Video rotation system and method

• US 10,270,984 B2
• Filed: 12/14/2017
• Issued: 04/23/2019
• Est. Priority Date: 12/02/2010
• Status: Active Grant

• Current Assignee: BBY Solutions Incorporated (Best Buy Co., Inc.)
• Original Assignee: BBY Solutions Incorporated (Best Buy Co., Inc.)
• Inventors: Nourbakhsh, Farhad, Brown, Steven
• Primary Examiner(s): Misleh, Justin P.
• Application Number:
  US15/842,094
• Publication Number:
  US 20180109738A1
• Time in Patent Office: 495 Days
• Field of Search: None
• CPC Class Codes: H04N 1/387 Composing, repositioning or otherwise geometrically modifying originals
• CPC Class Codes: H04N 1/3872 Repositioning or masking
• CPC Class Codes: H04N 1/3877 Image rotation
• CPC Class Codes: H04N 23/60 Control of cameras or camera modules
• CPC Class Codes: H04N 23/6812 based on additional sensors, e.g. acceleration sensors
• CPC Class Codes: H04N 23/683 performed by a processor, e.g. controlling the readout of an image memory
• CPC Class Codes: H04N 5/2628 Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation

Abstract

A video recording device is described having an orientation sensor. The recording device rotates video data received from an image sensor according to signals received from the orientation sensor. The rotation occurs before the video data is compressed according to a video codec and stored on a tangible storage device. By rotating the video data before compression, the need for intensive, post-capture video rotation on the compressed video file is eliminated.

Claims

1. A video capture device, comprising:

a) a sensor module having an image sensor that converts an optical image into a raw electronic image;

b) a video buffer that stores the raw electronic image, the raw electronic image being unprocessed by a video codec, the video buffer storing the raw electronic image in a matrix with rows and columns;

c) a first silicon chip separate from the sensor module, the first silicon chip having a digital signal processor that converts input image data to a video data file according to a video codec;

d) a non-transient memory device that stores the video data file;

e) an orientation sensor that provides an orientation signal reflecting an orientation of the video capture device; and

f) a second silicon chip separate from the sensor module and from the first silicon chip, the second silicon chip having transformation circuitry that receives the orientation signal and rotates the raw electronic image in the video buffer accordingly, wherein the transformation circuitry provides the rotated electronic image to the digital signal processor as the input image data, further wherein the transformation circuitry rotates the raw electronic image by one of 90, 180, or 270 degrees by altering a read order of the rows and columns as the raw electronic image is read from the video buffer.

2. A method for processing video data from a video capture device, comprising:

a) using an image sensor on a sensor module, converting an optical image into a raw electronic image;

b) storing the raw electronic image in a matrix with rows and columns on a video buffer, the raw electronic image being unprocessed by a video codec,

c) using a digital signal processor on a first silicon chip that is separate from the sensor module, converting input image data to a video data file according to the video codec;

d) storing the video data file in a non-transient memory device;

e) providing, by an orientation sensor, an orientation signal reflecting an orientation of the video capture device;

f) using transformation circuitry of a second silicon chip, which is separate from the sensor module and from the first silicon chip,

i) receiving the orientation signal and rotating the raw electronic image in the video buffer by one of 90, 180, or 270 degrees, by altering a read order of the rows and columns as the raw electronic image is read from the video buffer, and

ii) providing the rotated electronic image to the digital signal processor as the input image data.

3. The method of claim 2, wherein the orientation sensor comprises a sensor selected from the set of an accelerometer and a gyroscope.

4. The method of claim 2, wherein the transformation circuitry includes programming instructions stored on a memory device and a processor for implementing those instructions.

5. The method of claim 2, wherein the transformation circuitry comprises a programmable logic device programmed to implement transformation logic.

6. The method of claim 2, wherein the transformation circuitry stores the rotated electronic image on a secondary buffer external to the digital signal processor, further wherein the rotated electronic image is read from the secondary buffer by the digital signal processor.

7. The method of claim 6, wherein the transformation circuitry and the secondary buffer form part of one programmable logic device.

8. The method of claim 6, wherein the image sensor and video buffer are located on a sensor module.

9. A video capture device, comprising:

a) an image sensor, which converts a sequence of optical images into a sequence of frames, each such frame containing a raw electronic image;

b) a first buffer, upon which the sequence of frames are stored without processing the sequence of frames by a video codec, the first buffer representing each frame in the sequence of frames as a matrix with rows and columns;

c) an orientation sensor that, based on a first orientation and a second orientation of the video capture device, creates a first orientation signal, applicable to a first subsequence of the sequence of frames, and a second orientation signal, applicable to a second subsequence of the sequence of frames;

d) a transformation circuit, which,

(i) in accordance with the first orientation signal, creates a first square electronic image, by rotating a frame from the first subsequence by a first angle of 90, 180, or 270 degrees clockwise, wherein the rotation is effected by altering a read order of the rows and columns of the frame from the first subsequence as the frame from the first subsequence is read from the first buffer, and padding the rotated frame by adding padding pixel data; and

(ii) in accordance with the second orientation signal, creates a second square electronic image, by rotating a frame from the second subsequence by a second angle of 90, 180, or 270 degrees clockwise, wherein the rotation is effected by altering the read order of the rows and columns of the frame from the second subsequence as the frame from the second subsequence is read from the first buffer, and padding the rotated frame by adding padding pixel data, and wherein the second angle is distinct from the first angle;

e) a digital signal processor, which receives the first and second square electronic images, and creates a single video image file by applying a video codec to a sequence of square electronic images that includes the first and second square electronic images; and

f) a non-transitory memory device, upon which the video image file is stored.

10. The video capture device of claim 9, further comprising:

g) a second buffer, in which the first and second square electronic images are stored before the first and second square electronic images are transferred to the digital signal processor.

11. The video capture device of claim 9, wherein the video codec is selected from at least one of MPEG-2 video, MPEG-4 video, AVC/H.264, and Windows Media.

12. The video capture device of claim 9, wherein rotating the frame from the first subsequence further comprises:

i) receiving a request for image data from a digital signal processor, the digital signal processor expecting data to be transmitted in a first order;

ii) analyzing the first orientation signal to determine a degree of rotation;

iii) delivering the frame from the first subsequence to the digital signal processor in a second order different from the first order for the purpose of implementing the degree of rotation.

13. The video capture device of claim 9, wherein the transformation circuit, upon determining based on an orientation signal from the orientation sensor that a rotation angle for the video capture device exceeds a first predefined angle for more than a predefined time period, rotates a frame from the sequence of frames 90 degrees clockwise.

14. The video capture device of claim 9, wherein the transformation circuit, upon determining based on an orientation signal from the orientation sensor that a rotation angle for the video capture device exceeds a first predefined angle, rotates a frame from the sequence of frames, from a non-rotated orientation to an orientation that is rotated 90 degrees clockwise.

15. The video capture device of claim 14, wherein no rotation is allowed within a predetermined time period of at least one second after a previous rotation.

16. The video capture device of claim 14, wherein the transformation circuit, upon determining based on an orientation signal from the orientation sensor that a rotation angle for the video capture device is less than a second predefined angle, rotates the frame from the sequence of frames, from the orientation that is rotated 90 degrees clockwise to a non-rotated orientation.

17. The video capture device of claim 16, wherein the first predefined angle is greater than 45 degrees clockwise and the second predefined angle is less than 45 degrees clockwise.