Automatic adjustment of video orientation

• US 9,762,848 B2
• Filed: 03/15/2013
• Issued: 09/12/2017
• Est. Priority Date: 03/15/2013
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Nowakowski, Maciek S., Szabo, Balazs
• Primary Examiner(s): Wang, Yi
• Application Number:
  US13/838,686
• Publication Number:
  US 20140267901A1
• Time in Patent Office: 1,642 Days
• Field of Search: None
• CPC Class Codes: G06T 3/60 Rotation of whole images or parts thereof
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/234345 the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment
• CPC Class Codes: H04N 21/234363 by altering the spatial resolution, e.g. for clients with a lower screen resolution
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 23/681 Motion detection
• CPC Class Codes: H04N 23/6811 based on the image signal
• CPC Class Codes: H04N 5/2628 Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
• CPC Class Codes: H04N 7/0117 involving conversion of the spatial resolution of the incoming video signal for graphics images G09G2340/0407

Abstract

Methods, systems and computer program products for automatic adjustment of video orientation are provided. A computer-implemented method may include receiving a video comprising a plurality of image frames, detecting an orientation change in the video, determining a standard orientation for the video, and adjusting the video to the standard orientation by resizing one or more of the image frames and by rotating one or more of the image frames to the standard orientation. The adjusted video in the standard orientation then may be provided to a user.

Claims

1. A computer-implemented method comprising:

receiving, by a video sharing service, a video recorded by a video recording device of a mobile device of a user, the video comprising a plurality of image frames;

determining, by a processor of the video sharing service, that an orientation change and shaking of the mobile device have occurred during recording of the video, wherein the orientation change and shaking are determined for the video based on data stored by the video recording device in each of the plurality of image frames of the video, the data comprising orientation information of a corresponding image frame of the video and position information of the corresponding image frame of the video, the position information being indicative of shaking;

notifying, by the processor, the user of the orientation change and shaking of the mobile device during the recording of the video;

determining, by the processor, a standard orientation and a baseline alignment for the video, the standard orientation being determined based on a most common orientation detected throughout the video, and one or more parameters of a video player to present the video;

adjusting, by the processor, the video to the standard orientation and the baseline alignment, wherein the adjusting comprises;

automatically resizing one or more of the plurality of image frames in the video based on the standard orientation;

automatically rotating one or more of the plurality of image frames in the video to the standard orientation; and

automatically adjusting one or more of the plurality of image frames in the video to the baseline alignment to correct shaking; and

providing, by the processor, a user interface comprising the video player to present a preview of the adjusted video in the standard orientation and baseline alignment to the user on the mobile device.

2. The computer-implemented method of claim 1, wherein determining that the orientation change and shaking of the mobile device have occurred during recording of the video comprises:

comparing, by the processor, a video recording device position associated with a first image frame in the video to a second video recording device position associated with a second image frame in the video.

3. The computer-implemented method of claim 1, wherein adjusting the video to the standard orientation further comprises:

determining a degree of rotation required to adjust the image frame to the standard orientation.

4. The computer-implemented method of claim 1, wherein automatically resizing comprises cropping one or more of the image frames.

5. The computer-implemented method of claim 1, wherein automatically resizing comprises extending display resolution of one or more of the image frames.

6. The computer-implemented method of claim 5, wherein extending display resolution of one or more of the image frames comprises:

defining a square of longest sides of the video based on a landscape orientation of the video and a portrait orientation of the video; and

extending resolution of image frames to the square of the longest sides of the video.

7. The computer-implemented method of claim 5, wherein the resizing comprises:

calculating a standard display size for the video using shortest sides of the video; and

cropping portions of the one or more of the plurality of image frames that extend beyond the calculated display size.

8. The computer-implemented method of claim 1, further comprising:

providing an interface to allow the user to adjust the video to the standard orientation.

9. The computer-implemented method of claim 1, wherein the standard orientation is further determined based on an original orientation of the video.

10. The computer-implemented method of claim 1, wherein the standard orientation is further determined based on a stored user preference.

11. The computer-implemented method of claim 1, wherein the standard orientation is further determined based on a user selection.

12. The computer-implemented method of 1, wherein the one or more parameters of the video player comprises at least one of an orientation of the video player, a size of the video player, an orientation of a display device providing the video player, or a size of the display device.

13. A non-transitory computer readable medium having instructions stored thereon, that when executed by a processor, cause the processor to perform operations comprising:

receiving, by a video sharing service, a video recorded by a video recording device of a mobile device of a user, the video comprising a plurality of image frames;

determining, by the processor of the video sharing service, that an orientation change and shaking of the mobile device have occurred during recording of the video, wherein the orientation change and shaking are determined for the video based on data stored by the video recording device in each of the plurality of image frames of the video, the data comprising orientation information of a corresponding image frame of the video and position information of the corresponding image frame of the video, the position information being indicative of shaking;

notifying, by the processor, the user of the orientation change and shaking of the mobile device during the recording of the video;

determining, by the processor, a standard orientation and a baseline alignment for the video, the standard orientation being determined based on a most common orientation detected throughout the video, and one or more parameters of a video player to present the video;

adjusting, by the processor, the video to the standard orientation and the baseline alignment, wherein the adjusting comprises;

automatically resizing one or more of the plurality of image frames in the video based on the standard orientation;

automatically rotating one or more of the plurality of image frames in the video to the standard orientation; and

automatically adjusting one or more of the plurality of image frames in the video to the baseline alignment to correct shaking; and

providing, by the processor, a user interface comprising the video player to present a preview of the adjusted video in the standard orientation and baseline alignment to the user on the mobile device.

14. The computer readable medium of claim 13, wherein determining that the orientation change and shaking of the mobile device have occurred during recording of the video comprises:

comparing, by the processor, a video recording device position associated with a first image frame in the video to a second video recording device position associated with a second image frame in the video.

15. The computer readable medium of claim 13, wherein adjusting the video to the standard orientation comprises:

determining a degree of rotation required to adjust the image frame to the standard orientation.

16. A system, comprising:

a memory; and

a processor coupled to the memory to;

receive a video recorded by a video recording device of a mobile device of a user, the video comprising a plurality of image frames;

determine that an orientation change and shaking of the mobile device have occurred during recording of the video, wherein the orientation change and shaking are determined for the video based on data stored by the video recording device in each of the plurality of image frames of the video, the data comprising orientation information of a corresponding image frame of the video and position information of the corresponding image frame of the video, the position information being indicative of shaking;

notify the user of the orientation change and shaking of the mobile device during the recording of the video;

determine a standard orientation and a baseline alignment for the video, the standard orientation being determined based on a most common orientation detected throughout the video, and one or more parameters of a video player to present the video;

adjust the video to the standard orientation and the baseline alignment, wherein the adjusting comprises;

automatically resizing one or more of the plurality of image frames in the video based on the standard orientation;

automatically rotating one or more of the plurality of image frames in the video to the standard orientation; and

automatically adjusting one or more of the plurality of image frames in the video to the baseline alignment to correct shaking; and

provide a user interface comprising the video player to present a preview of the adjusted video in the standard orientation and baseline alignment to the user on the mobile device.

17. The system of claim 16, wherein to determine that the orientation change and shaking of the mobile device have occurred during recording of the video, the processor is to:

compare a video recording device position associated with a first image frame in the video to a second video recording device position associated with a second image frame in the video.

18. The system of claim 16, wherein to adjust the video to the standard orientation, the processor is to:

determine a degree of rotation required to adjust the image frame to the standard orientation.