AUTOMATIC ADJUSTMENT OF VIDEO ORIENTATION

• US 20170374314A1
• Filed: 09/11/2017
• Published: 12/28/2017
• Est. Priority Date: 03/15/2013
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Nowakowski, Maciek S., Szabo, Balazs
• Granted Patent: US 10,469,797 B2
• Time in Patent Office: Days
• CPC Class Codes: G06T 3/60 Rotation of whole images or parts thereof
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/234345 the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment
• CPC Class Codes: H04N 21/234363 by altering the spatial resolution, e.g. for clients with a lower screen resolution
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 23/681 Motion detection
• CPC Class Codes: H04N 23/6811 based on the image signal
• CPC Class Codes: H04N 5/2628 Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
• CPC Class Codes: H04N 7/0117 involving conversion of the spatial resolution of the incoming video signal for graphics images G09G2340/0407

Abstract

Methods, systems and computer program products for automatic adjustment of video orientation are provided. A computer-implemented method may include receiving a video comprising a plurality of image frames, determining that shaking of a mobile device has occurred during recording of the video, determining a baseline alignment for the video, adjusting the video in view of the baseline alignment, and providing a user interface comprising the video player to present a preview of the adjusted video to a user on the mobile device.

Claims

1. A computer-implemented method comprising:

receiving, by a processing device, a video recorded by a video recording device of a mobile device of a user, the video comprising a plurality of image frames;

determining, by the processor, that shaking of the mobile device has occurred during recording of the video, wherein the shaking is determined for the video based on data stored by the video recording device for the plurality of image frames of the video, the data comprising position information of a corresponding image frame of the video, the position information being indicative of shaking;

determining, by the processor, a baseline alignment for the video;

adjusting, by the processor, the video in view of the baseline alignment, wherein the adjusting comprises automatically adjusting one or more of the plurality of image frames in the video to the baseline alignment to correct shaking; and

providing, by the processor, a user interface comprising the video player to present a preview of the adjusted video to a user on the mobile device.

2. The computer-implemented method of claim 1, wherein determining that the shaking of the mobile device has occurred during recording of the video comprises:

comparing a video recording device position associated with a first image frame in the video to a second video recording device position associated with a second image frame in the video.

3. The computer-implemented method of claim 1, further comprising:

notifying the user of the shaking of the mobile device during the recording of the video.

4. The computer-implemented method of claim 1, further comprising:

determining that an orientation change of the mobile device has occurred during recording of the video, wherein the orientation change is determined for the video based on data stored by the video recording device in each of the plurality of image frames of the video, the data comprising orientation information of a corresponding image frame of the video;

5. The computer-implemented method of claim 4, further comprising:

determining a standard orientation for the video, the standard orientation being determined based on a most common orientation detected throughout the video, and one or more parameters of a video player to present the video.

6. The computer-implemented method of claim 4, further comprising:

adjusting the video to the standard orientation.

7. The computer-implemented method of claim 6, wherein adjusting the video to the standard orientation further comprises:

determining a degree of rotation required to adjust the image frame to the standard orientation.

8. The computer-implemented method of claim 6, wherein adjusting the video to the standard orientation further comprises:

providing an interface to allow the user to adjust the video to the standard orientation.

9. The computer-implemented method of claim 6, wherein adjusting the video to the standard orientation further comprises:

automatically resizing one or more of the plurality of image frames in the video based on the standard orientation; and

automatically rotating one or more of the plurality of image frames in the video to the standard orientation.

10. A computer readable medium having instructions stored thereon, that when executed by a processor, cause the processor to perform operations comprising:

receiving a video recorded by a video recording device of a mobile device of a user, the video comprising a plurality of image frames;

determining that shaking of the mobile device has occurred during recording of the video, wherein the shaking is determined for the video based on data stored by the video recording device for the plurality of image frames of the video, the data comprising position information of a corresponding image frame of the video, the position information being indicative of shaking;

determining a baseline alignment for the video;

adjusting the video in view of the baseline alignment, wherein the adjusting comprises automatically adjusting one or more of the plurality of image frames in the video to the baseline alignment to correct shaking; and

providing a user interface comprising the video player to present a preview of the adjusted video to a user on the mobile device.

11. The computer readable medium of claim 10, wherein determining that the shaking of the mobile device has occurred during recording of the video comprises:

comparing a video recording device position associated with a first image frame in the video to a second video recording device position associated with a second image frame in the video.

12. The computer readable medium of claim 10, wherein the operations further comprise:

notifying the user of the shaking of the mobile device during the recording of the video.

13. The computer readable medium of claim 10, wherein the operations further comprise:

determining that an orientation change of the mobile device has occurred during recording of the video, wherein the orientation change is determined for the video based on data stored by the video recording device in each of the plurality of image frames of the video, the data comprising orientation information of a corresponding image frame of the video;

14. The computer readable medium of claim 13, wherein the operations further comprise:

determining, by the processor, a standard orientation for the video, the standard orientation being determined based on a most common orientation detected throughout the video, and one or more parameters of a video player to present the video.

15. The computer readable medium of claim 14, wherein the operations further comprise:

adjusting the video to the standard orientation.

16. The computer readable medium of claim 15, wherein adjusting the video to the standard orientation further comprises:

determining a degree of rotation required to adjust the image frame to the standard orientation.

17. The computer readable medium of claim 15, wherein adjusting the video to the standard orientation further comprises:

providing an interface to allow the user to adjust the video to the standard orientation.

18. A system comprising:

a memory; and

a processing device, coupled to the memory, to;

receive a video recorded by a video recording device of a mobile device of a user, the video comprising a plurality of image frames;

determine that shaking of the mobile device has occurred during recording of the video, wherein the shaking is determined for the video based on data stored by the video recording device for the plurality of image frames of the video, the data comprising position information of a corresponding image frame of the video, the position information being indicative of shaking;

determine a baseline alignment for the video;

adjust the video in view of the baseline alignment, wherein the adjusting comprises automatically adjusting one or more of the plurality of image frames in the video to the baseline alignment to correct shaking; and

provide a user interface comprising the video player to present a preview of the adjusted video to a user on the mobile device.

19. The system of claim 18, wherein to determine that the shaking of the mobile device has occurred during recording of the video, the processing device is to compare a video recording device position associated with a first image frame in the video to a second video recording device position associated with a second image frame in the video.

20. The system of claim 18, wherein the processing device is to:

notify the user of the shaking of the mobile device during the recording of the video.