Processing a media content based on device movement

• US 10,564,425 B2
• Filed: 08/09/2017
• Issued: 02/18/2020
• Est. Priority Date: 02/27/2017
• Status: Active Grant

• Current Assignee: Snap, Inc.
• Original Assignee: Snap, Inc.
• Inventors: Bamberger, Alex, Hanover, Matthew, Litke, Nathan, Murray, Michael Brian
• Primary Examiner(s): Mengistu, Amare
• Assistant Examiner(s): Zubajlo, Jennifer L
• Application Number:
  US15/673,215
• Publication Number:
  US 20180246329A1
• Time in Patent Office: 923 Days
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G03B 17/48 adapted for combination with other photographic or optical apparatus
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06T 3/40 Scaling of whole images or parts thereof, e.g. expanding or contracting
• CPC Class Codes: H04M 2250/22 including a touch pad, a touch sensor or a touch detector digitizers for touch screens G06F3/041
• CPC Class Codes: H04N 13/194 Transmission of image signals
• CPC Class Codes: H04N 13/366 using viewer tracking
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 7/0122 the input and the output signals having different aspect ratios

Abstract

Systems and methods provide for detecting movement of the computing device during playback of media content on a display of the computing device, receiving movement data from one or more sensors of the computing device, analyzing the movement data to determine a direction of movement, calculating a rotation of the display of the media content based on the direction of movement, and causing the display of the media content to rotate relative to the direction of movement to display a portion of the media content associated with the direction of movement.

Claims

1. A method comprising:

displaying, by a computing device, a first portion of a circular video that was captured in a circular video format, the first portion comprising of an area of the circular video that fits in a display area of the computing device and excluding an area of the circular video that does not fit in the display area of the computing device;

detecting, by the computing device, movement of the computing device during playback of the first portion of the circular video;

receiving, by a computing device, movement data from one or more sensors of the computing device;

analyzing, by the computing device, the movement data to determine a direction of movement;

calculating a rotation of the display of the first portion of the circular video based on the direction of movement; and

causing the display of the first portion of the circular video to slide in a direction opposite to the direction of movement up to an edge of a predefined region, the predefined region being larger than the display area of the computing device and smaller than the circular video, to display a second portion of the circular video, the second portion comprising an area of the circular video including a sub-portion of the first portion of the circular video and an area that was not visible in the first portion of the circular video.

2. The method of claim 1, wherein the one or more sensors comprise at least one or an accelerometer sensor, a gyroscope sensor, and a gravity sensor.

3. The method of claim 1, wherein the movement data is received from an accelerometer sensor and wherein the movement data comprises the computing device'"'"'s orientation including the rotation of the computing device'"'"'s axes relative to the downward force of gravity.

4. The method of claim 3, wherein the computing device'"'"'s orientation further comprises the computing device'"'"'s rotation around its z-axis directed away from the display area of the computing device.

5. The method of claim 1, wherein the movement data is received from an accelerometer sensor and a gyroscope sensor, and the method further comprises:

determining that the computing device is held in a flat orientation; and

calculating the rotation of the display of the first portion of the circular video based on the movement data from the gyroscope sensor.

6. The method of claim 1, wherein the movement data is received from an accelerometer sensor and a gyroscope sensor, and the method further comprises:

determining that the computing device is held in a nearly flat orientation; and

calculating the rotation of the display of the first portion of the circular video based on the movement data from both the accelerometer sensor and the gyroscope sensor.

7. The method of claim 1, wherein the circular video was originally captured using a circular wide angle lens.

8. The method of claim 1, further comprising:

receiving pinch gesture data from the computing device operating system;

analyzing the pinch gesture data to determine a pinch scale and a pinch velocity;

calculating a display size of the circular video based on the pinch scale and pinch velocity; and

causing the circular video to display based on the display size.

9. The method of claim 1, wherein the first portion of the circular video comprise a media overlay, and wherein the media overlay rotates with the first portion of the circular video when the display of the first portion of the circular video is rotated relative to the direction of movement.

10. The method of claim 1, wherein the first portion of the circular video slides at a decelerating rate as it moves out towards an edge of the circular video and slides at a constant rate as it moves toward a center portion of the circular video.

11. The method of claim 1, wherein the first portion of the circular video slides following a quadratic curve when sliding out from a center of the circular video and follows a linear curve when moving towards the center of the circular video.

12. The method of claim 1, wherein the first portion of the circular video slides at a rate of a specified radians per second.

13. The method of claim 1, wherein the size of the predefined region is determined based on a diameter of the circular video.

14. A computing device comprising:

a processor; and

a computer readable medium coupled with the processor, the computer readable medium comprising instructions stored thereon that are executable by the processor to cause a computing device to perform operations comprising;

displaying a first portion of a circular video that was captured in a circular video format, the first portion comprising of an area of the circular video that fits in a display area of the computing device and excluding an area of the circular video that does not fit in the display area of the computing device;

detecting movement of the computing device during playback of the first portion of the circular video;

receiving movement data from one or more sensors of the computing device;

analyzing the movement data to determine a direction of movement;

calculating a rotation of the display of the first portion of the circular video based on the direction of movement; and

causing the display of the first portion of the circular video to slide in a direction opposite to the direction of movement up to an edge of a predefined region, the predefined region being larger than the display area of the computing device and smaller than the circular video, to display a second portion of the circular video, the second portion comprising an area of the circular video including a sub-portion of the first portion of the circular video and an area that was not visible in the first portion of the circular video.

15. The computing device of claim 14, wherein the movement data is received from an accelerometer sensor and wherein the movement data comprises the computing device'"'"'s orientation including the rotation of the computing device'"'"'s axes relative to the downward force of gravity, and wherein the computing device'"'"'s orientation further comprises the computing device'"'"'s rotation around its z-axis directed away from the display of the computing device.

16. The computing device of claim 14, wherein the movement data is received from an accelerometer sensor and a gyroscope sensor, and the operations further comprise:

determining that the computing device is held in a flat orientation; and

calculating the rotation of the display of the first portion of the circular video based on the movement data from the gyroscope sensor or calculating the rotation of the display of the first portion of the circular video based on the movement data from both the accelerometer sensor and the gyroscope sensor.

17. The computing device of claim 14, wherein the movement data is received from a gyroscope sensor, and the operations further comprise:

determining that the computing device is held in a nearly flat orientation; and

calculating the rotation of the display of the first portion of the circular video based on the movement data from the gyroscope sensor.

18. The computing device of claim 14, wherein the circular video was originally captured using a circular wide angle lens.

19. The computing device of claim 14, the operations further comprising:

receiving pinch gesture data from the computing device operating system;

analyzing the pinch gesture data to determine a pinch scale and a pinch velocity;

calculating a display size of the circular video based on the pinch scale and pinch velocity; and

causing the circular video to display based on the display size.

20. A non-transitory computer readable medium comprising instructions stored thereon that are executable by at least one processor to cause a computing device to perform operations comprising:

displaying a first portion of a circular video that was captured in a circular video format, the first portion comprising of an area of the circular video that fits in a display area of the computing device and excluding an area of the circular video that does not fit in the display area of the computing device;

detecting movement of computing device during playback of the first portion of the circular video;

receiving movement data from one or more sensors of the computing device;

analyzing the movement data to determine a direction of movement;

calculating a rotation of the display of the first portion of the circular video based on the direction of movement; and

causing the display of the first portion of the circular video to slide in a direction opposite to the direction of movement up to an edge of a predefined region, the predefined region being larger than the display area of the computing device and smaller than the circular video, to display a second portion of the circular video, the second portion comprising an area of the circular video including a sub-portion of the first portion of the circular video and an area that was not visible in the first portion of the circular video.