PROCESSING A MEDIA CONTENT BASED ON DEVICE MOVEMENT

• US 20190243144A1
• Filed: 04/18/2019
• Published: 08/08/2019
• Est. Priority Date: 02/27/2017
• Status: Active Grant

• Current Assignee: Snap, Inc.
• Original Assignee: Snap, Inc.
• Inventors: Bamberger, Alex, Hanover, Matthew, Litke, Nathan, Murray, Michael Brian
• Granted Patent: US 11,106,037 B2
• Time in Patent Office: Days
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G03B 17/48 adapted for combination with other photographic or optical apparatus
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06T 3/40 Scaling of whole images or parts thereof, e.g. expanding or contracting
• CPC Class Codes: H04M 2250/22 including a touch pad, a touch sensor or a touch detector digitizers for touch screens G06F3/041
• CPC Class Codes: H04N 13/194 Transmission of image signals
• CPC Class Codes: H04N 13/366 using viewer tracking
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 7/0122 the input and the output signals having different aspect ratios

Abstract

Systems and methods are provided for displaying a first portion of a video, the first portion comprising a subset of the video that fits in a display area of a computing device. The systems and methods further detect movement of the computing device during playback of the first portion of the video, calculate a rotation of the display of the first portion of the video based on a direction of the movement, and cause the display of the first portion of the video to rotate relative to the direction of movement to display a second portion of the video, the second portion comprising a subset of the video that is associated with the direction of movement and that was at least partially not visible in the first portion of the video when displayed in the display area of the computing device.

Claims

1. A method comprising:

displaying, by a computing device, a first portion of a video, the first portion comprising a subset of the video that fits in a display area of the computing device;

detecting, by the computing device, movement of the computing device during playback of the first portion of the video;

calculating a rotation of the display of the first portion of the video based on a direction of the movement; and

causing the display of the first portion of the video to rotate relative to the direction of movement to display a second portion of the video, the second portion comprising a subset of the video that is associated with the direction of movement and that was at least partially not visible in the first portion of the video when displayed in the display area of the computing device.

2. The method of claim 1, wherein the first portion of the video comprises a media overlay.

3. The method of claim 2, wherein the media overlay rotates with the first portion of the video when the display of the first portion of the video is rotated relative to the direction of movement.

4. The method of claim 2, wherein the media overlay comprises text, a sticker, a special effect, or a geo-filter.

5. The method of claim 2, wherein the media overlay was added to the video after creation of the video.

6. The method of claim 1, wherein before calculating the rotation of the display of the first portion of the video based on a direction of movement, the method comprises:

receiving movement data from one or more sensors of the computing device; and

analyzing the movement data to determine the direction of movement.

7. The method of claim 6, wherein the one or more sensors comprise at least one of an accelerometer sensor, a gyroscope sensor, or a gravity sensor.

8. The method of claim 6, wherein the movement data is received from an accelerometer sensor and wherein the movement data comprises the computing device'"'"'s orientation including the rotation of the computing device'"'"'s axes relative to the downward force of gravity.

9. The method of claim 8, wherein the computing device'"'"'s orientation further comprises the computing device'"'"'s rotation around its z-axis directed away from the display area of the computing device.

10. The method of claim 1, further comprising:

detecting parallax motion from the movement data from one or more sensors of the computing device;

analyzing the movement data to determine a direction of movement; and

causing the display of the first portion of the video to slide in the opposite direction of movement.

11. A computing device comprising:

a memory that stores instructions; and

one or more processors configured by the instructions to perform operations comprising;

displaying a first portion of a video, the first portion comprising a subset of the video that fits in a display area of the computing device;

detecting movement of the computing device during playback of the first portion of the video;

calculating a rotation of the display of the first portion of the video based on a direction of the movement; and

causing the display of the first portion of the video to rotate relative to the direction of movement to display a second portion of the video, the second portion comprising a subset of the video that is associated with the direction of movement and that was at least partially not visible in the first portion of the video when displayed in the display area of the computing device.

12. The computing device of claim 11, wherein the first portion of the video comprises a media overlay.

13. The computing device of claim 12, wherein the media overlay rotates with the first portion of the video when the display of the first portion of the video is rotated relative to the direction of movement.

14. The computing device of claim 12, wherein the media overlay comprises text, a sticker, a special effect, or a geo-filter.

15. The computing device of claim 12, wherein the media overlay was added to the video after creation of the video.

16. The computing device of claim 11, wherein before calculating the rotation of the display of the first portion of the video based on a direction of movement, the method comprises:

receiving movement data from one or more sensors of the computing device; and

analyzing the movement data to determine the direction of movement.

17. The computing device of claim 16, wherein the one or more sensors comprise at least one of an accelerometer sensor, a gyroscope sensor, or a gravity sensor.

18. The computing device of claim 16, wherein the movement data is received from an accelerometer sensor and wherein the movement data comprises the computing device'"'"'s orientation including the rotation of the computing device'"'"'s axes relative to the downward force of gravity and wherein the computing device'"'"'s orientation further comprises the computing device'"'"'s rotation around its z-axis directed away from the display area of the computing device.

19. The computing device of claim 11, the operations further comprising:

detecting parallax motion from the movement data from one or more sensors of the computing device;

analyzing the movement data to determine a direction of movement; and

causing the display of the first portion of the video to slide in the opposite direction of movement.

20. A non-transitory computer readable medium comprising instructions stored thereon that are executable by at least one processor to cause a computing device to perform operations comprising:

displaying a first portion of a video, the first portion comprising a subset of the video that fits in a display area of the computing device;

detecting movement of the computing device during playback of the first portion of the video;

calculating a rotation of the display of the first portion of the video based on a direction of the movement; and

causing the display of the first portion of the video to rotate relative to the direction of movement to display a second portion of the video, the second portion comprising a subset of the video that is associated with the direction of movement and that was at least partially not visible in the first portion of the video when displayed in the display area of the computing device.