PROCESSING A MEDIA CONTENT BASED ON DEVICE MOVEMENT

• US 20180246329A1
• Filed: 08/09/2017
• Published: 08/30/2018
• Est. Priority Date: 02/27/2017
• Status: Active Grant

• Current Assignee: Snap, Inc.
• Original Assignee: Snap, Inc.
• Inventors: Bamberger, Alex, Hanover, Matthew, Litke, Nathan, Murray, Michael Brian
• Granted Patent: US 10,564,425 B2
• Time in Patent Office: Days
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G03B 17/48 adapted for combination with other photographic or optical apparatus
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06T 3/40 Scaling of whole images or parts thereof, e.g. expanding or contracting
• CPC Class Codes: H04M 2250/22 including a touch pad, a touch sensor or a touch detector digitizers for touch screens G06F3/041
• CPC Class Codes: H04N 13/194 Transmission of image signals
• CPC Class Codes: H04N 13/366 using viewer tracking
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 7/0122 the input and the output signals having different aspect ratios

Abstract

Systems and methods provide for detecting movement of the computing device during playback of media content on a display of the computing device, receiving movement data from one or more sensors of the computing device, analyzing the movement data to determine a direction of movement, calculating a rotation of the display of the media content based on the direction of movement, and causing the display of the media content to rotate relative to the direction of movement to display a portion of the media content associated with the direction of movement.

Claims

1. A method comprising:

detecting, by a computing device, movement of the computing device during playback of media content on a display of the computing device;

receiving, by a computing device, movement data from one or more sensors of the computing device;

analyzing, by the computing device, the movement data to determine a direction of movement;

calculating a rotation of the display of the media content based on the direction of movement; and

causing the display of the media content to rotate relative to the direction of movement to display a portion of the media content associated with the direction of movement.

2. The method of claim 1, wherein the one or more sensors comprise at least one or an accelerometer sensor, a gyroscope sensor, and a gravity sensor.

3. The method of claim 1, wherein the movement data is received from an accelerometer sensor and wherein the movement data comprises the computing device'"'"'s orientation including the rotation of the computing device'"'"'s axes relative to the downward force of gravity.

4. The method of claim 3, wherein the computing device'"'"'s orientation further comprises the computing device'"'"'s rotation around its z-axis directed away from the display of the computing device.

5. The method of claim 1, wherein the movement data is received from an accelerometer sensor and a gyroscope sensor, and the method further comprises:

determining that the computing device is held in a flat orientation; and

calculating the rotation of the display of the media content based on the movement data from the gyroscope sensor.

6. The method of claim 1, wherein the movement data is received from an accelerometer sensor and a gyroscope sensor, and the method further comprises:

determining that the computing device is held in a nearly flat orientation; and

calculating the rotation of the display of the media content based on the movement data from both the accelerometer sensor and the gyroscope sensor.

7. The method of claim 1, wherein the movement data is received from an accelerometer, and the method further comprising:

determining that the computing device is held in a nearly flat orientation; and

calculating the rotation of the display of the media content based on the movement data from the gyroscope sensor.

8. The method of claim 1, wherein the media content was originally captured using a circular wide angle lens.

9. The method of claim 1, wherein displaying the portion of the media content associated with the direction of movement comprises displaying a portion of the media content that was not previously viewable on a display of the computing device.

10. The method of claim 1, further comprising:

detecting parallax motion from the movement data from the one or more sensors;

analyzing the movement data to determine a direction of movement; and

causing the display of media content to slide in the opposite direction of movement.

11. The method of claim 1, further comprising:

receiving pinch gesture data from the computing device operating system;

analyzing the pinch gesture data to determine a pinch scale and a pinch velocity;

calculating a display size of the media content based on the pinch scale and pinch velocity; and

causing the media content to display based on the display size.

12. A computing device comprising:

a processor; and

a computer readable medium coupled with the processor, the computer readable medium comprising instructions stored thereon that are executable by the processor to cause a computing device to perform operations comprising;

detecting movement of the computing device during playback of media content on a display of the computing device;

receiving movement data from one or more sensors of the computing device;

analyzing the movement data to determine a direction of movement;

calculating a rotation of the display of the media content based on the direction of movement; and

causing the display of the media content to rotate relative to the direction of movement to display a portion of the media content associated with the direction of movement.

13. The computing device of claim 12, wherein the movement data is received from an accelerometer sensor and wherein the movement data comprises the computing device'"'"'s orientation including the rotation of the computing device'"'"'s axes relative to the downward force of gravity, and wherein the computing device'"'"'s orientation further comprises the computing device'"'"'s rotation around its z-axis directed away from the display of the computing device.

14. The computing device of claim 12, wherein the movement data is received from an accelerometer sensor and a gyroscope sensor, and the operations further comprise:

determining that the computing device is held in a flat orientation; and

calculating the rotation of the display of the media content based on the movement data from the gyroscope sensor.

15. The computing device of claim 12, wherein the movement data is received from an accelerometer sensor and a gyroscope sensor, and the operations further comprise:

determining that the computing device is held in a nearly flat orientation; and

calculating the rotation of the display of the media content based on the movement data from both the accelerometer sensor and the gyroscope sensor.

16. The computing device of claim 12, wherein the movement data is received from an accelerometer, and the operations further comprise:

determining that the computing device is held in a nearly flat orientation; and

calculating the rotation of the display of the media content based on the movement data from the gyroscope sensor.

17. The computing device of claim 12, wherein the media content was originally captured using a circular wide angle lens.

18. The computing device of claim 12, wherein displaying the portion of the media content associated with the direction of movement comprises displaying a portion of the media content that was not previously viewable on a display of the computing device.

19. The computing device of claim 12, the operations further comprising:

receiving pinch gesture data from the computing device operating system;

analyzing the pinch gesture data to determine a pinch scale and a pinch velocity;

calculating a display size of the media content based on the pinch scale and pinch velocity; and

causing the media content to display based on the display size.

20. A non-transitory computer readable medium comprising instructions stored thereon that are executable by at least one processor to cause a computing device to perform operations comprising:

detecting movement of the computing device during playback of media content on a display of the computing device;

receiving movement data from one or more sensors of the computing device;

analyzing the movement data to determine a direction of movement;

calculating a rotation of the display of the media content based on the direction of movement; and

causing the display of the media content to rotate relative to the direction of movement to display a portion of the media content associated with the direction of movement.