Processing and formatting video for interactive presentation

• US 10,622,023 B2
• Filed: 07/01/2016
• Issued: 04/14/2020
• Est. Priority Date: 07/01/2016
• Status: Active Grant

• Current Assignee: Snap, Inc.
• Original Assignee: Snap, Inc.
• Inventors: Li, Jia, Litke, Nathan, Paredes, Jose Jesus (Joseph), Sheth, Rahul Bhupendra, Szeto, Daniel, Xu, Ning, Yang, Jianchao
• Primary Examiner(s): Pendleton, Brian T
• Assistant Examiner(s): Saint Cyr, Jean D
• Application Number:
  US15/201,079
• Publication Number:
  US 20180007444A1
• Time in Patent Office: 1,383 Days
• Field of Search: None
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/102 Programmed access in sequence to addressed parts of tracks of operating record carriers access by moving the head G11B3/08, G11B5/54, G11B7/085, G11B21/022; by moving the record carrier G11B15/005, G11B17/005, by driving of both record carrier and head G11B15/1816

Abstract

Systems and methods are described for receiving, at a computing device, a plurality of video sources related to an event. For each video source of the plurality of video sources, the systems and methods further provide for analyzing, by the computing device, the video source of the plurality of video sources to determine a device orientation to associate with the video source, associating, by the computing device, the device orientation with the video source, and storing, by the computing device, the video source and the associated device orientation.

Claims

1. A method comprising:

receiving, from a plurality of client devices, at a server system, a plurality of media items each comprising video content related to an event, wherein the video content is captured by each of the plurality of client devices using at least one device orientation, the at least one device orientation comprising a landscape orientation, a portrait orientation, or a tilt angle orientation;

storing, by the server system, each media item of the plurality of media items and the at least one device orientation corresponding to each media item, and associating each media item of the plurality of media items with the event;

receiving from a first computing device, by the server system, a first device orientation detected for the first computing device during display of a first media item related to the event;

determining a second media item, of the stored media items, that was captured in a device orientation corresponding to the first device orientation detected for the first computing device;

providing, by the server system to the first computing device, the second media item that was captured in the device orientation corresponding to the first device orientation detected for the first computing device to be displayed on the first computing device;

detecting, by the server system, a change from the first device orientation to a second device orientation for the first computing device;

in response to the detected change to the second device orientation for the first computing device, determining a third media item that was captured in a device orientation corresponding to the second device orientation detected for the first computing device; and

providing, by the server computer to the first computing device, the third media item that was captured in the device orientation corresponding to the second device orientation detected for the first computing device to be displayed on the first computing device.

2. The method of claim 1, further comprising:

detecting, by the server system, a device orientation of a second computing device;

determining a stored media item that was captured in a device orientation corresponding to the device orientation detected for the second computing device; and

providing, by the server system to the second computing device, the stored media item that was captured in the device orientation corresponding to the device orientation of the second computing device, wherein video content of the stored media item is displayed on the second computing device.

3. The method of claim 1, wherein the at least one device orientation is a landscape view or a portrait view.

4. The method of claim 1, wherein the at least one device orientation is determined based on an angle of a subject of the video content.

5. The method of claim 4, wherein the at least one device orientation is a tilt angle based on the angle of the subject of the video content.

6. The method of claim 2, wherein detecting the device orientation of the second computing device is based on receiving a device orientation from the second computing device.

7. The method of claim 1, further comprising:

analyzing the video content of each media item of the plurality of media items to determine at least one region or object to associate with the media item;

associating the at least one region or object with the media item; and

storing the association of the at least one region or object with the media item.

8. The method of claim 7, further comprising:

detecting an input via a second computing device indicating a selection of a region or object of a video;

determining a stored media item associated with the selected region or object of the video; and

providing the stored media item associated with the selected region or object, wherein the stored media item associated with the selected region or object is displayed on the second computing device.

9. A server computer comprising:

a processor; and

a computer readable medium coupled with the processor, the computer readable medium comprising instructions stored thereon that are executable by the processor to cause the server computer to perform operations comprising;

receiving, from a plurality of client devices a plurality of media items each comprising video content related to an event, wherein the video content is captured by each of the plurality of client devices using at least one device orientation, the at least one device orientation comprising a landscape orientation, a portrait orientation, or a tilt angle orientation;

storing each media item of the plurality of media items and the at least one device orientation corresponding to each media item, and associating each media item of the plurality of media items with the event;

receiving from a first computing device a first device orientation detected for the first computing device during display of a first media item related to the event;

determining a second media item, of the stored media items, that was captured in a device orientation corresponding to the first device orientation detected for the first computing device;

providing, to the first computing device, the second media item that was captured in the device orientation corresponding to the first device orientation detected for the first computing device to be displayed on the first computing device;

detecting a change from the first device orientation to a second device orientation for the first computing device;

in response to the detected change to the second device orientation for the first computing device, determining a third media item that was captured in a device orientation corresponding to the second device orientation detected for the first computing device; and

providing, to the first computing device, the third media item that was captured in the device orientation corresponding to the second device orientation detected for the first computing device to be displayed on the first computing device.

10. The server computer of claim 9, the operations further comprising:

detecting, by the server system, a device orientation of a second computing device;

determining a stored media item that was captured in a device orientation corresponding to the device orientation detected for the second computing device; and

providing, by the server system to the second computing device, the stored media item that was captured in the device orientation corresponding to the device orientation of the second computing device, wherein video content of the stored media item is displayed on the second computing device.

11. The server computer of claim 9, wherein the at least one device orientation is a landscape view or a portrait view.

12. The server computer of claim 9, wherein the at least one device orientation is determined based on an angle of a subject of the video content and wherein the at least one device orientation is a tilt angle based on the angle of the subject of the video content.

13. The server computer of claim 10, wherein the stored media item that was captured in the device orientation corresponding to the device orientation for the second computing device is provided to the second computing device and the second computing device displays the stored media item.

14. The server computer of claim 9, the operations further comprising:

analyzing the video content of each media item of the plurality of media items to determine at least one region or object to associate with the media item;

associating the at least one region or object with the media item; and

storing the association of the at least one region or object with the media item.

15. The server computer of claim 9, the operations further comprising:

detecting an input via a second computing device indicating a selection of a region or object of a video;

determining a stored media item associated with the selected region or object of the video; and

providing the stored media item associated with the selected region or object, wherein the stored media item associated with the selected region or object is displayed on the second computing device.

16. A non-transitory computer readable medium comprising instructions stored thereon that are executable by at least one processor to cause a computing device to perform operations comprising:

receiving, from a plurality of client devices a plurality of media items each comprising video content related to an event, wherein the video content is captured by each of the plurality of client devices using at least one device orientation, the at least one device orientation comprising a landscape orientation, a portrait orientation, or a tilt angle orientation;

storing each media item of the plurality of media items and the at least one device orientation corresponding to each media item, and associating each media item of the plurality of media items with the event;

receiving from a first computing device a first device orientation detected for the first computing device during display of a first media item related to the event;

determining a second media item, of the stored media items, that was captured in a device orientation corresponding to the first device orientation detected for the first computing device;

providing, to the first computing device, the second media item that was captured in the device orientation corresponding to the first device orientation detected for the first computing device to be displayed on the first computing device;

detecting a change from the first device orientation to a second device orientation for the first computing device;

in response to the detected change to the second device orientation for the first computing device, determining a third media item that was captured in a device orientation corresponding to the second device orientation detected for the first computing device; and

providing, to the first computing device, the third media item that was captured in the device orientation corresponding to the second device orientation detected for the first computing device to be displayed on the first computing device.

17. The non-transitory computer readable medium of claim 16, wherein the at least one device orientation is determined based on an angle of a subject of the video content.

18. The non-transitory computer readable medium of claim 16, wherein the at least one device orientation is a tilt angle based on the angle of the subject of the video content.

19. The non-transitory computer readable medium of claim 16, the operations further comprising:

analyzing the video content of each media item of the plurality of media items to determine at least one region or object to associate with the media item;

associating the at least one region or object with the media item; and

storing the association of the at least one region or object with the media item.

20. The non-transitory computer readable medium of claim 16, the operations further comprising:

detecting an input via a second computing device indicating a selection of a region or object of a video;

determining a stored media item associated with the selected region or object of the video; and

providing the stored media item associated with the selected region or object, wherein the stored media item associated with the selected region or object is displayed on the second computing device.