MULTI-ANGLE VIDEO EDITING BASED ON CLOUD VIDEO SHARING

• US 20160345035A1
• Filed: 05/18/2015
• Published: 11/24/2016
• Est. Priority Date: 05/18/2015
• Status: Active Grant

• Current Assignee: Beijing Shunyuan Kaihua Technology Limited
• Original Assignee: Zepp Labs, Inc. (Zepp Health Corporation)
• Inventors: Han, Zheng, Xu, Jie
• Granted Patent: US 9,554,160 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: H04N 21/21805 enabling multiple viewpoints, e.g. using a plurality of cameras
• CPC Class Codes: H04N 21/2225 Local VOD servers
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/23424 involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
• CPC Class Codes: H04N 21/2353 specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata
• CPC Class Codes: H04N 21/2743 Video hosting of uploaded data from client
• CPC Class Codes: H04N 21/42202 environmental sensors, e.g. for detecting temperature, luminosity, pressure, earthquakes
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/436 Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
• CPC Class Codes: H04N 21/437 Interfacing the upstream path of the transmission network, e.g. for transmitting client requests to a VOD server flow control in data networks H04L47/10; streaming protocols, e.g. RTP or RTCP, H04L65/65; scheduling or organising the servicing of application requests in data packet switching networks H04L67/60
• CPC Class Codes: H04N 21/816 involving special video data, e.g 3D video
• CPC Class Codes: H04N 21/8547 involving timestamps for synchronizing content

Abstract

A solution for composing a multi-angle video from videos captured from different angles is disclosed. A request to compose a multi-angle video is received from a target user, requesting composing a multi-angle video using a video captured by the target user and videos captured by other users nearby the target user. A plurality of videos captured by nearby users are identified based on metadata associated with the captured videos, e.g., geolocation and timestamps of the videos, and presented to the target user. A video sequence including two or more videos from the plurality of videos captured by nearby users is received and the multi-angle video is composed based on the received video sequence.

Claims

1. A computer-implemented method for composing a multi-angle video at a client device, the method comprising:

capturing a video to be used in a multi-angle video by a client device associated with a target user, the multi-angle video comprising at least a portion of the captured video and a plurality of portions of other videos captured by other users nearby the target user;

determining a plurality of metadata associated with the captured video, the plurality of metadata associated with the captured video comprises at least one from the group consisting of;

geolocation information describing a location of the client device,

timestamp indicating when the video was captured by the client device,

identification of key-frames extracted from the captured video, and

identification of lower resolution images corresponding to the extracted key-frames; and

sending the captured video and associated metadata to a computer server.

3. The computer-implemented method of claim 1, further comprising:

determining geolocation information describing a location of the client device;

synchronizing a timestamp associated with the capture video with a clock of the computer server;

extracting a plurality of key-frames of the captured video; and

generating lower resolution images corresponding to the extracted key-frames.

4. The computer-implemented method of claim 3, wherein extracting a plurality of key-frames from the captured video comprises:

extracting a video frame from the captured video for every predefined time interval.

5. The computer-implemented method of claim 3, wherein extracting a plurality of key-frames from the captured video further comprises:

extracting a video frame from the captured video for very predefined set of video frames of the captured video.

6. The computer-implemented method of claim 1, wherein the geolocation comprises at least one from a group comprising:

a latitude, a longitude, an altitude, and an orientation associated with the client device.

7. The computer-implemented method of claim 1, further comprising:

sending a request to compose a multi-angle video including the captured video to the computer server;

receiving a plurality of portions of other videos captured by other users nearby the target user;

selecting one or more portions of other videos; and

generating the multi-angle video based on the selected portions of other videos and the video captured by the client device associated with the target user.

8. The computer-implemented method of claim 7, wherein generating the multi-angle video comprises:

combining the selected portions of other videos captured by other users nearby the target user with the video captured by the client device associated with the target user according to timestamps associated with the selected videos.

2. (canceled)

9. A computer-implemented method for composing a multi-angle video, the method comprising:

receiving, from a target user, a request to compose a multi-angle video;

receiving a video captured by the target user and a plurality videos captured by other users nearby the target user;

identifying the plurality of videos captured by the other users nearby the target user;

presenting, to the target user, the plurality of videos captured by the other users nearby the target user;

receiving, from the target user, a selection of portions of videos captured by the target user and the other users nearby the target user, wherein the selection comprises at least a first portion of the video captured by the target user, and a second portion of a video captured by one user nearby the target user; and

composing a multi-angle video based on the selected portions of the videos.

10. The computer-implemented method of claim 9, wherein the nearby users are users that were recording a video concurrently with the target user, and wherein the nearby users were located within a threshold distance of a location of the target user when the target user was recording the video.

12. The computer-implemented method of claim 9, further comprising:

extracting the first portion from the video captured by the target user, and extracting the second portion from the video captured by the one user nearby the target user, and

combining the first portion and the second portion to generate the multi-angle video.

13. The computer-implemented method of claim 9, wherein identifying the plurality of videos captured by the other users comprises:

determining a geolocation and a time associated with a video captured by the target user; and

identifying other users that captured a video that overlapped in time with the video captured by the target user and have a geolocation within a threshold distance of the geolocation associated with the video captured by the target user.

14. The computer-implemented method of claim 9 wherein identifying the plurality of videos captured by the other users comprises:

determining a geolocation and a time associated with a video captured by the target user; and

identifying a geographical boundary based on the determined geolocation; and

identifying other users that captured a video that overlapped in time with the video captured by the target user and have a geolocation within the identified geographical boundary.

15. The computer-implemented method of claim 14, wherein the geographical boundary is a circle centered at the determined geolocation associated with the video captured by the target user.

16. The computer-implemented method of claim 14, wherein identifying the geographical boundary comprises:

identifying a geographical feature nearby the determined geolocation associated with the video captured by the target user; and

identifying a geographical boundary associated with the identified geographical feature.

17. The computer-implemented method of claim 9, further comprising:

responsive to determining that a video from the plurality of videos captured by the other users is unavailable, sending a request to the user associated with the unavailable video to provide the unavailable video.

11. (canceled)

18. A non-transitory computer readable storage medium storing executable computer program instruction for composing a multi-angle video at a client device, the instruction when executed by a computer processor cause the computer processor to:

multi-angle video by a client device associated with a target user, the multi-angle video comprising at least a portion of the captured video and a plurality of portions of other videos captured by other users nearby the target user;

determining a plurality of metadata associated with the captured video, the plurality of metadata associated with the captured video comprises at least one of the following;

geolocation information describing a location of the client device,

timestamp indicating when the video was captured by the client device,

identification of key-frames extracted from the captured video, and

identification of lower resolution images corresponding to the extracted key-frames; and

send the captured video and associated metadata a the computer server.

20. The computer readable storage medium of claim 18, wherein the instructions when executed by a computer processor further cause the computer processor to:

determine geolocation information describing a location of the client device;

synchronize a timestamp associated with the capture video with a clock of the computer server;

extract a plurality of key-frames of the captured video; and

generate lower resolution images corresponding to the extracted key-frames.

21. The computer readable storage medium of claim 18, wherein the instructions when executed by a computer processor further cause the computer processor to:

send a request to compose a multi-angle video including the captured video to the computer server;

receive a plurality of portions of other videos captured by other users nearby the target user;

select one or more portions of other videos; and

generate the multi-angle video based on the selected portions of other videos and the video captured by the client device associated with the target user.

19. (canceled)

22. A non-transitory computer readable storage medium storing executable computer program instruction for composing a multi-angle video, the instruction when executed by a computer processor cause the computer processor to:

receive, from a target user, a request to compose a multi-angle video;

receive a video captured by the target user and a plurality videos captured by other users nearby the target user;

identify the plurality of videos captured by the other users nearby the target user;

present, to the target user, the plurality of videos captured by the other users nearby the target user;

receive, from the target user, a selection of portions of videos captured by the target user and the other users nearby the target user, wherein the selection comprises at least a first portion of the video captured by the target user, and a second portion of a video captured by one user nearby the target user; and

compose a multi-angle video based on the selected portions of the videos.

23. The computer readable storage medium of claim 22, wherein the the other users are users that were recording a video concurrently with the target user, and wherein the the other users were located within a threshold distance of a location of the target user when the target user was recording the video.

24. The computer readable storage medium of claim 22 wherein the instructions for identifying the plurality of videos captured by the other users, when executed by the computer processor cause the processor to:

determine a geolocation and a time associated with a video captured by the target user; and

identify a geographical boundary based on the determined geolocation; and

identify other users that captured a video that overlapped in time with the video captured by the target user and have a geolocation within the identified geographical boundary.

25. The computer readable storage medium of claim 22, wherein the instructions when executed by a computer processor further cause the computer processor to:

responsive to determining that a video from the plurality of videos captured by the other users is unavailable, send a request to the user associated with the unavailable video to provide the unavailable video.