Method and electronic device for generating multiple point of view video

• US 10,186,299 B2
• Filed: 06/19/2014
• Issued: 01/22/2019
• Est. Priority Date: 07/10/2013
• Status: Active Grant

• Current Assignee: HTC Corporation
• Original Assignee: HTC Corporation
• Inventors: Wang, Yuan-Kang, Lee, Wen-Chuan
• Primary Examiner(s): Kelley, Christopher S
• Assistant Examiner(s): Tarko, Asmamaw G
• Application Number:
  US14/308,716
• Publication Number:
  US 20150015680A1
• Time in Patent Office: 1,678 Days
• CPC Class Codes: G06F 16/4393 Multimedia presentations, e.g. slide shows, multimedia albums
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: G11B 27/19 by using information detectable on the record carrier
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: G11B 27/30 on the same track as the main recording
• CPC Class Codes: H04N 13/30 Image reproducers optical systems for producing stereoscopic or other three-dimensional effects G02B30/00
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/47205 for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
• CPC Class Codes: H04N 9/806 with processing of the sound signal

Abstract

The present disclosure proposes a method and an electronic device of generating a multiple point of view (MPOV) video. In the present disclosure, the method for generating the MPOV video may include a step of obtaining a plurality of media contents, determining, from the plurality of media contents, a first media content and a second media content as relevant media contents, wherein each of the relevant media contents comprises a scene of a same event, identifying an overlap section comprising a portion of the first media content overlapping with a portion of the second media content, identifying a highlight period by analyzing a content feature of the portion of the first media content and the portion of the second media content within the overlap section, and generating the MPOV video based on the first media content and the second media content within the highlight period.

Claims

1. A method of generating a multiple point of view (MPOV) video, applicable to an electronic device, the method comprising:

identifying, by a processor, from the plurality of media contents, a first media content and a second media content as relevant media contents of a same event;

identifying, by the processor, an overlap period which the first media content and the second media content overlap in time;

identifying a plurality of continuous images captured in a zoom-in shot type or a zoom-out shot type as a target media content of the relevant media contents by analyzing a content feature of the relevant media contents associated with the overlap period;

identifying, by the processor, a target duration of the target media content as a highlight period within the overlap period, wherein the target duration is less than a duration of the overlap period; and

generating, by the processor, at least a portion of the MPOV video based on the first media content and the second media content within the highlight period and excluding a remaining time period of the overlap period, wherein the highlight period and the remaining time period are different durations in the overlap period, and the highlight period plus the remaining time period is equal to the whole overlap period,

wherein a frame of the MPOV video comprises at least two portion, the first media content and the second media content within the highlight period recording a proximal same moment of the same event from different perspective are respectively displayed in the at least two portion of the frame of the MPOV video.

2. The method of claim 1, wherein identifying the highlight period by analyzing the content feature of the relevant media contents associated with the overlap period comprises:

analyzing the content feature of the first media content and the second media content by determining whether the first media content or the second media content within the overlap period is a still image.

3. The method of claim 1, further comprising:

analyzing the content feature of the first media content and the second media content by determining a shot type of the first media content and the second media content based on a ratio of an object that occupies a frame of the first media content or the second media content within the overlap period; and

identifying the highlight period among the overlap period based on the shot type of the first media content or the second media content associated with the overlap period.

4. The method of claim 3, wherein the shot type comprises at least one of a closed-up shot, a zoom-out shot and a zoom-in shot.

5. The method of claim 1, wherein identifying the overlap period which the first media content and the second media overlap in time comprises:

identifying the overlap period based on a timestamp of each of the first media content and the second media content.

6. The method of claim 5, wherein the timestamp comprises a start time and an end time of the first media content and the second media content.

7. The method of claim 1, wherein the step of identifying the overlap period which the first media content and the second media content overlap in time comprises:

identifying the overlap period based on audio information of the first media content and the second media content.

8. The method of claim 1, wherein the first media content and the second media content are captured from different points of view of the same event by different electronic devices.

9. The method of claim 1, wherein the first media content and the second media content comprise a still image, video, burst images, and an audio recording.

10. The method of claim 1, further comprises selecting a footage having a predetermined duration from the overlap period among the relevant media contents as the highlight period.

11. An electronic device, comprising:

a processor, configured for;

identifying, from the plurality of media contents, a first media content and a second media content as relevant media contents of a same event;

identifying an overlap period which the first media content and the second media content overlap in time;

identifying a plurality of continuous images captured in a zoom-in shot type or a zoom-out shot type as a target media content of the relevant media contents by analyzing a content feature of the relevant media contents associated with the overlap period;

identifying a target duration period of the target media content as a highlight period within the overlap period, wherein the target duration is less than a duration of the overlap period; and

generating at least a portion of the MPOV video based on the first media content and the second media content within the highlight period and excluding a remaining time period of the overlap period, wherein the highlight period and the remaining time period are different durations in the overlap period, and the highlight period plus the remaining time period is equal to the whole overlap period,

wherein a frame of the MPOV video comprises at least two portions, the first media content and the second media content within the highlight period recording a proximal same moment of the same event from different perspective are respectively displayed in the at least two portions of the frame of the MPOV video.

12. The electronic device of claim 11, wherein the processor is further configured for analyzing the content feature of the first media content and the second media content by determining whether the first media content or the second media content within the overlap period is a still image.

13. The electronic device of claim 11, wherein the processor is further configured for analyzing the content feature of the first media content and the second media content by determining a shot type of the first media content and the second media content based on the ratio of an object that occupies a frame of the first media content and the second media content associated with the overlap period, and identifying the highlight period among the overlap period based on the shot type of the first media content or the second media content associated with the overlap period.

14. The electronic device of claim 13, wherein the shot type comprises at least one of a closed-up shot, a zoom-out shot and a zoom-in shot.

15. The electronic device of claim 11, wherein the processor is further configured for identifying the overlap period based on a timestamp of each of the first media content and the second media content.

16. The method of claim 15, wherein the timestamp comprises a start time and an end time of the first media content and the second media content.

17. The electronic device of claim 11, wherein the processor is further configured for identifying the overlap period based on audio information of the first media content and the second media content.

18. The electronic device of claim 11, wherein the first media content and the second media content are captured from different points of view of the same event by different electronic devices.

19. The electronic device of claim 11, wherein the first media content and the second media content comprises a still image, a video, burst images and an audio recording.

20. The electronic device of claim 11, wherein the processor is further configured for selecting a footage having a predetermined duration from the overlap period among the relevant media contents as the highlight period.