Method and electronic device for generating multiple point of view video

• US 10,141,022 B2
• Filed: 06/19/2014
• Issued: 11/27/2018
• Est. Priority Date: 07/10/2013
• Status: Active Grant

• Current Assignee: HTC Corporation
• Original Assignee: HTC Corporation
• Inventors: Ying, Wen-Ping, Wang, Yuan-Kang, Verick, Hira Singh, Wu, Jing-Lung, Lee, Wen-Chuan, Chen, Chia-Wei, Culos, Kenneth Todd, Kuo, Wei-Chih, Tsai, Ming-Han, Chueh, Hsin-Ti, Ito, Tai
• Primary Examiner(s): Tran, Thai
• Assistant Examiner(s): Hasan, Syed
• Application Number:
  US14/308,720
• Publication Number:
  US 20150110467A1
• Time in Patent Office: 1,622 Days
• Field of Search: 386241, 386210, 386278, 707999103, 379 8901, 715202, 715716, 709206, 709224, 380237, 713176
• CPC Class Codes: G06F 16/4393 Multimedia presentations, e.g. slide shows, multimedia albums
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: G11B 27/19 by using information detectable on the record carrier
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: G11B 27/30 on the same track as the main recording
• CPC Class Codes: H04N 13/30 Image reproducers optical systems for producing stereoscopic or other three-dimensional effects G02B30/00
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/47205 for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
• CPC Class Codes: H04N 9/806 with processing of the sound signal

Abstract

The present disclosure provides an electronic device for generating a multiple point of view (MPOV) video and the method thereof. The present disclosure involves the electronic device to obtain a plurality of media contents. The electronic device would identify a first media content relating to a second media content in time and location according to time information, audio information, and location information including a geographic tag and a surrounding signal information. Then, the first media content and the second media content are provided as relevant media contents for generating the MPOV video of the event having the relevant media content captured from different point of view.

Claims

1. A method of generating a multiple point of view (MPOV) video applicable to an electronic device comprising a processor, the method comprising:

obtaining, by the electronic device, a plurality of media contents;

identifying, by the processor of the electronic device, from the plurality of media contents, a first media content and a second media content as relevant media contents related to a same event based on each metadata that corresponds to each of the media contents, wherein the metadata comprises a time information, an audio information and a location information;

transmitting, by the electronic device, a set of relevance criteria to other electronic device for identifying, by the other electronic device, a third media content from another media contents captured by an image capturing component of the other electronic device as one of the relevant media contents relating to the same event as the first media content and the second media content;

receiving, by the electronic device, the third media content identified by the other electronic device from the other electronic device for generating the MPOV video; and

generating, by the processor of the electronic, the MPOV video by combining a partial period from each of the first, second and third media contents into one frame as a highlight of the event, and simultaneously displaying the first, second and third media contents in different sections of the frame.

2. The method of claim 1, further comprising:

identifying the first media content and the second media content as the relevant media contents by analyzing the first and second media contents for extracting a real-time audio information and comparing the real-time audio information between the first media content and the second media content.

3. The method of claim 1, wherein the audio information comprises a value and a timestamp of a distinguishable feature for an audio waveform.

4. The method of claim 1, wherein determining the relevant media contents further comprises:

identifying the first media content and the second media content as the relevant media contents relating to the same event in time by comparing a time code of the first media content and a time code of the second media content.

5. The method of claim 1, wherein the location information comprises a geographic tag comprising a GPS position and an accuracy data, and determining, from the media contents, the first media content and the second media content as relevant media contents related to the same event further comprises:

determining whether the accuracy data is within the predetermined accuracy range, and when the accuracy data is within the predetermined accuracy range, identifying the first media content and the second media content as the relevant media contents relating to the same event in location by determining whether a difference between the GPS position of the first media content and the GPS position of the second media content is within a predetermined distance.

6. The method of claim 1, wherein the location information comprises a surrounding signal information comprising a list ranking a signal strength of a nearby device, and determining, from the media contents, the relevant media contents further comprises:

identifying the first media content and the second media content as the relevant media contents relating to the same event in location by comparing the nearby device listed in the list of the first media content and the list of the second media content.

7. The method of claim 6, wherein the nearby device comprises an access point or other electronic devices.

8. The method of claim 1, wherein the set of relevance criteria is determined based on the time information, the audio information and the location information of the of the first media contents and second media content.

9. The method of claim 1, wherein the first media content and the second media content comprises a still image, continuous images and an audio recording.

10. An electronic device, comprising:

a processor, configured for;

obtaining a plurality of media contents;

identifying, from the plurality of media contents, a first media content and a second media content as relevant media contents related to a same event based on each metadata that corresponds to each of the media contents, wherein the metadata comprises a time information, an audio information and a location information; and

generating the MPOV video by combining a partial period from each of the first, second and third media contents into one frame as a highlight of the event, and simultaneously displaying the first and second media contents in different sections of the frame; and

a transceiver, configured for;

transmitting a set of relevance criteria to other electronic device for identifying, by the other electronic device, the third media content from another media contents captured by an image capturing component of the other electronic device as one of the relevant media contents relating to the same event as the first media content and the second media content; and

receiving the third media content identified by the other electronic device from the other electronic device for generating the MPOV video.

11. The electronic device of claim 10, wherein the processor is further configured for identifying the first media content and the second media content as the relevant media contents by analyzing the first and second media contents to extract a real-time audio information and comparing the real-time audio information between the first media content and the second media content.

12. The electronic device of claim 10, wherein the audio information comprises a value and a timestamp of a distinguishable feature for an audio waveform.

13. The electronic device of claim 10, wherein the processor is configured for identifying the first media content and the second media content as the relevant media contents relating to the same event in time by comparing a time code of the first media content and a time code of the second media content.

14. The electronic device of claim 10, wherein the location information comprises a geographic tag comprising a GPS position and an accuracy data, and the processor is further configured for determining whether the accuracy data is within the predetermined accuracy range, and when the accuracy data is within the predetermined accuracy range, identifying the first media content and the second media content as the relevant media contents relating to the same event in location by determining whether a difference between the GPS position of the first media content and the GPS position of the second media content is within a predetermined distance range.

15. The electronic device of claim 10, wherein the location information comprises a surrounding signal information comprising a list ranking a signal strength of a nearby device, and the processor is further configured for identifying the first media content and the second media content as the relevant media contents relating to the same event in location by comparing the nearby device listed in the list of the first media content and the list of the second media content.

16. The electronic device of claim 15, wherein the nearby device comprises an access point and other electronic devices.

17. The electronic device of claim 10, wherein the set of relevance criteria is determined based on the time information, the audio information and the location information of the first media content and the second media content.

18. The electronic device of claim 10, wherein the first media content and the second media content comprises a still image, continuous image and an audio recording.