Electronic device and operation method thereof

• US 10,542,309 B2
• Filed: 12/26/2017
• Issued: 01/21/2020
• Est. Priority Date: 12/26/2016
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Yakishyn, Yevgen, Radomskyi, Oleksandr, Shchur, Oleksandr, Peteichuk, Aleksandra
• Primary Examiner(s): Tran, Thai Q
• Assistant Examiner(s): Mesa, Jose M
• Application Number:
  US15/854,510
• Publication Number:
  US 20180184148A1
• Time in Patent Office: 756 Days
• CPC Class Codes: G06F 16/783 using metadata automatically derived from the content
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: H04N 21/26258 for generating a list of items to be played back in a given order, e.g. playlist, or scheduling item distribution according to such list retrieval of multimedia data based on playlists G06F16/40
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/433 Content storage operation, e.g. storage operation in response to a pause request, caching operations
• CPC Class Codes: H04N 21/4825 using a list of items to be played back in a given order, e.g. playlists
• CPC Class Codes: H04N 21/4828 for searching program descriptors retrieval of video data G06F16/739
• CPC Class Codes: H04N 21/8146 involving graphical data, e.g. 3D object, 2D graphics
• CPC Class Codes: H04N 21/816 involving special video data, e.g 3D video
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 21/854 Content authoring

Abstract

A method of operating an electronic device comprises obtaining a search path. The method also comprises obtaining at least one video content related to the search path and determining intersection points between the at least one video content. The method also comprises extracting parts of the at least one video content corresponding to the search path by using the intersection points and generating video content of the search path by stitching the extracted parts together.

Claims

1. A method of operating an electronic device, the method comprising:

receiving a user input to obtain a search path, wherein when the search path is located outdoors, the user input includes a departure and a destination and when the search path is located indoors the user input includes a building identifier or a floor number;

determining whether at least one video content from a plurality of video contents is related to the search path based on additional information associated with each of the plurality of video contents;

obtaining the at least one video content related to the search path;

after obtaining the at least one video content related to the search path, determining intersection points between the at least one video content and the search path;

extracting the intersection points and parts, wherein the intersection points are located on the search path and the parts correspond to paths between the intersection points from the at least one video content; and

generating video content of the search path by stitching the extracted parts together,

wherein generating the video content comprises;

selecting the parts to be stitched based on context information of the extracted parts; and

stitching the selected parts together.

2. The method of claim 1, wherein the determining of the intersection points between the at least one video content comprises:

obtaining photographing paths of the at least one video content; and

determining the intersection points by overlaying the photographing paths of the at least one video content.

3. The method of claim 2, wherein the obtaining of the photographing paths of the at least one video content comprises:

extracting a visual descriptor from the at least one video content;

calculating a motion of a camera by using the visual descriptor; and

obtaining the photographing paths based on the motion of the camera.

4. The method of claim 2, wherein the obtaining of the photographing paths of the at least one video content comprises obtaining the photographing paths based on the additional information of the at least one video content comprising a photographing position.

5. The method of claim 1, wherein the obtaining of the plurality of video contents comprises obtaining the plurality of video contents by photographing at least a portion of the search path.

6. The method of claim 1, wherein the plurality of video contents comprises 360 degree video content.

17. The method of claim 1, further comprises:

setting a region of interest (ROI) around the search path,

wherein obtaining the plurality of video contents comprises obtaining the plurality of video contents based on the ROI that is around the search path.

18. The method of claim 1, wherein:

the additional information that is associated with each of the plurality of video contents includes at least one of a title, photographing position information, a hash tag, index information, and summary information; and

the context information of the extracted parts includes at least one of weather, season, time, and surrounding environment.

7. An electronic device comprising:

a memory configured to store a program for an operation of the electronic device; and

a processor coupled to the memory, the processor configured to;

receive a user input to obtain a search path, wherein when the search path is located outdoors, the user input includes a departure and a destination and when the search path is located indoors the user input includes a building identifier or a floor number,

determine whether at least one video content from a plurality of video contents is related to the search path based on additional information associated with each of the plurality of video contents;

obtain the at least one video content related to the search path,

after obtaining the at least one video content related to the search path, determine intersection points between the at least one video content and the search path,

extract the intersection points and parts, where the intersection points are located on the search path and the parts correspond to paths between the intersection points from the at least one video content, and

generate video content of the search path by stitching the extracted parts together by executing the program,

wherein the processor is further configured to;

select the parts to be stitched based on context information of the extracted parts, and

stitch the selected parts together.

8. The electronic device of claim 7, wherein the processor is further configured to:

obtain photographing paths of the at least one video content; and

determine the intersection points by overlaying the photographing paths of the at least one video content.

9. The electronic device of claim 8, wherein the processor is further configured to:

calculate a motion of a camera by using a visual descriptor; and

obtain the photographing paths based on the motion of the camera.

10. The electronic device of claim 8, wherein the processor is further configured to obtain the photographing paths based on the additional information of the at least one video content comprising a photographing position.

11. The electronic device of claim 7, wherein the processor is further configured to obtain the plurality of video contents by photographing at least a portion of the search path.

12. The electronic device of claim 7, wherein the plurality of video contents comprises 360 degree video content.

19. The electronic device of claim 7, wherein the processor is further configured to:

set a region of interest (ROI) around the search path,

wherein obtaining the plurality of video contents comprises obtaining the plurality of video contents based on the ROI that is around the search path.

20. The electronic device of claim 7, wherein:

the additional information that is associated with each of the plurality of video contents includes at least one of a title, photographing position information, a hash tag, index information, and summary information; and

the context information of the extracted parts includes at least one of weather, season, time, and surrounding environment.

13. A non-transitory computer-readable medium embodying a computer program, the computer program comprising computer readable program code that, when executed by a processor, causes the processor to:

receive a user input to obtain a search path, wherein when the search path is located outdoors, the user input includes a departure and a destination and when the search path is located indoors the user input includes a building identifier or a floor number;

determine whether at least one video content from a plurality of video contents is related to the search path based on additional information associated with each of the plurality of video contents;

obtain the at least one video content related to the search path;

after obtaining the at least one video content related to the search path, determine intersection points between the at least one video content and the search path;

extract the intersection points and parts, wherein the intersection points are located on the search path and the parts correspond to paths between the intersection points from the at least one video content; and

generate video content of the search path by stitching the extracted parts together,

wherein the processor selects the parts to be stitched based on context information of the extracted parts and stitches the selected parts together.

14. The non-transitory computer-readable medium of claim 13, further comprising program code that, when executed by the processor, causes the processor to:

obtain photographing paths of the at least one video content; and

determine the intersection points by overlaying the photographing paths of the at least one video content.

15. The non-transitory computer-readable medium of claim 14, further comprising program code that, when executed by the processor, causes the processor to:

calculate a motion of a camera by using a visual descriptor; and

obtain the photographing paths based on the motion of the camera.

16. The non-transitory computer-readable medium of claim 14, further comprising program code that, when executed by the processor, causes the processor to obtain the photographing paths based on the additional information of the at least one video content including a photographing position.