Systems and Methods for Editing Three-Dimensional Video

• US 20140258867A1
• Filed: 03/07/2013
• Published: 09/11/2014
• Est. Priority Date: 03/07/2013
• Status: Active Grant

• Current Assignee: Cyberlink Corporation
• Original Assignee: Cyberlink Corporation
• Inventors: Yang, Chia-Che, Yeh, Chun Ming
• Granted Patent: US 9,436,358 B2
• Time in Patent Office: Days
• US Class Current: 715/723
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range

Abstract

Various embodiments are disclosed for editing a video sequence. One embodiment, among others, is a method for editing a video in a video editing system. The method comprises obtaining a video sequence and identifying objects in the video sequence with corresponding depth information, displaying the video sequence in a display panel in a user interface, and facilitating insertion of an object into the video sequence by displaying in the user interface, a timeline and a control panel including a graphical representation for each of the identified objects with corresponding depth information. The graphical representations are arranged relative to the timeline and based on the corresponding depth information. The method further comprises obtaining input from a user positioning the object into the video sequence relative to the identified objects with corresponding depth information.

Claims

1. A method for editing a video in a video editing system, comprising:

obtaining a video sequence and identifying objects in the video sequence with corresponding depth information;

displaying the video sequence in a display panel in a user interface;

facilitating insertion of an object into the video sequence by displaying in the user interface, a timeline and a control panel including a graphical representation for each of the identified objects with corresponding depth information, wherein the graphical representations are arranged relative to the timeline and based on the corresponding depth information; and

obtaining input from a user positioning the object into the video sequence relative to the identified objects with corresponding depth information.

2. The method of claim 1, wherein the control panel displays objects according to an axis corresponding to time and an axis corresponding to depth.

3. The method of claim 2, wherein the graphical representations comprise line objects, and wherein a length of each of the line objects corresponds to a duration of the object depicted in the video sequence.

4. The method of claim 3, wherein a location of each of the graphical representations corresponds to a relative depth of each corresponding object.

5. The method of claim 3, wherein the line objects extend in a horizontal direction along the axis corresponding to time.

6. The method of claim 1, wherein obtaining the user input positioning the object into the video sequence comprises:

displaying a graphical representation of the inserted object relative to the objects with corresponding depth information;

obtaining a position of the inserted object relative to the objects with corresponding depth information; and

based on the obtained position, displaying the object inserted into the video sequence relative to the objects with corresponding depth information.

7. The method of claim 6, wherein obtaining the user input positioning the object into the video sequence further comprises obtaining a position of the inserted object relative to the timeline.

8. The method of claim 6, wherein displaying the object inserted into the video sequence relative to the objects with corresponding depth information based on the obtained position comprises displaying the inserted object occluding or being occluded by the objects with corresponding depth information.

9. The method of claim 1, wherein the object comprises a graphic or text.

10. The method of claim 1, wherein in response to hovering a pointer over a graphical representation in the control panel, the object corresponding to the graphical representation is highlighted to the user.

11. The method of claim 10, wherein the object is highlighted by displaying a graphic on or near the object in the display panel.

12. The method of claim 1, wherein in response to hovering a pointer over a graphical representation in the control panel, the object corresponding to the graphical representation is shown in the form of a thumbnail image in the control panel.

13. The method of claim 1, further comprising obtaining user input specifying a viewing angle for displaying the video sequence in the display panel.

14. The method of claim 13, wherein the user input for specifying the viewing angle comprises at least one of input defined via navigation of a pointing device, input via a touch panel, a keyboard input, and an audio input.

15. The method of claim 1, further comprising dividing the video sequence into additional video sequences according to scene changes, wherein a scene change corresponds to at least a change in depth of at least one object in the video sequence.

16. A method for editing a frame in a video editing system, comprising:

obtaining a frame within a video sequence and identifying objects in the frame with corresponding depth information;

displaying the frame in a display panel in a user interface;

facilitating insertion of an object into the frame by displaying in the user interface, a control panel including a graphical representation for each of the identified objects with corresponding depth information, wherein the graphical representations are arranged based on relative positioning of each of the identified objects and based on their corresponding depth information; and

obtaining input from a user positioning the object into the frame relative to the identified objects with corresponding depth information.

17. A system for editing a video, comprising:

a media interface configured to obtain a video sequence;

an object analyzer configured to identify objects in the video sequence with corresponding depth information;

a user interface component configured to display the video sequence in a display panel in a user interface, where the user interface is further configured to display in the user interface, a timeline and a control panel including a graphical representation for each of the identified objects with corresponding depth information, wherein the graphical representations are arranged relative to the timeline and based on the corresponding depth information; and

a special effects editor configured to apply a special effect to the video sequence, wherein the special effect comprises positioning of an object into the video sequence relative to the identified objects with corresponding depth information.

18. The system of claim 17, wherein the graphical representations comprise line objects, wherein a length of the line objects correspond to a duration of the object depicted in the video sequence.

19. The system of claim 18, wherein a location of the graphical representations correspond to a relative depth of each corresponding object.

20. The system of claim 17, wherein the user interface component is further configured to:

display a graphical representation of the inserted object relative to the objects with corresponding depth information;

obtain a position of the inserted object relative to the objects with corresponding depth information; and

based on the obtained position, display the object inserted into the video sequence relative to the objects with corresponding depth information.

21. A non-transitory computer-readable medium embodying a program executable in a computing device, comprising:

code that obtains a video sequence and identifies objects in the video sequence with corresponding depth information;

code that displays the video sequence in a display panel in a user interface;

code that displays in the user interface, a timeline and a control panel including a graphical representation for each of the identified objects with corresponding depth information, wherein the graphical representations are arranged relative to the timeline and based on the corresponding depth information; and

code that obtains input from a user positioning the object into the video sequence relative to the identified objects with corresponding depth information.

22. The non-transitory computer-readable medium of claim 21, wherein the control panel corresponds to a top view of the objects with corresponding depth information.

23. The non-transitory computer-readable medium of claim 22, wherein spacing between the objects along a first axis represents a relative difference in depth between the objects.

24. The non-transitory computer-readable medium of claim 23, wherein locations and lengths of the objects along a second axis correspond to timing information.