Zoom editor

• US 20030090504A1
• Filed: 10/11/2002
• Published: 05/15/2003
• Est. Priority Date: 10/12/2001
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Worrill, Joshua, Brook, John Charles, Reeve, Rupert William Galloway, Kowald, Julie Rae, Ma, Choi Chi Evelene
• Granted Patent: US 7,480,864 B2
• Time in Patent Office: Days
• US Class Current: 715/716
• CPC Class Codes: G06F 16/739 in form of a video summary, e.g. the video summary being a video sequence, a composite still image or having synthesized frames
• CPC Class Codes: G06F 16/743 a collection of video files or sequences
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 1/00442 Simultaneous viewing of a plurality of images, e.g. using a mosaic display arrangement of thumbnails
• CPC Class Codes: H04N 1/00453 arranged in a two dimensional array
• CPC Class Codes: H04N 1/00458 Sequential viewing of a plurality of images, e.g. browsing or scrolling

Abstract

A method and apparatus for processing media items is disclosed. The method involves selecting a sub-set (106) of the media items (102), and concurrently displaying a spatial representation (606) and a temporal representation (610) of the selected sub-set. Using this starting point, a user can browse, using either a temporal control input (414) or a spatial control input (406), applied to the associated temporal or spatial display (610, 606 respectively), to modify the media item selection (106). The display corresponding to the non-selected navigation mode is automatically and contemporaneously changed to reflect the change in the media item selection.

Claims

1. A method of processing a set of media items, said method comprising the steps of:

(a) selecting a sub-set of said media items;

(b) concurrently displaying (i) a spatial representation of the selected sub-set and (ii) a temporal representation of the selected sub-set;

(c) selecting one of a temporal navigation mode and a spatial navigation mode;

(d) providing a spatial navigation command, if the spatial navigation mode has been selected, to the spatial representation to thereby modify the selection of the sub-set of said media items, to thereby contemporaneously change the spatial representation and the corresponding temporal representation; and

(e) providing a temporal navigation command, if the temporal navigation mode has been selected, to the temporal representation to thereby modify the selection of the sub-set of said media items, to thereby contemporaneously change the temporal representation and the corresponding spatial representation.

2. A method according to claim 1;

wherein;

the spatial representation of the selected sub-set is displayed by applying spatial extraction rules to the sub-set;

the temporal representation of the selected sub-set is displayed by applying video rules to the sub-set;

the modification, dependent upon the spatial navigation command, of the selection of the media items is dependent upon spatial selection rules; and

the modification, dependent upon the temporal navigation command, of the selection of the media items is dependent upon temporal selection rules.

3. A method according to claim 2, wherein the spatial extraction rules, the video rules, the spatial selection rules and the temporal selection rules are incorporated into a template.

4. A method of processing according to claim 3, said method comprising further steps of:

editing the modified sub-set of media items by at least one of (i) modifying a media item in the modified sub-set, and (ii) incorporating a transition between two of the media items in the modified sub-set; and

storing at least one of (i) information about a media item in the edited sub-set and (ii) the media item in the edited sub-set, to thereby form an edit-view production.

5. A method according to claim 4, wherein:

the editing step is performed by auto-editing rules that are included in the template, and the information about the media item in the edited sub-set is an EDL.

6. A method of processing according to claim 5, wherein said template reduces the spatial resolution of said edited media items, to thereby form an edit-preview production which is a summarisation of the edit-view production.

7. A method of processing according to claim 5, wherein said template reduces the colour resolution of said edited media items, to thereby form an edit-preview production which is a summarisation of the edit-view production.

8. A method of processing according to claim 5, wherein said template reduces the temporal resolution of said edited media items, to thereby form an edit-preview production which is a summarisation of the edit-view production.

9. A method of processing according to claim 5 further comprising, after the editing step, a further step of:

applying a summarisation template to the edited modified sub-set of media items to thereby form an edit-preview production which is a summarisation of the edit-view production.

10. A method according to claim 5, comprising further steps of:

compositing and rendering the edited modified sub-set of media items to thereby form a print resolution production;

frame sampling the print resolution production to thereby produce frames for printing.

11. A method according to claim 10, wherein the frame sampling is dependent upon at least one of the EDL and metadata associated with the modified sub-set of media items.

12. An apparatus for processing a set of media items, said apparatus comprising:

(a) means for selecting a sub-set of said media items;

(b) means for concurrently displaying (i) a spatial representation of the selected sub-set and (ii) a temporal representation of the selected sub-set;

(c) means for selecting one of a temporal navigation mode and a spatial navigation mode;

(d) means for providing a spatial navigation command, if the spatial navigation mode has been selected, to the spatial representation to thereby modify the selection of the sub-set of said media items, to thereby contemporaneously change the spatial representation and the corresponding temporal representation; and

(e) means for providing a temporal navigation command, if the temporal navigation mode has been selected, to the temporal representation to thereby modify the selection of the sub-set of said media items, to thereby contemporaneously change the temporal representation and the corresponding spatial representation.

13. A computer program product including a computer readable medium having recorded thereon a computer program for directing a processor to execute a method for processing a set of media items, said program comprising:

(a) code for a selecting step for selecting a sub-set of said media items;

(b) code for a displaying step for concurrently displaying (i) a spatial representation of the selected sub-set and (ii) a temporal representation of the selected sub-set;

(c) code for a selecting step for selecting one of a temporal navigation mode and a spatial navigation mode;

(d) code for a providing step for providing a spatial navigation command, if the spatial navigation mode has been selected, to the spatial representation to thereby modify the selection of the sub-set of said media items, to thereby contemporaneously change the spatial representation and the corresponding temporal representation; and

(e) code for a providing step for providing a temporal navigation command, if the temporal navigation mode has been selected, to the temporal representation to thereby modify the selection of the sub-set of said media items, to thereby contemporaneously change the temporal representation and the corresponding spatial representation.

14. A computer program for directing a processor to execute a method for processing a set of media items, said program comprising:

(a) code for a selecting step for selecting a sub-set of said media items;

(b) code for a displaying step for concurrently displaying (i) a spatial representation of the selected sub-set and (ii) a temporal representation of the selected sub-set;

(c) code for a selecting step for selecting one of a temporal navigation mode and a spatial navigation mode;

(d) code for a providing step for providing a spatial navigation command, if the spatial navigation mode has been selected, to the spatial representation to thereby modify the selection of the sub-set of said media items, to thereby contemporaneously change the spatial representation and the corresponding temporal representation; and

(e) code for a providing step for providing a temporal navigation command, if the temporal navigation mode has been selected, to the temporal representation to thereby modify the selection of the sub-set of said media items, to thereby contemporaneously change the temporal representation and the corresponding spatial representation.

15. An apparatus for processing a set of media items, said apparatus comprising:

a memory for storing a program; and

a processor for executing the program, said program comprising;

(a) code for a selecting step for selecting a sub-set of said media items;

(b) code for a displaying step for concurrently displaying (i) a spatial representation of the selected sub-set and (ii) a temporal representation of the selected sub-set;

(c) code for a selecting step for selecting one of a temporal navigation mode and a spatial navigation mode;

(d) code for a providing step for providing a spatial navigation command, if the spatial navigation mode has been selected, to the spatial representation to thereby modify the selection of the sub-set of said media items, to thereby contemporaneously change the spatial representation and the corresponding temporal representation; and

(e) code for a providing step for providing a temporal navigation command, if the temporal navigation mode has been selected, to the temporal representation to thereby modify the selection of the sub-set of said media items, to thereby contemporaneously change the temporal representation and the corresponding spatial representation.

16. An apparatus for previewing a production, said apparatus comprising:

means for applying a temporal summarisation process to the production to thereby form a temporal summary of the production;

means for displaying said temporal summary;

means providing a navigation input relative to said displayed temporal summary display, to thereby indicate a temporal region of interest within the production; and

means for modifying the temporal summarisation process to thereby emphasise said temporal region of interest in the temporal summary.

17. An apparatus for previewing a production, wherein the production has been generated by applying a video production template, said apparatus comprising:

means for applying a temporal summarisation template to the production to thereby form a temporal summary of the production; and

means for displaying said temporal summary for previewing.

19. An apparatus according to claim 17, further comprising:

means providing a navigation input relative to said displayed temporal summary display, to thereby indicate a temporal region of interest within the production; and

means for modifying the temporal summarisation process to thereby emphasise said temporal region of interest in the temporal summary.

20. An apparatus according to either one of claims 17 and 19, wherein:

the video production template and the summarisation template are incorporated into a common template; and

the common template is applied to a set of raw clips and associated meta-data to thereby form both the production and the temporal summary.

18. An apparatus for previewing a production, said apparatus comprising:

means for applying a temporal summarisation template to the production to thereby form a temporal summary of the production; and

means for displaying said temporal summary for previewing.

21. A method for previewing a production, said method comprising the steps of:

applying a temporal summarisation process to the production to thereby form a temporal summary of the production;

displaying said temporal summary;

providing a navigation input relative to said displayed temporal summary display, to thereby indicate a temporal region of interest within the production; and

modifying the temporal summarisation process to thereby emphasise said temporal region of interest in the temporal summary.

22. A method for previewing a production, wherein the production has been generated by applying a video production template, said method comprising the steps of:

applying a temporal summarisation template to the production to thereby form a temporal summary of the production; and

displaying said temporal summary for previewing.

24. A method according to claim 22, comprising further steps of:

providing a navigation input relative to said displayed temporal summary display, to thereby indicate a temporal region of interest within the production; and

modifying the temporal summarisation process to thereby emphasise said temporal region of interest in the temporal summary.

23. A method for previewing a production, said method comprising the steps of:

applying a temporal summarisation template to the production to thereby form a temporal summary of the production; and

displaying said temporal summary for previewing.

25. A method for previewing a production, said method comprising the steps of:

applying a temporal summarisation process to the production to thereby form a temporal summary of the production;

displaying said temporal summary;

(a) providing a navigation input relative to said displayed temporal summary display, to thereby indicate a temporal region of interest within the production; and

(b) modifying the temporal summarisation process to thereby emphasise said temporal region of interest in the temporal summary, wherein;

said step (a) directly initiates said step (b).

26. A method of producing, from a first plurality of video frames each having a corresponding set of meta-data, a frame for printing, said method comprising the steps of:

applying a production template to the first plurality of video frames, to thereby produce;

(a) a production comprising a second plurality of effected video frames, said effected frames having had at least one of editing and effects applied thereto; and

(b) a description of at least one of the production template and the production;

applying a printing template to the production, to thereby;

(a) determine a relative suitability measure for at least some of the second plurality of effected video frames dependent upon at least one of (i) said corresponding sets of meta-data, and (ii) said description; and

(b) produce said frame for printing dependent upon said relative suitability measures.

27. A method of producing, from a first plurality of video frames and a corresponding set of meta-data, a frame for printing, said method comprising the steps of:

applying a production template to the first plurality of video frames, to thereby produce;

(a) a production comprising a second plurality of effected video frames, said effected frames having been at least one of edited and having had effects applied thereto; and

(b) a description of at least one of the production template and the production;

applying a printing template to the production, to thereby;

(a) determine a relative suitability measure for at least some of the second plurality of effected video frames dependent upon at least one of (i) said corresponding sets of meta-data, and (ii) said description; and

(b) produce said frame for printing dependent upon said relative suitability measures.

28. A method of producing, from a first plurality of video frames, a frame for printing, said method comprising the steps of:

applying a production template to the first plurality of video frames, to thereby produce;

(a) a production comprising a second plurality of effected video frames, said effected frames having been at least one of edited and having had effects applied thereto; and

(b) a description of at least one of the production template and the production;

applying a printing template to the production, to thereby;

(a) determine a relative suitability measure for at least some of the second plurality of effected video frames dependent upon said description; and

(b) produce said frame for printing dependent upon said relative suitability measures.

29. An apparatus for producing, from a first plurality of video frames each having a corresponding set of meta-data, a frame for printing, said apparatus comprising:

a production template;

means for applying the production template to the first plurality of video frames, to thereby produce;

(a) a production comprising a second plurality of effected video frames, said effected frames having had at least one of editing and effects applied thereto; and

(b) a description of at least one of the production template and the production;

a printing template;

means for applying a printing template to the production, to thereby;

(a) determine a relative suitability measure for at least some of the second plurality of effected video frames dependent upon at least one of (i) said corresponding sets of meta-data, and (ii) said description; and

(b) produce said frame for printing dependent upon said relative suitability measures.

30. A method of producing, from (i) a production comprising a plurality of effected video frames, said effected frames having had at least one of editing and effects applied thereto, and (ii) a description of at least one of (a) a production template used to form the production from a first plurality of video frames each having a corresponding set of meta-data, and (b) the production, a frame for printing, said method comprising the steps of:

determining a relative suitability measure for at least some of the plurality of effected video frames dependent upon at least one of (i) said corresponding sets of meta-data, and (ii) said description; and

producing said frame for printing dependent upon said relative suitability measures.

31. An apparatus for producing, from (i) a production comprising a plurality of effected video frames, said effected frames having had at least one of editing and effects applied thereto, and (ii) a description of at least one of (a) a production template used to form the production from a first plurality of video frames each having a corresponding set of meta-data, and (b) the production, a frame for printing, said apparatus comprising:

means for determining a relative suitability measure for at least some of the plurality of effected video frames dependent upon at least one of (i) said corresponding sets of meta-data, and (ii) said description; and

means for producing said frame for printing dependent upon said relative suitability measures.

32. A method of constructing a production from a set of media items, the method comprising selecting a media item from the set;

wherein;

the selecting step effects incorporation of the selected media item into an EDL; and

the incorporating step effects a presentation dependent upon the EDL contents.

33. A method according to claim 32;

wherein;

the selecting step effects, prior to the presentation of the EDL contents, incorporation of an auto-editing template; and

the presentation of the EDL contents is determined by application of the template to the EDL contents.

34. An apparatus for browsing a set of media items comprising:

means for selecting a sub-set of said media items;

means for displaying, substantially simultaneously, representations of said sub-set and a temporal summary related to said sub-set;

means for providing a first navigation input to the display of the representations of the sub-set, to thereby effect a corresponding change in the selection of the sub-set and consequently a change in both said displayed representations of said sub-set and said displayed temporal summary related to said sub-set; and

means for providing a second navigation input to the display of the temporal summary related to the sub-set, to thereby effect a corresponding change in the selection of the sub-set and consequently a change in both said displayed temporal summary related to said sub-set and said displayed representations of said sub-set.

36. An apparatus according to either one of claims 34 and 35, wherein said displayed representations comprise a spatial summary display of the sub-set.

37. An apparatus according to claim 36, wherein

the first navigation input is a spatial navigation input for effecting selection according to a set of spatial selection rules;

and

the second navigation input is a temporal navigation input for effecting selection according to a set of temporal selection rules.

38. An apparatus according to claim 36, wherein:

the selected sub-set includes at least one of wholly encompassed media items and partially encompassed media items from the set;

the displayed representation of the selected sub-set can include, dependent on the spatial selection rules, at least one of representations of said wholly encompassed media items, and representations of said partially encompassed media items; and

the displayed temporal summary relating to the selected sub-set can include, dependent on the temporal selection rules, at least one of a temporal summary related to said wholly encompassed media items, and a temporal summary related to said partially encompassed media items.

35. An apparatus for browsing a set of media items comprising:

means for providing a first navigation input relative to a display in a first display window to thereby (i) select a first sub-set of said media items, (ii) display, in said first display window, representations of said first sub-set, and (iii) display, in a second display window, a temporal summary relating to said first sub-set;

means for providing a second navigation input relative to the display in the second display window to thereby (i) select a second sub-set of said media items, (ii) display, in the first display window, representations of the second sub-set, and (iii) display, in the second display window, a temporal summary relating to the second sub-set; and

a display wherein the first display window and the second display window are made substantially simultaneously visible to a user.

39. A method of browsing a set of media items, said method comprising the steps of:

selecting a sub-set of said media items;

displaying, substantially simultaneously, representations of said sub-set and a temporal summary related to said sub-set;

providing a first navigation input to the display of the representations of the sub-set, to thereby effect a corresponding change in the selection of the sub-set and consequently a change in both said displayed representations of said sub-set and said displayed temporal summary related to said sub-set; and

providing a second navigation input to the display of the temporal summary related to the sub-set, to thereby effect a corresponding change in the selection of the sub-set and consequently a change in both said displayed temporal summary related to said sub-set and said displayed representations of said sub-set.

40. A method of browsing a set of media items, said method comprising the steps of:

providing a first navigation input relative to a display in a first display window to thereby (i) select a first sub-set of said media items, (ii) display, in said first display window, representations of said first sub-set, and (iii) display, in a second display window, a temporal summary relating to said first sub-set;

providing a second navigation input relative to the display in the second display window to thereby (i) select a second sub-set of said media items, (ii) display, in the first display window, representations of the second sub-set, and (iii) display, in the second display window, a temporal summary relating to the second sub-set; and

displaying, substantially simultaneously, the first display window and the second display window.

41. A method of browsing a set of media items, said method comprising the steps of:

(a) providing a first navigation input relative to a display in a first display window to thereby (aa) select a first sub-set of said media items, (ab) display, in said first display window, representations of said first sub-set, and (ac) display, in a second display window, a temporal summary relating to said first sub-set; and

(b) providing a second navigation input relative to the display in the second display window to thereby (ba) select a second sub-set of said media items, (bb) display, in the first display window, representations of the second sub-set, and (bc) display, in the second display window, a temporal summary relating to the second sub-set, wherein;

said step (a) directly initiates, as hereinbefore defined, said steps (ab) and (ac); and

said step (b) directly initiates, as hereinbefore defined, said steps (bb) and (bc).