SYSTEM AND METHOD FOR SEMI-AUTOMATIC VIDEO EDITING

• US 20130343727A1
• Filed: 12/06/2012
• Published: 12/26/2013
• Est. Priority Date: 03/08/2010
• Status: Active Grant

• Current Assignee: Vimeo, Inc.
• Original Assignee: Magisto Ltd. (Vimeo, Inc.)
• Inventors: Rav-Acha, Alex, Boiman, Oren
• Granted Patent: US 9,502,073 B2
• Time in Patent Office: Days
• US Class Current: 386/282
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: G11B 27/329 on a disc [VTOC]
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 21/47205 for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
• CPC Class Codes: H04N 5/76 Television signal recording
• CPC Class Codes: H04N 9/87 Regeneration of colour television signals H04N9/80 takes precedence

Abstract

A non-transitory computer readable medium that stores instructions that cause a computerized system to: process a media stream to extract metadata about characteristics of the media stream; display to a user the metadata; receive from the user an instruction to generate a modified media stream that is responsive to at least one characteristic that is represented by the metadata; and process the media stream to generate a modified media stream, in response to the instruction.

Claims

1. A non-transitory computer readable medium that stores instructions that cause a computerized system to:

process a media stream to extract metadata about characteristics of the media stream;

display to a user the metadata;

receive from the user an instruction to generate a modified media stream that is responsive to at least one characteristic that is represented by the metadata; and

process the media stream to generate a modified media stream, in response to the instruction.

2. The non-transitory computer readable medium according to claim 1 that stores instructions that cause the computerized system to generate a modified media stream that is shorter than the media stream.

3. The non-transitory computer readable medium according to claim 1 that stores instructions that cause the computerized system to generate the modified media stream by applying a non-parametric method.

4. The non-transitory computer readable medium according to claim 1 that stores instructions that cause the computerized system to generate the modified media stream in response to a speech attribute that is indicative of an importance level of media frames that are associated with speech.

5. The non-transitory computer readable medium according to claim 1 wherein a characteristic of the media stream is an importance of a certain person, wherein a face of the certain person appears in the media stream.

6. The non-transitory computer readable medium according to claim 1 wherein a characteristic of the media stream is an importance of a certain scene, wherein the scene appears in the media stream.

7. The non-transitory computer readable medium according to claim 1 that stores instructions that cause the computerized system to generate the modified media stream in response to a face attribute that is indicative of an importance level of media frames that comprise faces.

8. The non-transitory computer readable medium according to claim 1 that stores instructions that cause the computerized system to generate the modified media stream in response to an action attribute that is indicative of an importance level of media frames that are associated with action.

9. The non-transitory computer readable medium according to claim 1 that stores instructions that cause the computerized system to display to a user metadata relating to a portion of the media stream while acquiring another portion of the media stream.

10. The non-transitory computer readable medium according to claim 1 that stores instructions that cause the computerized system to generate a mosaic of visual entities, wherein a first visual entity of the mosaic represents the altered media stream;

and wherein at least a second visual entity of the mosaic is not representative of the altered media stream;

wherein a relationship between a size of the first and second visual entities is responsive to a relationship between importance levels associated with the first and second visual entities.

11. The non-transitory computer readable medium according to claim 10, wherein the visual entities comprise still pictures and video streams.

12. The non-transitory computer readable medium according to claim 1 that stores instructions that cause the computerized system to trigger the generating of the modified media stream in response to a detection of camera activity.

13. The non-transitory computer readable medium according to claim 1 that stores instructions that cause the computerized system to trigger the generating of the modified media stream when the user is located at a predetermined location.

14. The non-transitory computer readable medium according to claim 1 that stores instructions that cause the computerized system to trigger the generating of the modified media stream in response to an activity of another user that is associated with the user.

15. The non-transitory computer readable medium according to claim 1 wherein the media stream comprises audio frames that are synchronized with video stream;

wherein the non-transitory computer readable medium stores instructions that cause the computerized system to generate a modified audio stream that comprises selected audio frames and a modified video stream;

wherein the modified video stream comprises video frames synchronized with selected audio frames and additional video content;

wherein the modified video stream and the modified audio stream are synchronized.

16. A non-transitory computer readable medium that stores instructions that cause a computerized system to:

receive a media stream that comprises a plurality of frames;

generate a modified media stream that comprises selected frames of the plurality of frames, wherein the generating comprises excluding rejected frames of the plurality of frames;

display to a user information about the selected frames and the rejected frames;

receive from a user an instruction to alter the modified media stream; and

alter, in response to the instruction, the modified media stream by performing at least one out of (a) adding at least one rejected frame to the modified media frame;

(b) removing at least one selected frame from the modified media frame to provide an altered media stream.

17. The non-transitory computer readable medium according to claim 16 that stores instructions that cause the computerized system to display to the user information on a touch screen of a mobile device;

and receiving the instruction from the touch screen.

18. The non-transitory computer readable medium according to claim 16 that stores instructions that cause the computerized system to generate the modified media stream in response to a type of soundtrack associated with the media stream.

19. The non-transitory computer readable medium according to claim 16 that stores instructions that cause the computerized system to obtain media streams from multiple users and to generate the modified media stream from frames of the media streams.

20. The non-transitory computer readable medium according to claim 19 that stores instructions that cause the computerized system to receive from multiple users instructions to alter the modified media streams and to generate the modified media stream in response to the instructions.

21. A non-transitory computer readable medium that stores instructions that cause a mobile phone to acquire a media stream and to receive from the user the metadata in response to a display of at least a portion of the media stream.

22. The non-transitory computer readable medium according to claim 21, that stores instructions that cause the mobile device to receive from the user the metadata in response to a display of an automatically extracted meta-data from a media stream.

23. The non-transitory computer readable medium according to claim 21, that stores instructions that cause the mobile device to receive the metadata during an acquisition of the media stream.

24. The non-transitory computer readable medium according to claim 21, that stores instructions that cause the mobile device to process speech of the user that is sensed during an acquisition of media stream to extract the metadata.

25. The non-transitory computer readable medium according to claim 24, wherein the speech does not include instructions aimed to the mobile device.

26. A method, comprising:

acquiring a media stream;

processing the media stream to extract metadata about characteristics of the media stream;

displaying to a user the metadata;

receiving from the user an instruction to generate a modified media stream that is responsive to at least one characteristic that is represented by the metadata; and

processing the media stream to generate a modified media stream, in response to the instruction.

27. A method, comprising:

receiving a media stream that comprises a plurality of frames;

generating a modified media stream that comprises selected frames of the plurality of frames, wherein the generating comprises excluding rejected frames of the plurality of frames;

displaying to a user information about the selected frames and the rejected frames;

receiving from a user an instruction to alter the modified media stream; and

altering, in response to the instruction, the modified media stream by performing at least one out of (a) adding at least one rejected frame to the modified media frame;

(b) removing at least one selected frame from the modified media frame to provide an altered media stream.

28. A computerized system, comprising:

a media stream acquisition module arranged to receive a media stream that comprises a plurality of frames;

an editing module arranged to generate a modified media stream that comprises selected frames of the plurality of frames, wherein the generating comprises excluding rejected frames of the plurality of frames;

a touch screen arranged to display to a user information about the selected frames and the rejected frames and to receive from a user an instruction to alter the modified media stream; and

wherein the editing module is further arranged to alter, in response to the instruction, the modified media stream by performing at least one out of (a) adding at least one rejected frame to the modified media frame;

(b) removing at least one selected frame from the modified media frame to provide an altered media stream.