Method, device, terminal device, and storage medium for video effect processing

• US 10,212,386 B2
• Filed: 05/18/2016
• Issued: 02/19/2019
• Est. Priority Date: 08/28/2015
• Status: Active Grant

• Current Assignee: Xiaomi Inc. (Xiaomi Corp.)
• Original Assignee: Xiaomi Inc. (Xiaomi Corp.)
• Inventors: Liu, Jie, Wu, Xiaoyong, Wang, Wei
• Primary Examiner(s): Dang, Hung Q
• Application Number:
  US15/158,276
• Publication Number:
  US 20170064245A1
• Time in Patent Office: 1,007 Days
• Field of Search: 386343-352
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: G11B 27/005 Reproducing at a different information rate from the information rate of recording for television signals H04N5/783
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 5/783 Adaptations for reproducing at a rate different from the recording rate

Abstract

A method for video effect processing includes receiving a video effect processing instruction associated with a video, performing a movement amount detection on each of a plurality of video frames of the video to determine target video frames that require the video effect processing, and performing the video effect processing on the target video frames during playback of the video.

Claims

1. A method for video effect processing, comprising:

receiving a video effect processing instruction associated with a video;

performing a movement amount detection on each of a plurality of video frames of the video to determine target video frames that require the video effect processing; and

performing the video effect processing on the target video frames during playback of the video,

wherein when the video effect processing instruction includes a slow motion video effect processing instruction, performing the movement amount detection to determine the target video frames includes, for each of the plurality of video frames;

acquiring motion vector magnitude values of all preset blocks in the video frame;

determining a number of fast blocks in the video frame, a fast block being a preset block that has a motion vector magnitude value greater than a motion vector threshold;

calculating a first ratio between the number of fast blocks and a total number of preset blocks in the video frame;

determining whether the first ratio is greater than a first preset ratio threshold; and

determining, if the first ratio is greater than the first preset ratio threshold, the video frame to be a target video frame; and

wherein when the video effect processing instruction includes a fast forward video effect processing instruction that is configured to trigger the video to be played faster than a normal speed, performing the movement amount detection to determine the target video frames includes, for each of the plurality of video frames;

acquiring motion vector magnitude values of all preset blocks in the video frame;

determining a number of slow blocks in the video frame, a slow block being a preset block that has a motion vector magnitude value smaller than the motion vector threshold;

calculating a second ratio between the number of slow blocks and the total number of preset blocks in the video frame;

determining whether the second ratio is greater than a second preset ratio threshold; and

determining, if the second ratio is greater than the second preset ratio threshold, the video frame to be the target video frame.

2. The method according to claim 1, wherein receiving the video effect processing instruction includes:

receiving a video effect processing instruction generated by a user clicking a preset video effect processing button.

3. The method according to claim 2, wherein when the video effect processing instruction includes the slow motion video effect processing instruction, performing the video effect processing on the target video frames includes:

performing a frame interpolation process on the target video frames according to a preset interpolation algorithm.

4. The method according to claim 2, wherein when the video effect processing instruction includes the fast forward video effect processing instruction, performing the video effect processing on the target video frames includes:

performing a frame extraction process on the target video frames according to a preset extraction algorithm.

5. A terminal device, comprising:

a processor; and

a memory storing instructions that, when executed by the processor, cause the processor to;

receive a video effect processing instruction associated with a video;

perform a movement amount detection on each of a plurality of video frames of the video to determine target video frames that require the video effect processing; and

perform the video effect processing on the target video frames during playback of the video,

wherein when the video effect processing instruction includes a slow motion video effect processing instruction, the instructions further cause the processor to, for each of the plurality of video frames;

acquire motion vector magnitude values of all preset blocks in the video frame;

determine a number of fast blocks in the video frame, a fast block being a preset block that has a motion vector magnitude value greater than a motion vector threshold;

calculate a first ratio between the number of fast blocks and a total number of preset blocks in the video frame;

determine whether the first ratio is greater than a first preset ratio threshold; and

determine, if the first ratio is greater than the first preset ratio threshold, the video frame to be a target video frame; and

wherein when the video effect processing instruction includes a fast forward video effect processing instruction that is configured to trigger the video to be played faster than a normal speed, the instructions further cause the processor to, for each of the plurality of video frames;

acquire motion vector magnitude values of all preset blocks in the video frame;

determine a number of slow blocks in the video frame, a slow block being a preset block that has a motion vector magnitude value smaller than the motion vector threshold;

calculate a second ratio between the number of slow blocks and the total number of preset blocks in the video frame;

determine whether the second ratio is greater than a second preset ratio threshold; and

determine, if the second ratio is greater than the second preset ratio threshold, the video frame to be the target video frame.

6. The terminal device according to claim 5, wherein the instructions further cause the processor to:

receive a video effect processing instruction generated by a user clicking a preset video effect processing button.

7. The terminal device according to claim 6, wherein when the video effect processing instruction includes the slow motion video effect processing instruction, the instructions further cause the processor to:

perform a frame interpolation process on the target video frames according to a preset interpolation algorithm.

8. The terminal device according to claim 6, wherein when the video effect processing instruction includes the fast forward video effect processing instruction, the instructions further cause the processor to:

perform a frame extraction process on the target video frames according to a preset extraction algorithm.

9. A non-transitory computer-readable storage medium storing instructions that, when executed by a processor in a terminal, cause the terminal to:

receive a video effect processing instruction associated with a video;

perform a movement amount detection on each of a plurality of video frames of the video to determine target video frames that require the video effect processing; and

perform the video effect processing on the target video frames during playback of the video,

wherein when the video effect processing instruction includes a slow motion video effect processing instruction, the instructions further cause the terminal to, for each of the plurality of video frames;

acquire motion vector magnitude values of all preset blocks in the video frame;

determine a number of fast blocks in the video frame, a fast block being a preset block that has a motion vector magnitude value greater than a motion vector threshold;

calculate a first ratio between the number of fast blocks and a total number of preset blocks in the video frame;

determine whether the first ratio is greater than a first preset ratio threshold; and

determine, if the first ratio is greater than the first preset ratio threshold, the video frame to be a target video frame; and

wherein when the video effect processing instruction includes a fast forward video effect processing instruction that is configured to trigger the video to be played faster than a normal speed, the instructions further cause the processor to, for each of the plurality of video frames;

acquire motion vector magnitude values of all preset blocks in the video frame;

determine a number of slow blocks in the video frame, a slow block being a preset block that has a motion vector magnitude value smaller than the motion vector threshold;

calculate a second ratio between the number of slow blocks and the total number of preset blocks in the video frame;

determine whether the second ratio is greater than a second preset ratio threshold; and

determine, if the second ratio is greater than the second preset ratio threshold, the video frame to be the target video frame.