Method, apparatus and computer program product for periodic motion detection in multimedia content

• US 9,269,158 B2
• Filed: 09/17/2013
• Issued: 02/23/2016
• Est. Priority Date: 09/25/2012
• Status: Active Grant

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Technologies Oy (Nokia Corporation)
• Inventors: Ukil, Soumik, Govindarao, Krishna Annasagar, Shenoy, Ravi
• Primary Examiner(s): Tsai, Tsung-Yin
• Application Number:
  US14/028,748
• Publication Number:
  US 20140086452A1
• Time in Patent Office: 889 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/20068 Projection on vertical or horizontal image axis
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51

Abstract

In an example embodiment a method, apparatus and computer program product are provided. The method includes facilitating selection of a region of interest (ROI) in a plurality of frames of a multimedia content. The ROI is associated with a motion of at least one object. An object mobility data matrix associated with the ROI is determined in the plurality of frames. The object mobility data matrix is indicative of a difference in motion of the at least one object in the plurality of frames. A projection of the object mobility data matrix is determined on a line. The motion of the at least one object in the ROI is determined across the plurality of frames to as a periodic motion or a non-periodic motion based on the projection of the object mobility data matrix.

Claims

1. A method comprising:

facilitating selection of a region of interest (ROI) associated with a motion of at least one object in a plurality of frames of a multimedia content is;

determining, by a processor, an object mobility data matrix associated with the ROI in the plurality of frames, the object mobility data matrix being indicative of a difference in motion of the at least one object in the plurality of frames;

determining a projection of the object mobility data matrix on a line; and

determining the motion of the at least one object in the ROI across the plurality of frames as a periodic motion or a non-periodic motion based on the projection of the object mobility data matrix;

wherein determining the motion comprises;

computing a cepstrum based on the projection; and

determining the motion of the at least one object as the periodic motion based on a presence of at least one peak in the computed cepstrum having an amplitude greater than a predetermined threshold amplitude, and a quefrency greater than a predetermined threshold quefrency.

2. The method as claimed in claim 1, wherein the line is orthogonal to a diagonal of the object mobility data matrix.

3. The method as claimed in claim 1, further comprising determining a period of the motion of the at least one object in the ROI, wherein the period of the motion comprises a value of quefrency at a peak of the at least one peak occurring in the computed cepstrum and having the amplitude greater than the predetermined threshold amplitude, and the quefrency greater than the predetermined threshold quefrency.

4. The method as claimed in claim 1, further comprising determining the motion as the non-periodic motion if the at least one peak having the amplitude greater than the predetermined threshold is not present in the cepstrum.

5. The method as claimed in claim 1, wherein the multimedia content comprises a video content.

6. The method as claimed in claim 1 further comprising generating an animated image associated with the multimedia content based on the selection of the ROI and determination of the period of the motion of the at least one object in the ROI.

7. An apparatus comprising:

at least one processor; and

at least one memory comprising computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus to at least perform;

facilitate selection of a region of interest (ROI) associated with a motion of at least one object in a plurality of frames of a multimedia content;

determine an object mobility data matrix associated with the ROI in the plurality of frames, the object mobility data matrix being indicative of a difference in motion of the at least one object in the plurality of frames;

determine a projection of the object mobility data matrix on a line; and

determine the motion of the at least one object in the ROI across the plurality of frames as a periodic motion or a non-periodic motion based on the projection of the object mobility data matrix;

wherein determining the motion comprises;

compute a cepstrum based on the projection; and

determine the motion of the at least one object as the periodic motion based on a presence of at least one peak in the computed cepstrum having an amplitude greater than a predetermined threshold amplitude, and a quefrency greater than a predetermined threshold quefrency.

8. The apparatus as claimed in claim 7, wherein the line is orthogonal to a diagonal of the object mobility data matrix.

9. The apparatus as claimed in claim 7, wherein the apparatus is further caused, at least in part to determine a period of the motion of the at least one object in the ROI, wherein the period of the motion comprises a value of quefrency at a peak of the at least one peak occurring in the computed cepstrum and having the amplitude greater than the predetermined threshold amplitude, and the quefrency greater than the predetermined threshold quefrency.

10. The apparatus as claimed in claim 7, wherein the apparatus is further caused, at least in part to determine the motion as the non-periodic motion if the at least one peak having the amplitude greater than the predetermined threshold is not present in the cepstrum.

11. The apparatus as claimed in claim 7, wherein the multimedia content comprises a video content.

12. The apparatus as claimed in claim 7, wherein the apparatus is further caused, at least in part to generate an animated image associated with the multimedia content based on the selection of the ROI and determination of the period of the motion of the at least one object in the ROI.

13. A non-transitory computer readable medium comprising a set of instructions, which, when executed by one or more processors, cause an apparatus to at least perform:

facilitate selection of a region of interest (ROI) associated with a motion of at least one object in a plurality of frames of a multimedia content;

determine an object mobility data matrix associated with the ROI in the plurality of frames, the object mobility data matrix being indicative of a difference in motion of the at least one object in the plurality of frames;

determine a projection of the object mobility data matrix on a line; and

determine the motion of the at least one object in the ROI across the plurality of frames as a periodic motion or a non-periodic motion based on the projection of the object mobility data matrix;

wherein determining the motion comprises;

compute a cepstrum based on the projection; and

determine the motion of the at least one object as the periodic motion based on a presence of at least one peak in the computed cepstrum having an amplitude greater than a predetermined threshold amplitude, and a quefrency greater than a predetermined threshold quefrency.

14. The non-transitory computer readable medium as claimed in claim 13, wherein the line is orthogonal to a diagonal of the object mobility data matrix.

15. The non-transitory computer readable medium as claimed in claim 13, wherein the apparatus is further caused, at least in part to determine a period of the motion of the at least one object in the ROI, wherein the period of the motion comprises a value of quefrency at a peak of the at least one peak occurring in the computed cepstrum and having the amplitude greater than the predetermined threshold amplitude, and the quefrency greater than the predetermined threshold quefrency.

16. The non-transitory computer readable medium as claimed in claim 13, wherein the apparatus is further caused, at least in part to determine the motion as the non-periodic motion if the at least one peak having the amplitude greater than the predetermined threshold is not present in the cepstrum.

17. The non-transitory computer readable medium as claimed in claim 13, wherein the apparatus is further caused, at least in part to generate an animated image associated with the multimedia content based on the selection of the ROI and determination of the period of the motion of the at least one object in the ROI.