METHOD AND DEVICE FOR DETERMINING INTER-CUT TIME RANGE IN MEDIA ITEM

• US 20200057890A1
• Filed: 10/24/2019
• Published: 02/20/2020
• Est. Priority Date: 04/28/2017
• Status: Active Grant

• Current Assignee: Advanced New Technologies Company Limited (Ant Group Co., Ltd.)
• Original Assignee: Alibaba Group Holding Ltd.
• Inventors: LIU, Lindong
• Granted Patent: US 10,936,878 B2
• Time in Patent Office: Days
• CPC Class Codes: G06V 20/42 of sport video content
• CPC Class Codes: G06V 20/49 Segmenting video sequences, i.e. computational techniques such as parsing or cutting the sequence, low-level clustering or determining units such as shots or scenes
• CPC Class Codes: H04H 60/37 for identifying segments of broadcast information, e.g. scenes or extracting programme ID
• CPC Class Codes: H04H 60/58 of audio determination or detection of speech characteristics in general G10L25/00; speech recognition in general G10L15/00
• CPC Class Codes: H04H 60/59 of video recognising characters or patterns in general G06F18/00, G06V20/00
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/454 Content or additional data filtering, e.g. blocking advertisements
• CPC Class Codes: H04N 21/47217 for controlling playback functions for recorded or on-demand content, e.g. using progress bars, mode or play-point indicators or bookmarks specific graphical features in visual interfaces H04N21/4312
• CPC Class Codes: H04N 21/8126 involving additional data, e.g. news, sports, stocks, weather forecasts
• CPC Class Codes: H04N 21/845 Structuring of content, e.g. decomposing content into time segments
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments

Abstract

This specification describes techniques for determining an inter-cut time range in a media item. In one example method, a set of candidate segmentation points representing time points in a media item is determined, wherein each candidate segmentation point represents at least one of a time point at which feature media data appears in the media item, or a time point at which feature media data disappears from the media item. Based on the candidate segmentation points, an inter-cut time range is identified. The inter-cut time range is associated with a start point from the candidate segmentation points that satisfies a predetermined start point condition, and the inter-cut time range is associated with an end point from the candidate segmentation points that satisfies a predetermined end point condition. The inter-cut time range represents a time period between the start point and the end point in the media item.

Claims

1. A computer-implemented method for determining an inter-cut time range in a media item, comprising:

determining candidate segmentation points representing time points in the media item, wherein each candidate segmentation point represents at least one of a time point at which feature media data appears in the media item, or a time point at which feature media data disappears from the media item; and

identifying an inter-cut time range based on the candidate segmentation points, the inter-cut time range associated with a start point from the candidate segmentation points that satisfies a predetermined start point condition, and associated with an end point from the candidate segmentation points that satisfies a predetermined end point condition, wherein the inter-cut time range represents a time period between the start point and the end point in the media item.

2. The computer-implemented method of claim 1, wherein the feature media data comprises a feature image in a video picture produced by playing the media item.

3. The computer-implemented method of claim 2, wherein the predetermined start point condition comprises that the feature image appears in or disappears from the video picture.

4. The computer-implemented method of claim 2, wherein the predetermined end point condition comprises that the feature image disappears from or appears in the video picture.

5. The computer-implemented method of claim 2, wherein the feature image is located in a predetermined area in the video picture, and wherein determining the candidate segment points comprises:

analyzing at least one of a color ratio or a graphics shape of the predetermined area in the video picture; and

identifying, as a candidate segmentation point, at least one of a time point at which the feature image appears in the predetermined area or a time point at which the feature image disappears from the predetermined area.

6. The method according to claim 2, wherein the feature image comprises a scoreboard in a sports game video.

7. The computer-implemented method of claim 1, wherein the feature media data comprises a feature sound in the media item.

8. The computer-implemented method of claim 7, wherein the feature sound comprises a sound with at least one of a predetermined volume, tone, or timbre, and wherein the predetermined start point condition comprises a time point at which the feature sound appears in or disappears from the media item.

9. The computer-implemented method of claim 7, wherein the feature sound comprises a sound with at least one of a predetermined volume, tone, or timbre, and wherein the predetermined end point condition comprises a time point at which the feature sound disappears from or appears in the media item.

10. The computer-implemented method of claim 7, wherein the feature sound comprises a sound with at least one of a predetermined volume, tone, or timbre.

11. The computer-implemented method of claim 1 further comprising using different colors in a progress bar to show an area corresponding to the inter-cut time range and an area corresponding to a non-spot period when the media item is played.

12. The computer-implemented method of claim 1 further comprising skipping the inter-cut time range when the media item is played.

13. The computer-implemented method of claim 1 further comprising deleting the inter-cut time range from the media item.

14. A non-transitory, computer-readable medium storing one or more instructions executable by a computer system to perform operations comprising:

determining candidate segmentation points representing time points in a media item, wherein each candidate segmentation point represents at least one of a time point at which feature media data appears in the media item, or a time point at which feature media data disappears from the media item; and

identifying an inter-cut time range based on the candidate segmentation points, the inter-cut time range associated with a start point from the candidate segmentation points that satisfies a predetermined start point condition, and associated with an end point from the candidate segmentation points that satisfies a predetermined end point condition, wherein the inter-cut time range represents a time period between the start point and the end point in the media item.

15. The non-transitory, computer-readable medium of claim 14, wherein the feature media data comprises a feature image in a video picture produced by playing the media item.

16. The non-transitory, computer-readable medium of claim 15, wherein the predetermined start point condition comprises that the feature image appears in or disappears from the video picture.

17. The non-transitory, computer-readable medium of claim 15, wherein the predetermined end point condition comprises that the feature image disappears from or appears in the video picture.

18. The non-transitory, computer-readable medium of claim 15, wherein the feature image is located in a predetermined area in the video picture, and wherein determining the candidate segment points comprises:

analyzing at least one of a color ratio or a graphics shape of the predetermined area in the video picture; and

identifying, as a candidate segmentation point, at least one of a time point at which the feature image appears in the predetermined area or a time point at which the feature image disappears from the predetermined area.

19. The non-transitory, computer-readable medium of claim 15, wherein the feature image comprises a scoreboard in a sports game video.

20. A computer-implemented system, comprising:

one or more computers; and

one or more computer memory devices interoperably coupled with the one or more computers and having tangible, non-transitory, machine-readable media storing one or more instructions that, when executed by the one or more computers, perform one or more operations comprising;

determining candidate segmentation points representing time points in a media item, wherein each candidate segmentation point represents at least one of a time point at which feature media data appears in the media item, or a time point at which feature media data disappears from the media item; and

identifying an inter-cut time range based on the candidate segmentation points, the inter-cut time range associated with a start point from the candidate segmentation points that satisfies a predetermined start point condition, and associated with an end point from the candidate segmentation points that satisfies a predetermined end point condition, wherein the inter-cut time range represents a time period between the start point and the end point in the media item.