Content processing apparatus and method, and program

• US 9,325,946 B2
• Filed: 03/30/2011
• Issued: 04/26/2016
• Est. Priority Date: 04/09/2010
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Tanaka, Kazumasa, Tanaka, Kenji, Takahashi, Yoshihiro
• Primary Examiner(s): Tran, Thai
• Assistant Examiner(s): Yang, Nien-Ru
• Application Number:
  US13/635,059
• Publication Number:
  US 20130011120A1
• Time in Patent Office: 1,854 Days
• Field of Search: 386/241, 386/E9.011
• US Class Current: 1/1
• CPC Class Codes: G06F 16/5838 using colour
• CPC Class Codes: G06F 16/738 Presentation of query results
• CPC Class Codes: G06F 16/785 using colour or luminescence
• CPC Class Codes: G11B 27/105 of operating discs
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/4828 for searching program descriptors retrieval of video data G06F16/739
• CPC Class Codes: H04N 21/8153 comprising still images, e.g. texture, background image
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests
• CPC Class Codes: H04N 9/8227 the additional signal being at least another television signal

Abstract

Metadata including information identifying scene change points is extracted from a moving image. Representative images, which are still images corresponding to the identified scene change points of the content, are extracted from the moving image. A timeline of the content is displayed, and indications of the locations and durations of scenes identified by the scene change points are displayed. Thumbnails of the representative images are displayed at time positions associated with the content timeline; and the location in a scene of a representative image is displayed with an identifying characteristic that identifies the corresponding thumbnail.

Claims

1. A content processing apparatus comprising:

a metadata extracting unit configured to extract metadata from content of a moving image, the metadata including information identifying scene change points of the content;

an image extracting unit configured to extract from the moving image representative images which are still images corresponding to the identified scene change points of the content;

a still image display configured to display in a predetermined thumbnail display area an array of particular extracted still images corresponding to the representative images at the identified scene change points; and

a timeline display configured to display a timeline of the content and including a scene display region for displaying plural representations of temporal length and locations of respective plural scenes identified by the scene change points of the content, the timeline display displaying thumbnail images of the extracted still images that are displayed in the thumbnail display area, juxtaposed at time positions along the content timeline indicating the locations in the moving image content of a respective still image, the scene display region further displaying identifying characteristics within the plural representations of the respective plural scenes that identify the locations of those corresponding thumbnail images within the plural scenes, and when the content is instructed to be replayed a slider representing the position of the content then being replayed is displayed on a time axis of the timeline for specifying a position in the scene of a frame of the content being replayed, and wherein a predetermined display characteristic of the displayed thumbnail image in the timeline display that corresponds to an image included in the scene being replayed at the specified position of the slider is changed to visually identify the image in the content that is then being replayed.

2. The content processing apparatus according to claim 1,

wherein the identifying characteristic is a color representing the scene specified by a predetermined method to display the content in the timeline.

3. The content processing apparatus according to claim 2,

wherein the timeline display includes a screen to display the moving image at a predetermined position of the screen.

4. The content processing apparatus according to claim 3,

wherein the timeline display generates display data for displaying on the screen a representative image display region for displaying a list of the representative images, and a moving image display region for displaying the moving image of the replayed content.

5. A non-transitory computer readable medium on which is recorded a program that, when read, controls a computer to operate as a content processing apparatus comprised of:

a metadata extracting unit that extracts metadata from content of a moving image, the metadata including information identifying scene change points of the content;

an image extracting unit for extracting from the moving image representative images which are still images corresponding to the identified scene change points of the content;

a still image display unit for displaying in a predetermined thumbnail display area an array of particular extracted still images corresponding to the representative images at the identified scene change points; and

a timeline display unit for displaying a timeline of the content and including a scene display region for displaying plural representations of temporal length and locations of respective plural scenes identified by the scene change points of the content, the timeline display means displaying thumbnail images of the extracted still images that are displayed in the thumbnail display area, juxtaposed at time positions along the content timeline indicating the locations in the moving image content of a respective still image, the scene display region further displaying identifying characteristics within the plural representations of the respective plural scenes that identify the locations of those corresponding thumbnail images within the plural scenes, and when the content is instructed to be replayed a slider representing the position of the content then being replayed is displayed on a time axis of the timeline for specifying a position in the scene of a frame of the content being replayed, and wherein a predetermined display characteristic of the displayed thumbnail image in the timeline display that corresponds to an image included in the scene being replayed at the specified position of the slider is changed to visually identify the image in the content that is then being replayed.

6. A content processing method comprising:

extracting metadata from content of a moving image, the metadata including information identifying scene change points of the content;

extracting from the moving image representative images which are still images corresponding to the identified scene change points of the content;

displaying in a predetermined thumbnail display area an array of particular extracted still images corresponding to the representative images at the identified scene change points; and

displaying display data representing a timeline of the content including a scene display region for displaying plural representations of temporal length and locations of respective plural scenes identified by the scene change points of the content, and to display thumbnail images of the extracted still images that are displayed in the thumbnail display area juxtaposed at time positions along the content timeline indicating the locations in the moving image content of a respective still image, the scene display region further displaying identifying characteristics within the plural representations of the respective plural scenes that identify the locations of those corresponding thumbnail images within the plural scenes, and when the content is replayed, to cause the display of a slider representing the position of the content then being replayed on a time axis of the timeline for specifying a position in the scene of a frame then being replayed in that content, and to change a predetermined display characteristic of the displayed thumbnail image in the timeline display that corresponds to an image included in the scene being replayed at the specified position of the slider to visually identify the image in the content that is then being replayed.