Electronic apparatus and video display method

• US 7,986,819 B2
• Filed: 08/28/2009
• Issued: 07/26/2011
• Est. Priority Date: 10/24/2008
• Status: Active Grant

• Current Assignee: Toshiba Client Solutions CO., Ltd. (Hon Hai Precision Industry Co., Ltd.)
• Original Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Inventors: Momosaki, Kohei
• Primary Examiner(s): Couso; Jose L
• Application Number:
  US12/549,849
• Publication Number:
  US 20100104145A1
• Time in Patent Office: 697 Days
• Field of Search: 382/115, 382/117, 382/118, 348/77, 348/78, 348/143, 348/150, 705/1.1, 705/26, 705/37, 707/999.001, 707/999.002, 707/999.009, 707/999.01, 707/999.2, 709/217, 709/223, 713/150, 713/155, 713/170, 713/175, 713/176, 713/180
• US Class Current: 382/118
• CPC Class Codes: G06F 16/583 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/70 of video data
• CPC Class Codes: G06V 20/40 in video content extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44
• CPC Class Codes: G06V 40/173 face re-identification, e.g. recognising unknown faces across different face tracks

Abstract

According to one embodiment, an electronic apparatus includes an indexing module, an image display processing module, a playback processing module, and a emphasizing processing module. The indexing module extracts face images which appear in a sequence of moving image data, and outputs time stamp information indicating a timing of appearance of each of the extracted face images. The image display processing module displays the extracted face images on a first display area. The playback processing module plays back the moving image data and displays the moving image data on a second display area. The emphasizing processing module emphasizes, when the moving image data is played back, a face image on the first display area, which appears within a predetermined period corresponding to a present playback position of the moving image data, based on the time stamp information corresponding to each face image which belongs to the extracted face images.

Claims

1. An electronic apparatus comprising:

one or more processors configured to extract face images which appear in a sequence of moving image data in video content data, and to output time stamp information indicating a time of appearance of each of the extracted face images on the sequence of the moving image data;

display the extracted face images on a first display area on a display screen, the first display area comprising face image display areas arranged in a matrix including rows and columns, time segments in a total duration of the moving image data being assigned to the columns, the extracted face images being arranged on the columns assigned the time segments to which the time stamp information of the extracted face images belong;

play back the moving image data and to display the moving image data on a second display area on the display screen; and

display a first face image on the first display area with emphasis which appears within a time period corresponding to a playback position of the moving image data based on the time stamp information corresponding to each of the extracted face images, when the moving image data is played on the second display area.

2. The apparatus of claim 1, wherein the one or more processors is configured to classify the extracted face image, and to assign an identifier to face images classified as an identical person, and to display other face images on the first display area with emphasis which are assigned the same identifier as the identifier of the first face image.

3. The apparatus of claim 2, wherein the one or more processors is configured to update face images to be displayed with emphasis on the first display area along with progress of playback of the moving image data.

4. The apparatus of claim 1, wherein the one or more processors is configured to select a predetermined number of face images from face images which belong to each time segment, and to display the predetermined number of selected face images on the face image display areas of the corresponding column on the first display area, and to extract a face image which appears within the time period from the extracted face images, and to display the extracted face image on the face image display area of the corresponding column on the first display area with emphasis when the face image which appears within the time period is not displayed on the first display area.

5. An electronic apparatus comprising:

one or more processors configured to extract face images which appear in a sequence of moving image data in video content data, to output time stamp information indicating a time of appearance of each of the extracted face images on the sequence of the moving image data, to classify the extracted face images, and to assign an identifier to face images classified as an identical person;

select a predetermined number of face images which belong to each of time segments in an order of frequency of appearance based on the identifiers assigned to the extracted face images from the extracted face images and to display the predetermined number of the selected face images on a first display area on a display screen, the first display area comprising face image display areas arranged in a matrix including rows and columns, time segments in a total duration of the moving image data being assigned to the columns, the predetermined number of the selected face images being arranged on the image display areas of the corresponding columns in the first display area;

play back the moving image data and to display the moving image data on a second display area on the display screen; and

display a first face image which appears within the time period corresponding to a playback position of the moving image, and other face images which are assigned the same identifier as the identifier of the first face image, on the first display area with emphasis based on the time stamp information corresponding to the extracted face images, when the moving image data is played on the second display area.

6. The apparatus of claim 5, wherein the one or more processors is configured to extract a face image which appears within the time period from the extracted face images, and to display the extracted face image on the face image display area of the corresponding column on the first display area with emphasis when the first face image which appears within the time period is not displayed on the first display area.

7. A video processing method comprising:

using one or more processors for extracting face images which appear in a sequence of moving image data in video content data, and

outputting time stamp information indicating a time of appearance of each of the extracted face images on the sequence of the moving image data;

displaying the extracted face images on a first display area on a display screen, the first display area comprising face image display areas arranged in a matrix including rows and columns, time segments in a total duration of the moving image data being assigned to the columns, the extracted face images being arranged on the columns assigned the time segments to which the time stamp information of the extracted face images belong;

playing back the moving image data and displaying the moving image data on a second display area on the display screen; and

displaying a first face image on the first display area with emphasis which appears within the time period corresponding to a playback position of the moving image data, based on the time stamp information corresponding to each of the extracted face image, when the moving image data is played on the second display area.

8. The method of claim 7, wherein

the extracting and outputting comprise classifying the extracted face images, and assigning an identifier to face images classified as an identical person;

and

the displaying comprises displaying other face images on the first display area with emphasis which are assigned the same identifier as the identifier of the first face image.