Image display apparatus and computer program product

• US 20090080698A1
• Filed: 03/18/2008
• Published: 03/26/2009
• Est. Priority Date: 09/25/2007
• Status: Active Grant

• Current Assignee: Toshiba Visual Solutions Corporation (Toshiba Corporation)
• Original Assignee: Kabushiki Kaisha Toshiba (Toshiba Corporation)
• Inventors: Sekine, Masahiro, Yamauchi, Yasunobu, Higuchi, Yasukazu, Mihara, Isao
• Granted Patent: US 8,041,155 B2
• Time in Patent Office: Days
• US Class Current: 382/103
• CPC Class Codes: G06F 16/7328 Query by example, e.g. a complete video frame or video sequence graphical querying G06F16/7335
• CPC Class Codes: G06F 16/743 a collection of video files or sequences
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/783 using metadata automatically derived from the content
• CPC Class Codes: G06T 11/206 Drawing of charts or graphs

Abstract

A comprehensive degree of relevance of other moving picture contents with respect to a moving-picture content to be processed is calculated by using any one of or all of content information, frame information, and image characteristics, to display a virtual space in which a visualized content corresponding to a moving picture content to be displayed, which is selected based on the degree of relevance, is located at a position away from a layout position of the visualized content corresponding to the moving picture content to be processed, according to the degree of relevance.

Claims

1. An image display apparatus comprising:

a storage unit that stores moving picture contents in which frame information indicating a characteristic of each frame is added to any one or all of a series of frames constituting a moving picture, and content information indicating a characteristic of each of the moving picture contents;

a content selecting unit that selects a moving picture content to be processed from the moving picture contents stored in the storage unit;

a first relevant degree calculator that calculates a degree of relevance between the moving picture content to be processed and respective other moving picture contents, based on a similarity between content information related to the moving picture content to be processed and content information related to the moving picture contents other than the moving picture content to be processed stored in the storage unit;

a frame selecting unit that selects at least one frame contained in the moving picture content from the moving picture content to be processed, as a frame to be processed;

a second relevant degree calculator that calculates a degree of relevance between the moving picture content to be processed and respective other moving picture contents, based on a similarity between frame information added to the frame to be processed and frame information added to the frames in other moving picture contents;

an image analyzing unit that analyzes an image characteristic of an image contained in the frame to be processed and each frame constituting other moving picture contents;

a third relevant degree calculator that calculates a degree of relevance between the moving picture content to be processed and respective other moving picture contents, based on a similarity between an image analysis result of the frame to be processed and an image analysis result of frames in the other moving picture contents;

a content relevance calculator that calculates a comprehensive degree of relevance of each of the other moving picture contents with respect to the moving picture content to be processed, using the degree of relevance calculated by at least one of the first relevant degree calculator, the second relevant degree calculator, and the third relevant degree calculator;

a display-content selecting unit that selects a moving picture content to be displayed from the other moving picture contents, based on the comprehensive degree of relevance calculated by the content relevance calculator;

a content visualizing unit that generates a visualized content obtained by symbolizing the moving picture content to be processed and the moving picture content to be displayed, respectively;

a locating unit that locates a visualized content corresponding to the moving picture content to be processed in a virtual space, and respectively locates a visualized content corresponding to each moving picture content to be displayed at a position away from a layout position thereof according to the comprehensive degree of relevance of each moving picture content to be displayed;

a space visualizing unit that visualizes the virtual space, in which the visualized content is located, in a displayable state; and

a display unit that displays the visualized virtual space.

2. The apparatus according to claim 1, wherein the virtual space is a three-dimensional space, and

the locating unit respectively locates the visualized content corresponding to each moving picture content to be displayed, at a position away from the layout position of the visualized content corresponding to the moving picture content to be processed according to the degree of relevance of the moving picture content to be displayed, based on one coordinate system constituting the three-dimensional space, and respectively locates the visualized content corresponding to each moving picture content to be displayed in a predetermined region in a plane formed by the other two coordinates of the three-dimensional space categorized for each characteristic of the moving picture content, based on the content information of each moving picture content to be displayed.

3. The apparatus according to claim 2, wherein the locating unit allocates each characteristic of the moving picture content to each orientation direction in the plane based on the layout position of the visualized content corresponding to the moving picture content to be processed.

4. The apparatus according to-claim 1, further comprising:

a receiving unit that receives a selection of a specific visualized content from the visualized contents present in the virtual space displayed by the display unit, wherein

the content selecting unit selects a moving picture content corresponding to the selected specific visualized content as the moving picture content to be processed.

5. The apparatus according to claim 1, further comprising:

a layout-history managing unit that correspondingly stores the layout position in the virtual space of the visualized content located in the virtual space by the locating unit, the characteristic of the moving picture content corresponding to the visualized content, and the degree of relevance, wherein

the locating unit locates the visualized contents of the moving picture content having the same characteristic and substantially the same degree of relevance in the layout position stored corresponding to the characteristic and the degree of relevance, based on the layout-history managing unit.

6. The apparatus according to claim 1, further comprising:

an analyzing unit that analyzes a biased state of the visualized content located in the virtual space, wherein

the locating unit biases a coordinate system constituting the virtual space according to an analysis result by the analyzing unit.

7. The apparatus according to claim 1, further comprising:

an analyzing unit that analyzes a biased state of the visualized content located in the virtual space, wherein

the display-content selecting unit restricts the number of moving picture contents to be displayed, which are selected from the other moving picture contents, according to the analysis result by the analyzing unit.

8. The apparatus according to claim 1, further comprising:

an analyzing unit that analyzes a biased state of the visualized content located in the virtual space, wherein

the content visualizing unit combines a plurality of visualized contents in the biased state, according to the analysis result by the analyzing unit, thereby generating a new visualized content.

9. The apparatus according to claim 1, further comprising:

an analyzing unit that analyzes a biased state of the visualized content located in the virtual space; and

a content fabricating unit that combines the contents to be displayed according to the analysis result by the analyzing unit, to generate a new content to be displayed.

10. The apparatus according to claim 1, further comprising:

a relevance analyzing unit that analyzes a biased state of the visualized content located in the virtual space based on the degree of relevance calculated by the content relevance calculator and a layout status of the visualized content by the locating unit, wherein

the space visualizing unit changes a condition involved in visualization of the virtual space according to the analysis result by the relevance analyzing unit.

11. The apparatus according to claim 1, further comprising:

a layout-motion interpolating unit that interpolates the layout position of each visualized content located in the virtual space for every screen display interval of the display unit, wherein

the space visualizing unit updates the display of the virtual space for every screen display interval.

12. The apparatus according to claim 1, further comprising:

an electronic-program-guide managing unit that obtains electronic program guides from a server that distributes the electronic program guides, manages the electronic program guides as the content information, and manages moving picture data relating to the electronic program guides as the moving picture content;

a receiving unit that obtains stream-distributed data; and

a stream managing unit that manages the data obtained by the receiving unit as the moving picture content, and manages information of the data as the content information.

13. An image display apparatus comprising:

a storage unit that stores a plurality of moving picture contents;

a content selecting unit that selects a moving picture content to be processed from the moving picture contents stored in the storage unit;

a content relevance calculator that calculates a degree of relevance of each of moving picture contents other than the moving picture content to be processed with respect to the moving picture content to be processed, based on a degree of similarity between a characteristic of the moving picture content to-be processed and a characteristic of the other moving picture contents stored in the storage unit;

a content visualizing unit that generates visualized contents obtained by symbolizing the moving picture content to be processed and the other moving picture contents, respectively;

a locating unit that locates a visualized content corresponding to the moving picture content to be processed in a virtual space, and respectively locates a visualized content corresponding to each of the other moving picture contents at a position away from the located position of the moving picture content to be processed to the extent according to the degree of relevance of each of the other moving picture contents;

a space visualizing unit that visualizes the virtual space, in which the visualized contents are located, in a displayable state; and

a display unit that displays the visualized virtual space.

14. The apparatus according to claim 13, further comprising:

a display-content selecting unit that selects a moving picture content to be displayed from the other moving picture contents, based on the degree of relevance calculated by the content relevance calculator;

wherein

the content visualizing unit further generates visualized contents obtained by symbolizing the moving picture content to be displayed; and

the locating unit locates the respective visualized contents corresponding to the moving picture content to be displayed at a position away from the located position of the visualized contents corresponding to the moving picture content to be processed to the extent according to the degree of relevance of each of the moving picture contents to be displayed.

15. A computer program product having a computer readable medium including programmed instructions for displaying images, wherein the instructions, when executed by a computer, cause the computer to perform:

selecting a moving picture content to be processed from the moving picture contents stored in a storage unit that stores moving picture contents in which frame information indicating a characteristic of each frame is added to any one or all of a series of frames constituting a moving picture, and content information indicating a characteristic of each of the moving picture contents, each of the moving picture contents and the content information being related to each other;

first calculating a degree of relevance between the moving picture content to be processed and respective other moving picture contents, based on a similarity between content information related to the moving picture content to be processed and content information related to the moving picture contents other than the moving picture content to be processed stored in the storage unit;

selecting at least one frame contained in the moving picture content from the moving picture content to be processed, as a frame to be processed;

second calculating a degree of relevance between the moving picture content to be processed and respective other moving picture contents, based on a similarity between frame information added to the frame to be processed and frame information added to the frames in other moving picture contents;

analyzing an image characteristic of an image contained in the frame to be processed and each frame constituting other moving picture contents;

third calculating a degree of relevance between the moving picture content to be processed and respective other moving picture contents, based on a similarity between an image analysis result of the frame to be processed and an image analysis result of frames in the other moving picture contents;

calculating a comprehensive degree of relevance of each of the other moving picture contents with respect to the moving picture content to be processed, using the degree of relevance calculated by at least one of the first relevant degree calculator, the second relevant degree calculator, and the third relevant degree calculator;

selecting a moving picture content to be displayed from the other moving picture contents, based on the comprehensive degree of relevance calculated by the content relevance calculator;

generating a visualized content obtained by symbolizing the moving picture content to be processed and the moving picture content to be displayed, respectively;

locating a visualized content corresponding to the moving picture content to be processed in a virtual space, and respectively locating a visualized content corresponding to each moving picture content to be displayed at a position away from a layout position thereof according to the comprehensive degree of relevance of each moving picture content to be displayed;

visualizing the virtual space, in which the visualized content is located, in a displayable state; and

displaying the visualized virtual space.