Video browser based on character relation
First Claim
Patent Images
1. An apparatus for processing multimedia data, the apparatus comprising:
- a memory; and
a processor configured to perform operations comprising;
receiving segment information about an audio-visual program, the segment information including segment location information identifying a plurality of audio-visual segments in the audio-visual program, wherein the segment location information defines each audio-visual segment by a temporal position in a multimedia stream of the audio-visual program and wherein each audio-visual segment represents a continuous temporal content portion in the audio-visual program;
generating a hierarchical data structure configured to facilitate browsing content in the audio-visual program, the hierarchical data structure including a first structural part which stores the segment information and a distinct second structural part which stores segment group information defining first and second segment groups for the audio-visual program, each of the first and second segment groups defining a respective set of non-contiguous audio-visual segments which are selected from the plurality of audio-visual segments and identified in the segment group information by references to the corresponding segments in the segment information of the audio-visual program, wherein said segment group information specifies a respective group type and a respective duration for each of said first and second segment groups, the respective group types indicating that the first and second segment groups represent respective first and second content summaries related to objects or events as depicted in the audio-visual program, and wherein the segment group information includes segment order information defining that (i) the audio-visual segments within the first segment group are ordered relative to each other according to a time sequence that is significant for the first content summary'"'"'s representation of the corresponding events or objects in the audio-visual program and (ii) the audio-visual segments within the second segment group are not ordered relative to each other according to any time sequence that is significant for the second content summary'"'"'s representation of the corresponding events or objects in the audio-visual program; and
storing the hierarchical data structure including the segment information and the segment group information in the memory.
1 Assignment
0 Petitions
Accused Products
Abstract
A video data structure and a video browser for video browsing based on content is disclosed. An embodiment of the present invention allows users to easily understand relationships between characters and changes in relationships between characters in a movie or drama by displaying significant events in connection to corresponding relationships and by displaying character relationships in a tree structure.
-
Citations
24 Claims
-
1. An apparatus for processing multimedia data, the apparatus comprising:
-
a memory; and a processor configured to perform operations comprising; receiving segment information about an audio-visual program, the segment information including segment location information identifying a plurality of audio-visual segments in the audio-visual program, wherein the segment location information defines each audio-visual segment by a temporal position in a multimedia stream of the audio-visual program and wherein each audio-visual segment represents a continuous temporal content portion in the audio-visual program; generating a hierarchical data structure configured to facilitate browsing content in the audio-visual program, the hierarchical data structure including a first structural part which stores the segment information and a distinct second structural part which stores segment group information defining first and second segment groups for the audio-visual program, each of the first and second segment groups defining a respective set of non-contiguous audio-visual segments which are selected from the plurality of audio-visual segments and identified in the segment group information by references to the corresponding segments in the segment information of the audio-visual program, wherein said segment group information specifies a respective group type and a respective duration for each of said first and second segment groups, the respective group types indicating that the first and second segment groups represent respective first and second content summaries related to objects or events as depicted in the audio-visual program, and wherein the segment group information includes segment order information defining that (i) the audio-visual segments within the first segment group are ordered relative to each other according to a time sequence that is significant for the first content summary'"'"'s representation of the corresponding events or objects in the audio-visual program and (ii) the audio-visual segments within the second segment group are not ordered relative to each other according to any time sequence that is significant for the second content summary'"'"'s representation of the corresponding events or objects in the audio-visual program; and storing the hierarchical data structure including the segment information and the segment group information in the memory. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A method implemented by an apparatus for processing multimedia data, the method comprising:
-
generating segment information about an audio-visual program as a first structural part of a hierarchical data structure configured to facilitate browsing content in the audio-visual program, the segment information including segment location information identifying a plurality of audio-visual segments in the audio-visual program, wherein the segment location information defines each audio-visual segment by a temporal position in a multimedia stream of the audio-visual program and wherein each audio-visual segment represents a continuous temporal content portion in the audio-visual program; generating segment group information as a distinct second structural part of the hierarchical data structure configured to facilitate browsing content in the audio-visual program; and transmitting said segment information and said segment group information to a client, wherein said segment group information; defines first and second segment groups for the audio-visual program, each of which defines a respective set of non-contiguous audio-visual segments which are selected from the plurality of audio-visual segments and identified in the segment group information by references to the corresponding segments in the segment information of the audio-visual program; specifies a respective group type and a respective duration for each of said first and second segment groups, the respective group types indicating that the first and second segment groups represent respective first and second content summaries related to objects or events as depicted in the audio-visual program; and includes segment order information defining that (i) the audio-visual segments within the first segment group are ordered relative to each other according to a time sequence that is significant for the first content summary'"'"'s representation of the corresponding events or objects in the audio-visual program and (ii) the audio-visual segments within the second segment group are not ordered relative to each other according to any time sequence that is significant for the second content summary'"'"'s representation of the corresponding events or objects in the audio-visual program. - View Dependent Claims (10, 11, 12)
-
-
13. An apparatus for processing multimedia data, the apparatus comprising:
-
a memory; and a processor configured to perform operations comprising; receiving segment information about an audio-visual program, the segment information including segment location information identifying a plurality of audio-visual segments in the audio-visual program, wherein segment location information defines each audio-visual segment by a temporal position in a multimedia stream of the audio-visual program and wherein each audio-visual segments represents a continuous temporal content portion in the audio-visual program; receiving segment group information defining first and second segment groups for the audio-visual program; generating a hierarchical data structure configured to facilitate browsing content in the audio-visual program, the hierarchical data structure including a first structural part which stores the received segment information and a distinct second structural part which stores the segment group information, wherein each of the first and second segment groups define a respective set of non-contiguous audio-visual segments which are selected from the plurality of audio-visual segments and identified in the segment group information by references to the corresponding segments in the segment information of the audio-visual program, wherein said segment group information specifies a respective group type and a respective duration for each of said first and second segment groups, the respective group types indicating that the first and second segment groups represent respective first and second content summaries related to objects or events as depicted in the audio-visual program, and wherein the segment group information includes segment order information defining that (i) the audio-visual segments within the first segment group are ordered relative to each other according to a time sequence that is significant for the first content summary'"'"'s representation of the corresponding events or objects in the audio-visual program and (ii) the audio-visual segments within the second segment group are not ordered relative to each other according to any time sequence that is significant for the second content summary'"'"'s representation of the corresponding events or objects in the audio-visual program; and storing the hierarchical data structure including the segment information and the segment group information in the memory. - View Dependent Claims (14, 15, 16)
-
-
17. A method implemented by an apparatus for processing multimedia data, the method comprising:
-
receiving segment information about an audio-visual program, the segment information including segment location information identifying a plurality of audio-visual segments in the audio-visual program, wherein the segment location information defines each audio-visual segment by a temporal position in a multimedia stream of the audio-visual program and wherein each audio-visual segment represents a continuous temporal content portion in the audio-visual program; receiving segment group information from a provider; and storing said received segment information and said segment group information in distinct first and second structural parts of a hierarchical data structure configured to facilitate browsing content in the audio-visual program in a client, wherein said segment group information; defines first and second segment groups for the audio-visual program, each of which defines a respective set of non-contiguous audio-visual segments that are selected from the plurality of audio-visual segments and identified in the segment group information by references to the corresponding segments in the segment information of the audio-visual program; specifies a respective group type and a respective duration for each of said first and second segment groups, the respective group types indicating that the first and second segment groups represent respective first and second content summaries related to objects or events as depicted in the audio-visual program; and includes segment order information defining that (i) the audio-visual segments within the first segment group are ordered relative to each other according to a time sequence that is significant for the first content summary'"'"'s representation of the corresponding events or objects in the audio-visual program and (ii) the audio-visual segments within the second segment group are not ordered relative to each other according to any time sequence that is significant for the second content summary'"'"'s representation of the corresponding events or objects in the audio-visual program. - View Dependent Claims (18, 19, 20)
-
-
21. A storage medium storing a hierarchical data structure configured to be processed by multimedia data processing apparatus to facilitate browsing content in an audio-visual program, the stored hierarchical data structure comprising:
-
a first structural part which stores segment information about the audio-visual program, the segment information including segment location information identifying a plurality of audio-visual segments in the audio-visual program, wherein the segment location information defines each audio-visual segment by a temporal position in a multimedia stream of the audio-visual program and wherein each audio-visual segment represents a continuous temporal content portion in the audio-visual program; a distinct second structural part which stores segment group information defining first and second segment groups for the audio-visual program, each of which defines a respective set of non-contiguous audio-visual segments that are selected from the plurality of audio-visual segments and identified in the segment group information by references to the corresponding segments in the segment information of the audio-visual program, wherein said segment group information specifies a respective group type and a respective duration for each of said first and second segment groups, the respective group types indicating that the first and second segment groups represent respective first and second content summaries related to objects or events as depicted in the audio-visual program, and wherein the segment group information includes segment order information defining that (i) the audio-visual segments within the first segment group are ordered relative to each other according to a time sequence that is significant for the first content summary'"'"'s representation of the corresponding events or objects in the audio-visual program and (ii) the audio-visual segments within the second segment group are not ordered relative to each other according to any time sequence that is significant for the second content summary'"'"'s representation of the corresponding events or objects in the audio-visual program. - View Dependent Claims (22, 23, 24)
-
Specification