Method for content-based non-linear control of multimedia playback
First Claim
1. A method comprising:
- receiving, via a graphical user interface of a mobile control device and from a user, a search term, wherein the mobile control device communicates over a communication network with a plurality of external devices;
searching, based on the search term, a plurality of multimedia data stored in a database at a multimedia server to generate matched multimedia data associated with the search term, the matched multimedia data comprising a condensed representation pertaining to a video content, offline transcriptions, and closed captions associated with the video content, wherein the condensed representation, the offline transcriptions, and the closed captions associated with the video content are stored in the database, wherein the matched multimedia data is generated by automatically;
analyzing the video content and identifying video shot boundaries in the video content;
extracting, from the video content, (1) text from the closed captions and (2) a frame corresponding to the text; and
extracting small segments of organized multimedia data based on topic boundaries and the video shot boundaries, each small segment of the small segments being smaller than a respective program containing the small segments;
displaying, with the matched multimedia data and via the graphical user interface, a plurality of command icons for controlling which display device, of the plurality of external devices, selected video content will be played on;
receiving, via the graphical user interface of the mobile control device and from the user, a choice from the matched multimedia data to yield the selected video content;
identifying a first display device of the plurality of external devices connected to the mobile control device via the communication network;
identifying a second display device of the plurality of external devices connected to the mobile control device via the communication network, the second display device being distinct from the first display device; and
receiving, via the graphical user interface of the mobile control device, a user input to play the selected video content on one of the first display device and the second display device, wherein the plurality of command icons remains on the graphical user interface of the mobile control device after the first display device or the second display device has been selected for control so that the user can assert control commands regardless of where the user is in a navigation session.
1 Assignment
0 Petitions
Accused Products
Abstract
A system and method are provided for content-based non-linear control of video data playback. A multimedia database having multimedia data including multimedia content data is searched based on a user query to determine a first set of multimedia data. The multimedia data includes indexes to and condensed representations of corresponding video data stored in a video database. A portion of the first set of multimedia data is displayed at a control device in response to the user query. A user of the control device selects an element of the first set of multimedia data for video playback and video data corresponding to the element delivered to a video device for playback. A user of the control device selects an element of the first set of multimedia data for additional information and a second set of multimedia data corresponding to the element delivered to the control device.
122 Citations
17 Claims
-
1. A method comprising:
-
receiving, via a graphical user interface of a mobile control device and from a user, a search term, wherein the mobile control device communicates over a communication network with a plurality of external devices; searching, based on the search term, a plurality of multimedia data stored in a database at a multimedia server to generate matched multimedia data associated with the search term, the matched multimedia data comprising a condensed representation pertaining to a video content, offline transcriptions, and closed captions associated with the video content, wherein the condensed representation, the offline transcriptions, and the closed captions associated with the video content are stored in the database, wherein the matched multimedia data is generated by automatically; analyzing the video content and identifying video shot boundaries in the video content; extracting, from the video content, (1) text from the closed captions and (2) a frame corresponding to the text; and extracting small segments of organized multimedia data based on topic boundaries and the video shot boundaries, each small segment of the small segments being smaller than a respective program containing the small segments; displaying, with the matched multimedia data and via the graphical user interface, a plurality of command icons for controlling which display device, of the plurality of external devices, selected video content will be played on; receiving, via the graphical user interface of the mobile control device and from the user, a choice from the matched multimedia data to yield the selected video content; identifying a first display device of the plurality of external devices connected to the mobile control device via the communication network; identifying a second display device of the plurality of external devices connected to the mobile control device via the communication network, the second display device being distinct from the first display device; and receiving, via the graphical user interface of the mobile control device, a user input to play the selected video content on one of the first display device and the second display device, wherein the plurality of command icons remains on the graphical user interface of the mobile control device after the first display device or the second display device has been selected for control so that the user can assert control commands regardless of where the user is in a navigation session. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A system comprising:
-
a processor; and a computer-readable storage medium having instructions stored which, when executed by the processor, cause the processor to perform operations comprising; receiving, via a graphical user interface of a mobile control device and from a user, a search term, wherein the mobile control device communicates over a communication network with a plurality of external devices; searching, based on the search term, a plurality of multimedia data stored in a database at a multimedia server to generate matched multimedia data associated with the search term, the matched multimedia data comprising a condensed representation pertaining to a video content, offline transcriptions, and closed captions associated with the video content, wherein the condensed representation, the offline transcriptions, and the closed captions associated with the video content are stored in the database, wherein the matched multimedia data is generated by automatically; analyzing the video content and identifying video shot boundaries in the video content; extracting, from the video content, (1) text from the closed captions and (2) a frame corresponding to the text; and extracting small segments of organized multimedia data based on topic boundaries and the video shot boundaries, each small segment of the small segments being smaller than a respective program containing the small segments; displaying, with the matched multimedia data and via the graphical user interface, a plurality of command icons for controlling which display device, of the plurality of external devices, selected video content will be played on; receiving, via the graphical user interface of the mobile control device and from the user, a choice from the matched multimedia data to yield the selected video content; identifying a first display device of the plurality of external devices connected to the mobile control device via the communication network; identifying a second display device of the plurality of external devices connected to the mobile control device via the communication network, the second display device being distinct from the first display device; and receiving, via the graphical user interface of the mobile control device, a user input to play the selected video content on one of the first display device and the second display device, wherein the plurality of command icons remains on the graphical user interface of the mobile control device after the first display device or the second display device has been selected for control so that the user can assert control commands regardless of where the user is in a navigation session. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16)
-
-
17. A computer-readable storage device having instructions stored which, when executed by a computing device, cause the computing device to perform operations comprising:
receiving, via a graphical user interface of a mobile control device and from a user, a search term, wherein the mobile control device communicates over a communication network with a plurality of external devices; searching, based on the search term, a plurality of multimedia data stored in a database at a multimedia server to generate matched multimedia data associated with the search term, the matched multimedia data comprising a condensed representation pertaining to a video content, offline transcriptions, and closed captions associated with the video content, wherein the condensed representation, the offline transcriptions, and the closed captions associated with the video content are stored in the database, wherein the matched multimedia data is generated by automatically; analyzing the video content and identifying video shot boundaries in the video content; extracting, from the video content, (1) text from the closed captions and (2) a frame corresponding to the text; and extracting small segments of organized multimedia data based on topic boundaries and the video shot boundaries, each small segment of the small segments being smaller than a respective program containing the small segments; displaying, with the matched multimedia data and via the graphical user interface, a plurality of command icons for controlling which display device, of the plurality of external devices, selected video content will be played on; receiving, via the graphical user interface of the mobile control device and from the user, a choice from the matched multimedia data to yield the selected video content; identifying a first display device of the plurality of external devices connected to the mobile control device via the communication network; identifying a second display device of the plurality of external devices connected to the mobile control device via the communication network, the second display device being distinct from the first display device; and receiving, via the graphical user interface of the mobile control device, a user input to play the selected video content on one of the first display device and the second display device, wherein the plurality of command icons remains on the graphical user interface of the mobile control device after the first display device or the second display device has been selected for control so that the user can assert control commands regardless of where the user is in a navigation session.
Specification