Video providing textual content system and method

• US 9,565,476 B2
• Filed: 12/03/2012
• Issued: 02/07/2017
• Est. Priority Date: 12/02/2011
• Status: Active Grant

• Current Assignee: Netzyn, Inc.
• Original Assignee: Netzyn, Inc.
• Inventors: Bakke, Steve
• Primary Examiner(s): Huynh, An Son P
• Application Number:
  US13/692,349
• Publication Number:
  US 20130145394A1
• Time in Patent Office: 1,527 Days
• Field of Search: 725/38, 725/88, 725/90, 725/102, 386/343, 386345-357
• US Class Current: 1/1
• CPC Class Codes: H04N 21/42224 Touch pad or touch panel provided on the remote control
• CPC Class Codes: H04N 21/472 End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content end-user interfaces for retrieving video data from a database G06F16/739; network services for supporting unicast streaming H04L65/612
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments

Abstract

A system for interacting with a video includes a processor, a video decoder communicatively connected to the processor, a storage communicatively connected to the demultiplexer, the storage contains at least one video file having more than one video frame, at least one of the video frame including at least one respective metadata segment of the video frame, and an input device communicatively connected to the processor. The processor, responsive to the input device, processes the at least one of the video frame including the at least one respective metadata segment, controlling selection of another of the more than one video frame for the video decoder.

Claims

1. A system for interacting with a video, comprising:

an input device;

a processor communicatively connected to the input device for processing the video, wherein the video comprises a header section and a plurality of video frames, each video frame of the plurality of video frames includes a respective video segment and a respective metadata segment, wherein the respective metadata segment in each video frame includes one or more logical determinants, each of the one or more logical determinants is associated with a respective action type and a respective video frame identifier for logically selecting the respective video frame identifier of a respective video frame based on a respective action type included in a respective input received from the input device;

a video decoder communicatively connected to the processor;

a demultiplexer communicatively connected to the video decoder;

a storage communicatively connected to the demultiplexer;

a display communicatively connected to the processor;

the storage contains computer readable instructions, which when executed by the processor to perform;

reading the header section of the video to determine a respective segment of the header section that corresponds to a first video frame of the plurality of video frames;

calling the first video frame of the video, the first video frame includes a first respective metadata segment and a first respective video segment, wherein the first respective metadata segment includes a third video frame identifier and at least one logical determinant associated with an action type for logically selecting the third video frame identifier of a third video frame of the plurality of video frames responsive to a select input received by the processor from the input device;

receiving the first video frame of the video from the demultiplexer and the video decoder;

displaying by the display, the first video segment of the first video frame of the video received from the demultiplexer and the video decoder;

in response to an action type included in the select input received by the processor from the input device corresponding to the first respective metadata segment;

(i) processing the first respective metadata segment of the first video frame, (ii) based on;

(a) the action type included in the select input, (b) the action type associated with at least one logical determinant included in the first respective metadata segment, and (c) the third frame identifier included in the first respective metadata segment, selecting the third video frame for the video decoder, the third video frame includes a third respective metadata segment and third respective video segment, wherein the third respective metadata segment includes another video frame identifier and at least one logical determinant associated with an action type for logically selecting another video frame identified by the another video frame identifier, (iii) receiving the third video frame of the video from the demultiplexer and the video decoder, and (iv) displaying by the display, the third respective video segment of the third video frame of the video received from the demultiplexer and the video decoder; and

in response to the select input is not received by the processor from the input device;

(i) reading the header section of the video for another respective segment of the header section corresponding to a second video frame of the plurality of video frames, (ii) calling the second video frame of the video, the second video frame includes a second respective video segment and a second respective metadata segment, wherein the second respective metadata segment includes a fourth video frame identifier and at least one logical determinant associated with an action type for logically selecting the fourth video frame identifier of a fourth video frame of the plurality of video frames responsive to another select input received by the processor from the input device, (iii) receiving the second video frame of the video from the demultiplexer and the video decoder, and (iv) displaying by the display, the second respective video segment of the second video frame of the video received from the demultiplexer and the video decoder.

2. A system for processing a video file structure of a plurality of respective video frames of the video file structure in a non-transitory tangible media, comprising:

an input device;

a processor communicatively connected to the video file structure and the input device, for processing the plurality of respective video frames, wherein the video file structure comprises a header section and the plurality of respective video frames, each respective video frame of the plurality of respective video frames includes a respective video segment and a respective metadata segment, wherein the respective metadata segment in each respective video frame of the plurality of respective video frames includes at least another respective video frame identifier associated with respective one or more logical determinants, each of the respective one or more logical determinants is associated with a respective select input type for logically selecting the at least another respective video frame identifier for another respective video frame based on the respective select input type received from the input device;

memory communicatively connected to the processor;

a display communicatively connected to the processor;

the memory contains computer readable instructions, which when executed by the processor to perform;

processing the header section of the video file structure, the header section includes a respective header segment for a first respective video frame of the plurality of respective video frames;

processing the first respective video frame based on a first respective video frame identifier included in the header section, the first respective video frame includes a first respective video segment and a first respective metadata segment, wherein the first respective metadata segment includes a third respective video frame identifier and at least one logical determinant associated with an action type for logically selecting the third respective video frame identifier of a third respective video frame of the plurality of respective video frames responsive to a select input received by the processor from the input device;

displaying by the display, an image of the first respective video segment for the first respective video frame;

in response to an action type included in the select input received by the processor from the input device corresponding to the first respective metadata segment;

(i) processing the first respective metadata segment of the first respective video frame, (ii) selecting the third respective video frame based on;

(a) the action type included in the select input, (b) the action type associated with at least one logical determinant included in the first respective metadata segment, and (c) the third respective video frame identifier included in the first respective metadata segment, wherein the third respective video frame includes a third respective metadata segment and third respective video segment, and wherein the third respective metadata segment includes another respective video frame identifier and at least one logical determinant associated with an action type for logically selecting another respective video frame identified by the another respective video frame identifier, (iii) receiving the third respective video frame, and (iv) displaying by the display, a third image of the third respective video segment; and

in response to the select input is not received by the processor from the input device;

(i) reading the header section for another respective segment of the header section corresponding to a second respective video frame of the plurality of respective video frames, (ii) calling the second respective video frame, wherein the second respective video frame includes a second respective video segment and a second respective metadata segment, wherein the second respective metadata segment includes a fourth respective video frame identifier and at least one logical determinant associated with an action type for logically selecting the fourth respective video frame identifier of a fourth respective video frame of the plurality of respective video frames responsive to another select input received by the processor from the input device, (iii) receiving and processing the second respective video frame by the processor, and (iv) displaying by the display, a second image of the second respective video segment.

3. A method of processing a video file of a plurality of video frames, comprising:

reading a header of the video file by a processor, the header includes a plurality of respective segments, wherein each respective segment of the plurality of respective segments for each video frame of the plurality of video frames corresponds to one of the video frame, respectively, and references any other of the plurality of video frames that must be processed prior to processing the one of the plurality of video frames corresponding to the respective segment;

demultiplexing the video file by a demultiplexer communicatively connected to the processor to obtain a first video frame of the plurality of video frames;

decoding the first video frame by a decoder communicatively connected to the demultiplexer and the processor, the first video frame includes a first respective video segment and a first respective metadata segment, the first respective metadata segment includes a third video frame identifier and at least one logical determinant associated with an action type for logically selecting the third video frame identifier of a third video frame of the plurality of video frames responsive to a select input received by the processor from an input device;

processing the first video frame by the processor based on a respective segment of the plurality of respective segments included in the header, the first video frame includes the first respective video segment and a first respective metadata segment, wherein the first respective metadata segment includes a third respective video frame identifier and at least one logical determinant associated with an action type for logically selecting the third respective video frame identifier of a third respective video frame of the plurality of respective video frames responsive to a select input received by the processor from the input device;

displaying on a display communicatively connected to the processor, an image of the first video segment in response to processing the first video segment;

in response to an action type included in the select input received by the processor from the input device corresponding to the first respective metadata segment;

(i) processing the first respective metadata segment by the processor (ii) selecting the third respective video frame for decoding based on;

(a) the action type included in the select input, (b) the action type associated with the at least one logical determinant included in the first respective metadata segment, and (c) the third video frame identifier included in the first respective metadata segment, wherein the third video frame includes a third respective metadata segment and a third respective video segment, and wherein the third respective metadata segment includes at least one other video frame identifier and third one or more logical determinants, each of the third one or more logical determinants is associated with an action type for logically selecting another video frame identified by the at least one other video frame identifier, (iii) receiving the third video frame, and (iv) displaying on the display, a third image of the third respective video segment; and

in response to the select input is not received by the processor from the input device;

(i) reading the header of the video file by the processor for subsequent respective segment corresponding to a second video frame of the plurality of video frames, (ii) selecting by the processor, the second video frame for decoding by the decoder, wherein the second video frame includes a second respective video segment and a second respective metadata segment, wherein the second respective metadata segment includes a fourth video frame identifier and second one or more logical determinants, each of the second one or more logical determinants is associated with an action type for logically selecting the fourth video frame identifier of a fourth video frame of the plurality of video frames responsive to another input received by the processor from the input device, (iii) receiving and processing the second video frame by the processor, and (iv) displaying on the display, a second image of the second video segment.

4. The method of claim 3, wherein the step of selecting the third video frame is directed by the respective segment of the header for the third video frame included in the first video frame, further comprising:

processing the first respective video segment for the first video frame, prior to processing the third respective video segment and displaying the third image.

5. A system for displaying a video of successive images from a video file of a succession of video frames, comprising:

a processor for processing the video file, wherein the video file comprises a header and the video frames, each video frame of the video frames includes a respective video segment and a respective metadata segment, wherein the respective metadata segment in each video frame includes at least one respective video frame identifier and one or more logical determinants, each of the one or more logical determinants is associated with a respective action type and the at least one respective video frame identifier for logically selecting the at least one respective video frame identifier of a respective video frame based on a respective action type included in a respective input received from an input device,

wherein the header includes respective header segments, each respective header segment corresponds to one of the video frames, respectively, at least one of the respective header segments of one of the video frames references another one of the video frames;

a demultiplexer for splitting the video file into the video frames;

a decoder communicatively connected to the demultiplexer, for rendering each of the video frames for processing;

the input device for receiving input operative to the respective metadata segment;

a display;

a processor communicatively connected to the decoder, the display and the input device, for processing each of the video frames of the succession as follows;

reading the header of the video file for the respective header segment for a first video frame of the succession, the header includes a respective segment for each video frame, respectively, of the video file, each respective segment references any other video frame that must be processed prior to processing the video frame corresponding to the respective segment;

processing the first video frame based on a first respective segment included in the header, the first video frame includes a first respective video segment and a first respective metadata segment, wherein the first respective metadata segment includes a third respective video frame identifier and at least one logical determinant associated with an action type for logically selecting the third respective video frame identifier of a third video frame of the video frames responsive to a select input received by the processor from the input device;

displaying on the display, a first image of the first respective video segment for the first video frame;

in response to an action type included in the select input received by the processor from the input device corresponding to the first respective metadata segment;

(i) processing the first respective metadata segment of the first video frame, (ii) selecting the third video frame based on (a) the action type included in the select input, (b) the action type associated with the at least one logical determinant included in the first respective metadata segment, and (c) the third respective video frame identifier included in the first respective metadata segment, wherein the third video frame includes a third respective metadata segment and a third respective video segment, and wherein the third respective metadata segment includes another respective video frame identifier and at least one logical determinant associated with an action type for logically selecting another video frame identified by the another respective video frame identifier (iii) receiving and processing the third video frame by the processor, and (iv) displaying by the display, a third image of the third respective video segment; and

in response to the select input is not received by the processor from the input device;

(i) reading the header for another respective segment of the header corresponding to a second video frame of the video frames, (ii) selecting the second video frame for decoding by the decoder, wherein the second video frame includes a second respective video segment and a second respective metadata segment, wherein the second respective metadata segment includes a fourth respective video frame identifier and at least one logical determinant associated with an action type for logically selecting the fourth respective video frame identifier of a fourth video frame responsive to another select input received by the processor from the input device, (iii) receiving and processing the second video frame by the processor, and (iv) displaying by the display, a second image of the second respective video segment.

6. The system of claim 5, further comprising:

a storage containing the video file communicatively connected to the demultiplexer, the video file is streamed from the storage to the demultiplexer.

7. The system of claim 5, further comprising:

memory communicatively connected to the processor;

wherein the memory contains the video file.

8. A method for play of an interactive video of a plurality of video frames, the interactive video includes a header section and the plurality of video frames, each video frame, respectively, of the plurality of video frames includes a respective metadata segment associated with a respective video segment of each frame, respectively, comprising:

reading a header section of the interactive video by a processor, the header section includes a plurality of respective segments, wherein each respective segment of the plurality of respective segments for each video frame of the plurality of video frames corresponds to one of the video frame, respectively, and references any other of the video frames that must be processed prior to processing the one of the video frames corresponding to the respective segment;

demultiplexing the interactive video by a demultiplexer communicatively connected to the processor;

decoding a first video frame of the plurality of video frames by a decoder communicatively connected to the demultiplexer and the processor, the first video frame includes a first respective video segment and a first respective metadata segment, the first respective metadata segment includes a third video frame identifier and at least one logical determinant associated with an action type for logically selecting the third video frame identifier of a third video frame of the plurality of video frames responsive to a select input received by the processor from an input device;

processing by the processor, the first video frame based on a respective segment of the plurality of respective segments included in the header section, the first video frame includes a first respective video segment and a first respective metadata segment, wherein the first respective metadata segment includes a third respective video frame identifier and at least one logical determinant associated with an action type for logically selecting the third respective video frame identifier of a third video frame of the plurality of video frames responsive to a select input received by the processor from the input device;

displaying on a display communicatively connected to the processor, an image of the first video segment in response to processing the first video frame;

in response to an action type included in the select input received by the processor from the input device corresponding to the first respective metadata segment;

(i) processing the first respective metadata segment by the processor (ii) selecting the third video frame for decoding based on;

(a) the action type included in the select input, (b) the action type associated with the at least one logical determinant included in the first respective metadata segment, and (c) the third video frame identifier included in the first metadata segment, wherein the third video frame includes a third respective metadata segment and third respective video segment, and wherein the third respective metadata segment includes at least one other video frame identifier and third one or more logical determinants, each of the third one or more logical determinants is associated with an action type for logically selecting other video frame identified by the at least one other video frame identifier, (iii) receiving and processing the third video frame by the processor, and (iv) displaying on the display, a third image of the third video segment; and

in response to the select input is not received by the processor from the input device;

(i) reading the header section of the interactive video by the processor for subsequent respective segment corresponding to a second video frame of the plurality of video frames, (ii) selecting by the processor, the second video frame for decoding by the decoder, wherein the second video frame includes a second respective video segment and a second respective metadata segment, wherein the second respective metadata segment includes a fourth video frame identifier and second one or more logical determinants, each of the second one or more logical determinants is associated with an action type and a respective second select input for logically selecting the fourth video frame identifier of a fourth video frame responsive to another select input received by the processor from the input device (iii) receiving and processing by the processor, the second video frame, and (iv) displaying on the display, a second image of the second video segment.

9. A system, comprising:

a processor;

a display communicatively connected to the processor;

an input device communicatively connected to the processor;

memory communicatively connected to the processor, containing computer readable instructions, which when executed by the processor to perform;

receiving a video file by the processor, the video file being encoded, the video file comprises a header section and a plurality of video frames, each video frame of the plurality of video frames includes a respective video segment and a respective metadata segment, wherein the respective metadata segment in each video frame includes one or more logical determinants, each of the one or more logical determinants is associated with a respective action type and a respective video frame identifier for logically selecting the respective video frame identifier of a respective video frame based on a respective action type included in a respective input received from the input device;

decoding the video file by a video decoder communicatively connected to the processor;

demultiplexing the video file by a demultiplexer communicatively connected to the processor;

processing by the processor the header section to select a first video frame of the plurality of video frames, and the first video frame includes at least one first respective metadata segment and a first respective video segment, wherein the first respective metadata segment includes a third video frame identifier and at least one logical determinant associated with an action type for logically selecting the third video frame identifier of a third video frame of the plurality of video frames responsive to a select input received by the processor from an input device;

displaying by the processor, a first image of the first respective video segment on the display;

in response to an action type included in the select input received by the processor from the input device corresponding to the first respective metadata segment;

(i) processing the first respective metadata segment by the processor (ii) selecting the third video frame for decoding by the video decoder based on;

(a) the action type included in the select input, (b) the action type associated with the at least one logical determinant included in the first respective metadata segment, and (c) the third video frame identifier included in the first respective metadata segment, wherein the third video frame includes a third respective metadata segment and third respective video segment, and wherein the third respective metadata segment includes at least one other video frame identifier and third one or more logical determinants, each of the third one or more logical determinants is associated with an action type for logically selecting other video frame identified by the at least one other video frame identifier, (iii) receiving and processing the third video frame by the processor, and (iv) displaying on the display, a third image of the third video segment; and

in response to the select input is not received by the processor from the input device;

(i) reading the header section of the video file by the processor for subsequent respective segment corresponding to a second video frame of the plurality of video frames, (ii) selecting by the processor, the second video frame for decoding by the video decoder, wherein the second video frame includes a second respective video segment and a second respective metadata segment, wherein the second respective metadata segment includes a fourth video frame identifier and second one or more logical determinants, each of the second one or more logical determinants is associated with an action type and a respective second select input for logically selecting the fourth video frame identifier of a fourth video frame responsive to another select input received by the processor from the input device (iii) receiving and processing by the processor, the second video frame, and (iv) displaying on the display, a second image of the second video segment.

10. A method of processing a video file, comprising:

receiving a first frame of the video file by a processor, the video file comprises a header and a plurality of frames, each frame of the plurality of frames includes a respective video segment and a respective metadata segment, wherein the respective metadata segment in each frame includes at least one respective frame identifier and one or more logical determinants, each of the one or more logical determinants is associated with a respective action type and the at least one respective frame identifier for logically selecting the at least one respective frame identifier of a respective frame based on a respective action type included in a respective input received from an input device, the first frame is first frame of the plurality of frames, the first frame includes a first respective video segment and a first respective metadata segment, wherein the first respective metadata segment includes one or more logical determinants, each of the one or more logical determinants is associated with a respective action type and a third frame identifier for logically selecting the third frame identifier of a third frame of the video file based on the respective action type included in a respective input received from an input device communicatively connected to the processor;

storing the first frame in memory communicatively connected to the processor;

displaying a first image on a display communicatively connected to the processor, the first image on the display corresponds to the first respective video segment of the first frame of the video file;

in response to an action type included in the select input received by the processor from the input device corresponding to the first respective metadata segment;

(i) processing the first respective metadata segment by the processor (ii) selecting the third frame for decoding by a video decoder based on;

(a) the action type included in the select input, (b) the action type associated with the at least one logical determinant included in the first respective metadata segment, and (c) the third frame identifier included in the first respective metadata segment, wherein the third frame includes a third respective metadata segment and third respective video segment, and wherein the third respective metadata segment includes at least one other frame identifier and third one or more logical determinants, each of the third one or more logical determinants is associated with an action type for logically selecting other frame of the plurality of frames identified by the at least one other frame identifier, (iii) receiving and processing the third frame by the processor, and (iv) displaying on the display, a third image of the third video segment; and

in response to the select input is not received by the processor from the input device;

(i) reading the header of the video file by the processor for subsequent respective segment corresponding to a second frame of the plurality of frames, (ii) selecting by the processor, the second frame for decoding by the video decoder, wherein the second frame includes a second respective video segment and a second respective metadata segment, wherein the second respective metadata segment includes a fourth frame identifier and second one or more logical determinants, each of the second one or more logical determinants is associated with an action type and a respective second select input for logically selecting the fourth frame identifier of a fourth frame of the plurality of frames responsive to another select input received by the processor from the input device (iii) receiving and processing by the processor, the second frame, and (iv) displaying on the display, a second image of the second video segment.