Multiple-mode system and method for providing user selectable video content

• US 10,275,128 B2
• Filed: 03/17/2014
• Issued: 04/30/2019
• Est. Priority Date: 03/15/2013
• Status: Active Grant

• Current Assignee: ActiveVideo Networks, Inc. (CommScope Holding Company, Inc.)
• Original Assignee: ActiveVideo Networks, Inc. (CommScope Holding Company, Inc.)
• Inventors: Brockmann, Ronald Alexander, Dev, Anuj, Hiddink, Gerrit
• Primary Examiner(s): Hailu, Tadesse
• Assistant Examiner(s): Hope, Darrin
• Application Number:
  US14/217,108
• Publication Number:
  US 20140289627A1
• Time in Patent Office: 1,870 Days
• Field of Search: 715719
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04N 21/23412 for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects
• CPC Class Codes: H04N 21/2343 involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements video transcoding H04N19/40; media packet handling at the source H04L65/762
• CPC Class Codes: H04N 21/234309 by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4 or from Quicktime to Realvideo conversion of standards in analog television systems H04N7/01
• CPC Class Codes: H04N 21/234363 by altering the spatial resolution, e.g. for clients with a lower screen resolution
• CPC Class Codes: H04N 21/236 Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream multiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00
• CPC Class Codes: H04N 21/23614 Multiplexing of additional data and video streams arrangements for simultaneous broadcast of plural pieces of information H04H20/28
• CPC Class Codes: H04N 21/258 Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data arrangements for services using the result on the distributing side of broadcast systems H04H60/66; profiles in network data switching protocols H04L67/30
• CPC Class Codes: H04N 21/25825 involving client display capabilities, e.g. screen resolution of a mobile phone optimising the visualisation of content during browsing in the Internet G06F16/9577; processing of terminal status or physical abilities in wireless networks H04W8/22; authentication in wireless network security H04W12/06
• CPC Class Codes: H04N 21/25833 involving client hardware characteristics, e.g. manufacturer, processing or storage capabilities allocation of resources considering hardware capabilities in multiprogramming arrangements G06F9/5044; allocation of resources considering software capabilities in multiprogramming arrangements G06F9/5055
• CPC Class Codes: H04N 21/25858 involving client software characteristics, e.g. OS identifier

Abstract

The method of providing audiovisual content to a client device configured to be coupled to a display. The method detects a selection of a graphical element corresponding to a video content item. In response to detecting the selection of the graphical element, a transmission mode is determined. The transmission mode is a function of: (i) one or more decoding capabilities of the client device; (ii) a video encoding format of the video content item; (ii) whether the video content item should be displayed in a full screen or a partial screen format; and (iv) whether the client device is capable of overlaying image data into a video stream. Next, audiovisual data that includes the video content item is prepared for transmission according to the determined transmission mode. Finally, the prepared audiovisual data is transmitted from the server toward the client device, according to the determined transmission mode, for display on the display.

Claims

1. A method of providing audiovisual content to a client device configured to be coupled to a display, the method comprising, at a server:

detecting a selection of a graphical element corresponding to a video content item;

in response to detecting the selection of the graphical element, determining a transmission mode as a function of;

1) one or more decoding capabilities of the client device;

2) a video encoding format of the video content item;

3) whether the video content item is to be displayed in a full screen or a partial screen format; and

4) whether the client device is capable of overlaying image data into a video stream;

preparing, for transmission according to the determined transmission mode, a series of frames that includes audiovisual data including the video content item; and

transmitting the prepared series of frames, from the server toward the client device, according to the determined transmission mode, for display on the display;

wherein, in accordance with a determination that the video content item is to be displayed in a partial screen format, the transmission mode is a first transmission mode in which the series of frames includes the video content item and a first GUI, and the preparing includes, prior to transmitting the prepared series of frames;

rendering the first GUI according to a previously set screen resolution; and

stitching the video content item into the rendered first GUI, wherein the series of frames includes the video content item as stitched into the rendered first GUI, and wherein a respective frame of the series of frames combines content for the video content item and the rendered first GUI.

2. The method of claim 1, wherein, in accordance with a determination that:

the video content item is to be displayed in a full screen format, and

the client device is not capable of decoding the video encoding format of the video content item;

the transmission mode is a second transmission mode in which the preparing includes transcoding the video content item.

3. The method of claim 2, wherein, in accordance with a determination that:

the video content item is to be displayed in a full screen format,

the client device is capable of decoding the video encoding format of the video content item, and

no image data is to be overlaid on the video content item;

the transmission mode is a third transmission mode in which, the preparing includes repackaging the video content item.

4. The method of claim 3, wherein, in accordance with a determination that:

the video content item is to be displayed in a full screen format,

the client device is capable of decoding the video encoding format of the video content item, and

the client device is capable of overlaying image data into the video content item;

the transmission mode is a fourth transmission mode in which;

the overlaying image data includes a second GUI that includes various user interface elements, and

the preparing includes rendering the second GUI according to a client overlay resolution.

5. The method of claim 4, wherein, in accordance with a determination that:

the video content item is to be displayed in a full screen format,

the client device is capable of decoding the video encoding format of the video content item, and

the client device is not capable of overlaying image data into the video content item, the transmission mode is a fifth transmission mode in which the preparing includes;

rendering the second GUI according to a video resolution, video size, and video frame rate;

decoding all or a portion of the video content item;

blending the rendered second GUI into the decoded portion; and

re-encoding the blended portion according to the video encoding format of the video content item.

6. The method of claim 1, wherein, in accordance with a determination that the client device is capable of receiving streaming content in a native format, the transmitting step comprises passing through content that is in the native format.

7. A computer program product for providing audiovisual content to a client device configured to be coupled to a display, the computer program product comprising a computer useable medium on which is stored non-transitory computer program code comprising program code for:

detecting a selection of a graphical element corresponding to a video content item;

in response to detecting the selection of the graphical element, determining a transmission mode as a function of;

1) one or more decoding capabilities of the client device;

2) a video encoding format of the video content item;

3) whether the video content item should is to be displayed in a full screen or a partial screen format; and

4) whether the client device is capable of overlaying image data into a video stream;

preparing, for transmission according to the determined transmission mode, a series of frames that includes audiovisual data including the video content item; and

transmitting the prepared series of frames, from the server toward the client device, according to the determined transmission mode, for display on the display;

wherein, in accordance with a determination that the video content item is to be displayed in a partial screen format, the transmission mode is a first transmission mode in which the series of frames includes the video content item and a first GUI, and the preparing includes, prior to transmitting the prepared series of frames;

rendering the first GUI according to a previously set screen resolution; and

stitching the video content item into the rendered first GUI, wherein the series of frames includes the video content item as stitched into the rendered first GUI, and wherein a respective frame of the series of frames combines content for the video content item and the rendered first GUI.

8. The computer program product of claim 7, wherein the program code for preparing further includes program code for, in accordance with a determination that

the video content item is to be displayed in a full screen format, and

the client device is not capable of decoding the video encoding format of the video content item:

transcoding the video content item according to a second transmission mode.

9. The computer program product of claim 8, wherein the program code for preparing further includes program code for, in accordance with a determination that:

the video content item is to be displayed in a full screen format,

the client device is capable of decoding the video encoding format of the video content item, and

no image data should be overlaid on the video content item;

repackaging the video content item according to a third transmission mode.

10. The computer program product of claim 9, wherein the overlaying image data includes a second GUI, the second GUI includes video playback controls, and the program code for preparing includes program code for, in accordance with a determination that:

the video content item is to be displayed in a full screen format,

the client device is capable of decoding the video encoding format of the video content item, and

the client device is capable of overlaying image data into the video content item;

rendering the second GUI according to a client overlay resolution according to a fourth transmission mode.

11. The computer program product of claim 10, wherein the program code for preparing further includes program code for, in accordance with a determination that:

the video content item is to be displayed in a full screen format,

the client device is capable of decoding the video encoding format of the video content item, and

the client device is not capable of overlaying image data into the video content item;

according to a fifth transmission mode;

rendering the second GUI according to a video resolution, video size, and video frame rate;

decoding a portion of the video content item;

blending the rendered second GUI into the decoded portion;

re-encoding the blended portion according to the video encoding format of the video content item.

12. The computer program product of claim 7, wherein, in accordance with a determination that the client device is capable of receiving streaming content in a native format, the transmitting step comprises passing through content that is in the native format.

13. A computer system for providing audiovisual content to a client device configured to be coupled to a display, the computer system comprising:

an application engine for providing a graphical user interface (GUI);

control logic for;

in response to detecting a selection of a graphical element corresponding to a video content item, determining a transmission mode as a function of;

1) one or more decoding capabilities of the client device;

2) a video encoding format of the video content item;

3) whether the video content item is to be displayed in a full screen or a partial screen format; and

4) whether the client device is capable of overlaying image data into a video stream; and

preparing, for transmission according to the determined transmission mode, a series of frames that includes audiovisual data including the video content item;

and

a transmitter for transmitting the prepared series of frames, from the computer system toward the client device, according to the determined transmission mode, for display on the display;

wherein, in accordance with a determination that the video content item is to be displayed in a partial screen format, the transmission mode is a first transmission mode in which the series of frames includes the video content item and a first GUI, and the preparing includes, prior to transmitting the prepared series of frames;

rendering the first GUI according to a previously set screen resolution; and

stitching the video content item into the rendered first GUI, wherein the series of frames includes the video content item as stitched into the rendered first GUI, and wherein a respective frame of the series of frames combines content for the video content item and the rendered first GUI.

14. The computer system of claim 13, further comprising a transcoder configured to, according to a second transmission mode, transcode the video content item, in accordance with a determination that the video content item is to be displayed in a full screen format and the client device is not capable of the video encoding format of the video content item.

15. The computer system of claim 14, further comprising a packager configured to, according to a third transmission mode, repackage the video content item, in accordance with a determination that the video content item is to be displayed in a full screen format, the client device is capable of decoding the video encoding format of the video content item, and no image data is to be overlaid on the video content item.

16. The computer system of claim 15, wherein the overlaying image data includes a second GUI, the second GUI includes interface elements, and wherein the application engine is configured to, according to a fourth transmission mode, render the second GUI according to a client overlay resolution, in accordance with a determination that the selected video is to be displayed in a full screen format, the client device is capable of decoding the video encoding format of the video content item, and the client device is capable of overlaying image data into the video content item.

17. The computer system of claim 16, wherein, in accordance with a determination that the video content item is to be displayed in a full screen format, the client device is capable of decoding the video encoding format of the video content item, and the client device is not capable of overlaying image data into the video content item, the transmission mode is a fifth transmission mode in which:

the application engine is configured to render the second GUI according to a video resolution, video size, and video frame rate;

the transcoder is configured to decode a portion of the video content item;

a blender is configured to blend the rendered second GUI into the decoded portion;

and

the transcoder is further configured to re-encode the blended portion according to the video encoding format.

18. The computer system of claim 13, wherein, in accordance with a determination that the client device is capable of receiving streaming content in a native format, the transmitting comprises passing through content that is in the native format.

19. The computer system of claim 13, wherein operation of a transcoder, a blender, a stitcher, and a packager is optional according to the determined transmission mode.