INTELLIGENT TV MOSAIC FOR IP TV

• US 20100115554A1
• Filed: 12/10/2008
• Published: 05/06/2010
• Est. Priority Date: 10/31/2008
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Collet, Jean-luc, Fresko, Corinne S., Lanne, Fabien Patrick, Drouet, Francois-Xavier
• Granted Patent: US 8,875,183 B2
• Time in Patent Office: Days
• US Class Current: 725/41
• CPC Class Codes: H04N 21/4314 for fitting data in a restricted space on the screen, e.g. EPG data in a rectangular grid
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/44222 Analytics of user selections, e.g. selection of programs or purchase activity monitoring of user selections in data processing systems G06F11/34; arrangements for monitoring the user's behaviour or opinions in broadcast systems H04H60/33
• CPC Class Codes: H04N 21/4532 involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/47 End-user applications
• CPC Class Codes: H04N 21/6125 involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/6175 involving transmission via Internet broadcast-related systems characterised by the transmission system being the Internet H04H60/82

Abstract

A method of building an interactive display related to TV programs in an internet protocol television (IPTV) environment includes parsing a plurality of TV programs provided in an IPTV environment for display to a user. The step of parsing includes capturing an image in each TV program, identifying video content in each captured image, interpreting the video content, capturing audio data, identifying an audio content in each captured audio data, and interpreting the audio content for each captured audio data. The method further includes the steps of identifying a selected TV program by the user; determining a correlation level between the interpreted video and audio content of the selected TV program and the interpreted video and audio content of each of the other TV programs; determining TV programs other than the selected TV program; and building and presenting a mosaic display on a TV display including the selected TV program.

Claims

1. A method of building an interactive display related to TV programs in an internet protocol television (IPTV) environment, comprising:

parsing a plurality of TV programs provided in an IPTV environment for display to a user, wherein the step of parsing includes;

capturing an image in each TV program;

identifying video content in each captured image wherein the video content comprises at least one object;

interpreting the video content for each captured image;

capturing audio data for each of the TV programs;

identifying an audio content in each captured audio data wherein the audio content comprises text and/or sound; and

interpreting the audio content for each captured audio data;

identifying a selected TV program by the user;

determining a correlation level using predefined rules between the interpreted video and audio content of the selected TV program and the interpreted video and audio content of each of the other TV programs;

determining TV programs other than the selected TV program using the correlation level of the TV programs; and

building and presenting a mosaic display on a TV display with the selected TV program and the plurality of other TV programs.

2. The method of claim 1, wherein the steps are repeated and/or the method further includes a first step of;

requesting the subsequent steps by a user.

3. The method of claim 1, wherein the display is a mosaic having a plurality of interactive areas.

4. The method of claim 3, further including:

selecting the interactive areas using a head end device which provides a plurality of TV programs in an IPTV environment.

5. A system for building an interactive display related to TV programs in an internet protocol television (IPTV) environment, comprising:

a computer having a computer program stored on a computer readable medium for parsing a plurality of TV programs provided in an IPTV environment for display to a user;

a metadata aggregator for capturing an image in each TV program, the meta data aggregator;

identifies video content in each captured image wherein the video content comprises at least one object, interprets the video content for each captured image;

capturing audio data for each of the TV programs, identifies an audio content in each captured audio data wherein the audio content comprises text and/or sound, and interprets the audio content for each captured audio data;

the computer program further identifies a selected TV program by the user, and determines a correlation level using predefined rules between the interpreted video and audio content of the selected TV program and the interpreted video and audio content of each of the other TV programs;

determining TV programs other than the selected TV program using the correlation level of the TV programs;

a mosaic builder electrically communicates with a TV of the user and the metadata aggregator; and

a TV display of the user'"'"'s TV presenting a mosaic display using the mosaic builder, the mosaic display including the selected TV program and the plurality of other TV programs.

6. The system of claim 5, wherein the display is a mosaic having a plurality of interactive areas.

7. The system of claim 6, farther including:

a head end device providing selection of the interactive areas which provides a plurality of TV programs in an IPTV environment.

8. The system of claim 5, wherein metadata is gathered from a TV channel provider using an electronic program guide.

9. The system of claim 5, further including:

a thumbnail generator for decoding several IPTV video streams simultaneously.

10. The system of claim 5, wherein metadata for non live TV channels is generated from video demand catalogs and/or other video server providers and used by the metadata aggregator.

11. A computer program product comprising a computer readable medium having recorded thereon a computer program for enabling a processor in a computer system to build an interactive display related to TV programs in an internet protocol television environment, the computer program performing the steps of:

parsing a plurality of TV programs provided in an IPTV environment for display to a user, wherein the step of parsing includes;

capturing an image in each TV program;

identifying video content in each captured image wherein the video content comprises at least one object;

interpreting the video content for each captured image;

capturing audio data for each of the TV programs;

identifying an audio content in each captured audio data wherein the audio content comprises text and/or sound; and

interpreting the audio content for each captured audio data;

identifying a selected TV program by the user;

determining a correlation level using predefined rules between the interpreted video and audio content of the selected TV program and the interpreted video and audio content of each of the other TV programs;

determining TV programs other than the selected TV program using the correlation level of the TV programs; and

building and presenting a mosaic display on a TV display with the selected TV program and the plurality of other TV programs.

12. The computer program product of claim 11, wherein the steps are repeated and/or the program farther includes a first step of:

requesting the subsequent steps by a user.

13. The computer program product of claim 11, wherein the display is a mosaic having a plurality of interactive areas.

14. The computer program product of claim 11, further including the step of:

selecting the interactive areas using a head end device which provides a plurality of TV programs in an IPTV environment.