Systems and methods for resizing content based on a relative importance of the content

• US 10,694,137 B2
• Filed: 07/01/2016
• Issued: 06/23/2020
• Est. Priority Date: 05/10/2016
• Status: Active Grant

• Current Assignee: Rovi Guides, Inc. (Adeia Inc.)
• Original Assignee: Rovi Guides, Inc. (Adeia Inc.)
• Inventors: Panchaksharaiah, Vishwas Sharadanagar, Gupta, Vikram Makam
• Primary Examiner(s): Harold, Jefferey F
• Assistant Examiner(s): Sanders, Justin B
• Application Number:
  US15/200,216
• Publication Number:
  US 20170332036A1
• Time in Patent Office: 1,453 Days
• Field of Search: 348565
• CPC Class Codes: H04N 21/2187 Live feed
• CPC Class Codes: H04N 21/41265 having a remote control device for bidirectional communication between the remote control device and client device unidirectional remote control device H04N21/42204
• CPC Class Codes: H04N 21/4312 involving specific graphical features, e.g. screen layout, special fonts or colors, blinking icons, highlights or animations
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/4532 involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 5/45 Picture in picture , e.g. displaying simultaneously another television channel in a region of the screen

Abstract

Systems and methods are described herein for providing a media guidance application that resizes content based on a relative importance of the content. For example, a display may have first and second content generated for display. If the first content is more important to a user than the second content, a size of the first content will be increased with respect to a size of the second content on the display. If the second content is more important to the user than the first content, then a size of the second content will be increased with respect to a size of the first content on the display.

Claims

1. A method for resizing content on a display device based on a relative importance of the content, the method comprising:

generating for simultaneous display on a first display device, at a first time, live audio-visual media at a first size and catch-up audio-visual media playing in a window of a second size smaller than the first size, wherein the catch-up audio-visual media corresponds to a previously broadcast segment of the live audio-visual media;

simultaneously monitoring a relative importance of concurrently-presented events from the live audio-visual media and from the catch-up audio-visual media as each of the live audio-visual media and the catch-up audio-visual media play back;

retrieving a profile associated with the user, wherein the profile indicates attributes of events that are important to the user;

determining, based on the profile, during the monitoring, that an importance of a first event occurring at a second time later than the first time of the concurrently-presented events from the live audio-visual media is smaller in importance than an importance of a second event of the concurrently-presented events from the catch-up audio-visual media; and

resizing, at the second time, the window of the catch-up audio-visual media to a third size larger than the second size of the window at the first time based on a comparison, performed during the monitoring, of the importance of the first event with respect to the importance of the second event.

2. The method of claim 1, wherein resizing the window comprises:

increasing a size of the window in response to determining that the importance of the second event is greater than the importance of the first event.

3. The method of claim 2, further comprising:

toggling an audio output to audio of the live audio-visual media in response to determining that the importance of the first event is greater than the importance of the second event; and

toggling the audio output to audio of the catch-up audio-visual media in response to determining that the importance of the second event is greater than the importance of the first event.

4. The method of claim 1, wherein resizing the window comprises:

identifying, based on the profile, a second display device accessible to the user;

comparing a first size of the first display device to a second size of the second display device to determine whether the first display device is larger than the second display device;

in response to determining that the first display device is larger than the second display device;

generating for display the window of the catch-up audio-visual media on the first display device when the importance of the second event is greater than the importance of the first event; and

generating for display the live audio-visual media on the first display device when the importance of the first event is greater than the importance of the second event.

5. The method of claim 1, further comprising:

computing a difference between the importance of the first event and the importance of the second event; and

resizing the window of the catch-up audio-visual media such that a difference in a size of the live audio-visual media with respect to the size of the window of the catch-up audio-visual media on the first display device is proportional to the difference between the importance of the first event and the importance of the second event.

6. The method of claim 1, wherein computing the comparison of the importance of the first event with respect to the importance of the second event comprises:

determining a first event type of the first event and second event type of the second event;

retrieving, from a database, a set of popular event types;

comparing the first event type and the second event type to each event type of the set of popular event types to determine whether either of the first event type and the second event type match a popular event type from the set;

determining that the importance of the first event is greater than the importance of the second event when the first event type matches a popular event type from the set; and

determining that the importance of the second event is greater than the importance of the when the second event type matches a popular event type from the set.

7. The method of claim 1, wherein computing the comparison of the importance of the first event with respect to the importance of the second event comprises:

identifying an object of a plurality of objects having importance to the user based on the profile;

performing object recognition on a first frame corresponding to the first event and a second frame corresponding to the second event to determine whether the object appears in one of the first and the second frame;

determining that the importance of the first event is greater than the importance of the second event in response to determining that the object appears in the first frame; and

determining that the importance of the second event is greater than the importance of the first event in response to determining that the object appears in the second frame.

8. The method of claim 7, wherein determining that the importance of the first event is greater than the importance of the second event when the object appears in the first frame further comprises:

enumerating a first number of objects in the first frame matching the plurality of objects having importance to the user;

enumerating a second number of objects in the second frame matching the plurality of objects having importance to the user; and

determining that the importance of the first event is greater than the importance of the second event in response to determining that first frame has a highest respective amount of objects matching the plurality object having importance to the user.

9. The method of claim 7, wherein the object appears in the first frame, and wherein the catch-up audio-visual media overlays the live audio-visual media on the first display device, further comprising:

identifying a location of the object within the first frame;

determining, based on the location, whether the catch-up audio-visual media overlays the location of the object within the first frame; and

in response to determining that the window of the catch-up audio-visual media overlays the location of the object within the first frame, resizing the window of the catch-up audio-visual media to exclude overlaying the location of the object.

19. The method of claim 1, further comprising detecting the concurrently-presented events from the live audio-visual media and from the catch-up audio-visual media, based on sensor information retrieved from a plurality of sensors that are located in a setting depicted in the live audio-visual media.

10. A system comprising control circuitry configured to resize content on a display device based on a relative importance of the content, wherein the control circuitry is configured to:

generate for simultaneous display on a first display device, at a first time, live audio-visual media at a first size and catch-up audio-visual media playing in a window of a second size smaller than the first size, wherein the catch-up audio-visual media corresponds to a previously broadcast segment of the live audio-visual media;

simultaneously monitor a relative importance of concurrently-presented events from the live audio-visual media and from the catch-up audio-visual media as each of the live audio-visual media and the catch-up audio-visual media play back;

retrieve a profile associated with the user, wherein the profile indicates attributes of events that are important to the user;

determine, based on the profile, during the monitoring, that an importance of a first event occurring at a second time later than the first time of the concurrently-presented events from the live audio-visual media is smaller in importance than an importance of a second event of the concurrently-presented events from the catch-up audio-visual media; and

resize, at the second time, the window of the catch-up audio-visual media to a third size larger than the second size of the window at the first time based on a comparison, performed during the monitoring, of the importance of the first event with respect to the importance of the second event.

11. The system of claim 10, wherein the control circuitry is further configured, when resizing the window based on a comparison of the importance of the second event, to:

increase a size of the window in response to determining that the importance of the second event is greater than the importance of the first event.

12. The system of claim 11, wherein the control circuitry is further configured to:

toggle an audio output to audio of the live audio-visual media in response to determining that the importance of the first event is greater than the importance of the second event; and

toggle the audio output to audio of the catch-up audio-visual media in response to determining that the importance of the second event is greater than the importance of the first event.

13. The system of claim 12, wherein the control circuitry is further configured, when resizing window, to:

identify, based on the profile, a second display device accessible to the user;

compare a first size of the first display device to a second size of the second display device to determine whether the first display device is larger than the second display device;

in response to determining that the first display device is larger than the second display device;

generate for display the window of the catch-up audio-visual media on the first display device when the importance of the second event is greater than the importance of the first event; and

generate for display the live audio-visual media on the first display device when the importance of the first event is greater than the importance of the second event.

14. The system of claim 13, wherein the control circuitry is further configured to:

compute a difference between the importance of the first event and the importance of the second event; and

resize the window of the catch-up audio-visual media such that a difference in a size of the live audio-visual media with respect to the size of the window of the catch-up audio-visual media on the first display device is proportional to the difference between the importance of the first event and the importance of the second event.

15. The system of claim 10, wherein the control circuitry is further configured, when computing the comparison of the importance of the first event with respect to the importance of the second event, to:

determine a first event type of the first event and second event type of the second event;

retrieve, from a database, a set of popular event types;

compare the first event type and the second event type to each event type of the set of popular event types to determine whether either of the first event type and the second event type match a popular event type from the set;

determine that the importance of the first event is greater than the importance of the second event when the first event type matches a popular event type from the set; and

determine that the importance of the second event is greater than the importance of the when the second event type matches a popular event type from the set.

16. The system of claim 10, wherein the control circuitry is further configured, when computing the comparison of the importance of the first event with respect to the importance of the second event comprises, to:

identify an object of a plurality of objects having importance to the user based on the profile;

perform object recognition on a first frame corresponding to the first event and a second frame corresponding to the second event to determine whether the object appears in one of the first and the second frame;

determine that the importance of the first event is greater than the importance of the second event in response to determining that the object appears in the first frame; and

determine that the importance of the second event is greater than the importance of the first event in response to determining that the object appears in the second frame.

17. The system of claim 16, wherein the control circuitry is further configured, when determining that the importance of the first event is greater than the importance of the second event when the object appears in the first frame, to:

enumerate a first number of objects in the first frame matching the plurality of objects having importance to the user;

enumerate a second number of objects in the second frame matching the plurality of objects having importance to the user; and

determine that the importance of the first event is greater than the importance of the second event in response to determining that first frame has a highest respective amount of objects matching the plurality object having importance to the user.

18. The system of claim 16, wherein the object appears in the first frame, and wherein the catch-up audio-visual media overlays the live audio-visual media on the first display device, to:

identify a location of the object within the first frame;

determine, based on the location, whether the catch-up audio-visual media overlays the location of the object within the first frame; and

in response to determining that window of the catch-up audio-visual media overlays the location of the object within the first frame, resize the window of the catch-up audio-visual media to exclude overlaying the location of the object.

20. The system of claim 10, wherein the control circuitry is further configured to detect the concurrently-presented events from the live audio-visual media and from the catch-up audio-visual media, based on sensor information retrieved from a plurality of sensors that are located in a setting depicted in the live audio-visual media.