System and method for delivering media based on viewer behavior

• US 10,531,144 B2
• Filed: 11/30/2018
• Issued: 01/07/2020
• Est. Priority Date: 11/08/2012
• Status: Active Grant

• Current Assignee: Time Warner Cable Enterprises LLC (Charter Communications Incorporated)
• Original Assignee: Time Warner Cable Enterprises LLC (Charter Communications Incorporated)
• Inventors: Yu, Jian, Chen, David, Patel, Vipul, Gould, Kenneth
• Primary Examiner(s): Flynn, Nathan J
• Assistant Examiner(s): Trinh, Tung T
• Application Number:
  US16/206,774
• Publication Number:
  US 20190098353A1
• Time in Patent Office: 403 Days
• CPC Class Codes: H04N 21/2402 Monitoring of the downstream path of the transmission network, e.g. bandwidth available traffic monitoring in data switching networks H04L43/00; monitoring data switching networks utilization H04L43/0876
• CPC Class Codes: H04N 21/2668 Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/44224 Monitoring of user activity on external systems, e.g. Internet browsing

Abstract

Methods, systems and devices are provided for communicating multimedia content over a service provider network. A network server may receive an audio-video stream from a content provider server, relaying the audio-video stream to a receiver device via the service provider network, receive an operating mode notification identifying a user behavior from the receiver device, and ceasing the relaying of the audio-video stream to the receiver device based on the user behavior. The network server may also alter the audio-video stream based on the received operating mode notification and send the altered audio-video stream to the receiver device via the service provider network.

Claims

1. A method of reducing network resource consumption based on user behaviors, comprising:

receiving, via a processor in a receiver device, an audio-video stream from a network server;

presenting audio and video content to a user via an electronic display and speakers coupled to the receiver device;

monitoring user activities to determine whether there is a change in user behavior;

determining an operating mode based on the user behavior in response to determining that there is the change in the user behavior;

generating and sending a notification message that identifies the determined operating mode to the network server; and

receiving an altered stream from the network server in response to generating and sending the notification message that identifies the determined operating mode to the network server, wherein the altered stream comprises only a closed caption data stream that is generated based on the presented audio and video content.

2. The method of claim 1, further comprising presenting content on the electronic display based on the determined operating mode and content included in the received altered stream.

3. The method of claim 1, wherein monitoring the user activities to determine whether there is the change in the user behavior comprises activating an eye tracking component to determine whether eye movements of the user are consistent with active viewing of the presented audio and video content.

4. The method of claim 1, wherein monitoring the user activities to determine whether there is the change in the user behavior comprises determining whether a user interface has scrolled off of a media player portion of a browser.

5. The method of claim 1, wherein monitoring the user activities to determine whether there is the change in the user behavior comprises periodically activating a camera to determine whether both eyes of the user are visibly open.

6. The method of claim 1, wherein monitoring the user activities to determine whether there is the change in the user behavior comprises activating a motion sensor to determine whether the user is in close proximity to the receiver device.

7. The method of claim 1, wherein monitoring the user activities to determine whether there is the change in the user behavior comprises activating an orientation sensor to determine whether the receiver device is face down.

8. The method of claim 1, wherein determining the operating mode based on the user behavior in response to determining that there is the change in the user behavior comprises determining the operating mode based on an availability of resources in response to determining that there is the change in the user behavior.

9. The method of claim 1, further comprising modifying the usage of resources on the receiver device in response to sending the notification message that identifies the determined operating mode to the network server.

10. A receiver device, comprising:

an electronic display;

a speaker;

a processor coupled to the electronic display and the speaker, wherein the processor is configured with processor-executable software instructions to;

receive an audio-video stream from a network server;

present audio and video content to a user via the electronic display and the speaker;

monitor user activities to determine whether there is a change in user behavior;

determine an operating mode based on the user behavior in response to determining that there is the change in the user behavior;

generate and send a notification message that identifies the determined operating mode to the network server; and

receive an altered stream from the network server in response to generating and sending the notification message that identifies the determined operating mode to the network server, wherein the altered stream comprises only a closed caption data stream that is generated based on the presented audio and video content.

11. The receiver device of claim 10, wherein the processor is further configured with processor-executable software instructions to present content on the electronic display based on the determined operating mode and content included in the received altered stream.

12. The receiver device of claim 10, further comprising an eye tracking component, wherein the processor is configured with processor-executable software instructions to monitor the user activities to determine whether there is the change in the user behavior by activating the eye tracking component to determine whether eye movements of the user are consistent with active viewing of the presented audio and video content.

13. The receiver device of claim 10, further comprising a user interface, wherein the processor is configured with processor-executable software instructions to monitor the user activities to determine whether there is the change in the user behavior by determining whether the user interface has scrolled off of a media player portion of a browser.

14. The receiver device of claim 10, further comprising a camera, wherein the processor is configured with processor-executable software instructions to monitor the user activities to determine whether there is the change in the user behavior by periodically activating the camera to determine whether both eyes of the user are visibly open.

15. The receiver device of claim 10, further comprising a motion sensor, wherein the processor is configured with processor-executable software instructions to monitor the user activities to determine whether there is the change in the user behavior by activating the motion sensor to determine whether the user is in close proximity to the receiver device.

16. The receiver device of claim 10, further comprising an orientation sensor, wherein the processor is configured with processor-executable software instructions to monitor the user activities to determine whether there is the change in the user behavior by activating the orientation sensor to determine whether the receiver device is face down.

17. The receiver device of claim 10, wherein the processor is configured with processor-executable software instructions to determine the operating mode based on the user behavior in response to determining that there is the change in the user behavior by determining the operating mode based on an availability of resources in response to determining that there is the change in the user behavior.

18. The receiver device of claim 10, wherein the processor is further configured with processor-executable software instructions to modify the usage of resources on the receiver device in response to sending the notification message that identifies the determined operating mode to the network server.

19. A non-transitory computer readable storage medium having stored thereon processor-executable software instructions configured to cause a processor in a receiver device to perform operations for reducing network resource consumption based on user behaviors, the operations comprising:

receiving an audio-video stream from a network server;

presenting audio and video content to a user via an electronic display and speakers coupled to the receiver device;

monitoring user activities to determine whether there is a change in the user behavior;

determining an operating mode based on the user behavior in response to determining that there is the change in the user behavior;

generating and sending a notification message that identifies the determined operating mode to the network server; and

receiving an altered stream from the network server in response to generating and sending the notification message that identifies the determined operating mode to the network server, wherein the altered stream comprises only a closed caption data stream that is generated based on the presented audio and video content.