Automated in-home observation of user interactions with video devices

• US 20040237096A1
• Filed: 05/20/2003
• Published: 11/25/2004
• Est. Priority Date: 05/20/2003
• Status: Abandoned Application

• Current Assignee: Comcast Cable Communications LLC (Comcast Corporation)
• Original Assignee: Comcast Cable Holdings LLC (Comcast Corporation)
• Inventors: Cain, Michael E., Marics, Monica Ann
• Application Number:
  US10/441,402
• Publication Number:
  US 20040237096A1
• Time in Patent Office: Days
• US Class Current: 725/13
• CPC Class Codes: H04H 60/41 for identifying broadcast space, i.e. broadcast channels, broadcast stations or broadcast areas
• CPC Class Codes: H04H 60/59 of video recognising characters or patterns in general G06F18/00, G06V20/00
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/42653 for processing graphics
• CPC Class Codes: H04N 21/4334 Recording operations recording of a television signal H04N5/76; arrangements for recording or accumulating broadcast information or broadcast-related information H04H60/27
• CPC Class Codes: H04N 21/44222 Analytics of user selections, e.g. selection of programs or purchase activity monitoring of user selections in data processing systems G06F11/34; arrangements for monitoring the user's behaviour or opinions in broadcast systems H04H60/33
• CPC Class Codes: H04N 21/8153 comprising still images, e.g. texture, background image
• CPC Class Codes: H04N 5/4448 for frame-grabbing
• CPC Class Codes: H04N 7/163 by receiver means only

Abstract

A computer-based method of monitoring and recording user interaction with a video service device is provided. The video service device is connected to a display. The computer is programmed to monitor and selectively record information received from the video service device, a video camera, and a remote control signal detector. The computer-based method includes, over a period of time, detecting a plurality of remote control signals indicative of button clicks, grabbing first video frames from the video service device, and grabbing second video frames from the video camera. The detected remote control signals, the first video frames, and the second video frames are recorded to the storage medium as a sequence of events while preserving the time relationship among the various events with respect to each other thereby establishing a common time base for the recorded sequence of events.

Claims

1. A computer-based method of monitoring and recording user interaction with a video service device, the video service device being connected to a display, the computer including a first video frame grabber, and a second video frame grabber, wherein the video service device is connected to the first video frame grabber, a video camera is connected to the second video frame grabber, and a remote control signal detector is connected to the computer, the computer being programmed to monitor and selectively record information received from the video service device, the video camera, and the remote control signal detector, the computer-based method comprising:

over a period of time, detecting a plurality of remote control signals with the remote control signal detector, each remote control signal being indicative of a remote control button click by the user;

over the period of time, grabbing a plurality of first video frames with the first video frame grabber from the video service device;

over a period of time, grabbing a plurality of second video frames with the second video frame grabber from the video camera; and

recording the detected remote control signals, the first video frames, and the second video frames to a storage device as a sequence of events over the period of time while preserving the time relationship among the various events with respect to each other thereby establishing a common time base for the recorded sequence of events.

2. The method of claim 1 further comprising:

in response to detecting a remote control signal with the remote control signal detector indicative of a remote control button click by the user, grabbing a sequence of first video frames with the first video frame grabber from the video service device.

3. The method of claim 2 wherein grabbing the sequence of first video frames further comprises:

if an additional remote control signal is detected while grabbing the sequence of first video frames, restarting a counter such that the grabbed sequence extends beyond the additional remote control signal detection.

4. The method of claim 1 further comprising:

recording a particular second video frame grabbed with the second video frame grabber from the video camera whenever the particular second video frame was preceded by a detected remote control signal.

5. The method of claim 1 further comprising:

recording a particular second video frame grabbed with the second video frame grabber from the video camera whenever the particular second video frame was preceded by an immediately previous second video frame that, when compared with the particular second video frame, indicates a significant motion differential.

6. The method of claim 1 wherein automatic video frame grabs from the video camera take place continuously and are temporarily stored in an image buffer for subsequent recording when dictated by recording rules.

7. A computer readable storage medium having instructions stored thereon to direct a computer to perform a method of monitoring and recording user interaction with a video service device, the video service device being connected to a display, the computer including a first video frame grabber, and a second video frame grabber, wherein the video service device is connected to the first video frame grabber, a video camera is connected to the second video frame grabber, and a remote control signal detector is connected to the computer, the computer being programmed to monitor and selectively record information received from the video service device, the video camera, and the remote control signal detector, the medium further comprising:

instructions for, over a period of time, detecting a plurality of remote control signals with the remote control signal detector, each remote control signal being indicative of a remote control button click by the user;

instructions for, over the period of time, grabbing a plurality of first video frames with the first video frame grabber from the video service device;

instructions for, over a period of time, grabbing a plurality of second video frames with the second video frame grabber from the video camera; and

instructions for recording the detected remote control signals, the first video frames, and the second video frames to a storage device as a sequence of events over the period of time while preserving the time relationship among the various events with respect to each other thereby establishing a common time base for the recorded sequence of events.

8. The medium of claim 7 further comprising:

instructions for, in response to detecting a remote control signal with the remote control signal detector indicative of a remote control button click by the user, grabbing a sequence of first video frames with the first video frame grabber from the video service device.

9. The medium of claim 7 wherein the instructions for grabbing the sequence of first video frames further comprises:

instructions for, if an additional remote control signal is detected while grabbing the sequence of first video frames, restarting a counter such that the grabbed sequence extends beyond the additional remote control signal detection.

10. The medium of claim 7 further comprising:

instructions for recording a particular second video frame grabbed with the second video frame grabber from the video camera whenever the particular second video frame was preceded by a detected remote control signal.

11. The medium of claim 7 further comprising:

instructions for recording a particular second video frame grabbed with the second video frame grabber from the video camera whenever the particular second video frame was preceded by an immediately previous second video frame that, when compared with the particular second video frame, indicates a significant motion differential.

12. The medium of claim 7 further comprising:

instructions for automatically and continuously grabbing video frames from the video camera and temporarily storing the video frame grabs in an image buffer for subsequent recording when dictated by recording rules.