Method and apparatus for monitoring a user's activities

• US 8,199,160 B2
• Filed: 06/02/2006
• Issued: 06/12/2012
• Est. Priority Date: 06/02/2006
• Status: Active Grant

• Current Assignee: ATG Advanced Swiss Technology Group AG
• Original Assignee: Advanced US Technology Group, Inc.
• Inventors: Hauke, Rudolf
• Primary Examiner(s): Crawford, Jacinta M
• Application Number:
  US11/421,892
• Publication Number:
  US 20080049027A1
• Time in Patent Office: 2,202 Days
• Field of Search: 725/9, 725/10, 725/19, 725/18, 725/25, 725/28, 725/31, 345/531, 345/545
• US Class Current: 345/531
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/44016 involving splicing one content stream with another content stream, e.g. for substituting a video clip
• CPC Class Codes: H04N 21/440245 the reformatting operation being performed only on part of the stream, e.g. a region of the image or a time segment
• CPC Class Codes: H04N 21/4524 involving the geographical location of the client retrieval from the Internet by querying based on geographical locations G06F16/9537; systems specially adapted for using geographical information in broadcast systems H04H60/70; protocols in which the network application is adapted for the location of the user terminal in communication control or processing H04L67/52; services making use of the location of users or terminals in wireless networks H04W4/02; locating users or terminals in wireless networks H04W64/00
• CPC Class Codes: H04N 21/4532 involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/4542 Blocking scenes or portions of the received content, e.g. censoring scenes
• CPC Class Codes: H04N 21/4751 for defining user accounts, e.g. accounts for children
• CPC Class Codes: H04N 21/6582 Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number arrangements where receivers interact with the broadcast H04H20/38
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 7/163 by receiver means only

Abstract

A method for monitoring a user'"'"'s activities, wherein the activities comprising an output via a graphics device having a frame buffer. The method includes retrieving image data from the frame buffer, examining the image data, identifying an offensive attribute within the image data, and reacting to the attribute in a predefined way.

Claims

1. A method for monitoring a user'"'"'s activities on an electronic device comprising a hardware level, an operating system level and an application level, the activities comprising an output of content loaded from a content source by an application in the application level, which finally outputs the content to a human readable device via a graphics device having a monitoring unit and a frame buffer and a graphics processor arranged within the hardware level, wherein the frame buffer holds digital image data representing the content to be output and is the last instance in which the content to be output is digitally available, wherein the digital image data in the frame buffer is periodically read by the graphics processor and output to the human readable device, the method comprising the steps of:

retrieving the image data from the frame buffer;

examining the image data by performing a content-based classification of the image data;

identifying an offensive attribute within the image data, wherein the identifying is performed based on the examining of the image data and independently from the content source of the image data; and

reacting to the attribute in a predefined way by modifying parts of or the whole of the frame buffer,

wherein the steps are performed by the monitoring unit.

2. The method as recited in claim 1, wherein the reacting step comprises denying the output of at least a part of the image data.

3. The method as recited in claim 1, wherein the reacting step comprises replacing at least a part of the image data by a predefined substitute.

4. The method as recited in claim 1, wherein the reacting step comprises logging an identification of the offensive attribute into a memory.

5. The method as recited in claim 1, wherein the reacting step comprises communicating a message to a surveillance instance, the message comprising at least one of an indicator for an identification of the offensive attribute and a plurality of indicators for identifications logged earlier.

6. The method as recited in claim 5, wherein the reacting step comprises waiting for an established internet connection before communicating the message.

7. The method as recited in claim 5, further comprising the step of determining a whereabout of the device by means of a positioning system and wherein the message comprises the whereabout.

8. The method as recited in claim 7, further comprising detecting a nearby cellular phone and wherein the whereabout is determined utilizing the nearby cellular phone.

9. The method as recited in claim 5, further comprising detecting a nearby cellular phone and wherein the message is communicated via the nearby cellular phone.

10. The method as recited in claim 1, wherein the content-based classification comprises an optical character recognition.

11. The method as recited in claim 1, wherein the graphics device includes one of a graphics adapter and a graphics processing unit of a printer.

12. The method as recited in claim 1, wherein the frame buffer is integrated into the graphics device.

13. The method as recited in claim 1, further comprising matching the offensive attribute with predefined categories for determining the predefined way.

14. The method as recited in claim 13, further comprising tracing a document containing the variation.

15. The method as recited in claim 1, wherein the offensive attribute is a variation in the image data, predefined to be recognizable by the method.

16. An apparatus for monitoring a user'"'"'s activities on an electronic device comprising a hardware level, an operating system level and an application level, the activities comprising an output of content loaded from a content source by an application in the application level, which finally outputs the content to a human readable device via a graphics device having a monitoring unit and a frame buffer and a graphics processor arranged within the hardware level, wherein the frame buffer holds digital image data representing the content to be output and is the last instance where the content to be output is digitally available, wherein the digital image data in the frame buffer is periodically read by the graphics processor and output to the human readable device, and comprising:

a retrieving unit configured to retrieve the image data from the frame buffer;

an examination and identification unit configured to examine the image data by performing a content-based classification of the image data so as to identify an offensive attribute within the image data, wherein the identifying is based on the examining of the image data and independently from the content source of the image data; and

a reaction unit configured to react to the attribute in a predefined way by modifying part of or the whole of the frame buffer.

17. The apparatus as recited in claim 16, wherein the apparatus includes at least one of a graphics controller for a graphics adapter for a computer, a cellular phone, a handheld computer, a digital television set, and a graphics processing unit for a printer.