UNSUPERVISED ANOMALY DETECTION USING SHADOWING OF HUMAN COMPUTER INTERACTION CHANNELS
First Claim
1. A method comprising:
- accessing, at a shadowing device, a video input stream of display screen images rendered on a display screen of a display device, the display screen images recorded by the shadowing device to produce the video input stream;
identifying, at the shadowing device, a first frame of the video input stream;
determining, at the shadowing device, whether an anomaly is associated with the video input stream based, at least in part, on applying a rule of a set of rules to at least a portion of the first frame, wherein the set of rules defines a control image associated with the video input stream; and
determining whether to take an action based on the determining whether the anomaly is associated with the video input stream.
1 Assignment
0 Petitions
Accused Products
Abstract
Technologies are provided in embodiments to detect anomalies by shadowing human-computer interaction channels. Embodiments include accessing a shadow signal generated by a shadowing device. In an embodiment, the shadow signal can be a video input stream of display screen images rendered on a display screen, where the display screen images were recorded by the shadowing device. The embodiment also includes identifying, at the shadowing device, a first frame of the video input stream, and determining whether an anomaly is associated with the video input stream based, at least in part, on applying a rule of a set of rules to at least a portion of the first frame, where the set of rules defines a control image associated with the video input stream. The embodiment further includes determining whether to take an action based on the determining whether the anomaly is associated with the video input stream.
-
Citations
20 Claims
-
1. A method comprising:
-
accessing, at a shadowing device, a video input stream of display screen images rendered on a display screen of a display device, the display screen images recorded by the shadowing device to produce the video input stream; identifying, at the shadowing device, a first frame of the video input stream; determining, at the shadowing device, whether an anomaly is associated with the video input stream based, at least in part, on applying a rule of a set of rules to at least a portion of the first frame, wherein the set of rules defines a control image associated with the video input stream; and determining whether to take an action based on the determining whether the anomaly is associated with the video input stream. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15)
-
-
16. A system comprising:
-
a memory element; and a shadowing device including a processor to execute instructions stored in the memory element to; recording display screen images rendered on a display screen of a display device; access a video input stream based on the recording; identify a first frame of the video input stream; determine whether an anomaly is associated with the video input stream based, at least in part, on applying a rule of a set of rules to at least a portion of the first frame, wherein the set of rules defines a control image associated with the video input stream; and determine whether to take an action based on determining whether the anomaly is associated with the video input stream. - View Dependent Claims (17, 18)
-
-
19. A computer program product comprising a computer readable storage medium comprising computer readable program code embodied therewith, the computer readable program code comprising:
-
computer readable program code configured to access a video input stream of display screen images rendered on a display screen of a display device, the display screen images recorded by a shadowing device; computer readable program code configured to identify a first frame of the video input stream; computer readable program code configured to determine whether an anomaly is associated with the video input stream based, at least in part, on applying a rule of a set of rules to at least a portion of the first frame, wherein the set of rules defines a control image associated with the video input stream; and computer readable program code configured to determining whether to take an action based on the determining whether the anomaly is associated with the video input stream. - View Dependent Claims (20)
-
Specification