Generating alerts based upon detector outputs
First Claim
1. A system comprising:
- a client device comprising one or more processors;
the client device coupled, via electronic communications, to a server computer comprising one or more processors, the server computer configured to receive, from a video source, video data comprising a plurality of frames, wherein each frame comprises a plurality of pixels;
the client device configured to;
determine, by the one or more processors of the client device, a monitoring region in the plurality of frames, wherein the monitoring region comprises a subset of the plurality of pixels, by associating the subset of the plurality of pixels with a key item comprising a particular pixel pattern;
extract, by the one or more processors of the client device, pixel data from the subset of the plurality of pixels in the monitoring region in a subset of the plurality of frames;
perform an analysis, by the one or more processors of the client device, of the extracted pixel data from the monitoring region; and
perform, by the one or more processors of the client device, an action based on the analyzing.
11 Assignments
0 Petitions
Accused Products
Abstract
Systems and methods for generating alerts and enhanced viewing experience features using on-screen data are disclosed. Textual data corresponding to on-screen text is determined from the visual content of video data. The textual data is associated with corresponding regions and frames of the video data in which the corresponding on-screen text was detected. Users can select regions in the frames of the visual content to monitor for a particular triggering item (e.g., a triggering word, name, or phrase). During play back of the video data, the textual data associated with the selected regions in the frames can be monitored for the triggering item. When the triggering item is detected in the textual data, an alert can be generated. Alternatively, the textual data for the selected region can be extracted to compile supplemental information that can be rendered over the playback of the video data or over other video data.
-
Citations
19 Claims
-
1. A system comprising:
-
a client device comprising one or more processors; the client device coupled, via electronic communications, to a server computer comprising one or more processors, the server computer configured to receive, from a video source, video data comprising a plurality of frames, wherein each frame comprises a plurality of pixels; the client device configured to; determine, by the one or more processors of the client device, a monitoring region in the plurality of frames, wherein the monitoring region comprises a subset of the plurality of pixels, by associating the subset of the plurality of pixels with a key item comprising a particular pixel pattern; extract, by the one or more processors of the client device, pixel data from the subset of the plurality of pixels in the monitoring region in a subset of the plurality of frames; perform an analysis, by the one or more processors of the client device, of the extracted pixel data from the monitoring region; and perform, by the one or more processors of the client device, an action based on the analyzing. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17)
-
-
18. A system comprising:
-
a client device comprising one or more processors; the client device coupled, via electronic communications, to a server computer comprising one or more processors, the server computer configured to receive, from a video source, video data comprising a plurality of frames; the client device configured to; receive, by the one or more processors of the client device, previously determined detector output data corresponding to the video data, wherein the previously determined detector output data comprises textual data corresponding to images of text detected in corresponding regions of the plurality of frames; determine, by the one or more processors of the client device, a monitoring region in the plurality of frames, wherein the monitoring region comprises at least one of the regions in the plurality of frames, by associating the at least one of the regions in the plurality of frames with a key item comprising a particular pixel pattern; define, by the one or more processors of the client device, a text string; and for each frame in the plurality of frames; determine, by the one or more processors of the client device, the textual data from the previously determined detector output data for the monitoring region; compare, by the one or more processors of the client device, the textual data with the text string; determine, by the one or more processors of the client device, a match based on the comparing; and perform, by the one or more processors of the client device, one or more actions in response to the match. - View Dependent Claims (19)
-
Specification