COMPUTER-VISION BASED PROCESS RECOGNITION
First Claim
1. A computer-vision based method for validating an activity workflow of a human performer, the method comprising:
- determining an expected sequence of actions associated with a target activity;
receiving a video stream from an image capture device monitoring an activity performed by an associated human performer;
determining an external cue in the video stream;
associating a frame capturing the external cue as a first frame in a key frame sequence;
determining an action being performed by the associated human performer in the key frame sequence;
in response to determining the action in the key frame sequence matching an expected action in the target activity, verifying the action as being performed in the monitored activity; and
,in response to not determining the action in the key frame sequence, generating an alert indicating an error in the monitored activity.
6 Assignments
0 Petitions
Accused Products
Abstract
A computer-vision based method for validating an activity workflow of a human performer includes identifying a target activity. The method includes determining an expected sequence of actions associated with the target activity. The method includes receiving a video stream from an image capture device monitoring an activity performed by an associated human performer. The method includes determining an external cue in the video stream. The method includes associating a frame capturing the external cue as a first frame in a key frame sequence. The method includes determining an action being performed by the associated human performer in the key frame sequence. In response to determining the action in the key frame sequence matching an expected action in the target activity, the method includes verifying the action as being performed in the monitored activity. In response to not determining the action in the key frame sequence, the method includes generating an alert indicating an error in the monitored activity.
43 Citations
20 Claims
-
1. A computer-vision based method for validating an activity workflow of a human performer, the method comprising:
-
determining an expected sequence of actions associated with a target activity; receiving a video stream from an image capture device monitoring an activity performed by an associated human performer; determining an external cue in the video stream; associating a frame capturing the external cue as a first frame in a key frame sequence; determining an action being performed by the associated human performer in the key frame sequence; in response to determining the action in the key frame sequence matching an expected action in the target activity, verifying the action as being performed in the monitored activity; and
,in response to not determining the action in the key frame sequence, generating an alert indicating an error in the monitored activity. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A system for validating an activity workflow of a human performer, the system comprising a computer device including a memory in communication with a processor configured to:
-
determine an expected sequence of actions associated with a target activity; receive a video stream from an image capture device monitoring an activity performed by an associated human performer; determining an external cue in the video stream; associating a frame capturing the external cue as a first frame in a key frame sequence; determine an action being performed by the associated human performer in the key frame sequence; in response to determining the action in the key frame sequence matching an expected action in the target activity, verify the action as being performed in the monitored activity; and
,in response to not determining the action in the key frame sequence, generate an alert indicating an error in the monitored activity. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19)
-
-
20. A computer-vision based method for validating an activity workflow of a human performer, the method comprising:
-
determining an expected sequence of actions associated with a target activity; receiving a video stream from an image capture device monitoring an activity performed by an associated human performer; determining an action performed by the associated human performer in the monitored video stream; in response to determining the action matching an expected action in the monitored video stream, verifying the action as being performed in the monitored activity; and
,in response to not determining the action in the monitored video stream, generating an alert indicating an error in the monitored activity.
-
Specification