ANALYZING VIDEO STREAMS IN AN INDUSTRIAL ENVIRONMENT TO IDENTIFY POTENTIAL PROBLEMS AND SELECT RECIPIENTS FOR A DISPLAY OF VIDEO STREAMS RELATED TO THE POTENTIAL PROBLEMS

• US 20170300753A1
• Filed: 04/19/2016
• Published: 10/19/2017
• Est. Priority Date: 04/19/2016
• Status: Active Grant

• Current Assignee: Rockwell Automation Technologies Incorporated (Rockwell Automation, Inc.)
• Original Assignee: Rockwell Automation Technologies Incorporated (Rockwell Automation, Inc.)
• Inventors: Billi, Sharon M., Como, Christopher Wayne, Gray, Edward A., Reissner, Kyle, Walter, Jonathan D., Singhai, Mohit, Reichard, Douglas J., Sandler, Scott N., Bliss, Ronald E., Pantaleano, Michael John, Cahalane, Ryan, Korpela, Jessica L., McCleave, Bruce T.
• Granted Patent: US 10,325,155 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 18/2411 based on the proximity to a decision surface, e.g. support vector machines
• CPC Class Codes: G06V 10/764 using classification, e.g. of video objects
• CPC Class Codes: G06V 20/41 Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items segmenting video sequences G06V20/49
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 2201/06 Recognition of objects for industrial automation
• CPC Class Codes: H04N 5/765 Interface circuits between an apparatus for recording and another apparatus
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

The subject matter disclosed herein relates generally to industrial automation systems, and, more particularly, to collecting video streams from a variety of video devices in an industrial environment, identifying and analyzing potential problems in the industrial environment using the video streams, and presenting the video streams and data associated with the potential problem to appropriate recipients.

Claims

1. A system, comprising:

a processor; and

a memory communicatively coupled to the processor, the memory having stored therein computer-executable instructions, comprising;

a video receiving component configured to obtain video streams captured by cameras in an industrial environment;

a video monitoring component configured to identify a potential problem in the industrial environment based on a video stream of the video streams;

a recipient identification component configured to select a recipient for the video stream from a plurality of recipients according to a selection criteria associated with the potential problem; and

a video presentation component configured to present a display comprising the video stream to a display device associated with a selected recipient.

2. The system of claim 1, further comprising a data monitoring component that identifies data produced in the industrial environment associated with the potential problem;

and

wherein the display further comprises the identified data.

3. The system of claim 2, wherein the identified data comprises potential instigator data indicating a possible cause of the potential problem.

4. The system of claim 1, wherein the video monitoring component is further configured to identify at least one other video stream of the video streams that is indicative of a potential instigator of the potential problem;

and

wherein the display further comprises the at least one other video stream.

5. The system of claim 1, wherein the selection criteria comprises an ability of the recipient to resolve the potential problem.

6. The system of claim 1, further comprising a display device identification component configured to select the display device out of a plurality of display devices associated with the recipient based upon respective availability of the display devices to the recipient.

7. The system of claim 1, further comprising a video tagging component configured to tag at least a portion of the video stream with a unique identifier associated with the potential problem.

8. The system of claim 2, further comprising a data tagging component configured to tag the identified data with a unique identifier associated with the potential problem.

9. The system of claim 2, further comprising a video/data synchronization component configured to time synchronize the video stream with the identified data;

and

wherein the display is configured to present a playback of the video stream in time synchronization with the identified data.

10. The system of claim 4, further comprising a video/data synchronization component configured to time synchronize the video stream with the at least one other video stream;

and

wherein the display is configured to present a playback of the video stream in time synchronization with the at least one other video stream.

11. A method, comprising:

receiving, by a system comprising a processor, video streams captured by cameras in an industrial environment;

determining, by the system, a potential problem in the industrial environment based on a video stream of the video streams;

selecting, by the system, a recipient from a plurality of recipients for the video stream according to a selection criteria associated with the potential problem; and

streaming, by the system, a display comprising the video stream to a display device associated with a selected recipient.

12. The method of claim 11, further comprising identifying, by the system, data produced in the industrial environment associated with the potential problem;

and

wherein the display further comprises the identified data.

13. The method of claim 12, wherein the identified data comprises potential instigator data indicating a possible cause of the potential problem.

14. The method of claim 12, further comprising tagging, by the system, at least a portion of the video stream and the identified data with a unique identifier associated with the potential problem.

15. The method of claim 11, further comprising identifying, by the system, at least one other video stream of the video streams that depicts a potential instigator of the potential problem;

and

wherein the display further comprises the other video stream.

16. A non-transitory computer-readable medium having stored thereon instructions that, in response to execution, cause a system comprising a processor to perform operations, the operations comprising:

accessing video streams captured by cameras in an industrial environment;

predicting a potential problem in the industrial environment based on at least one video stream of the video streams; and

selecting at least one recipient from a plurality of recipients for the video stream according to a selection criteria associated with the potential problem; and

delivering a display comprising the at least one video stream to at least one display device associated with the at least one selected recipient.

17. The non-transitory computer-readable medium of claim 16, the operations further comprising identifying, by the system, data produced in the industrial environment associated with the potential problem;

and

wherein the display further comprises the identified data.

18. The non-transitory computer-readable medium of claim 16, wherein the selection criteria comprises a maintenance history of a recipient with a machine involved in the potential problem.

19. The non-transitory computer-readable medium of claim 16, wherein the selection criteria comprises a physical proximity of a recipient to a location of the potential problem.

20. The non-transitory computer-readable medium of claim 16, wherein the selection criteria comprises an availability of particular display device to a recipient.