RECOGNITION-BASED INDUSTRIAL AUTOMATION CONTROL WITH PERSON AND OBJECT DISCRIMINATION

• US 20160303741A1
• Filed: 06/29/2016
• Published: 10/20/2016
• Est. Priority Date: 02/27/2013
• Status: Active Grant

• Current Assignee: Rockwell Automation Technologies Incorporated (Allen-Bradley Co., Inc.)
• Original Assignee: Rockwell Automation Technologies Incorporated (Allen-Bradley Co., Inc.)
• Inventors: Scott, Steven J., Nguyen, Thong T., Brandt, David D., Gibart, Tony, Dotson, Gary D.
• Granted Patent: US 9,731,421 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: B25J 9/1694 characterised by use of sensors other than normal servo-feedback from position, speed or acceleration sensors, perception control, multi-sensor controlled systems, sensor fusion
• CPC Class Codes: B25J 9/1697 Vision controlled systems
• CPC Class Codes: G05B 15/02 electric
• CPC Class Codes: G05B 19/409 characterised by using manual data input [MDI] or by using control panel, e.g. controlling functions with the panel; characterised by control panel details or by setting parameters G05B19/408, G05B19/4093 take precedence
• CPC Class Codes: G05B 2219/2614 HVAC, heating, ventillation, climate control
• CPC Class Codes: G05B 2219/2642 Domotique, domestic, home control, automation, smart house
• CPC Class Codes: G06F 18/256 of results relating to different input data, e.g. multimodal recognition
• CPC Class Codes: G06V 30/142 using hand-held instruments; Constructional details of the instruments

Abstract

The present disclosure generally relates to a method for performing industrial automation control in an industrial automation system may include detecting, via a sensor system, positions and/or motions of one or more humans and/or one or more objects in an industrial automation system and distinguishing, via a programmed computer system, between one or more humans and one or more objects based upon the detected positions and/or motions. The method may then include implementing a control and/or notification action based upon the distinction.

Claims

1. A method for controlling an industrial automation system, comprising:

receiving, via a sensor system, image data representing a plurality of humans permissibly present in a control area, image data for one of the humans comprising indicia of operator authorization;

converting the image data into analytical representations of the humans, each representation comprising a plurality of data points;

distinguishing between the plurality of humans based upon the plurality of data points;

identifying as an authorized operator the human having the indicia of operator authorization;

interpreting a gesture of the authorized operator as corresponding to a control input for the industrial automation system; and

implementing control of the industrial automation system based upon the interpretation.

2. The method of claim 1, wherein the indicia are provided by an article carried or worn by the authorized operator.

3. The method of claim 2, wherein the article comprises an article of clothing.

4. The method of claim 1, wherein the indicia comprise a color disposed on the authorized operator.

5. The method of claim 1, wherein the indicia comprise a gesture made by the authorized operator.

6. The method of claim 1, comprising recognizing different humans as having different levels of authority based on at least one of particular motions or gestures performed by one or more of the humans, particular articles of clothing worn by one or more of the humans, emblems, symbols, or tags detected on one or more of the humans, and stored profiles of one or more of the humans.

7. The method of claim 1, wherein the indicia comprise facial features and/or body parameters of the authorized operator, and wherein distinguishing between the plurality of humans comprises comparing facial features and/or body parameters to one or more profiles of one or more humans.

8. The method of claim 1, comprising interpreting the gesture as one of a plurality of gestures in the library associated a pattern indicative of the respective control input.

9. The method of claim 1, comprising detecting, via the sensor system, an undesirable object in the industrial automation system, and implementing the control based upon the detecting of the undesired object.

10. A method for controlling an industrial automation system, comprising:

receiving, via a sensor system, image data representing a plurality of humans permissibly present in a control area, image data for one of the humans comprising indicia of operator authorization;

analyzing the image data to identify as an authorized operator the human having the indicia of operator authorization;

interpreting a gesture of the authorized operator as corresponding to a control input for the industrial automation system; and

implementing control of the industrial automation system based upon the interpretation.

11. The method of claim 10, wherein the image data is analyzed by converting the image data into analytical representations of the humans, each representation comprising a plurality of data points, and distinguishing between the plurality of humans based upon the plurality of data points.

12. The method of claim 10, wherein the indicia are provided by an article carried or worn by the authorized operator.

13. The method of claim 10, wherein the indicia comprise a color disposed on the authorized operator.

14. The method of claim 10, wherein the indicia comprise a gesture made by the authorized operator.

15. The method of claim 10, wherein the indicia comprise facial features and/or body parameters of the authorized operator, and wherein distinguishing between the plurality of humans comprises comparing facial features and/or body parameters to one or more profiles of one or more humans.

16. The method of claim 10, comprising interpreting the gesture as one of a plurality of gestures in the library associated a pattern indicative of the respective control input.

17. A system for performing industrial automation control, comprising:

a sensor system configured to create image data representing a plurality of humans permissibly present in a control area, image data for one of the humans comprising indicia of operator authorization;

processing circuitry configured to convert the image data into analytical representations of the humans, each representation comprising a plurality of data points, to distinguish between the plurality of humans based upon the plurality of data points, to identify as an authorized operator the human having the indicia of operator authorization, and to interpret a gesture of the authorized operator as corresponding to a control input for the industrial automation system; and

a control component configured to implement control of the industrial automation system based upon the interpretation.

18. The system of claim 17, wherein the image data is analyzed by converting the image data into analytical representations of the humans, each representation comprising a plurality of data points, and distinguishing between the plurality of humans based upon the plurality of data points.

19. The system of claim 17, wherein the indicia are provided by an article carried or worn by the authorized operator.

20. The system of claim 17, wherein the indicia comprise a color disposed on the authorized operator.