Image recognition for personal protective equipment compliance enforcement in work areas

• US 9,695,981 B2
• Filed: 04/20/2012
• Issued: 07/04/2017
• Est. Priority Date: 04/20/2012
• Status: Active Grant

• Current Assignee: Honeywell International Inc.
• Original Assignee: Honeywell International Inc.
• Inventors: Bedros, Saad J., Mohideen, Mohammed Ibrahim, Gellaboina, Mahesh Kumar, Cabuz, Cleopatra, Au, Kwong Wing, Venkatesha, Sharath, Khurana, Himanshu, CS, Adishesha, Davalos, Pedro
• Primary Examiner(s): Ouellette, Jonathan
• Application Number:
  US13/452,596
• Publication Number:
  US 20130282609A1
• Time in Patent Office: 1,901 Days
• Field of Search: 705325, 705500, 705 11-912
• CPC Class Codes: F16P 3/142 using image capturing devices
• CPC Class Codes: G06F 18/00 Pattern recognition
• CPC Class Codes: G06Q 50/265 Personal security, identity or safety
• CPC Class Codes: G06V 10/757 Matching configurations of points or features
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 40/10 Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: G07C 1/10 together with the recording, indicating or registering of other data, e.g. of signs of identity
• CPC Class Codes: G07C 9/38 with central registration
• CPC Class Codes: G08B 21/02 Alarms for ensuring the safety of persons
• CPC Class Codes: G08B 21/24 Reminder alarms, e.g. anti-loss alarms

Abstract

A method comprises receiving one or more images of a person from one or more image capture devices in response to an input, identifying one or more items of personal protective equipment in the one or more images, determining the positioning of the one or more items of personal protective equipment relative to the person in the one or more images, and verifying compliance with personal protective equipment standards based on the one or more identified items of personal protective equipment and the positioning of the one or more items of personal protective equipment.

Claims

1. A personal protective equipment compliance system comprising:

a location device;

an access device configured to deny access to a work area unless the access device receives a compliance verification signal indicative of compliance with one or more personal protective equipment standards;

an image capture device;

a memory comprising a non-transitory, computer readable media;

a processor; and

an image recognition processing tool that, when executed by the processor, configures the processor to;

determine a location of a person based on a signal from the location device;

direct one or more image capture devices to the location of the person by one or more of the following;

panning, tilting, zooming;

receive one or more images from the image capture device;

detect one or more items of personal protective equipment within the one or more images;

detect the positioning of the one or more items of personal protective equipment on a person within the one or more images when the one or more items of personal protective equipment are detected;

identify the type of the one or more items of personal protective equipment when the one or more items of personal protective equipment are detected;

verify compliance with the one or more personal protective equipment standards based on the positioning of the one or more items of personal protective equipment and the type of the one or more items of personal protective equipment; and

send the compliance verification signal indicative of the compliance verification to the access device;

wherein the access device is further configured to, in response to receiving the compliance verification signal, grant access to the work area;

wherein the location device is separate and apart from the one or more image capture devices.

2. The personal protective equipment compliance system of claim 1, wherein the image recognition processing tool, when executed by the processor, further configures the processor to:

send an alert to an output device when compliance with the personal protective equipment standards is not verified, wherein the message comprises information on the personal protective equipment standards; and

store information related to the compliance verification in at least one of an access log or a compliance log.

3. The personal protective equipment compliance system of claim 1, wherein one or more items of personal protective equipment comprise at least one item selected from the group consisting of:

glasses, goggles, an ear plug, ear muffs, a face mask, a respirator, a hair net, a hard hat, a wrist band, gloves, a skirt, a gown, an apron, shoes, boots, a safety harness, a safety suit, a chemical suit, and any combinations thereof.

4. The personal protective equipment, compliance system of claim 1, wherein identify the type of the one or more items of personal protective equipment comprises:

identifying the kind of the one or more items of personal protective equipment; and

identifying at least one of the type or a sub-type of the one or more items of personal protective equipment.

5. The personal protective equipment compliance system of claim 1, wherein the image capture device comprises a spectral camera, color video camera or infrared camera.

6. The personal protective equipment compliance system of claim 1, wherein identify the type of the one or more items of personal protective equipment comprises:

identify one or more coded markings associated with the one or more items of personal protective equipment, wherein the one or more coded markings comprise at least one of a color code pattern, a color-symbol pattern, an asymmetrical pattern, a one dimensional bar code, a standard bar code, a two dimensional bar code, a shot code, a SEMACODE, or a color light pattern.

7. The personal protective equipment compliance system of claim 6, wherein the one or more coded markings are formed from at least one of an infrared (IR) reflective coating, IR absorptive coating, an ultraviolet (UV) reflective coating, or a UV absorptive coating.

8. The personal protective equipment compliance system of claim 7, wherein the personal protective equipment comprises glasses or goggles, and wherein the one or more coded markings are located on one or more lenses of the glasses or goggles.

9. The personal protective equipment compliance system of claim 1, wherein receive one or more images comprises receiving a set of images and ranking each image of the set according to confidence level.

10. The personal protective equipment compliance system of claim 9, wherein receive one or more images from an image capture device comprises retrieving a plurality of images from a circular storage buffer, and wherein the plurality of images are received from a plurality of image capture devices which have each been directed to the location of the person.

11. The personal protective equipment compliance system of claim 9, wherein detect the positioning of the one or more items of personal protective equipment comprises analyzing the set of images and weighting or averaging the set of images to prevent false positives or false negatives.

12. The personal protective equipment compliance system of claim 1, wherein detect the positioning of the one or more items of personal protective equipment comprises extracting one or more portions of the one or more images and using a background modeling/removal routine.

13. A personal protective equipment compliance system comprising:

a trigger device, wherein the trigger device is an entry way device located at an entry way to a work area;

an image capture device;

a memory comprising a non-transitory, computer readable media;

a processor; and

an image recognition processing tool that, when executed by the processor, configures the processor to;

receive a trigger signal from the trigger device;

receive one or more images from the image capture device in response to receiving the trigger signal;

detect one or more items of personal protective equipment within the one or more images;

detect the positioning of the one or more items of personal protective equipment on a person within the one or more images when the one or more items of personal protective equipment are detected;

identify the type of the one or more items of personal protective equipment when the one or more items of personal protective equipment are detected;

verify compliance with one or more personal protective equipment standards at the entry way to the work area based on the positioning of the one or more items of personal protective equipment and the type of the one or more items of personal protective equipment; and

send an output signal indicative of the compliance verification;

wherein a piece of equipment is configured to, in response to an access device for the piece of equipment receiving the output signal, activate;

wherein the piece of equipment is that to which the personal protective equipment relates to for protective purposes; and

wherein the trigger device is separate and apart from the one or more image capture devices.

14. The personal protective equipment compliance system of claim 13, wherein the access device comprises a lock-out feature.

15. The personal protective equipment compliance system of claim 13, wherein receive one or more images from an image capture device comprises retrieving the one or more images from a circular storage buffer.

16. The personal protective equipment compliance system of claim 15, wherein the one or more images comprise at least one image obtained prior to activation of the trigger device for use as background reference data.

17. The personal protective equipment compliance system of claim 13, wherein the image recognition processing tool, when executed by the processor, further configures the processor to:

determine a location of a person within the work area beyond the entry way based on a signal from a location device;

direct one or more image capture devices to the location of the person by one or more of the following;

panning, tilting, zooming;

receive one or more images from the location directed one or more image capture devices;

detect one or more items of personal protective equipment within the one or more images from the location directed one or more image capture devices;

detect the positioning of the one or more items of personal protective equipment on a person within the one or more images from the location directed one or more image capture devices when the one or more items of personal protective equipment are detected;

identify the type of the one or more items of personal protective equipment when the one or more items of personal protective equipment are detected within the one or more images from the location directed one or more image capture devices;

verify continued compliance with one or more personal protective equipment standards based on the positioning of the one or more items of personal protective equipment and the type of the one or more items of personal protective equipment as detected within the one or more images from the location directed one or more image capture devices; and

send a second output signal indicative of continued compliance verification;

wherein the location device is separate and apart from the one or more image capture devices.