Personnel tracking and monitoring system and method employing protective gear including a personnel electronic monitor device

• US 10,019,881 B2
• Filed: 11/04/2016
• Issued: 07/10/2018
• Est. Priority Date: 11/04/2015
• Status: Active Grant

• Current Assignee: Avante International Technology
• Original Assignee: Streamlight, Inc.
• Inventors: Chung, Kevin Kwong-Tai, Chung, Albert Han-Ping, Huang, Yulin, Dilalo, Michael
• Primary Examiner(s): NGUYEN, LAURA N
• Application Number:
  US15/343,399
• Publication Number:
  US 20170124836A1
• Time in Patent Office: 613 Days
• Field of Search: None
• CPC Class Codes: G08B 13/19621 Portable camera
• CPC Class Codes: G08B 21/02 Alarms for ensuring the safety of persons
• CPC Class Codes: G08B 21/0415 detecting absence of activity per se
• CPC Class Codes: G08B 25/016 Personal emergency signalling and security systems emergency non-personal manually actuated alarm activators G08B25/12
• CPC Class Codes: G08B 25/10 using wireless transmission systems G08B25/009 takes precedence
• CPC Class Codes: H04B 7/14 Relay systems
• CPC Class Codes: H04W 4/80 Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
• CPC Class Codes: H04W 4/90 Services for handling of emergency or hazardous situations, e.g. earthquake and tsunami warning systems [ETWS]
• CPC Class Codes: H04W 64/00 Locating users or terminals or network equipment for network management purposes, e.g. mobility management

Abstract

A personnel tracking and monitoring system and method comprises sets of monitoring devices each including: an electronic device having a unique identifier, a locating device, wireless communication devices communicating via a plurality of protocols, and an imaging device and a biologic monitor device communicating image and biologic data to the electronic device. The unique identifier, the location data and time data are associated with image data and with biologic data and are transmitted wirelessly via portable relay devices to one or more monitoring stations which store same in a database. Data stored in the data base is compared with predetermined criteria and if any predetermined criteria is exceeded, an indication thereof is communicated to the monitoring stations and/or to the electronic device to which such indication relates.

Claims

1. A personnel tracking and monitoring system comprising:

a plurality of sets of monitoring devices configured to be carried by personnel, each set of monitoring devices including;

an electronic device having a unique identifier and including a locating device configured to provide location data, a wireless communication device configured for communicating via a plurality of communication protocols, and a user interface configured to provide information to a user in human perceivable form and to receive information from a user wherein the wireless communication device is configured to communicate information provided to and received by the user interface;

an imaging device configured to provide image data and including a wireless transmitter for communicating the image data to the wireless communication device of said electronic device via a first short range communication protocol thereof; and

a biologic monitor device configured to provide biologic data of a personnel when carried by that personnel and including a wireless transmitter for communicating the biologic data to the wireless communication device of said electronic device via the first or a second short range communication protocol thereof;

said electronic device including a processor configured to associate the unique identifier, the location data and time data with received image data and with received biologic data and to cause the wireless communication device to transmit the received image data and biologic data and the unique identifier, the location data and the time data associated therewith via the first or second short range communication protocol thereof or via a longer range communication protocol thereof; and

a plurality of portable relay devices configured for being deployed at a site, each said portable relay device having a wireless communication device configured to communicate with the wireless communication devices of said plurality of sets of monitoring devices to relay the image data and biologic data and the unique identifier, the location data and the time data associated therewith to one or more monitoring stations either directly or via one or more of the plurality of portable relay devices;

wherein records describing the site and/or communication facilities at the site are received prior to arrival at the site and deployment of the portable relay devices at specific locations at the site is planned based upon the received site records, wherein the portable relay devices are configured based upon the deployment plan including defining for each portable relay device the specific location at which that portable relay device is to be deployed, and wherein each portable relay device is deployed at the specific location at the site defined therefor in accordance with the deployment plan,

whereby each portable relay device has a specific location defined therein and is deployed substantially at that specific defined location so that location with respect to each deployed portable relay device can be defined without reference to an external locating signal;

each monitoring station including a communication device configured to communicate directly or indirectly with the wireless communication devices of said plurality of portable relay devices to receive the image data and biologic data and the unique identifier, the location data and the time data associated therewith relayed thereby, and a database for storing the received image data and biologic data and the unique identifier, the location data and the time data associated therewith, and

at least one monitoring station including a processor configured to compare data stored in the data base with one or more predetermined criteria and when one or more of the predetermined criteria is exceeded, to generate an indication thereof and to communicate the indication to each monitoring station, to the electronic device to which such indication relates, or to each monitoring station and to the electronic device to which such indication relates.

2. The system of claim 1 wherein said locating device includes:

a global positioning system receiver;

or

a global positioning system receiver including wide area augmentation.

3. The system of claim 2 further comprising at least one accelerometer and/or gyroscopic device and/or a received signal strength indication device configured to provide motion data and to provide location data relative to a location determined by said global positioning system receiver, whereby the location data relative to a location determined by said global positioning system receiver is provided when GPS signal to said global positioning system receiver is lost.

4. The system of claim 1 wherein said electronic device includes a motion sensor configured to provide motion data that is representative of whether a person wearing said electronic device is animated or is substantially motionless.

5. The system of claim 4 wherein a notification is generated when the motion data represents that the person wearing said electronic device is substantially motionless for more than a predetermined period of time.

6. The system of claim 4 wherein a notification is:

generated by the processor of said electronic device and is transmitted by the wireless communication device of said electronic device when the motion data represents that the person wearing said electronic device is substantially motionless for more than a predetermined period of time;

or

generated by the processor of said monitoring station and is transmitted by the communication device of said monitoring station when the motion data exceeds a predetermined criteria representing being substantially motionless for more than a predetermined period of time.

7. The system of claim 4 wherein said motion sensor includes at least one accelerometer or an inertial device or both.

8. The system of claim 1 wherein the wireless communication devices of said electronic devices and of said relay devices communicate using an IEEE 802.1 network, an IEEE 802.15 network, a Bluetooth network, a Wi-Fi network, a ZigBee network, an EmberNet ad hoc network, 3G and/or 4G LTE data frequencies, 433 MHz and/or 700 MHz frequencies, commercial band LTE frequencies, RFID communication, microwave and/or fiberoptic links, a cellular network, and/or a satellite network.

9. The system of claim 1 wherein said electronic device further comprises one or more sensors that monitor health-indicating characteristics of personnel, ambient conditions, hazardous substances, hazardous conditions, and/or the environment.

10. The system of claim 9 wherein said one or more sensors include sensors of environmental conditions, temperature, pressure, position, acceleration, impact, distance, gyroscopic and/or inertial information, magnetic field, electrical continuity, altitude, a physical parameter, moisture, humidity, chemicals, gases, medical parameters, biological substances and/or agents, radioactivity, optical, light, infrared, images, still and/or video images, sound, noise, electromagnetic fields, and any combination of any two or more thereof.

11. The system of claim 1 wherein:

said imaging device includes a still imager or a video imager or both;

or

said biologic monitor senses calories expended, steps taken, stair steps climbed, stair steps descended, time, distance, body temperature, heart rate, respiration, or any combination thereof;

or

said imaging device includes a still imager or a video imager or both, and said biologic monitor senses calories expended, steps taken, stair steps climbed, stair steps descended, time, distance, body temperature, heart rate, respiration, or any combination thereof.

12. The system of claim 1 wherein said user interface comprises:

a sound transducer including any one or more of a buzzer, beeper, annunciator, loudspeaker, earphone, an audibly perceptible device, a microphone, a sound pick up device, or any combination thereof;

or

a visual transducer including any one or more of a light, a flashing light, a light producing different colors, a LED, a LCD display, a visually perceptible device, a display screen, an imaging device to capture still and/or video images, or a combination thereof;

or

both a sound transducer and a visual transducer.

13. The system of claim 1 wherein said user interface includes any one or more of an annunciator, loudspeaker, earphone, or an audibly perceptible device, and includes a microphone, or a sound pick up device, coupled to said wireless communication device of said electronic device for providing two-way voice communication.

14. The system of claim 1 wherein said electronic device, said imaging device and said biologic monitor are made of a material, are encased in a material and/or are enclosed in a housing that withstands the extremes of temperature, high heat, fire, flame, and corrosive gas to which they may be exposed.

15. The system of claim 1 wherein the records describing the site and/or the communication facilities at the site are received whilst en route to the site and deployment of the portable relay devices is planned based upon the received site records, wherein the portable relay devices are configured based upon the deployment plan and are deployed at the site in accordance with the deployment plan.

16. The system of claim 1 wherein the records describing the site and/or the communication facilities at the site are received whilst en route to the site.

17. The system of claim 1 wherein the defined specific locations include entrances, exits, stairways, elevators, and/or spaces that are at known predetermined locations at the site.

18. The system of claim 1 wherein the records describing the site and/or the communication facilities at the site are received whilst en route to the site;

deployment of personnel and of the portable relay devices is planned based upon the received site records;

the electronic devices, the portable relay devices or both the electronic devices and the portable relay devices are configured based upon the received site records, the deployment plan or both; and

wherein personnel and the portable relay devices are deployed in accordance with the deployment plan.

19. A method for tracking and monitoring personnel comprising:

providing a plurality of sets of monitoring devices configured to be carried by personnel, each set of monitoring devices including;

an electronic device having a unique identifier and including a locating device configured to provide location data, a wireless communication device configured for communicating via a plurality of communication protocols, and a user interface configured to provide information to a user in human perceivable form and to receive information from a user wherein the wireless communication device is configured to communicate information provided to and received by the user interface;

an imaging device configured to provide image data and including a wireless transmitter for communicating the image data to the wireless communication device of the electronic device via a first short range communication protocol thereof; and

a biologic monitor device configured to provide biologic data of a personnel when carried by that personnel and including a wireless transmitter for communicating the biologic data to the wireless communication device of the electronic device via the first or a second short range communication protocol thereof;

associating the unique identifier, the location data and time data with received image data and with received biologic data;

transmitting the received image data and biologic data and the unique identifier, the location data and the time data associated therewith via the first or second short range communication protocol or via a longer range communication protocol;

deploying a plurality of portable relay devices at a site, each portable relay device having a wireless communication device configured to communicate with the wireless communication devices of the plurality of sets of monitoring devices;

receiving prior to arrival at the site records describing the configuration of the site;

planning deployment of the portable relay devices at specific locations at the site based upon the received site records;

configuring the portable relay devices based upon the deployment plan including defining for each portable relay device the specific location at which that portable relay device is to be deployed; and

deploying the portable relay devices at the specific locations at the site in accordance with the deployment plan,

whereby each portable relay device has a specific location defined therein and is deployed substantially at that specific defined location so that location with respect to each deployed portable relay device can be defined without reference to an external locating signal;

relaying the image data and biologic data and the unique identifier, the location data and the time data associated therewith to one or more monitoring stations either directly or via one or more of the plurality of portable relay devices;

communicating directly or indirectly with the wireless communication devices of the plurality of portable relay devices to receive the image data and biologic data and the unique identifier, the location data and the time data associated therewith relayed thereby,

storing the received image data and biologic data and the unique identifier, the location data and the time data associated therewith in a database;

comparing data stored in the data base with one or more predetermined criteria and when one or more of the predetermined criteria is exceeded,

generating an indication thereof and communicating the indication to each monitoring station, to the electronic device to which such indication relates, or to each monitoring station and to the electronic device to which such indication relates.

20. The method of claim 19 wherein the locating device includes:

a global positioning system receiver;

or

a global positioning system receiver including wide area augmentation.

21. The method of claim 19 further comprising:

receiving motion data from at least one accelerometer and/or gyroscopic device and/or a received signal strength indication device of the electronic device; and

processing the motion data to provide location data relative to a location determined by the locating device, whereby the location data relative to a location determined by the locating device is provided when external signal to the locating device is lost.

22. The method of claim 19 further comprising:

receiving motion data from a motion sensor of the electronic device; and

processing the motion data to determine whether a person wearing the electronic device is animated or is substantially motionless.

23. The method of claim 22 further including generating a notification when the motion data represents that the person wearing the electronic device is substantially motionless for more than a predetermined period of time.

24. The method of claim 22 further including generating a notification, wherein the generating the notification includes:

generating the notification in the electronic device and transmitting the notification via the wireless communication device of the electronic device when the motion data represents that the person wearing said electronic device is substantially motionless for more than the predetermined period of time;

or

generating the notification at a monitoring station and transmitting the notification via the communication device of the monitoring station when the motion data exceeds a predetermined criteria representing being substantially motionless for more than the predetermined period of time.

25. The method of claim 22 wherein the motion sensor includes at least one accelerometer or an inertial device or both.

26. The method of claim 19 wherein the transmitting the received image data and biologic data and the unique identifier, the location data and the time data associated therewith by the electronic devices and the relaying thereof employs an IEEE 802.1 network, an IEEE 802.15 network, a Bluetooth network, a Wi-Fi network, a ZigBee network, an EmberNet ad hoc network, 3G and/or 4G LTE data frequencies, 433 MHz and/or 700 MHz frequencies, commercial band LTE frequencies, RFID communication, microwave and/or fiberoptic links, a cellular network, and/or a satellite network.

27. The method of claim 19 further including monitoring health-indicating characteristics of personnel, ambient conditions, hazardous substances, hazardous conditions, and/or the environment by one or more sensors of the electronic device.

28. The method of claim 27 wherein the one or more sensors include sensors of environmental conditions, temperature, pressure, position, acceleration, impact, distance, gyroscopic and/or inertial information, magnetic field, electrical continuity, altitude, a physical parameter, moisture, humidity, chemicals, gases, medical parameters, biological substances and/or agents, radioactivity, optical, light, infrared, images, still and/or video images, sound, noise, electromagnetic fields, and any combination of any two or more thereof.

29. The method of claim 19 wherein:

the image data includes still images or video images or both;

or

the biologic data includes calories expended, steps taken, stair steps climbed, stair steps descended, time, distance, body temperature, heart rate, respiration, or any combination thereof;

or

the image data includes still images or video images or both, and the biologic data includes calories expended, steps taken, stair steps climbed, stair steps descended, time, distance, body temperature, heart rate, respiration, or any combination thereof.

30. The method of claim 19 wherein the user interface:

provides information audibly via any one or more of a buzzer, beeper, annunciator, loudspeaker, earphone, an audibly perceptible device, a microphone, a sound pick up device, or any combination thereof;

or

provides information visually via any one or more of a light, a flashing light, a light producing different colors, a LED, a LCD display, a visually perceptible device, a display screen, an imaging device to capture still and/or video images, or a combination thereof;

or

provides information both audibly and visually.

31. The method of claim 19 further including enclosing and/or encasing the electronic device, the imaging device and/or the biologic monitor in a material and/or in a housing that withstands the extremes of temperature, high heat, fire, flame, and/or corrosive gas to which the electronic device may be exposed.

32. The method of claim 19 further comprising:

receiving whilst en route to the site records describing the site and/or communication facilities at the site;

planning deployment of the portable relay devices based upon the received site records;

configuring the portable relay devices based upon the deployment plan; and

deploying the portable relay devices at the site in accordance with the deployment plan.

33. The method of claim 19 wherein the receiving site records prior to arrival at the site includes receiving site records whilst en route to the site.

34. The method of claim 19 wherein the defined specific locations include entrances, exits, stairways, elevators, and/or spaces that are at known predetermined locations at the site.

35. The method of claim 19 further comprising:

receiving whilst en route to the site records describing the site and/or communication facilities at the site;

planning deployment of personnel and of the portable relay devices based upon the received site records;

configuring the electronic devices, the portable relay devices or both the electronic devices and the portable relay devices based upon the received site records, the deployment plan or both; and

deploying personnel and the portable relay devices in accordance with the deployment plan.