System and method for biosensor-triggered multimedia collaboration

• US 10,038,875 B2
• Filed: 08/22/2016
• Issued: 07/31/2018
• Est. Priority Date: 03/09/2015
• Status: Active Grant

• Current Assignee: Mutualink, Inc.
• Original Assignee: Mutualink, Inc.
• Inventors: Mazzarella, Joseph R., Wengrovitz, Michael S.
• Primary Examiner(s): Smith, Creighton
• Application Number:
  US15/242,792
• Publication Number:
  US 20160360153A1
• Time in Patent Office: 708 Days
• CPC Class Codes: H04L 65/102 Gateways arrangements for connecting between networks having differing types of switching systems, e.g. gateways, H04L12/66
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04N 5/772 the recording apparatus and the television camera being placed in the same enclosure
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/185 from a mobile camera, e.g. for remote control
• CPC Class Codes: H04N 7/188 Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position signal generation from motion picture films H04N5/253
• CPC Class Codes: H04W 76/50 for emergency connections
• CPC Class Codes: Y04S 40/18 Network protocols supporting networked applications, e.g. including control of end-device applications over a network

Abstract

Embodiments include a system, method, and computer program product for using a biosensor worn by a user to trigger an event and activate a camera worn by the user to begin streaming and/or recording video data. The biosensor trigger also initiates a real time multimedia collaboration session with the user wearing the biosensor and one or more designated parties. Through an interoperability gateway device, a voice communications device of the user is bridged with voice communications devices of the designated parties, and the video data is electronically transmitted to the designated parties. Thus, the designated parties may have real time voice communications among each other and with the user, and the designated parties may also view the video data in real time. Embodiments also determine when an event has ended and deactivates the camera worn by the user.

Claims

1. A system, comprising:

one or more processors;

a memory coupled to the one or more processors, wherein the one or more processors are configured to;

electronically receive a first biometric signal from a first body-worn biosensor, wherein the first body-worn biosensor is associated with a first interoperability workstation (IWS) of a first agency;

electronically determine using the first biometric signal that a first event occurs;

electronically transmit an activation message to a first camera device in proximity to the first body-worn biosensor to begin recording and transmitting first video data;

electronically transmit a first event alert to the first IWS, wherein based on rules, the first IWS establishes a first biosensor-triggered multimedia collaboration that includes the first video data;

electronically receive a second biometric signal from the first body-worn biosensor;

electronically determine using the second biometric signal, that the first event has ceased; and

electronically transmit a deactivation message to the first camera device to cease recording video data.

2. The system of claim 1, wherein the one or more processors are further configured to:

electronically receive a third biometric signal from a second biosensor, wherein the second biosensor is associated with a different user than that associated with the first body-worn biosensor;

electronically determine using the third biometric signal that a second event occurs; and

electronically transmit an activation message to a second camera device in proximity to the second biosensor to begin recording and transmitting second video data.

3. The system of claim 2, wherein the one or more processors are further configured to electronically transmit a second event alert to the first IWS, wherein the first IWS establishes a second biosensor-triggered multimedia collaboration that includes the second video data.

4. The system of claim 2, wherein the one or more processors are further configured to electronically transmit a second event alert to the first IWS, wherein the first IWS includes the second video data in the first biosensor-triggered multimedia collaboration.

5. The system of claim 1, wherein the first biosensor-triggered multimedia collaboration comprises a first resource that receives the first video data and has voice communications with a user associated with the first body-worn biosensor.

6. The system of claim 1, wherein to electronically determine using the first biometric signal that the first event occurs, the one or more processors are configured to:

compare the first biometric signal with a trigger threshold to detect that the trigger threshold is satisfied, wherein the trigger threshold comprises a criteria, a parameter, a static rule, or a dynamic rule.

7. The system of claim 6, wherein the trigger threshold further comprises:

a change in a value over time, a rate of change of values over time, correlations with data from a different biosensor sensor, correlations with data from an environmental sensor, correlations with data from a GPS system, a health or a fitness condition of a user associated with the first body-worn biosensor, a condition of other personnel being monitored in proximity to the user, a material rating, a system rating, or a system limit.

8. The system of claim 1, wherein the one or more processors are further configured to electronically transmit an audio or visual message to a user associated with the first body-worn biosensor based on:

the first body-worn biosensor signal, an environmental sensor signal, a third biosensor signal from another biosensor, or a change in a trigger threshold.

9. The system of claim 8, wherein the one or more processors are further configured to receive input from the user via a graphical user interface (GUI), a voice interaction interface, or a gesture recognition interface.

10. The system of claim 1, wherein the first body-worn biosensor signal comprises:

a respiration rate, a heart rate, a blood pressure, a perspiration rate, an oxygen level, a body temperature, a voltaic skin response, a bioelectric activity, an altitude, a pitch, a yaw, a rotation or other angular movement, a position, a force, a location, an acceleration, a deceleration, or a change in any of the above.

11. The system of claim 1, wherein the one or more processors are further configured to receive an environmental condition signal from an environmental sensor in proximity to the first body-worn biosensor comprising:

an ambient temperature, a wind chill, a dew point, a radiation level, a chemical level, a biological agent, a sound, a pressure, a humidity level, a precipitation level, an air pollutant level, a lightning strike, a terrain, an altitude, a location, an air quality level, or a change in any of the above.

12. A system for a first interoperability workstation (IWS) of a first agency, comprising:

one or more processors;

a memory coupled to the one or more processors, wherein the one or more processors are configured to;

electronically receive an event alert, wherein the event alert is determined from a first biometric signal from a body-worn biosensor, wherein the body-worn biosensor is associated with the first IWS;

based on the event alert and rules, establish a biosensor-triggered multimedia collaboration that includes video data from a camera device, wherein the camera device is activated based on the event alert;

electronically receive an event-ceased message, wherein the event-ceased message is based on a determination using a second biometric signal from the body-worn biosensor, that the first event has ceased; and

end the biosensor-triggered multimedia collaboration.

13. The system of claim 12, wherein the biosensor-triggered multimedia collaboration comprises a first resource that receives the video data in real time and has voice communications with a user associated with the body-worn biosensor.

14. The system of claim 12, wherein, the one or more processors are further configured to:

electronically transmit an invitation to the biosensor-triggered multimedia collaboration session to a second IWS of the first agency;

electronically receive an acceptance from the second IWS; and

bridge a second resource under control of the second IWS to the biosensor-triggered multimedia collaboration session, wherein the second resource receives the video data in real time, and has voice communications with a user associated with the body-worn biosensor.

15. The system of claim 12, wherein the one or more processors are further configured to:

electronically transmit an invitation to the biosensor-triggered multimedia collaboration session to a second IWS of a second agency;

electronically receive an acceptance from the second IWS; and

bridge a second resource under control of the second IWS to the biosensor-triggered multimedia collaboration session, wherein the second resource receives the video data in real time, and has voice communications with a user associated with the body-worn biosensor.

16. The system of claim 12, wherein the rules comprise:

a resource'"'"'s geographic proximity to the body-worn biosensor, an identity of a user associated with the body-worn biosensor, a unique user ID associated with a Push to Talk (PTT) Client operating on a mobile phone associated with the user, a radio unit ID associated with the user, a telephone number associated with the user, a department, a working group, a task group, a division, a function, an expertise, a skill, a credential, or a position.

17. A method for a first interoperability workstation (IWS) of a first agency, comprising:

electronically receiving an event alert, wherein the event alert is determined from a first biometric signal from a body-worn biosensor, wherein the body-worn biosensor is associated with the first IWS;

based on the event alert and rules, establishing a biosensor-triggered multimedia collaboration that includes video data from a camera device, wherein the camera device is activated based on the event alert;

electronically receiving an event-ceased message, wherein the event-ceased message is based on a determination using a second biometric signal from the body-worn biosensor, that the first event has ceased; and

ending the biosensor-triggered multimedia collaboration.

18. The method of claim 17, wherein the biosensor-triggered multimedia collaboration comprises a first resource that receives the video data in real time and has voice communications with a user associated with the body-worn biosensor.

19. The method of claim 17, further comprising:

electronically transmitting an invitation to the biosensor-triggered multimedia collaboration session to a second IWS of the first agency;

electronically receiving an acceptance from the second IWS;

bridging a second resource under control of the second IWS to the biosensor-triggered multimedia collaboration session, wherein the second resource receives the video data in real time, and has voice communications with a user associated with the body-worn biosensor.

20. The method of claim 17 further comprising:

electronically transmitting an invitation to the biosensor-triggered multimedia collaboration session to a second IWS of a second agency;

electronically receiving an acceptance from the second IWS; and

bridging a second resource under control of the second IWS to the biosensor-triggered multimedia collaboration session, wherein the second resource receives the video data in real time, and has voice communications with a user associated with the body-worn biosensor.