System and method for biosensor-triggered multimedia collaboration

• US 9,426,433 B1
• Filed: 03/09/2015
• Issued: 08/23/2016
• Est. Priority Date: 03/09/2015
• Status: Active Grant

• Current Assignee: Mutualink, Inc.
• Original Assignee: Mutualink, Inc.
• Inventors: Mazzarella, Joseph R., Wengrovitz, Michael S.
• Primary Examiner(s): Smith, Creighton
• Application Number:
  US14/642,325
• Publication Number:
  US 20160269692A1
• Time in Patent Office: 533 Days
• Field of Search: 348/207.11, 348/211.99
• US Class Current: 1/1
• CPC Class Codes: H04L 65/102 Gateways arrangements for connecting between networks having differing types of switching systems, e.g. gateways, H04L12/66
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04N 5/772 the recording apparatus and the television camera being placed in the same enclosure
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/185 from a mobile camera, e.g. for remote control
• CPC Class Codes: H04N 7/188 Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position signal generation from motion picture films H04N5/253
• CPC Class Codes: H04W 76/50 for emergency connections
• CPC Class Codes: Y04S 40/18 Network protocols supporting networked applications, e.g. including control of end-device applications over a network

Abstract

Embodiments include a system, method, and computer program product for using a biosensor worn by a user to trigger an event and activate a camera worn by the user to begin streaming and/or recording video data. The biosensor trigger also initiates a real time multimedia collaboration session with the user wearing the biosensor and one or more designated parties. Through an interoperability gateway device, a voice communications device of the user is bridged with voice communications devices of the designated parties, and the video data is electronically transmitted to the designated parties. Thus, the designated parties may have real time voice communications among each other and with the user, and the designated parties may also view the video data in real time. Embodiments also determine when an event has ended and deactivates the camera worn by the user.

Claims

1. A system, comprising:

one or more processors; and

a memory,

wherein the one or more processors are configured to;

electronically receive a first biometric signal from a biosensor worn by a user associated with a first personal area network (PAN), wherein the biosensor is associated with a first interoperability workstation (IWS) of a first agency;

electronically determine, using the first biometric signal, that an event occurs;

electronically transmit an activation message to a camera device worn by the user to begin recording and transmitting video data;

electronically transmit an event alert to the first IWS,

wherein based on rules of the first IWS, the first IWS establishes a biosensor-triggered multimedia collaboration session including one or more first resources under control of the first IWS including a voice communication device of the user, and the video data transmitted by the camera device, and

wherein the one or more first resources receive, in real time, the video data transmitted by the camera device via an interoperability gateway device and have voice communications with the user;

electronically receive a second biometric signal from the biosensor;

electronically determine, using the second biometric signal, that the event has ceased; and

electronically transmit a deactivation message to the camera device to cease recording video data.

2. The system of claim 1, wherein based on the rules of the first IWS, the first IWS is further configured to:

electronically transmit an invitation to the biosensor-triggered multimedia collaboration session to a second IWS of the first agency;

electronically receive an acceptance from the second IWS; and

bridge one or more second resources under control of the second IWS to the biosensor-triggered multimedia collaboration session, wherein the one or more second resources receive in real time, the video data transmitted by the camera device via the interoperability gateway device, and have voice communications with the user.

3. The system of claim 1, wherein based on the rules of the first IWS, the first IWS is further configured to:

electronically transmit an invitation to the biosensor-triggered multimedia collaboration session to a second IWS of a second agency;

electronically receive an acceptance from the second IWS; and

bridge one or more second resources under control of the second IWS to the biosensor-triggered multimedia collaboration session, wherein the one or more second resources receive in real time, the video data transmitted by the camera device via the interoperability gateway device, and have voice communications with the user.

4. The system of claim 1, wherein the first IWS is further configured to:

electronically receive a camera deactivated message; and

determine, based on the rules, to end the biosensor-triggered multimedia collaboration session.

5. The system of claim 1, wherein to electronically determine, the one or more processors are configured to:

compare the first biometric signal with a trigger threshold rule comprising at least one of;

a criteria, a parameter, a static rule, or a dynamic rule to detect that the trigger threshold rule is exceeded.

6. The system of claim 5, wherein the trigger threshold rule further comprises at least one of:

a change in a value over time, a rate of change of values over time, correlations with data from a different biosensor, correlations with data from an environmental sensor, correlations with data from a GPS system, a health or a fitness condition of the user, a condition of other, personnel being monitored in proximity to the user, a material rating, a system rating, or a system limit.

7. The system of claim 5, wherein the one or more processors are further configured to electronically transmit an audio or visual message to the user based on at least one of:

the first biometric signal, an environmental sensor signal, a biosensor signal from another biosensor, or a change in the trigger threshold rule.

8. The system of claim 7, wherein the one or more processors are further configured to receive input from the user via at least one of a graphical user interface (GUI), a voice interaction interface, or a gesture recognition interface.

9. The system of claim 1, wherein the first biometric signal comprises at least one of:

a respiration rate, a heart rate, a blood pressure, a perspiration rate, an oxygen level, a body temperature, a voltaic skin response, a bioelectric activity, an altitude, a pitch, a yaw, a rotation or other angular movement, a position, a force, a location, an acceleration, a deceleration, or a change in any of the above.

10. The system of claim 1, wherein the biosensor is associated with a unique identification based on at least one of:

a biosensor machine address, a serial number, an encryption key, an electronic serial number, a telephone number, an Internet Protocol (IP) address, or a unique identification associated with the user.

11. The system of claim 10, wherein the unique identification associated with the biosensor comprises at least one of:

a name, an agency, a department ID, an employee ID number, an operator number, a team ID, a badge number, or a social security number.

12. The system of claim 1, wherein the rules of the first IWS include parameters comprising at least one of:

a resource'"'"'s geographic proximity to the user, an identity of the user associated with the biosensor, a unique user ID associated with a Push to Talk (PTT) Client operating on a mobile phone associated with the user, a radio unit ID associated with the user, a telephone number associated with the user, a department, a working group, a task group, a division, a function, an expertise, a skill, a credential, or a position.

13. The system of claim 1, wherein the one or more processors are further configured to receive an environmental condition signal from an environmental sensor worn by the user comprising at least one of:

an ambient temperature, a wind chill, a dew point, a radiation level, a chemical level, a biological agent, a sound, a pressure, a humidity level, a precipitation level, an air pollutant level, a lightning strike, a terrain, an altitude, a location, an air quality level, or a change in any of the above.

21. The system of claim 1, wherein the one or more processors are further configured to:

electronically receive and store a trigger threshold rule of a second biosensor worn by a second user associated with a second PAN;

electronically receive a third biometric signal from the second biosensor, wherein the second biosensor is associated with the first IWS;

electronically determine, using the third biometric signal, that a second event occurs;

electronically transmit a second activation message to a second camera device worn by the second user to begin recording and transmitting a second video data;

electronically transmit a second event alert to the first IWS, wherein based on the rules of the first IWS, the first IWS establishes a second biosensor-triggered multimedia collaboration session including the one or more first resources including a second voice communication device of the second user, and the second video data transmitted by the second camera device, and

wherein the one or more first resources receive in real time, the second video data transmitted by the second camera device via the interoperability gateway device and have voice communications with the second user;

electronically receive a fourth biometric signal from the second biosensor;

electronically determine, using the fourth biometric signal, that the second event has ceased; and

electronically transmit a second deactivation message to the second camera device to cease recording the second video data.

22. The system of claim 1, wherein the one or more processors are further configured to:

electronically receive and store a trigger threshold rule of a second biosensor worn by a second user associated with a second PAN;

electronically receive a third biometric signal from the second biosensor, wherein the second biosensor is associated with the first IWS;

electronically determine, using the third biometric signal, that a second event occurs;

electronically transmit a second activation message to a second camera device worn by the second user to begin recording and transmitting a second video data;

electronically transmit a second event alert to the first IWS, wherein based on the rules, the first IWS includes in the established biosensor-triggered multimedia collaboration session, a voice communication device of the second user, and the second video data transmitted by the second camera device, and

wherein the one or more first resources receive in real time, the second video data transmitted by the second camera device via the interoperability gateway device and have voice communications with the second user;

electronically receive a fourth biometric signal from the second biosensor;

electronically determine, using the fourth biometric signal, that the second event has ceased; and

electronically transmit a second deactivation message to the second camera device to cease recording the second video data.

14. A method, comprising:

electronically receiving a first biometric signal from a biosensor worn by a user, wherein the biosensor is associated with a first interoperability workstation (IWS) of a first agency;

electronically determining, using the first biometric signal, that an event occurs;

electronically transmitting an activation message to a camera device worn by the user to begin recording and transmitting video data;

electronically transmitting an event alert to the first IWS,

wherein based on rules of the first IWS, the first IWS establishes a biosensor-triggered multimedia collaboration session including one or more first resources under control of the first IWS including a voice communication device of the user, and the video data transmitted by the camera device, and

wherein the one or more first resources receive in real time, the video data transmitted by the camera device via an interoperability gateway device and have voice communications with the user;

electronically receiving a second biometric signal from the biosensor;

electronically determining, using the second biometric signal, that the event has ceased; and

electronically transmitting a deactivation message to the camera device to cease recording video data.

15. The method of claim 14, wherein based on the rules of the first IWS, the method further comprises:

electronically transmitting an invitation to the biosensor-triggered multimedia collaboration session to a second IWS of the first agency;

electronically receiving an acceptance from the second IWS; and

bridging one or more second resources under control of the second IWS to the biosensor-triggered multimedia collaboration session, wherein the one or more second resources receive in real time, the video data transmitted by the camera device via the interoperability gateway device, and have voice communications with the user.

16. The method of claim 14, wherein based on the rules of the first IWS, the method further comprises:

electronically transmitting an invitation to the biosensor-triggered multimedia collaboration session to a second IWS of a second agency;

electronically receiving an acceptance from the second IWS; and

bridging one or more third resources under control of the second IWS to the biosensor-triggered multimedia collaboration session, wherein the one or more second resources receive in real time, the video data transmitted by the camera device via the interoperability gateway device, and have voice communications with the user.

17. The method of claim 14, further comprising:

electronically receiving a camera deactivated message; and

determining, based on the rules, to end the biosensor-triggered multimedia collaboration session.

18. The method of claim 14, wherein the electronically determining comprises:

comparing the first biometric signal with a trigger threshold rule comprising at least one of;

a criteria, a parameter, a static rule, or a dynamic rule to detect that the trigger threshold rule is exceeded.

19. The method of claim 18, wherein the trigger threshold rule further comprises at least one of:

a change in a value over time, a rate of change over time, a correlation between data from a different biosensor, a correlation between data from an environmental sensor, a health or a fitness condition of the user, a condition of other personnel being monitored in proximity to the user, a material rating, a system rating, or a system limit.

20. The method of claim 18, further comprising electronically transmitting an audio or visual message to the user based on at least one of:

the first biometric signal, an environmental sensor signal, a biosensor signal from another biosensor, or a change in the trigger threshold rule.