Biosensor-triggered multimedia collaboration

• US 10,404,942 B2
• Filed: 07/30/2018
• Issued: 09/03/2019
• Est. Priority Date: 03/09/2015
• Status: Active Grant

• Current Assignee: Mutualink, Inc.
• Original Assignee: Mutualink, Inc.
• Inventors: Mazzarella, Joseph R., Wengrovitz, Michael S.
• Primary Examiner(s): Ramakrishnaiah, Melur
• Application Number:
  US16/049,590
• Publication Number:
  US 20180338115A1
• Time in Patent Office: 400 Days
• Field of Search: 348 1401- 1416, 379 37, 379 45
• CPC Class Codes: H04L 65/102 Gateways arrangements for connecting between networks having differing types of switching systems, e.g. gateways, H04L12/66
• CPC Class Codes: H04L 65/403 Arrangements for multi-party communication, e.g. for conferences data switching systems for conference H04L12/18; arrangements for connecting several subscribers to a common circuit, i.e. affording conference facilities H04M3/56; television conferencing systems H04N7/15
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04N 5/772 the recording apparatus and the television camera being placed in the same enclosure
• CPC Class Codes: H04N 7/147 Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals selecting H04Q
• CPC Class Codes: H04N 7/185 from a mobile camera, e.g. for remote control
• CPC Class Codes: H04N 7/188 Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position signal generation from motion picture films H04N5/253
• CPC Class Codes: H04W 76/50 for emergency connections
• CPC Class Codes: Y04S 40/18 Network protocols supporting networked applications, e.g. including control of end-device applications over a network

Abstract

Embodiments include a computer program product for using a biosensor worn by a user to trigger an event and activate a camera worn by the user to begin streaming and/or recording video data. The biosensor trigger also initiates a real time multimedia collaboration session with the user wearing the biosensor and one or more designated parties. Through an interoperability gateway device, a voice communications device of the user is bridged with voice communications devices of the designated parties, and the video data is electronically transmitted to the designated parties. Thus, the designated parties may have real time voice communications among each other and with the user, and the designated parties may also view the video data in real time. Embodiments also determine when an event has ended and deactivates the camera worn by the user.

Claims

1. A non-transitory computer-readable medium storing instructions that, when executed by a processor of a first electronic device, cause the processor to perform operations, the operations comprising:

electronically receiving a first biometric signal from a biosensor worn by a user, wherein the biosensor is associated with a first interoperability workstation (IWS);

electronically determining, using the first biometric signal, that a first event occurs;

electronically transmitting an activation message to a camera device worn by the user to begin recording and transmitting video data;

electronically transmitting a first event alert to the first IWS, wherein based on rules of the first IWS, the first IWS establishes a biosensor-triggered multimedia collaboration session including one or more first resources under control of the first IWS including the video data transmitted;

electronically receiving a second biometric signal from the biosensor;

electronically determining, using the second biometric signal, that the first event has ceased; and

electronically transmitting an event-ended message to the first IWS.

2. The non-transitory computer-readable medium of claim 1, wherein the operations further comprise:

electronically receiving a third biometric signal from a second biosensor, wherein the second biosensor is associated with a different user than that associated with the first body-worn biosensor;

electronically determining using the third biometric signal that a second event occurs; and

electronically transmitting an activation message to a second camera device in proximity to the second biosensor to begin recording and transmitting second video data.

3. The non-transitory computer-readable medium of claim 2, wherein the operations further comprise electronically transmitting a second event alert to the first IWS, wherein the first IWS establishes a second biosensor-triggered multimedia collaboration that includes the second video data.

4. The non-transitory computer-readable medium of claim 2, wherein the operations further comprise electronically transmitting a second event alert to the first IWS, wherein the first IWS includes the second video data in the first biosensor-triggered multimedia collaboration.

5. The non-transitory computer-readable medium of claim 1, wherein the first biosensor-triggered multimedia collaboration comprises a first resource that receives the first video data and has voice communications with a user associated with the first body-worn biosensor.

6. The non-transitory computer-readable medium of claim 1, wherein the electronically determining, using the first biometric signal, that the first event occurs operation comprises comparing the first biometric signal with a trigger threshold to detect that the trigger threshold is satisfied, wherein the trigger threshold comprises a criteria, a parameter, a static rule, or a dynamic rule.

7. The non-transitory computer-readable medium of claim 6, wherein the trigger threshold further comprises:

a change in a value over time, a rate of change of values over time, correlations with data from a different biosensor sensor, correlations with data from an environmental sensor, correlations with data from a GPS system, a health or a fitness condition of a user associated with the first body-worn biosensor, a condition of other personnel being monitored in proximity to the user, a material rating, a system rating, or a system limit.

8. The non-transitory computer-readable medium of claim 1, wherein the operations further comprise electronically transmitting an audio or visual message to a user associated with the first body-worn biosensor based on:

the first biometric signal, an environmental sensor signal, a third biometric signal from another biosensor, or a change in a trigger threshold.

9. The non-transitory computer-readable medium of claim 8, wherein the operations further comprise receiving input from the user via a graphical user interface (GUI), a voice interaction interface, or a gesture recognition interface.

10. The non-transitory computer-readable medium of claim 1, wherein the first biometric signal comprises:

a respiration rate, a heart rate, a blood pressure, a perspiration rate, an oxygen level, a body temperature, a voltaic skin response, a bioelectric activity, an altitude, a pitch, a yaw, a rotation or other angular movement, a position, a force, a location, an acceleration, a deceleration, or a change in any of the above.

11. The non-transitory computer-readable medium of claim 1, wherein the operations further comprise receiving an environmental condition signal from an environmental sensor in proximity to the first body-worn biosensor comprising:

an ambient temperature, a wind chill, a dew point, a radiation level, a chemical level, a biological agent, a sound, a pressure, a humidity level, a precipitation level, an air pollutant level, a lightning strike, a terrain, an altitude, a location, an air quality level, or a change in any of the above.

12. The non-transitory computer-readable medium of claim 1, wherein the operations further comprise electronically transmitting a deactivation message to the camera device to cease recording video data.

13. A method, comprising:

electronically receiving a first biometric signal from a biosensor worn by a user, wherein the biosensor is associated with a first interoperability workstation (IWS);

electronically determining, using the first biometric signal, that a first event occurs;

electronically transmitting an activation message to a camera device worn by the user to begin recording and transmitting video data;

electronically transmitting a first event alert to the first IWS, wherein based on rules of the first IWS, the first IWS establishes a biosensor-triggered multimedia collaboration session including the video data transmitted;

electronically receiving a second biometric signal from the biosensor;

electronically determining, using the second biometric signal, that the first event has ceased; and

electronically transmitting an event-ended message.

14. The method of claim 13, further comprising electronically transmitting a deactivation message to the camera device to cease recording video data.

15. The method of claim 13, further comprising:

electronically receiving a third biometric signal from a second biosensor, wherein the second biosensor is associated with a different user than that associated with the first body-worn biosensor;

electronically determining using the third biometric signal that a second event occurs; and

electronically transmitting an activation message to a second camera device in proximity to the second biosensor to begin recording and transmitting second video data.

16. The method of claim 15, further comprising electronically transmitting a second event alert to the first IWS, wherein the first IWS establishes a second biosensor-triggered multimedia collaboration that includes the second video data.

17. The method of claim 15, further comprising electronically transmitting a second event alert to the first IWS, wherein the first IWS includes the second video data in the first biosensor-triggered multimedia collaboration.

18. A non-transitory computer-readable medium storing instructions that, when executed by a processor of a first electronic device, cause the processor to perform operations for a first interoperability workstation (IWS), the operations comprising:

electronically receiving an event alert, wherein the event alert is determined from a first biometric signal from a body-worn biosensor, wherein the body-worn biosensor is associated with the first IWS;

based on the event alert, establishing a biosensor-triggered multimedia collaboration that includes video data from a camera device, wherein the camera device is activated based on the event alert;

electronically receiving an event-ceased message, wherein the event-ceased message is based on a determination using a second biometric signal from the body-worn biosensor, that the first event has ceased; and

determining whether to end the biosensor-triggered multimedia collaboration.

19. The non-transitory computer-readable medium of claim 18, wherein the operations further comprise:

electronically transmitting an invitation to the biosensor-triggered multimedia collaboration to a second IWS;

electronically receiving an acceptance from the second IWS; and

bridging a second resource under control of the second IWS to the biosensor-triggered multimedia collaboration, wherein the second resource receives the video data in real time, and has voice communications with a user associated with the body-worn biosensor.

20. A system comprising:

one or more processors;

a memory coupled to the one or more processors, wherein the one or more processors are configured to;

electronically receive a first biometric signal from a biosensor worn by a user, wherein the biosensor is associated with a first processing device;

electronically determine, using the first biometric signal, that a first event occurs;

electronically transmit an activation message to a camera device worn by the user to begin recording and transmitting video data;

electronically transmit a first event alert to the first processing device, wherein based on rules of the first processing device, the first processing device establishes a biosensor-triggered multimedia collaboration session including one or more first resources under control of the first processing device including the video data transmitted;

electronically receive a second biometric signal from the biosensor;

electronically determine, using the second biometric signal, that the first event has ceased; and

electronically transmit an event-ended message-to the first-processing device.