Apparatus, method and computer readable medium for tracking data and events
First Claim
1. A method of integrating data from a plurality of devices, the method comprising:
- receiving, in real-time, first data from a first device, which records, as video data, values depicted on a monitoring display of a first medical equipment;
receiving, in real-time, second data from a second device, the second device being a second type of device different from a first type of the first device;
determining, by a computer, a first type of the first data and a second type of the second data;
generating additional data based on the first type of the first data and the second type of the second data, wherein the additional data comprises searchable metadata specific for each of the first type of the first data and the second type of the second data and a trigger based on a first value in the first data exceeding a first predetermined threshold and a second value in the second data exceeding a second predetermined threshold, occurring at substantially same time,wherein the second device is a second medical equipment that gathers vital signs of a patient or a simulator of the patient in a metric format,wherein the trigger is based on at least one value comprising the first value extracted from the video data and the second value indicating the vital signs of the patient,wherein at least one of the first device and the second device is controlled to perform an action based on the trigger; and
converting the first data into a text format by;
recognizing at least one indicator by performing, in real-time, an optical character recognition on the at least one indicator displayed on the monitoring display of the first medical equipment, wherein the at least one indicator is displayed adjacent to data values and wherein each of the at least one indicator indicates a type of the data values,determining the type of the data values based on the at least one indicator corresponding to the data values, andrecognizing the data values by performing the optical character recognition on the data values corresponding to the at least one indicator,wherein the trigger is selected from among a plurality of triggers based on the type of the data values and wherein the data values are compared to the trigger to detect an event, andwherein the event indicates a medical condition occurring in the patient or the simulator of the patient.
1 Assignment
0 Petitions
Accused Products
Abstract
A methods, an apparatus, a computer-readable medium, and a system for integrating data from a plurality of devices. The first data is received from a first device and the second data is received from a second device, which is a different type of device than the first device. Type of data is determined and additional data is generated based on the determined type of data received from these different devices. The additional data includes searchable metadata and/or one or more triggers based on a combination of the first and second received data. Accordingly, searchable metadata for recordings and metric values from various devices used in a session are generated. Additionally, annotations may be provided to emphasize the occurrence of triggering events.
12 Citations
22 Claims
-
1. A method of integrating data from a plurality of devices, the method comprising:
-
receiving, in real-time, first data from a first device, which records, as video data, values depicted on a monitoring display of a first medical equipment; receiving, in real-time, second data from a second device, the second device being a second type of device different from a first type of the first device; determining, by a computer, a first type of the first data and a second type of the second data; generating additional data based on the first type of the first data and the second type of the second data, wherein the additional data comprises searchable metadata specific for each of the first type of the first data and the second type of the second data and a trigger based on a first value in the first data exceeding a first predetermined threshold and a second value in the second data exceeding a second predetermined threshold, occurring at substantially same time, wherein the second device is a second medical equipment that gathers vital signs of a patient or a simulator of the patient in a metric format, wherein the trigger is based on at least one value comprising the first value extracted from the video data and the second value indicating the vital signs of the patient, wherein at least one of the first device and the second device is controlled to perform an action based on the trigger; and converting the first data into a text format by; recognizing at least one indicator by performing, in real-time, an optical character recognition on the at least one indicator displayed on the monitoring display of the first medical equipment, wherein the at least one indicator is displayed adjacent to data values and wherein each of the at least one indicator indicates a type of the data values, determining the type of the data values based on the at least one indicator corresponding to the data values, and recognizing the data values by performing the optical character recognition on the data values corresponding to the at least one indicator, wherein the trigger is selected from among a plurality of triggers based on the type of the data values and wherein the data values are compared to the trigger to detect an event, and wherein the event indicates a medical condition occurring in the patient or the simulator of the patient. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. An apparatus configured to integrate data generated by a plurality of different devices, the apparatus comprising:
-
a processor; and a memory configured to store instructions, which when executed by the processor cause the processor to control the apparatus to perform; receiving, in real-time, first data from a first device, which records, as video data, values depicted on a monitoring display of a first medical equipment; receiving, in real-time, second data from a second device, the second device being a second type of device different from a first type of the first device; determining a first type of the first data and a second type of the second data; generating additional data based on the first type of the first data and the second type of the second data, wherein the additional data comprises searchable metadata specific for each of the first type of the first data and the second type of the second data and a trigger based on a first value in the first data exceeding a first predetermined threshold and a second value in the second data exceeding a second predetermined threshold, occurring at substantially same time; and controlling at least one of the first device and the second device to perform an action based on the trigger, wherein the first value is extracted from the video data and the second value indicates vital signs of a patient or a simulator of the patient, and wherein the second device is a second medical equipment that gathers the vital signs of the patient or the simulator of the patient in a metric format, and wherein the instructions further comprise; recognizing at least one indicator by performing, in real-time, an optical character recognition on the at least one indicator displayed on the monitoring display of the first medical equipment, wherein the at least one indicator is displayed adjacent to data values displayed on a display and wherein each of the at least one indicator indicates a type of the data values; determining the type of the data values based on the at least one indicator corresponding to the data values; continuously converting, in real time, the data values adjacent to the at least one indicator; selecting a sub-trigger from among a plurality of triggers based on the type of the data values; and comparing the sub-trigger to each of the data values to determine an occurrence of an event. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17, 18, 19)
-
-
20. A non-transitory computer readable medium storing instructions when executed by a computer cause the computer to perform:
-
receiving, in real-time, first data from a first device, which records, as video data, values depicted on a monitoring display of a first medical equipment; receiving, in real-time, second data from a second device, the second device being a second type of device different from a first type of the first device; determining, by the computer, a first type of the first data and a second type of the second data; generating additional data based on the first type of the first data and the second type of the second data, wherein the additional data comprises searchable metadata specific for each of the first type of the first data and the second type of the second data and a trigger based on a first value in the first data exceeding a first predetermined threshold and a second value in the second data exceeding a second predetermined threshold, at substantially same time; and controlling at least one of the first device and the second device to perform an action based on the trigger, wherein the second device is a second medical equipment that gathers vital signs of a patient or a simulator of the patient in a metric format, wherein the trigger is based on at least one value comprising the first value extracted from the video data and the second value indicating the vital signs of the patient; and converting the first data into a text format by; recognizing at least one indicator by performing, in real-time, an optical character recognition on the at least one indicator displayed on the monitoring display of the first medical equipment, wherein the at least one indicator is displayed adjacent to data values and wherein each of the at least one indicator indicates a type of the data values, determining the type of the data values based on the at least one indicator corresponding to the data values, and recognizing the data values by performing the optical character recognition on the data values corresponding to the at least one indicator, wherein the trigger is selected from among a plurality of triggers based on the type of the data values and wherein the data values are compared to the trigger to detect an event, and wherein the event indicates a medical condition occurring in the patient or the simulator of the patient.
-
-
21. A system for processing data from a plurality of devices, the system comprising:
-
at least one medical monitoring equipment configured to monitor metric output from at least one of;
an object and a human, during a session;at least one audio or video recorder configured to record the at least one of the object and the human, during the session; and a server comprising at least one processor and a memory, the server configured to; receive first data from the at least one medical monitoring equipment and second data from the at least one audio or video recorder, determine a type of an apparatus based on the first data and the second data, generate additional data based on the type of the apparatus, wherein the additional data comprises metadata specific to the type of the apparatus and a trigger comprising a first sub-trigger which is based on a first value of the first data received from the at least one medical monitoring equipment exceeding a first threshold value and a second sub-trigger based on a second value of the second data from the at least one audio and video recorder exceeding a second predetermined threshold, and setting, by the server, a plurality of different actions for the trigger, wherein the first sub-trigger triggers a first recording of first values of the first data received from the at least one medical monitoring equipment for a first duration and the second sub-trigger triggers a second recording of second values of the second data received from the at least one audio and video recorder for a second duration, wherein the first duration is different from the second duration, wherein the first recording and the second recording are combined to generate a single recording or a single event, wherein the plurality of different actions comprise different durations of recording the first data of the at least one medical monitoring equipment from the second data of the at least one audio or video recorder, wherein the plurality of different actions comprises obtaining a past recording, which is prior to occurrence of the trigger, for at least one of the at least one medical monitoring equipment and the at least one audio or video recorder and combining with a current recording of the first data and the second data, and wherein the trigger is generated, on the fly, based on continuously receiving the first data and the second data, in real-time. - View Dependent Claims (22)
-
Specification