APPARATUS, METHOD AND COMPUTER READABLE MEDIUM FOR TRACKING DATA AND EVENTS

• US 20140222805A1
• Filed: 02/03/2014
• Published: 08/07/2014
• Est. Priority Date: 02/01/2013
• Status: Active Grant

• Current Assignee: B-Line Medical, LLC
• Original Assignee: B-Line Medical, LLC
• Inventors: HUANG, Lucas K., KAZOUN, Chafic A., KROPP, Anton D., NEFF, Samuel R., RAMSAY, David A.
• Granted Patent: US 10,692,591 B2
• Time in Patent Office: Days
• US Class Current: 707/732
• CPC Class Codes: G06F 16/90335 Query processing
• CPC Class Codes: G16H 10/60 for patient-specific data, e.g. for electronic patient records

Abstract

A methods, an apparatus, a computer-readable medium, and a system for integrating data from a plurality of devices. The first data is received from a first device and the second data is received from a second device, which is a different type of device than the first device. Type of data is determined and additional data is generated based on the determined type of data received from these different devices. The additional data includes searchable metadata and/or one or more triggers based on a combination of the first and second received data. Accordingly, searchable metadata for recordings and metric values from various devices used in a session are generated. Additionally, annotations may be provided to emphasize the occurrence of triggering events.

Claims

1. A method of integrating data from a plurality of devices, the method comprising:

receiving first data from a first device;

receiving second data from a second device different type of device with respect to the first device;

determining, by a computer, type of the first received data and the second received data; and

generating additional data based on the determined type of the first and second received data,

wherein the additional data comprises at least one of searchable metadata and a trigger based on a combination of the first and second received data.

2. The method of claim 1, wherein the first device and the second device are equipment that gather data in at least one of a text format, an image format, an audio format, and a video format.

3. The method of claim 1, wherein the first device and the second device are equipment utilized in a medical procedure or a simulation session of a medical procedure and wherein the first device and the second device monitor output from at least one of:

a patient, a simulator of a patient, a medical personnel, and a learner.

4. The method of claim 1, wherein the generating of the additional data based on the determined type of the first received data and the second received data comprises:

extracting information from the first received data;

generating fields for the searchable metadata based on a predefined criteria; and

storing in a memory the generated metadata fields along with a location of the first received data,

wherein different metadata fields are generated based on a type of a device such that different metadata fields are generated for the first device and the second device, and

wherein the predefined criteria comprises a structured rule set comprising metadata fields to be generated for each device type.

5. The method of claim 4, wherein the first received data and the second received data are displayed data and wherein the displayed data is converted to determine type of the device.

6. The method of claim 5, wherein the converting of the displayed data comprises performing optical character recognition on indicators of a device displayed adjacent to the selected displayed data and wherein the device types comprise audio/video recorders and medical equipment that monitors a condition of a patient or a simulator.

7. The method of claim 1, further comprising:

receiving a user-defined search query;

searching data comprising the first data and the second data based on the generated additional data and the user-defined search query;

extracting at least one of the first data and the second data based on whether the generated additional data matches the user-defined search query; and

generating search results by combining the extracted data; and

outputting the generated search results.

8. The method of claim 7, wherein the user-defined search query comprises at least one value for data from a plurality of devices and at least one specified duration of a recording.

9. The method of claim 8, wherein the at least one specified duration of the recording comprises at least one of:

duration of the recording after an occurrence of an event, duration of a past recording to be integrated with the recording and wherein the event occurs if the data matches the value defined in the search query.

10. The method of claim 7, further comprising:

automatically generating annotations in the data based on the user-defined search query; and

outputting the search results with the generated annotations,

wherein the generated annotations indicate points in the data where the user-specified criteria is met.

11. The method of claim 10, wherein the outputting the search results comprises a user interface which outputs a recording of a session or a clip of the session provided in the search results synchronously with metric values from at least two different types of sources, wherein the metric values are output in a form of a graph, and wherein the generated annotations are provided for each of the recording and the metric values from the at least two different types of the sources.

12. An apparatus configured to integrate data generated by a plurality of different devices, the apparatus comprising:

a processor configured to execute instructions; and

a memory configured to store the instructions, which comprise;

receiving first data from a first device;

receiving second data from a second device different type of device with respect to the first device;

determining type of the first received data and the second received data; and

generating additional data based on the determined type of the first received data and the second received data,

wherein the additional data comprises at least one of searchable metadata and a trigger based on a combination of the first received data and the second received data.

13. The apparatus of claim 12, wherein the first device and the second device are equipment that gather data in at least one of a text format, an image format, an audio format, and a video format.

14. The apparatus of claim 12, wherein the first device and the second device are equipment utilized in a medical procedure or a simulation session of a medical procedure and wherein the first device and the second device monitor output from at least one of:

a patient, a simulator of a patient, a medical personnel, and a learner.

15. The apparatus of claim 12, wherein the instruction of said generating the additional data based on the determined type of the first received data and the second received data comprises:

extracting information from the first received data;

generating fields for the searchable metadata based on a predefined criteria; and

storing in a memory the generated metadata fields along with a location of the first received data,

wherein different metadata fields are generated based on a type of a device such that different metadata fields are generated for the first device and the second device, and

wherein the predefined criteria comprises a structured rule set comprising metadata fields to be generated for each device type.

16. The apparatus of claim 15, wherein the first received data and the second received data are displayed data and wherein the displayed data is converted to determine type of the device.

17. The apparatus of claim 16, wherein the processor converts the displayed data comprises performing optical character recognition on indicators of a device displayed adjacent to the selected displayed data and wherein the device types comprise audio/video recorders and medical equipment that monitors a condition of a patient or a simulator.

18. The apparatus of claim 12, wherein the instructions further comprise:

receiving a user-defined search query;

searching data comprising the first data and the second data based on the generated additional data and the user-defined search query;

extracting at least one of the first data and the second data based on whether the generated additional data matches the user-defined search query; and

generating search results by combining the extracted data; and

outputting the generated search results.

19. The apparatus of claim 18, wherein the user-defined search query comprises at least one value for data from a plurality of devices and at least one specified duration of a recording.

20. The apparatus of claim 19, wherein the at least one specified duration of the recording comprises at least one of:

duration of the recording after an occurrence of an event, duration of a past recording to be integrated with the recording and wherein the event occurs if the data matches the value defined in the search query.

21. The apparatus of claim 18, wherein the instructions further comprise:

automatically generating annotations in the data based on the user-defined search query; and

outputting the search results with the generated annotations,

wherein the generated annotations indicate points in the data where the user-specified criteria is met.

22. The apparatus of claim 21, wherein the outputting the search results comprises a user interface which outputs a recording of a session or a clip of the session provided in the search results synchronously with metric values from at least two different types of monitoring sources, wherein the metric values are output in a form of a graph, and wherein the generated annotations are provided for each of the recording and the metric values from the at least two different types of the monitoring sources.

23. A non-transitory computer readable medium storing instructions when executed by a computer cause a computer to perform the following operations:

receiving first data from a first device;

receiving second data from a second device different type of device with respect to the first device;

determining by a computer type of the first received data and the second received data;

generating additional data based on the determined type of the first received data and the second received data,

wherein the additional data comprises at least one of searchable metadata and a trigger based on a combination of the first received data and the second received data.

24. A system for processing data from a plurality of devices, the system comprising:

at least one monitoring equipment configured to monitor output from at least one of an object and a human during a session;

at least one audio or video recorder configured to record the at least one of the object and the human during the session; and

a server comprising at least one processor and a memory, the server configured to receive data from the at least one monitoring equipment and the at least one audio or video recorder, determine type of an apparatus based on the received data, and generate additional data based on the determined type of the apparatus.