Multi-site data sharing platform

• US 9,092,556 B2
• Filed: 10/02/2014
• Issued: 07/28/2015
• Est. Priority Date: 03/15/2013
• Status: Active Grant

• Current Assignee: Eagleyemed, Inc.
• Original Assignee: Eagleyemed, Inc.
• Inventors: Hiriyannaiah, Harish P., Amble, Ravi N., Raza, Farooq Mirza Mohammad, Salve, Steven J.
• Primary Examiner(s): BROWN, ANTHONY D
• Application Number:
  US14/505,367
• Publication Number:
  US 20150035959A1
• Time in Patent Office: 299 Days
• Field of Search: 713/189
• US Class Current: 1/1
• CPC Class Codes: A61B 5/0004 characterised by the type of physiological signal transmitted
• CPC Class Codes: A61B 5/0006 ECG or EEG signals
• CPC Class Codes: A61B 5/0008 Temperature signals
• CPC Class Codes: A61B 5/0013 Medical image data A61B1/00011, A61B6/56, A61B8/56 take precedence
• CPC Class Codes: A61B 5/0022 Monitoring a patient using a global network, e.g. telephone networks, internet
• CPC Class Codes: A61B 5/0035 adapted for acquisition of images from more than one imaging mode, e.g. combining MRI and optical tomography
• CPC Class Codes: A61B 5/0077 Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/01 Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue clinical contact thermometers G01K13/20
• CPC Class Codes: A61B 5/02055 Simultaneously evaluating both cardiovascular condition and temperature
• CPC Class Codes: A61B 5/021 Measuring pressure in heart or blood vessels A61B5/0205 takes precedence
• CPC Class Codes: A61B 5/02416 using photoplethysmograph signals, e.g. generated by infrared radiation A61B5/14552 takes precedence
• CPC Class Codes: A61B 5/055 involving electronic [EMR] or nuclear [NMR] magnetic resonance, e.g. magnetic resonance imaging
• CPC Class Codes: A61B 5/08 Detecting, measuring or recording devices for evaluating the respiratory organs A61B5/0205 takes precedence
• CPC Class Codes: A61B 5/14532 for measuring glucose, e.g. by tissue impedance measurement
• CPC Class Codes: A61B 5/14551 for measuring blood gases
• CPC Class Codes: A61B 5/318 Heart-related electrical modalities, e.g. electrocardiography [ECG]
• CPC Class Codes: A61B 5/369 Electroencephalography [EEG] devices for psychotechnics A61B5/16
• CPC Class Codes: A61B 5/7425 Displaying combinations of multiple images regardless of image source, e.g. displaying a reference anatomical image with a live image geometric transforms for image registration G06T3/14; enhancement using image fusion G06T5/50; algorithms for registration of images G06T7/30
• CPC Class Codes: A61B 5/743 Displaying an image simultaneously with additional graphical information, e.g. symbols, charts, function plots
• CPC Class Codes: A61B 5/7475 User input or interface means, e.g. keyboard, pointing device, joystick
• CPC Class Codes: A61B 6/032 : Transmission computed tomography [CT]
• CPC Class Codes: A61B 6/468 : allowing annotation or message recording
• CPC Class Codes: A61B 6/5294 : involving using additional data, e.g. patient information, image labeling, acquisition parameters
• CPC Class Codes: A61B 8/13 : Tomography A61B8/10, A61B8/12 take precedence; tomography for radiation diagnosis A61B6/02
• CPC Class Codes: A61B 8/463 : characterised by displaying multiple images or images and diagnostic data on one display composite display in devices for short-range imaging with acoustic waves G01S7/52074
• CPC Class Codes: A61B 8/468 : allowing annotation or message recording
• CPC Class Codes: A61B 8/5292 : using additional data, e.g. patient information, image labeling, acquisition parameters
• CPC Class Codes: A61B 8/565 : involving data transmission via a network
• CPC Class Codes: G11B 27/11 : by using information not detectable on the record carrier
• CPC Class Codes: G16H 30/20 : for handling medical images, e.g. DICOM, HL7 or PACS
• CPC Class Codes: G16H 30/40 : for processing medical images, e.g. editing
• CPC Class Codes: G16H 40/60 : for the operation of medical equipment or devices
• CPC Class Codes: G16H 40/67 : for remote operation
• CPC Class Codes: H04N 7/183 : for receiving images from a single remote source

Abstract

A variety of methods and arrangements for sharing medical data are described. In one aspect, one or more data streams are received from one or more medical imaging/sensing or other types of devices. Frames are obtained from the streams. In some embodiments, particular frames and/or parts of frames are selectively encrypted. The frames are transmitted to a remote device, where they are rendered and/or displayed at the remote device. In various embodiments, the frames of different streams are synchronized.

Claims

1. A method for sharing medical data in a telemedicine session comprising:

receiving a biometric imaging stream in real time from a medical scanning device at a first telemedicine device that is at a first location on a network;

receiving a data stream in real time at a second telemedicine device that is at a second location on the network that is different from the first location, the data stream being one selected from the group consisting of a video stream received from a video camera and a biometric data stream that is received from a medical sensing device wherein the biometric imaging stream and the data stream are received simultaneously;

obtaining a plurality of biometric imaging frames from the biometric imaging stream as the biometric imaging stream is being received;

obtaining a plurality of data frames from the data stream as the data stream is being received;

inserting timestamps into the biometric imaging and data frames so that they can be rendered synchronously in real time on a remote device;

inserting a first timestamp into one of the biometric imaging frames at the first telemedicine device wherein the first timestamp is obtained at the first telemedicine device using a timing source selected from the group consisting of an NTP server and a GPS satellite;

inserting a second timestamp into one of the data frames at the second telemedicine device wherein the second timestamp is obtained at the second telemedicine device using a timing source selected from the group consisting of an NTP server and a GPS satellite wherein the one of the biometric imaging frames is obtained at the first telemedicine device at approximately the same time as the one of the data frames is obtained at the second telemedicine device, thereby causing the first timestamp to be approximately the same as the second timestamp and helping to ensure that the ones of the biometric imaging and data frames are rendered approximately simultaneously at the remote device; and

transmitting the biometric imaging and data frames in real time to the remote device while the biometric imaging and data streams are being received so that the biometric imaging and data frames can be rendered in substantially real time at the remote device.

2. A method as recited in claim 1 wherein:

the biometric imaging stream is received from a medical scanning device that is being applied to a patient; and

the video stream is received from a video camera that is directed a person using the second telemedicine device.

3. A method as recited in claim 1 further comprising:

receiving the biometric imaging and data frames at the remote device; and

rendering the biometric imaging and data frames in an order based on the timestamps.

4. A method as recited in claim 1, the method further comprising:

partially encrypting the biometric imaging and data frames such that at least a portion of one or more of the frames is not encrypted.

5. A method as recited in claim 4 further comprising:

the encrypting involves at least one selected from the group consisting of (1) encrypting a particular type of frame and not encrypting another type of frame;

(2) encrypting a part of a frame and leaving other parts of the frame;

(3) encrypting at least a portion of a header of a frame;

(4) encrypting a portion of a header of a frame and a portion of media payload in the frame while leaving other parts of the frame unencrypted; and

(5) encrypting only a header and not a media payload of the frame.

6. A method as recited in claim 4 further comprising:

transmitting a message to the remote device indicating which part of each frame is encrypted.

7. A method as recited in claim 1 further comprising:

compressing the biometric imaging stream at a first level of compression; and

compressing the video stream at a second level of compression wherein the first level of compression is substantially less than the second level of compression.

8. A method as recited in claim 1 wherein:

the biometric imaging stream is generated by at least one selected from the group consisting of an ultrasound device, an magnetic resonance imaging (MRI) device, a computed tomography (CT) device and an X-ray device.

9. A method as recited in claim 1 further comprising:

receiving from a user an annotation on a particular biometric imaging frame;

generating an annotation frame from the annotation;

adding an annotation timestamp to the annotation frame and the biometric imaging frame so that when the annotation and biometric imaging frames are reconstructed and rendered at a rendering device, the annotation and the biometric imaging frames are synchronized; and

transmitting the annotation frame and the biometric imaging frame to the rendering device.

10. A method as recited in claim 1 wherein:

the biometric imaging stream is an ultrasound image stream that is generated using an ultrasound probe and that is received in real time; and

the data stream is a video stream that is received in real time from a video camera.

11. A method as recited in claim 1, further comprising:

receiving the biometric imaging frames in real time at the remote device over the network;

receiving the data frames at the remote device over the network wherein the biometric imaging frames and the data frames are received simultaneously as they are being generated and transmitted;

obtaining timestamps from the biometric imaging and data frames;

synchronizing the biometric imaging and data frames based on the timestamps; and

rendering the synchronized biometric imaging and data frames synchronously in real time as the biometric imaging and video frames are received over the network.

12. A method as recited in claim 11 wherein the synchronized frames are rendered in order based on the timestamps.

13. A method as recited in claim 11 further comprising:

receiving from a user an annotation on a particular biometric imaging frame;

generating an annotation frame from the annotation;

associating the annotation frame and the biometric imaging frame with an annotation timestamp;

inserting the annotation timestamp into the annotation frame and the biometric imaging frame so that when the biometric imaging frame and the annotation frame are rendered at a rendering device, the annotation and the biometric imaging frame are synchronized; and

transmitting the biometric imaging and annotation frames to the rendering device.

14. A method as recited in claim 11 wherein:

the medical scanning device is at least one selected from the group consisting of an ultrasound device, a magnetic resonance imaging (MRI) device, a computed tomography (CT) device and an X-ray device.

15. A method as recited in claim 1 further comprising:

selectively encrypting a portion of the biometric imaging frames and leaving another portion of the biometric imaging frames unencrypted.

16. A method as recited in claim 15 wherein:

the selective encryption involves at least one selected from the group consisting of;

(1) encrypting a particular type of frame and not encrypting another type of frame;

(2) encrypting a part of each frame and leaving other parts of the frame unencrypted;

(3) encrypting at least a portion of a header of each frame;

(4) encrypting a portion of a header of each frame and a portion of media payload of the frame while leaving other parts of the frame unencrypted; and

(5) encrypting only a header of each frame and not a media payload of the frame.

17. A method as recited in claim 15 further comprising:

receiving a second data stream from a second medical sensing device at the first location;

obtaining a plurality of second data stream data frames from the second data stream;

selectively encrypting a portion of the second data stream data frames and leaving another portion of the second data stream data frames unencrypted; and

transmitting the second data stream data frames to the remote device wherein;

the second data stream involves multichannel data obtained from the second medical sensing device;

the second medical sensing device is at least one selected from the group consisting of an electrocardiogram device, electroencephalography device, a pulse oximeter device, a thermal/temperature sensor, a blood pressure testing device, a glucose level testing device, and a pulmonary function testing device; and

the selective encryption of the second data stream data frames involves encrypting control information in a header of each second data stream data frame and leaving other parts of the frame unencrypted and wherein the control information indicates at least one selected from the group consisting of channel ID and sampling speed.

18. A method as recited in claim 15 wherein:

the selective encryption of the biometric imaging frames involves encrypting control information in a header of each biometric imaging frame and leaving other parts of the frame unencrypted and wherein the control information indicates at least one selected from the group consisting of (1) number of macroblocks in a portion of the frame;

(2) a quantization table; and

(3) DC coefficient of each of a plurality of macroblocks in the frame.

20. A method as recited in claim 9 where the rendering device is one selected from the group consisting of the first telemedicine device, the second telemedicine device and the remote device.

19. A telemedicine system comprising:

A first telemedicine device at a first location on a network, the first telemedicine device comprising;

a first processor; and

a first memory that stores computer readable instructions, which when executed by the first processor causes the first telemedicine device to;

receive a biometric imaging stream in real time from a medical scanning device;

obtain a plurality of biometric imaging frames from the biometric imaging stream as the biometric imaging stream is being received;

insert timestamps into the biometric imaging frames so that they can be rendered synchronously in real time on a remote device;

insert a first timestamp into one of the biometric imaging frames wherein the first timestamp is obtained at the first telemedicine device using a timing source selected from the group consisting of an NTP server and a GPS satellite; and

transmit the biometric imaging frames in real time to the remote device while the biometric imaging stream is being received so that the biometric imaging frames can be rendered in substantially real time at the remote device; and

A second telemedicine device at a second location on the network, the second telemedicine device comprising;

a second processor; and

a second memory that stores computer readable instructions, which when executed by the second processor causes the second telemedicine device to;

receive a data stream in real time, the data stream being one selected from the group consisting of a video stream received from a video camera and a biometric data stream that is received from a medical sensing device;

obtain a plurality of data frames from the data stream as the data stream is being received;

insert timestamps into the data frames so that they can be rendered synchronously in real time on the remote device;

insert a second timestamp into one of the data frames wherein the second timestamp is obtained at the second telemedicine device using a timing source selected from the group consisting of an NTP server and a GPS satellite and wherein the one of the biometric imaging frames is obtained at the first telemedicine device at approximately the same time as the one of the data frames is obtained at the second telemedicine device, thereby causing the first timestamp to be approximately the same as the second timestamp and helping to ensure that the ones of the biometric imaging and data frames are rendered simultaneously at the remote device; and

transmit the data frames in real time to the remote device while the data stream is being received so that the data frames can be rendered in substantially real time at the remote device.