Visual indexing system for medical diagnostic data

• US 9,129,361 B2
• Filed: 11/28/2011
• Issued: 09/08/2015
• Est. Priority Date: 05/24/2011
• Status: Active Grant

• Current Assignee: Jianguo Zhang, Jianyong Sun, Weiling Zheng, Wenjie Dong
• Original Assignee: Jianguo Zhang, Jianyong Sun, Weiling Zheng, Wenjie Dong
• Inventors: Zhang, Jianguo, Dong, Wenjie, Zheng, Weiling, Sun, Jianyong
• Primary Examiner(s): Chen, Wenpeng
• Application Number:
  US13/816,660
• Publication Number:
  US 20130294664A1
• Time in Patent Office: 1,380 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: A61B 5/0013 Medical image data A61B1/00011, A61B6/56, A61B8/56 take precedence
• CPC Class Codes: A61B 6/468 allowing annotation or message recording
• CPC Class Codes: A61B 6/56 Details of data transmission or power supply, e.g. use of slip rings
• CPC Class Codes: G06T 7/0012 Biomedical image inspection
• CPC Class Codes: G16H 10/60 for patient-specific data, e.g. for electronic patient records
• CPC Class Codes: G16H 30/20 for handling medical images, e.g. DICOM, HL7 or PACS
• CPC Class Codes: G16H 30/40 for processing medical images, e.g. editing

Abstract

The present invention is a system and method for visually indexing medical data about a patient by generating an image for presentation to a user depicting a subset of the patient'"'"'s body parts, with body parts having associated diagnostic data highlighted. A user may then select a highlighted body part and be presented with some or all of the associated diagnostic data. The user may manipulate the presented image, which is derived from a three dimensional model, to rotate it or zoom is to expose more body parts, or more detailed body parts depicting child body parts associated with the diagnostic data. The system or method may employ a patient index comprising a hierarchical graph with nodes corresponding to body parts and associated with diagnostic data for those body parts.

Claims

1. A medical data indexing system comprising:

(a) a programmable computer processor;

(b) a non-transitory computer-readable memory accessible by the computer processor;

(c) software stored in the computer-readable memory, wherein when the software is executed by the computer processor, the software causes the computer processor to;

(i) retrieve from one or more medical information systems, each medical information system being separate and distinct from, and designed and developed separately from, the medical data indexing system, via a computer network, electronic patient records for a plurality of patients, each patient having a set of body parts, the patient record for each patient comprising (1) a specification of one or more target body parts having diagnostic data associated therewith stored in one of the medical information systems, one or more of the target body parts being an affected target body part, each of whose associated diagnostic data indicates the existence of a medical condition associated with the affected target body part, and (2) the diagnostic data associated with each of the target body parts;

(ii) analyze the patient records to determine which body parts are the target body parts;

(iii) analyze the diagnostic data to determine which body parts are the affected target body parts and to identify the indicated medical conditions;

(iv) for a specified patient, generate an index image depicting a set of the patient'"'"'s body parts, including one or more internal body parts, and, if one or more of the target body parts identified by the medical data indexing system'"'"'s analysis of one of the patient records retrieved over the computer network from one of the medical information systems are depicted in the index image, automatically highlight the depicted target body parts in the index image, and if one or more affected target body parts are depicted in the index image then, for each depicted affected target body part, automatically highlight the depicted affected target body part in a manner differentiating it from other body parts;

(v) receive a data retrieval request from a requestor, the request specifying a patient, and provide the index image for the specified patient to the requestor; and

(vi) if one or more target body parts are highlighted in the index image, and the requestor selects one of the highlighted target body parts, provide some or all of the diagnostic data associated with the selected target body part to the requestor.

2. The medical data indexing system of claim 1 wherein the patient records for at least one patient are retrieved from at least two medical information systems via the computer network and combined by the medical data indexing system.

3. The medical data indexing system of claim 2, wherein the index image is derived from a three dimensional model of a body.

4. The medical data indexing system of claim 3, wherein the system allows the requestor to request rotation of the body depicted in the index image, the system modifies the index image to reflect the requested rotation, and the system provides the modified index image to the requestor.

5. The medical data indexing system of claim 2 wherein the patient records for one patient are retrieved from at least two picture archiving and communication systems.

6. The medical data indexing system of claim 1 wherein the patient'"'"'s body parts are depicted in the index image in relative positions corresponding to the relative positions of the body parts in the patient.

7. The medical data indexing system of claim 1, wherein (a) the index image depicts one or more target body parts, (b) the system allows the requestor to request zooming of the index image to depict one or more of the target body parts so that they occupy a larger area in the zoomed index image than in the index image and so that they are shown with greater detail, (c) the system zooms the index image accordingly, and (d) the system provides the zoomed index image to the requestor.

8. The medical data indexing system of claim 7, wherein one or more of the target body parts comprise child body parts, and the highlighting of each target body part in the zoomed index image is limited to the one or more child body parts of the target body part that are associated with the diagnostic data.

9. The medical data indexing system of claim 1, wherein the specification of a target body part retrieved over the computer network from one of the medical information systems comprises one or more words and the software further causes the computer processor to analyze the words in the patient record to automatically determine the target body part.

10. The medical data indexing system of claim 9, wherein the analysis of the diagnostic data is done using natural language processing.

11. The medical data indexing system of claim 1, wherein at least one target body part is depicted and automatically highlighted in the index image.

12. The medical data indexing system of claim 1, wherein the patient record further comprises one or more diagnostic data record specifications for each target body part that specify the type of associated diagnostic data that is available, and the software further causes the computer processor to provide some or all of the diagnostic data record specifications for one of the target body parts to the requestor if the requestor selects that target body part.

13. The medical data indexing system of claim 12, wherein the medical information system comprises a picture archiving and communication system, one or more of the diagnostic data record specifications further comprise one or more diagnostic image identifiers associated with one or more of the target body parts, each diagnostic image identifier uniquely identifying a diagnostic image stored by the picture archiving and communication system, and, if the requestor selects a diagnostic data record specification that includes one or more diagnostic image identifiers, the system provides the requestor with the option of receiving one or more of the diagnostic images identified by one or more of the diagnostic image identifiers.

14. The medical data indexing system of claim 12, wherein the medical information system comprises a laboratory information system, one or more of the diagnostic data record specifications comprises one or more lab report identifiers, and, if the requestor selects a diagnostic data record specification that includes one or more lab report identifiers, the system provides the requestor with the option of receiving one or more of the lab reports identified by one or more of the lab report identifiers.

15. The medical indexing system of claim 1, wherein, when one of the affected target body parts is selected by the requester, the system provides the requestor with a portion of the associated diagnostic data that contains information used by the software to determine the medical condition.

16. The medical data indexing system of claim 1, wherein, for each target body part, the software further causes the computer processor to analyze the diagnostic data associated with the target body part to determine a status of the target body part specifying whether, for that target body part, (a) a medical condition exists, (b) a medical condition does not exist, or (c) the software cannot determine whether a medical condition exists, and wherein each target body part depicted in the index image is automatically highlighted in a manner differentiating whether the target body part'"'"'s status is (a), (b) or (c).

17. The medical data indexing system of claim 1, wherein the patient is human, the patient record includes the patient'"'"'s gender, and the generated index image is based on a three dimensional model of either a man'"'"'s body or a woman'"'"'s body, corresponding to the patient'"'"'s gender.

18. The medical data indexing system of claim 1, wherein the patient record, including all available diagnostic data, is retrieved from the medical information systems immediately after the requestor requests data for the patient.

19. The medical data indexing system of claim 1, wherein the requester is a user, providing the index image comprises displaying the index image to the user, the user selects a body part using a mouse or touch screen, and providing the associated diagnostic data comprises displaying some or all of the associated diagnostic data.

20. The medical data indexing system of claim 1, wherein the requester is a client computer process, providing the index image comprises sending the index image or a pointer to the index image to the client, the client selects a body part by sending a message to the system specifying the body part, and providing the associated diagnostic data comprises sending the associated diagnostic data or a pointer to the associated diagnostic data to the client.

21. The medical data indexing system of claim 1, wherein the patient record provided by the medical data indexing systems comprises a directed acyclic graph having nodes and edges, wherein the nodes correspond to pre-defined body part identifiers, the edges connect nodes that share a parent-child relationship, and each node corresponding to one of the target data parts is associated with the diagnostic data for that target data part.

22. The medical data indexing system of claim 1 wherein none of the diagnostic data associated with the target body parts is provided to the medical information system storing the diagnostic data by the medical data indexing system, and the medical information system storing the diagnostic data is not part of the medical data indexing system.

23. A medical data indexing system comprising a patient indexing server comprising:

(a) a programmable computer processor;

(b) a non-transitory computer-readable memory accessible by the computer processor;

(c) software stored in the computer-readable memory, wherein when the software is executed by the computer processor, the software causes the computer processor to;

(i) obtain electronic patient records for a plurality of patients via a computer network, each patient having a set of body parts, from one or more medical information systems, each medical information system being separate and distinct from, and designed and developed separately from, the medical data indexing system, the patient record for each patient comprising (1) a specification of one or more target body parts having diagnostic data associated therewith stored in one of the medical information systems, one or more of the target body parts being an affected target body part, each of whose associated diagnostic data indicates the existence of a medical condition associated with the affected target body part, and (2) the diagnostic data for each target body part, wherein one or more of the target body parts are internal body parts;

(ii) analyze the patient records to determine which body parts are the target body parts;

(iii) analyze the diagnostic data to determine which body parts are the affected target body parts and to identify the indicated medical conditions;

(iv) for each patient, construct a patient index comprising a pre-defined set of body part identifiers by identifying one or more pre-defined body part identifiers corresponding to the specification of each of the target body parts identified by the medical data indexing system'"'"'s analysis, and automatically associate the diagnostic data for each of the target body parts with the identified pre-defined target body part identifiers in the patient index, and associate the indicated medical condition with each affected target body part'"'"'s identifier in the patient index; and

(v) receive data retrieval requests from requestors, each request specifying a patient, and, for each request, provide the patient index corresponding to the specified patient to the requestor.

24. The medical data indexing system of claim 23 wherein the patient records for at least one patient are retrieved from at least two medical information systems via the computer network.

25. The medical data indexing system of claim 24, wherein the requestor is a patient visualization server, the patient visualization server comprising a computer processor running software that causes the computer processor to:

a. receive an index image request from a client specifying a patient;

b. send a data retrieval request to the patient indexing server to request a patient index for the specified patient, and receive the patient index for the specified patient from the patient indexing server;

c. generate an index image depicting the body parts corresponding to a subset of the pre-defined set of body part identifiers in the patient index, and, if one or more target body parts in the patient index are depicted in the index image, automatically highlight a portion of the index image depicting the one or more target body parts, and if one or more affected target body parts are depicted in the index image then, for each depicted affected target body part, automatically highlight a portion of the index image depicting the depicted affected target body part in a manner differentiating it from other body parts; and

d. send the index image to the client.

26. The medical data indexing system of claim 25, further comprising the patient visualization server.

27. The medical data indexing system of claim 26, wherein the software further causes the computer processor in the patient visualization server to:

a. receive index image revision requests from the client, revise the index image according to each request, automatically highlight the target body parts depicted in the revised index images, and provide the revised index images to the client; and

b. receive data retrieval requests from the client, each request specifying one of the target body parts, and, for each request, provide some or all of the diagnostic data associated with the specified target body part to the client.

28. The medical data indexing system of claim 24, wherein the body parts are depicted in the index image in relative positions corresponding to the relative positions of the body parts in the patient.

29. The medical data indexing system of claim 24, wherein the pre-defined set of body part identifiers is hierarchical, based on parent-child relationships between the body parts, and the patient index comprises a directed acyclic graph having nodes and edges, wherein the nodes correspond to pre-defined body part identifiers, the edges connect nodes that share a parent-child relationship, and each node corresponding to a particular target body part is associated with the diagnostic data for that particular target body part.

30. The medical data indexing system of claim 29, wherein the nodes contain addresses of, or pointers to, the associated diagnostic data.

31. The medical data indexing system of claim 29, wherein the directed acyclic graph is depicted in the index image, and the nodes with associated diagnostic data are highlighted.

32. The medical data indexing system of claim 23 wherein none of the diagnostic data associated with the target body parts is provided to the medical information system storing the diagnostic data by the medical data indexing system.

33. A method of indexing medical data by a computer system, the method comprising the steps of:

a. Receiving a patient identifier specifying a patient from a requestor, the patient having a set of body parts;

b. automatically retrieving and receiving from a medical information system an electronic patient record for the patient via a computer network, the medical information system being separate and distinct from, and designed and developed separately from, the computer system performing the method, the patient record comprising (1) a specification of one or more target body parts having diagnostic data associated therewith stored in one of the medical information systems, including one or more internal body parts, one or more of the target body parts being an affected target body part, each of whose associated diagnostic data indicates the existence of a medical condition associated with the affected target body part, and (2) the diagnostic data associated with each of the target body parts;

c. analyzing the patient record to determine which body parts are the target body parts;

d. analyzing the diagnostic data to determine which body parts are the affected target body parts and to identify the indicated medical conditions;

e. generating an index image depicting a set of the patient'"'"'s body parts;

f. if one or more of the target body parts identified by the analysis of one of the patient record retrieved over the computer network from one of the medical information systems are depicted in the index image, automatically highlighting those target body parts in the index image;

g. if one or more affected target body parts are depicted in the index image then, for each depicted affected target body part, automatically highlighting the depicted affected target body part in a manner differentiating it from other body parts;

h. providing the index image to the requestor; and

i. if the requestor selects one of the highlighted target body parts, providing some or all of the associated diagnostic data to the requestor.

34. The method of claim 33 wherein patient records for at least one patient are retrieved from at least two medical information systems via the computer network.

35. A method of indexing medical data by a computer system, the method comprising the steps of:

a. receiving a data retrieval request from a requestor, the request specifying a patient;

b. automatically obtaining an electronic patient record for the patient from one or more medical information systems via a computer network, each medical information system being separate and distinct from, and designed and developed separately from, the computer system performing the method, the patient having a set of body parts, the patient record comprising (1) a specification of one or more target body parts having diagnostic data associated therewith stored in one of the medical information systems, including one or more internal body parts, one or more of the target body parts being an affected target body part, each of whose associated diagnostic data indicates the existence of a medical condition associated with the affected target body part, and (2) the diagnostic data for each target body part;

c. analyzing the patient record to determine which body parts are the target body parts;

d. analyzing the diagnostic data to determine which body parts are the affected target body parts and to identify the indicated medical conditions;

e. constructing a patient index comprising a pre-defined set of body part identifiers by identifying one or more pre-defined body part identifiers corresponding to the specification of each of the target body parts identified by the analysis of the patient record as having diagnostic data associated therewith stored in one of the medical information systems, and automatically associating the diagnostic data for each of the target body parts with the identified pre-defined target body part identifiers in the patient index, and associating the indicated medical condition with each affected target body part'"'"'s identifier in the patient index; and

f. providing the patient index to the requestor.

36. The method of claim 35 wherein patient records for at least one patient are retrieved from at least two medical information systems via the computer network.