Method and apparatus for providing medical information

• US 10,283,088 B2
• Filed: 06/12/2014
• Issued: 05/07/2019
• Est. Priority Date: 06/12/2013
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Ban, Dae-hyun, Lee, Woong, Han, Jeong-ho, Oh, Keum-yong, Lee, Chang-lae
• Primary Examiner(s): Richer, Aaron M
• Assistant Examiner(s): Vu, Khoa
• Application Number:
  US14/303,086
• Publication Number:
  US 20140368545A1
• Time in Patent Office: 1,790 Days
• Field of Search: None
• CPC Class Codes: A61B 6/03 Computed tomography [CT] echo-tomography A61B8/14
• CPC Class Codes: A61B 6/032 Transmission computed tomography [CT]
• CPC Class Codes: A61B 6/463 characterised by displaying multiple images or images and diagnostic data on one display
• CPC Class Codes: G01R 33/283 Intercom or optical viewing arrangements, structurally associated with NMR apparatus
• CPC Class Codes: G01R 33/546 Interface between the MR system and the user, e.g. for controlling the operation of the MR system or for the design of pulse sequences
• CPC Class Codes: G06F 3/1423 controlling a plurality of local displays, e.g. CRT and flat panel display
• CPC Class Codes: G06T 2207/10072 Tomographic images
• CPC Class Codes: G06T 2207/30004 Biomedical image processing
• CPC Class Codes: G06T 7/0012 Biomedical image inspection
• CPC Class Codes: G09G 2340/12 Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
• CPC Class Codes: G09G 5/14 Display of multiple viewports
• CPC Class Codes: G16H 40/63 for local operation

Abstract

The medical information providing method includes: capturing a room image of an inside of an examination room in which an object is positioned for medical examination; obtaining diagnostic information of the object; and displaying the diagnostic information which is overlaid on the room image according to a first mode, on a display.

Claims

1. A medical information providing method for providing medical information via a medical information providing apparatus, wherein the medical information providing apparatus comprises a plurality of displays disposed on a border with a console room window disposed between an examination room and a console room, and at least one image capturing device, the medical information providing method comprising:

capturing a room image of an inside of the examination room in which an object is positioned for medical examination by the at least one image capturing device;

obtaining information of at least one among a position of a user, a distance between the user and each of the plurality of displays, respectively, and a direction of a view of the user;

selecting, for each of the plurality of displays, a partial region of the captured room image a border of which is matched to a border of a room view observable via the console room window and to an image displayed on at least one display among the plurality of displays, based on the at least one among the position of the user, the distance between the user and each of the plurality of displays, respectively, and the direction of the view of the user, and

displaying the selected partial region of the captured room image, on each of the plurality of displays, respectively.

2. The medical information providing method of claim 1, further comprising:

defining a medical information providing mode to include at least one selected from a first mode configured to provide diagnostic information to be overlaid on the selected partial region of the captured room image, a second mode configured to provide the selected partial region of the captured room image, and a third mode configured to provide the diagnostic information; and

displaying at least one selected from the selected partial region of the captured room image and the diagnostic information according to the medical information providing mode, on the plurality of displays.

3. The medical information providing method of claim 2, wherein the displaying the at least one selected from the selected partial region of the captured room image and the diagnostic information comprises determining the medical information providing mode while a diagnostic process with respect to the object is being performed.

4. The medical information providing method of claim 3, wherein the displaying comprises:

displaying the room image according to the second mode on the at least one display;

changing the second mode of the plurality of displays to the third mode or the first mode, in response to starting the diagnostic process with respect to the object; and

displaying the diagnostic information in the third mode or the first mode on the plurality of displays, in response to the changing.

5. The medical information providing method of claim 2, wherein

the displaying the at least one selected from the selected partial region of the captured room image and the diagnostic information comprises determining the medical information providing mode of the plurality of displays.

6. The medical information providing method of claim 5, wherein the determining the medical information providing mode comprises determining the medical information providing mode of the plurality of displays as the third mode or the first mode, in response to starting a diagnostic process of the object.

7. The medical information providing method of claim 5, wherein the determining the medical information providing mode comprises changing the medical information providing mode of the plurality of displays, based on priority orders pre-set in the plurality of displays, respectively.

8. The medical information providing method of claim 7, wherein the priority orders are determined based on at least one among a position, a size, and a resolution of the plurality of displays, respectively.

9. The medical information providing method of claim 7, wherein the plurality of displays comprises a first display and a second display, and the displaying the at least one selected from the selected partial region of the captured room image and the diagnostic information further comprises:

displaying a first piece of the diagnostic information on the first display, in response to starting a diagnostic process of the object;

consequently, displaying the first piece of the diagnostic information on the second display having a lower priority than that of the first display, in response to the diagnostic process of the object being progressed and a second piece of the diagnostic information being obtained; and

displaying the second piece of the diagnostic information on the first display in response to obtaining the second piece of the diagnostic information.

10. The medical information providing method of claim 5, wherein the plurality of displays is embodied in the console room window, and the plurality of displays is disposed adjacent each other along a side edge of the console room window or on an entirety of the console room window.

11. The medical information providing method of claim 5, wherein the displaying further comprises:

selecting a plurality of partial regions from the captured room image according to an arrangement of the plurality of displays;

matching the plurality of partial regions with the plurality of displays, respectively; and

displaying images of the plurality of partial regions on the matched plurality of displays.

12. The medical information providing method of claim 11, wherein the plurality of partial regions are spatially connected to each other.

13. The medical information providing method of claim 5, further comprising:

receiving an external input signal via a user input unit that commonly corresponds to the plurality of displays; and

controlling the plurality of displays based on the external input signal.

14. The medical information providing method of claim 1, wherein the selecting comprises selecting the partial region based on an identification (ID) device configured to identify an operator.

15. The medical information providing method of claim 14, wherein the selecting comprises selecting the partial region based on the ID device of the operator who logs into a medical diagnostic system, to perform the medical examination of the object.

16. The medical information providing method of claim 1, further comprising obtaining diagnostic information of the object, the diagnostic information comprising at least one among:

an identification (ID) information of the object,

information about a diagnostic process with respect to the object, and

medical history information of the object.

17. The method of claim 1, wherein the captured room image is a contemporary image of the examination room captured by a camera.

18. The method of claim 1, wherein the displaying further comprises displaying diagnostic information as an overlay on the captured room image.

19. The method of claim 1, wherein the capturing comprises capturing an image of a diagnostic medical apparatus incorporated into the medical information providing apparatus, and

the displaying further comprises:

displaying, on a screen of the at least one display, an image of a portion of the diagnostic medical apparatus visually spatially connected to other portion of the diagnostic medical apparatus, the other portion being observable through the console room window, so that the displayed image of the portion of the diagnostic medical apparatus is visually perceived as a continuation of the other portion of the diagnostic medical apparatus.

20. A magnetic resonance imaging (MRI) system or a computed tomography (CT) system which performs the medical information providing method of claim 1.

38. A non-transitory computer-readable recording medium having recorded thereon a program which, when executed by a computer, causes the computer to perform the method of claim 1.

21. A medical information providing apparatus comprising:

an image capturing device configured to capture a room image of an inside of an examination room in which an object is positioned for medical examination; and

a plurality of displays disposed on a border with a console room window disposed between the examination room and a console room, and configured to display at least a part of the captured room image,

at least one processor configured to;

obtain information of at least one among a position of a user, a distance between the user and each of the plurality of displays, respectively, and a direction of a view of the user,

select, for each of the plurality of displays, a partial region of the captured room image a border of which is matched to a border of a room view observable via the console room window and to an image displayed on at least one display among the plurality of displays, based on the at least one among the position of the user, the distance between the user and each of the plurality of displays, respectively, and the direction of the view of the user, and

control to display the selected partial region of the captured room image, on each of the plurality of displays, respectively.

22. The medical information providing apparatus of claim 21, wherein the at least one processor is further configured to:

define a medical information providing mode to include at least one selected from a first mode configured to provide diagnostic information on the selected partial region of the captured room image, a second mode configured to provide the selected partial region of the captured room image, and a third mode configured to provide the diagnostic information; and

provide at least one selected from the selected partial region of the captured room image and the diagnostic information, according to the medical information providing mode, to the plurality of displays.

23. The medical information providing apparatus of claim 22, wherein the at least one processor is further configured to determine the medical information providing mode for the plurality of displays while a diagnostic process with respect to the object is being performed.

24. The medical information providing apparatus of claim 23, wherein the room image according to the second mode is displayed on the at least one display, prior to beginning of the diagnostic process,

the at least one processor is further configured to change the second mode to the third mode or the first mode, in response to the diagnostic process with respect to the object being started, and

the plurality of displays are further configured to display the diagnostic information in the third mode or the first mode, in response to the second mode being changed to the third mode or the first mode.

25. The medical information providing apparatus of claim 22, wherein the at least one processor is further configured to determine the medical information providing mode of the plurality of displays.

26. The medical information providing apparatus of claim 25, wherein the at least one processor is further configured to determine the medical information providing mode of the plurality of displays, respectively, as the third mode or the first mode, in response to a diagnostic process of the object being started.

27. The medical information providing apparatus of claim 25, wherein the at least one processor is further configured to change the medical information providing mode of the plurality of displays, based on priority orders pre-set in the plurality of displays, respectively.

28. The medical information providing apparatus of claim 27, wherein the priority orders are determined based on at least one among a position, a size, and a resolution of the plurality of displays, respectively.

29. The medical information providing apparatus of claim 27, wherein the respective displays comprise a first display and a second display, and

the at least one processor is further configured to provide a first piece of the diagnostic information to the first display in response to a diagnostic process of the object being started, consequently provide the first piece of the diagnostic information to the second display that has a lower priority than that of the first display in response to the diagnostic process of the object being advanced and a second piece of the diagnostic information being obtained, and provide the second piece of the diagnostic information to the first display in response to the second piece of the diagnostic information being obtained.

30. The medical information providing apparatus of claim 25, wherein the plurality of displays is embodied in the console room window, and the plurality of displays is disposed adjacent each other along a side edge of the console room window or on an entirety of the console room window.

31. The medical information providing apparatus of claim 25,

wherein the at least one processor is further configured to select a plurality of partial regions from the room image according to an arrangement of the plurality of displays, match the plurality of partial regions with the plurality of displays, respectively, and provide images of the plurality of partial regions to the plurality of matched displays.

32. The medical information providing apparatus of claim 31, wherein the plurality of partial regions are spatially connected to each other.

33. The medical information providing apparatus of claim 25, further comprising a user input receiver that commonly corresponds to the plurality of displays,

wherein the at least one processor is further configured to control the plurality of displays based on an external input signal received via the user input receiver.

34. The medical information providing apparatus of claim 21, wherein the at least one processor is further configured to select the partial region based on an identification (ID) device configured to identify an operator.

35. The medical information providing apparatus of claim 34, wherein the at least one processor is further configured to select the partial region based on the ID device of the operator who logs into a medical diagnostic system to perform the medical examination of the object.

36. The medical information providing apparatus of claim 21, further comprising a diagnostic information obtainer configured to obtain diagnostic information of the object,

wherein the diagnostic information comprises at least one among:

an identification (ID) information of the object,

information about a diagnostic process with respect to the object, and

medical history information of the object.

37. The medical information providing apparatus of claim 21, further comprising a magnetic resonance imaging (MRI) system or a computed tomography (CT) system.

40. The apparatus of claim 36, further comprising:

a user workstation which is disposed in the second room and comprises a user interface (UI) configured to interface with the plurality of displays, and is configured to receive a signal from the user for manipulating one among graphical objects displayed on the UI and physical keys provided with the UI to control plurality of displays.

41. The apparatus of claim 36, wherein the room image processor and the medical processor are embodied in a user workstation.

42. The apparatus comprising of claim 36, further comprising a mode determiner configured to determine a medical information providing mode in the plurality of displays to include at least one among:

a second mode configured to provide the room image,

a third mode configured to provide the medical image, and

a first mode configured to provide the medical image overlaid on the room image.

43. The apparatus comprising of claim 36, wherein the image capturing devices are attached to rear surfaces of corresponding displays.

44. The apparatus comprising of claim 43, wherein the image capturing devices are configured to obtain portions of the room image corresponding to a field of view (FOV) of each of the image capturing devices, respectively,

the room image processor is further configured to provide the portions of the room image to the plurality of displays which have been configured to provide the room image, and

the medical processor is further configured to provide the medical image of the object on at least one among the room image and the plurality of displays configured to provide the medical image.

45. The apparatus comprising of claim 36, wherein the plurality of displays are attached to the display panel side by side to form a seamless display comprising display tiles arranged in an addressable array.

39. An apparatus comprising:

image capturing devices configured to capture a room image including a plurality of partial regions of an inside of a first room, in which an object is positioned for medical imaging;

a room image processor configured to obtain the room image from the image capturing devices and form a visual representation of the room image;

a medical processor configured to process medical imaging information of the object while the medical imaging of the object proceeds and form a medical image of a region of interest (ROI) of the object; and

a plurality of displays which are disposed in an array on a display panel in a second room separated from the first room and configured to display the visual representation of the room image for a larger region than an observed first room inside region via a console room window, by displaying the plurality of partial regions spatially connected to each other, and to display the medical image of the ROI of the object,

wherein the spatially connected plurality of partial regions together display a contagious image of the room image for the larger region than the observed first room inside region, and

wherein at least one display is embodied in the console room window, among the plurality of displays,

wherein the room image processor is further configured to;

obtain information of at least one among a position of a user, a distance between the user and each of the plurality of displays, respectively, and a direction of a view of the user,

select, for each of the plurality of displays, a partial region of the captured room image a border of which is matched to a border of a room view observable via the console room window and to an image displayed on the at least one display, based on the at least one among the position of the user, the distance between the user and each of the plurality of displays, respectively, and the direction of the view of the user, and

display the partial region of the captured room image, on each of the plurality of displays, respectively.

46. An apparatus comprising:

an image capturing device configured to obtain a room image of an inside of a first room, in which an object is positioned for medical imaging;

a medical processor configured to obtain pieces of medical information of the object;

a plurality of displays which are disposed in an array on a display panel in a second room; and

a user workstation which is disposed in the second room, and configured to control the medical imaging of the object and display at least one of the pieces of medical information to be overlaid on the room image for a larger region than an observed first room inside region via a console room window, on the plurality of displays, and

wherein at least one display is embodied in the console room window, among the plurality of displays, and

wherein the user workstation is further configured to;

obtain information of at least one among a position of a user, a distance between the user and each of the plurality of displays, respectively, and a direction of a view of the user,

select, for each of the plurality of displays, a partial region of the captured room image a border of which is matched to a border of a room view observable via the console room window and to an image displayed on the at least one display, based on the at least one among the position of the user, the distance between the user and each of the plurality of displays, respectively, and the direction of the view of the user, and

display the selected partial region of the captured room image, on each of the plurality of displays, respectively.

47. The apparatus of claim 46, wherein the medical processor comprises:

an image processor configured to obtain a medical image of the object and provide the medical image to the plurality of displays;

a pre-processor configured to obtain and provide an imaging schedule of the object to the plurality of displays; and

a contrast monitoring processor configured to control an injection of contrast in the object and provide a contrast monitoring image to the plurality of displays.

48. The apparatus of claim 47, wherein the user workstation is further configured to define an image providing mode and set an image providing order in the plurality of displays, and to control the displaying of the room image, the medical image, the imaging schedule, and the contrast monitoring image based on the image providing mode and the image providing order, on the plurality of displays, respectively.

49. The apparatus of claim 46, further comprising at least one among a computed tomography (CT) imaging system and a magnetic resonance (MR) imaging system,

wherein the user workstation is further configured to provide at least one among a CT image and an MR image to the plurality of displays.

50. The apparatus of claim 49, wherein the medical processor comprises a registration processor configured to superimpose the CT image of a region of interest (ROI) of the object with the MR image of the ROI of the object, and

the user workstation is further configured to provide a superimposed image to the plurality of displays.