Medical support system

• US 6,151,521 A
• Filed: 05/04/1998
• Issued: 11/21/2000
• Est. Priority Date: 11/19/1997
• Status: Expired due to Fees

• Current Assignee: Mitsubishi Denki Kabushiki Kaisha (Mitsubishi Electric Corporation)
• Original Assignee: Mitsubishi Denki Kabushiki Kaisha (Mitsubishi Electric Corporation)
• Inventors: Guo, Qinglian, Maeda, Mitsuo, Kamei, Katsuyuki, Muroi, Katsunobu, Ohsuga, Mieko
• Primary Examiner(s): Lateef, Marvin M.
• Assistant Examiner(s): MANTIS MERCADER, ELENI M
• Application Number:
  US09/071,831
• Time in Patent Office: 932 Days
• Field of Search: 600/407, 128/903, 128/904, 128/905, 128/922, 382/128, 396/333, 396/14, 396/325, 345/1, 345/2, 345/903, 348/13, 348/14, 348/15, 348/7, 348/12, 348/36, 348/38, 348/39
• US Class Current: 600/407
• CPC Class Codes: A61B 5/0002 Remote monitoring of patients using telemetry, e.g. transmission of vital signals via a communication network A61B5/07 takes precedence; transmission systems for measured values G08C; transmission H04B; transmission of digital information H04L; wireless communication networks H04W
• CPC Class Codes: A61B 5/0064 Body surface scanning
• CPC Class Codes: A61B 5/7425 Displaying combinations of multiple images regardless of image source, e.g. displaying a reference anatomical image with a live image geometric transforms for image registration G06T3/14; enhancement using image fusion G06T5/50; algorithms for registration of images G06T7/30
• CPC Class Codes: Y10S 128/904 Telephone telemetry
• CPC Class Codes: Y10S 128/905 Feedback to patient of biological signal other than brain electric signal
• CPC Class Codes: Y10S 128/922 including image analysis

Abstract

A medical support system includes a patient-side system including patient shooting devices for photographing a patient'"'"'s body and forming respective images displaying respective parts of the patient'"'"'s body; a medical-side system located at a position spaced away from the patient-side system and including an image synthesizer for splicing together, at boundary portions, respective adjacent images of the patient'"'"'s body to produce a composite image displaying an area of the patient'"'"'s body extending across the respective images, and a display for displaying the composite image produced by the image synthesizer; and a communication link for transmitting information between the medical-side system and the patient-side system and for transferring the images produced by the patient shooting devices to the medical-side system.

Claims

1. A medical support system comprising:

a patient-side system including patient image shooting means comprising a plurality of shooting devices for photographing a patient'"'"'s body and forming a plurality of images, respective images displaying respective parts of the patient'"'"'s body;

a medical-side system located at a position spaced away from said patient-side system and including image synthesizing means for splicing together, at boundary portions, respective adjacent images of parts of the patient'"'"'s body to produce a composite image displaying an area of the patient'"'"'s body extending across the respective adjacent images, and display means for displaying the composite image produced by said image synthesizing means; and

communication means for transmitting information between said medical-side system and said patient-side system and for transferring the plurality of images produced by said patient image shooting means to said medical-side system.

2. The medical support system according to claim 1, wherein said medical-side system has shooting-device position control means for controlling the positions of the plurality of shooting devices of said patient image shooting means in said patient-side system.

3. The medical support system according to claim 2, wherein said medical-side system has shooting-device position display means for displaying the positions of said plurality of shooting devices thereon.

4. The medical support system according to claim 2, wherein said medical-side system has selecting means for selecting a patient part/range photographed by said patient-side system and said shooting-device position control means controls said patient image shooting means according to the information selected by said selecting means.

5. The medical support system according to claim 4, wherein said medical-side system has human-body form image display means for displaying a human-body form image corresponding to the form of a human body and displaying a part of the human-body form image corresponding to the patient part selected by said selecting means in distinction from other parts.

6. The medical support system according to claim 5, wherein said medical-side system has shot-state input means for selecting and inputting a photographed posture of the patient and said human-body form image display means displays thereon a human-body form image corresponding to the posture inputted to said shot-state input means.

7. The medical support system according to claim 1, wherein said medical-side system includes voice input means for inputting a voice, voice output means for outputting voice information sent from said patient-side system and shooting means for photographing images, and said patient-side system includes display means for displaying the images obtained by the shooting means of said medical-side system and voice output means for outputting the voice inputted from the voice input means of said medical-side system.

8. The medical support system according to claim 7, wherein said medical-side system has voice information recognizing means for recognizing information about the voice inputted from said voice input means and outputting a signal for specifying a human body part to be photographed.

9. The medical support system according to claim 1, wherein said plurality of shooting devices of said patient-side system are located in a common plane.

10. The medical support system according to claim 9, wherein said plurality of shooting devices are movable within the plane.

11. The medical support system according to claim 1, wherein said plurality of shooting devices differ from each other in shooting directions.

12. The medical support system according to claim 1, wherein said medical-side system has shooting-device position calculating means for calculating the position of each shooting device of said patient-side system, said shooting-device position calculating means calculating the positions of said plurality of shooting devices so that movements of said plurality of shooting devices reach minimum or said plurality of shooting devices reaches a minimum quantity.

13. The medical support system according to claim 1, wherein said patient-side system has first information storing means for storing the images produced by said patient image shooting means and said medical-side system has second information storing means for storing the images sent from said patient-side system.

14. The medical support system according to claim 1, wherein:

said image synthesizing means includes means for determining a layout of the plurality of images from information about positions of the plurality of shooting devices,

boundary extracting means for extracting boundaries of the plurality of images through a boundary extracting filter,

means for calculating a center line of an overlapping area in which respective adjacent images overlap each other in vicinities of the boundaries of respective images,

means for calculating intersections of the boundaries extracted from the boundary extracting means of the adjacent images and extracting an area in which the intersections increase, thereby producing a template image,

means for creating a window identical in size to the template image and calculating a position used to splice the adjacent images together while moving the window within the overlapping area,

registration processing means for adjusting a mutually related position of the adjacent images in a vertical or horizontal direction and effecting a registration process on the adjacent images so that the boundaries of the adjacent images are joined to each other, and

intensity blending process executing means for effecting a blending process of at least one of intensities and color tones of the center line and pixels around the center line.

15. The medical support system according to claim 14, wherein said intensity blending process executing means calculates densities of respective pixels within the overlapping area from the following equations (1) through (3):

space="preserve" listing-type="equation">I(p)=I1(p)×

s1(p)+I2(p)×

s2(p) (1)

space="preserve" listing-type="equation">s1(p)=-1.0×

(x1-R+d)/d+1.0 (2)

space="preserve" listing-type="equation">s2(p)=1.0×

(x2+R-d)/d+1.0 (3)

where p;

the position of each pixel that belongs to the overlapping area,

wherein the position of p represented in the form of a coordinate system of one image is given as (x1, y1) and the position of p represented in the form of a coordinate system of the other image is given as (x2, y2),

I(p);

the density of a pixel at the point p of a composite image,

I1(p);

the density of a pixel at the point p of one image,

I2(p);

the density of a pixel at the point p of the other image,

R;

the radius of an image area, and

d;

the width of the overlapping area.

16. The medical support system according to claim 14, wherein said means for effecting a blending process calculates densities of respective pixels within the overlapping area from the following equations (4) through (8):

space="preserve" listing-type="equation">R(p)=R1(p)×

s1(p)+R2(p)×

s2(p) (4)

space="preserve" listing-type="equation">G(p)=G1(p)×

s1(p)+G2(p)×

s2(p) (5)

space="preserve" listing-type="equation">B(p)=B1(p)×

s1(p)+B2(p)×

s2(p) (6)

space="preserve" listing-type="equation">s1(p)=-1.0×

(x1-R+d)/d+1.0 (7)

space="preserve" listing-type="equation">s2(p)=1.0×

(x2+R-d)/d+1.0 (8)

where p;

the position of each pixel that belongs to the overlapping area,

wherein the position of p represented in the form of a coordinate system of one image is given as (x1, y1) and the position of p represented in the form of a coordinate system of the other image is given as (x2, y2),

R(p), G(p) and B(p);

tonal values of respective colors of R (red), G (green) and B (blue) of a pixel at a point p of a composite image,

R1(p), G1(p) and B1(p);

tonal values of respective colors of R (red), G (green) and B (blue) of a pixel at the point p of one image,

R2(p), G2(p) and B2(p);

tonal values of respective colors of R (red), G (green) and B (blue) of a pixel at the point p of the other image,

R;

the radius of an image area, and

d;

the width of the overlapping area.

17. The medical support system according to claim 1, wherein a background pattern is provided and said plurality of shooting devices photographs the patients body with the background pattern as background.

18. The medical support system according to claim 17, wherein the background pattern includes straight lines.

19. The medical support system according to claim 18, wherein the straight lines have varying widths.

20. The medical support system according to claim 18, wherein spaces between adjacent pairs of the straight lines vary.