Remote operation support system and method

• US 6,490,490 B1
• Filed: 03/10/2000
• Issued: 12/03/2002
• Est. Priority Date: 11/09/1998
• Status: Expired due to Term

• Current Assignee: Olympus Optical Corporation Limited (Olympus Corporation)
• Original Assignee: Olympus Optical Corporation Limited (Olympus Corporation)
• Inventors: Mizuno, Hitoshi, Gotanda, Masakazu, Uchikubo, Akinobu
• Primary Examiner(s): PATEL, RAMESH B
• Application Number:
  US09/523,355
• Time in Patent Office: 998 Days
• Field of Search: 700/17, 700/64, 700/65, 700/66, 700/83-88, 700/246, 700/250, 600/101-104, 600/109-111, 600/112, 600/114, 600/117-118, 600/126, 600/166-167, 600/160, 600/173, 600/407, 604/246, 606/157, 704/258
• US Class Current: 700/65
• CPC Class Codes: A61B 1/00045 Display arrangement
• CPC Class Codes: A61B 1/0005 combining images e.g. side-by-side, superimposed or tiled
• CPC Class Codes: A61B 1/04 combined with photographic or television appliances
• CPC Class Codes: G16H 20/40 relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• CPC Class Codes: G16H 30/40 for processing medical images, e.g. editing
• CPC Class Codes: G16H 40/67 for remote operation

Abstract

According to a remote operation support system, a physician present in a remote place can view endoscopic images displayed in an operating room over a communication line, and change an image area or a viewing direction represented by endoscopic images in a desired manner by performing manipulations. The physician present in the remote place can thus support an operator present in the operating room. An endoscope system installed in the operating room and a remote control system installed in a control room located in the remote place are linked using a public communication line. The endoscope system has a signal transmission apparatus installed in the operating room. The signal transmission apparatus in the operating room converts a video signal and a control signal or patient data, which are produced by a CCU and a system controller respectively, and outputs resultant signals over the public line. The remote control system has a signal transmission apparatus installed in the control room. The signal transmission apparatus in the control room is connected on the public line and converts the transmitted signals into the original signals. A second monitor and a remote controller are connected to the transmission apparatus.

Claims

1. A remote operation support system in which an operating room and a control room located away from the operating room are linked using a communication line so that an operator present in the operating room can perform an operation while being supported by a supporter present in the control room, said remote operation support system comprising:

an endoscopic imaging system having an image formation optical system and an imaging device;

an image processing unit for converting an image signal produced by said endoscopic imaging system into a video signal;

a first display unit for displaying endoscopic images expressed by the video signal produced by said image processing unit;

a field-of-view change control unit for changing an image area or a viewing direction offered by said endoscopic imaging system; and

a first signal transmission apparatus for transmitting a signal processed by said image processing unit over said communication line, and receiving an input signal over said communication line,

wherein said endoscopic imaging system, image processing unit, first display unit, field-of-view change control unit, and first signal transmission apparatus are installed in the operating room,

said remote operation support system further comprising;

a second signal transmission apparatus for receiving a signal from said first signal transmission apparatus over said transmission line, and transmitting a signal produced in the control room;

a second display unit for displaying an endoscopic video signal received by said second signal transmission apparatus; and

a control unit for producing an instruction signal used to change the image area or viewing direction represented by the endoscopic images displayed on said second display unit, and controlling said field-of-view change control unit in the operating room by way of said second signal transmission apparatus and communication line,

wherein said second signal transmission apparatus, second display unit, and control unit are installed in the control room.

2. A remote operation support system according to claim 1, wherein said field-of-view change control unit installed in said operating room changes the image area or viewing direction by changing the relative positions of said image formation optical system and imaging device included in said endoscopic imaging system.

3. A remote operation support system according to claim 1, wherein an instruction signal output from said control unit in the control room is produced by performing calculation based on a magnitude of shift observed on said second display unit.

4. A remote operation support system according to claim 1, wherein an instruction signal output from said control unit in the control room is produced by performing calculation based on a speed of shift observed on said second display unit.

5. A remote operation support system according to claim 1, wherein an instruction signal output from said control unit in the control room is produced by performing calculation based on an angle of shift observed on said second display unit.

6. A remote operation support method in which an operating room and a control room located away from the operating room are linked using a communication line so that an operator present in the operating room can perform an operation while being supported by a supporter present in the control room, said remote operation support method comprising the steps of:

imaging an intracavitary region of a certain object in the operating room;

processing an image signal expressing endoscopic images taken at said imaging step, and converting the image signal into a video signal;

transmitting the video signal to the control room;

receiving the video signal transmitted from the operating room;

displaying endoscopic images according to the received video signal;

producing and outputting an instruction signal used to change an image area or a viewing direction represented by the endoscopic images displayed at said displaying step;

transmitting the instruction signal produced and output at the preceding step to the operating room;

receiving the instruction signal transmitted at the preceding step in the operating room; and

changing the image area or viewing direction in the intracavitary region of the object according to the received instruction signal.

7. A remote operation support method according to claim 6, wherein said step of producing and outputting an instruction signal used to change an image area or a viewing direction represented by endoscopic images includes a designating step of designating a change point so that a field-of-view change instruction unit can change a field of view represented by the endoscopic images displayed on said display unit, and an arithmetic step of calculating the relationship between a destination point designated at said designating step and an origin.

8. A remote operation support method according to claim 7, wherein at said arithmetic step, a magnitude of shift is calculated based on two points designated on said display unit on which endoscopic images are displayed.

9. A remote operation support method according to claim 7, wherein at said arithmetic step, an angle of shift is calculated based on two points designated on said display unit on which endoscopic images are displayed.

10. A remote operation support method according to claim 7, wherein at said arithmetic step, a speed of shift is calculated based on two points designated on said display unit on which endoscopic images are displayed.

11. A remote operation support method according to claim 6, wherein at said step of producing and outputting an instruction signal used to change an image area or a viewing direction represented by endoscopic images, the relative positions of an image formation optical system and an imaging device included in said endoscopic imaging system are changed in order to change the image area or viewing direction.

12. A remote operation support method according to claim 6, wherein at said step of producing and outputting an instruction signal used to change an image area or a viewing direction represented by endoscopic images, a read area in an image accumulation unit included in said endoscopic imaging system is controlled in order to change the image area or an image position.