Interactive displays

• US 9,283,054 B2
• Filed: 08/23/2013
• Issued: 03/15/2016
• Est. Priority Date: 08/23/2013
• Status: Active Grant

• Current Assignee: Cilag Gmbh International (Johnson & Johnson)
• Original Assignee: Ethicon Endo-Surgery LLC (Johnson & Johnson)
• Inventors: Morgan, Jerome R., Shelton, Frederick E. IV, Schellin, Emily A.
• Primary Examiner(s): Edun, Muhammad N.
• Application Number:
  US13/974,208
• Publication Number:
  US 20150054753A1
• Time in Patent Office: 935 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: A61B 17/00234 for minimally invasive surgery A61B17/0218, A61B17/0469, A61B17/12013, A61B17/1285, A61B17/29, A61B17/320016 take precedence
• CPC Class Codes: A61B 17/068 Surgical staplers , e.g. containing multiple staples or clampsstaplers containing only one staple A61B17/10; magazines or containers for staples A61B17/105; for performing anastomosis A61B17/115; staplers in general B25C5/00
• CPC Class Codes: A61B 17/072 for applying a row of staples in a single action , e.g. the staples being applied simultaneously
• CPC Class Codes: A61B 17/07207 the staples being applied sequentially
• CPC Class Codes: A61B 17/105 Wound clamp magazines for packaging sharps A61B50/3001
• CPC Class Codes: A61B 2017/00017 Electrical control of surgical instruments
• CPC Class Codes: A61B 2017/00084 Temperature
• CPC Class Codes: A61B 2017/00115 with audible or visual output
• CPC Class Codes: A61B 2017/00119 alarm; indicating an abnormal situation
• CPC Class Codes: A61B 2017/00123 and automatic shutdown
• CPC Class Codes: A61B 2017/00137 Details of operation mode
• CPC Class Codes: A61B 2017/00154 pulsed
• CPC Class Codes: A61B 2017/0019 Means for setting or varying the pulse width
• CPC Class Codes: A61B 2017/00199 with a console, e.g. a control panel with a display
• CPC Class Codes: A61B 2017/00221 with wireless transmission of data, e.g. by infrared radiation or radiowaves
• CPC Class Codes: A61B 2017/00367 Details of actuation of instruments, e.g. relations between pushing buttons, or the like, and activation of the tool, working tip, or the like
• CPC Class Codes: A61B 2017/00398 using powered actuators, e.g. stepper motors, solenoids
• CPC Class Codes: A61B 2017/00402 Piezo electric actuators
• CPC Class Codes: A61B 2017/00407 Ratchet means
• CPC Class Codes: A61B 2017/0046 with a releasable handle; with handle and operating part separable
• CPC Class Codes: A61B 2017/00464 : for use with different instruments
• CPC Class Codes: A61B 2017/00473 : Distal part, e.g. tip or head A61B2017/00464 takes precedence
• CPC Class Codes: A61B 2017/00477 : Coupling A61B2017/0046 takes precedence
• CPC Class Codes: A61B 2017/00482 : with a code
• CPC Class Codes: A61B 2017/00486 : Adaptors for coupling parts with incompatible geometries
• CPC Class Codes: A61B 2017/00734 : battery operated
• CPC Class Codes: A61B 2017/07214 : Stapler heads
• CPC Class Codes: A61B 2017/07228 : Arrangement of the staples
• CPC Class Codes: A61B 2017/07257 : characterised by its anvil
• CPC Class Codes: A61B 2017/07271 : characterised by its cartridge
• CPC Class Codes: A61B 2017/07278 : characterised by its sled or its staple holder
• CPC Class Codes: A61B 2017/07285 : characterised by its cutter
• CPC Class Codes: A61B 2017/2901 : Details of shaft
• CPC Class Codes: A61B 2017/291 : the position of the handle being adjustable with respect to the shaft
• CPC Class Codes: A61B 2017/2923 : Toothed members, e.g. rack and pinion
• CPC Class Codes: A61B 2017/2927 : the angular position of the head being adjustable with respect to the shaft
• CPC Class Codes: A61B 2017/2929 : with a head rotatable about the longitudinal axis of the shaft
• CPC Class Codes: A61B 2017/2941 : Toggle linkages
• CPC Class Codes: A61B 2017/2946 : Locking means
• CPC Class Codes: A61B 2034/252 : indicating steps of a surgical procedure
• CPC Class Codes: A61B 2034/254 : being adapted depending on the stage of the surgical procedure
• CPC Class Codes: A61B 2034/256 : having a database of accessory information, e.g. including context sensitive help or scientific articles
• CPC Class Codes: A61B 2090/035 : preventing further rotation
• CPC Class Codes: A61B 2090/037 : with a frangible part, e.g. by reduced diameter
• CPC Class Codes: A61B 2090/0803 : Counting the number of times an instrument is used
• CPC Class Codes: A61B 2090/0804 : Counting number of instruments used; Instrument detectors
• CPC Class Codes: A61B 2090/0807 : Indication means
• CPC Class Codes: A61B 2090/0808 : for indicating correct assembly of components, e.g. of the surgical apparatus
• CPC Class Codes: A61B 2090/0811 : for the position of a particular part of an instrument with respect to the rest of the instrument, e.g. position of the anvil of a stapling instrument
• CPC Class Codes: A61B 2090/0814 : Preventing re-use
• CPC Class Codes: A61B 2090/372 : Details of monitor hardware
• CPC Class Codes: A61B 2560/0214 : of power generation or supply
• CPC Class Codes: A61B 34/10 : Computer-aided planning, simulation or modelling of surgical operations
• CPC Class Codes: A61B 34/25 : User interfaces for surgical systems
• CPC Class Codes: A61B 34/30 : Surgical robots
• CPC Class Codes: A61B 34/74 : Manipulators with manual electric input means
• CPC Class Codes: A61B 34/76 : Manipulators having means for providing feel, e.g. force or tactile feedback
• CPC Class Codes: A61B 90/03 : Automatic limiting or abutting means, e.g. for safety
• CPC Class Codes: A61B 90/37 : Surgical systems with images on a monitor during operation
• CPC Class Codes: A61B 90/90 : Identification means for patients or instruments, e.g. tags
• CPC Class Codes: A61B 90/96 : using barcodes
• CPC Class Codes: A61B 90/98 : using electromagnetic means, e.g. transponders
• CPC Class Codes: G06F 21/60 : Protecting data
• CPC Class Codes: G06F 3/016 : Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0416 : Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/04817 : using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 : Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04845 : for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0488 : using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06T 11/60 : Editing figures and text; Combining figures or text
• CPC Class Codes: G09G 5/14 : Display of multiple viewports
• CPC Class Codes: G16H 20/40 : relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• CPC Class Codes: G16H 40/63 : for local operation
• CPC Class Codes: G16Z 99/00 : Subject matter not provided for in other main groups of this subclass
• CPC Class Codes: H01M 10/425 : Structural combination with electronic components, e.g. electronic circuits integrated to the outside of the casing printed circuits H05K1/00
• CPC Class Codes: H01M 10/48 : Accumulators combined with arrangements for measuring, testing or indicating the condition of cells, e.g. the level or density of the electrolyte constructional details of current conducting connections for detecting conditions inside cells or batteries, e.g. details of voltage sensing terminals, H01M50/569
• CPC Class Codes: H01M 2220/30 : Batteries in portable systems, e.g. mobile phone, laptop
• CPC Class Codes: H02J 2310/23 : The load being a medical device, a medical implant, or a life supporting device
• CPC Class Codes: H02J 7/00 : Circuit arrangements for charging or depolarising batteries or for supplying loads from batteries
• CPC Class Codes: H02J 7/0068 : Battery or charger load switching, e.g. concurrent charging and load supply H02J7/0013 takes precedence
• CPC Class Codes: H02J 7/342 : The other DC source being a battery actively interacting with the first one, i.e. battery to battery charging with circuits for polarity protection H02J7/0034
• CPC Class Codes: H02J 9/061 : for DC powered loads
• CPC Class Codes: H03K 2217/96062 : with tactile or haptic feedback
• CPC Class Codes: Y02E 60/10 : Energy storage using batteries

Abstract

An interactive display. The interactive display can include a first layer of information and a second layer of information. The first layer of information can include video feedback of a surgical instrument as viewed by an endoscope. The second layer of information can include a control panel, feedback measured and/or sensed by the surgical instrument, and/or controls for controlling the surgical instrument. A user can interface with the interactive display via a touch screen.

Claims

1. A system in signal communication with a surgical instrument for displaying feedback during an endoscopic operation, the system comprising:

a screen comprising a touch-sensitive interface, wherein said touch-sensitive interface is configured to receive at least one input;

a first layer depicted on said screen, wherein said first layer comprises primary feedback from the surgical instrument; and

a second layer depicted on said screen, wherein said second layer comprises secondary feedback from the surgical instrument, wherein said second layer at least partially overlays said first layer, and wherein at least one input to said touch-sensitive interface is configured to rearrange said secondary feedback of said second layer relative to said primary feedback of said first layer.

2. The system of claim 1, wherein said primary feedback comprises video feedback of the surgical instrument.

3. The system of claim 2, wherein said secondary feedback comprises data sensed by the surgical instrument.

4. The system of claim 1, wherein the at least one input comprises moving said secondary feedback between a plurality of positions.

5. The system of claim 1, wherein the at least one input comprises converting said secondary feedback between a plurality of unit systems.

6. The system of claim 1, wherein the at least one input comprises converting said secondary feedback between a numerical display and a graphical display.

7. The system of claim 1, wherein the at least one input comprises resizing said secondary feedback.

8. A system in signal communication with a surgical instrument for displaying feedback during an endoscopic operation, the system comprising:

a screen comprising a touch-sensitive interface, wherein said touch-sensitive interface is configured to receive at least one input;

a first layer depicted on said screen, wherein said first layer comprises primary feedback from the surgical instrument, wherein said primary feedback comprises video feedback of the surgical instrument; and

a second layer depicted on said screen, wherein said second layer comprises secondary feedback from the surgical instrument, wherein said secondary feedback comprises data sensed by the surgical instrument, wherein said second layer at least partially overlays said first layer, and wherein at least one input to said touch-sensitive interface is configured to manipulate said secondary feedback of said second layer relative to said primary feedback of said first layer, wherein the at least one input comprises dragging at least one datum of said data sensed by the surgical instrument to a particular position on said screen relative to the surgical instrument depicted in said second layer.

9. A system in signal communication with a surgical instrument for displaying feedback during an endoscopic operation, the system comprising:

a screen comprising a touch-sensitive interface, wherein said touch-sensitive interface is configured to receive at least one input;

a first layer depicted on said screen, wherein said first layer comprises primary feedback from the surgical instrument; and

a second layer depicted on said screen, wherein said second layer comprises secondary feedback from the surgical instrument, wherein said second layer at least partially overlays said first layer, and wherein at least one input to said touch-sensitive interface is configured to manipulate said secondary feedback of said second layer relative to said primary feedback of said first layer;

wherein the at least one input comprises selecting a portion of said secondary feedback, wherein the portion of said secondary feedback corresponds to a feature of the surgical instrument, and wherein the selected portion of said secondary feedback self-locates to a position on said screen near the corresponding feature of the surgical instrument depicted in said first layer.

10. The system of claim 9, wherein the position on said screen overlaps the corresponding feature of the surgical instrument depicted in said first layer.

11. A system in signal communication with a surgical instrument for displaying feedback during an endoscopic operation, the system, comprising:

a screen positioned remotely from the surgical instrument and comprising a touch-sensitive interface, wherein said touch-sensitive interface is configured to receive at least one input;

a first layer depicted on said screen, wherein said first layer comprises primary feedback from the surgical instrument;

a second layer depicted on said screen, wherein said second layer comprises secondary feedback from the surgical instrument, wherein said second layer at least partially overlays said first layer, and wherein at least one input to said touch-sensitive interface is configured to manipulate said secondary feedback of said second layer relative to said primary feedback of said first layer; and

a controller in signal communication with said touch-sensitive interface and the surgical instrument, wherein said controller selectively controls the surgical instrument based on said at least one input.

12. A device in signal communication with an endoscopic instrument, the device comprising:

an underlying display of video feedback from the endoscopic instrument;

an overlying display of dynamic feedback from the endoscopic instrument; and

manipulation means for rearranging at least a portion of said overlying display of dynamic feedback relative to said underlying display of video feedback.

13. The device of claim 12, wherein said overlying display of dynamic feedback comprises information sensed by the endoscopic instrument.

14. The device of claim 12, wherein said manipulation means comprises a touch screen.

15. A system for use with a surgical instrument, the system comprising:

a screen separate from the surgical instrument and comprising a touch-sensitive interface, wherein feedback from the surgical instrument is configured to be depicted on said screen, and wherein said feedback comprises;

an endoscopic video feed; and

a condition of the surgical instrument overlaying at least a portion of said endoscopic video feed; and

a controller in signal communication with said touch-sensitive interface and the surgical instrument, wherein said controller selectively controls the surgical instrument based on input to said touch-sensitive interface.

16. The system of claim 15, wherein said controller communicates with the surgical instrument wirelessly.

17. The system of claim 15, wherein the surgical instrument comprises a threshold limit, and wherein said controller controls the surgical instrument to surpass the threshold limit.

18. The system of claim 15, wherein said touch-sensitive interface comprises a plurality of controls, and wherein said plurality of controls are adjustable.

19. A system for use with a surgical instrument, the system comprising:

a screen comprising a touch-sensitive interface, wherein feedback from the surgical instrument is configured to be depicted on said screen, and wherein said feedback comprises;

an endoscopic video feed; and

a condition of the surgical instrument overlaying at least a portion of said endoscopic video feed; and

a controller in signal communication with said touch-sensitive interface and the surgical instrument, wherein said controller selectively controls the surgical instrument based on input to said touch-sensitive interface;

wherein said touch-sensitive interface comprises a manipulatable schematic of at least a portion of the surgical instrument, and wherein manipulation of said manipulatable schematic is configured to control the corresponding at least a portion of the surgical instrument.

20. The system of claim 19, wherein said manipulatable schematic is moveable relative to said endoscopic video feed.