Systems and methods for surgical procedure safety

• US 20130113929A1
• Filed: 11/08/2011
• Published: 05/09/2013
• Est. Priority Date: 11/08/2011
• Status: Abandoned Application

• Current Assignee: Mary Maitland Deland
• Original Assignee: Mary Maitland Deland
• Inventors: DeLAND, Mary Maitland
• Application Number:
  US13/291,581
• Publication Number:
  US 20130113929A1
• Time in Patent Office: Days
• US Class Current: 348/143
• CPC Class Codes: A61B 2034/2065 Tracking using image or pattern recognition
• CPC Class Codes: A61B 90/361 Image-producing devices, e.g. surgical cameras
• CPC Class Codes: A61B 90/90 Identification means for patients or instruments, e.g. tags
• CPC Class Codes: G06F 18/254 of classification results, e.g. of results related to same input data
• CPC Class Codes: G06V 10/809 of classification results, e.g. where the classifiers operate on the same input data
• CPC Class Codes: G06V 20/30 in albums, collections or shared content, e.g. social network photos or video
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69

Abstract

The systems and methods describe herein can track instruments or tools with one or more cameras adapted to view predetermined areas. A memory unit stores video from the one or more cameras. A recognition unit is adapted to recognize identities and positions of instruments or tools in images produced by the one or more cameras. A control unit is adapted to track positions of the instruments or tools, based on an output of the recognition unit and to store the identities and the positions of the instruments or tools in the memory unit. An output unit is adapted to indicate to an operator, the positions of the instruments or tools in the predetermined areas, and to indicate when all of a predetermined set of instruments or tools in the predetermined areas are located within a view of one or more predetermined cameras of the one or more cameras.

Claims

1. A method of tracking surgical instruments comprising:

imaging predetermined areas with one or more cameras to form time sequences of images;

storing the time sequences of the images in a memory;

recognizing, by a recognition unit, an identity and positions of the instruments or tools in the images of the predetermined areas;

tracking movement of the instruments or tools in and between the predetermined areas using the recognized instruments or tools and the positions of the recognized instruments or tools;

storing a time of the movement of each instrument or tool and storing the identity of the instrument or tool and the time in the memory; and

indicating when a predetermined set of instruments or tools is in predetermined ones of the predetermined areas.

2. The method of claim 1, further comprising determining the predetermined set of instruments based the recognition of instruments or tools in images of the predetermined areas formed before a procedure begins.

3. The method of claim 1, wherein indicating that the predetermined set of instruments or tools is in predetermined one of the predetermined areas comprises outputting using a synthesized or recorded voice.

4. The method of claim 1, wherein each time the movement of a one of the instruments or tools is detected, outputting an indication of the movement using a synthesized or recorded voice indicating the identity of the instrument or tool.

5. The method of claim 1, further comprising displaying a list of the times that a selected instrument was moved based on a request from a user.

6. The method of claim 5, further comprising displaying a portion of the time sequences of the images based on a time selected from the displayed list.

7. The method of claim 1, further comprising determining the predetermined set of instruments or tools based on recognizing, by the recognition unit, the identity and the positions of the instruments or tools in the images of the predetermined areas formed before a procedure is begun.

8. The method of claim 1, wherein the predetermined set of instruments or tools is based on a template of instruments or tools stored in the memory, and the method further comprises determining if all of a list of instruments or tools on the template are recognized by the recognition unit in the images of the predetermined areas formed before a procedure is begun, the template corresponding to the procedure to be performed.

9. The method of claim 1, the method further comprising:

indicating that each of a predetermined set of parts can no longer be recognized by the recognition unit has been in images of predetermined ones of the predetermined areas.

10. The method of claim 1, wherein the instruments or tools are surgical instruments.

11. A system for tracking instruments or tools comprising:

one or more cameras adapted to view predetermined areas;

a memory unit that stores video from the one or more cameras;

a recognition unit adapted to recognize identities and positions of instruments or tools in images produced by the one or more cameras;

a control unit adapted to track positions of the instruments or tools, based on an output of the recognition unit and to store the identities and the positions of the instruments or tools in the memory unit; and

an output unit adapted to indicate to an operator, the positions of the instruments or tools in the predetermined areas, and to indicate when all of a predetermined set of instruments or tools in the predetermined areas are located within a view of one or more predetermined cameras of the one or more cameras.

12. The system of claim 11, wherein the output unit outputs speech indicating that all of the tools in the predetermined areas are located within the view of one or more predetermined cameras of the one or more cameras.

13. The system of claim 12, wherein the control unit is adapted to store in the memory unit times that the positions of the instruments are changed.

14. The system of claim 13, wherein the control unit is adapted to output the times that the position of a selected one of the instruments or tools was changed from the memory unit.

15. The system of claim 14, wherein the control unit is adapted to play portions of the stored video from the one or more cameras corresponding to the times that the position of the selected instrument or tool changed.

16. The system of claim 11, wherein the control unit is adapted to record the identity of each one of the instruments or tools recognized in by the recognition unit in images from the one or more cameras taken before a start of a procedure and to check that each one of the instruments and tools are recognized by the recognition unit in images from the one or more cameras taken at an end of the procedure.

17. The system of claim 16, wherein the control unit is further adapted to record the identity of each one of one or more parts recognized in by the recognition unit in images from the one or more cameras taken before the start of a procedure and to check that each one of each one of the one or more parts not recognized by the recognition unit in images from the one or more cameras taken at the end of the procedure.

18. The system of claim 16, wherein the control unit is further adapted to record the identity of each one of one or more parts recognized in by the recognition unit in images from the one or more cameras taken before the start of a procedure and to check that each one of each one of the one or more parts not recognized by the recognition unit in images from the one or more cameras taken at the end of the procedure.

19. The system of claim 11, wherein the control unit is adapted generate an output to indicate the identity of the instruments moved each time an instrument is moved.

20. The system of claim 11, wherein the instruments or tools are surgical instruments.