Automated use of a vision system to unroll a label to capture and process drug identifying indicia present on the label

• US 7,017,623 B2
• Filed: 06/21/2004
• Issued: 03/28/2006
• Est. Priority Date: 06/21/2004
• Status: Active Grant

• Current Assignee: Baxter Corporation Englewood (Baxter International Inc.)
• Original Assignee: Forhealth Technologies Incorporated (Baxter International Inc.)
• Inventors: Osborne, Joel A., Tribble, Dennis
• Primary Examiner(s): Douglas, Steven O.
• Application Number:
  US10/873,420
• Publication Number:
  US 20050279419A1
• Time in Patent Office: 645 Days
• Field of Search: 141/2, 141/18, 141 21- 27, 141/94, 141/95, 141/198, 141/100, 141/104, 604/407, 604/411, 604/416
• US Class Current: 141/27
• CPC Class Codes: A61M 2205/6063 Optical identification systems
• CPC Class Codes: G09F 3/02 Forms or constructions layered products B32B

Abstract

In one exemplary embodiment, an automated medication preparation is provided and typically involves the preparation and dispensing of drug products, whether they are in a bag, a syringe or via some other type of administration vehicle. The system includes: an automated device for delivering a prescribed unit dose of medication to a drug product container from a drug container. A label containing medication information (medication identifying indicia) is disposed about an outer surface, e.g., a circumference, of the drug container. The automated system includes a vision system for detecting and processing the medication identifying indicia that is found on the label, the vision system is capable of reading a bar code that is formed on the label and includes a second optical device for producing a rollout image of the label as the drug vial is rotated on a turntable, as well as an optical recognition system (software) for reading a particular coordinate location of the rollout image and for detecting and recognizing characters that represent medication information associated with the drug container as well as bar code information. When the occurrence of a prescribed event is detected by one of the first and second optical devices, a controller prevents the unit dose from being delivered from the drug container to the drug product container.

Claims

1. An automated medication preparation system including preparation and dispensing of a drug product that is initially stored in a drug container having a label containing medication identifying indicia disposed on an outer surface of the drug container, the system comprising:

an automated device for preparing and dispensing a prescribed unit dose of medication; and

a vision system including;

(1) a camera that faces the drug container and is configured to produce a rollout image of the label as the drug container is rotated so as to capture the entire surface of the label;

(2) a mapping system that maps the rollout image to produce a two dimensional coordinate map overlaid on the rollout image and (3) an optical character recognition system that is configured to read a particular coordinate location of the rollout image for detecting any characters that may be present therein and that are part of the medication identifying indicia, wherein the processing of the medication identifying indicia influences the further processing of the drug container.

2. The automated system of claim 1, wherein the automated device dispenses the prescribed unit dose of medication by injecting the medication through an uncapped barrel of a syringe in a just-in-time for use manner and includes an automated device having a fluid delivery device that includes a main conduit, wherein the fluid delivery device is adapted to perform the following operations:

(1) receive and dispense diluent from a diluent supply in a prescribed amount to reconstitute the medication in the drug container; and

(2) aspirating the reconstituted medication into the main conduit and later discharging the reconstituted medication from the drug container into the syringe.

3. The automated system of claim 2, wherein the fluid delivery device is fluidly connected to the main conduit that is selectively connected at its opposite end to the diluent source and to a means for creating either negative pressure or positive within the main conduit for aspirating fluid into the main conduit or discharging fluid therefrom, respectively.

4. The automated system of claim 3, wherein the means comprises:

a collection member for storing diluent received from either the diluent source or diluent that is drawn into the collection member from a downstream section of the main conduit; and

a control unit and a valve mechanism that are operatively connected to the collection member to create negative pressure therein to drawn fluid therein or to create positive pressure to force fluid to be discharged therefrom.

5. The automated system of claim 4, wherein the collection member comprises:

a first syringe having a barrel with an interior having a first volume; and

a second syringe having a barrel with an interior having a second volume;

wherein each of the first and second syringes having a slideable plunger contained in the respective barrel and each syringe being in selective fluid communication with each of the diluent source and the main conduit that leads to the fluid delivery device.

6. The automated system of claim 5, wherein the control unit comprises:

a first syringe driver associated with the first syringe for selectively moving the plunger a prescribed distance;

a second syringe driver associated with the second syringe for selectively moving the plunger a prescribed distance; and

the valve mechanism includes a first valve for providing selective fluid communication between the control unit and the diluent source and a second valve for providing selective fluid communication between the control unit and the downstream section of the main conduit.

7. The automated system of claim 6, wherein the first and second syringes are fluidly interconnected by a connector conduit that has a valve associated therewith for permitting selective flow between the syringes.

8. The automated system of claim 6, wherein at least one of the first and second syringes has an input port and an output port with the input port being connected to a first conduit that connects at its opposite end to the diluent source with a valve being associated with the first conduit to provide selective communication between the diluent source and the input port, the output port being connected to a second conduit that connects at its opposite end to the main conduit with a valve being associated with the second conduit to provide selective communication between the output port and the main conduit.

9. The automated system of claim 6, wherein each of the first and second syringe drivers comprises a stepper motor that operates such that an incremental distance of movement of the plunger is equated to a number of steps through which the motor is driven, thereby permitting precise control over the exact distance that the plunger is moved.

10. The automated system of claim 1, wherein the drug container is disposed on a rotatable turntable that is in operative communication with a master controller that is also operatively connected to the camera so as to calculate an optimal speed of the turntable, based on a number of inputted parameters including a circumference of the drug container, as well as an optimal focusing distance of the camera to ensure that a high quality rollout image is captured and produced.

11. The automated system of claim 1, wherein the vision system is a digital system and the camera is of the type that provides a digital rollout image and large format digital panorama images.

12. The automated system of claim 1, wherein the vision system includes software for reading a bar code that forms a part of the medication identifying indicia that is included as part of the rollout image of the label.

13. The automated system of claim 12, wherein the medication identifying indicia that is represented by the bar code includes at least a National Drug Code (NDC) which identifies a labeler/vendor, product, and trade package size associated with the drug container being imaged.

14. The automated system of claim 12, wherein the bar code is located in a first location on the label and an expiration date and lot number are located in a second different location on the label such that the optical character recognition system is instructed to read the second location and to recognize any characters contained therein before performing contextual processing where the medication identifying indicia is recognized.

15. The automated system of claim 1, wherein the mapping system overlays an X, Y coordinate map on the rollout image produced by the camera and stored in a computer system that is operatively connected to the camera, the camera capturing the rollout image and then sending a signal to the computer system that represents a digital image of the label that can be displayed on a display with the X, Y coordinate map being laid thereover to divide the label into a number of different coordinates.

16. The automated system of claim 15, wherein the computer system is operatively connected to the optical recognition system such that the optical recognition system can be instructed to read selected coordinates to detect and analyze any characters found therein in order to identify the characters.

17. The automated system of claim 15, wherein the computer system includes a database that contains coordinate locations on the label where select medication identifying indicia is present based on identifying information inputted into the computer system.

18. The automated system of claim 17, wherein the inputted identifying information includes labeler/vendor information, product information and trade package information.

19. The automated system of claim 17, wherein the select medication identifying indicia includes an expiration date of the medication contained in the drug container and lot number information for the drug container.

20. The automated system of claim 19, wherein the computer system includes a database that includes a list of lot numbers associated with drug medications that are subject to recall orders, wherein the lot number information that is detected on the rollout image of the label of the drug container is compared to the recall list and if the detected lot number is on the recall list, then the computer system instructs the automated system to remove the drug container and prevent it from being further processed.

21. The automated system of claim 19, wherein the computer system stores the present date and is configured so that the expiration date that is detected and read on the rollout image of the label of the drug container is compared to the present date and if the expiration date has passed or if the expiration date is within a threshold number of days from the present date, then the computer system instructs the automated system to remove the drug container and prevent it from being further processed.

22. The automated system of claim 1, wherein the vision system includes software that digitizes a rollout image that is produced by the camera, the digitized rollout image being delivered to a computer system that stores the image and overlays the coordinate map thereon.

23. An automated medication preparation system including preparation and dispensing of a drug product that is initially stored in a drug container having a label containing medication identifying indicia disposed on an outer surface of the drug container, the system comprising:

an automated device for preparing and dispensing a prescribed unit dose of medication; and

a vision system for detecting and processing the medication identifying indicia that is found on the label, the vision system including;

a rollout camera for producing a rollout image of the label;

an optical device including first software for reading medication identifying indicia other than a bar code from the rollout image of the label, the optical device including second software for reading a bar code that is present on the rollout image of the label; and

a controller in communication with the vision system such that when an occurrence of a prescribed event is detected by the vision system, the controller prevents the unit dose from being delivered from the drug container to an intended drug storage member.

24. The automated system of claim 23, wherein the automated device dispenses the prescribed unit dose of medication by injecting the medication into a product storage member in a just-in-time for use manner, wherein the automated device for dispensing the unit dose of medication to the product storage member comprises an automated device having a fluid delivery device that includes a main conduit, wherein the fluid delivery device is adapted to perform the following operations:

(1) receiving and discharging diluent from a diluent supply in a prescribed amount to reconstitute the medication in a drug container; and

(2) aspirating the reconstituted medication into the main conduit and later discharging the reconstituted medication from the drug container into the product storage member.

25. The automated system of claim 23, wherein the optical device includes an optical character recognition system that processes images, marks, characters, or illustrations detected as part of the rollout image into a format that is identifiable by a computer that is associated with the controller.

26. The automated system of claim 23, further including a rotatable turntable upon which the drug vial sits in sight of the rollout camera such that the synchronized rotation of the drug container and controlling a focusing distance of the camera yield a high quality rollout image of the label that captures the entire landscape of the label.

27. The automated system of claim 23, further including a mapping system for producing a two dimensional coordinate map that is overlaid on a digitized rollout image of the label after its image is captured by the rollout camera, the label being divided into a number of regions that are identifiable by X, Y coordinates.

28. The automated system of claim 23, wherein the bar code includes at least a National Drug Code (NDC) which identifies a labeler/vendor, product, and trade package size associated with the drug container being imaged.

29. The automated system of claim 25, wherein the bar code is located in a first location on the label and wherein the medication identifying indicia other than the barcode includes an expiration date and lot number that are located in a second different location on the label such that the optical character recognition system is instructed to read the second location and to recognize any characters contained therein before performing contextual processing where the medication identifying indicia is recognized and is sent to the controller for additional processing.

30. The automated system of claim 23, wherein one of the prescribed events is a situation where the detected expiration date is earlier than the present date or within a predetermined number of days from the present date, and whereupon the occurrence of this situation, the controller instructs the automated system to remove the drug container, thereby preventing any unit dose from being withdrawn therefrom.

31. The automated system of claim 23, wherein one of the prescribed events is a situation where the detected lot number is included on list of lot numbers that are stored on a database associated with the controller and are those lot numbers that are associated with drug medications that are subject to recall orders, wherein the lot number information that is detected and read on the label of the drug container is compared to the recall list and if the detected lot number is on the recall list, then the computer system instructs the automated system to remove the drug container and prevent it from being further processed.

32. The automated system of claim 23, wherein the optical device includes an optical character recognition system that can be instructed to read a particular coordinate location of the rollout image for detecting any characters that may be present therein and that are part of the medication identifying indicia, wherein the processing of the medication identifying indicia influences the further processing of the drug container.

33. The automated system of claim 32, wherein the controller includes a database that contains mapping coordinates that are previously inputted therein and represent target coordinate locations for where the medication identifying indicia is likely positioned on the rollout image of the label based on prescribed search criteria.

34. The automated system of claim 33, wherein the medication identifying indicia comprises an expiration date and lot number information associated with the drug container and the prescribed search criteria includes at least a labeler/vendor of the drug container, a product name, and trade package size associated with the drug container.

35. The automated system of claim 34, wherein the optical character recognition system is instructed to read a particular coordinate location of the rollout image based on the target coordinate locations generated by the controller after a user inputs the prescribed search criteria.

36. The automated system of claim 23, wherein the label is disposed about a circumference of the drug container.

37. An automated medication preparation system including preparation and dispensing of a drug product that is initially stored in a drug container having a label containing medication identifying indicia disposed on an outer surface of the drug container and is later dispensed into a drug product container, the system comprising:

an automated device for preparing and dispensing a prescribed unit dose of medication; and

a vision system for detecting and processing the medication identifying indicia that is found on the label, the vision system including;

an optical device for producing a rollout image of the entire landscape of the label as the drug container is rotated on a turntable and an optical recognition system for reading a particular coordinate location of the rollout image and for detecting and recognizing characters that at least represent an expiration date and lot number information of the drug vial, the optical device including software for reading a bar code that is part of the rollout image of the label; and

a controller in communication with the vision system and being configured to compare product information read from the bar code with inputted product information and to compare the expiration date with a present date and the lot number with a drug recall list such that at least when one of (a) the read product information is different from the inputted product information;

(b) the expiration date is early than or within a prescribed number of days from the present date;

or (c) the lot number is on the recall list, than the controller prevents the unit dose from being automatically delivered from the drug container to the drug product container.

38. The automated system of claim 37, wherein the automated device delivers the prescribed unit dose of medication by delivering the medication to the drug product container in a just-in-time for use manner, wherein the automated device for delivering the unit dose of medication to the drug product container comprises an automated device having a fluid delivery device that includes a main conduit, wherein the fluid delivery device is adapted to perform the following operations:

(1) receiving and discharging diluent from a diluent supply in a prescribed amount to reconstitute the medication in a drug container; and

(2) aspirating the reconstituted medication into the main conduit and later discharging the reconstituted medication from the drug container into the drug product container, and wherein the drug product container is selected from the group consisting of a syringe and an I.V. bag.

39. An automated medication preparation system including preparation and dispensing of a drug product that is initially stored in a drug container having a label containing medication identifying indicia disposed on an outer surface of the drug container, the system comprising:

an automated device for preparing and dispensing a prescribed unit dose of medication; and

a vision system for optically unrolling a label to produce a rollout image of the label and to capture and process medication identifying indicia that is present on the label; and

a controller in communication with the vision system for preventing the unit dose from being automatically delivered from the drug container to the syringe when a prescribed event occurs.

40. The automated system of claim 39, wherein the automated device delivers the prescribed unit dose of medication by delivering the medication to the drug product container in a just-in-time for use manner, wherein the automated device for delivering the unit dose of medication to the drug product container comprises an automated device having a fluid delivery device that includes a main conduit, wherein the fluid delivery device is adapted to perform the following operations:

(1) receiving and discharging diluent from a diluent supply in a prescribed amount to reconstitute the medication in a drug container; and

(2) aspirating the reconstituted medication into the main conduit and later discharging the reconstituted medication from the drug container into the drug product container.

41. The automated system of claim 39, wherein the medication identifying indicia includes an expiration date and one of the prescribed events is a situation where a detected expiration date is earlier than the present date or within a predetermined number of days from the present date, and whereupon the occurrence of this situation, the controller instructs the automates system to remove the drug container, thereby preventing any unit dose from being withdrawn therefrom.

42. The automated system of claim 39, wherein the medication identifying indicia includes a lot number and one of the prescribed events is a situation where the detected lot number is included on list of lot numbers that are stored on a database associated with the controller and are those lot numbers that are associated with drug medications that are subject to recall orders, wherein the lot number information that is detected and read on the label of the drug container is compared to the recall list and if the detected lot number is on the recall list, then the controller instructs the automated system to remove the drug container and prevent it from being further processed.

43. The automated system of claim 39, wherein the medication identifying indicia identifies a labeler/vendor, product, and trade package size associated with the drug container being optically unrolled and one of the prescribed events is a situation where the read drug identifying indicia is different from inputted drug identifying indicia.

44. A method for automated preparation and dispensing of a unit dose of medication to a drug product container from a drug container in which a base medication is initially stored, wherein a label containing medication identifying indicia is disposed about an outer surface of the drug container, the method comprising the steps of:

providing a fluid delivery device for delivering a prescribed unit dose of medication to the drug product container;

placing the drug container on a rotatable turntable and rotating the drug container;

disposing a vision system proximate the rotating drug container, the vision system including a rollout camera that faces the drug container;

producing a rollout image of the label as the drug container is rotated;

processing the rollout image and detecting, with an optical character recognition system, any characters that are present in a select coordinate target zone of the label, the characters being part of the medication identifying indicia; and

preventing the drug container from being delivered to a downstream station where the unit dose of medication is withdrawn therefrom upon the occurrence of a prescribed event.

45. The method of claim 44, further including the step of:

reading, with software, a bar code that is disposed on an outer surface of the drug container;

comparing product information read from the bar code with inputted product information; and

wherein one of the prescribed events occurs when the read product information is different from the inputted product information.

46. The method of claim 44, wherein the step of:

detecting, with an optical character recognition system, any characters that are present in a select coordinate target zone of the label includes the steps of;

reading a particular coordinate location of the rollout image to optically detect and recognize characters that at least represent an expiration date and lot number information of the drug container;

comparing the expiration date with a present date and the lot number with a drug recall list; and

wherein one of the prescribed events occurs when either (a) the expiration date is earlier than or within a prescribed number of days from the present date;

or (b) the lot number is on the recall list.

47. The method of claim 44, further including the step of:

profiling where select medication identifying indicia are found on the label;

mapping and storing locations of the profiled select medication identifying indicia in a database;

using the stored medication identifying indicia to identify the select coordinate target zone.

48. A method for automated preparation and dispensing of a unit dose of medication to a drug product container from a drug container in which a base medication is initially stored, wherein a label containing medication identifying indicia is disposed about an outer surface of the drug container, the method comprising the steps of:

providing a fluid delivery device for delivering a prescribed unit dose of medication to the drug product container, wherein the fluid delivery device is adapted to aspirate reconstituted medication from the drug container into a main fluid conduit and later discharge the reconstituted medication into the drug product container;

placing the drug container on a rotatable turntable and rotating the drug container;

disposing a vision system proximate the rotating drug container for detecting and processing the medication identifying indicia that is found on the label, the vision system including an optical device including a rollout camera and associated character recognition software;

producing, with the rollout camera, a rollout image of the label as the drug container is rotated on the turntable;

reading, with the optical device, a bar code that is disposed on an outer surface of the drug container;

processing the rollout image by overlaying a coordinate map defined by map coordinates to assist in identifying particular zones of the label;

reading a particular coordinate location of the rollout image to optically detect and recognize characters that at least represent an expiration date and lot number information of the drug container;

comparing medication information read from the bar code with inputted medication information;

comparing the expiration date with a present date and the lot number with a drug recall list; and

preventing the unit dose from being automatically delivered from the drug container to the syringe upon the occurrence of at least one of the following events (a) the read medication information is different from the inputted medication information;

(b) the expiration date is earlier than or within a prescribed number of days from the present date;

or (c) the lot number is on the recall list.

49. The method of claim 48, wherein the fluid delivery device is in selective fluid communication with a fluid pump apparatus that is in selective fluid communication with a diluent source, the fluid pump apparatus having a first controllable syringe that is in fluid communication with the diluent source and with a second controllable syringe that is also in selective fluid communication with the fluid delivery device through the main conduit which is primed, each of the syringes being operably connected to a drive that causes either a positive or negative pressure to exist in a barrel thereof, and the step of reconstituting the medication includes the steps of:

opening fluid communication between the diluent source and the first syringe and preventing fluid communication between the second syringe and the fluid delivery device;

operating a drive of one of the first and second syringes to create a negative pressure therein resulting in a prescribed amount of diluent being drawn into the barrel thereof;

preventing fluid communication between the diluent source and the first syringe and allowing fluid communication between the second syringe and the delivery device;

operating the drive so as to discharge the prescribed amount of diluent from one of the first and second syringes into the primed main conduit resulting in the prescribed amount of diluent being discharged through the delivery device and into the drug container;

agitating contents of the drug container;

operating a drive of one of the first and second syringes to create a negative pressure therein resulting in the prescribed dosage amount of medication being aspirated into the main conduit with an air block separating the aspirated medication from the diluent in the main conduit due to a volume of diluent, which is equal to the prescribed dosage amount, be drawn into the drug product container;

positioning the delivery device within the syringe; and

operating the drive of one of the first and second syringes to create a positive pressure therein resulting in the prescribed dosage amount of medication being discharged from the main fluid conduit into the syringe as a result of the volume of diluent being discharged from the syringe into the main conduit.