Automated dispensary for identifying embossed characters and package labeling

• US 8,577,145 B2
• Filed: 12/19/2009
• Issued: 11/05/2013
• Est. Priority Date: 12/19/2009
• Status: Active Grant

• Current Assignee: MedAvail, Inc. (Walgreens Boots Alliance Incorporated)
• Original Assignee: Pcas Patient Care Automation Services Inc.
• Inventors: Panetta, Richard
• Primary Examiner(s): Li, Ruiping
• Application Number:
  US12/642,786
• Publication Number:
  US 20110150346A1
• Time in Patent Office: 1,417 Days
• Field of Search: 382/104, 382/218, 382/321, 382181-189, 382141-143, 348/148, 348/E7.085
• US Class Current: 382/181
• CPC Class Codes: A47F 1/04 Racks or containers with arrangements for dispensing articles , e.g. by means of gravity or springs
• CPC Class Codes: G06K 15/024 for printing on segmented surfaces, e.g. sticker sheets, label rolls
• CPC Class Codes: G06K 7/10712 Fixed beam scanning
• CPC Class Codes: G06K 7/12 using a selected wavelength, e.g. to sense red marks and ignore blue marks
• CPC Class Codes: G06V 30/10 Character recognition
• CPC Class Codes: G06V 30/12 Detection or correction of errors, e.g. by rescanning the pattern
• CPC Class Codes: G06V 30/1429 Identifying or ignoring parts by sensing at different wavelengths
• CPC Class Codes: G06V 30/1434 Special illumination such as grating, reflections or deflections, e.g. for characters with relief

Abstract

In a method and apparatus for identifying an embossed character, light of one color is directed in one direction across the embossed character to illuminate certain character parts and light of another color is directed in another direction across the embossed character to illuminate other character parts. Image data for the two colors are captured and are subjected to separate image processing to detect edges highlighted by the directed light. The processed images are combined and supplemented with OCR analysis before being compared with predicted characters. Based on the comparison, a determination is made as to the probable identity of the character.

Claims

1. A method comprising:

loading a plurality of packages into respective storage stations inside a robotic prescription dispensary, wherein each said package has;

a substantially planar outside surface with an embossed character therein; and

a shape and size different from that of a plurality of other said packages in respective said storage stations inside the robotic prescription dispensary;

for each package loaded inside the robotic prescription dispensary;

retrieving the package from the corresponding said storage station;

moving the package to an inspection station inside the robotic prescription dispensary;

directing first light in a first direction across the embossed character to illuminate first parts of the embossed character;

recording first image data representing the embossed character illuminated by the first light;

directing second light in a second direction across the embossed character to illuminate second parts of the embossed character;

recording second image data representing the embossed character illuminated by the second light;

combining the first image data and the second image data to produce combined image data;

comparing the combined image data to reference data;

on the basis of the comparison, identifying the embossed character;

applying the identified embossed character as an identifying label to the package;

retrieving the labeled package from the inspection station inside the robotic prescription dispensary; and

moving the labeled package to one of the storage stations inside the robotic prescription dispensary;

receiving, from a network, information containing a script for a medicament prescribed to a patient;

picking one said labeled package in one said storage station inside the robotic prescription dispensary bearing the identifying label that corresponds to the script for the medicament prescribed to the patient;

printing, and applying to the picked package, a prescription label corresponding to;

the identifying label; and

the patient;

and

dispensing the prescription labeled picked package to a user of the robotic prescription dispensary.

2. The method as defined in claim 1, further comprising, the first light having a first color and the second light having a second color.

3. The method as defined in claim 1, further comprising directing each of the first and the second light at a low angle of incidence to a plane of a surface within which the embossed character is formed.

4. The method as defined in claim 1, further comprising the first direction being orthogonal to the second direction.

5. The method as defined in claim 1 further comprising providing to the user information relevant to the prescription labeled picked package dispensed to the user of the robotic prescription dispensary.

6. The method as defined in claimed in claim 1, further comprising subjecting each of the first and second images to image processing prior to combining the first and second image data, wherein the image processing includes detecting character edges.

7. The method as defined in claim 6, wherein:

the first image data is scanned in the first direction to detect first character edges; and

the second image data is scanned in the second direction to detect second character edges.

8. The method as defined in claim 1, further comprising:

obtaining a supplementary image of the character and processing data representing the combined image with data representing the supplementary image;

based on the processed data, identifying the character; and

obtaining the supplementary image data using an OCR (optical character recognition) technique.

9. The method as defined in claim 1, further comprising providing a receipt for the script to the user of the robotic prescription dispensary.

10. The method as defined in claim 1, further comprising comparing the combined image data with predicted image data to derive a recognition confidence factor depending on a degree of matching of the combined image data to the predicted image data.

11. The method as defined in claim 10, further comprising adjusting imaging conditions to maximize the recognition confidence factor.

12. The method as defined in claim 10, further comprising adjusting at least one of package position and orientation to maximize the recognition confidence factor.

13. A system comprising:

a loader module operable to load a plurality of packages into respective storage stations inside a robotic prescription dispensary, wherein each said package has;

a substantially planar outside surface with an embossed character therein; and

a shape and size different from that of a plurality of other said packages in respective said storage stations inside the robotic prescription dispensary;

for each package loaded inside the robotic prescription dispensary;

a mover module operable to;

retrieve the package from the corresponding said storage station; and

move the package to an inspection station inside the robotic prescription dispensary;

an inspection module in the inspection station inside the automated dispensary having a lighting sub-system for;

directing first light in a first direction across the embossed character to illuminate first parts of the embossed character; and

directing second light in a second direction across the embossed character to illuminate second parts of the embossed character;

an imaging sub-system for recording;

first image data representing the embossed character illuminated by the first light; and

-second image data representing the embossed character illuminated by the second light; and

a processing sub-system having a filtering module to filter;

the first image data to obtain first edge data corresponding to the light directed in the first direction; and

the second image data to obtain second edge data corresponding to the light directed in the second direction;

a combining module for combining the first image data and the second image data to produce combined image data; and

an identification module to identify the embossed character from the combined image data;

a labeling module operable to apply the identified embossed character as an identifying label to the package;

a first retrieving module operable to retrieve the labeled package from the inspection station inside the robotic prescription dispensary; and

a second mover module operable to move the labeled package to one of the storage stations inside the robotic prescription dispensary;

a receiver module operable to receive, from a network, information containing a script for a medicament prescribed to a patient;

a picking module operable to pick one said labeled package in one said storage station inside the robotic prescription dispensary bearing the identifying label that corresponds to the script for the medicament prescribed to the patient;

a printing and applying module operable to print and apply to the picked package, a prescription label corresponding to;

the identifying label; and

the patient;

and

a dispensing module operable to dispense the prescription labeled picked package to a user of the robotic prescription dispensary.

14. The system as defined in claim 13, further comprising, the lighting sub-system including a first light source having light output of a first color and a second light source having light output at a second color.

15. The system as defined in claim 14, further comprising the lighting sub-system having directing means to direct each of the first and the second light at a low angle of incidence to a plane of a surface within which the embossed character is formed.

16. The system as defined in claim 15, further comprising the directing means operable to direct the first light in the first direction and the second light in the second direction, the first and second directions being orthogonal to one another.

17. The system as defined in claim 13, further comprising provider module operable to provide to the user information relevant to the prescription labeled picked package dispensed to the user of the robotic prescription dispensary.

18. A method comprising:

for each of plurality of robotic prescription dispensaries connected by a communications network;

loading a plurality of unserialized packages into respective storage stations inside the robotic prescription dispensary, wherein each said package bears embossed characters therein;

and

for each said unserialzed package loaded inside the robotic prescription dispensary;

retrieving the package from the corresponding said storage station;

moving the package to an inspection station inside the robotic prescription dispensary;

directing a plurality of lights, each being in a different direction, across the embossed characters to illuminate a corresponding part of the embossed characters;

recording, for each said light, corresponding image data representing the embossed characters illuminated by the light;

combining the recorded image data for each said light to produce combined image data;

comparing the combined image data to reference data;

on the basis of the comparison, identifying the embossed characters;

sending the identified embossed characters in a transmission addressed for delivery to a location on the communications network;

receiving, in response to the sent transmission, a transmission from an address on the communications and containing modified identified embossed characters corresponding to the identified embossed characters in the sent transmission;

applying an identifying label to the package having the modified identified embossed characters as at least a part of a serialization of the package;

retrieving the labeled package from the inspection station inside the robotic prescription dispensary; and

moving the labeled package to one of the storage stations inside the robotic prescription dispensary;

receiving, from the communications network, information containing a script for a medicament prescribed to a patient;

picking one said labeled package in one said storage station inside the robotic prescription dispensary bearing the identifying label that corresponds to the script for the medicament prescribed to the patient;

printing, and applying to the picked package, a prescription label corresponding to;

the identifying label; and

the patient;

and

dispensing the prescription labeled picked package to a user of the robotic prescription dispensary.

19. The method as defined in claim 18, wherein each said unserialized package has:

a substantially planar outside surface with the embossed character therein; and

a shape and size different from that of a plurality of other said packages in respective said storage stations inside the robotic prescription dispensary.

20. The method as defined in claim 18, further comprising providing to the user information relevant to the prescription labeled picked package dispensed to the user of the robotic prescription dispensary.