Method, system, and apparatus for identifying pharmaceutical products

• US 9,008,411 B2
• Filed: 05/09/2011
• Issued: 04/14/2015
• Est. Priority Date: 05/09/2011
• Status: Expired due to Fees

• Current Assignee: Mini Graphics, Inc.
• Original Assignee: Mini Graphics, Inc.
• Inventors: DeLise, Stephen W. Jr., DeLise, James F., DeLise, Frank
• Primary Examiner(s): BHATNAGAR, ANAND P
• Application Number:
  US13/103,285
• Publication Number:
  US 20120290619A1
• Time in Patent Office: 1,436 Days
• Field of Search: 382/100, 382/103, 382/154, 382/181, 382/190, 382/195, 382/203, 382/285, 707609-686, 348/92, 348/135, 348169-172
• US Class Current: 382/154
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 20/66 Trinkets, e.g. shirt buttons or jewellery items recognising microscopic objects G06V20/69
• CPC Class Codes: G16H 20/10 relating to drugs or medications, e.g. for ensuring correct administration to patients
• CPC Class Codes: G16H 70/40 relating to drugs, e.g. their side effects or intended usage

Abstract

A method, system and apparatus is provided for identifying pharmaceutical products. A database of known pharmaceuticals is provided with links to virtual 3D models of each pharmaceutical. When a pill needs to be identified, an image of the pill is transmitted to the database CPU. The CPU screens out non-matching records and obtains perspective data based on the orientation of the pill. The CPU manipulates a 3D model into the same perspective as the pill to facilitate identification.

Claims

1. A method for identifying a pill comprising the steps of:

storing a pharmaceutical database on an electronic storage device including a virtual 3D model of each pharmaceutical within the database;

transmitting a simple 2D image of a pill to a central processing unit (CPU) that is operatively coupled to the pharmaceutical database;

determining the perspective of the 2D image; and

generating an image of the virtual 3D model from a perspective that matches the perspective of the 2D image.

2. The method of claim 1, wherein the pharmaceutical database includes a plurality of records of known pharmaceuticals, each record contains (i) a virtual 3D model, (ii) static characteristics comprising color, shape and alphanumeric characters of the pharmaceutical, and (iii) medical and safety data.

3. The method of claim 2, wherein the simple 2D image comprises an image taken at a remote field location under ambient lighting conditions with a commercially available digital camera in the absence of spectrally modified lighting other than the camera'"'"'s flash.

4. The method of claim 3, wherein the transmitting step comprises transmitting simple 2D query image via a wireless cellular telephone network to the CPU, wherein the CPU contains a set of instructions for performing data and image processing, and comparing functions.

5. The method of claim 2, wherein prior to said generating step, the method further includes:

analyzing the simple 2D image to identity one of the color, shape or alphanumeric characters of the imaged pill, wherein the simple 2D image comprises a 2D query image.

6. The method of claim 5, wherein following said analyzing step and prior to said generating step, the method further includes:

comparing one of the identified color, shape or alphanumeric characters to the static characteristics in the database to divide the records into a no-match group and a matched group, whereby only records in the matched group will be eligible for the generating step.

7. The method of claim 6, wherein said generating step includes retrieving a virtual 3D model from a record in the matched group and generating a perspective-adjusted 3D model.

8. The method of claim 7, wherein said generating step includes rendering a 2D matching image of the perspective-adjusted 3D model and comparing the 2D matching image to the 2D query image.

9. The method of claim 6, wherein following said generating and comparing steps, the method includes:

identifying the pill as a known pharmaceutical and transmitting medical and safety data for that pharmaceutical back to the source of the query.

10. A system for identifying a pill comprising:

an electronic storage device containing a pharmaceutical database including a virtual 3D model of each pharmaceutical in the database;

a central processing unit (CPU) operatively coupled to said electronic storage device;

a set of instructions for programming the CPU to perform data and image processing in response to a database query; and

an image generating module that generates an image of a 3D model, wherein the selection of the 3D model is based on said data processing results and the image type is based on said image processing result.

11. The system of claim 10, further comprising a simple query image of a pill requiring identification and a telecommunications network for transmitting the query image to the CPU.

12. The system of claim 11, wherein the pharmaceutical database includes a plurality of records of known pharmaceuticals, each record contains (i) a link to a virtual 3D model, (ii) static characteristics comprising color, shape and alphanumeric characters of the pharmaceutical, and (iii) medical and safety data.

13. The system of claim 12, wherein the image generating module contains a set of instructions for manipulating the 3D model which is capable of showing the 3D model in any orientation and at a range of scales.

14. The system of claim 13, wherein the CPU obtains perspective and scale data from the query image and the image generating module orients the 3D model based on the perspective data to obtain the same perspective as the query image, wherein the oriented 3D model is defined as a perspective-adjusted 3D model.

15. The system of claim 14, wherein the perspective data from the query image is recorded via a coordinate system and transferred to the 3D model.

16. The system of claim 15, wherein the scale data is obtained from a reference object in the query image.

17. The system of claim 16, further including a reference library coupled to the image generating module, wherein the reference library contains 3D models of common objects used to scale the perspective-adjusted 3D model.