Computing systems and methods for electronically indicating the acceptability of a product

• US 9,224,120 B2
• Filed: 10/19/2011
• Issued: 12/29/2015
• Est. Priority Date: 04/20/2010
• Status: Active Grant

• Current Assignee: Temptime Corporation (Zebra Technologies Corporation)
• Original Assignee: Temptime Corporation (Zebra Technologies Corporation)
• Inventors: Grabiner, Frederick R., Lentz, Carl M., Moore, Emily, Prusik, Thaddeus, Osborn, Bruce-Erik, Puro, Nicholas
• Primary Examiner(s): Nguyen, Kira
• Application Number:
  US13/276,543
• Publication Number:
  US 20120175412A1
• Time in Patent Office: 1,532 Days
• Field of Search: 705/317, 382/141
• US Class Current: 1/1
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06Q 10/0833 Tracking
• CPC Class Codes: G06Q 10/087 Inventory or stock management, e.g. order filling, procurement or balancing against orders
• CPC Class Codes: G06Q 30/0623 Item investigation
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06T 7/90 Determination of colour characteristics
• CPC Class Codes: G07G 1/0054 with control of supplementary check-parameters, e.g. weight or number of articles
• CPC Class Codes: G07G 1/0081 the reader being a portable scanner or data reader G07G1/009 takes precedence
• CPC Class Codes: G16H 10/00 ICT specially adapted for the handling or processing of patient-related medical or healthcare data for medical reports G16H15/00; for therapies or health-improving plans G16H20/00; for the handling or processing of medical images G16H30/00
• CPC Class Codes: G16H 15/00 ICT specially adapted for medical reports, e.g. generation or transmission thereof
• CPC Class Codes: G16H 20/00 ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
• CPC Class Codes: G16H 20/13 delivered from dispensers
• CPC Class Codes: G16H 30/20 for handling medical images, e.g. DICOM, HL7 or PACS
• CPC Class Codes: G16H 40/20 for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
• CPC Class Codes: G16H 40/67 for remote operation

Abstract

In part, the invention relates to computing systems and methods for electronically indicating the acceptability of a product. An image capture and communication device may analyze a product label that includes one or more monitors, authentication elements, and identification elements. The image capture and communication device may determine the type and features of the monitors, authentication elements, and identification elements. The image capture and communication device may transmit data based on the type and features to a host server, which may transmit data associated with the host product to the image capture and communication device in, inter alia, the form of an acceptability report.

Claims

1. A computer-implemented method of optically processing a product label implementable using an image capture and communication device, the method comprising:

capturing, using a camera, first image data from a product label, wherein the product label comprises an environmental monitor having a first shape and an environmental monitor state, the first image data being captured from multiple angles using the camera;

receiving the first image data from the camera at a computer processor;

detecting, with the computer processor, the presence and position of the first shape from the first image data captured from multiple angles;

in response to detecting the presence and position of the first shape, processing with the computer processor the first image data captured from multiple angles to identify, based on the position of the first shape, a first subset of the first image data captured from multiple angles obtained with respect to the environmental monitor;

determining with the computer processor the environmental monitor state from the first subset of first image data captured from multiple angles; and

generating with the computer processor a product acceptability report based upon the determined monitor state.

2. The method of claim 1, further comprising:

capturing using the camera, second image data;

identifying a patterned region in the second image data;

processing the second image data in response to identifying the patterned region to identify a second subset of second image data containing a first identifier; and

determining a source of the first identifier, wherein the acceptability report further comprises information relating to the determined source.

3. The method of claim 2 wherein the first identifier is disposed on or near the product label and wherein the identifying a patterned region, processing the first image data in response to identifying the patterned region, and determining a source of the first identifier, and generating a product acceptability report are performed using the image capture and communication device.

4. The method of claim 1 wherein the image capture and communication device is a mobile device comprising a display and the camera, and the acceptability report is human readable, the method further comprising:

displaying the acceptability report on the display.

5. The method of claim 4 further comprising:

preventing the captured first image data from being pre-processed after the image is captured by the camera by controlling an application programming interface used to control the camera.

6. The method of claim 4 wherein the first image data comprises a plurality of frames of image data and wherein the method further comprises

differentiating between the plurality of frames and removing optical defects based on the differences between the plurality of frames.

7. The method of claim 4, further comprising:

adjusting a dynamic range for the first image data using a patterned region as a reference, the patterned region comprising a black and white barcode.

8. The method of claim 4, further comprising:

identifying the first subset of image data based on the first image data captured from the plurality of angles.

9. The method of claim 4, wherein the product label is configured for use with a product that requires cold storage, but that can be exposed to an ambient room temperature for a predetermined time period such that the monitor state undergoes a change detectable in the first image data if the predetermined time period is exceeded, the method further comprising:

determining from the monitor state that the predetermined time period for exposure to the ambient room temperature has not been exceeded.

10. The method of claim 4, further comprising:

determining a first optical density value correlated with the environmental monitor state and comparing the first optical density value with a plurality of optical densities correlated with residual shelf lives of the product.

11. The method of claim 10, further comprising:

providing an estimated shelf life for the product in the acceptability report.

12. The method of claim 1, wherein the first shape is approximately circular, and wherein detecting the presence and position of the first shape further comprises:

identifying a plurality of ellipses in the first image data, the ellipses in the first image data being images of the circular indicator on the label.

13. The method of claim 4 further comprising:

capturing third image data from a second label using the camera, wherein the third image data comprises a second identifier defined by a patterned region; and

populating a records management system with event data associated with an event relating to a product associated with the product label and an entity associated with the second identifier.

14. The method of claim 13, wherein the event is selected from the group consisting of:

vaccination of the entity with the product;

delivery of the product to the entity;

performing a procedure on the entity;

rejection of the product by the entity;

consumption of the product by the entity;

acknowledgement of the acceptability report by the entity;

the entity performing an experiment using the product; and

combinations of two or more of the foregoing events.

15. The method of claim 4, wherein an other indicia is provided on the label, further comprising:

obtaining supplemental label data from the other indicia on the label and processing the first image data using the supplemental label data.

16. The method of claim 2, wherein the image capture and communication device is configured for communication with a host server, and wherein at least identifying a patterned region, processing the first image data in response to identifying the patterned region, and determining a source of the first identifier, and generating a product acceptability report are performed using the host server.

17. The method of claim 2, wherein the first and second image data are captured from a single image captured using the camera, and wherein the first image data and second image data are received at the computer processor from the camera as a single image file.