Computing systems and methods for electronically indicating the acceptability of a product

• US 9,811,632 B2
• Filed: 12/28/2015
• Issued: 11/07/2017
• Est. Priority Date: 04/20/2010
• Status: Active Grant

• Current Assignee: Temptime Corporation (Zebra Technologies Corporation)
• Original Assignee: Temptime Corporation (Zebra Technologies Corporation)
• Inventors: Grabiner, Frederick Robert, Lentz, Carl Michael, Moore, Emily, Prusik, Thaddeus, Puro, Nicholas, Osborn, Bruce-Erik
• Primary Examiner(s): Nguyen, Kira
• Application Number:
  US14/981,457
• Publication Number:
  US 20160154939A1
• Time in Patent Office: 680 Days
• Field of Search: 705317, 382141
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06Q 10/0833 Tracking
• CPC Class Codes: G06Q 10/087 Inventory or stock management, e.g. order filling, procurement or balancing against orders
• CPC Class Codes: G06Q 30/0623 Item investigation
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06T 7/90 Determination of colour characteristics
• CPC Class Codes: G07G 1/0054 with control of supplementary check-parameters, e.g. weight or number of articles
• CPC Class Codes: G07G 1/0081 the reader being a portable scanner or data reader G07G1/009 takes precedence
• CPC Class Codes: G16H 10/00 ICT specially adapted for the handling or processing of patient-related medical or healthcare data for medical reports G16H15/00; for therapies or health-improving plans G16H20/00; for the handling or processing of medical images G16H30/00
• CPC Class Codes: G16H 15/00 ICT specially adapted for medical reports, e.g. generation or transmission thereof
• CPC Class Codes: G16H 20/00 ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
• CPC Class Codes: G16H 20/13 delivered from dispensers
• CPC Class Codes: G16H 30/20 for handling medical images, e.g. DICOM, HL7 or PACS
• CPC Class Codes: G16H 40/20 for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
• CPC Class Codes: G16H 40/67 for remote operation

Abstract

In part, the invention relates to computing systems and methods for electronically indicating the acceptability of a product. An image capture and communication device may analyze a product label that includes one or more monitors, authentication elements, and identification elements. The image capture and communication device may determine the type and features of the monitors, authentication elements, and identification elements. The image capture and communication device may transmit data based on the type and features to a host server, which may transmit data associated with the host product to the image capture and communication device in, inter alia, the form of an acceptability report.

Claims

1. An apparatus for processing a product provided with a product label, the apparatus comprising:

a memory; and

a processor in communication with the memory; and

a camera in communication with the processor and the memory, wherein the memory comprises instructions executable by the processor to cause the processor to;

capture using a camera, first image data from a product label, wherein the product label comprises an environmental monitor having a first shape and an environmental monitor state, the first image data being captured from multiple angles using the camera;

receive the first image data from the camera;

detect the presence and position of the first shape from the first image data captured from multiple angles;

in response to detecting the presence and position of the first shape, process the first image data captured from multiple angles to identify, based on the position of the first shape, a first subset of the first image data captured from multiple angles obtained from the environmental monitor;

determine the environmental monitor state from the first subset of the first image data captured from multiple angles; and

generate a product acceptability report based upon the determined monitor state.

2. The apparatus of claim 1 wherein the memory and processor are disposed in a mobile device.

3. The apparatus of claim 1 wherein the memory further comprises instructions that when executed by the processor cause the processor to automatically compensate for noise or glare in the first image data.

4. The apparatus of claim 1 further comprising a display in electrical communication with the processor and wherein the memory device further comprises instructions that when executed by the processor cause the processor to inform a user, using the display, to capture the first image data from multiple angles.

5. The apparatus of claim 1 wherein the environmental monitor experiences a detectable change in color when exposed to an environmental stimulus damaging to the product, and wherein determining the environmental monitor state includes detecting whether the detectable change in color has occurred.

6. The apparatus of claim 1, wherein the memory further comprises instructions executable by the processor to cause the processor to:

capture using the camera, second image data;

identify a patterned region in the second image data;

process the second image data in response to identifying the patterned region to identify a second subset of the second image data containing a first identifier; and

determine a source of the first identifier, wherein the acceptability report is further based on information relating to the determined source.

7. The apparatus of claim 6 wherein the instructions further cause the processor to

process a third subset of the second image data to determine an authentication state;

and wherein

the acceptability report indicates that the product is acceptable conditioned on whether the determined environmental monitor state satisfies a predetermined acceptance level and the authentication state is verified as authentic.

8. The apparatus of claim 7, wherein the second image data contains entity information, and wherein the memory further comprises instructions that when executed by the processor cause the processor to:

route the monitor state, the authentication state, and the entity information to a database.

9. The apparatus of claim 8 wherein the entity is selected from the group consisting of a patient;

a product transport company;

a clinical trial administrator;

a hospital;

a pharmaceutical company;

a supplier;

a distributor;

a quality control service provider;

a manufacturer; and

a consumer.

10. The apparatus of claim 8, wherein the memory further comprises instructions executable by the processor to populate a records management system with event data associated with an event relating to a product associated with the product label.

11. The apparatus of claim 10, wherein the event is selected from the group consisting of:

vaccination of the entity with the product,

delivery of the product to the entity,

performing a procedure on the entity,

rejection of the product by the entity,

consumption of the product by the entity,

acknowledgement of the acceptability report by the entity,

the entity performing an experiment using the product, and

combinations of two or more of the foregoing events.

12. The apparatus of claim 1, wherein apparatus is a mobile device comprising a display and the camera.

13. The apparatus of claim 1, wherein the memory further comprises instructions executable by the processor to prevent the captured first image data from being pre-processed after the image is captured by the camera by controlling an application programming interface used to control the camera.

14. The apparatus of claim 1, wherein the first image data comprises a plurality of frames of image data and wherein the memory further comprises instructions executable by the processor to differentiate between the plurality of frames and remove optical defects based on the differences between the plurality of frames.

15. The apparatus of claim 1, wherein the memory further comprises instructions executable by the processor to adjust a dynamic range for the first image data using a patterned region as a reference, the patterned region comprising a black and white barcode.

16. The apparatus of claim 1, wherein the memory further comprises instructions executable by the processor to identify the first subset of image data based on the first image data captured from the plurality of angles.

17. The apparatus of claim 1, wherein the product label is configured for use with a product that requires cold storage, but that can be exposed to an ambient room temperature for a predetermined time period such that the monitor state undergoes a change detectable in the first image data if the predetermined time period is exceeded, and wherein the memory further comprises instructions executable by the processor to determine from the monitor state that the predetermined time period for exposure to the ambient room temperature has not been exceeded.

18. The apparatus of claim 17, wherein the memory further comprises instructions executable by the processor to determine a first optical density value correlated with the environmental monitor state and comparing the first optical density value with a plurality of optical densities correlated with residual shelf lives of the product.

19. The apparatus of claim 17, wherein the memory further comprises instructions executable by the processor to provide an estimated shelf life for the product in the acceptability report.

20. The apparatus of claim 1, wherein the first shape is approximately circular, wherein the memory further comprises instructions executable by the processor to identify a plurality of ellipses in the first image data, the ellipses in the first image data being images of the circular indicator on the label.