Method of and apparatus for identifying consumer products in a retail environment when bar code symbols on the products are not readable or have been removed from packaging

• US 7,578,442 B2
• Filed: 03/29/2007
• Issued: 08/25/2009
• Est. Priority Date: 11/24/2000
• Status: Expired due to Fees

• Current Assignee: Metrologic Instruments Incorporated (Honeywell International Inc.)
• Original Assignee: Metrologic Instruments Incorporated (Honeywell International Inc.)
• Inventors: Zhu, Xiaoxun, Knowles, C. Harry, Good, Timothy, Schmidt, Mark, Ciarlante, Nicola
• Primary Examiner(s): Kim; Ahshik
• Application Number:
  US11/729,659
• Publication Number:
  US 20070262149A1
• Time in Patent Office: 880 Days
• Field of Search: 235/462.01, 235/462.14, 235/462.42, 235/383
• US Class Current: 235/462.01
• CPC Class Codes: G06K 2207/1012 Special detection of object
• CPC Class Codes: G06K 7/10693 for omnidirectional scanning
• CPC Class Codes: G06K 7/10712 Fixed beam scanning
• CPC Class Codes: G06K 7/10722 Photodetector array or CCD scanning
• CPC Class Codes: G06K 7/10732 Light sources
• CPC Class Codes: G06K 7/10851 Circuits for pulse shaping, amplifying, eliminating noise signals, checking the function of the sensing device basic electronic circuitry H03
• CPC Class Codes: G06Q 20/20 Point-of-sale [POS] network systems
• CPC Class Codes: G06Q 20/202 Interconnection or interaction of plural electronic cash registers [ECR] or to host computer, e.g. network details, transfer of information from host to ECR or from ECR to ECR
• CPC Class Codes: G06Q 20/203 Inventory monitoring
• CPC Class Codes: G06Q 20/208 Input by product or record sensing, e.g. weighing or scanner processing
• CPC Class Codes: G06Q 20/209 Specified transaction journal output feature, e.g. printed receipt or voice output
• CPC Class Codes: G06Q 30/06 Buying, selling or leasing transactions
• CPC Class Codes: G06V 10/141 Control of illumination

Abstract

A method of and system for identifying a consumer product in a retail store environment when a bar code symbol on a product is not readable or has been removed from the product'"'"'s packaging. The system comprises a database system, and a digital image capturing and processing system installed in the retail environment and in data communication with the database system. The digital image capturing and processing system is capable of capturing one or more digital images for each consumer product sold in the retail store environment, and storing the digital images in the database subsystem, along with product identifying information for each consumer product. When the imaged bar code symbol happens to be unreadable, or when the bar code symbol label happens to have fallen off or have been removed from the packaging, then one or more digital images of the consumer product are compared with digital images stored in the database subsystem to identify the consumer product graphically represented in the digital images.

Claims

1. A method of identifying a consumer product in a retail store environment when a bar code symbol label on the packaging of the consumer product is not readable or has been removed from said packaging, said method comprising the steps of:

(a) providing a digital image capturing and processing system at a point of sale (POS) station in said retail store environment;

(b) using said digital image capturing and processing system to capture one or more digital images of each consumer product sold in said retail store environment having packaging and bearing a bar code symbol label applied to said packaging, and storing said digital images in a database subsystem, along with product identifying information for each consumer product; and

(c) when a consumer checks out one said consumer product at said POS station in said retail store environment, an attempt is made to automatically identify the consumer product by capturing and processing one or more digital images of the consumer product using said digital image capturing and processing system so as to read the bar code symbol label on said packaging, and

when the imaged bar code symbol label on said packaging is unreadable, or when the bar code symbol label has fallen off or has been removed from said packaging, then said digital image capturing and processing system uses (i) said one or more digital images of said consumer product, and (ii) said plurality of digital images stored in said database subsystem, to assist in the automatic identification of said consumer product.

2. A method of identifying a consumer product in a retail store environment when a bar code symbol label on a consumer product is not readable or has been removed from the packaging of the consumer product, said method comprising the steps of:

(a) providing a digital image capturing and processing system at a point of sale (POS) station in said retail store environment;

(b) using said digital image capturing and processing system to capture a plurality of digital images of each consumer product sold in said retail store environment, and storing said digital images in a database subsystem, along with product identifying information for each consumer product; and

(c) when a consumer checks out one said consumer product at said POS station in said retail store environment, an attempt is made to identify said consumer product by capturing and processing one or more of said plurality of digital images of said consumer product using said digital image capturing and processing system so as to read the bar code symbol label on the packaging of the consumer product, and

(d) when the imaged bar code symbol is unreadable, or when the bar code symbol label has fallen off or has been removed from said packaging, then said digital image capturing and processing system uses (i) said one or more digital images of said consumer product, and (ii) said plurality of digital images stored in said database subsystem, to assist in the identification of said consumer product; and

wherein said digital image capturing and processing system comprises a plurality of coplanar illumination and imaging stations, for generating and projecting a complex of coplanar illumination and imaging planes through an imaging window, and into a 3D imaging volume definable relative to said imaging window, for supporting imaging of objects passing through said 3D imaging volume and producing digital images of objects within said 3D imaging volume.

3. The method of claim 2, wherein an image recognition process supported on an application server accesses (i) and analyzes said one or more digital images of said consumer product captured by said digital image capturing and processing system, and said plurality of digital images stored in said database subsystem, and (ii) identifies the consumer product graphically represented in said one or more digital images.

4. The method of claim 3, wherein step (c) comprises:

(i) running, in said application server, a computer-assisted image comparison process comparing said one or more digital images of the given consumer product captured by said digital image capturing and processing system, with the digital images stored in said database subsystem; and

(ii) when the consumer product has been recognized by way of said computer-assisted image comparison process, said digital image capturing and processing system serving corresponding consumer product and price information to the consumer so as to enable a consumer product purchase transaction at said POS station.

5. The method of claim 2, wherein in step (b), said product identifying information comprises a Universal Product Number assigned to said consumer product by its manufacturer, a trademark assigned to said consumer product, and a product descriptor associated with said consumer product.

6. The method of claim 2, wherein said digital image capturing and processing system comprises an omni-directional image capture and processing system.

7. A system for identifying a consumer product in a retail store environment when a bar code symbol label on the packaging of a consumer product is not readable or has been removed from said packaging, said system comprising:

a database system; and

a digital image capturing and processing system installed at a point of sale (POS) station in said retail store environment, and in data communication with said database system,

wherein said digital image capturing and processing system captures one or more digital images of each consumer product sold in said retail store environment, and having packaging and bearing a bar code symbol on said packaging, and storing said digital images in said database system, along with product identifying information for each consumer product;

wherein when a consumer checks out one said consumer product at said POS station in said retail store environment, then an attempt is made to automatically identify consumer product by capturing and processing one or more of said digital images of the consumer product using said digital image capturing and processing system so as to read the bar code symbol label on said packaging; and

wherein when the imaged bar code symbol label on said packaging is unreadable, or when the bar code symbol label has fallen off or has been removed from said packaging, then said digital image capturing and processing system uses (i) said one or more digital images of said consumer product, and (ii) said digital images stored in said database subsystem, to assist in the automatic identification of the consumer product.

8. The system of claim 7, wherein said product identifying information comprises a Universal Product Number assigned to said consumer product by its manufacturer, a trademark assigned to said consumer product, and a product descriptor associated with said consumer product.

9. A system for identifying a consumer product in a retail store environment when a bar code symbol label on the packaging of a consumer product is not readable or has been removed from said packaging, said system comprising:

a database system; and

a digital image capturing and processing system installed at a point of sale (POS) station in said retail store environment, and in data communication with said database system,

wherein said digital image capturing and processing system captures one or more digital images of each consumer product sold in said retail store environment, and said digital images are stored in said database system, along with product identifying information for each consumer product;

wherein when a consumer checks out one said consumer product at said POS station in said retail store environment, then an attempt is made to identify said consumer product by capturing and processing one or more digital images of said consumer product using said digital image capturing and processing system so as to read the bar code symbol label on the packaging of the consumer product; and

wherein when the imaged bar code symbol is unreadable, or when the bar code symbol label has fallen off or has been removed from the packaging, then said digital image capturing and processing system uses (i) said one or more digital images of said consumer product, and (ii) said digital images stored in said database system to assist in the identification of the consumer product; and

wherein said digital image capturing and processing system comprises a plurality of coplanar illumination and imaging stations, for generating and projecting a complex of coplanar illumination and imaging planes through an imaging window, and into a 3D imaging volume definable relative to said imaging window, for supporting imaging of objects passing through said 3D imaging volume and producing digital images of objects within said 3D imaging volume.

10. The system of claim 9, which further comprises an image recognition process supported on an application server which accesses and analyzes the digital images of the consumer product captured by said digital image capturing and processing system, and said digital images stored in said database subsystem, to identify the consumer product graphically represented in said one or more digital images.

11. The system of claim 10, wherein said application server runs a computer-assisted image comparison process for comparing one or more digital images of a given consumer product captured by said digital image capturing and processing subsystem, with the digital images stored in said database system server during programming and setup operations;

and when the consumer product has been recognized by way of said computer-assisted image comparison process, said digital image capturing and processing system serves corresponding consumer product and price information to the consumer so as to enable a consumer product purchase transaction at said POS station.

12. The system of claim of claim 9, wherein said digital image capturing and processing system comprises an omni-directional image capture and processing system.