Method of and apparatus for identifying consumer products in a retail environment when bar code symbols on the products are not readable or have been removed from packaging

• US 20070262149A1
• Filed: 03/29/2007
• Published: 11/15/2007
• Est. Priority Date: 11/24/2000
• Status: Active Grant

• Current Assignee: Anatoly Kotlarsky, C Knowles, John Furlong, Mark Hernandez, Mark Schmidt, Michael Veksland, Nicola Ciarlante, Tao Xian, Timothy Good, Xiaoxun Zhu
• Original Assignee: Anatoly Kotlarsky, C Knowles, John Furlong, Mark Hernandez, Mark Schmidt, Michael Veksland, Nicola Ciarlante, Tao Xian, Timothy Good, Xiaoxun Zhu
• Inventors: Zhu, Xiaoxun, Veksland, Michael, Xian, Tao, Good, Timothy, Schmidt, Mark, Kotlarsky, Anatoly, Furlong, John, Hernandez, Mark, Ciarlante, Nicola, Knowles, C.
• Granted Patent: US 7,578,442 B2
• Time in Patent Office: Days
• US Class Current: 235/462.10
• CPC Class Codes: G06K 2207/1012 Special detection of object
• CPC Class Codes: G06K 7/10693 for omnidirectional scanning
• CPC Class Codes: G06K 7/10712 Fixed beam scanning
• CPC Class Codes: G06K 7/10722 Photodetector array or CCD scanning
• CPC Class Codes: G06K 7/10732 Light sources
• CPC Class Codes: G06K 7/10851 Circuits for pulse shaping, amplifying, eliminating noise signals, checking the function of the sensing device basic electronic circuitry H03
• CPC Class Codes: G06Q 20/20 Point-of-sale [POS] network systems
• CPC Class Codes: G06Q 20/202 Interconnection or interaction of plural electronic cash registers [ECR] or to host computer, e.g. network details, transfer of information from host to ECR or from ECR to ECR
• CPC Class Codes: G06Q 20/203 Inventory monitoring
• CPC Class Codes: G06Q 20/208 Input by product or record sensing, e.g. weighing or scanner processing
• CPC Class Codes: G06Q 20/209 Specified transaction journal output feature, e.g. printed receipt or voice output
• CPC Class Codes: G06Q 30/06 Buying, selling or leasing transactions
• CPC Class Codes: G06V 10/141 Control of illumination

Abstract

A method of and system for identifying a consumer product in a retail store environment when a bar code symbol on a product is not readable or has been removed from the product'"'"'s packaging. The system comprises a database system, and a digital image capturing and processing system installed in the retail environment and in data communication with the database system. The digital image capturing and processing system is capable of capturing one or more digital images for each consumer product sold in the retail store environment, and storing the digital images in the database subsystem, along with product identifying information for each consumer product. When the imaged bar code symbol happens to be unreadable, or when the bar code symbol label happens to have fallen off or have been removed from the packaging, then one or more digital images of the consumer product are compared with digital images stored in the database subsystem to identify the consumer product graphically represented in the digital images.

Claims

1. A method of identifying a consumer product in a retail store environment when a bar code symbol on a product is not readable or has been removed from the product'"'"'s packaging, said method comprising the steps of:

(a) providing a digital image capturing and processing system in said retail environment;

(b) using said digital image capturing and processing system to capture a plurality of digital images for each consumer product sold in said retail store environment, and storing said digital images in a database subsystem, along with product identifying information for each consumer product; and

(c) when a consumer checks out a consumer product at the POS station in said retail store environment, an attempts is made to identify consumer product by capturing and processing one or more digital images of the consumer product using said digital image capturing and processing system so as to read the bar code symbol label on its packing, and

when the imaged bar code symbol happens to be unreadable, or when the bar code symbol label happens to have fallen off or have been removed from the packaging, then said digital image capturing and processing system uses (i) said one or more digital images of said consumer product, and (ii) said plurality digital images stored in said database subsystem, to assist in the identification of said consumer product.

2. The method of claim 1, wherein an image recognition process supported on an application server accesses and analyzes digital images produced from said digital image capturing and processing system and said plurality of digital images stored in said database subsystem, and identifies the consumer product graphically represented in said one or more digital images.

3. The method of claim 2, wherein step (c) comprises:

(i) running, in said application server, a computer-assisted image comparison process for comparing (ii) one or more digital images of a given consumer product captured by said digital image capturing and processing subsystem, and (iii) with the digital images stored in said database system server during programming and setup operations; and

(ii) when the consumer product has been recognized by way of said computer-assisted image comparison process, said digital image capturing and processing system serving corresponding consumer product and price information to the consumer so as to enable a consumer product purchase transaction at said POS station.

4. The method of claim 1, wherein in step (b), said product identifying information comprises a Universal Product Number assigned to said consumer product by its manufacturer, a trademark assigned to said consumer product, and a product descriptor associated with said consumer product.

5. The method of claim of claim 1, wherein said digital image capturing and processing system comprises an omni-directional image capture and processing system.

6. The method of claim 5, wherein said digital image capturing and processing system comprises a plurality of coplanar illumination and imaging stations, for generating and projecting a complex of coplanar illumination and imaging planes through an imaging window, and into a 3D imaging volume definable relative to said imaging window, for supporting imaging of objects passing through said 3D imaging volume and producing digital images of objects within said 3D imaging volume.

7. A system for identifying a consumer product in a retail store environment when a bar code symbol on a product is not readable or has been removed from the product'"'"'s packaging, said system comprising:

a database system; and

a digital image capturing and processing system installed in said retail environment, and in data communication with said database system,

wherein said digital image capturing and processing system is capable of capturing one or more digital images for each consumer product sold in said retail store environment, and storing said digital images in said database subsystem, along with product identifying information for each consumer product;

wherein when a consumer checks out a consumer product at the POS station in said retail store environment, then an attempt is made to identify consumer product by capturing and processing one or more digital images of the consumer product using said digital image capturing and processing system so as to read the bar code symbol label on its packing; and

wherein when the imaged bar code symbol happens to be unreadable, or when the bar code symbol label happens to have fallen off or have been removed from the packaging, then said digital image capturing and processing system uses (i) said one or more digital images of said consumer product, and (ii) said digital images stored in said database subsystem to assist in the identification of the consumer product.

8. The system of claim 7, wherein an image recognition process supported on an application server accesses and analyzes the digital images produced from said digital image capturing and processing system and stores said digital images in said database subsystem to identify the consumer product graphically represented in said one or more digital images.

9. The system of claim 8, wherein said application server runs a computer-assisted image comparison process for comparing (ii) one or more digital images of a given consumer product captured by said digital image capturing and processing subsystem, and (iii) with the digital images stored in said database system server during programming and setup operations;

and (ii) when the consumer product has been recognized by way of said computer-assisted image comparison process, said digital image capturing and processing system serving corresponding consumer product and price information to the consumer so as to enable a consumer product purchase transaction at said POS station.

10. The system of claim 7, wherein said product identifying information comprises a Universal Product Number assigned to said consumer product by its manufacturer, a trademark assigned to said consumer product, and a product descriptor associated with said consumer product.

11. The system of claim of claim 7, wherein said digital image capturing and processing system comprises an omni-directional image capture and processing system.

12. The system of claim 7, wherein said digital image capturing and processing system comprises a plurality of coplanar illumination and imaging stations, for generating and projecting a complex of coplanar illumination and imaging planes through an imaging window, and into a 3D imaging volume definable relative to said imaging window, for supporting imaging of objects passing through said 3D imaging volume and producing digital images of objects within said 3D imaging volume.