IMAGE PROCESSING DEVICE

• US 20170293820A1
• Filed: 03/15/2017
• Published: 10/12/2017
• Est. Priority Date: 04/07/2016
• Status: Abandoned Application

• Current Assignee: Toshiba Tec Corporation (Toshiba Corporation)
• Original Assignee: Toshiba Tec Corporation (Toshiba Corporation)
• Inventors: Sawada, Takayuki, Yasunaga, Masaaki
• Application Number:
  US15/459,069
• Publication Number:
  US 20170293820A1
• Time in Patent Office: Days
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06Q 20/208 Input by product or record sensing, e.g. weighing or scanner processing
• CPC Class Codes: G06Q 20/387 Payment using discounts or coupons relating to marketing G06Q30/02
• CPC Class Codes: G06Q 30/0207 Discounts or incentives, e.g. coupons or rebates
• CPC Class Codes: G06Q 30/0238 at point-of-sale [POS]
• CPC Class Codes: G06Q 30/0283 Price estimation or determination
• CPC Class Codes: G06V 20/63 Scene text, e.g. street names
• CPC Class Codes: G06V 20/68 Food, e.g. fruit or vegetables
• CPC Class Codes: G07G 1/0036 Checkout procedures
• CPC Class Codes: G07G 1/0063 with means for detecting the geometric dimensions of the article of which the code is read, such as its size or height, for the verification of the registration

Abstract

According to one embodiment, an image processing device includes a region cutout unit, a mask generation unit, a commodity identification unit, and a discount processing unit. The region cutout unit cuts out a partial image corresponding to commodity from an input image. The mask generation unit generates discount information on the basis of a first pattern image and generates a first mask pattern on the basis of a position where the first pattern image is detected, in a case where the first pattern image is detected in the partial image. The commodity identification unit specifies commodity corresponding to the partial image by matching a mask image which is masked by the first mask pattern with respect to the partial image, with a dictionary-registered image corresponding to each of a plurality of pieces of commodity, and acquires commodity information corresponding to the partial image.

Claims

1. An image processing device comprising:

a region cutout unit that cuts out a partial image corresponding to commodity from an input image;

a mask generation unit that, in a case where a first pattern image is detected in the partial image, generates discount information on the basis of the first pattern image and generates a first mask pattern on the basis of a position where the first pattern image is detected;

a commodity identification unit that specifies commodity corresponding to the partial image by matching a mask image which is masked by the first mask pattern with respect to the partial image, with a dictionary-registered image corresponding to each of a plurality of pieces of commodity, and acquires commodity information corresponding to the partial image; and

a discount processing unit that performs discount processing on the basis of a price of the commodity that the commodity information indicates and the discount information.

2. The device according to claim 1, further comprising:

a commodity information acquisition unit that, in a case where a second pattern image is detected in the partial image, acquires commodity information corresponding to the second pattern image,

wherein the commodity identification unit acquires commodity information corresponding to the partial image, based on matching of the mask image and the dictionary-registered image, in a case where the second pattern image is not detected in the partial image.

3. The device according to claim 2,

wherein the mask generation unit generates a third mask pattern on the basis of a position where a third pattern image is detected, in a case where the first pattern image is not detected in the partial image and the third pattern image is detected, and

wherein, in a case where the second pattern image is not detected in the partial image, the commodity identification unit specifies commodity corresponding to the partial image by matching a mask image which is masked by the third mask pattern with respect to the partial image with a dictionary-registered image corresponding to each of a plurality of pieces of commodity, and acquires commodity information corresponding to the partial image.

4. The device according to claim 1,

wherein the region cutout unit cuts out a plurality of partial images corresponding to each of a plurality of pieces of commodity from the input image, and

wherein the discount processing unit performs discount processing with respect to the commodity information corresponding to a partial image in which the first pattern image is detected by using the mask generation unit.

5. The device according to claim 1, wherein the commodity identification unit includes,

a first masking unit that generates a mask partial image by converting a part of the partial image into a constant pixel value, based on the first mask pattern;

a local feature point extraction unit that extracts local feature point information with respect to the mask partial image;

a feature point matching unit that collates the local feature point information and local feature point information of commodity image which is previously registered in a dictionary, and outputs a projection conversion matrix which represents a relative position relationship between both, and commodity information of candidate commodity with respect to content of the partial image, based on a correspondence state of a local feature point between both;

a projection conversion unit that reads a dictionary-registered image corresponding to commodity information of the candidate commodity and generates a projection registration image which is obtained by performing projection conversion of the dictionary-registered image on the basis of the projection conversion matrix;

a second masking unit that generates a mask registration image by converting a part of the projection registration image into a constant pixel value, based on the first mask pattern; and

a detailed matching unit that calculates degree of similarity between the mask partial image and the mask registration image, and outputs commodity information corresponding to the partial image, based on the degree of similarity and a predetermined determination threshold.