Commodity recognition apparatus and commodity recognition method

• US 9,165,191 B2
• Filed: 08/13/2013
• Issued: 10/20/2015
• Est. Priority Date: 09/03/2012
• Status: Expired due to Fees

• Current Assignee: Toshiba Tec Corporation (Toshiba Corporation)
• Original Assignee: Toshiba Tec Corporation (Toshiba Corporation)
• Inventors: Sugasawa, Hiroshi, Naito, Hidehiro
• Primary Examiner(s): BHATNAGAR, ANAND P
• Application Number:
  US13/965,384
• Publication Number:
  US 20140064559A1
• Time in Patent Office: 798 Days
• Field of Search: 382/100, 382/103, 382/108, 382/110, 382/112, 382181-231, 382/291, 382/292, 382/301, 382/321, 348/89, 348/135, 348/143
• US Class Current: 1/1
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 20/68 Food, e.g. fruit or vegetables

Abstract

A commodity recognition apparatus detects an appearance feature amount of a commodity included in an image captured by an image capturing unit, extracts a candidate of the commodity included in the captured image by comparing the data of the appearance feature amount with the feature amount data in a recognition dictionary file, recognizes a character string included in the image captured by the image capturing unit, and determines a commodity of a recognition target according to the recognized character string and the extracted candidate of the commodity.

Claims

1. A commodity recognition apparatus, comprising:

a feature amount detection module configured to detect an appearance feature amount of a commodity included in an image captured by an image capturing unit;

a commodity candidate extraction module configured to extract a candidate of the commodity included in the image by comparing the data of the appearance feature amount detected by the feature amount detection module with the feature amount data in a recognition dictionary file storing feature amount data representing the surface information of a commodity for each commodity which is a recognition target;

a determination module configured to determine whether or not character recognition is required from the candidate of the commodity extracted as the candidate by the commodity candidate extraction module;

a character recognition module configured to recognize a character string included in the image captured by the image capturing unit, if the determination module determines that the character recognition is required; and

a commodity determination module configured to determine a commodity of a recognition target according to the character string recognized by the character recognition module and the candidate of the commodity extracted by the commodity candidate extraction module.

2. The commodity recognition apparatus according to claim 1, wherein

the commodity determination module determines, as a commodity of the recognition target, the commodity including the character string recognized by the character recognition module in its commodity name from the candidate of the commodity extracted by the commodity candidate extraction module.

3. The commodity recognition apparatus according to claim 1, further comprising:

a flag storage section configured to store a flag for distinguishing whether or not the character recognition is required for each commodity of the recognition target, wherein

the determination module is configured to determine whether or not the character recognition is required according to the flag for the commodity extracted as the candidate by the commodity candidate extraction module.

4. The commodity recognition apparatus according to claim 3, further comprising:

a notification unit configured to notify a result of the character recognition if the result of executing the character recognition module is that the character string cannot be recognized from the image captured by the image capturing unit.

5. The commodity recognition apparatus according to claim 3,

wherein

the character recognition module is executed if the determination module determines that the character recognition is required for the commodity.

6. A commodity recognition method, including:

detecting an appearance feature amount of a commodity included in an image captured;

comparing the data of the detected appearance feature amount with a stored feature amount data representing surface information of a commodity for each commodity of a recognition target to extract a candidate of the commodity included in the image captured;

determining whether or not character recognition is required from the candidate of the commodity extracted as the candidate;

recognizing a character string included in the image captured, if it is determined that the character recognition is required; and

determining a commodity of the recognition target according to the recognized character string and the candidate of the extracted commodity.

7. A commodity recognition apparatus, comprising:

an interface which captures an image captured by a camera; and

a processor, the processor executing the following;

detecting an appearance feature amount of a commodity included in the image captured by the camera;

comparing data of the appearance feature amount of the commodity with feature amount data in a recognition dictionary file storing feature amount data representing surface information of a commodity for each commodity which is a recognition target;

determining whether or not the character recognition is required from the candidate of the commodity extracted as the candidate;

recognizing a character string included in the image captured by the camera, if the determination module determines that the character recognition is required; and

determining a commodity of a recognition target from the candidate of the commodity according to the character string recognized.

8. The commodity recognition apparatus according to claim 7, wherein

the processor determines, as a commodity of the recognition target, the commodity including the character string recognized in its commodity name from the candidate of the commodity.

9. The commodity recognition apparatus according to claim 7, further comprising:

a memory configured to store a flag for distinguishing whether or not the character recognition is required for each commodity of the recognition target, wherein

the processor determines whether or not the character recognition is required according to the flag for the commodity extracted as the candidate.

10. The commodity recognition apparatus according to claim 9, wherein

the processor notifies a result of the character recognition if the result of executing the character recognition module is that the character string cannot be recognized.