Generation of two-dimensional and three-dimensional images of items for visual recognition in checkout apparatus
First Claim
1. A method comprising:
- detecting, at a checkout apparatus a request for adding an item to be visually recognized during sales transactions;
capturing and storing a color image, by each of one or more cameras of the checkout apparatus, of an examination space when the item is present in the examination space, wherein a user is collocated with the checkout apparatus;
repeating the capturing and storing of color images of the item at different poses within the examination space until at least a predetermined threshold number of color images of the item are captured;
generating, by a hardware processor of the checkout apparatus, additional color images of the item by modifying the captured color images;
building a machine-learning model for item recognition, at the checkout apparatus, by training a machine-learning tool with the captured color images and the additional color images; and
rebuilding the machine-learning model with transaction data, wherein the transaction data comprises a transaction image of the item during operation, associated with an item identifier and a note, wherein the note comprises information about a purchase state.
1 Assignment
0 Petitions
Accused Products
Abstract
Methods, systems, and computer programs are presented for capturing color images of items for a machine-learning model. In one method, a request, for adding an item to be visually recognized during sales transactions, is detected at a checkout apparatus. Further, the method includes capturing and storing a color image, by each of one or more cameras of the checkout apparatus, of an examination space when the item is present. Further, the capturing and storing of color images of the item is repeated at different poses until at a predetermined number of color images of the item are captured. Further, the method includes generating, by a processor of the checkout apparatus, additional images of the item by modifying the captured color images. A machine-learning model for item recognition is built by training a machine-learning tool with the captured images and the additional images.
63 Citations
30 Claims
-
1. A method comprising:
-
detecting, at a checkout apparatus a request for adding an item to be visually recognized during sales transactions; capturing and storing a color image, by each of one or more cameras of the checkout apparatus, of an examination space when the item is present in the examination space, wherein a user is collocated with the checkout apparatus; repeating the capturing and storing of color images of the item at different poses within the examination space until at least a predetermined threshold number of color images of the item are captured; generating, by a hardware processor of the checkout apparatus, additional color images of the item by modifying the captured color images; building a machine-learning model for item recognition, at the checkout apparatus, by training a machine-learning tool with the captured color images and the additional color images; and rebuilding the machine-learning model with transaction data, wherein the transaction data comprises a transaction image of the item during operation, associated with an item identifier and a note, wherein the note comprises information about a purchase state. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 30)
-
-
20. A checkout apparatus comprising:
-
a display; one or more cameras for capturing color images of an examination space of the checkout apparatus; a memory comprising instructions; and one or more processors, wherein the instructions, when executed by the one or more processors, cause the one or more processors to perform operations comprising; detecting a request for adding an item to be visually recognized during sales transactions; capturing and storing a color image, by each of one or more cameras of the checkout apparatus, of the examination space when the item is present in the examination space, wherein a user is collocated with the checkout apparatus; repeating the capturing and storing of color images of the item at different poses within the examination space until at least a predetermined threshold number of color images of the item are captured; generating additional color images of the item by modifying the captured color images; building a machine-learning model for item recognition, at the checkout apparatus, by training a machine-learning tool with the captured color images and the additional color images; and rebuilding the machine-learning model with transaction data generated during sales transactions, wherein the transaction data comprises a transaction image of the item during operation, associated with an item identifier and a purchase state. - View Dependent Claims (21, 22, 23, 24, 25, 26, 27, 28)
-
-
29. A non-transitory machine-readable storage medium comprising instructions that, when executed by a machine, cause the machine to perform operations comprising:
-
detecting, at a checkout apparatus, a request for adding an item to be visually recognized during sales transactions; capturing and storing a color image, by each of one or more cameras of the checkout apparatus, of an examination space when the item is present in the examination space, wherein a user is collocated with the checkout apparatus; repeating the capturing and storing of color images of the item at different poses within the examination space until at least a predetermined threshold number of color images of the item are captured; generating, by a hardware processor of the checkout apparatus, additional color images of the item by modifying the captured color images; building a machine-learning model for item recognition, at the checkout apparatus, by training a machine-learning tool with the captured color images and the additional color images; and rebuilding the machine-learning model with transaction data generated during sales transactions, wherein the transaction data comprises a transaction image of the item during operation, associated with an item identifier and a purchase state for the respective sales transaction.
-
Specification