METHOD, COMPUTER PROGRAM PRODUCT, AND SYSTEM FOR PROVIDING A SENSOR-BASED ENVIRONMENT

• US 20160110799A1
• Filed: 03/31/2015
• Published: 04/21/2016
• Est. Priority Date: 10/15/2014
• Status: Active Grant

• Current Assignee: Toshiba Global Commerce Solutions Holdings Corporation (Toshiba Corporation)
• Original Assignee: Toshiba Global Commerce Solutions Holdings Corporation (Toshiba Corporation)
• Inventors: Herring, Dean Frederick, Johnson, Brad Matthew, Smith, Jeffrey John, Rodriguez, Adrian Xavier, Wahrer, Kathleen
• Granted Patent: US 10,776,844 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G01B 11/00 Measuring arrangements characterised by the use of optical techniques
• CPC Class Codes: G01B 11/02 for measuring length, width or thickness G01B11/08 takes precedence
• CPC Class Codes: G01G 19/40 with provisions for indicating, recording, or computing price or other quantities dependent on the weight indicating means for weighing apparatus G01G23/18; recording means for weighing apparatus G01G23/18; computers in general G06
• CPC Class Codes: G01G 19/4144 for controlling weight of goods in commercial establishments, e.g. supermarket, P.O.S. systems
• CPC Class Codes: G01S 19/13 Receivers
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06F 18/24 Classification techniques
• CPC Class Codes: G06F 2218/12 Classification; Matching
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06Q 10/087 Inventory or stock management, e.g. order filling, procurement or balancing against orders
• CPC Class Codes: G06Q 20/18 involving self-service terminals [SST], vending machines, kiosks or multimedia terminals
• CPC Class Codes: G06Q 20/204 comprising interface for record bearing medium or carrier for electronic funds transfer or payment credit
• CPC Class Codes: G06Q 20/208 Input by product or record sensing, e.g. weighing or scanner processing
• CPC Class Codes: G06Q 20/209 Specified transaction journal output feature, e.g. printed receipt or voice output
• CPC Class Codes: G06Q 20/322 Aspects of commerce using mobile devices [M-devices]
• CPC Class Codes: G06Q 30/016 After-sales
• CPC Class Codes: G06Q 30/0224 based on user history
• CPC Class Codes: G06Q 30/0235 constrained by time limit or expiration date
• CPC Class Codes: G06Q 30/0251 : Targeted advertisements
• CPC Class Codes: G06Q 30/0269 : based on user profile or attribute
• CPC Class Codes: G06Q 30/0609 : Buyer or seller confidence or verification
• CPC Class Codes: G06Q 30/0623 : Item investigation
• CPC Class Codes: G06Q 30/0629 : for generating comparisons
• CPC Class Codes: G06Q 30/0631 : Item recommendations
• CPC Class Codes: G06Q 30/0633 : Lists, e.g. purchase orders, compilation or processing
• CPC Class Codes: G06Q 30/0635 : Processing of requisition or of purchase orders
• CPC Class Codes: G06Q 30/0639 : Item locations
• CPC Class Codes: G06T 11/60 : Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 2207/30232 : Surveillance
• CPC Class Codes: G06T 7/66 : of image moments or centre of gravity
• CPC Class Codes: G06V 20/68 : Food, e.g. fruit or vegetables
• CPC Class Codes: G06V 20/80 : Recognising image objects characterised by unique random patterns
• CPC Class Codes: G06V 40/10 : Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: G06V 40/16 : Human faces, e.g. facial parts, sketches or expressions
• CPC Class Codes: G06V 40/166 : using acquisition arrangements
• CPC Class Codes: G06V 40/172 : Classification, e.g. identification
• CPC Class Codes: G06V 40/179 : metadata assisted face recognition
• CPC Class Codes: G07G 1/0045 : with a code reader for reading of an identifying code of the article to be registered, e.g. barcode reader or radio-frequency identity [RFID] reader
• CPC Class Codes: G07G 1/0054 : with control of supplementary check-parameters, e.g. weight or number of articles
• CPC Class Codes: G07G 1/0063 : with means for detecting the geometric dimensions of the article of which the code is read, such as its size or height, for the verification of the registration
• CPC Class Codes: G07G 1/0072 : with means for detecting the weight of the article of which the code is read, for the verification of the registration weighing combined with recording means, e.g. in weighing scale, G01G19/415
• CPC Class Codes: G07G 3/003 : Anti-theft control theft alarms G08B13/00
• CPC Class Codes: H04N 23/00 : Cameras or camera modules comprising electronic image sensors; Control thereof
• CPC Class Codes: H04N 23/60 : Control of cameras or camera modules
• CPC Class Codes: H04N 7/181 : for receiving images from a plurality of remote sources

Abstract

Method, computer program product, and system to provide assistance to at least a first person during a transaction within an environment having a plurality of items. The method includes identifying the first person within the environment, and analyzing acquired image information to determine at least one item interaction of the transaction and thereby associate the identified first person with the transaction. The method further includes determining whether the first person is associated with a personal profile that includes information related to the environment, the information including at least one of personal preferences and personal historical data reflecting one or more previous transactions of the first person. When the first person is determined to be associated with a personal profile, the method further includes determining, based on the information in the personal profile, an amount of assistance to provide to the first person during the transaction.

Claims

1. A computer-implemented method to provide assistance to at least a first person during a transaction within an environment having a plurality of items, the transaction including at least a first item interaction performed by the first person, the method comprising:

identifying the first person within the environment;

analyzing acquired image information to determine the first item interaction and thereby associate the identified first person with the transaction;

determining whether the first person is associated with a personal profile that includes information related to the environment, wherein the information includes at least one of personal preferences and personal historical data reflecting one or more previous transactions of the first person; and

when the first person is determined to be associated with a personal profile;

determining, based on the information in the personal profile, an amount of assistance to provide to the first person during the transaction.

2. The computer-implemented method of claim 1, further comprising:

performing, based on the determined amount of assistance to provide to the first person during the transaction, at least one of;

presenting information to the first person using a computing device associated with the first person, and

adapting a current assignment distribution of employees within the environment to produce a second assignment distribution.

3. The computer-implemented method of claim 2, wherein adapting the current assignment distribution of employees is based on a respective proficiency score corresponding to each of the employees included in the current assignment distribution.

4. The computer-implemented method of claim 1, further comprising:

identifying a second person within the environment;

associating the identified second person with a second transaction;

determining that the identified second person is not associated with a personal profile; and

determining a default amount of assistance to provide to the second person during the second transaction, wherein the determined default amount of assistance is relatively greater than the determined amount of assistance for the first person.

5. The computer-implemented method of claim 1, wherein the transaction is a checkout transaction in a checkout area of the environment, and wherein the information indicates a personal preference for using one of self-checkout terminals and manned checkout terminals.

6. The computer-implemented method of claim 5, wherein the personal preference is determined based on the personal historical data.

7. The computer-implemented method of claim 1, wherein the personal profile includes one or more proficiency scores for the first person, and wherein determining the amount of assistance to provide to the first person is further based on at least one proficiency score.

8. A computer program product to provide assistance to at least a first person during a transaction within an environment having a plurality of items, the transaction including at least a first item interaction performed by the first person, the computer program product comprising:

a computer-readable storage medium having computer-readable program code embodied therewith, the computer-readable program code executable by one or more computer processors to perform an operation that includes;

identifying the first person within the environment;

analyzing acquired image information to determine the first item interaction and thereby associate the identified first person with the transaction;

determining whether the first person is associated with a personal profile that includes information related to the environment, wherein the information includes at least one of personal preferences and personal historical data reflecting one or more previous transactions of the first person; and

when the first person is determined to be associated with a personal profile;

determining, based on the information in the personal profile, an amount of assistance to provide to the first person during the transaction.

9. The computer program product of claim 8, the operation further including:

performing, based on the determined amount of assistance to provide to the first person during the transaction, at least one of;

presenting information to the first person using a computing device associated with the first person, and

adapting a current assignment distribution of employees within the environment to produce a second assignment distribution.

10. The computer program product of claim 9, wherein adapting the current assignment distribution of employees is based on a respective proficiency score corresponding to each of the employees included in the current assignment distribution.

11. The computer program product of claim 8, the operation further including:

identifying a second person within the environment;

associating the identified second person with a second transaction;

determining that the identified second person is not associated with a personal profile; and

determining a default amount of assistance to provide to the second person during the second transaction, wherein the determined default amount of assistance is relatively greater than the determined amount of assistance for the first person.

12. The computer program product of claim 8, wherein the transaction is a checkout transaction in a checkout area of the environment, and wherein the information indicates a personal preference for using one of self-checkout terminals and manned checkout terminals.

13. The computer program product of claim 12, wherein the personal preference is determined based on the personal historical data.

14. The computer program product of claim 8, wherein the personal profile includes one or more proficiency scores for the first person, and wherein determining the amount of assistance to provide to the first person is further based on at least one proficiency score.

15. A system to provide assistance to at least a first person during a transaction within an environment having a plurality of items, the transaction including at least a first item interaction performed by the first person, the system comprising:

one or more computer processors;

at least one visual sensor disposed within the environment and communicatively coupled with the one or more computer processors; and

a memory containing program code which, when executed by the one or more computer processors, performs an operation that includes;

identifying the first person within the environment;

analyzing acquired image information to determine the first item interaction and thereby associate the identified first person with the transaction;

determining whether the first person is associated with a personal profile that includes information related to the environment, wherein the information includes at least one of personal preferences and personal historical data reflecting one or more previous transactions of the first person; and

when the first person is determined to be associated with a personal profile;

determining, based on the information in the personal profile, an amount of assistance to provide to the first person during the transaction.

16. The system of claim 15, the operation further including:

performing, based on the determined amount of assistance to provide to the first person during the transaction, at least one of;

presenting information to the first person using a computing device associated with the first person, and

adapting a current assignment distribution of employees within the environment to produce a second assignment distribution.

17. The system of claim 16, wherein adapting the current assignment distribution of employees is based on a respective proficiency score corresponding to each of the employees included in the current assignment distribution.

18. The system of claim 15, the operation further including:

identifying a second person within the environment;

associating the identified second person with a second transaction;

determining that the identified second person is not associated with a personal profile; and

determining a default amount of assistance to provide to the second person during the second transaction, wherein the determined default amount of assistance is relatively greater than the determined amount of assistance for the first person.

19. The system of claim 15, wherein the transaction is a checkout transaction in a checkout area of the environment, and wherein the information indicates a personal preference for using one of self-checkout terminals and manned checkout terminals.

20. The system of claim 19, wherein the personal preference is determined based on the personal historical data.