Personal audio/visual system providing allergy awareness
First Claim
1. A method for recommending an item to a user, the method comprising:
- receiving image data of a scene from a camera, the scene comprises a particular item on a shelf, wherein the particular item is arranged in a known relative position to another item on the shelf, the particular item has a visual characteristic and is arranged in a certain location among a plurality of locations in a store, and the another item has a visual characteristic;
identifying the certain location based on a location of the user;
accessing a data source comprising an inventory of items in the store, each item in the inventory of items is cross-referenced to a location among the plurality of locations;
identifying candidate items in the inventory of items, the candidate items comprise items in the inventory which are cross-referenced to the certain location and excludes items in the inventory of items which are not cross-referenced to the certain location, and the candidate items are cross-referenced to image data;
performing a comparison which compares the visual characteristic of the particular item and the visual characteristic of the another item to the image data of the candidate items;
identifying one of the candidate items as a match to the particular item based on the comparison and the known relative position to the another item on the shelf, the one of the candidate items is cross-referenced to a parameter in the inventory;
obtaining a determination as to whether or not the particular item is recommended for the user based on a comparison of the parameter to a preference associated with the user; and
informing the user as to whether or not the particular item is recommended for the user based on the determination.
2 Assignments
0 Petitions
Accused Products
Abstract
A system provides a recommendation of food items to a user based on nutritional preferences of the user, using a head-mounted display device (HMDD) worn by the user. In a store, a forward-facing camera of the HMDD captures an image of a food item. The food item can be identified by the image, such as based on packaging of the food item. Nutritional parameters of the food item are compared to nutritional preferences of the user to determine whether the food item is recommended. The HMDD displays an augmented reality image to the user indicating whether the food item is recommended. If the food item is not recommended, a substitute food item can be identified. The nutritional preferences can indicate food allergies, preferences for low calorie foods and so forth. In a restaurant, the HMDD can recommend menu selections for a user.
-
Citations
16 Claims
-
1. A method for recommending an item to a user, the method comprising:
-
receiving image data of a scene from a camera, the scene comprises a particular item on a shelf, wherein the particular item is arranged in a known relative position to another item on the shelf, the particular item has a visual characteristic and is arranged in a certain location among a plurality of locations in a store, and the another item has a visual characteristic; identifying the certain location based on a location of the user; accessing a data source comprising an inventory of items in the store, each item in the inventory of items is cross-referenced to a location among the plurality of locations; identifying candidate items in the inventory of items, the candidate items comprise items in the inventory which are cross-referenced to the certain location and excludes items in the inventory of items which are not cross-referenced to the certain location, and the candidate items are cross-referenced to image data; performing a comparison which compares the visual characteristic of the particular item and the visual characteristic of the another item to the image data of the candidate items; identifying one of the candidate items as a match to the particular item based on the comparison and the known relative position to the another item on the shelf, the one of the candidate items is cross-referenced to a parameter in the inventory; obtaining a determination as to whether or not the particular item is recommended for the user based on a comparison of the parameter to a preference associated with the user; and informing the user as to whether or not the particular item is recommended for the user based on the determination. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A display device, comprising:
-
an augmented reality projection system; a camera which receives image data of a scene, the scene comprises a particular item which is arranged in a known relative position to another item in a store, the particular item has a visual characteristic and is arranged in a certain location among a plurality of locations in the store, and the another item has a visual characteristic; a location-detection system which determines a location of the display device; and a control circuit in communication with the augmented reality projection system and the camera, the control circuit is configured to; communicate the image data and the location of the display device to a server and, in response, receive from the server a determination as to whether or not the particular item is recommended for a user, the determination is based on a correspondence between a preference associated with the user and a parameter of a candidate item in an inventory of items in the store which is a best match to the visual characteristic of the particular item, wherein the best match is based on;
(a) a comparison which compares the visual characteristic of the particular item and the visual characteristic of the another item to image data of the inventory of items, and (b) the known relative position to the another item in the store; andcause the augmented reality projection system of the display device to project an augmented reality image to the user, based on the determination. - View Dependent Claims (7, 8, 9, 10, 11, 12)
-
-
13. A server, comprising:
-
a communication interface; a database comprising an inventory of candidate items in a store, each candidate item in the inventory of candidate items is cross-referenced to an aisle among a plurality of aisles in the store and to image data of the candidate item; a memory which stores program code; and a control circuit associated with the communication interface, the database and the memory, the control circuit is configured to execute the program code to; receive, via the communication interface, from a device of a user, an identification of an aisle in which the device is located and image data of a scene, the image data is from a camera of the device and identifies a visual characteristic of a particular item which is arranged in a certain aisle among a plurality of aisles in a store and a visual characteristic of another item which is arranged in the certain aisle, identify the certain aisle based on the aisle of the device, perform a comparison between the visual characteristic of the particular item and the visual characteristic of the another item to the image data of candidate items in the inventory which are cross-referenced to the certain aisle but not to candidate items in the inventory which are not cross-referenced to the certain aisle, identify a candidate item in the inventory as a match to the another item, based on the identifying of the candidate item and a known relative position of the another item to the particular item, identify a candidate item in the inventory as a match to the particular item; obtain a determination as to whether or not the particular item is recommended for the user based on a comparison of a parameter and a preference associated with the user, the parameter is cross-referenced to the candidate item which is the match to the particular item, and inform the user as to whether or not the particular item is recommended for the user based on the determination. - View Dependent Claims (14, 15, 16)
-
Specification