Wearable food nutrition feedback system
First Claim
Patent Images
1. An augmented display apparatus, comprising:
- a see-through, head mounted display;
a plurality of sensors detecting visual information in a field of view of the apparatus;
one or more processing devices in communication with the see-through, head mounted display and the plurality of sensors, the one or more processing devices automaticallyidentify food items proximate to the apparatus by evaluating the food items at a known location and accessing food item data associated with the known location;
match items on a menu with the food item data associated with the known location;
determine feedback information for one or more of the food items identified and relevant to a wearer of the apparatus before consumption of one or more of the food items, the feedback information includes providing nutritional information about the food items based on the food item data at the known location; and
render the feedback information as a virtual object, prior to the consumption, in the see-through, head mounted display.
2 Assignments
0 Petitions
Accused Products
Abstract
A see-through, head mounted display and sensing devices cooperating to provide feedback on food items detected in the device field of view. Feedback can include warnings based on personal wearer needs, general nutrition information, food consumption tracking and social interactions. The system includes one or more processing devices in communication with display and the sensors which identify food items proximate to the apparatus, determine feedback information relevant to a wearer of the apparatus; and render feedback information in the display.
-
Citations
20 Claims
-
1. An augmented display apparatus, comprising:
-
a see-through, head mounted display; a plurality of sensors detecting visual information in a field of view of the apparatus; one or more processing devices in communication with the see-through, head mounted display and the plurality of sensors, the one or more processing devices automatically identify food items proximate to the apparatus by evaluating the food items at a known location and accessing food item data associated with the known location; match items on a menu with the food item data associated with the known location; determine feedback information for one or more of the food items identified and relevant to a wearer of the apparatus before consumption of one or more of the food items, the feedback information includes providing nutritional information about the food items based on the food item data at the known location; and render the feedback information as a virtual object, prior to the consumption, in the see-through, head mounted display. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A see-through, head mounted display device including a processor and non-transitory computer readable storage, the non-transitory computer readable storage including computer readable instructions when executed by the processor performing a method comprising:
-
receiving input from a plurality of sensors mounted on the see-through, head mounted display device, the plurality of sensors mounted to detect image data in a field of view of the see-through, head mounted display device and wearer gaze of the see-through, head mounted display device; identifying one or more food items proximate to the see-through, head mounted device based on the image data and the wearer gaze; accessing feedback information for the one or more food items from the non-transitory computer readable storage storing third party food item data associated with a specific location in which the see-through, head mounted display device is currently located; detecting consumption of the one or more of the food items identified and generating consumption feedback information for the one or more of the food items identified, the consumption feedback information indicating nutritional information related to the one or more of the food items based on the third party food item data associated with the specific location; and providing the feedback information and the consumption feedback information on the one or more food items for display in the see-through, head mounted display device as virtual objects, each of the feedback information together identifiable with the one or more of the food items. - View Dependent Claims (11, 12, 13, 14)
-
-
15. A method for providing nutritional information for food items in a field of view of a see-through, head mounted display system, comprising:
-
determining a current location, orientation and the field of view for the see-through, head mounted display system; determining whether third party data is available for the current location and if so, associating the third party data with the current location, the third party data including food identification data and the nutritional information stored in a non-transitory storage and associated with the food items consumed by a wearer of the system while at the current location; evaluating sensor data from the see-through, head mounted display system to identify the food items proximate to the system, the evaluating using the third party data acquired from the non-transitory storage associated with the current location; determining the nutritional information based on recipe data stored in the non-transitory storage and matching the food items identified and relevant to the wearer of the system; detecting consumption of at least a portion of the food items by the wearer; and providing the nutritional information based on the third party data and the recipe data for at least one of the food items and the consumption to the wearer in the see-through, head mounted display system as a virtual object. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification