PROVIDING RECOMMENDATIONS BASED UPON ENVIRONMENTAL SENSING

• US 20160255401A1
• Filed: 05/11/2016
• Published: 09/01/2016
• Est. Priority Date: 02/05/2013
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Hayton, Mike, Johnson, Zach
• Granted Patent: US 9,749,692 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/436 using biological or physiological data of a human being, e.g. blood pressure, facial expression, gestures
• CPC Class Codes: G06Q 30/0252 based on events or environment, e.g. weather or festivals
• CPC Class Codes: G06Q 30/0631 Item recommendations
• CPC Class Codes: H04N 21/42201 biosensors, e.g. heat sensor for presence detection, EEG sensors or any limb activity sensors worn by the user input arrangements for interaction with the human body based on nervous system activity detection G06F3/015
• CPC Class Codes: H04N 21/42202 environmental sensors, e.g. for detecting temperature, luminosity, pressure, earthquakes
• CPC Class Codes: H04N 21/42203 sound input device, e.g. microphone
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/4532 involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/4668 for recommending content, e.g. movies
• CPC Class Codes: H04N 21/8126 involving additional data, e.g. news, sports, stocks, weather forecasts

Abstract

Embodiments are disclosed that relate to providing digital content recommendations based upon environmental sensor data. For example, one embodiment provides a computing device configured to receive sensor data from a sensor system, to detect a user present in the use environment via the sensor data, identify the user, recognize a current state of each of one or more use environment state features associated with the user via the sensor data, and store the current state of each of the one or more use environment state features. The computing device is further configured to detect a triggering condition for a selected use environment state feature, and in response provide information related to the selected use environment state feature based upon one or more of the current state of the use selected use environment state feature and a previously-stored state of the selected use environment state feature.

Claims

1. A computing device, comprising:

a logic subsystem; and

a data storage subsystem comprising instructions stored thereon that are executable by the logic subsystem to;

receive sensor data from a sensor system including one or more sensors configured to acquire the sensor data by monitoring a use environment;

associate the sensor data with a user;

recognize a current state of each of one or more use environment state features associated with the user via the sensor data;

store the current state of each of the one or more use environment state features;

detect a triggering condition for a selected use environment state feature; and

upon detecting the triggering condition, provide information related to the selected use environment state feature based upon one or more of the current state of the use selected use environment state feature and a previously-stored state of the selected use environment state feature.

2. The computing device of claim 1, where the current state of each of the one or more use environment features is stored via one or more of a local storage machine and a remote storage machine.

3. The computing device of claim 1, where the instructions are further executable to determine whether the user has provided authorization to be monitored by the sensor system, where the current state of each of the one or more use environment state features associated with the user are stored only if the user has provided authorization.

4. The computing device of claim 1, further comprising capturing the sensor data at a first, lower bitrate corresponding to a passive monitoring mode when no activity is detected, and at a second, higher bitrate corresponding to an active monitoring mode when activity is detected.

5. The computing device of claim 1, where the selected use environment state feature includes one of a physical feature of the user, an activity performed by the user, and a device being operated by the user.

6. The computing device of claim 5, where the triggering condition includes a change in the physical feature of the user meeting a triggering threshold.

7. The computing device of claim 6, where the information related to the selected use environment feature includes one or more of information describing the change in the physical feature, a recommendation of goods or services related to the physical feature, and a recommendation of one or more changes to user behavior.

8. The computing device of claim 1, where the selected use environment state feature includes one of an identity of a content item being consumed in the use environment, an identity of a constituent component of the content item being consumed in the use environment, a device accessing the content item, and a current access position of the content item.

9. The computing device of claim 8, where the triggering condition includes a user input requesting provision of the information related to the selected use environment state feature.

10. The computing device of claim 8, where the information related to the selected use environment state feature includes one or more of information regarding a related content item, auxiliary information for the content item, and a link to acquire an instance of the content item.

11. The computing device of claim 1, where the one or more sensors include one or more of an audio sensor and an image sensor.

12. A method for monitoring a use environment, the method comprising:

acquiring first sensor data at a first bitrate via one or more sensors monitoring the use environment, the first bitrate corresponding to a passive monitoring mode;

recognizing activity in the use environment based on the first sensor data;

in response, acquiring second sensor data at a second bitrate via the one or more sensors, the second bitrate being higher than the first bitrate and corresponding to an active monitoring mode;

recognizing in the use environment a content item being consumed in the use environment via the second sensor data; and

providing information related to the content item.

13. The method of claim 12, where recognizing activity in the use environment comprises detecting one or more of motion meeting a motion threshold, sound meeting a sound threshold, and a user present in the use environment.

14. The method of claim 12, where recognizing the content item being experienced in the use environment comprises comparing an audio sample of the second sensor data representing the content item to known audio information.

15. The method of claim 12, where recognizing the content item being experienced in the use environment comprises comparing an image sample of the second sensor data representing the content item to known image information.

16. The method of claim 12, where recognizing the content item being experienced in the use environment includes identifying a source of the content item.

17. The method of claim 12, further comprising adding the content item to a content playlist.

18. The method of claim 12, further comprising recognizing a number of users present in the use environment, where the information related to the selected use environment state feature is selected based upon the number of users.

19. A computing device, comprising:

a logic subsystem; and

a data storage subsystem comprising instructions stored thereon that are executable by the logic subsystem to;

receive first sensor data from a sensor system including one or more sensors configured to acquire data via monitoring a use environment, the first sensor data acquired at a first bitrate corresponding to a passive monitoring mode;

detect a user present in the use environment via the first sensor data;

receive second sensor data from the sensor system, the second sensor data acquired at a second bitrate corresponding to an active monitoring mode, the second bitrate being higher than the first bitrate;

identify the user;

upon identifying the user, recognize a current state of each of one or more use environment state features associated with the user via the second sensor data;

store the current state of each of the one or more use environment state features;

detect a triggering condition for a selected use environment state feature; and

upon detecting the triggering condition, provide information related to the selected use environment state feature based upon one or more of the current state of the use selected use environment state feature and a previously-stored state of the selected use environment state feature.

20. The computing device of claim 19, the instructions being further executable to determine whether the user has provided authorization to be monitored by the sensor system by recognizing one or more of previously-defined authorization information and an authorization gesture, where the current state of each of one or more use environment features is not stored authorization to be monitored by the sensor system has not been provided.