Controlling display of data to a person via a display apparatus

• US 10,671,940 B2
• Filed: 10/26/2017
• Issued: 06/02/2020
• Est. Priority Date: 10/31/2016
• Status: Active Grant

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Technologies Oy (Nokia Corporation)
• Inventors: Marin, Janne, Kasslin, Mika, Laitinen, Lauri, Beszteri, Istvan, Alanen, Olli, Chistyakov, Oleg
• Primary Examiner(s): Chen, Alan
• Application Number:
  US16/342,295
• Publication Number:
  US 20190258955A1
• Time in Patent Office: 950 Days
• CPC Class Codes: G06F 21/6218 to a system of files or objects, e.g. local or distributed file system or database
• CPC Class Codes: G06N 20/00 Machine learning
• CPC Class Codes: G06Q 10/00 Administration; Management
• CPC Class Codes: G06Q 10/08 Logistics, e.g. warehousing, loading or distribution; Inventory or stock management

Abstract

A method comprising: identifying characteristic changes in radio environment arising from a person; and using the identified characteristic changes in radio environment arising from a person to predict when a person approaches a display apparatus and to pre-fetch data for the person.

Claims

1. An apparatus comprising:

at least one processor; and

at least one non-transitory memory including computer program code;

the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to perform;

identifying, by the at least one processor, characteristic changes in radio environment arising in accordance with behaviors of a person detected by a plurality of sensors; and

using, by the at least one processor, the identified characteristic changes in radio environment to predict when the person approaches a display apparatus and to pre-fetch data for the person;

recording events comprising one or more radio environment events;

using a combination of the recorded events comprising the one or more radio environment events as an input to a machine learning algorithm for predicting with a defined level of confidence that the person is approaching the display apparatus;

after predicting when the person is approaching the display apparatus, either detecting arrival of a person at the display apparatus and adjusting the algorithm to increase the level of confidence for a subsequent prediction based on the arrival of the person at the display apparatus and further based on the combination of the recorded events comprising the one or more radio environment events, or determining that a person does not arrive at the display apparatus and adjusting the algorithm to decrease the level of confidence for a subsequent prediction based on that the person does not arrive at the display apparatus and further based on the combination of the recorded events comprising the one or more radio environment events.

2. An apparatus as claimed in claim 1, wherein the characteristic changes in radio environment arising from a person depends upon electrical properties of the person.

3. An apparatus as claimed in claim 1, wherein identifying characteristic changes in radio environment arising from a person does not involve tracking an electronic device or identifying characteristic changes in radio environment arising from an electronic device.

4. An apparatus as claimed in claim 1, wherein the at least one memory and the computer program code are further configured to, with the at least one processor, cause the apparatus at least to perform:

using the identified characteristic changes in radio environment arising from a person to predict when a particular person approaches the display apparatus and pre-fetch data for that particular person.

5. An apparatus as claimed in claim 1, wherein the at least one memory and the computer program code are further configured to, with the at least one processor, cause the apparatus at least to perform:

receiving radio environment data over an extended period of time and performing temporal pattern recognition in the received radio environment data to identify characteristic changes in radio environment arising from a person.

6. An apparatus as claimed in claim 1, wherein the at least one memory and the computer program code are further configured to, with the at least one processor, cause the apparatus at least to perform:

recording events comprising one or more radio environment events, detecting arrival of a person at the display apparatus, and using a combination of the recorded events comprising one or more radio environment events that are recorded prior to the arrival of the person, as a learning input to a machine learning algorithm for predicting when a person is approaching the display apparatus.

7. An apparatus as claimed in claim 6, wherein the recorded events additionally comprise one or more of:

time of day, day of week and schedule of one or more a persons.

8. An apparatus as claimed in claim 1, wherein the pre-fetched data is data for display to the person via the display apparatus.

9. An apparatus as claimed in claim 8, wherein the at least one memory and the computer program code are further configured to, with the at least one processor, cause the apparatus at least to perform:

authentication of the person before displaying pre-fetched data to that person via the display apparatus.

10. An apparatus as claimed in claim 1, wherein the changes in the radio environment are detected by a plurality of spatially separated sensors configured to form a radio frequency impedance network having electrical properties that are changed by movement of a person relative to the sensors.

11. The apparatus as claimed in claim 1, wherein the recorded events additionally comprise one or more schedule events of the person.

12. A method comprising:

identifying, by at least one processor, characteristic changes in radio environment arising in accordance with behaviors of a person detected by a plurality of sensors; and

using, by the at least one processor, the identified characteristic changes in radio environment to predict when the person approaches a display apparatus and to pre-fetch data for the person;

recording events comprising one or more radio environment events;

using a combination of the recorded events comprising the one or more radio environment events as an input to a machine learning algorithm for predicting with a defined level of confidence that the person is approaching the display apparatus;

after predicting when the person is approaching the display apparatus, either detecting arrival of a person at the display apparatus and adjusting the algorithm to increase the level of confidence for a subsequent prediction based on the arrival of the person at the display apparatus and further based on the combination of the recorded events comprising the one or more radio environment events, or determining that a person does not arrive at the display apparatus and adjusting the algorithm to decrease the level of confidence for a subsequent prediction based on that the person does not arrive at the display apparatus and further based on the combination of the recorded events comprising the one or more radio environment events.

13. A method as claimed in claim 12, wherein the method is performed when a connection bandwidth for obtaining data for display is below a threshold value.

14. A method as claimed in claim 12, wherein the display apparatus is a mirror comprising a display and a one-way mirror, wherein the display apparatus operates as a mirror in the absence of the display displaying data and wherein data is displayed through the mirror when the display displays data.

15. A method as claimed in claim 12, wherein the characteristic changes in radio environment arising from a person depends upon electrical properties of the person.

16. A method as claimed in claim 12, wherein identifying characteristic changes in radio environment arising from a person does not involve tracking an electronic device or identifying characteristic changes in radio environment arising from an electronic device.

17. A method as claimed in claim 12, wherein using the identified characteristic changes in radio environment arising from a person to predict when a person approaches a display apparatus and to pre-fetch data for the person comprises using the identified characteristic changes in radio environment arising from a person to predict when a particular person approaches the display apparatus and pre-fetch data for that particular person.

18. A method as claimed in claim 12, wherein the changes in the radio environment are detected by a plurality of spatially separated sensors configured to form a radio frequency impedance network having electrical properties that are changed by movement of a person relative to the sensors.

19. A non-transitory computer readable medium comprising program instructions stored thereon to cause performing of at least the following:

identifying, by at least one processor, characteristic changes in radio environment arising in accordance with behaviors of a person detected by a plurality of sensors; and

using, by the at least one processor, the identified characteristic changes in radio environment to predict when the person approaches a display apparatus and to pre-fetch data for the person;

recording events comprising one or more radio environment events;

using a combination of the recorded events comprising the one or more radio environment events as an input to a machine learning algorithm for predicting with a defined level of confidence that the person is approaching the display apparatus;

after predicting when the person is approaching the display apparatus, either detecting arrival of a person at the display apparatus and adjusting the algorithm to increase the level of confidence for a subsequent prediction based on the arrival of the person at the display apparatus and further based on the combination of the recorded events comprising the one or more radio environment events, or determining that a person does not arrive at the display apparatus and adjusting the algorithm to decrease the level of confidence for a subsequent prediction based on that the person does not arrive at the display apparatus and further based on the combination of the recorded events comprising the one or more radio environment events.