Method for detecting context of a mobile device and a mobile device with a context detection module

• US 9,549,292 B2
• Filed: 06/21/2015
• Issued: 01/17/2017
• Est. Priority Date: 02/17/2012
• Status: Active Grant

• Current Assignee: Context Directions LLC (Jeffrey M. Gross)
• Original Assignee: BinarTech Sp. z o.o
• Inventors: Aksamit, Pawel
• Primary Examiner(s): TRAN, MONG-THUY THI
• Application Number:
  US14/745,433
• Publication Number:
  US 20150289107A1
• Time in Patent Office: 576 Days
• Field of Search: 455/456.1, 455/418
• US Class Current: 1/1
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34
• CPC Class Codes: H04M 1/72454 according to context-related or environment-related conditions
• CPC Class Codes: H04W 24/00 Supervisory, monitoring or testing arrangements
• CPC Class Codes: H04W 24/02 Arrangements for optimising operational condition
• CPC Class Codes: H04W 4/025 using location based information parameters
• CPC Class Codes: H04W 4/027 using movement velocity, acceleration information
• CPC Class Codes: H04W 52/0254 detecting a user operation or a tactile contact or a motion of the device
• CPC Class Codes: Y02D 30/70 in wireless communication networks

Abstract

A method for detecting a context of a mobile device (100) equipped with sensors (111, 121, 122, 131) and a context detection module (109) in which the sensors (111, 121, 122, 131) are assigned to at least two groups (110, 120, 30), each of which comprises at least one sensor (111, 121, 122, 131), and each group (110, 120, 130) is allocated a group classifier (116, 126, 136) 10 adapted to detect, in a form of a classification result, currently identified, by means of a given classifier, context of the device (100) based on indications of the sensors (111, 121, 122, 131) belonging to the given group, characterized in that with a use of the context detection module, whereas the groups (110, 102, 130) of sensors are ordered hierarchically, and the device context is detected 1 by reading a classification result indicated by the classifier (116, 126, 136) of the currently active group, wherein in case of detection of an identified context in the active group, switching on power supply of the sensors and activating classification in a group (110, 120, 130) with a level higher by one level and reading the context indicated by said group'"'"'s classifier, wherein based on the 20 results of the classification indicated by the higher groups'"'"' classifiers (116, 26, 136), executing adaptation of the configuration of lower groups'"'"' classifiers (116, 126, 136).

Claims

1. A method for detecting a context of a mobile device equipped with sensors and a context detection module comprising:

assigning the sensors to at least two groups, each of which comprises at least one sensor,

allocating to each group a group classifier adapted to detect, in a form of a classification result, currently identified, by means of a given classifier, context of the device based on indications of the sensors belonging to the given group,

wherein the groups of sensors are assigned levels according to a hierarchy that determines the order of switching on the groups of sensors during context detection;

using the context detection module to;

indicate the classification result as either positive or negative, wherein the positive classification result indicates that the identified context occurs and the negative classification results indicates that the identified context does not occur;

detect the device context by reading classification results indicated by classifiers, wherein the classification is started from the classifier of the group of the lowest level in the hierarchy, wherein each time when the classification result indicated by the classifier is positive or when the classification result indicated by the classifier is negative for a plurality of times in a row, switching on a power supply of the sensors and activating classification by the classifier allocated to a group with a level higher by one level in the hierarchy and reading the context indicated by said group'"'"'s classifier; and

,

based on the results of the classification indicated by the higher groups'"'"' classifiers, executing adaptation of the configuration of lower groups'"'"' classifiers.

2. The method according to claim 1, wherein if the result of the classification indicated by a top level group classifier is a positive result of the classification, executing at least one operation from a set, which comprises:

adapting user interface of the mobile device, changing of state or mode of an operating application of the mobile device, execution of an application, closing of an application, activation of a function of the mobile device, mobile device'"'"'s function deactivation, changing of the configuration of the mobile device, playback of a sound signal, establishing a voice call, sending of a text message, sending of a graphical message, establishing a data connection, data transmission.

3. The method according to claim 1, wherein at least one group of sensors comprises a sensor from a set, which includes:

an accelerometer, a microphone, a magnetic field sensor, a compass, a light sensor, a camera, a signal strength sensor of mobile telephony base stations, a proximity sensor of a radio transmitter or relay, a receiver of satellite geographic positioning system.

4. The method according to claim 3, wherein the satellite geographic positioning system receiver belongs to the group of the highest level.

5. The method according to claim 1, wherein the sensor groups are ordered hierarchically such that the total amount of energy required to determine a classification result in lower levels groups is less than the amount of energy required to determine the result of the classification in groups of higher levels.

6. The method according to claim 1, wherein the sensors groups are ordered hierarchically in such a way that the result of the classification in groups of higher levels has lower uncertainty than the classification result of the lower levels groups.

7. The method according to claim 1, wherein switching the power on for at least one sensor is based on a change of its mode of operation from a more energy efficient to a less energy efficient.

8. The method according to claim 1, wherein substantially in parallel with powering on a higher level group of sensors there are powered off sensors of a lower level group.

9. The method according to claim 8, wherein switching the power off for at least one sensor is based on a change of its mode of operation from a less energy efficient to a more energy efficient.

10. The method according to claim 1, wherein at least one sensor is switched to a reduced power consumption after reading indication of a given sensor.

11. The method according to claim 1, wherein at least one of the sensors belonging to the lowest level group has power supply switched on in a constant mode.

12. The method according to claim 1, wherein there is switched on at least one of the sensors belonging to the lowest level group, periodically or according to a fixed schedule.

13. The method according to claim 1, wherein the continuous powering or period or power on schedule of at least one sensor depend on the internal state of the mobile device, on the configuration of the device selected by the user, on an entry in a user'"'"'s calendar or on the currently specified device'"'"'s context.

14. The method according to claim 1, wherein indications of the sensors assigned to a given group, are read by means of a module for determining features assigned to the given group and adapted for determining a features vector on the basis of readings of the sensors belonging to the given group.

15. The method according to claim 14, wherein the features vector further includes readings of a sensor belonging to a group of lower level.

16. The method according to claim 1, wherein in at least one classifier there is stored a set of positive patterns comprising features vectors indicating a positive result of the classification, and a set of negative patterns comprising features vectors indicating a negative result of classification.

17. The method according to claim 1, wherein at least one classifier is adapted to determine the context of the device based on a formula of “

k nearest neighbours”

.

18. A mobile device equipped with sensors and a context detection module in which

the sensors are assigned to at least two groups, each of which comprises at least one sensor,

and the context detection module comprises classifiers connected to predefined groups whereas each classifier adapted to detect, in a form of a classification result, currently identified, by means of a given classifier, context of the device based on indications of the sensors belonging to the given group,

wherein the groups of sensors are assigned levels according to a hierarchy that determines the order of switching on the groups of sensors during context detection,

wherein the classification result is indicated as either positive or negative, wherein the positive classification result indicates that the identified context occurs and the negative classification results indicates that the identified context does not occur;

the context detection module is adapted to verify context of the device by reading a classification result indicated by the classifiers, wherein the classification is started from the classifier of the group of the lowest level in the hierarchy, wherein each classifier comprises a classification determination module connected to a power controller, which is activated with a signal from the classifier indicating a positive classification result or a signal from the classifier indicating a negative classification result for a plurality of times in a row, and adapted to switch a power supply on to a group of sensors with a level higher by one level in the hierarchy in order to read the context indicated by said group'"'"'s classifier,

wherein the classifiers further comprise an adaptation module configured to adapt the configuration of the classifier based on results of classifications indicated by higher groups'"'"' classifiers.

19. The device according to claim 18, wherein it is adapted to execute, if the result of the classification indicated by a top level group classifier is a positive result of the classification, at least one operation from a set, which comprises:

adaptation of user interface the mobile device, changing of state or mode of an operating application of the mobile device, execution of an application, closing of an application, activation of a function of the mobile device, mobile device'"'"'s function deactivation, changing of the configuration of the mobile device, playback of a sound signal, establishing a voice call, sending of a text message, sending of a graphical message, establishing a data connection, data transmission.

20. The device according to claim 18, wherein at least one group of sensors comprises a sensor selected from a set, which includes:

an accelerometer, a microphone, a magnetic field sensor, a compass, a light sensor, a camera, a signal strength sensor of mobile telephony base stations, a proximity sensor of a radio transmitter or relay, a receiver of satellite geographic positioning system.

21. The device according to claim 20, wherein the satellite geographic positioning system receiver belongs to the group of the highest level.

22. The device according to claim 18, wherein the sensor groups are ordered hierarchically such that the total amount of energy required to determine a classification result in lower levels groups is less than the amount of energy required to determine the result of the classification in groups of higher levels.

23. The device according to claim 18, wherein the sensors groups are ordered hierarchically in such a way that the result of the classification in groups of higher levels has lower uncertainty than the classification result of the lower levels groups.

24. The device according to claim 18, wherein the power supply controller is adapted to switching the power on for at least one sensor by changing its mode of operation from a more energy efficient to a less energy efficient.

25. The device according to claim 18, wherein the power supply controller is adapted to, substantially in parallel with powering on a higher level group of sensors, power off sensors of a lower level group.

26. The device according to claim 25, wherein the switching the power off for at least one sensor is based on a change of its mode of operation from a less energy efficient to a more energy efficient.

27. The device according to claim 18, wherein at least one sensor is switched to a reduced power consumption after reading indication of a given sensor.

28. The device according to claim 18, wherein at least one of the sensors belonging to the lowest level group has power supply switched on in a constant mode.

29. The device according to claim 18, wherein at least one of the sensors belonging to the lowest level group is switched on periodically or according to a fixed schedule.

30. The device according to claim 18, wherein the continuous powering or period or power on schedule of at least one sensor depend on the internal state of the mobile device, on the configuration of the device selected by the user, on an entry in a user'"'"'s calendar or on the currently specified device'"'"'s context.

31. The device according to claim 18, wherein the context detection module is equipped with modules for determining features, of which each is connected to a given group and is configured to determine a features vector on the basis of readings of the sensors belonging to the given group.

32. The device according to claim 31, wherein the features vector further includes readings of a sensor belonging to a group of lower level.

33. The device according to claim 18, wherein in at least one classifier there is stored a set of positive patterns comprising features vectors indicating a positive result of the classification, and a set of negative patterns comprising features vectors indicating a negative result of the classification.

34. The device according to claim 18, wherein at least one classifier is adapted to determine the context of the device based on a formula of “

k nearest neighbours”

.

35. A computer usable non-transitory storage medium having a computer program embodied thereon for causing a suitable programmed system to detect context of a mobile device equipped with sensors and a context detection module, by performing the following steps when such program is executed on the system, the steps comprising:

assigning the sensors to at least two groups, each of which comprises at least one sensor,

allocating to each group a group classifier adapted to detect, in a form of a classification result, currently identified, by means of a given classifier, context of the device based on indications of the sensors belonging, to the given group,

wherein the groups of sensors are assigned levels according to a hierarchy that determines the order of switching on the groups of sensors during context detection,

using the context detection module to;

indicate the classification result as either positive or negative, wherein the positive classification result indicates that the identified context occurs and the negative classification results indicates that the identified context does not occur;

detect the device context by reading classification results indicated by classifiers, wherein the classification is started from the classifier of the group of the lowest level in the hierarchy, wherein each time when the classification result indicated by the classifier is positive or when the classification result indicated by the classifier is negative for a plurality of times in a row, switching on a power supply of the sensors and activating classification by the classifier allocated to a group with a level higher by one level in the hierarchy and reading the context indicated by said group'"'"'s classifier; and

,

based on the results of the classification indicated by the higher groups'"'"' classifiers, executing adaptation of the configuration of lower groups'"'"' classifiers.