Apparatus and method for detecting user action

• US 9,999,395 B2
• Filed: 04/14/2011
• Issued: 06/19/2018
• Est. Priority Date: 08/06/2010
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Chae, Seung-Chul, Lee, Sun-Jae, Chang, Kyung-Ah
• Primary Examiner(s): Benlagsir, Amine
• Application Number:
  US13/086,602
• Publication Number:
  US 20120032819A1
• Time in Patent Office: 2,623 Days
• Field of Search: 341 20, 341 21, 341 22, 341 23
• CPC Class Codes: A61B 2562/0219 Inertial sensors, e.g. accelerometers, gyroscopes, tilt switches
• CPC Class Codes: A61B 5/1113 Local tracking of patients, e.g. in a hospital or private home
• CPC Class Codes: A61B 5/1118 Determining activity level
• CPC Class Codes: A61B 5/6898 Portable consumer electronic devices, e.g. music players, telephones, tablet computers
• CPC Class Codes: G16H 40/67 for remote operation

Abstract

Provided is an apparatus and method for detecting a user activity using a mobile terminal. The apparatus includes a sensing data collection unit to collect sensing data, a location determination unit to determine a location of the mobile terminal using the sensed data, and an action determination unit to determine an activity of a user that is using the mobile terminal based on the collected sensing data and the determined location of the mobile terminal.

Claims

1. An apparatus for detecting a user activity, the apparatus comprising:

a sensing data collector configured to collect sensing data from a sensor mounted on a mobile terminal of a user;

a location determiner configured to acquire posture data of the mobile terminal based on the collected sensing data, and to determine a location of the mobile terminal relative to the user based on the acquired posture data and location probabilities comprising probability increase conditions, wherein the probability increase condition is a modeling element about a condition that increases a probability of a presence of the mobile terminal at a representative location, with respect to possible locations of the mobile terminal relative to the user; and

an action determiner configured to determine the activity of the user based on the determined location of the mobile terminal relative to the user, the collected sensing data, and representative activities,

wherein the action determiner is further configured to select the activity of the user, from among the representative activities, based upon the determined location of the mobile terminal relative to the user and a data pattern with a highest probability of matching the collected sensing data, and

wherein the location determiner is further configured to select location candidates based on the acquired posture data and the location probabilities, and select the determined location of the mobile terminal relative to the user from the location candidates based on the collected sensing data from any combination of any two or more of a triaxial acceleration sensor, a proximity sensor, an orientation sensor, a terrestrial magnetism sensor, a display ON/OFF monitoring sensor, and a sound detection sensor.

2. The apparatus of claim 1, wherein the location determiner is further configured to acquire the posture data using the collected sensing data of the triaxial acceleration sensor.

3. The apparatus of claim 2, wherein the acquired posture data comprises information about inclinations with respect to respective axes of a coordinate system for the triaxial acceleration sensor.

4. The apparatus of claim 1, wherein the action determiner is further configured to determine the activity of the user by restricting the representative activities based on the determined location of the mobile terminal relative to the user.

5. The apparatus of claim 1, wherein the acquiring of the posture data is based on a posture pattern, and the location of the mobile terminal relative to the user is based on a probability that the posture pattern indicates that the mobile terminal is located at a particular location relative to the user.

6. The apparatus of claim 5, wherein the location of the mobile terminal relative to the user is one of a pocket of the user, hands of the user, a neck of the user, and a waist of the user.

7. The apparatus of claim 1, wherein the location of the mobile terminal relative to the user is a portion, of a body of the user, to which the mobile terminal is most probable to be proximate.

8. A method of detecting a user activity, the method comprising:

collecting sensing data from a sensor mounted on a mobile terminal of a user;

acquiring posture data of the mobile terminal based on the collected sensing data, and determining a location of the mobile terminal relative to the user based on the acquired posture data and location probabilities comprising probability increase conditions, wherein the probability increase condition is a modeling element about a condition that increases a probability of a presence of the mobile terminal at a representative location, with respect to possible locations of the mobile terminal relative to the user; and

determining an activity of the user based on the determined location of the mobile terminal relative to the user, the collected sensing data, and representative activities,

wherein the determining of the activity of the user further comprises selecting the activity of the user, from among the representative activities, based upon the determined location of the mobile terminal relative to the user and a data pattern with a highest probability of matching the collected sensing data, and

wherein the determining of the location of the mobile terminal relative to the user further comprises selecting location candidates by comparing the acquired posture data and the location probabilities, and selecting the determined location of the mobile terminal relative to the user from the selected location candidates based on the collected sensing data from any combination of any two or more of a triaxial acceleration sensor, a proximity sensor, an orientation sensor, a terrestrial magnetism sensor, a display ON/OFF monitoring sensor, and a sound detection sensor.

9. The method of claim 8, wherein the acquiring of the posture data of the mobile terminal based on the collected sensing data comprises using the collected sensing data of the triaxial acceleration sensor.

10. The method of claim 8, wherein the data pattern is chosen from a plurality of data patterns comprising a data pattern associated with each representative activity, and

wherein the selecting of the activity of the user further comprises determining the probability of said each representative activity'"'"'s associated data pattern matching the collected sensing data.

11. The method of claim 8, wherein the location of the mobile terminal relative to the user is a portion, of a body of the user, to which the mobile terminal is most probable to be proximate.

12. A mobile terminal for detecting a user activity, the mobile terminal comprising:

a sensing data collector configured to collect sensing data from a sensor mounted on the mobile terminal of a user;

a location determiner configured to determine an orientation and a movement of the mobile terminal based on the collected sensing data, and to determine a location of the mobile terminal relative to the user based on the orientation and the movement and location probabilities comprising probability increase conditions, wherein the probability increase condition is a modeling element about a condition that increases a probability of a presence of the mobile terminal at a representative location, with respect to possible locations of the mobile terminal relative to the user; and

an action determiner configured to determine the activity of the user based on the determined location of the mobile terminal relative to the user, the collected sensing data, and representative activities,

wherein the action determiner is further configured to determine the activity of the user based further on the representative activities, based upon the determined location of the mobile terminal relative to the user and a data pattern with a highest probability of matching the orientation and the movement of the mobile terminal, and

wherein the location determiner is further configured to select location candidates based on the orientation and the movement of the mobile terminal and the location probabilities, and select the determined location of the mobile terminal relative to the user from the location candidates based on the collected sensing data from any combination of any two or more of a triaxial acceleration sensor, a proximity sensor, an orientation sensor, a terrestrial magnetism sensor, a display ON/OFF monitoring sensor, and a sound detection sensor.

13. The mobile terminal of claim 12, wherein the location determiner is further configured to determine the location of the mobile terminal relative to the user based on possible detected locations of the mobile terminal, orientations and movements that the mobile terminal is likely to have at the possible detected locations, and the location probabilities.

14. The mobile terminal of claim 12, wherein the sensing data collector comprises the triaxial acceleration sensor configured to obtain the orientation and the movement of the mobile terminal, and

the location determiner is further configured to determine the location of the mobile terminal based on data sensed by the triaxial acceleration sensor.

15. The apparatus of claim 12, wherein the location of the mobile terminal relative to the user is a portion, of a body of the user, to which the mobile terminal is most probable to be proximate.