Method of operating mobile device by recognizing user's gesture and mobile device using the method

• US 8,831,636 B2
• Filed: 09/06/2011
• Issued: 09/09/2014
• Est. Priority Date: 09/06/2010
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Koh, Jun-ho, Jun, Hae-sik, Kim, Young-suk, Lee, Kyung-eun
• Primary Examiner(s): Arevalo, Joseph
• Application Number:
  US13/225,944
• Publication Number:
  US 20120058783A1
• Time in Patent Office: 1,099 Days
• Field of Search: 345/467, 345/168, 345/173, 715/823, 715/810, 715/858, 455/466, 455/566, 455/99, 455/73, 455/412.2, 455/456.1, 455/456.2, 455/509, 455/574, 455/437, 455/418, 455/414.1, 455/517, 455/41.2, 455/556.1, 455/550.1, 455/411, 370/349, 370/252, 370/332, 370/335, 370/342, 370/338, 370/331
• US Class Current: 455/456.2
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: H04M 1/72451 according to schedules, e.g. using calendar applications
• CPC Class Codes: H04M 1/72454 according to context-related or environment-related conditions
• CPC Class Codes: H04M 1/72457 according to geographic location
• CPC Class Codes: H04M 1/72472 wherein the items are sorted according to specific criteria, e.g. frequency of use
• CPC Class Codes: H04M 2250/12 including a sensor for measuring a physical value, e.g. temperature or motion telephones including GPS signal receivers H04M2250/10
• CPC Class Codes: H04W 4/02 Services making use of location information
• CPC Class Codes: H04W 4/029 Location-based management or tracking services

Abstract

A method of operating a mobile device by recognizing a user'"'"'s gesture and a mobile device that uses the method, the method includes recognizing the user'"'"'s gesture and circumstance information; generating circumstantial gesture information according to a combination of the recognized gesture and the circumstance information; and executing an application item corresponding to the circumstantial gesture information.

Claims

1. A method of operating a mobile device by recognizing a user'"'"'s gesture, the method comprising:

recognizing the user'"'"'s gesture and circumstance information;

outputting to a user, information indicating the recognized gesture and the circumstance information;

generating circumstantial gesture information according to a combination of the recognized gesture and the circumstance information; and

executing an application item corresponding to the circumstantial gesture information,

wherein the circumstance information includes a time at which the user'"'"'s gesture is recognized and a location of the mobile device at the time, and is obtained in connection with a Personal Information Management System (PIMS), and

wherein recognizing the user'"'"'s gesture and the circumstance information includes sensing the user'"'"'s gesture and determining a gesture corresponding to the recognized gesture by comparing a sensed gesture to a plurality of gestures that are previously stored.

2. The method of claim 1, wherein time information about the time is obtained through at least one of an illumination intensity sensor and a clock, which is included in the mobile device.

3. The method of claim 1, wherein location information about the location is obtained through at least one of a Global Positioning System (GPS) reception interface, a Wireless Fidelity (WiFi) interface, and a cellular interface, which is included in the mobile device.

4. The method of claim 1, wherein the application item varies according to a combination of the recognized gesture and the circumstance information.

5. The method of claim 1, wherein the mobile device senses the user'"'"'s gesture by using at least one of an accelerometer, a gyroscope, a camera, a range finder, a terrestrial magnetism sensor, a pressure sensor, and a touch screen.

6. The method of claim 1, further comprising:

outputting, to a user, information indicating the recognized gesture and the circumstance information; and

receiving user feedback information indicating whether the recognized gesture and the circumstance information was intended by the user.

7. A method of operating a mobile device by recognizing a user'"'"'s gesture, the method comprising:

recognizing the user'"'"'s gesture and circumstance information;

outputting to a user, information indicating the recognized gesture and the circumstance information;

generating circumstantial gesture information according to a combination of the recognized gesture and the circumstance information;

mapping the circumstantial gesture information to one of a plurality of application items; and

storing the mapping of the circumstantial gesture information to the one application item,

wherein the circumstance information includes a time at which the user'"'"'s gesture is recognized and a location of the mobile device at the time, and is obtained in connection with a Personal Information Management System (PIMS), and

wherein recognizing the user'"'"'s gesture and the circumstance information includes sensing the user'"'"'s gesture and determining a gesture corresponding to the recognized gesture by comparing a sensed gesture to a plurality of gestures that are previously stored.

8. The method of claim 7, wherein mapping the circumstantial gesture information to one of the plurality of application items comprises:

outputting, to a user, an application items list including the plurality of application items;

receiving a selection of an application item in the application items list based on a user input signal; and

mapping the circumstantial gesture information to the selected application item.

9. A mobile device operating by recognizing a user'"'"'s gesture, the mobile device comprising:

a gesture setting unit for recognizing the user'"'"'s gesture and circumstance information, and generating circumstantial gesture information according to a combination of the recognized gesture and the circumstance information; and

a gesture executing unit for executing an application item corresponding to the circumstantial gesture information,

wherein the circumstance information includes a time at which the user'"'"'s gesture is recognized and a location of the mobile device at the time, and is obtained in connection with a Personal Information Management System (PIMS), and

wherein recognizing the user'"'"'s gesture and the circumstance information includes sensing the user'"'"'s gesture and determining a gesture corresponding to the recognized gesture by comparing a sensed gesture to a plurality of gestures that are previously stored.

10. The mobile device of claim 9, wherein the application item varies according to a combination of the recognized gesture and the circumstance information.

11. The mobile device of claim 9, further comprising:

a providing unit for outputting, to a user, information indicating the recognized gesture and the circumstance information; and

an input unit for receiving user feedback information indicating whether the recognized gesture and the circumstance information was intended by the user.

12. The mobile device of claim 11, wherein the providing unit includes a display unit.

13. The mobile device of claim 9, further comprising a circumstance information obtaining unit for obtaining the circumstance information in connection with a user'"'"'s emotional state.

14. The mobile device of claim 13, where the user'"'"'s emotional state is determined according to a decibel level of sound information received through a microphone.

15. The mobile device of claim 9, wherein the gesture setting unit maps the circumstantial gesture information to one of a plurality of application items, and stores the mapping of the circumstantial gesture information to the one application item to a memory, and

wherein the gesture executing unit executes the mapped application item.

16. A non-transitory computer-readable recording medium having recorded thereon a program for executing a method of operating a mobile device by recognizing a user'"'"'s gesture, the method comprising:

recognizing the user'"'"'s gesture and circumstance information;

outputting to a user, information indicating the recognized gesture and the circumstance information;

generating circumstantial gesture information according to a combination of the recognized gesture and the circumstance information; and

executing an application item corresponding to the circumstantial gesture information,

wherein the circumstance information includes a time at which the user'"'"'s gesture is recognized and a location of the mobile device at the time, and is obtained in connection with a Personal Information Management System (PIMS), and

wherein recognizing the user'"'"'s gesture and the circumstance information includes sensing the user'"'"'s gesture and determining a gesture corresponding to the recognized gesture by comparing a sensed gesture to a plurality of gestures that are previously stored.