Gesture-based control method and apparatus of an electronic device

• US 8,744,528 B2
• Filed: 05/16/2011
• Issued: 06/03/2014
• Est. Priority Date: 05/16/2011
• Status: Active Grant

• Current Assignee: LG Electronics, Inc. (LG Corporation)
• Original Assignee: LG Electronics, Inc. (LG Corporation)
• Inventors: Kim, Yongsin, Cho, Jeff
• Primary Examiner(s): WASHINGTON, ERIKA ALISE
• Application Number:
  US13/201,950
• Publication Number:
  US 20120295661A1
• Time in Patent Office: 1,114 Days
• Field of Search: 455/556.1
• US Class Current: 455/566
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 21/629 to features or functions of an application
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

An electronic device is provided comprising a camera obtaining an image, and a controller that performs a control operation based on a gesture recognized from the obtained image, wherein the controller performs a predetermined function of an application being executed when a predetermined gesture of a user is recognized, wherein the user does not have a control right and the predetermined gesture corresponds to the predetermined function.

Claims

1. An electronic device, comprising:

a camera configured to obtain an image; and

a controller configured to;

perform a control operation based on a control granting gesture recognized from the obtained image; and

perform a predetermined function of an application being executed when a predetermined gesture of a user is recognized, the user not having a control right, the predetermined gesture corresponding to the predetermined function, the predetermined gesture being different from the control granting gesture.

2. The electronic device of claim 1, wherein the controller is further configured to grant the user only a control right for the application being executed when the predetermined gesture is recognized.

3. The electronic device of claim 2, wherein the controller is further configured to grant the user only a control right for at least one function, including the predetermined function of the application being executed, when the predetermined gesture is recognized.

4. The electronic device of claim 2, wherein the controller is further configured to grant another user only a control right for the application being executed when the predetermined gesture of the user is recognized.

5. The electronic device of claim 1, wherein:

the application being executed comprises an application for controlling content received from another electronic device interworking with the electronic device; and

the user who does not have the control right is a user of the another electronic device.

6. The electronic device of claim 5, wherein the electronic device is further configured to receive the content through a near-field wireless communication network formed between the electronic device and the another electronic device.

7. The electronic device of claim 6, wherein the controller is further configured to:

obtain a location of the another electronic device using a wireless location determination method based on the near-field wireless communication network; and

obtain a location of a user who has a control right for the second control right based on the location of the another electronic device.

8. The electronic device of claim 1, wherein:

the application being executed is an application for performing a function associated with an external interrupt; and

the user who does not have the control right is a user associated with the external interrupt.

9. The electronic device of claim 8, wherein the controller is further configured to:

store information associated with the external interrupt if the user associated with the external interrupt is not recognized from the image; and

output the stored information if the user associated with the external interrupt is recognized.

10. The electronic device of claim 1, wherein:

the electronic device comprises a mobile terminal;

the application being executed is a phone application; and

the controller is further configured to obtain the user'"'"'s image using the camera if the mobile terminal is away from the user'"'"'s face during a call.

11. The electronic device of claim 10, wherein the controller is further configured to shift a call mode of the mobile terminal to a speaker phone mode if the mobile terminal is away from the user'"'"'s face during a call.

12. The electronic device of claim 1, wherein the controller is further configured to display a virtual keyboard on an execution screen of the application when a gesture of the user for displaying the virtual keyboard on the execution screen of the application is recognized.

13. The electronic device of claim 1, wherein the controller is further configured to perform a character input using a virtual keyboard when a gesture of the user for entering a character using the virtual keyboard is recognized while the virtual keyboard is displayed on an execution screen of the application.

14. The electronic device of claim 1, wherein:

the application being executed comprises a driving application of the electronic device;

the driving application is in execution as a background process; and

the predetermined function comprises a function of changing an operational state of the electronic device based on the user'"'"'s gesture.

15. The electronic device of claim 1, wherein:

the application being executed comprises a driving application of the electronic device;

the driving application is in execution as a background process; and

the predetermined function comprises a function of performing a predetermined function of a predetermined application corresponding to the user'"'"'s gesture.

16. An electronic device, comprising:

a camera configured to obtain an image; and

a controller configured to;

grant a user a control right based on a gesture recognized from the obtained image; and

deprive the user of the control right if the user'"'"'s control gesture is not recognized for a predetermined time, the controller further configured to differently set the predetermined time based on a type of an application.

17. The electronic device of claim 16, wherein the controller is further configured to differently set the predetermined time based on a function performed by the application.

18. The electronic device of claim 17, wherein the controller is further configured to differently set the predetermined time based on the user'"'"'s setting.

19. The electronic device of claim 16, wherein the controller is further configured to differently set the predetermined time based on the user'"'"'s setting.

20. The electronic device of claim 16, wherein the controller is further configured to maintain the control right granted to the user while a predetermined application is in execution even if a gesture of abandoning the control right is recognized.

21. The electronic device of claim 16, wherein the controller is further configured to maintain the control right granted to the user until an application being executed is terminated even if the user'"'"'s control gesture is not recognized for the predetermined time.

22. The electronic device of claim 16, wherein the controller is further configured to maintain the control right granted to the user until a predetermined function of an application being executed is terminated even if the user'"'"'s control gesture is not recognized for the predetermined time.

23. The electronic device of claim 16, wherein the controller is further configured to differently set or maintain the predetermined time based on whether a function associated with the performed predetermined function is conducted in the predetermined application.

24. An electronic device forming a network along with another electronic device, the electronic device comprising:

a camera configured to obtain an image; and

a controller configured to grant a user a control right for the electronic device and the another electronic device such that the user controls the electronic device and the another electronic device, based on a gesture recognized from the obtained image.

25. The electronic device of claim 24, wherein the controller is further configured to grant the user a control right for the electronic device corresponding to a control right obtaining gesture recognized as an analysis result of the user'"'"'s image among a plurality of predetermined control right obtaining gestures.

26. The electronic device of claim 24, wherein, when a second user who has a control right for the another electronic device is recognized from the obtained image, the controller is further configured to grant the second user a control right for the another electronic device allowing the second user to control the another electronic device through the electronic device.

27. The electronic device of claim 24, wherein, when a second user who previously had a control right for the another electronic device is recognized from the obtained image, the controller is further configured to grant the second user a control right for the another electronic device allowing the second user to control the another electronic device through the electronic device.

28. An electronic device, comprising:

a camera configured to obtain an image; and

a controller configured to;

grant a user a control right for the electronic device such that the user controls the electronic device, based on a gesture recognized from the obtained image; and

deprive the user of the control right if the user departs from a recognition range of the camera, the controller maintaining the control right granted to the user for at least a predetermined time after the user departs from the recognition range of the camera.

29. The electronic device of claim 28, wherein the controller is further configured to grant a second user recognized through the camera a control right allowing the second user to control the electronic device using a gesture when the user departs from the recognition range of the camera.

30. The electronic device of claim 29, wherein the second user is a user preset as a user who is the second to have a control right for the electronic device.

31. The electronic device of claim 29, wherein the controller is further configured to change an operational mode of the electronic device if the second user is not recognized when the user departs from the recognition range of the camera.

32. An electronic device, comprising:

a camera configured to obtain an image; and

a controller configured to;

perform a control operation based on a control granting gesture recognized from the obtained image, the control operation granting a control right to a first user; and

perform a predetermined function of an application being executed when a predetermined gesture of a second user, different from the first user, is recognized, where only the first user has the control right, the predetermined gesture corresponding to the predetermined function, the predetermined gesture being different from the control granting gesture.