METHOD AND APPARATUS FOR MANIPULATING A GRAPHICAL USER INTERFACE USING CAMERA

• US 20140092015A1
• Filed: 09/29/2012
• Published: 04/03/2014
• Est. Priority Date: 09/29/2012
• Status: Abandoned Application

• Current Assignee: Zhaohui Xing
• Original Assignee: Zhaohui Xing
• Inventors: Xing, Zhaohui
• Application Number:
  US13/631,863
• Publication Number:
  US 20140092015A1
• Time in Patent Office: Days
• US Class Current: 345/158
• CPC Class Codes: G06V 40/171 Local features and components; Facial parts eye characteristics G06V40/18; Occluding parts, e.g. glasses; Geometrical relationships
• CPC Class Codes: G06V 40/176 Dynamic expression

Abstract

A method and a computing device for manipulating a graphical user interface (GUI) using camera are disclosed. The computing device captures images of a user by using a camera, detects the face image of the user from captured images, and detects at least one facial feature in the face image. The computing device analyzes at least one parameter of one or more facial features to determine gestures.

Claims

1. A method performed by a computing device for manipulating a graphic object presented on a display, the method comprising:

capturing images of a user by using an imaging device;

detecting the face image of the user in the captured images;

recognizing at least one facial feature in the face image;

calculating at least one parameter of said at least one facial feature; and

manipulating said graphic object based on the analysis of said at least one parameter of the at least one facial feature.

2. The method of claim 1 wherein said imaging device is located in proximity to the display.

3. The method of claim 2 wherein said at least one facial feature is selected from the group of eye, eyebrow, nose, mouth and ear.

4. The method of claim 3 wherein said at least one parameter of the at least one facial feature is selected from the group of shape, size, angle and position of the at least one facial feature.

5. The method of claim 4 wherein said computing device is a portable computing device.

6. The method of claim 5 wherein said imaging device is integrated in the portable computing device.

7. The method of claim 6 wherein said computing device is a phone.

8. The method of claim 6 wherein said computing device is a tablet.

9. The method of claim 6 wherein said computing device is a game console.

10. The method of claim 1 further comprising:

calculating at least one parameter of said face image; and

manipulating said graphic object based on the analysis of said at least one parameter of said face image and said at least one parameter of the at least one facial feature.

11. A computing device, comprising:

an imaging device;

a screen; and

a processing unit functionally coupling to said imaging device and said screen;

said processing unit executing code for

displaying on said screen an image comprising a graphic object;

instructing said imaging device to capture images of a user;

detecting the face image of the user in the captured images;

recognizing at least one facial feature in the face image;

calculating at least one parameter of said at least one facial feature; and

manipulating said graphic object based on the analysis of said at least one parameter of the at least one facial feature.

12. The computing device of claim 11 wherein said imaging device is located in proximity to the display.

13. The computing device of claim 12 wherein said at least one facial feature is selected from the group of eye, eyebrow, nose, mouth and ear.

14. A computing device of claim 13 wherein said at least one parameter of the at least one facial feature is selected from the group of shape, size, angle and position of the at least one facial feature.

15. A computing device of claim 14 wherein said computing device is a portable computing device.

16. A computing device of claim 15 wherein said imaging device is integrated in the portable computing device.

17. A computing device of claim 16 wherein said computing device is a phone.

18. A computing device of claim 16 wherein said computing device is a tablet.

19. A computing device claim 16 wherein said computing device is a game console.

20. The method of claim 11 further comprising:

calculating at least one parameter of said face image; and

manipulating said graphic object based on the analysis of said at least one parameter of said face image and said at least one parameter of the at least one facial feature.

21. A non-transitory computer readable medium having computer executable program for detecting a gesture, the computer executable program comprising:

computer executable code for instructing an imaging device to capture images of a user;

computer executable code for detecting the face image of the user in the captured images;

computer executable code for recognizing at least one facial feature in the face image;

computer executable code for calculating at least one parameter of said at least one facial feature; and

computer executable code for manipulating said graphic object based on the analysis of said at least one parameter of the at least one facial feature.

22. A non-transitory computer readable medium of claim 21 wherein said at least one facial feature is selected from the group of eye, eyebrow, nose, mouth and ear.

23. A non-transitory computer readable medium of claim 22 wherein said at least one parameter of the at least one facial feature is selected from the group of shape, size, angle and position of the at least one facial feature.

24. A non-transitory computer readable medium of claim 23 further comprising:

computer executable code for calculating at least one parameter of said face image; and

computer executable code for manipulating said graphic object based on the analysis of said at least one parameter of said face image and said at least one parameter of the at least one facial feature.