Method and apparatus for a gesture-based user interface

• US 20030095154A1
• Filed: 11/19/2001
• Published: 05/22/2003
• Est. Priority Date: 11/19/2001
• Status: Abandoned Application

• Current Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Original Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Inventors: Colmenarez, Antonio J.
• Application Number:
  US09/988,944
• Publication Number:
  US 20030095154A1
• Time in Patent Office: Days
• US Class Current: 715/863
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

A visual user interface provided on a display. The display provides a plurality of selection options to a user. A processor is operatively coupled to the display for sequentially highlighting each of the plurality of selection options for a period of time. The processor, during the highlighting, receives one or more images of the user from an image input device and determines whether a selection gesture from the user is contained in the one or more images. When a selection gesture is contained in the one or more images, the processor performs an action determined by the highlighted selection option.

Claims

1. A video display device comprising:

a display configured to display a plurality of selection options;

a processor operatively coupled to the display and configured to sequentially highlight each of the plurality of selection options for a period of time and configured to receive a selection gesture from the user for selecting a highlighted selection option.

2. The video display device of claim 1, wherein the processor is configured to highlight each of the plurality of selection options by causing the display to display one of each of the plurality of selection options for the period of time.

3. The video display device of claim 1, wherein the processor is configured to highlight each of the plurality of selection options by causing the display to alter a display characteristic for one of each of the plurality of selection options for the period of time.

4. The video display device of claim 1, comprising an audio output device, wherein the processor is configured to highlight each of the plurality of selection options by causing the audio output device to sequentially output an audio indication associated with a corresponding one of each of the plurality of selection options.

5. The video display device of claim 1, comprising a camera operatively coupled to the processor for acquiring an image of the user containing the selection gesture.

6. The video display device of claim 5, wherein the image information is contained in a plurality of images and wherein the processor is configured to analyze the plurality of images to determine the selection gesture.

7. The video display device of claim 5, wherein the image information is contained in a plurality of images and wherein the processor is configured to determine the selection gesture by analyzing the plurality of images and determining a trajectory of a hand of the user.

8. The video display device of claim 1, wherein the processor is configured to determine the selection gesture by analyzing an image of the user and determining a posture of a hand of the user.

9. The video display device of claim 1, wherein the video display device is a television.

10. A method of providing a user interface containing a plurality of selection options, the method comprising the acts of:

displaying a plurality of selection options;

highlighting each one of the plurality of selection options sequentially;

analyzing an image of the user to determine whether the image contains a selection gesture for a highlighted selection option.

11. The method of claim 10, wherein analyzing the image comprises:

receiving a plurality of images; and

analyzing the plurality of images to determine whether the plurality of images contains a selection gesture.

12. The method of claim 10, wherein analyzing the image comprises:

receiving a plurality of images;

analyzing the plurality of images to determine a trajectory of a hand of the user; and

determining whether the plurality of images contains a selection gesture by the determined trajectory.

13. The method of claim 10, wherein analyzing the image comprises:

analyzing an image of the user to determine a posture of a hand of the user; and

determining whether the image contains a selection gesture by the determined posture.

14. A program portion stored on a processor readable medium for providing a user interface containing a plurality of selection options, the program segment comprising:

a program segment for controlling a display of the plurality of selection options;

a program segment for highlighting each one of the plurality of selection options for a period of time;

a program segment for analyzing an image of a user to determine whether the image contains a selection gesture; and

a program segment for performing a selection option if a selection gesture is received while the selection option is highlighted.

15. The program portion of claim 14, wherein the program segment for analyzing the image comprises:

a program segment for controlling receipt of a plurality of images; and

a program segment for analyzing the plurality of images to determine whether the selection gesture is received.

16. The program portion of claim 14, wherein the program segment for analyzing the image comprises:

a program segment for controlling receipt of a plurality of images;

a program segment for analyzing the plurality of images to determine a trajectory of a hand of the user; and

a program segment for determining whether the selection gesture is received by the determined trajectory.

17. The program portion of claim 14, wherein the program segment for analyzing the image comprises:

a program segment for analyzing an image of the user to determine a posture of a hand of the user; and

a program segment for determining whether the selection gesture is received by the determined posture.