Gesture based control of element or item

• US 9,417,703 B2
• Filed: 04/13/2012
• Issued: 08/16/2016
• Est. Priority Date: 04/20/2011
• Status: Active Grant

• Current Assignee: Shenzhen TCL Creative Cloud Technology Co., Ltd.
• Original Assignee: Koninklijke Philips N.V.
• Inventors: Sterken, Hendirkus Petrus Maria, Geurts, Lucas Jacobus Franciscus, Kaufholz, Paul, Knoester, Jaap, Stuyfzand, Ivo Don
• Primary Examiner(s): Angkool, David Phantana
• Application Number:
  US14/006,795
• Publication Number:
  US 20140047395A1
• Time in Patent Office: 1,586 Days
• Field of Search: 715/863
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0485 Scrolling or panning

Abstract

Apparatuses (1) for controlling elements (40-70) possibly shown on screens (31) or items (71) possibly represented by the elements (70) comprise detectors (11-13) for detecting features of objects (2) such as body parts in first and second dimensions and converters (14) for converting first features into actions for the elements (40-70) or the items (71). By making the actions dependent on second features, a number of possibilities is increased. First features may be movements of the objects (2) and second features may be absolute or relative positions of the objects (2). First dimensions may be parallel to the screens (31) and second dimensions may be perpendicular or parallel to the screens (31), or vice versa. Actions may comprise browsing groups (4-6) of elements (40-69) at position dependent speeds or browsing one or more groups (4-6) depending on the positions. The items (71) may be lamps, appliances, audio players, video players, whereby their parameters may be adjusted in dependence of the movements and the positions.

Claims

1. An apparatus for controlling an item represented by an element displayed on a screen, the apparatus comprising:

a detector configured to detect a first feature of an object in a first dimension and a second feature of the object in a second dimension, the first dimension being a direction (X) parallel to the screen and the second dimension being a direction (Z) perpendicular to the screen; and

a converter configured to convert the first feature into an action to be performed on the item, the action depending on the second feature, wherein the first feature represents a movement of the object and the second feature represents a position of the object at a distance form the screen, and the action comprising browsing.

2. The apparatus of claim 1, the browsing comprising:

browsing a group of elements comprising the element at a speed that depends on the position of the object.

3. The apparatus of claim 1, the browsing comprising:

browsing a plurality of groups of elements, one group comprising the element, for the position being at a first position of the object, and the browsing comprising browsing one of the groups for the position being at a second position of the object.

4. The apparatus of claim 1, the browsing comprising:

browsing at a relatively general scale for the position being at a first position of the object, and the browsing comprising browsing at a relatively specific scale for the position being at a second position of the object.

5. The apparatus of claim 1, the object being a body part or a physical object held by or coupled to the body part, and the position of the object being a relative position with respect to a second object, the second object being another body part or a rest of the body.

6. The apparatus of claim 1, the converter being arranged for converting the second feature into information to be shown on the screen or to be reproduced otherwise.

7. The apparatus of claim 1, the detector being arranged to detect the movement of the object or the position of the object in a third dimension, the third dimension being in a second direction (Y) parallel to the screen and different from the direction (X).

8. The apparatus of claim 1, the second feature defining an aspect or a type or a parameter of the action.

9. A device comprising:

a display screen; and

an apparatus comprising;

a detector configured to detect a first feature of an object in a first dimension and a second feature of the object in a second dimension, the first dimension being a direction (X) parallel to the screen and the second dimension being a direction (Z) perpendicular to the screen; and

a converter configured to convert the first feature into an action to be performed on the element or the item, the action depending on the second feature, wherein the first feature represents a movement of the object and the second feature represents a position of the object at a distance from the screen.

10. A method for controlling an item represented by an element displayed on a display screen, the method comprising:

detecting by a detector a first feature of an object in a first dimension and a second feature of the object in a second dimension, the first dimension being a direction (X) parallel to the display screen and the second dimension being a direction (Z) perpendicular to the display screen; and

converting by a converter the first feature into an action to be performed on the item, the action depending on the second feature, wherein the first feature being a movement of the object and the second feature being a distance of the object with respect to the display screen, and the action comprising browsing.

11. A computer program product stored on a tangible computer readable medium for performing a method as defined in claim 10 when executed by the detector and converter.