Electronic device with a user interface that has more than two degrees of freedom, the user interface comprising a touch-sensitive surface and contact-free detection means

• US 9,323,379 B2
• Filed: 12/09/2011
• Issued: 04/26/2016
• Est. Priority Date: 12/09/2011
• Status: Active Grant

• Current Assignee: Microchip Technology Germany GmbH (Microchip Technology Incorporated)
• Original Assignee: Microchip Technology Germany GmbH (Microchip Technology Incorporated)
• Inventors: Aubauer, Roland, Gebhard, Roman
• Primary Examiner(s): Yang, Ryan R
• Application Number:
  US13/315,739
• Publication Number:
  US 20130147833A1
• Time in Patent Office: 1,600 Days
• Field of Search: 345/619
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/04106 Multi-sensing digitiser, i.e. digitiser using at least two different sensing technologies simultaneously or alternatively, e.g. for detecting pen and finger, for saving power or for improving position detection
• CPC Class Codes: G06F 2203/04108 Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/041662 using alternate mutual and self-capacitive scanning
• CPC Class Codes: G06F 3/044 by capacitive means
• CPC Class Codes: G06F 3/0446 using a grid-like structure of electrodes in at least two directions, e.g. using row and column electrodes
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

The invention relates to an electronic device for determining a first positional information and a second positional information regarding a user input object, such as at least one user hand or at least one stylus, the electronic device comprising: a touch-sensitive surface; contact-free detection means; and controller means that are operatively connected to the touch-sensitive surface and to the contact-free detection means; wherein the first positional information depends on where the user input object contacts the touch-sensitive surface, and wherein the second positional information depends on the spatial configuration of the user input object with regard to the touch-sensitive surface, characterized in that the controller means are adapted for simultaneously and/or alternately determining the first positional information via the touch-sensitive surface and the second positional information via the contact free detection means.

Claims

1. An electronic device for determining a first positional information and a second positional information regarding a user input object, such as at least one user hand or at least one stylus, the electronic device comprising:

a touch-sensitive surface;

contact-free detection unit; and

a controller that is operatively connected with the touch-sensitive surface and with the contact-free detection unit;

a gesture recognition module that is a separate module or an integral part of the controller,

wherein the first positional information depends on where the user input object contacts the touch-sensitive surface, and

wherein the second positional information depends on the spatial configuration of the user input object above the touch-sensitive surface,

wherein the controller is adapted for simultaneously and/or alternately determining the first positional information via the touch-sensitive surface and the second positional information via the contact free detection unit, wherein the controller is further configured to determine a gesture performed by the user input object while the input object touches the touch sensitive surface;

wherein the gesture recognition module is adapted for identifying the gesture as belonging to a predefined gesture category from tracking at least the second positional information, wherein the gesture belongs to the predefined category if the first position is determined by at least one finger of a hand, and remaining parts of the hand perform the gesture while the first position remains substantially constant; and

wherein the electronic device is adapted for transitioning from a first state into a second state when or after the gesture is identified as belonging to the predefined gesture category by the gesture recognition module.

2. The electronic device according to claim 1, wherein the controller is adapted for simultaneously determining the first positional information and the second positional information using time-division-multiplexing and/or frequency-division-multiplexing.

3. The electronic device according to claim 1, wherein the first positional information comprises first data that depends on where the user input object contacts the touch-sensitive surface, and the second positional information comprises a second data that depends on the spatial configuration of the user input object.

4. The electronic device according to claim 3, wherein the first positional information comprises a mean position of where the user input object contacts the touch sensitive surface.

5. The electronic device according to claim 3, wherein the second position is a mean position of the user input object or of a portion of the user input object.

6. The electronic device according to claim 1, wherein the second positional information depends on the spatial configuration of a portion of the user input object that is within a predefined distance of the touch-sensitive surface, wherein the predefined distance is preferably less than:

0.5 cm, 1 cm, 1.5 cm, 2 cm, 2.5 cm, 3 cm, 3.5 cm, 4 cm, 4.5 cm, 5 cm, 5.5 cm, 6 cm, 7 cm, 8 cm, 9 cm, 10 cm, 15 cm, 20 cm, 50 cm, 1 m, 2 m, 5 m, or 10 m.

7. The electronic device according to claim 1, wherein the first positional information is determined and/or represented in two dimensions, and/or wherein the second positional information is determined and/or represented in three dimensions.

8. The electronic device according to claim 1, wherein both the first positional information and the second positional information are determined and/or represented in the same coordinate system,

wherein both the first and the second positional information are preferably determined and/or represented in the same coordinate system,

wherein both the first positional information and the second positional information is preferably determined relative to a reference position on the touch-sensitive surface.

9. The electronic device according to claim 1, wherein the touch-sensitive surface is part of a touch-sensitive display.

10. The electronic device according to claim 1, wherein the contact-free detection unit comprise a contact-free 3D scanner, which is of the active or the passive type.

11. The electronic device according to claim 10, wherein the contact-free 3D scanner comprises at least one video camera for recording images of the user input object and an image analysis controller for determining the second positional information from the recorded images, wherein the image analysis module is a separate module or an integral part of the controller.

12. The electronic device according to claim 1, wherein the contact-free detection unit comprises capacitive sensing unit, which in turn comprise:

an electric field generation unit for generating an electric field that is static or quasi-static;

electric field detection electrodes for detecting changes of the electric field caused by the user input object, wherein the electric field detection electrodes are separate from or an integral part of the electric field generation unit.

13. The electronic device according to claim 12, wherein the capacitive sensing unit comprises:

an electric field generation electrode for generating an electric field that is static or quasi-static;

the electric field detection electrodes for detecting changes of the electric field caused by the user input object, and an analysis module for determining the second positional information from the detected changes of the electric field, wherein the analysis module is a separate module or an integral part of the controller.

14. The electronic device according to claim 12, wherein the electric field generation unit and/or the electric field detection electrodes are an integral part of the touch-sensitive surface and/or of the touch-sensitive display.

15. The electronic device according to 1, wherein the gesture recognition module is adapted for:

preferably storing and/or obtaining a predefined gesture category,

recording a gesture from the first and the second positional information, wherein, the gesture is tracked as long as the user input object touches the touch-sensitive surface,

identifying the recorded gesture as belonging to the predefined gesture category.

16. The electronic device according to claim 15, wherein the device is configured to extract a parameter from the identified gesture, such as a zoom factor, or a discrete rotation angle.

17. The electronic device according to claim 15, wherein the gesture comprises a trajectory in a phase space, the phase space being defined by all possible states of the first and the second positional information.

18. The electronic device according to claim 1, wherein a gesture belongs to the predefined category:

if the second position moves on a substantially circular trajectory around a rotational axis, the rotational axis being perpendicular to the touch-sensitive surface and intersecting the first position, the first position remaining substantially constant, or

if the second position moves on a trajectory, which is substantially a line, towards or away from the touch-sensitive surface, the first position remaining substantially constant, the line preferably being perpendicular to the touch-sensitive surface, or

if the second position moves on a substantially circular trajectory around a rotational axis, the rotational axis lying within the touch-sensitive surface and intersecting the first position, the first position remaining substantially constant, or

if the second position moves on a trajectory, which is substantially a line, in parallel to the touch-sensitive surface, the first position remaining substantially constant, or

if the first and the second position simultaneously move in substantially the same direction,

wherein said same direction is substantially parallel to the touch-sensitive surface.

19. The electronic device according to claim 1, wherein the gesture recognition module is adapted for determining a vector, wherein the initial point of the vector is the first position and the terminal point of the vector is the second position.

20. The electronic device according to claim 1, wherein the gesture recognition module is adapted for determining the second position in a cylindrical coordinates system and/or transforming the second position into a cylindrical coordinates system, wherein the origin of the cylindrical coordinates system is the first position, wherein the height axis is perpendicular to the touch-sensitive surface, and wherein the reference axis lies within the touch sensitive surface.

21. The electronic device according to claim 1, wherein a start of a gesture is detecting a touch and an end of the gesture is defined by detecting a release of the touch.

22. A method for determining a first positional information and a second positional information regarding a user input object by controlling an electronic device comprising a touch-sensitive surface, a contact-free detection unit, and a controller that is operatively connected with the touch-sensitive surface and with the contact-free detection unit, wherein the first positional information depends on where the user input object contacts the touch-sensitive surface, and wherein the second positional information depends on the spatial configuration of the user input object with regard to the touch-sensitive surface, the method comprising the steps of:

determining the first positional information via the touch-sensitive display,

determining and tracking at least the second positional information via the contact free detection unit while the input object touches the touch sensitive surface; and

determining a gesture from at least the tracked second positional information.

23. The method according to claim 22, wherein the steps of determining the first position and the second position are performed using a time-division-multiplexing method and/or a frequency-division-multiplexing method.

24. The method according to claim 22, wherein a start of a gesture is detecting a touch and an end of the gesture is defined by detecting a release of the touch.

25. A method for determining a first positional information and a second positional information regarding a user input object by controlling an electronic device comprising a touch-sensitive surface, a contact-free detection unit, and a controller that is operatively connected with the touch-sensitive surface and with the contact-free detection unit, wherein the first positional information depends on where the user input object contacts the touch-sensitive surface, and wherein the second positional information depends on the spatial configuration of the user input object with regard to the touch-sensitive surface, the method comprising:

determining the first positional information and the second positional information while the electronic device is in a first state;

recording a gesture by tracking at least the second positional information while the input object touches the touch sensitive surface,

transitioning the electronic device to a second state if the detected gesture belongs to a predefined gesture category; and

maintaining the device in the first state if the detected phase space trajectory does not belong to a predefined gesture category.

26. The method according to claim 25, wherein the first positional information remains substantially constant.

27. The method according to claim 25, further comprising the step of extracting a parameter from the identified gesture, such as a zoom factor, or a discrete rotation angle.

28. An electronic device for determining a first positional information and a second positional information regarding a user input object, such as at least one user hand or at least one stylus, the electronic device comprising:

a two-dimensional touch-sensitive surface;

three-dimensional contact-free detection unit, wherein the three-dimensional contact-free detection unit, which in turn comprise;

an electric field generation unit for generating an electric field that is static or quasi-static;

electric field detection electrodes for detecting changes of the electric field caused by the user input object, wherein the electric field detection electrodes are separate from or an integral part of the electric field generation unit;

and

a controller operatively connected to the touch-sensitive surface and to the contact-free detection unit;

wherein the first positional information is generated by at least one finger of a hand defining a touching position and comprises first data that depends on where the user input object contacts the touch-sensitive surface, and

wherein the second positional information defines a gesture generated at least by remaining parts of the hand while the at least one finger maintains its touching position and comprises second data that depends on the spatial configuration of at least the remaining parts of the hand above the touch-sensitive surface,

wherein the controller is adapted to determine and to output the first positional information via the touch-sensitive surface and to track the second positional information via the contact free detection unit, wherein the controller is adapted for simultaneously determining the first positional information and to track the second positional information using time-division-multiplexing and/or frequency-division-multiplexing.

29. The electronic device according to claim 28, wherein a start of a gesture is detecting a touch and an end of the gesture is defined by detecting a release of the touch.