Apparatus and method for user input for controlling displayed information

• US 10,146,426 B2
• Filed: 11/09/2010
• Issued: 12/04/2018
• Est. Priority Date: 11/09/2010
• Status: Active Grant

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Technologies Oy (Nokia Corporation)
• Inventors: Yan, Qifeng
• Primary Examiner(s): EARLES, BRYAN E
• Application Number:
  US12/942,463
• Publication Number:
  US 20120113018A1
• Time in Patent Office: 2,947 Days
• Field of Search: None
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: H04N 13/128 Adjusting depth or disparity
• CPC Class Codes: H04N 13/302 for viewing without the aid of special glasses, i.e. using autostereoscopic displays

Abstract

In accordance with an example embodiment of the present invention, a method for proximity based input is provided, comprising: receiving information on presence of an object in close proximity to a touch screen surface, detecting a display element currently associated with the object, the display element being visualized to be displaced from the screen surface level in the z-direction substantially perpendicular to the screen surface, and adapting the display element on the basis of distance between object and the screen, wherein the display element is visualized to locate substantially at the touch screen surface level in response to detecting the object to touch the touch screen surface.

Claims

1. An apparatus, comprising:

at least one processor and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to;

receive information on presence of an object in a first position and in close proximity to a touch screen surface;

receive an indication of a display element currently associated with the object and selected from a first display element and a second display element, the display element being displayed such that (i) an entirety of the display element appears spaced apart from the screen surface level in a z-direction substantially perpendicular to the screen surface so as to create an appearance of a gap in the z-direction between the entirety of the display element and the screen surface, and (ii) the display element appears displaced from at least one other display element in an xy plane parallel to the screen surface;

receive an indication of a transition of the object from the first position towards the touch screen to a second position, wherein the second position indicates the object is substantially in contact with the touch screen surface; and

in response to the indication of the transition of the object,

in an instance in which the first display element that is currently associated with the object appears to float above the screen surface level in the z-direction, cause the first display element to move in the same direction as the object towards the touch screen, and display the first display element substantially at the touch screen surface and substantially in contact with the object; and

in an instance in which the second display element that is currently associated with the object appears to float below the screen surface level in the z-direction on an opposite side of the touch screen surface as compared to the position of the object, cause the second display element to move in a direction opposite to the direction of movement of the object towards the touch screen surface, and display the second display element substantially at the touch screen surface and substantially in contact with the object.

2. The apparatus of claim 1, wherein the at least one memory and the computer program code are further configured to at least cause the apparatus to:

cause the display element currently associated with the object to change on the basis of a disparity value dependent on a detected distance.

3. The apparatus of claim 2, wherein the disparity value defines displacement between two images of the display element in x-direction substantially parallel to the screen surface.

4. The apparatus of claim 3, wherein the apparatus is configured to set the disparity value as zero in response to receiving indication of the transition.

5. The apparatus of claim 1, wherein the at least one memory and the computer program code are further configured to at least cause the apparatus to:

change a display mode from a three-dimensional mode to a two-dimensional mode in response to receiving indication of the transition.

6. The apparatus of claim 1, wherein the at least one memory and the computer program code are further configured to at least cause the apparatus to:

receive indication of a virtual touch of the object to a portion of a display element; and

associate the display element with the object in response to receiving indication of the virtual touch.

7. The apparatus of claim 1, wherein the apparatus is a mobile communications device comprising the touch screen.

15. The apparatus of claim 1, wherein the first display element is displayed such that the display element currently associated with the object appears to float above or below the screen surface level in the z-direction, and wherein the at least one memory and the computer program code are further configured to, with the at least one processor, cause the apparatus to:

receive an indication of a transition of the object from the first position to a third position, wherein the third position indicates that the object is in proximity to the touch screen surface without being in contact with the screen surface, and wherein the third position is displaced from the screen surface by a different distance than the first position; and

cause the display element to change in response to receiving the indication of the transition to the third position such that the display element is displayed so as to appear displaced from the screen surface level in the z-direction by a different distance than in response to the object being in the first position.

8. A method, comprising:

receiving information on presence of an object in a first position and in close proximity to a touch screen surface;

receiving an indication of a display element currently associated with the object and selected from a first display element and a second display element, the display element being displayed such that (i) an entirety of the display element appears spaced apart from the screen surface level in a z-direction substantially perpendicular to the screen surface so as to create an appearance of a gap in the z-direction between the entirety of the display element and the screen surface, and (ii) the display element appears displaced from at least one other display element in an xy plane parallel to the screen surface;

receiving an indication of a transition of the object from the first position towards the touch screen to a second position, wherein the second position indicates the object is substantially in contact with the touch screen surface; and

in response to the indication of the transition of the object,

in an instance in which the first display element that is currently associated with the object appears to float above the screen surface level in the z-direction, causing the first display element to move in the same direction as the object towards the touch screen, and displaying the first display element substantially at the touch screen surface and substantially in contact with the object; and

in an instance in which the second display element that is currently associated with the object appears to float below the screen surface level in the z-direction on an opposite side of the touch screen surface as compared to the position of the object, causing the second display element to move in a direction opposite to the direction of movement of the object towards the touch screen surface, and displaying the second display element substantially at the touch screen surface and substantially in contact with the object.

9. The method of claim 8, further comprises:

causing the display element currently associated with the object to change on the basis of a disparity value dependent on a detected distance.

10. The method of claim 9, wherein the disparity value defines displacement between two images of the display element in x-direction substantially parallel to the screen surface.

11. The method of claim 10, wherein the disparity value is set as zero in response to receiving indication of the transition.

12. The method of claim 8, further comprising:

change a display mode from a three-dimensional mode to a two-dimensional mode in response to detecting the transition.

13. The method of claim 8, further comprising:

receiving indication of a virtual touch of the object to a portion of a display element; and

associate the display element with the object in response to receiving indication of the virtual touch.

16. The method of claim 8, wherein the display element currently associated with the object is displayed such that the display element appears to float above or below the screen surface level in the z-direction, and wherein the method further comprises:

receiving an indication of a transition of the object from the first position to a third position, wherein the third position indicates that the object is in proximity to the touch screen surface without being in contact with the screen surface, and wherein the third position is displaced from the screen surface by a different distance than the first position; and

causing the display element to change in response to receiving the indication of the transition to the third position such that the display element is displayed so as to appear displaced from the screen surface level in the z-direction by a different distance than in response to the object being in the first position.

14. A computer program product comprising at least one non-transitory computer-readable medium bearing computer-executable program code instructions stored therein, the computer-executable program code instructions comprising program code instructions to:

receive information on presence of an object in a first position and in close proximity to a touch screen surface,

receive an indication of a display element currently associated with the object and selected from a first display element and a second display element, the display element being displayed such that (i) an entirety of the display elements appears spaced apart from the screen surface level in the z-direction substantially perpendicular to the screen surface so as to create an appearance of a gap in the z-direction between the entirety of the display element and the screen surface, and (ii) the display element appears displaced from at least one other display element in an xy plane parallel to the screen surface;

receive an indication of a transition of the object from the first position towards the touch screen to a second position, wherein the second position indicates the object is substantially in contact with the touch screen surface; and

in response to the indication of the transition of the object,

in an instance in which the first display element that is currently associated with the object appears to float above the screen surface level in the z-direction, cause the first display element to move in the same direction as the object towards the touch screen, and display the first display element substantially at the touch screen surface and substantially in contact with the object; and

in an instance in which the second display element that is currently associated with the object appears to float below the screen surface level in the z-direction on an opposite side of the touch screen surface as compared to the position of the object, cause the second display element to move in a direction opposite to the direction of movement of the object towards the touch screen surface, and display the second display element substantially at the touch screen surface and substantially in contact with the object.