USER INTERFACE DEVICE CAPABLE OF IMAGE SCROLLING NOT ACCOMPANYING FINGER MOVEMENT, IMAGE SCROLLING METHOD, AND PROGRAM

• US 20140139471A1
• Filed: 06/29/2012
• Published: 05/22/2014
• Est. Priority Date: 07/22/2011
• Status: Active Grant

• Current Assignee: KDDI Corporation
• Original Assignee: KDDI Corporation
• Inventors: Matsuki, Tomoaki
• Granted Patent: US 9,285,976 B2
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 2203/04105 Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A process is disclosed of scrolling an image on a user interface device configured to display the image on a display screen and enable a user to input with the user'"'"'s finger touch on a touch screen in association with the displayed image, the process including: scrolling the image in response to the finger'"'"'s drag motion on the touch screen; and, in response to an event occurring in which, after the drag motion ended, the finger is held in touch with the touch screen at substantially the same location as where the finger was located when the drag motion ended, without releasing from the touch screen, further scrolling the image to perform follow-up scrolling, after experiencing an idle period or not.

Claims

1. A user interface device operable to perform a display function of displaying an image, a touch panel function of outputting successive locations of the user'"'"'s finger contact point on a touch screen over time, and a function of scrolling an integral image being displayed, in response to a drag motion performed on the touch screen with the user'"'"'s finger, the user interface device comprising:

a pressing-force sensor detecting a pressing force with which the finger presses the touch screen;

a motion-recognizing unit configured to determine whether or not the drag motion has ended;

a scroll-rate determining unit configured to be operable in response to the motion-recognizing unit determining that the drag motion has ended, to determine a post-drag scroll rate that is a scroll rate of scrolling to be performed subsequently to the drag motion, based on a magnitude of the pressing force detected by the pressing-force sensor at an end time of the drag motion and/or during a period of time after the end time of the drag motion; and

a scroll controller configured to further scroll the integral image being displayed, at the determined post-drag scroll rate, after scrolling invoked by the drag motion ends.

2. The user interface device according to claim 1, wherein the scroll controller is configured to be operable in response to the user pressing the finger onto the touch screen just after the drag motion, to raise a scroll rate of the scrolling to be performed by the scroll controller up to the determined post-drag scroll rate.

3. The user interface device according to claim 1, further comprising:

a haptic feedback arrangement configured to impart haptic feedback to the user'"'"'s finger in contact with the touch screen; and

a haptic feedback controller configured to control the haptic feedback arrangement to impart to the finger via the touch screen, the haptic feedback with an intensity changing as a function of a scroll rate of the scrolling to be performed by the scroll controller.

4. The user interface device according to claim 3, wherein the haptic feedback controller is configured to control the haptic feedback arrangement to impart to the finger vibrations with intensities that become higher as the scroll rate of the scrolling becomes higher.

5. The user interface device according to claim 1, wherein the motion-recognizing unit is configured to be operable in response to the motion-recognizing unit determining that the drag motion has ended, to determine whether or not the finger is in touch with the touch screen, and

the scroll controller is configured to be operable in response to the motion-recognizing unit determining that the finger is in touch with the touch screen, to further scroll the integral image at the determined post-drag scroll rate.

6. The user interface device according to claim 1, the scroll-rate determining unit is configured to determine the post-drag scroll rate to be zero, when the pressing force is below a predetermined threshold.

7. The user interface device according to claim 1, wherein the scroll controller is configured to retain information indicative of a direction of scrolling that was invoked by the drag motion, and further scroll the integral image in a same direction as that of the scrolling invoked by the drag motion, subsequently to the drag motion.

8. The user interface device according to claim 1, wherein the scroll-rate determining unit is configured to detect successive values of the pressing force via the pressing-force sensor, during the period of time subsequent to the end time of the drag motion and optionally at the end time of the drag motion, and determine the post-drag scroll rate at each point in time, based on a maximum value among the detected values of the pressing force obtained until each point in time.

9. The user interface device according to claim 8, wherein the motion-recognizing unit is configured to successively determine whether or not the finger is in touch with the touch screen after the drag motion ends, and

the scroll-rate determining unit is configured to determine the post-drag scroll rate to be zero regardless of the maximum value of the pressing force, when the motion-recognizing unit determines that the finger is not in touch with the touch screen.

10. The user interface device according to claim 8, wherein the scroll-rate determining unit is configured to be operable in response to an event occurring in which the pressing force changes over time such that the pressing force increases to a first value just after the drag motion ends, and then the pressing force decreases to a second value, to control the scroll rate of the scrolling to exhibit a characteristic that the scroll rate increases to a value of the post-drag scroll rate which is determined depending on the first value, and then the scroll rate is kept unchanged.

11. A method of scrolling an image on a user interface device operable to perform a display function of displaying an image, a touch panel function of outputting successive locations of the user'"'"'s finger contact point on a touch screen over time, and a function of scrolling an integral image being displayed, in response to a drag motion performed on the touch screen with the user'"'"'s finger,

wherein the user interface device comprises a pressing-force sensor detecting a pressing force with which the finger presses the touch screen,

the method comprising:

a first step of determining whether or not the drag motion has ended;

a second step of determining, in response to the motion-recognizing unit determining that the drag motion has ended, a post-drag scroll rate that is a scroll rate of scrolling to be performed subsequently to the drag motion, based on a magnitude of the pressing force detected by the pressing-force sensor at an end time of the drag motion and/or during a period of time subsequent to the end time of the drag motion; and

a third step of further scrolling the integral image being displayed, at the determined post-drag scroll rate, after scrolling invoked by the drag motion ends.

12. The method according to claim 11, wherein the second step is implemented to detect successive values of the pressing force via the pressing-force sensor, during the period subsequent to the end time of the drag motion and optionally at the end time of the drag motion, and determine the post-drag scroll rate at each point in time, based on a maximum value among the detected values of the pressing force obtained until each point in time.

16. A program to be executed by a computer to perform the method according to claim 11.

13. A process of scrolling an image on a user interface device configured to display the image on a display screen and enable a user to input with the user'"'"'s finger touch on a touch screen in association with the displayed image, the process comprising:

a first step of scrolling the image in response to the finger'"'"'s drag motion on the touch screen; and

a second step of further scrolling, in response to an event occurring in which, after the drag motion ended, the finger is held in touch with the touch screen at substantially the same location as where the finger was located when the drag motion ended, without releasing from the touch screen, the image to perform follow-up scrolling, after experiencing an idle period or not.

14. The process according to claim 13, wherein the second step is implemented to control a scroll rate of the follow-up scrolling, depending on an intensity of the finger'"'"'s touch on the touch screen, such that the scroll rate increases continuously or stepwise, as the intensity of the finger'"'"'s touch increases.

15. The process according to claim 14, wherein the second step is implemented to control the scroll rate of the follow-up scrolling, such that the scroll rate does not decrease even when the intensity of the finger'"'"'s touch decreases.