User interface device that zooms image in response to operation that presses screen, image zoom method, and program

• US 9,389,722 B2
• Filed: 09/05/2012
• Issued: 07/12/2016
• Est. Priority Date: 09/09/2011
• Status: Active Grant

• Current Assignee: KDDI Corporation
• Original Assignee: KDDI Corporation
• Inventors: Matsuki, Tomoaki, Tsuchida, Hiroyuki, Ono, Yoshisato
• Primary Examiner(s): Merkoulova, Olga
• Application Number:
  US14/342,815
• Publication Number:
  US 20140300569A1
• Time in Patent Office: 1,406 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 2203/04105 Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
• CPC Class Codes: G06F 2203/04106 Multi-sensing digitiser, i.e. digitiser using at least two different sensing technologies simultaneously or alternatively, e.g. for detecting pen and finger, for saving power or for improving position detection
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G09G 2340/045 Zooming at least part of an image, i.e. enlarging it or shrinking it
• CPC Class Codes: G09G 3/20 for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters

Abstract

A method is disclosed of controlling a user interface device for displaying on a display screen a plurality of objects, and for enabling a user to perform an input action by touching the display screen with the user'"'"'s finger. This method includes: upon the user'"'"'s touch to the display screen at a region of one of the plurality of objects being displayed, selecting the one object as a zoom target; upon an event occurring in which an intensity of the finger'"'"'s touch on the display screen exceeds a predetermined threshold, determining a magnification ratio of the zoom target or a change rate of the magnification ratio, based on the intensity of the finger'"'"'s touch; and zooming in the zoom target on the display screen with the determined magnification ratio or the determined change rate.

Claims

1. A user interface device for displaying on a display screen a zoom target, and for enabling a user to perform an input action by touching the display screen with a finger, the user interface device comprising:

a pressing-force sensor detecting a pressing force with which the finger presses the display screen;

at least one of a virtual or physical reduction button and a virtual or physical undo button; and

a zoom controller configured to;

enlarge the zoom target in response to the detected pressing force exceeding a predetermined enlargement threshold, with an enlargement ratio of the zoom target depending on a magnitude of the pressing force, without requiring the user to operate an enlargement button,

hold a size of the zoom target without restoring the size of the zoom target to an original size in response to a release of the finger from the display screen,

wherein the reduction button is present, reduce the zoom target, in response to the user touching the reduction button, and

wherein the undo button is present, restore the size of the zoom target so that the size becomes equal to the original size, in response to the user touching the undo button.

2. The user interface device according to claim 1, further comprising:

a zoom-speed determining unit configured to;

activate in response to the finger touching the display screen and the detected pressing force being equal to or larger than the predetermined threshold, and

determine a target value of a zoom-in speed indicative of a change rate in a magnification ratio of the zoom target, as a function of a magnitude of the pressing force,

wherein the zoom controller is configured to zoom in the zoom target such that an actual value of the magnification ratio of the zoom target increases at the determined target value of the zoom-in speed.

3. The user interface device according to claim 1, further comprising:

a magnification-ratio determining unit configured to be activated in response to the finger touching the display screen and the detected pressing force being equal to or larger than the predetermined threshold, and to determine a target value of a magnification ratio of the zoom target, as a function of a magnitude of the pressing force,

wherein the zoom controller is configured to zoom in the zoom target such that an actual value of the magnification ratio of the zoom target is equal to the determined target value of the magnification ratio.

4. The user interface device according to claim 1, wherein the zoom controller is configured to zoom in the zoom target by using a touch position of the finger as a zoom center point.

5. The user interface device according to claim 1, wherein the zoom controller is configured to zoom in the zoom target by using a position as a zoom-in center point, and to display on the display screen a to-be-selected-for-reduction object to be selected by the user for issuing a request for reducing the magnified zoom target, when the zoom target is magnified,

the touch-position recognizing unit is configured to determine whether a touch position of the finger overlaps a region of the to-be-selected-for-reduction object being displayed on the display screen, and

the zoom controller is configured to be activated when the touch position overlaps the region of the to-be-selected-for-reduction object being displayed and the detected pressing force is equal to or larger than the predetermined threshold, and to reduce the magnified zoom target by using a position substantially equal to the position used as the zoom-in center point, as a zoom-out center point.

6. The user interface device according to claim 5, further comprising:

a zoom-speed determining unit configured to;

activate when the finger'"'"'s touch position overlaps a region of the zoom target being displayed and the detected pressing force is equal to or larger than the predetermined threshold, to determine a target value of a zoom-in speed indicative of an increase rate in a magnification ratio of the zoom target, as a function of a magnitude of the pressing force, and

activate when the finger'"'"'s touch position overlaps the region of the to-be-selected-for-reduction object being displayed and the detected pressing force is equal to or larger than the predetermined threshold, to determine a target value of a zoom-out speed indicative of a decrease rate in a magnification ratio of the zoom target, as a function of a magnitude of the pressing force,

wherein the zoom controller is configured to magnify the zoom target such that an actual value of the magnification ratio of the zoom target increases at the determined target value of the zoom-in speed, or reduce the zoom target such that an actual value of the magnification ratio of the zoom target decreases at the determined target value of the zoom-out speed.

7. The user interface device according to claim 5, further comprising:

a magnification-ratio determining unit configured to;

activate when the finger'"'"'s touch position overlaps a region of the zoom target being displayed and the detected pressing force is equal to or larger than the predetermined threshold, to determine a target value of a first magnification-ratio of the zoom target, as a function of a magnitude of the pressing force, and

activate when the finger'"'"'s touch position overlaps the region of the to-be-selected-for-reduction object being displayed and the detected pressing force is equal to or larger than the predetermined threshold, to determine a target value of a second magnification-ratio of the zoom target, as a function of a magnitude of the pressing force,

wherein the zoom controller is configured to magnify the zoom target such that an actual value of the magnification ratio of the zoom target is equal to the determined target value of the first magnification-ratio, or reduce the zoom target such that an actual value of the magnification ratio of the zoom target is equal to the determined target value of the second magnification-ratio.

8. The user interface device according to claim 1, wherein

the finger is of a hand of the user that holds the user interface device, and

the zoom controller is configured to activate in response to an action of the user of pressing the display screen at the zoom target with the finger, to zoom in the zoom target by using the finger'"'"'s touch position as a zoom center point.

9. The user interface device according to claim 1, wherein the zoom controller is further configured to:

vibrate the display screen to impart to the finger in touch with the display screen, haptic feedback as a response, with higher levels of vibrations as an intensity of the user touching the display screen with the finger becomes higher.

10. The user interface device according to claim 1, wherein the zoom controller is further configured to:

store in a memory a touch position of the finger on the display screen when the zoom target is being enlarged, as a zoom center point; and

reduce the zoom target using the same zoom center point as that previously stored in the a memory.

11. A method of zooming a zoom target displayed on a display screen of a user interface device including at least one of a virtual or physical reduction button and a virtual or physical undo button, and enabling a user to perform an input action by touching the display screen with a finger, the method comprising:

enlarging the zoom target on the display screen in response to the finger touching the display screen and a pressing force with which the finger presses the display screen being equal to or larger than a predetermined enlargement threshold, with an enlargement ratio of the zoom target depending on a magnitude of the pressing force, without requiring the user to operate an enlargement button;

holding a size of the zoom target without restoring the size of the zoom target to an original size in response to a release of the finger from the display;

when the reduction button is present, reducing the zoom target, in response to the user touching the reduction button; and

when the undo button is present, restoring the size of the zoom target so that the size becomes equal to the original size, in response to the user touching the undo button.

13. A non-transitory computer-readable storage medium containing software for causing a computer to perform the method according to claim 11.

12. A method of zooming a zoom target displayed on a display screen of a user interface device including at least one of a virtual or physical reduction button and virtual or physical undo button, and enabling a user to perform an input action by touching the display screen with a finger, the method comprising:

enlarging the zoom target on the display screen in response to an increase in an intensity of a touch of the finger on the display screen, with an enlargement ratio of the zoom target depending on the touch intensity, without requiring the user to operate an enlargement button;

holding a size of the zoom target without restoring the size of the zoom target to an original size in response to a release of the finger from the display screen;

when the reduction button is present, reducing the zoom target, in response to a touch of the finger on the reduction button; and

when the undo button is present, restoring the size of the zoom target so that the size becomes equal to the original size, in response to a touch of the finger on the undo button.

14. A non-transitory computer-readable storage medium containing software for causing a computer to perform the method according to claim 12.

15. The method according to claim 12, further comprising:

vibrating the display screen to impart to the finger in touch with the display screen, haptic feedback as a response, with higher levels of vibrations as an intensity of the user touching the display screen with the finger becomes higher.

16. The method according to claim 12, further comprising:

storing in a memory a touch position of the finger on the display screen when the zoom target is being enlarged, as a zoom center point; and

reducing the zoom target using the same zoom center point as that previously stored in the a memory.