METHOD AND APPARATUS OF CONTROLLING AN INTERFACE BASED ON TOUCH OPERATIONS

• US 20140359528A1
• Filed: 06/04/2013
• Published: 12/04/2014
• Est. Priority Date: 06/04/2013
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: MURATA, Yu
• Granted Patent: US 10,282,067 B2
• Time in Patent Office: Days
• US Class Current: 715/833
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 40/166 Editing, e.g. inserting or deleting

Abstract

An apparatus includes a touch panel display and circuitry for controlling the touch panel display such that an initial selection range of at least one of one or more character strings and one or more images is displayed. The circuitry determines, based on a predetermined condition of an input operation, a first mode and a second mode of altering the initial selection range. The circuitry alters the initial selection range by controlling the touch panel display such that, in response to a detection of the input operation and based on the determined mode, a starting point and/or an end point of the initial selection range are moved at a predetermined speed. The circuitry respectively controls the touch panel display under the first mode and the second mode such that the predetermined speed is different than, or the same as, a speed that the instruction object moves on the operation surface.

Claims

1. An apparatus comprising:

a touch panel display that displays an interface including at least one of one or more character strings and one or more images, the touch panel display including one or more sensors for detecting an input operation by one or more instruction objects on the touch panel display; and

circuitry configured to;

control the touch panel display such that an initial selection range of the at least one of the one or more character strings and the one or more images is displayed;

determine an initial coordinate corresponding to a position on an operation surface of the touch panel display at which the input operation is initially performed;

determine a speed at which the instruction object moves on the operation surface during the input operation; and

selectively determine, based on a predetermined condition of the input operation, a first mode and a second mode of altering the displayed initial selection range, wherein

the initial selection range includes a starting point and an end point that are displayed on the touch panel display,

the circuitry alters the initial selection range by controlling the touch panel display such that, in response to the detection of the input operation and based on the selectively determined mode, at least one of the displayed starting point and the displayed end point are moved at a predetermined speed from their initial positions,

when the circuitry determines the initial selection range is altered in accordance with the first mode, the circuitry controls the touch panel display such that the predetermined speed is different than the detected speed at which the instruction object moves on the operation surface, and

when the circuitry determines the initial selection range is altered in accordance with the second mode, the circuitry controls the touch panel display such that the predetermined speed is substantially the same as the detected speed at which the instruction object moves on the operation surface.

2. The apparatus of claim 1, wherein

the predetermined condition is based on the determined initial coordinate.

3. The apparatus of claim 2, wherein

the first mode is selected when the initial coordinate is at least a predetermined distance from a display coordinate included in one of the initial selection range, the one or more character strings, and the one or more images.

4. The apparatus of claim 3, wherein

the second mode is selected when the initial coordinate is within the predetermined distance from the display coordinate.

5. The apparatus of claim 3, wherein:

when the first mode is selected, the circuitry controls the touch panel display such that an operation area is displayed on the touch panel display, and

when the input operation is performed within the operation area, the circuitry is configured to alter the displayed initial selection range by moving the at least one of the displayed starting point and the displayed end point at the predetermined speed that is different than the detected speed.

6. The apparatus of claim 1, wherein

the circuitry is configured to calculate a time duration during which at least one of the one or more instruction objects are in contact with the operation surface during the input operation.

7. The apparatus of claim 6, wherein

a travel distance of the at least one of the displayed starting point and the displayed end point during the altering of the initial selection range is based on the calculated time duration.

8. The apparatus of claim 1, wherein

the predetermined condition is based on a number of instruction objects detected during the input operation.

9. The apparatus of claim 8, wherein

the second mode is selected when two or more instruction objects are detected during the input operation.

10. The apparatus of claim 9, wherein

the second mode is selected when the two or more instruction objects are detected moving in a corresponding direction.

11. The apparatus of claim 10, wherein

the second mode is selected when the two or more instruction objects that are moving in the corresponding direction are the only instruction objects detected on the operation surface.

12. The apparatus of claim 1, wherein

when two instruction objects are detected on the operation surface of the touch panel display during the input operation, the initial detection range is altered by moving the starting point in a direction corresponding to a movement of the left-most detected instruction object and by moving the end point in a direction corresponding to a movement of the right-most detected instruction object.

13. The apparatus of claim 1, wherein:

the interface includes one or more directional keys, and

when the input operation is performed at a position on the operation surface corresponding to the one or more directional keys, the circuitry alters the initial selection range based on a predetermined movement direction assigned to the one or more directional keys.

14. The apparatus of claim 13, wherein

when the input operation corresponds to tapping the instruction object on the operation surface for less than or equal to a predetermined time period at the position corresponding to the one or more directional keys, the circuitry alters the initial selection range by moving one of the start point and the end point a distance corresponding to one character, of the characters included in the one or more character strings.

15. The apparatus of claim 13, wherein:

a first set of directional keys corresponds to the starting point such that a detected input operation performed at a position corresponding to the first set of directional keys results in the circuitry controlling the touch panel display to alter the initial selection range by moving the starting point, and

a second set of directional keys corresponds to the end point such that a detected input operation performed at a position corresponding to the second set of directional keys results in the circuitry controlling the touch panel display to alter the initial selection range by moving the end point.

16. The apparatus of claim 1, wherein:

the interface includes one or more scroll bars including one or more markers corresponding to the starting point and the end point, and

when the input operation is performed at a position on the operation surface corresponding to the one or more markers, the circuitry controls the touch panel display such that a displayed position of the one or more markers changes based on positional changes of the one or more instruction objects while the one or more instruction objects are maintained in contact with the operations surface.

17. The apparatus of claim 16, wherein:

the circuitry controls the touch panel display such that the displayed initial selection range is changed by moving one or more of the starting point and the end point in a direction corresponding to the changing of the displayed position of the one or more markers, and

the predetermined speed at which the one or more of the starting point and the end point are moved increases with increasing distance of the one or more markers from a center region of the one or more scroll bars.

18. The apparatus of claim 1, wherein:

the predetermined condition is based on a comparison of the determined speed at which the instruction object moves on the operation surface during the input operation,

the first mode is selected when the determined speed is greater than a predetermined speed threshold, and

the second mode is selected when the determined speed is less than the predetermined threshold.

19. A method of controlling a touch panel display that displays an interface including at least one of one or more character strings and one or more images, the touch panel display including one or more sensors for detecting an input operation by one or more instruction objects on the touch panel display, the method comprising:

controlling, by circuitry, the touch panel display such that an initial selection range of the at least one of the one or more character strings and the one or more images is displayed;

determining, by the circuitry, an initial coordinate corresponding to a position on an operation surface of the touch panel display at which the input operation is initially performed;

determining, by the circuitry, a speed at which the instruction object moves on the operation surface during the input operation; and

selectively determining, by the circuitry based on a predetermined condition of the input operation, a first mode and a second mode of altering the initial selection range, wherein

the initial selection range includes a starting point and an end point that are displayed on the touch panel display,

the circuitry alters the initial selection range by controlling the touch panel display such that, in response to the detection of the input operation and based on the selectively determined mode, at least one of the displayed starting point and the displayed end point are moved at a predetermined speed from their initial positions,

when the circuitry determines the initial selection range is altered in accordance with the first mode, the circuitry controls the touch panel display such that the predetermined speed is different than the detected speed at which the instruction object moves on the operation surface, and

when the circuitry determines the initial selection range is altered in accordance with the second mode, the circuitry controls the touch panel display such that the predetermined speed is substantially the same as the detected speed at which the instruction object moves on the operation surface.

20. A non-transitory computer readable medium having instructions stored therein that when executed by one or more processors causes the one or more processors to perform a method comprising:

displaying an interface including at least one of one or more character strings and one or more images on a touch panel display;

detecting, based on an input from one or more sensors included in the touch panel display, an input operation by one or more instruction objects on the touch panel display;

controlling the touch panel display such that an initial selection range of the at least one of the one or more character strings and the one or more images is displayed;

determining an initial coordinate corresponding to a position on an operation surface of the touch panel display at which the input operation is initially performed;

determining a speed at which the instruction object moves on the operation surface during the input operation; and

selectively determining, based on a predetermined condition of the input operation, a first mode and a second mode of altering the initial selection range, wherein

the initial selection range includes a starting point and an end point that are displayed on the touch panel display,

the initial selection range is altered by controlling the touch panel display such that, in response to the detection of the input operation and based on the selectively determined mode, at least one of the displayed starting point and the displayed end point are moved at a predetermined speed from their initial positions,

when the initial selection range is altered in accordance with the first mode, the touch panel display is controlled such that the predetermined speed is different than the detected speed at which the instruction object moves on the operation surface, and

when the initial selection range is altered in accordance with the second mode, the touch panel display is controlled such that the predetermined speed is substantially the same as the detected speed at which the instruction object moves on the operation surface.