Touch panel device and method of controlling a touch panel device

• US 9,285,880 B2
• Filed: 03/14/2013
• Issued: 03/15/2016
• Est. Priority Date: 12/26/2012
• Status: Active Grant

• Current Assignee: Panasonic Automotive Systems Company of America (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Intellectual Property Management Co., Ltd. (Panasonic Holdings Corporation)
• Inventors: Araki, Shoichi
• Primary Examiner(s): MERCEDES, DISMERY E
• Application Number:
  US13/803,425
• Publication Number:
  US 20140176455A1
• Time in Patent Office: 1,097 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

An apparatus including: a panel; actuators; a movement input determining unit which calculates movement directions and distances of touch positions, based on time-series information of the touch positions; a display unit; a direction determining unit which determines a direction of an object included in the content item with respect to the display unit; a vibration position determining unit which determines a first touch position closer/closest to the object and one or more second touch positions detected simultaneously; a vibration determining unit which determines a tactile feedback signal presenting a vibration for the first touch position, based on the object direction; a multi-point simultaneous vibration control unit which performs control for presenting the vibration at the first touch position and not presenting the vibration at the second touch positions; and a content control unit which enables display of the content item by scrolling it based on the movement directions and distances.

Claims

1. A method of controlling a touch panel device, the method comprising:

detecting a plurality of inputs provided by multi-touch input at or around positions on a touch panel of a display screen;

detecting a plurality of input positions of the detected inputs in order to display a content item;

displaying a first part of the content item on a display area of the display screen;

determining whether an object included in a second part of the content item is present in an outside area of the display area of the display screen, the outside area being an area including the object that is not displayed on the display area of the display screen even though the object is included in the content item; and

detecting, using a processor, when the object is present in the outside area of the display area of the display screen;

calculating a distance between each of the plurality of input positions and the object;

causing a plurality of actuators to present a predetermined vibration at an input position at or around an input position closest to the object in the content item, among the plurality of input positions of inputs provided on the content item, the input position closest to the object being determined based on the distance, and

preventing the plurality of actuators from presenting the predetermined vibration at an input position farthest from the object in the content item, among the plurality of input positions of inputs provided on the content item.

2. The method according to claim 1,

wherein the predetermined vibration presented by the plurality of actuators includes one of different vibration methods determined based on the distance between the object and the input position closest to the object.

3. The method according to claim 2,

wherein the predetermined vibration presented by the plurality of actuator is different when the object present in the second part is in a left or right direction with respect to the display area of the display screen than when the object present in the second part is in an upper or lower direction with respect to the display area.

4. The method according to claim 1, further comprising

causing the touch panel device to scroll the content item in response to sliding or tapping by a user;

and

causing, using the processor, the plurality of actuators to vibrate the touch panel when the object enters the display area from the second part.

5. A touch panel device, comprising:

a touch panel for multi-touch input;

a plurality of actuators that causes the touch panel to vibrate; and

a processor which;

detects a plurality of inputs provided by multi-touch input at or around positions on a surface of the touch panel of a display screen;

detects a plurality of input positions of the detected inputs in order to display a content item;

displays a first part of the content item on a display area of the display screen;

determines whether an object included in a second part of the content item is present in an outside area of the display area of the display screen, the outside area being an area including the object that is not displayed on the display area of the display screen even though the object is included in the content item; and

when the processor determines that the object is present in the outside area of the display area of the display screen;

calculates a distance between each of the plurality of input positions and the object;

causes the plurality of actuators to present a predetermined vibration at a position at or around an input position closest to the object in the content item, among the plurality of input positions of inputs provided on the item, the input position closest to the object being determined based on the distance; and

prevents the plurality of actuators from presenting the predetermined vibration at an input position farthest from the object in the content item, among the plurality of input positions of inputs provided on the content item.

6. The touch panel device according to claim 5,

wherein the predetermined vibration presented by the plurality of actuators includes one of different vibration methods determined based on the distance between the object and the input position closest to the object.

7. The touch panel device according to claim 5,

wherein the touch panel device scrolls the content item in response to sliding or tapping by a user, and

the processor causes the plurality of actuators to vibrate the touch panel when the object enters the display area from the second part.

8. The touch panel device according to claim 5,

wherein the predetermined vibration presented by the plurality of actuator is different when the object present in the second part is in a left or right direction with respect to the display area than when the object present in second part is in an upper or lower direction with respect to the display area.

9. The touch panel device according to claim 5,

wherein the content item is a map.

10. The touch panel device according to claim 5,

wherein the content item is a map, an electric document, a bookmark, or a Web page.

11. A tactile/haptic feedback touch panel apparatus, comprising:

a panel configured to receive touch input by a user and output a predetermined vibration notifying acceptance of the touch input;

a plurality of actuators which are arranged at different positions on the panel and vibrate the panel;

a touch information obtaining unit configured to obtain touch positions detected simultaneously at the different positions on the panel;

a movement input determining unit configured to calculate movement directions and movement distances of the touch positions detected simultaneously on the panel, based on time-series information of the touch positions;

a display unit configured to display a first part of a content item on a display area of a display screen;

a direction determining unit configured to determine an object direction of an object included in a second part of the content item when the object is present in an outside area of the display area of the display screen, the outside area being an area including the object that is not displayed on the display area of the display screen even though the object is included in the content item;

a distance calculating unit configured to calculate a distance between each of the touch positions and the object;

a vibration position determining unit configured to compare a position of the object and each of the touch positions, and determine (i) a touch position closest to the object as a first touch position at which the plurality of actuators presents the predetermined vibration and (ii) each of one or more touch positions detected simultaneously with the first touch position and as a second touch position at which the plurality of actuators presents the predetermined vibration;

a vibration determining unit configured to determine a tactile feedback signal presenting the predetermined vibration to be presented at the first touch position determined by the vibration position determining unit, based on the object direction determined by the direction determining unit and the distance determined by the distance calculating unit;

a multi-point simultaneous vibration control unit configured to calculate a driving signal for causing each of the actuators to present the predetermined vibration at the first touch position closest to the object in the content item and a driving signal for preventing each of the actuators from presenting the predetermined vibration at the second touch position which is farthest from the object in the content item, and simultaneously perform vibration control adapted to the respective touch positions on the panel by driving the actuators using the calculated driving signals; and

a content control unit configured to perform display control for displaying the content item onto the display area of the display screen by scrolling the content item based on the movement directions and the movement distances of the touch positions calculated by the movement input determining unit.

12. A method performed by a tactile/haptic feedback touch panel apparatus, the method allowing each of a plurality of actuators in the tactile/haptic feedback touch panel apparatus to output a predetermined vibration in response to touch input by a user on a panel in the tactile/haptic feedback touch panel apparatus, the method comprising:

obtaining a plurality of touch positions detected simultaneously at different positions on the panel;

calculating movement directions and movement distances of the touch positions detected simultaneously on the panel, based on time-series information of the touch positions;

displaying a first part of a content item on a display area of a display screen;

determining an object direction of an object in a second part of the content item when the object is present in an outside area of the display area of the display screen, the outside area being an area including the object is not displayed on the display area of the display screen even though the object is included in the content item;

calculating a distance between each of the touch positions and the object;

determining, among the plurality of touch positions, (i) a touch position closest to the object as a first touch position at which the plurality of actuators presents the predetermined vibration and (ii) each of the other one or more touch positions detected simultaneously with the first touch position and as a second touch position at which the plurality of actuators presents the predetermined vibration;

determining a tactile feedback signal representing the predetermined vibration to be presented at the determined first touch position, based on the object direction determined and the distance between each of the touch positions and the object;

driving the actuators so that each of the actuators presents the predetermined vibration at the first touch position closest to the object, and each of the actuators does not present the predetermined vibration at the second touch position which is farthest from the object; and

displaying the content item onto the display area of the display screen by scrolling the content item based on the calculated movement directions and movement distances.