Display terminal device connectable to external display device and method therefor

• US 9,582,903 B2
• Filed: 07/09/2013
• Issued: 02/28/2017
• Est. Priority Date: 07/30/2012
• Status: Active Grant

• Current Assignee: Casio Computer Company Limited
• Original Assignee: Casio Computer Company Limited
• Inventors: Hirotani, Takayuki
• Primary Examiner(s): CHOW, JEFFREY J
• Application Number:
  US13/937,579
• Publication Number:
  US 20140028719A1
• Time in Patent Office: 1,330 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/0383 Remote input, i.e. interface arrangements in which the signals generated by a pointing device are transmitted to a PC at a remote location, e.g. to a PC in a LAN
• CPC Class Codes: G06F 2203/04801 Cursor retrieval aid, i.e. visual aspect modification, blinking, colour changes, enlargement or other visual cues, for helping user do find the cursor in graphical user interfaces
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation

Abstract

The present invention is to maintain the viewability of display without impairing operability on a terminal side, even when the details of a touch operation performed on a display terminal device are transmitted to an external display device for display. In the present invention, when a touch operation is detected in an external transmission mode, the display terminal device generates details of a composite screen obtained by superimposing operation information (operation icon or animation image) indicating details of the touch operation on contents being displayed on the display screen (terminal screen), and transmits the contents of the composite screen to the external display device so as to change display contents on the external display device (display contents on its screen).

Claims

1. A display terminal device having a display screen on which a touch operation can be performed at an arbitrary point, the display terminal device comprising:

a controlling section which performs control to display, on the display screen, first screen information for the display screen, and to generate second screen information identical to the first screen information and transmit the generated second screen information to an external display device;

a judging section which, when a gesture operation by a finger performing an arbitrary touch operation is detected on a point on the display screen on which the first screen information is being displayed, detects the point of the touch operation on the display screen, and judges which gesture operation type, from among a plurality of gesture operation types prepared in advance including at least a pinch-out operation type and a flick operation type, an operation type of operation contents of the gesture operation on the display screen corresponds to; and

a superimposing section which selects a pinch-out operation imaging image representing, as a gesture image, a pinch-out operation by a gesture by fingers of a hand if the judged gesture operation type is the pinch-out operation type, and selects a flick operation imaging image representing, as a gesture image, a flick operation by a gesture by fingers of a hand if the judged gesture operation type is the flick operation type, and superimposes the selected operation imaging image near the detected point of the touch operation on the second screen information,

wherein, when the gesture operation is detected, the controlling section performs control to transmit, to the external display device, composite second screen information obtained by superimposing the operation imaging image on the second screen information, without changing display contents of the first screen information being displayed on the display screen.

2. The display terminal device according to claim 1, further comprising a storage section which stores, as the operation imaging image, a different operation animation image representing a different gesture operation in association with each of the plurality of gesture operation types,

wherein the superimposing section superimposes a stored operation animation image corresponding to the judged gesture operation type on the second screen information.

3. The display terminal device according to claim 1, wherein, when the external display device is connected to the display terminal device, the controlling section performs control to generate the second screen information or the composite second screen information and transmit the generated second screen information or the generated composite second screen information to the connected external display device.

4. The display terminal device according to claim 3, wherein the controlling section judges whether the external display device connected to the display terminal device is a specified external display device specified in advance, and, when it is judged that a specified external display device is connected to the display terminal device, the controlling section performs control to generate the second screen information or the composite second screen information and to transmit the generated second screen information or the obtained composite second screen information to the connected external display device.

5. The display terminal device according to claim 1, wherein, when the display terminal device is set in an external transmission mode, the controlling section performs control to generate the second screen information or the composite second screen information and transmit the generated second screen information or the generated composite second screen information to the connected external display device.

6. The display terminal device according to claim 1, wherein, when a predetermined time has elapsed after detecting the touch operation, the controlling section controls the external display device such that display contents being displayed on the external display device becomes identical to display contents being displayed on the display screen of the display terminal device.

7. A method for a display terminal device having a display screen on which a touch operation can be performed at an arbitrary point, the method comprising:

performing control to display, on the display screen, first screen information for the display screen, and to generate second screen information identical to the first screen information and transmit the generated second screen information to an external display device;

when a gesture operation by a finger performing an arbitrary touch operation is detected on a point on the display screen on which the first screen information is being displayed, detecting the point of the touch operation on the display screen, and judging which gesture operation type, from among a plurality of gesture operation types prepared in advance including at least a pinch-out operation type and a flick operation type, an operation type of operation contents of the gesture operation on the display screen corresponds to; and

selecting a pinch-out operation imaging image representing, as a gesture image, a pinch-out operation by a gesture by fingers of a hand if the judged gesture operation type is the pinch-out operation type, and selecting a flick operation imaging image representing, as a gesture image, a flick operation by a gesture by fingers of a hand if the judged gesture operation type is the flick operation type, and superimposing the selected operation imaging image near the detected point of the touch operation on the second screen information,

wherein, when the gesture operation is detected, control is performed to transmit, to the external display device, composite second screen information obtained by superimposing the operation imaging image on the second screen information, without changing display contents of the first screen information being displayed on the display screen.