Mobile communication terminal and data input method

• US 10,325,394 B2
• Filed: 04/18/2018
• Issued: 06/18/2019
• Est. Priority Date: 06/11/2008
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Wang, Sung-Sik, Cho, Yong-Hoon, Lee, Hoo-Doek
• Primary Examiner(s): Ajayi, Joel
• Application Number:
  US15/956,111
• Publication Number:
  US 20180232927A1
• Time in Patent Office: 426 Days
• Field of Search: 4555501
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G06F 40/171 by use of digital ink
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: H04M 1/72427 for supporting games or graphical animations
• CPC Class Codes: H04M 2250/22 including a touch pad, a touch sensor or a touch detector digitizers for touch screens G06F3/041
• CPC Class Codes: H04N 1/00209 Transmitting or receiving image data, e.g. facsimile data, via a computer, e.g. using e-mail, a computer network, the internet, I-fax
• CPC Class Codes: H04N 7/141 between two video terminals, e.g. videophone telephonic communication systems combined with television receiver for reception of entertainment or information matter H04M11/085

Abstract

A communication terminal includes a transceiver to receive first touch information from a counterpart terminal, the first touch information having coordinate information of a touch input inputted by a user of the counterpart terminal, the coordinate information being identified based on a coordinate of the touch input on an image displayed on the counterpart terminal. An image signal processor of the communication terminal controls the first touch information to be displayed on a display of the communication terminal, and controls image information corresponding to the image displayed on the counterpart terminal to be displayed on the display in association with the first touch information, and controls the first touch information to be displayed on the image information.

Claims

1. An electronic device, comprising:

a display comprising an image display area;

a touch-sensitive surface comprising a touch area;

one or more processors; and

memory storing one or more programs configured to be executed by the one or more processors, the one or more programs comprising instructions for;

displaying image data on the image display area, the image data comprising a video;

while displaying the video, receiving touch data representing selection of a graphical representation from a displayed list of graphical representations;

receiving touch data representing a location in the video;

obtaining time information of a time when the touch data representing the location in the video is received;

associating the graphical representation with the image data based on the time information; and

transmitting, to a recipient device, instructions to display graphical representation selected from the displayed list of graphical representations along with the video at a time during a playback of the video corresponding to the time information and at a location in the video determined based on the touch data representing the location in the video.

2. The electronic device of claim 1, the one or more programs further comprising instructions for:

calculating coordinate information about a position of the touch input in the touch area.

3. The electronic device of claim 2, the one or more programs further comprising instructions for:

generating touch data further according to the coordinate information.

4. The electronic device of claim 1, the one or more programs further comprising instructions for:

capturing, via a camera that is a part of the electronic device, the image data.

5. The electronic device of claim 1, the one or more programs further comprising instructions for:

receiving the image data via at least one of a multimedia message service, an email application, an Internet application, an Infrared Data Association module, or a Bluetooth®

module.

6. The electronic device of claim 1, wherein displaying the touch data comprises generating the selected graphical representation.

7. The electronic device of claim 1, wherein:

the selected graphical representation is an emoticon, and

the list of graphical representations is a list of emoticons.

8. A method, comprising:

at an electronic device with a display comprising an image display area and a touch-sensitive surface comprising a touch area;

displaying image data on the image display area;

the image data comprising a video;

while displaying the video, receiving touch data representing selection of a graphical representation from a displayed list of graphical representations;

receiving touch data representing a location in the video;

obtaining time information of a time when the touch data representing the location in the video is received;

associating the graphical representation with the image data based on the time information; and

transmitting, to a recipient device, instructions to display graphical representation selected from the displayed list of graphical representations along with the video at a time during a playback of the video corresponding to the time information and at a location in the video determined based on the touch data representing the location in the video.

9. The method of claim 8, further comprising:

calculating coordinate information about a position of the touch input in the touch area.

10. The method of claim 9, further comprising:

generating touch data further according to the coordinate information.

11. The method of claim 8, further comprising:

capturing, via a camera that is a part of the electronic device, the age data.

12. The method of claim 8, further comprising:

receiving the image data via at least one of a multimedia message service;

an email application, an Internet application, an Infrared Data Association module, or a Bluetooth®

module.

13. The method of claim 8, wherein displaying the touch data comprises generating the selected graphical representation.

14. The method of claim 8, wherein:

the selected graphical representation is an emoticon, and

the list of graphical representations is a list of emoticons.

15. A non-transitory computer-readable storage medium storing one or more programs configured to be executed by one or more processors of an electronic device with a display comprising an image display area and a touch-sensitive surface comprising a touch area, the one or more programs comprising instructions for:

displaying image data on the image display area, the image data comprising a video;

while displaying the video, receiving touch data representing selection of a graphical representation from a displayed list of graphical representations;

receiving touch data representing a location in the video;

obtaining time information of a time when the touch data representing the location in the video is received;

associating the graphical representation with the image data based on the time information; and

transmitting, to a recipient device, instructions to display graphical representation selected from the displayed list of graphical representations along with the video at a time during a playback of the video corresponding to the time information and at a location in the video determined based on the touch data representing the location in the video.

16. The non-transitory computer-readable storage medium of claim 15, further comprising instructions for:

calculating coordinate information about a position of the touch input in the touch area.

17. The non-transitory computer-readable storage medium of claim 16, further comprising instructions for:

generating touch data further according to the coordinate information.

18. The non-transitory computer-readable storage medium of claim 15, further comprising instructions for:

capturing, via a camera that is a part of the electronic device, the image data.

19. The non-transitory computer-readable storage medium of claim 15, further comprising instructions for:

receiving the image data via at least one of a multimedia message service, an email application, an Internet application, an Infrared Data Association module, or a Bluetooth®

module.

20. The non-transitory computer-readable storage medium of claim 15, wherein displaying the touch data comprises generating the selected graphical representation.

21. The non-transitory computer-readable storage medium of claim 15, wherein:

the selected graphical representation is an emoticon, and

the list of graphical representations is a list of emoticons.