USER INTERFACE INTERACTION SYSTEM AND METHOD FOR HANDHELD DEVICE AND TV SET

• US 20140130091A1
• Filed: 09/17/2012
• Published: 05/08/2014
• Est. Priority Date: 12/28/2011
• Status: Active Grant

• Current Assignee: Huizhou TCL Mobile Communication Company Limited (TCL Technology Group Corp.)
• Original Assignee: Huizhou TCL Mobile Communication Company Limited (TCL Technology Group Corp.)
• Inventors: Liu, Jiang, Yu, Jingjiang
• Granted Patent: US 9,723,352 B2
• Time in Patent Office: Days
• US Class Current: 725/37
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 3/03547 Touch pads, in which fingers can move on a surface
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G09G 2340/0407 Resolution change, inclusive of the use of different resolutions for different screen areas
• CPC Class Codes: G09G 2370/04 Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller
• CPC Class Codes: G09G 2370/12 Use of DVI or HDMI protocol in interfaces along the display data pipeline
• CPC Class Codes: H04N 21/41265 having a remote control device for bidirectional communication between the remote control device and client device unidirectional remote control device H04N21/42204
• CPC Class Codes: H04N 21/4222 Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy remote control device for a television receiver integrated into a mobile phone H04M1/72415
• CPC Class Codes: H04N 21/42224 Touch pad or touch panel provided on the remote control
• CPC Class Codes: H04N 21/43635 HDMI

Abstract

An interaction system and method for interaction between a handheld device and a television comprises the configuration and connection of a first HDMI transferring module and a television screen in addition to a configuration and connection of a second HDMI transferring module, a touch screen, a gesture managing module and a display managing module. A user interface system and method for interaction between a handheld device and a television can utilize a handheld device having a touch screen to operate the television without requiring the assistance of other hardware units, such as a mouse or keyboard. All the operations can be done by using only the handheld device, thereby reducing the costs of devices.

Claims

1. A user interface (UI) interaction method for a handheld device and a television, which comprises the steps of:

transferring EDID data (Extended Display Identification Data) of a television to a second HDMI (High Definition Multimedia Interface) transferring module through a first HDMI transferring module by the television;

transferring the EDID data of the television to a display managing module through the second HDMI transferring module by a handheld device;

initializing UI display data according to the EDID data and outputting the UI display data to the television by the display managing module;

initializing an operation mode to a cursor mode by a gesture managing module;

receiving a touch event from a user, updating the UI display data and sending it to the television by the handheld device,

wherein the operation mode comprises a cursor mode and a touch mode,

wherein when the touch event is receiving the touch event from the user, the step of receiving a touch event from the user comprises;

determining whether to switch the operation mode according to whether coordinates of the press event are in an operation mode switch area;

deciding whether the operation mode is the cursor mode, and if so, saving coordinates of the press event without sending the touch event, and if not, sending the touch event, updating the UI display data and sending the UI display data to the television,

wherein when the touch event is a move event, the step of receiving a touch event from a user comprises;

determining whether the operation mode is the cursor mode, and if not, sending the touch event, updating the UI display data and sending the UI display data the television;

determining whether a moving distance of the move event is larger than a threshold, and if not, not processing the move event, and if so, then entering a cursor moving state, calculating and moving a display position of the cursor, updating the UI display data and sending it to the television.

2. The user interface interaction method for a handheld device and a television according to claim 1, wherein in the step of receiving a touch event from a user, when the touch event is the press event, and the coordinates of the press event are in the operation mode switch area, the operation mode is switched to the touch mode.

3. The user interface interaction method for a handheld device and a television of claim 1, wherein the operation mode switch area is arranged at a top left of a touch screen of the handheld device.

16. The method of claim 1, wherein the operation mode is switched back and forth from the touch mode to the cursor mode by a tap on a touch screen of the handheld device.

19. The method of claim 1, wherein a resolution of the handheld device is matched with a resolution of the television.

4. A user interface (UI) interaction system for a handheld device and a television comprising:

the television comprising a display screen and a first HDMI (High Definition Multimedia Interface) transferring module connected with the display screen;

a handheld device comprising a second HDMI transferring module, a display managing module, a gesture managing module and a touch screen connected in sequences,

wherein the second HDMI transferring module and the first HDMI transferring module are in a communicating connection, used for transferring EDID data (Extended Display Identification Data) of the television from the first HDMI transferring module to the display managing module, and the touch screen is used for receiving a touch event performed by a user, and

wherein the display managing module is used for initializing UI display data according to the EDID data, and transferring the UI display data to the television, and the gesture managing module is used to manage an operation mode.

5. The user interface interaction system for a handheld device and a television of claim 4, wherein the operation mode comprises a cursor mode and a touch mode.

6. The user interface interaction system for a handheld device and a television of claim 4, wherein the touch event comprises a press event and a move event.

7. The user interface interaction system for a handheld device and a television of claim 4, wherein the touch screen is arranged with an operation mode switch area for switching the operation mode.

8. The user interface interaction system for a handheld device and a television of claim 7, wherein the operation mode switch area is arranged at a top left of the touch screen.

17. The system of claim 4, wherein the operation mode is switched back and forth from a touch mode to a cursor mode by a tap on a touch screen of the handheld device.

9. A user interface (UI) interaction method for a handheld device and a television, which comprises the steps of:

transferring EDID data (Extended Display Identification Data) of a television to a second HDMI (High Definition Multimedia Interface) transferring module through a first HDMI transferring module by the television;

transferring the EDID data of the television to a display managing module through the second HDMI transferring module by a handheld device;

initializing UI display data according to the EDID data, and outputting the UI display data to the television by the display managing module;

initializing an operation mode into a cursor mode by a gesture managing module; and

receiving a touch event from a user, updating the UI display data and sending it to the television by the handheld device.

10. The user interface interaction method for a handheld device and a television of claim 9, wherein the operation mode comprises a cursor mode and a touch mode.

11. The user interface interaction method for a handheld device and a television of claim 10, wherein the touch event in the step of receiving a touch event from a user comprises a press event and a move event.

12. The user interface interaction method for a handheld device and a television of claim 11, wherein when the touch event is the press event, the step of receiving a touch event from a user comprises:

determining whether to switch the operation mode according to whether the coordinates of the press event are in an operation mode switch area; and

determining whether the operation mode is the cursor mode, and if so, saving the coordinates of the press event without sending the touch event, and if not, sending the touch event, updating the UI display data and sending it to the television.

13. The user interface interaction method for a handheld device and a television according to claim 11, wherein when the touch event is the move event, the step of receiving a touch event from a user comprises:

determining whether the operation mode is the cursor mode, and if not, sending the touch event, updating the UI display data and sending it to the television; and

determining whether a moving distance of the move event is larger than a threshold, and if not, not processing the move event, and if so, then entering a cursor moving state, calculating and moving a display position of the cursor, updating the UI display data and sending it to the television.

14. The user interface interaction method for a handheld device and a television according to claim 12, wherein in the step of receiving a touch event from a user, when the touch event is the press event, and the coordinates of the press event are in the operation mode switch area, the operation mode is then switched to the touch mode.

15. The user interface interaction method for a handheld device and a television according to claim 12, wherein the operation mode switch area is arranged at the top left of a touch screen of the handheld device.

18. The method of claim 9, wherein the operation mode is switched back and forth from a touch mode to a cursor mode by a tap on a touch screen of the handheld device.

20. The method of claim 9, wherein a resolution of the handheld device is matched with a resolution of the television.