User interface interaction system and method for handheld device and TV set

• US 9,723,352 B2
• Filed: 09/17/2012
• Issued: 08/01/2017
• Est. Priority Date: 12/28/2011
• Status: Active Grant

• Current Assignee: Huizhou TCL Mobile Communication Company Limited (TCL Technology Group Corp.)
• Original Assignee: Huizhou TCL Mobile Communication Company Limited (TCL Technology Group Corp.)
• Inventors: Liu, Jiang, Yu, Jingjiang
• Primary Examiner(s): Flynn, Nathan
• Assistant Examiner(s): TRINH, TUNG THANH
• Application Number:
  US14/125,267
• Publication Number:
  US 20140130091A1
• Time in Patent Office: 1,779 Days
• Field of Search: 725 37, 345157, 345173
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 3/03547 Touch pads, in which fingers can move on a surface
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G09G 2340/0407 Resolution change, inclusive of the use of different resolutions for different screen areas
• CPC Class Codes: G09G 2370/04 Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller
• CPC Class Codes: G09G 2370/12 Use of DVI or HDMI protocol in interfaces along the display data pipeline
• CPC Class Codes: H04N 21/41265 having a remote control device for bidirectional communication between the remote control device and client device unidirectional remote control device H04N21/42204
• CPC Class Codes: H04N 21/4222 Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy remote control device for a television receiver integrated into a mobile phone H04M1/72415
• CPC Class Codes: H04N 21/42224 Touch pad or touch panel provided on the remote control
• CPC Class Codes: H04N 21/43635 HDMI

Abstract

An interaction system and method for interaction between a handheld device and a television comprises the configuration and connection of a first HDMI transferring module and a television screen in addition to a configuration and connection of a second HDMI transferring module, a touch screen, a gesture managing module and a display managing module. A user interface system and method for interaction between a handheld device and a television can utilize a handheld device having a touch screen to operate the television without requiring the assistance of other hardware units, such as a mouse or keyboard. All the operations can be done by using only the handheld device, thereby reducing the costs of devices.

Claims

1. A user interface (UI) interaction method for a handheld device and a television for choosing media content and playing games on the television using the handheld device, which comprises the steps of:

transferring EDID data (Extended Display Identification Data) of a television to a second HDMI (High Definition Multimedia Interface) transferring module through a first HDMI transferring module by the television;

transferring the EDID data of the television to a display managing module through the second HDMI transferring module by a handheld device;

adjusting a touch screen resolution of the handheld device to match with a display screen resolution of the television according to the EDID data;

initializing UI display data according to the EDID data and outputting the UI display data to the television by the display managing module;

initializing an operation mode to a cursor mode by a gesture managing module;

receiving a touch event from a user, updating the UI display data and sending it to the television by the handheld device to interact with a game display on the television,

wherein the operation mode comprises a cursor mode, that includes the touch event and a move event and that enables movement of a cursor on the television via the handheld device, and a touch mode that enables sending the touch event to the television from the handheld device,

wherein when the touch event is receiving the touch event from the user, the step of receiving the touch event from the user comprises;

determining whether to switch the operation mode according to whether coordinates of the press event are in an operation mode switch area,

wherein the operation mode switch area is arranged at a top left of the touch screen of the handheld device;

deciding whether the operation mode is the cursor mode, and if so, saving the coordinates of the press event without sending the touch event, and if not, sending the touch event, updating the UI display data and sending the UI display data to the television,

wherein the handheld device adapts to a plurality of types of televisions including high definition televisions,

wherein when the touch event is a move event, the step of receiving a touch event from a user comprises;

determining whether the operation mode is the cursor mode, and if not, sending the touch event, updating the UI display data and sending the UI display data to the television;

determining whether a moving distance of the move event is larger than a threshold, and if not, not processing the move event, and if so, then entering a cursor moving state, calculating and moving a display position of the cursor, updating the UI display data and sending it to the television.

2. The user interface interaction method for a handheld device and a television according to claim 1, wherein in the step of receiving a touch event from the user, when the touch event is the press event, and the coordinates of the press event are in the operation mode switch area, the operation mode is switched to the touch mode.

3. The method of claim 1, wherein the operation mode is switched back and forth from the touch mode to the cursor mode by a tap on a touch screen of the handheld device.

4. The method of claim 1, wherein the display managing module further displays the UI display data on the television synchronously with the outputting UI display data.