APPARATUS AND METHOD OF MULTI-INPUT AND MULTI-OUTPUT USING A MOBILE COMMUNICATION TERMINAL

• US 20120319951A1
• Filed: 03/11/2011
• Published: 12/20/2012
• Est. Priority Date: 03/12/2010
• Status: Abandoned Application

• Current Assignee: AQ Company Limited
• Original Assignee: AQ Company Limited
• Inventors: Lee, Sang Hoon
• Application Number:
  US13/581,610
• Publication Number:
  US 20120319951A1
• Time in Patent Office: Days
• US Class Current: 345/161
• CPC Class Codes: G06F 1/169 the I/O peripheral being an integrated pointing device, e.g. trackball in the palm rest area, mini-joystick integrated between keyboard keys, touch pads or touch stripes G06F1/1643 takes precedence; constructional details of pointing devices G06F3/033
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 2203/0384 Wireless input, i.e. hardware and software details of wireless interface arrangements for pointing devices
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Abstract

A multi input control window in one-to-one correspondence with an external information device can be programmed and activated in the mobile communication terminal in diverse ways through a multi input mode application unit, depending on the type of a multi-input operation. Also, a first input signal with respect to a touch screen, a second input signal with respect to an acceleration sensor, and a third input signal based on the location of a mobile communication terminal that moves in the X, Y and Z axes measured by a gyroscope sensor are wirelessly transmitted from the mobile communication terminal to the external information device. A fourth input signal for the voice-to-text conversion can be transmitted wirelessly. During a multi-input operation in the external information device, an event signal for outputting a vibration or speaker sound is sent as an output signal to the mobile communication terminal.

Claims

1. A multi-input and multi-output apparatus using a mobile communication terminal, the apparatus comprising:

an external information device for displaying a specific screen on a display of the external information device, controlling a position and operation of the mobile communication terminal in one-to-one correspondence with a multi-input signal transferred from the mobile communication terminal, and outputting an event signal generated on the display to the mobile communication terminal through a bi-directional data communication unit; and

the mobile communication terminal including a smart input-output module for transmitting the multi-input signal inputted from a touch screen, an acceleration sensor, a gyroscope sensor, a voice recognition unit, or a combination thereof to the external information device, receiving the event signal generated on the display from the external information device and transmitting the event signal to a sensing element.

2. The apparatus according to claim 1, wherein the smart input-output module comprises:

a first input signal setting unit connected to the touch screen of the mobile communication terminal through a program and setting a signal inputted from the touch screen as a first input signal;

a second input signal setting unit connected to the acceleration sensor of the mobile communication terminal through a program and setting an acceleration input signal of the mobile communication terminal inputted from the acceleration sensor as a second input signal;

a third input signal setting unit connected to the gyroscope sensor of the mobile communication terminal through a program and setting a position signal of the mobile communication terminal moving in the X-axis, Y-axis and Z-axis directions sensed by the gyroscope sensor as a third input signal;

a fourth input signal setting unit connected to the voice recognition unit of the mobile communication terminal through a program and setting a voice recognition signal inputted from the voice recognition unit as a fourth input signal;

a first output signal setting unit for setting an output signal for outputting a vibration signal among event signals generated on the display of the external information device to a vibration element of the sensing element as a first output signal;

a second output signal setting unit for setting an output signal for outputting a sound signal among the event signals generated on the display of the external information device to a speaker element of the sensing element as a second output signal;

a third output signal setting unit for setting an output signal for outputting a flickering signal among the event signals generated on the display of the external information device to a backlight unit embedded in the screen of the mobile communication terminal as a third output signal;

a digital converter for converting an analog signal inputted from the first input signal setting unit, the second input signal setting unit, the third input signal setting unit or the fourth input signal setting unit into a digital signal;

a smart multi-input mode control unit for controlling to convert the digital signal converted by the digital converter into a coded form that can be recognized by the external information device, switching the mobile communication terminal to a multi-input mode based on the first input signal setting unit, the second input signal setting unit, the third input signal setting unit, the fourth input signal setting unit, the first output signal setting unit, the second output signal setting unit and the third output signal setting unit, and controlling the touch screen, the acceleration sensor, the gyroscope sensor, the vibration element and the speaker element based on the multi-input mode; and

a second bi-directional data transmission unit for receiving the event signal from the external information device depending on a control signal of the smart multi-input mode control unit and transmitting the multi-input signal of the mobile communication terminal to the external information device.

3. The apparatus according to claim 2, wherein the smart multi-input mode control unit includes:

a multi-input mode application unit for executing the multi-input mode in the mobile communication terminal and activating a control window on the screen of the mobile communication terminal so that the external information device may be controlled one-to-one;

a multi-input mode kernel for providing a control window interface of the multi-input mode application unit, one-to-one corresponding to a multi-input screen displayed on the external information device; and

an event handler for storing the event signal received from the external information device and outputting the event signal to a sensing element by calling a sensing element algorithm corresponding to each event.

4. The apparatus according to claim 3, wherein the multi-input mode application unit comprises:

a gaming joystick input mode for controlling operation of the external information device one-to-one by setting the mobile communication terminal as a gaming joystick of 3D atmosphere based on the first input signal setting unit, the second input signal setting unit, the third input signal setting unit, the fourth input signal setting unit, the first output signal setting unit, the second output signal setting unit and the third output signal setting unit;

a wireless mouse input mode for controlling operation of the external information device one-to-one by setting the mobile communication terminal as a wireless mouse of a PC based on the first input signal setting unit, the second input signal setting unit, the third input signal setting unit, the fourth input signal setting unit, the first output signal setting unit, the second output signal setting unit and the third output signal setting unit;

a wireless keyboard input mode for controlling operation of the external information device one-to-one by setting the mobile communication terminal as a wireless keyboard of a PC based on the first input signal setting unit, the second input signal setting unit, the third input signal setting unit, the fourth input signal setting unit, the first output signal setting unit, the second output signal setting unit and the third output signal setting unit;

a vehicle smart key input mode for controlling operation of the external information device one-to-one by setting the mobile communication terminal as a smart key of a vehicle based on the first input signal setting unit, the second input signal setting unit, the third input signal setting unit, the fourth input signal setting unit, the first output signal setting unit, the second output signal setting unit and the third output signal setting unit;

a remote controller input mode for controlling operation of the external information device one-to-one by setting the mobile communication terminal as a remote controller for controlling an appliance based on the first input signal setting unit, the second input signal setting unit, the third input signal setting unit, the fourth input signal setting unit, the first output signal setting unit, the second output signal setting unit and the third output signal setting unit; and

a voice recognition input mode for controlling operation of the external information device one-to-one by setting the mobile communication terminal as a voice recognition input means based on the first input signal setting unit, the second input signal setting unit, the third input signal setting unit, the fourth input signal setting unit, the first output signal setting unit, the second output signal setting unit and the third output signal setting unit.

5. The apparatus according to claim 1, wherein the external information device comprises:

a display module for displaying a multi-input screen;

an information device control unit for controlling a position and operation of the mobile communication terminal on the multi-input screen in one-to-one correspondence when a multi-input or an application execution command is inputted through the multi-input signal of the mobile communication terminal and controlling to transmit an output signal to the sensing element of the mobile communication terminal depending on the event signal generated on the display; and

a first bi-directional data transmission unit for receiving the multi-input signal of the mobile communication terminal and transmitting the event signal to the mobile communication terminal according to a control signal of the information device control unit.

6. A multi-input and multi-output method using a mobile communication terminal, the method comprising:

executing an application related to a multi-input mode in an environment capable of executing the application in the mobile communication terminal, by a multi-input mode application unit of a smart multi-input mode control unit;

searching for an external information device capable of performing a multi-input operation, by the mobile communication terminal;

transmitting a multi-input authentication code to the mobile communication terminal, by the searched external information device;

driving the multi-input mode application unit of the smart multi-input mode control unit and selecting the multi-input mode corresponding to the multi-input authentication code, after receiving the multi-input authentication code of the external information device, by the mobile communication terminal;

activating a corresponding multi-input screen and synchronizing the mobile communication terminal and the external information device if the mobile communication terminal selects the multi-input mode, by the external information device;

outputting an event signal generated while displaying the multi-input screen to the mobile communication terminal through a bi-directional data communication unit, by the external information device;

receiving the event signal generated on the display of the external information device from the external information device and outputting the event signal to the sensing element, by the mobile communication terminal 200; and

terminating a connection related to the multi-input between the mobile communication terminal and the external information device if a multi-input mode end button is pressed.

7. The method according to claim 6, wherein said driving the multi-input mode application unit of the smart multi-input mode control unit comprises:

switching the mobile communication terminal into a software update mode or driving a daemon file related to software update, by the smart multi-input mode control unit;

checking validity of update software and a mobile device downloading the update software, by the smart multi-input mode control unit;

receiving an information file related to software that will be updated, by a base band chip and a multimedia chip of the mobile communication terminal;

receiving a terminal type supported by the software and driving information related to the terminal type through the update information and checking whether or not the software driven in the mobile communication terminal is compatible software, by the smart multi-input mode control unit;

receiving binary data of the software transmitted from the smart multi-input mode control unit, by the mobile communication terminal; and

normally installing upload of the software after receiving the software.