Method and mobile terminal device for mapping a virtual user input interface to a physical user input interface

• US 9,952,758 B2
• Filed: 05/31/2014
• Issued: 04/24/2018
• Est. Priority Date: 03/23/2005
• Status: Expired due to Fees

• Current Assignee: Conversant Wireless Licensing S.à.r.l. (f/k/a Core Wireless Licensing S.a.r.l.) (MOSAID Technologies Inc. (f/k/a Conversant Intellectual Property Management))
• Original Assignee: Conversant Wireless Licensing S.à.r.l. (f/k/a Core Wireless Licensing S.a.r.l.) (MOSAID Technologies Inc. (f/k/a Conversant Intellectual Property Management))
• Inventors: Hayashi, Sawako-Eeva, Joeressen, Olaf
• Primary Examiner(s): Tillery, Rashawn N
• Application Number:
  US14/292,903
• Publication Number:
  US 20140281953A1
• Time in Patent Office: 1,424 Days
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 13/537 using indicators, e.g. showing the condition of a game character on screen
• CPC Class Codes: A63F 13/5375 for graphically or textually suggesting an action, e.g. by displaying an arrow indicating a turn in a driving game
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: H04M 1/27453 Directories allowing storage of additional subscriber data, e.g. metadata
• CPC Class Codes: H04M 1/2747 Scrolling on a display
• CPC Class Codes: H04M 1/2748 by matching character strings
• CPC Class Codes: H04M 1/7243 with interactive means for internal management of messages

Abstract

The present invention provides a method an a device for mapping a virtual user input interface to a physical user input interface. The method is provided for mapping a virtual user input interface to a physical user input interface on a mobile terminal device. The mobile terminal device comprises a first physical user input interface, a display and a processing unit being connected to said display and said physical user interface, wherein an application is configured for use with a second user interface. The method of the invention comprises detecting an event indicative of an application to be executed that is configured for use with said second user interface and displaying a virtual user input interface representing said second user input interface on said display. If a a physical user input is received on said first physical user input interface, it is mapping to said displayed virtual user input interface, and displayed as an indication of a virtual input on said displayed virtual user input interface.

Claims

1. A method comprising:

configuring for execution in a mobile device, which includes a physical user input interface, an application that is originally configured for execution using a virtual user input interface;

displaying the virtual user input interface on a touchscreen display of the mobile device, wherein the physical user input interface is mapped to the virtual user input interface;

receiving a physical user input on the physical user input interface while simultaneously receiving an input through the virtual user input interface on the touchscreen display;

mapping the receiving physical input to the displayed virtual user input on the touchscreen display; and

determining to display an indication of a virtual input, based on the received physical input, on the displayed virtual user input interface while executing the application on the mobile terminal device based on the received input from both the physical user input interface and the virtual user input interface.

2. The method of claim 1, further comprising, when executing the application on the mobile terminal device, using the mapped input as input to control the application.

3. The method of claim 1 further comprising executing the application on the mobile device using the virtual user input interface as input to control the application.

4. The method of claim 1 further comprising executing the application on the mobile device using the physical user input interface as input to control the application.

5. The method of claim 1 further comprising indicating an input on the virtual user input interface through simultaneous illumination of a color on both the interface element on the virtual user input interface and an illumination element of the physical user input interface.

6. The method of claim 1 further comprising illuminating at least one illumination element of the physical user input interface based on the mapping when the user provides an input through the virtual user input interface.

7. The method of claim 1 further comprising indicating an input on the physical user input interface through simultaneous illumination of a color on both the interface element on the virtual user input interface and an illumination element of the physical user input interface.

8. The method of claim 1 further comprising indicating an input on the physical user input interface through force feedback at the physical user input interface and illumination of a color on the virtual user input interface.

9. A computer-readable storage medium carrying one or more sequences of one or more instructions which, when executed by one or more processors, cause an apparatus to at least perform the following steps:

configure, for execution in a mobile device, which includes a physical user input interface, an application that is originally configured for execution using a virtual user input interface;

display the virtual user input interface on a touchscreen display of the mobile device, wherein the physical user input interface is mapped to the virtual user input interface;

receive a physical user input on the physical user input interface while simultaneously receiving an input through the virtual user input interface on the touchscreen display;

map the receiving physical input to the displayed virtual user input on the touchscreen display; and

determine to display an indication of a virtual input, based on the received physical input, on the displayed virtual user input interface while executing the application on the mobile terminal device based on the received input from both the physical user input interface and the virtual user input interface.

10. The computer-readable storage medium of claim 9, wherein the apparatus is further caused to correlate a motion shown on the virtual user input interface to the physical user input interface such that the physical user input interface provides feedback to the user as the virtual user input interface, simultaneously, provides feedback to the user.

11. The computer-readable storage medium of claim 10, wherein the feedback on the physical user input interface is illumination of a corresponding portion of the physical user input interface.

12. The computer-readable storage medium of claim 10, wherein the apparatus is further caused to use the mapped input as input to control the application when executing the application on the mobile terminal device.

13. A device comprising:

a physical user input interface;

a display;

a processing unit connected to the display and the physical user input interface;

a module connected to the processing unit and to the physical user input interface; and

a memory connected to the processing unit and the module, the memory including mapping information related to a virtual user input interface,

wherein the processing unit is capable of executing applications through input using the virtual user input interface,

wherein the processing unit is configured to detect that an application is to be executed on the device,

wherein the module retrieves mapping information from the memory that includes a virtual user input interface matching the physical user input interface,

wherein the module is configured, with the processing unit, to display the virtual user input interface, which represents the physical user input interface, on the touchscreen display of the device, receiving a physical user input on the physical user input interface while simultaneously receive an input through the virtual user input interface on the touchscreen display, and map the receiving physical input to the displayed virtual user input on the touchscreen display.

14. The device of claim 13 further comprising a cellular telephone module connected to the processing unit for communication with the second device.

15. The device of claim 13, wherein the virtual user input interface includes at least one illumination element that provides illumination feedback, on the display, corresponding to the user'"'"'s input at the physical user input interface.

16. The device of claim 13, wherein the physical user input interface includes at least one actuator that provides force feedback corresponding to an illumination of at least one illumination element of the virtual user input interface on the display.

17. The device of claim 13, wherein the physical user input interface includes at least one actuator that provides force feedback corresponding to movement of a virtual element of the virtual user input interface on the display.