Method and Mobile Terminal Device for Mapping a Virtual User Input Interface to a Physical User Input Interface

• US 20140281953A1
• Filed: 05/31/2014
• Published: 09/18/2014
• Est. Priority Date: 03/23/2005
• Status: Active Grant

• Current Assignee: Conversant Wireless Licensing S.à.r.l. (f/k/a Core Wireless Licensing S.a.r.l.) (MOSAID Technologies Inc. (f/k/a Conversant Intellectual Property Management))
• Original Assignee: Core Wiresless Licensing SARL (MOSAID Technologies Inc. (f/k/a Conversant Intellectual Property Management))
• Inventors: HAYASHI, Sawako-Eeva, JOERESSEN, Olaf
• Granted Patent: US 9,952,758 B2
• Time in Patent Office: Days
• US Class Current: 715/701
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 13/537 using indicators, e.g. showing the condition of a game character on screen
• CPC Class Codes: A63F 13/5375 for graphically or textually suggesting an action, e.g. by displaying an arrow indicating a turn in a driving game
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: H04M 1/27453 Directories allowing storage of additional subscriber data, e.g. metadata
• CPC Class Codes: H04M 1/2747 Scrolling on a display
• CPC Class Codes: H04M 1/2748 by matching character strings
• CPC Class Codes: H04M 1/7243 with interactive means for internal management of messages

Abstract

The present invention provides a method an a device for mapping a virtual user input interface to a physical user input interface. The method is provided for mapping a virtual user input interface to a physical user input interface on a mobile terminal device. The mobile terminal device comprises a first physical user input interface, a display and a processing unit being connected to said display and said physical user interface, wherein an application is configured for use with a second user interface. The method of the invention comprises detecting an event indicative of an application to be executed that is configured for use with said second user interface and displaying a virtual user input interface representing said second user input interface on said display. If a a physical user input is received on said first physical user input interface, it is mapping to said displayed virtual user input interface, and displayed as an indication of a virtual input on said displayed virtual user input interface.

Claims

1. A method comprising:

configuring for execution in a mobile device, which includes a physical user input interface, an application that is originally configured for execution on a second device using a second physical user input interface of the second device;

retrieving a virtual user input interface matching the second physical user input interface of the second device;

displaying the virtual user input interface on a display of the mobile device, wherein the physical user input interface is mapped to the virtual user input interface; and

training a user to learn the mapping of the physical user input interface to the virtual user input interface using an interface element of the virtual user input interface.

2. The method of claim 1, wherein the step of training includes illuminating at least a portion of the interface element on the display in response to the user'"'"'s input on the physical user input interface.

3. The method of claim 1, wherein the step of training includes correlating a motion shown on the virtual user input interface to the physical user input interface such that the physical user input interface provides feedback to the user as the virtual user input interface, simultaneously, provides feedback to the user.

4. The method of claim 3, wherein the feedback on the physical user input interface is illumination of a corresponding portion of the physical user input interface.

5. The method of claim 3, wherein the feedback on the physical user input interface is a force feedback actuator of a physical input element of the physical user input interface.

6. The method of claim 1 further comprising executing the application on the mobile device using the virtual user input interface as input to control the application.

7. The method of claim 1 further comprising executing the application on the mobile device using the physical user input interface as input to control the application.

8. The method of claim 1 further comprising indicating an input on the virtual user input interface through simultaneous illumination of a color on both the interface element on the virtual user input interface and an illumination element of the physical user input interface.

9. The method of claim 1 further comprising illuminating at least one illumination element of the physical user input interface based on the mapping when the user provides an input through the virtual user input interface.

10. The method of claim 1 further comprising indicating an input on the physical user input interface through simultaneous illumination of a color on both the interface element on the virtual user input interface and an illumination element of the physical user input interface.

11. The method of claim 1 further comprising indicating an input on the physical user input interface through force feedback at the physical user input interface and illumination of a color on the virtual user input interface.

12. A computer-readable storage medium carrying one or more sequences of one or more instructions which, when executed by one or more processors, cause an apparatus to at least perform the following steps:

configure, for execution in a mobile device, which includes a physical user input interface, an application that is originally configured for execution on a second device using a second physical user input interface of the second device;

retrieve a virtual user input interface matching the second physical user input interface of the second device;

display the virtual user input interface on a display of the mobile device, wherein the physical user input interface is mapped to the virtual user input interface; and

train a user to learn the mapping of the physical user input interface to the virtual user input interface using an interface element of the virtual user input interface.

13. The computer-readable storage medium of claim 12, wherein the apparatus is further caused to correlate a motion shown on the virtual user input interface to the physical user input interface such that the physical user input interface provides feedback to the user as the virtual user input interface, simultaneously, provides feedback to the user.

14. The computer-readable storage medium of claim 13, wherein the feedback on the physical user input interface is illumination of a corresponding portion of the physical user input interface.

15. The computer-readable storage medium of claim 13, wherein the feedback on the physical user input interface is a force feedback actuator of a physical input element of the physical user input interface.

16. A device comprising:

a physical user input interface;

a display;

a processing unit connected to the display and the physical user input interface;

a module connected to the processing unit and to the physical user input interface; and

a memory connected to the processing unit and the module, the memory including training information and mapping information related to a second device that includes a second physical user input interface,

wherein the processing unit is capable of executing applications originally configured for execution on the second device and controlled through input using the second physical user input interface of the second device,

wherein the processing unit is configured to detect that an application is to be executed on the device,

wherein the module retrieves mapping information from the memory that includes a virtual user input interface matching the second physical user input interface of the second device,

wherein the modules is configured, with the processing unit, to display the virtual user input interface, which represents the second physical user input interface, on the display of the device and train a user to learn the mapping of the physical user input interface to the virtual user input interface through feedback using an interface element of the virtual user input interface.

17. The device of claim 16 further comprising a cellular telephone module connected to the processing unit for communication with the second device.

18. The device of claim 16, wherein the virtual user input interface includes at least one illumination element that provides illumination feedback, on the display, corresponding to the user'"'"'s input at the physical user input interface.

19. The device of claim 16, wherein the physical user input interface includes at least one actuator that provides force feedback corresponding to an illumination of at least one illumination element of the virtual user input interface on the display.

20. The device of claim 16, wherein the physical user input interface includes at least one actuator that provides force feedback corresponding to movement of a virtual element of the virtual user input interface on the display.