ADVANCED USER INTERFACE

• US 20150128049A1
• Filed: 07/08/2013
• Published: 05/07/2015
• Est. Priority Date: 07/06/2012
• Status: Abandoned Application

• Current Assignee: Robert S. Block, Sidlo, Paul, Wenger, Alexander A.
• Original Assignee: Robert S. Block, Sidlo, Paul, Wenger, Alexander A.
• Inventors: Block, Robert S., Wenger, Alexander A., Sidlo, Paul
• Application Number:
  US14/413,057
• Publication Number:
  US 20150128049A1
• Time in Patent Office: Days
• US Class Current: 715/728
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/1423 controlling a plurality of local displays, e.g. CRT and flat panel display
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 2360/02 Graphics controller able to handle multiple formats, e.g. input or output formats
• CPC Class Codes: G09G 2380/10 Automotive applications
• CPC Class Codes: G09G 2380/14 Electronic books and readers
• CPC Class Codes: G09G 5/022 using memory planes
• CPC Class Codes: G09G 5/14 Display of multiple viewports

Abstract

An advanced user interface includes a display device and a processing unit. The processing unit causes the display device to display a dynamic user interface containing a plurality of input areas in an adaptive graphical arrangement, detect user in puts on the dynamic user interface, and record the user inputs in a memory unit in association with a context of information inputted by the user. The graphical arrangement of input areas includes at least one primary input area, each of which is respectively associated with different information. The processing unit detects a user input for one of the input areas, compares the detected user input with prior user inputs recorded in the memory unit, and predicts a first next user input based on the comparison and the context of information associated with the detected user input. Based on the predicted first next user input, the processing unit dynamically modifies the displayed arrangement of the input areas so that information associated with the predicted first next user input is characterized and displayed as the at least one primary input area on the dynamic user interface.

Claims

1. An apparatus comprising:

at least one display device;

a processing unit configured to cause the at least one display device to display a dynamic user interface containing a plurality of input areas in an adaptive graphical arrangement, detect user inputs on the dynamic user interface, and record the user inputs in a memory unit in association with a context of information inputted by the user, wherein;

the graphical arrangement of input areas includes at least one primary input area, each of the input areas being respectively associated with different information;

the processing unit is configured to compare a detected user input for one of the input areas with prior user inputs recorded in the memory unit, and predict a first next user input based on the comparison and the context of information associated with the detected user input; and

the processing unit is configured to, based on the predicted first next user input, dynamically modify the displayed arrangement of the input areas so that information associated with the predicted first next user input is characterized and displayed as the at least one primary input area on the dynamic user interface.

2. The apparatus of claim 1, wherein:

the processing unit is configured to, in predicting the first next user input based on the comparison and the context of information associated with the detected user input, predict a respective likelihood of other information being selected in a second next user input based on the context of information associated with the first next user input; and

the processing unit is configured to display the other information associated with the context of information associated with the predicted first next user input in logical association with the primary input area based on the respective likelihood of the other information being selected in the second next user input.

3. The apparatus of claim 2, wherein:

the primary input area is arranged in logical association with at least one secondary input area; and

the processing unit is configured display the other information associated with the context of information associated with the predicted first next user input in the secondary input area based on the respective likelihood of the other information being selected in the second next user input.

4. The apparatus of claim 3, wherein:

the primary input area and the at least one secondary input area are each arranged as a geometric shape.

5. The apparatus of claim 1, comprising:

at least one tertiary input area arranged in logical association with the at least one secondary input area.

6. The apparatus of claim 1, wherein the input areas are associated with information including at least one of alphabet letters, numbers, symbols, phrases, sentences, paragraphs, forms, icons representing an executable operation, icons representing a commodity, icons representing a location, icons representing a form of communication, a command, and a mathematical notation.

7. The apparatus of claim 1, wherein:

the dynamic user interface includes a prediction field; and

the processing unit is configured to predict information associated with one or more user inputs and display the predicted information in the prediction field for the user to one of accept and reject the predicted information.

8. The apparatus of claim 7, wherein:

the processing unit is configured to compare a detected user input to the dynamic user interface with the predicted first next user input, and determine whether the user selected an incorrect input area based on the predicted first next user input; and

when the processing unit determines that the user selected an incorrect input area, the processing unit is configured to output a proposed correction in the prediction field for the user to one of accept and reject the proposed correction.

9. The apparatus of claim 1, wherein the apparatus is integrated in a mobility assistance device as an input/output unit for the mobility assistance device.

10. The apparatus of claim 9, wherein the mobility assistance device includes at least one of a personal transport vehicle, a walking assistance device, an automobile, an aerial vehicle, and a nautical vehicle.

11. The apparatus of claim 10, wherein the processing unit is configured to control the display device to display navigation information to a destination that is at least one of input and selected by the user by selecting at least one of the input areas of the dynamic user interface.

12. The apparatus of claim 1, wherein the apparatus is a computing device including at least one of a notebook computer, a tablet computer, a desktop computer, and a smartphone.

13. The apparatus of claim 12, wherein:

the computing device includes two display devices;

the processing unit is configured to display the dynamic user interface on one of the two display devices; and

the processing unit is configured to display information associated with at least one of the input areas selected by the user on the other one of the two display devices.

14. The apparatus of claim 1, wherein the processing unit is configured to control the display device to display the dynamic user interface on a first part of the display device, and display information associated with at least one of the input areas selected by the user on a second part of the display device such that the dynamic user interface and the information associated with the at least one of the input areas selected by the user are displayed together on the display device.

15. The apparatus of claim 1, comprising:

at least one of an audio input unit configured to receive an audible input from the user, a visual input unit configured to receive a visual input from the user, and a tactile unit configured to receive a touch input from the user,

wherein the processing unit is configured to interpret at least one of an audible input, a visual input, and a tactile input received from the user as a command to at least one of (i) select a particular input area on the dynamic user interface, (ii) scroll through input areas on the dynamic user interface, (iii) request information respectively associated with one or more user input areas on the dynamic user interface, and (iv) control movement of a mobility assistance device in which the apparatus is integrated.

16. The apparatus of claim 15, wherein:

the visual input unit is configured to obtain a facial image of at least one of the user and another individual; and

the processing unit is configured to associate personal information about the at least one of the user and the other individual from whom the facial image was obtained, and control the display unit to display the associated personal information.

17. The apparatus of claim 1, wherein the processing unit is configured to generate an icon for display on one of the input areas of the dynamic user interface based on a successive selection of a combination of input areas by the user.

18. The apparatus of claim 1, wherein the processing unit is configured to recognize repeated user inputs on the dynamic user interface based on the recorded user inputs in the memory unit, and generate an icon for display on one of the input areas of the dynamic user interface for an activity associated with the repeated user inputs.

19. The apparatus of claim 1, wherein the processing unit is configured to at least one of customize the dynamic user interface and a mouse associated with the dynamic user interface based on an activity of the user.

20. The apparatus of claim 1, wherein the processing unit is configured to transfer information associated with one or more user inputs between different applications executable on the apparatus.

21. The apparatus of claim 1, wherein the processing unit is configured to control the display device to prompt the user to perform an activity in association with information recorded in the memory unit with respect to at least one of a date, time and event.