Keyboard maximization on a multi-display handheld device

• US 10,592,061 B2
• Filed: 08/11/2015
• Issued: 03/17/2020
• Est. Priority Date: 10/01/2010
• Status: Active Grant

• Current Assignee: Z124 LLC (Flexis)
• Original Assignee: Z124 LLC (Flexis)
• Inventors: Sirpal, Sanjiv, Gimpl, Martin
• Primary Examiner(s): Khan, Shahid K
• Application Number:
  US14/823,856
• Publication Number:
  US 20160041756A1
• Time in Patent Office: 1,680 Days
• CPC Class Codes: G06F 1/16 Constructional details or arrangements
• CPC Class Codes: G06F 1/1616 with folding flat displays, e.g. laptop computers or notebooks having a clamshell configuration, with body parts pivoting to an open position around an axis parallel to the plane they define in closed position
• CPC Class Codes: G06F 1/1632 External expansion units, e.g. docking stations
• CPC Class Codes: G06F 1/1641 the display being formed by a plurality of foldable display components G06F1/1647 takes precedence
• CPC Class Codes: G06F 1/1647 including at least an additional display G06F1/1692 takes precedence
• CPC Class Codes: G06F 1/1677 for detecting open or closed state or particular intermediate positions assumed by movable parts of the enclosure, e.g. detection of display lid position with respect to main body in a laptop, detection of opening of the cover of battery compartment
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2200/1614 Image rotation following screen orientation, e.g. switching from landscape to portrait mode
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 2203/04803 Split screen, i.e. subdividing the display area or the window area into separate subareas
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0412 Digitisers structurally integrated in a display
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/044 by capacitive means
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 : Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0483 : Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 3/0484 : for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/04842 : Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 : for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/04847 : Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0486 : Drag-and-drop
• CPC Class Codes: G06F 3/0488 : using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 : for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 : by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/1423 : controlling a plurality of local displays, e.g. CRT and flat panel display
• CPC Class Codes: G06F 3/1446 : display composed of modules, e.g. video walls
• CPC Class Codes: G06T 3/02 : Affine transformations for image registration G06T3/147; for image mosaicing G06T3/4038
• CPC Class Codes: G06T 3/40 : Scaling of whole images or parts thereof, e.g. expanding or contracting
• CPC Class Codes: G09G 2356/00 : Detection of the display position w.r.t. other display screens
• CPC Class Codes: G09G 5/14 : Display of multiple viewports
• CPC Class Codes: H04L 12/1827 : Network arrangements for conference optimisation or adaptation

Abstract

Methods and devices for selectively presenting a virtual keyboard are provided. More particularly, a change in the operating mode of a multiple screen device from a multiple screen operating mode to a single screen operating mode, or from a single screen operating mode to a multiple screen operating mode, can be determined. Moreover, a change in the operating mode can effect a change in a presentation of a virtual keyboard. More particularly, a presentation of a virtual keyboard can be retained, where the number of screens of the device in view of the user is changed, provided an application with a keyboard focus remains in view of the user after the change in operating mode.

Claims

1. A method, comprising:

providing a device having first and second displays;

in a first operating mode, presenting a virtual keyboard and a first window having a keyboard focus, wherein the virtual keyboard has a first keyboard size and format, wherein the first window has a first window size, and wherein the first window having keyboard focus is based on the first window displaying an input field;

receiving input from a user, wherein the input includes a change in the number of displays that are active and places the device in a second operating mode;

determining whether the first window having keyboard focus remains active or does not remain active in the second operating mode;

in response to and based on the first operating mode comprising a single display mode, the second operating mode comprising a multi-display mode, and determining that the first window having keyboard focus remains active in the second operating mode, changing presentation of the first window, wherein the first window has one of the first window size or a second window size, and changing presentation of the virtual keyboard, wherein the second window size is larger than the first window size and wherein the virtual keyboard has a second keyboard size and format;

in response to and based on the first operating mode comprising a multi-display mode, the second operating mode comprising a single display mode, and determining that the first window having keyboard focus does not remain active in the second operating mode, discontinuing presentation of the first window, discontinuing presentation of the virtual keyboard on the first and second display, and dismissing keyboard focus on the first window; and

in response to and based on the first operating mode comprising a multi-display mode, the second operating mode comprising a single display mode, and determining that the first window having keyboard focus remains active in the second operating mode, discontinuing presentation of the first window, discontinuing presentation of the virtual keyboard on the first and second display, and maintaining keyboard focus on the first window.

2. The method of claim 1, wherein in the first operating mode the first and second displays are active, wherein a first portion of the virtual keyboard is presented using a first portion of the first display, wherein a second portion of the virtual keyboard is presented using a first portion of the second display, and wherein the first window is presented using one of a second portion of the first display and a second portion of the second display.

3. The method of claim 2, wherein in the second operating mode only one of the first display and the second display is active, and wherein the first window and a virtual keyboard are presented using the one of the first display and the second display that is active.

4. The method of claim 3, wherein the virtual keyboard displayed in the first operating mode is larger than the virtual keyboard displayed in the second operating mode.

5. The method of claim 4, wherein the virtual keyboard displayed in the first operating mode and the virtual keyboard displayed in the second operating mode present the same input options to the user.

6. The method of claim 3, wherein in the second operating mode the first window has the first window size.

7. The method of claim 3, wherein in the second operating mode the first window has the second window size, wherein the second window size is different than the first window size and format.

8. The method of claim 3, wherein the input received from the user includes closing the device.

9. The method of claim 1, wherein in the first operating mode only one of the first and second displays is active.

10. The method of claim 9, wherein in the second operating mode both the first and second displays are active.

11. A device, comprising:

a first display, the first display including a touch sensitive display area;

a second display, the second display including a touch sensitive display area;

memory;

a processor;

application programming stored in the memory and executed by the processor, wherein the application programming is operable to;

present a virtual keyboard and at least a portion of a first window having a keyboard focus, wherein the virtual keyboard is presented in a first keyboard size and format, and wherein the first window is presented in a first window size;

while presenting the virtual keyboard and at least a first portion of a first window having the keyboard focus, detect a change in a current operating mode;

determine whether the first window having the keyboard focus remains active or does not remain active after the detected change in operating mode;

in response to and based on the first operating mode comprising a single display mode, the second operating mode comprising a multi-display mode, and determining the first window having keyboard focus remains active in the second operating mode, maintain presentation of the first window, wherein the first window has one of the first window size or a second window size, and change presentation of the virtual keyboard, wherein the second window size is larger than the first window size and wherein the virtual keyboard has a second keyboard size and format;

in response to and based on the first operating mode comprising a multi-display mode, the second operating mode comprising a single display mode, and determining that the first window having keyboard focus does not remain active in the second operating mode, discontinuing presentation of the first window, discontinuing presentation of the virtual keyboard on the first and second display, and dismissing keyboard focus on the first window; and

in response to and based on the first operating mode comprising a multi-display mode, the second operating mode comprising a single display mode, and determining that the first window having keyboard focus remains active in the second operating mode, discontinuing presentation of the first window, discontinuing presentation of the virtual keyboard on the first and second display, and maintaining keyboard focus on the first window.

12. The device of claim 11, further comprising:

a hinge, wherein the hinge interconnects the first and second displays, wherein in the first operating mode the device is in an open state, and wherein in the second operating mode the device is in a closed state.

13. The device of claim 12, wherein in the first operating mode the virtual keyboard is presented by a first portion of the first display and a first portion of the second display, and wherein the at least a first portion of the first window is presented by a second portion of the first display.

14. The device of claim 13, wherein the first display is a primary display.

15. The device of claim 13, wherein the first window has a keyboard focus while the device is in the first operating mode and while the device is in the second operating mode.

16. A non-transitory computer readable medium having stored thereon computer-executable instructions, the computer executable instructions causing a processor to execute a method for providing a virtual keyboard by:

determining an operating mode of a device having at least a first touch sensitive display and a second touch sensitive display;

displaying a virtual keyboard and at least a first portion of a first window having a keyboard focus in a first operating mode, wherein the virtual keyboard has a first keyboard size and format in the first operating mode;

detecting a change from the first operating mode to a second operating mode;

determining whether the first window having the keyboard focus continues to be active or does not continue to be active;

in response to and based on the first operating mode comprising a single display mode, the second operating mode comprising a multi-display mode, and determining the first window having keyboard focus remains active in the second operating mode, maintaining presentation of the first window, wherein the first window has one of the first window size or a second window size, and changing presentation of the virtual keyboard, wherein the second window size is larger than the first window size and wherein the virtual keyboard has a second keyboard size and format;

in response to and based on the first operating mode comprising a multi-display mode, the second operating mode comprising a single display mode, and determining that the first window having keyboard focus does not remain active in the second operating mode, discontinuing presentation of the first window, discontinuing presentation of the virtual keyboard on the first and second display, and dismissing keyboard focus on the first window; and

in response to and based on the first operating mode comprising a multi-display mode, the second operating mode comprising a single display mode, and determining that the first window having keyboard focus remains active in the second operating mode, discontinuing presentation of the first window, discontinuing presentation of the virtual keyboard on the first and second display, and maintaining keyboard focus on the first window.

17. The computer readable medium of claim 16, the computer-executable instructions further comprising:

instructions to identify the first window as a window having a keyboard focus.

18. The computer readable medium of claim 17, wherein in the first operating mode both of the first and second touch sensitive displays are operative, and wherein in the second operating mode only one of the first and second touch sensitive displays is operative.

19. The computer readable medium of claim 18, wherein in the first operating mode the virtual keyboard is presented using a first portion of the first touch sensitive display and a first portion of the second touch sensitive display, wherein the first portion of the first window is presented by a second portion of the first touch sensitive display, and wherein at least a first portion of a second window is presented by a second portion of the second touch sensitive display.

20. The computer readable medium of claim 16, wherein in the first operating mode only one of the first and second touch sensitive displays is operative, and wherein in the second operating mode both of the first and second touch sensitive displays are operative.