METHOD AND APPARATUS FOR PROVIDING DYNAMICALLY POSITIONED CONTROLS

• US 20170300205A1
• Filed: 04/03/2017
• Published: 10/19/2017
• Est. Priority Date: 04/15/2016
• Status: Abandoned Application

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Villa, Andrea, Pajak, Arthur, Willkie, Chad, Oliver, Robyn
• Application Number:
  US15/477,814
• Publication Number:
  US 20170300205A1
• Time in Patent Office: Days
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 2203/04108 Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

Methods and apparatuses for providing dynamically positioned UI controls are disclosed. In one aspect, the method comprises performing a calibration a client device to facilitate ergonomic placement of at least one control element associated with a virtual control on the display. Calibration comprises prompting a user to grip the device in a first orientation. Then one or more grip locations at which the device is being gripped while in the first orientation are detected. The calibration also comprises prompting the user to touch a region of the display while maintaining the orientation and the grip. A touch input is detected within the display region subsequent to the prompting. Then, subsequent to the calibration, the at least one control element can be displayed on the display based on the calibration.

Claims

1. A method, operable by a device, of placing a virtual control on a touch-sensitive display of the client device, the method comprising:

performing a calibration of the device to facilitate ergonomic placement of at least one control element associated with the virtual control on the display, wherein the performing of the calibration comprises;

prompting a user of the device to hold the device in a calibration orientation,

detecting a calibration grip while the device is in the calibration orientation during the calibration subsequent to the prompting the user to hold the device,

prompting the user to touch a region of the display while maintaining the calibration orientation and the calibration grip, and

detecting a touch input within the region subsequent to the prompting the user to touch the region of the display; and

subsequent to the performing the calibration of the device;

detecting a post-calibration grip on the device; and

displaying the at least one control element at a location of the display, wherein the location is based on the performed calibration and the detected post-calibration grip.

2. The method of claim 1, wherein the performing of the calibration comprises determining an ergonomic reachable area on the display associated with the calibration while the device is in the calibration orientation based on the detected touch input.

3. The method of claim 2, wherein the displaying the at least one control element at the location of the display comprises placing the at least one control element to ensure that the at least one control element is reachable without adjustment of a post-calibration orientation or the post-calibration grip.

4. The method of claim 2, wherein the displaying the at least one control element at the location comprises positioning the at least one control element in the location of the display, wherein the location differs from a pre-calibration location of the at least one control element where the at least one control element would have otherwise been positioned but for the calibration.

5. The method of claim 1, wherein the calibration grip and/or the post-calibration grip include at least one of a left-handed grip, a right-handed grip, a one-handed grip, a two-handed grip, and/or a mounted grip, or any combination thereof;

and wherein the left-handed grip or the right-handed grip includes a grip that includes palm contact with the device or a grip that does not include palm contact with the device.

6. The method of claim 1, further comprising detecting a post-calibration orientation of the device after performing the calibration, wherein the displaying the at least one control element is further based on the detected post-calibration orientation.

7. The method of claim 1, further comprising:

detecting an object that generates the touch input within a distance above the display at a hover location;

determining that the object is within the distance above the display for a threshold period of time; and

repositioning the displayed at least one control element at the location of the display to the hover location.

8. The method of claim 1, wherein prompting the user to touch a region of the display comprises prompting the user to touch the region of the display at at least one of a farthest reach point or a nearest reach point while maintaining the calibration grip on the device.

9. The method of claim 1, wherein performing a calibration of the device comprises performing a calibration of the device for each of a first user and a second user and wherein the method further comprises:

generating user profiles for each of the first user and the second user, each user profile including information regarding at least one of a grip, an orientation, one or more regions of the display, and one or more control element locations, or any combination thereof; and

storing the user profiles in a memory.

10. The method of claim 1, wherein the performing of the calibration further comprises:

determining a finger pad size when detecting the touch input; and

displaying at least one additional control element at the location of the display; and

controlling spacing between the control elements based on the determined finger pad size.

11. An apparatus configured to place a virtual control on a touch-sensitive display of a client device, the apparatus comprising:

at least one sensor configured to detect one or more inputs based on a user'"'"'s grip and orientation of the device;

a processor configured to perform a calibration of the device to facilitate ergonomic placement of at least one control element associated with the virtual control on the display, wherein the processor is configured to at least;

prompt the user of the device to grip the device in a calibration orientation,

determine a calibration grip, based on the one or more inputs detected by the at least one sensor, while the device is in the calibration orientation during the calibration subsequent to the prompt of the user to grip the device,

prompt the user to touch a region of the display while maintaining the calibration orientation and the calibration grip,

detect a touch input within the region subsequent to the prompt of the user to touch the region of the display,

detect a post-calibration grip on the device subsequent to the calibration of the device, and

display the at least one control element at a location of the display, wherein the location is based on the performed calibration and the detected post-calibration grip.

12. The apparatus of claim 11, wherein the processor is further configured to determine a reachable area on the display associated with the calibration while the device is in the calibration orientation based on the detected touch input.

13. The apparatus of claim 12, wherein the reachable area bounds a plurality of regions each corresponding to one of a plurality of comfort levels of reachability based on the detected touch input.

14. The apparatus of claim 12, wherein the processor configured to display the at least one control element at the location of the display comprises the processor configured to place the at least one control element to ensure that the at least one control element is reachable without adjustment of a post-calibration orientation or the post-calibration grip.

15. The apparatus of claim 12, wherein the processor configured to display the at least one control element at the location comprises the processor configured to position the at least one control element in the location of the display, wherein the location differs from a pre-calibration location of the at least one control element where the at least one control element would have otherwise been positioned but for the calibration.

16. The apparatus of claim 11, wherein the display comprises a plurality of touch sensitive elements that each corresponds to a single location of the display.

17. The apparatus of claim 11, wherein the calibration grip and/or the post-calibration grip include at least one of a left-handed grip, a right-handed grip, a one-handed grip, a two-handed grip, and/or a mounted grip, or any combination thereof;

and wherein the left-handed grip or the right-handed grip includes a grip that includes palm contact with the device or a grip that does not include palm contact with the device.

18. The apparatus of claim 11, wherein the processor is further configured to detect a post-calibration orientation of the device after performing the calibration, wherein the processor is configured to display the at least one control element based on the detected post-calibration orientation.

19. The apparatus of claim 18, wherein the grip and the orientation are detected based at least in part on at least one of a grip sensor, a gyroscope, an accelerometer, a magnetometer, an infrared sensor, an ultrasound sensor, and/or a proximity sensor, or any combination thereof

20. The apparatus of claim 11, wherein the calibration is performed during an initial setup of the device or based on a request from the user or a software operating on the device.

21. The apparatus of claim 11, wherein the processor is further configured to:

detect an object that generates the touch input within a distance above the display at a hover location;

determine that the object is within the distance above the display for a threshold period of time; and

reposition the displayed at least one control element at the location of the display to the hover location.

22. The apparatus of claim 11, wherein the at least one control element is associated with a displayed user interface (UI) element of the mobile device touchscreen which activates an action when a touch is received at the location.

23. The apparatus of claim 11, wherein processor configured to prompt the user to touch a region of the display comprises the processor configured to prompt the user to touch the region of the display at at least one of a farthest reach point or a nearest reach point while maintaining the calibration grip on the device.

24. The apparatus of claim 11, wherein the processor configured to perform a calibration of the device comprises the processor configured to perform a calibration of the device for each of at least a first user and a second user and wherein the processor is further configured to:

generate a plurality of user profiles for each of the first user and the second user, each user profile including information regarding at least one of a grip, an orientation, one or more regions of the display, and one or more control element locations, or any combination thereof; and

store the plurality of user profiles in a memory.

25. The apparatus of claim 24, wherein the at least one user profile for the first user includes different control element locations as compared to the at least one user profile for the second user.

26. The apparatus of claim 11, wherein the processor is further configured:

determine a finger pad size when detecting the touch input; and

display at least one additional control element at the location of the display; and

control spacing between the control elements based on the determined finger pad size.

27. An apparatus configured to place a virtual control on a touch-sensitive display of a client device, the apparatus comprising:

means for performing a calibration of the device to facilitate ergonomic placement of at least one control element associated with the virtual control on the display;

means for prompting a user of the device to hold the device in a calibration orientation;

means for detecting a calibration grip while the device is in the calibration orientation during the calibration subsequent to the prompting the user to hold the device;

means for prompting the user to touch a region of the display while maintaining the calibration orientation and the calibration grip;

means for detecting a touch input within the region subsequent to the prompting the user to touch the region of the display;

means for detecting a post-calibration grip on the device; and

means for displaying the at least one control element at a location of the display, wherein the location is based on the performed calibration and the detected post-calibration grip.

28. The apparatus of claim 27, wherein the calibration is performed during an initial setup of the device or based on a request from the user or a software operating on the device.

29. The apparatus of claim 27, further comprising:

means for detecting an object that generates the touch input within a distance above the means for displaying at a hover location;

means for determining that the object is within the distance above the means for displaying for a threshold period of time; and

means for repositioning the displayed at least one control element at the location of the means for displaying to the hover location.

30. A non-transitory, computer-readable storage medium, comprising code executable to:

perform a calibration of the device to facilitate ergonomic placement of at least one control element associated with the virtual control on the display;

prompt a user of the device to hold the device in a calibration orientation;

detect a calibration grip while the device is in the calibration orientation during the calibration subsequent to the prompting the user to hold the device;

prompt the user to touch a region of the display while maintaining the calibration orientation and the calibration grip;

detect a touch input within the region subsequent to the prompting the user to touch the region of the display;

detect a post-calibration grip on the device; and

display the at least one control element at a location of the display, wherein the location is based on the performed calibration and the detected post-calibration grip.