Electronic Device Response to Force-Sensitive Interface

• US 20180299996A1
• Filed: 04/18/2017
• Published: 10/18/2018
• Est. Priority Date: 04/18/2017
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Kugler, Tyler Reed, Polyudov, Alexey, Lee, Seungyon, Lee, Yun-Ling, Quinn, Philip, Sundara-Rajan, Kishore, Zhai, Shumin, Mukherjee, Debanjan, Miller, James B., Reynolds, Isaac William
• Granted Patent: US 10,635,255 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1656 Details related to functional adaptations of the enclosure, e.g. to provide protection against EMI, shock, water, or to host detachable peripherals like a mouse or removable expansions units like PCMCIA cards, or to provide access to internal components for maintenance or to removable storage supports like CDs or DVDs, or to mechanically mount accessories mounting of accessories to a computer display G06F1/1607; display hoods G06F1/1603; cooling arrangements for portable computers G06F1/203
• CPC Class Codes: G06F 1/1684 Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 1/169 the I/O peripheral being an integrated pointing device, e.g. trackball in the palm rest area, mini-joystick integrated between keyboard keys, touch pads or touch stripes G06F1/1643 takes precedence; constructional details of pointing devices G06F3/033
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 2200/1636 Sensing arrangement for detection of a tap gesture on the housing
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 2203/04105 Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0414 using force sensing means to determine a position
• CPC Class Codes: G06F 3/045 using resistive elements, e.g. a single continuous surface or two parallel surfaces put in contact
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/04883 : for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 : by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/167 : Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Abstract

A method includes a processor of an electronic device receiving first input signals from a first sensor in response to user contact at a first edge of the device and second input signals from a second sensor in response to user contact at a second edge of the electronic device. The first and second sensors are covered by a housing of the device. The processor determines an external context of the device based on analysis of the first input signals and the second input signals. The determined external context indicates at least a position of the device relative to a user or an orientation of the device relative to a user. Responsive to determining the external context, the electronic device executes a particular user input action.

Claims

1. A computer-implemented method, comprising:

receiving, by a processor of an electronic device, in response to user contact at a first edge of a housing of the electronic device, first input signals from a first sensor of the electronic device, wherein the first sensor is covered by the housing of the electronic device;

receiving, by the processor, in response to user contact at a second edge of the housing of the electronic device, second input signals from a second sensor of the electronic device, wherein the second sensor is covered by the housing of the electronic device;

determining, by the processor and based on analysis of the first input signals and the second input signals, an external context of the electronic device that indicates at least one of;

i) a position of the electronic device relative to a user, or

ii) an orientation of the electronic device relative to the user; and

executing, by the electronic device, responsive to determining the external context of the electronic device, a particular user input action based on the determined external context of the electronic device.

2. The method of claim 1, wherein:

the external context indicates that the electronic device has transitioned from not being positioned in at least one hand of the user to being positioned in at least one hand of the user; and

the particular user input action executed by the electronic device includes causing a display of the electronic device to transition from not displaying a virtual keyboard to displaying a virtual keyboard.

3. The method of claim 1, wherein:

the external context indicates that the electronic device has transitioned from being positioned in both hands of the user or a first hand of the user to being positioned in a second hand of the user; and

the particular user input action executed by the electronic device includes adjusting a displayed position of a virtual keyboard from being positioned at a first location on a display of the electronic device to being positioned at a second location on the display of the electronic device, wherein the second position corresponds to a position of the second hand of the user.

4. The method of claim 1, wherein:

the external context indicates that the electronic device has transitioned from not being positioned in at least one hand of the user to being positioned in at least one hand of the user; and

the particular user input action executed by the electronic device includes at least one of;

a) activating a listening mode of the electronic device for receiving voice-input after the electronic device transitioned to being positioned in at least one hand of the user, and supplying an audible reply to the voice input,

b) deactivating the listening mode of the electronic device for receiving voice-input after the electronic device transitioned to being positioned in at least one hand of the user,

c) activating a voice-input to text conversion mode, such that voice input received by the electronic device after the electronic device transitioned to being positioned in at least one hand of the user is converted to text for presentation on a display of the electronic device, or

d) deactivating the voice-input to text conversion mode.

5. The method of claim 1, wherein:

the external context indicates that the electronic device has transitioned from not being positioned in at least one hand of the user to being positioned in at least one hand of the user; and

the particular user input action executed by the electronic device includes at least one of;

a) activating a camera application of the electronic device, or

b) causing the camera application of the electronic device to capture digital image content.

6. The method of claim 1, wherein:

the external context indicates that the electronic device has transitioned from not being positioned in at least one hand of the user to being positioned in at least one hand of the user; and

the particular user input action executed by the electronic device includes at least one of;

a) activating an audio signal transmission mode of the electronic device,

c) deactivating the audio signal transmission mode of the electronic device, or

b) causing a radio signal comprising audio data to be transmitted by a transmitter of the electronic device for receipt by a receiver of a second electronic device that is within a threshold distance of the electronic device.

7. The method of claim 1, further comprising:

determining, by the processor of the electronic device, that the user contact at the first edge and the user contact at the second edge occur at a same time;

wherein determining the external context of the electronic device includes determining, based on the user contact at the first edge and the user contact at the second edge occurring at the same time, that a user input gesture includes;

i) a swipe input along the first edge of the electronic device,

ii) a tap input at the first edge of the electronic device, or

iii) a squeeze input at the first edge of the electronic device and the second edge of the electronic device.

8. The method of claim 7, wherein the electronic device determines that the user input gesture includes the swipe input, the tap input, or the squeeze input without regard for one or more orientations of the electronic device as determined by gyroscopic or accelerometer sensors of the electronic device.

9. The method of claim 1, further comprising:

determining, by the processor of the electronic device and based on the determined external context, a particular hand that the user has a propensity to use when holding the electronic device, when the electronic device is positioned in a user hand.

10. The method of claim 9, wherein:

the external context indicates that the electronic device has transitioned from not being positioned in the particular hand of the user to being positioned in the particular hand of the user, to the exclusion of being positioned in both hands of the user, or another hand of the user; and

the particular user input action executed by the electronic device includes adjusting a displayed position of a virtual keyboard.

11. An electronic system comprising:

one or more processing devices;

one or more machine-readable storage devices for storing instructions that are executable by the one or more processing devices to cause performance of operations that comprise;

receiving, by a processor of an electronic device, in response to user contact at a first edge of a housing of the electronic device, first input signals from a first sensor of the electronic device, wherein the first sensor is covered by the housing of the electronic device;

receiving, by the processor, in response to user contact at a second edge of the housing of the electronic device, second input signals from a second sensor of the electronic device, wherein the second sensor is covered by the housing of the electronic device;

determining, by the processor and based on analysis of the first input signals and the second input signals, an external context of the electronic device that indicates at least one of;

i) a position of the electronic device relative to a user, or

ii) an orientation of the electronic device relative to the user; and

executing, by the electronic device, responsive to determining the external context of the electronic device, a particular user input action based on the determined external context of the electronic device.

12. The electronic system of claim 11, wherein:

the external context indicates that the electronic device has transitioned from not being positioned in at least one hand of the user to being positioned in at least one hand of the user; and

the particular user input action executed by the electronic device includes causing a display of the electronic device to transition from not displaying a virtual keyboard to displaying a virtual keyboard.

13. The electronic system of claim 11, wherein:

the external context indicates that the electronic device has transitioned from being positioned in both hands of the user or a first hand of the user to being positioned in a second hand of the user; and

the particular user input action executed by the electronic device includes adjusting a displayed position of a virtual keyboard from being positioned at a first location on a display of the electronic device to being positioned at a second location on the display of the electronic device, wherein the second position corresponds to a position of the second hand of the user.

14. The electronic system of claim 11, wherein:

the external context indicates that the electronic device has transitioned from not being positioned in at least one hand of the user to being positioned in at least one hand of the user; and

the particular user input action executed by the electronic device includes at least one of;

a) activating a listening mode of the electronic device for receiving voice-input after the electronic device transitioned to being positioned in at least one hand of the user, and supplying an audible reply to the voice input,

b) deactivating the listening mode of the electronic device for receiving voice-input after the electronic device transitioned to being positioned in at least one hand of the user,

c) activating a voice-input to text conversion mode, such that voice input received by the electronic device after the electronic device transitioned to being positioned in at least one hand of the user is converted to text for presentation on a display of the electronic device, or

d) deactivating the voice-input to text conversion mode.

15. The electronic system of claim 11, wherein:

the external context indicates that the electronic device has transitioned from not being positioned in at least one hand of the user to being positioned in at least one hand of the user; and

the particular user input action executed by the electronic device includes at least one of;

a) activating a camera application of the electronic device, or

b) causing the camera application of the electronic device to capture digital image content.

16. The electronic system of claim 11, wherein:

the external context indicates that the electronic device has transitioned from not being positioned in at least one hand of the user to being positioned in at least one hand of the user; and

the particular user input action executed by the electronic device includes at least one of;

a) activating an audio signal transmission mode of the electronic device,

c) deactivating the audio signal transmission mode of the electronic device, or

b) causing a radio signal comprising audio data to be transmitted by a transmitter of the electronic device for receipt by a receiver of a second electronic device that is within a threshold distance of the electronic device.

17. The electronic system of claim 11, further comprising:

determining, by the processor of the electronic device, that the user contact at the first edge and the user contact at the second edge occur at a same time;

wherein determining the external context of the electronic device includes determining, based on the user contact at the first edge and the user contact at the second edge occurring at the same time, that a user input gesture includes;

i) a swipe input along the first edge of the electronic device,

ii) a tap input at the first edge of the electronic device, or

iii) a squeeze input at the first edge of the electronic device and the second edge of the electronic device.

18. The electronic system of claim 17, wherein the electronic device determines that the user input gesture includes the swipe input, the tap input, or the squeeze input without regard for one or more orientations of the electronic device as determined by gyroscopic or accelerometer sensors of the electronic device.

19. The electronic system of claim 11, further comprising:

determining, by the processor of the electronic device and based on the determined external context, a particular hand that the user has a propensity to use when holding the electronic device, when the electronic device is positioned in a user hand.

20. One or more machine-readable storage devices storing instructions that are executable by one or more processing devices to cause performance of operations that comprise:

receiving, by a processor of an electronic device, in response to user contact at a first edge of a housing of the electronic device, first input signals from a first sensor of the electronic device, wherein the first sensor is covered by the housing of the electronic device;

receiving, by the processor, in response to user contact at a second edge of the housing of the electronic device, second input signals from a second sensor of the electronic device, wherein the second sensor is covered by the housing of the electronic device;

determining, by the processor and based on analysis of the first input signals and the second input signals, an external context of the electronic device that indicates at least one of;

i) a position of the electronic device relative to a user, or

ii) an orientation of the electronic device relative to the user; and

executing, by the electronic device, responsive to determining the external context of the electronic device, a particular user input action based on the determined external context of the electronic device.