Electronic device response to force-sensitive interface

• US 10,635,255 B2
• Filed: 04/18/2017
• Issued: 04/28/2020
• Est. Priority Date: 04/18/2017
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Kugler, Tyler Reed, Polyudov, Alexey, Lee, Seungyon, Lee, Yun-Ling, Quinn, Philip, Sundara-Rajan, Kishore, Zhai, Shumin, Mukherjee, Debanjan, Miller, James B., Reynolds, Isaac William
• Primary Examiner(s): Rayan, Mihir K
• Application Number:
  US15/490,756
• Publication Number:
  US 20180299996A1
• Time in Patent Office: 1,106 Days
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/1656 Details related to functional adaptations of the enclosure, e.g. to provide protection against EMI, shock, water, or to host detachable peripherals like a mouse or removable expansions units like PCMCIA cards, or to provide access to internal components for maintenance or to removable storage supports like CDs or DVDs, or to mechanically mount accessories mounting of accessories to a computer display G06F1/1607; display hoods G06F1/1603; cooling arrangements for portable computers G06F1/203
• CPC Class Codes: G06F 1/1684 Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
• CPC Class Codes: G06F 1/1686 the I/O peripheral being an integrated camera
• CPC Class Codes: G06F 1/169 the I/O peripheral being an integrated pointing device, e.g. trackball in the palm rest area, mini-joystick integrated between keyboard keys, touch pads or touch stripes G06F1/1643 takes precedence; constructional details of pointing devices G06F3/033
• CPC Class Codes: G06F 21/32 using biometric data, e.g. fingerprints, iris scans or voiceprints
• CPC Class Codes: G06F 2200/1636 Sensing arrangement for detection of a tap gesture on the housing
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 2203/04105 Pressure sensors for measuring the pressure or force exerted on the touch surface without providing the touch position
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0414 using force sensing means to determine a position
• CPC Class Codes: G06F 3/045 using resistive elements, e.g. a single continuous surface or two parallel surfaces put in contact
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/04883 : for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 : by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/167 : Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Abstract

A method includes a processor of an electronic device receiving first input signals from a first sensor in response to user contact at a first edge of the device and second input signals from a second sensor in response to user contact at a second edge of the electronic device. The first and second sensors are covered by a housing of the device. The processor determines an external context of the device based on analysis of the first input signals and the second input signals. The determined external context indicates at least a position of the device relative to a user or an orientation of the device relative to a user. Responsive to determining the external context, the electronic device executes a particular user input action.

Claims

1. A computer-implemented method, comprising:

receiving, by an electronic device, a single force-dependent gesture input that interacts with a peripheral edge of the electronic device;

determining that the single force-dependent gesture input represents a simultaneous squeeze input at opposing sides of the electronic device, based on the electronic device;

receiving first input signals from a first strain sensor that is covered by a housing of the electronic device

at a first edge of the housing of the electronic device, and

receiving second input signals from a second strain sensor that is covered by the housing of the electronic device at a second edge of the electronic device that opposes the first edge of the electronic device;

executing, by the electronic device, responsive to the electronic device receiving the single force-dependent gesture input and determining that the single force-dependent gesture input represents the simultaneous squeeze input at opposing sides of the electronic device actions comprising;

(i) activating a device assistant application of the electronic device, and

(ii) playing a recorded audio prompt that is responsive to the device assistant application being activated, wherein the audio prompt is played to cause a user to reply with voice input;

receiving a voice input that is responsive to the recorded audio prompt and that includes a command to be executed using the device assistant application; and

executing, using the device assistant application, an action corresponding to an instruction in the command that is received in response to the recorded audio prompt.

2. The method of claim 1, comprising:

determining, based on the input signals from the first strain sensor and the second strain sensor, that another force-dependent gesture input received by the electronic device indicates that the electronic device has transitioned from not being positioned in at least one hand of the user to being positioned in at least one hand of the user; and

executing, by the electronic device and responsive to the electronic device receiving the force-dependent gesture input, a particular user input action comprising causing a display of the electronic device to transition from not displaying a virtual keyboard to displaying a virtual keyboard.

3. The method of claim 1, comprising:

determining, based on the input signals from the first strain sensor and the second strain sensor, that another force-dependent gesture input received by the electronic device indicates that the electronic device has transitioned from being positioned in both hands of the user or a first hand of the user to being positioned in a second hand of the user; and

executing, by the electronic device and responsive to the electronic device receiving the force-dependent gesture input, a particular user input action comprising adjusting a displayed position of a virtual keyboard from being positioned at a first location on a display of the electronic device to being positioned at a second location on the display of the electronic device, wherein the second position corresponds to a position of the second hand of the user.

4. The method of claim 1, comprising:

determining, based on the input signals from the first strain sensor and the second strain sensor, that another force-dependent gesture input received by the electronic device indicates that the electronic device has transitioned from not being positioned in at least one hand of the user to being positioned in at least one hand of the user; and

executing, by the electronic device and responsive to the electronic device receiving the force-dependent gesture input, a particular user input action comprising at least one of;

a) activating an audio signal transmission mode of the electronic device,

b) deactivating the audio signal transmission mode of the electronic device, or

c) causing a radio signal comprising audio data to be transmitted by a transmitter of the electronic device for receipt by a receiver of a second electronic device that is within a threshold distance of the electronic device.

5. The method of claim 1, wherein the electronic device determines that the single force-dependent gesture input represents the simultaneous squeeze input at opposing sides of the electronic device without regard for one or more orientations of the electronic device as determined by gyroscopic or accelerometer sensors of the electronic device.

6. The method of claim 1, further comprising:

determining, by the electronic device and based on the determined single force-dependent gesture input that represents a simultaneous squeeze input at opposing sides of the electronic device, a particular hand that the user has a propensity to use when holding the electronic device, when the electronic device is positioned in a user hand.

7. The method of claim 1, wherein:

the first and second strain sensors are each covered respectively at two opposing sides of the housing; and

the single force-dependent gesture input comprises user contact at the first and second edges of the housing that provides a concurrent force on the first and second strain sensors when the user simultaneously squeezes the opposing sides of the electronic device.

8. The method of claim 1, wherein user input that prompts the activating the device assistant application and the playing the recorded audio prompt consists of the single force-dependent gesture input that represents the simultaneous squeeze input.

9. An electronic system comprising:

one or more processing devices;

one or more machine-readable storage devices for storing instructions that are executable by the one or more processing devices to cause performance of operations that comprise;

receiving, by an electronic device, a single force-dependent gesture input that interacts with a peripheral edge of the electronic device;

determining that the single force-dependent gesture input represents a simultaneous squeeze input at opposing sides of the electronic device, based on the electronic device;

receiving first input signals from a first strain sensor that is covered by a housing of the electronic device

at a first edge of the housing of the electronic device, and

receiving second input signals from a second strain sensor that is covered by the housing of the electronic device at a second edge of the electronic device that opposes the first edge of the electronic device;

executing, by the electronic device, responsive to the electronic device receiving the single force-dependent gesture input and determining that the single force-dependent gesture input represents the simultaneous squeeze input at opposing sides of the electronic device actions comprising;

(i) activating a device assistant application of the electronic device, and

(ii) playing a recorded audio prompt that is responsive to the device assistant application being activated, wherein the audio prompt is played to cause a user to reply with voice input;

receiving a voice input that is responsive to the recorded audio prompt and that includes a command to be executed using the device assistant application; and

executing, using the device assistant application, an action corresponding to an instruction in the command that is received in response to the recorded audio prompt.

10. The electronic system of claim 9, wherein the operations comprise:

determining, based on the input signals from the first strain sensor and the second strain sensor, that another force-dependent gesture input received by the electronic device indicates that the electronic device has transitioned from not being positioned in at least one hand of the user to being positioned in at least one hand of the user; and

executing, by the electronic device and responsive to the electronic device receiving the force-dependent gesture input, a particular user input action comprising causing a display of the electronic device to transition from not displaying a virtual keyboard to displaying a virtual keyboard.

11. The electronic system of claim 9, wherein the operations comprise:

determining, based on the input signals from the first strain sensor and the second strain sensor, that another force-dependent gesture input received by the electronic device indicates that the electronic device has transitioned from being positioned in both hands of the user or a first hand of the user to being positioned in a second hand of the user; and

executing, by the electronic device and responsive to the electronic device receiving the force-dependent gesture input, a particular user input action comprising adjusting a displayed position of a virtual keyboard from being positioned at a first location on a display of the electronic device to being positioned at a second location on the display of the electronic device, wherein the second position corresponds to a position of the second hand of the user.

12. The electronic system of claim 9, wherein the operations comprise:

determining, based on the input signals from the first strain sensor and the second strain sensor, that another force-dependent gesture input received by the electronic device indicates that the electronic device has transitioned from not being positioned in at least one hand of the user to being positioned in at least one hand of the user; and

executing, by the electronic device and responsive to the electronic device receiving the force-dependent gesture input, a particular user input action comprising at least one of;

a) activating an audio signal transmission mode of the electronic device,

b) deactivating the audio signal transmission mode of the electronic device, or

c) causing a radio signal comprising audio data to be transmitted by a transmitter of the electronic device for receipt by a receiver of a second electronic device that is within a threshold distance of the electronic device.

13. The electronic system of claim 9, wherein the electronic device determines that the single force-dependent gesture input represents the simultaneous squeeze input at opposing sides of the electronic device without regard for one or more orientations of the electronic device as determined by gyroscopic or accelerometer sensors of the electronic device.

14. The electronic system of claim 9, wherein the operations comprise:

determining, by the electronic device and based on the determined single force-dependent gesture input that represents a simultaneous squeeze input at opposing sides of the electronic device, a particular hand that the user has a propensity to use when holding the electronic device, when the electronic device is positioned in a user hand.

15. One or more non-transitory machine-readable storage devices storing instructions that are executable by one or more processing devices to cause performance of operations that comprise:

receiving, by an electronic device, a single force-dependent gesture input that interacts with a peripheral edge of the electronic device;

determining that the single force-dependent gesture input represents a simultaneous squeeze input at opposing sides of the electronic device, based on the electronic device;

receiving first input signals from a first strain sensor that is covered by a housing of the electronic device

at a first edge of the housing of the electronic device, and

receiving second input signals from a second strain sensor that is covered by the housing of the electronic device at a second edge of the electronic device that opposes the first edge of the electronic device;

executing, by the electronic device, responsive to the electronic device receiving the single force-dependent gesture input and determining that the single force-dependent gesture input represents the simultaneous squeeze input at opposing sides of the electronic device actions comprising;

(i) activating a device assistant application of the electronic device, and

(ii) playing a recorded audio prompt that is responsive to the device assistant application being activated, wherein the audio prompt is played to cause a user to reply with voice input;

receiving a voice input that is responsive to the recorded audio prompt and that includes a command to be executed using the device assistant application; and

executing, using the device assistant application, an action corresponding to an instruction in the command that is received in response to the recorded audio prompt.