Methods, controllers and computer program products for accessibility to computing devices

• US 10,281,986 B2
• Filed: 05/02/2013
• Issued: 05/07/2019
• Est. Priority Date: 05/03/2012
• Status: Active Grant

• Current Assignee: Georgia Tech Research Corporation (University System of Georgia)
• Original Assignee: Georgia Tech Research Corporation (University System of Georgia)
• Inventors: Howard, Ayanna, Berry, Brett, Devenish, Justin Nicholas, Hsu, Po Kai, Jernigan, Tiffany, Johnston, William, Park, Hae Won, Valentin, Giancarlo, Yau, Siu Chuen
• Primary Examiner(s): Edouard, Patrick N
• Assistant Examiner(s): Wilson, Douglas M
• Application Number:
  US14/397,894
• Publication Number:
  US 20150138068A1
• Time in Patent Office: 2,196 Days
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

Methods of providing user accessibility to an electronic device are provided. Methods include receiving a physical input via at least one user input device in a user interface, generating, in the user interface, a sensor output signal responsive to receiving the physical input from the user, and interpreting the sensor output signal as a gesture input signal that that is received by the electronic device. The gesture input signal is operative to cause the electronic device to perform a function corresponding to a gesture that is physically applied to the electronic device.

Claims

1. An apparatus for providing accessibility to an electronic device, the apparatus comprising:

a plurality of user input devices, each of which comprises a mechanical switch device, and each of which is configured to receive a physical input from a user via actuation of the mechanical switch device and to generate a respective sensor output signal responsive to the actuation, resulting in a plurality of sensor output signals;

a processing device that is configured to receive the plurality of sensor output signals and to interpret the plurality of sensor output signals as a single gesture input signal that is transmitted to the electronic device, wherein the single gesture input signal corresponds to a sequence of actuation of the plurality of the mechanical switch devices, the sequence of actuation being interpreted as a forward swipe gesture input signal or a backward swipe gesture input signal;

a sensor module that includes an interface housing that is dimensioned to receive the plurality of user input devices; and

an adjustable sleeve that supports the sensor module and the processing device and that is configured to be worn on a forearm of the user,

wherein the single gesture input signal is configured to cause the electronic device to change which row of a plurality of rows is highlighted in a graphical user interface generated by the electronic device, wherein the graphical user interface comprises a graphical representation of the plurality of rows, wherein each of the plurality of rows comprises a plurality of graphically generated buttons that respectively correspond to the plurality of user input devices.

2. The apparatus according to claim 1, wherein at least one of the plurality of user input devices comprises a force sensitive input device that is configured to provide the respective sensor output signal as a variable value that corresponds to an amount of physical input force applied to the force sensitive input device by the user.

3. The apparatus according to claim 2, wherein the force sensitive input device comprises a force sensitive resistor that is configured to have an electrical resistance that changes responsive to changes in physical force applied thereto.

4. The apparatus according to claim 3, further comprising a voltage divider circuit that comprises the force sensitive resistor therein and that is coupled to an analog input of the processing device, wherein as the physical force is applied to the force sensitive resistor a voltage value applied to the analog input of the processing device coupled to the voltage divider circuit changes responsive thereto.

5. The apparatus according to claim 1, wherein at least one of the plurality of user input devices comprises at least one of a joystick, track-ball, slam switch or a sip and puff switch.

6. The apparatus according to claim 1, wherein the interface housing comprises a curved base and a plurality of openings that are dimensioned to receive corresponding ones of the plurality of user input devices.

7. The apparatus according to claim 6, wherein the plurality of openings include edges that are substantially a same height as a contact surface of corresponding ones of the plurality of user input devices when the plurality of user input devices are mounted therein.

8. The apparatus according to claim 1, further comprising a wireless communication transmitter that is communicatively coupled to the processing device and that is configured to wirelessly transmit the single gesture input signal to be received by the electronic device.

9. The apparatus according to claim 1, wherein the interface housing comprises connection ports configured to be coupled to an external input device.

10. The apparatus according to claim 1, further comprising a plurality of feedback devices corresponding to the plurality of user input devices, ones of the plurality of feedback devices configured to provide a tactile feedback to a user corresponding to receiving the physical input from the user.

11. The apparatus according to claim 1, wherein the electronic device comprises a computer tablet device that is configured to wirelessly receive the single gesture input signal, and

wherein the computer tablet device comprises computer readable program code stored therein that, when executed by a processor in the computer tablet device, interprets the received single gesture input signal to control the computer tablet device.

12. A computer program product comprising:

a non-transitory computer readable storage medium having computer readable program code embodied in the medium, the computer readable program code comprising;

computer readable code to generate, in an electronic device, a graphical user interface that visually corresponds to an arrangement of a plurality of user input devices mounted in a wearable user interface, wherein each user input device comprises a mechanical switch device, wherein the wearable user interface is configured to convert user actuation of a plurality of the mechanical switch devices into a single gesture input signal that is transmitted to the electronic device; and

computer readable code to interpret the received single gesture input signal as an input to control the electronic device,

wherein the computer readable code to interpret the received single gesture input signal as an input to control the electronic device comprises computer readable code to interpret that the received single gesture input signal corresponds to a sequence of actuation of the plurality of the mechanical switch devices, the sequence of actuation being interpreted as a swipe gesture, further comprising computer readable code to execute an operation that corresponds to the swipe gesture,

wherein the plurality of user input devices in the wearable user interface comprises three user input devices that are arranged in a row in the wearable user interface,

wherein the graphical user interface that visually corresponds to the arrangement of the plurality of user input devices in the wearable user interface comprises a graphical representation of a plurality of rows of graphically generated buttons, each of the plurality of rows of graphically generated buttons comprising three graphically generated buttons corresponding to the three user input devices, and

wherein the computer readable code that executes the operation corresponding to the swipe gesture comprises computer readable code to change which of the plurality of rows of graphically generated buttons is highlighted responsive to a forward swipe or a backward swipe.

13. The computer program product according to claim 12, wherein the plurality of user input devices are mounted in the wearable user interface in an input layout pattern, and

wherein the computer readable code to generate, in the electronic device, the graphical user interface comprises computer readable code to generate a graphical representation that includes the input layout pattern.

14. The computer program product according to claim 12, wherein an order of the actuation of the plurality of the mechanical switch devices identifies the sequence of actuation as corresponding to either the forward swipe or the backward swipe.

15. The computer program product according to claim 12, further comprising computer readable code to generate mobile device commands that are responsive to the received single gesture input signal, wherein the mobile device commands are configured to be received by a remote mobility device that is operable to move responsive to receipt of the mobile device commands.

16. The computer program product according to claim 15, wherein the remote mobility device comprises a robot and wherein the graphical user interface comprises a robot control application.

17. A method of providing user accessibility to an electronic device, the method comprising:

receiving actuations of mechanical switch devices, each mechanical switch device arranged in a respective one of a plurality of user input devices mounted in a wearable user interface that is supported by an adjustable sleeve configured to be worn on a forearm of a user, wherein the plurality of user input devices in the wearable user interface comprises at least two user input devices that are arranged in a row in the wearable user interface;

generating, by a processor within the wearable user interface, a sensor output signal responsive to receiving each respective physical input, resulting in a plurality of sensor output signals; and

interpreting the plurality of sensor output signals as a single gesture input signal that is received by the electronic device, the single gesture input signal being operative to cause the electronic device to perform a function corresponding to a gesture physically inputted to the electronic device,

wherein interpreting the plurality of sensor output signals as the single gesture input signal that is received by the electronic device comprises interpreting that the single gesture input signal corresponds to a sequence of actuation of the plurality of the mechanical switch devices, the sequence of actuation being interpreted as a swipe gesture, and

wherein the function corresponding to the gesture physically inputted to the electronic device comprises changing, in a graphical user interface having a plurality of rows of graphically generated buttons, which of the plurality of rows of graphically generated buttons in the graphical user interface is highlighted, wherein each row of the graphically generated buttons comprises at least two graphically generated buttons, and wherein each row of the graphically generated buttons visually corresponds to an arrangement of the plurality of user input devices mounted in the wearable user interface.

18. The method according to claim 17, wherein generating at least one of the sensor output signals comprises generating a variable value that corresponds to an amount of physical input force applied to at least one of the user input devices.

19. The method according to claim 17, wherein at least one of the user input devices comprises a force sensitive resistor that is configured to have an electrical resistance that changes responsive to changes in physical force applied thereto.

20. The method according to claim 17, further comprising wirelessly transmitting the single gesture input signal from the wearable user interface to the electronic device.