Detection and usability of personal electronic devices for field engineers

• US 9,746,930 B2
• Filed: 03/26/2015
• Issued: 08/29/2017
• Est. Priority Date: 03/26/2015
• Status: Active Grant

• Current Assignee: GE Digital Holdings LLC (GE Aerospace)
• Original Assignee: General Electric Company
• Inventors: Wu, Chih-Sung
• Primary Examiner(s): Elahi, Towfiq
• Application Number:
  US14/670,293
• Publication Number:
  US 20160282948A1
• Time in Patent Office: 887 Days
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Abstract

A system and method for improved detection and usability of personal electronic devices for field engineers is disclosed. A personal electronic device stores a list of commands in memory. The personal electronic device presents a user interface in a relative motion input mode, wherein the user interface in the relative motion mode is divided into a plurality of user interface zones. The personal electronic device receives relative motion input, wherein the relative motion input is received through one or more relative motion sensors of the personal electronic device. The personal electronic device determines whether the received relative motion input matches input associated with a respective command in a list of reference commands. In accordance with a determination that the received relative motion input matches input is associated with a respective command in the list of reference commands, the personal electronic device executes the respective command.

Claims

1. A method comprising:

storing a list of commands in memory associated with a personal electronic device, wherein each stored command includes a function executable by the personal electronic device and an associated input that causes the command to be executed;

receiving user input through a touchscreen associated with the personal electronic device;

detecting one or more touch input anomalies in the received user input; and

in response to detecting one or more touch anomalies in the received user input;

changing the operating mode of the personal electronic device from a touch input mode to a relative motion input mode; and

altering a displayed user interface to a relative motion input-based user interface such that the user interface in the relative motion mode is divided into a plurality of user interface zones;

receiving relative motion input, wherein the relative motion input is received through one or more relative motion sensors of the personal electronic device;

determining whether the received relative motion input matches input associated with a respective command in a list of reference commands;

in accordance with a determination that the received relative motion input matches input is associated with a respective command in the list of reference commands, executing the respective command; and

in accordance with a determination that the received relative motion input does not match stored input associated with a respective command in the list of reference commands, determining and executing a closest matching command.

2. The method of claim 1, wherein before receiving relative motion input, a first user interface zone of the plurality of user interface zones is visually distinguished as selected, and wherein executing the respective-command comprises:

changing the visually distinguished interface zone from the first user interface zone to a second user interface zone based on the respective command.

3. The method of claim 1, wherein relative motion input represents a change in the personal electronic devices position or rotation.

4. The method of claim 1, wherein relative motion input represents motion of a user relative to the personal electronic device.

5. The method of claim 1, wherein the display associated with the personal electronic device is a touchscreen.

6. The method of claim 1, wherein the relative motion sensors of the personal electronic device include one or more of a gyroscope, an accelerometer, a microphone, and a camera.

7. The method of claim 1, further comprising, after executing the closest matching command, monitoring future user inputs to determine whether an undo command was received;

and

in accordance with a determination that no undo command was received, updating input data associated with the closest matching command to include the received user input.

8. The method of claim 7, wherein input data associated with a stored command includes a range of possible inputs.

9. The method of claim 8, wherein updating the input data associated with the closest matching command to include the received user input further comprises extending the range of possible inputs to cover the received user input.

10. The method of claim 1, further including, prior to changing the operating mode of the personal electronic device from the touch input mode to the relative motion input mode, displaying an operating mode change notification on the display associated with the personal electronic device.

11. The method of claim 1, further including, prior to changing the operating mode of the personal electronic device from the touch input mode to the relative motion input mode, displaying a prompt message on the display associated with the personal electronic device, wherein the prompt message suggests a change of operating mode;

receiving input indicating user acceptance of the change of operating mode; and

in response to receiving the input indicating user acceptance of the change of operating mode, changing the operating mode of the personal electronic device from the touch input mode to the relative motion input mode.

18. The method of claim 1, wherein in the touch input mode, the displayed user interface displays a standard user interface for an application displayed.

12. An electronic device comprising:

a storage module to store a list of commands in memory associated with a personal electronic device, wherein each stored command includes a function executable by the electronic device and associated input that causes the command to be executed;

an error response module to;

receive user input through a touchscreen associated with the personal electronic device;

detect one or more touch input anomalies in the received user input; and

in response to detecting one or more touch anomalies in the received user input;

change the operating mode of the personal electronic device from a touch input mode to a relative motion input mode; and

alter a displayed user interface to a relative motion input-based user interface such that the user interface in the relative motion mode is divided into a plurality of user interface zones;

a reception module to receive relative motion input, wherein the relative motion input is received through one or more relative motion sensors of the personal electronic device;

an input analysis module to determine whether the received relative motion input matches input associated with a respective command in a list of reference commands; and

an execution module to, in accordance with a determination that the received relative motion input matches input is associated with a respective command in the list of reference commands, execute the respective command, and in accordance with a determination that the received relative motion in out does not match stored input associated with a respective command in the list of reference commands, determining and executing a closest matching command.

13. The system of claim 12, wherein before receiving relative motion input, a first user interface zone of the plurality of user interface zones is visually distinguished as selected, and further comprising:

a change module to change the visually distinguished interface zone from the first user interface zone to a second user interface zone based on the respective command.

14. The electronic device of claim 12, wherein the relative motion sensors of the electronic device include one or more of a gyroscope, an accelerometer, a microphone, and a camera.

19. The electronic device of claim 12, wherein in the touch input mode, the displayed user interface displays a standard user interface for an application displayed.

15. A non-transitory computer-readable storage medium storing instructions that, when executed by the one or more processors of a machine, cause the machine to perform operations comprising:

storing a list of commands in memory associated with a personal electronic device, wherein each stored command includes a function executable by the personal electronic device and associated input that causes the command to be executed;

receiving user input through a touchscreen associated with the personal electronic device;

detecting one or more touch input anomalies in the received user input; and

in response to detecting one or more touch anomalies in the received user input;

changing the operating mode of the personal electronic device from a touch input mode to a relative motion input mode; and

altering a displayed user interface to a relative motion input-based user interface such that the user interface in the relative motion mode is divided into a plurality of user interface zones;

receiving relative motion input, wherein the relative motion input is received through one or more relative motion sensors of the personal electronic device;

determining whether the received relative motion input matches input associated with a respective command in a list of reference commands;

in accordance with a determination that the received relative motion input matches input is associated with a respective command in the list of reference commands, executing the respective command; and

in accordance with a determination that the received relative motion in out does not match stored input associated with a respective command in the list of reference commands, determining and executing a closest matching command.

16. The non-transitory computer-readable storage medium of claim 15, wherein before receiving relative motion input, a first user interface zone of the plurality of user interface zones is visually distinguished as selected, and wherein executing the respective command comprises:

changing the visually distinguished interface zone from the first user interface zone to a second user interface zone based on the respective command.

17. The non-transitory computer-readable storage medium of claim 16, wherein the relative motion sensors of the personal electronic device include one or more of a gyroscope, an accelerometer, a microphone, and a camera.

20. The non-transitory computer-readable storage medium of claim 15, wherein in the touch input mode, the displayed user interface displays a standard user interface for an application displayed.