Detection and usability of personal electronic devices for field engineers

• US 10,466,801 B2
• Filed: 08/11/2017
• Issued: 11/05/2019
• Est. Priority Date: 03/26/2015
• Status: Active Grant

• Current Assignee: GE Digital Holdings LLC (GE Aerospace)
• Original Assignee: General Electric Company
• Inventors: Wu, Chih-Sung
• Primary Examiner(s): Elahi, Towfiq
• Application Number:
  US15/675,516
• Publication Number:
  US 20170344125A1
• Time in Patent Office: 816 Days
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Abstract

A system and method for improved detection and usability of personal electronic devices for field engineers is disclosed. A personal electronic device stores a list of commands in memory. The personal electronic device presents a user interface in a relative motion input mode, wherein the user interface in the relative motion mode is divided into a plurality of user interface zones. The personal electronic device receives relative motion input, wherein the relative motion input is received through one or more relative motion sensors of the personal electronic device. The personal electronic device determines whether the received relative motion input matches input associated with a respective command in a list of reference commands. In accordance with a determination that the received relative motion input matches input is associated with a respective command in the list of reference commands, the personal electronic device executes the respective command.

Claims

1. A method comprising:

storing a list of commands in memory associated with a personal electronic device, wherein each stored command includes a function executable by the personal electronic device and an associated input that causes the command to be executed;

receiving relative motion input, wherein the relative motion input is received through one or more relative motion sensors of the personal electronic device;

determining whether the received relative motion input matches input associated with a respective command in a list of reference commands;

in accordance with a determination that the received relative motion input does not match stored input associated with a respective command in the list of reference commands, determining and executing a closest matching command;

monitoring future user inputs to determine whether an undo command is received after executing the closest matching command; and

in response to another command being received after executing the closest matching command or determining that an undo command has not been received within a predetermined period of time, updating input data associated with the closest matching command to include the received user input.

2. The method of claim 1, further comprising presenting, on a display associated with the personal electronic device, a user interface in a relative motion input mode, wherein the user interface in the relative motion mode is divided into a plurality of user interface zones.

3. The method of claim 2, wherein before receiving relative motion input, a first user interface zone of the plurality of user interface zones is visually distinguished as selected, and wherein executing the respective command comprises:

changing the visually distinguished interface zone from the first user interface zone to a second user interface zone based on the respective command.

4. The method of claim 1, further comprising:

receiving user input through a touchscreen associated with the personal electronic device;

detecting one or more touch input anomalies in the received user input; and

in response to detecting one or more touch anomalies in the received user input, changing an operating mode of the personal electronic device from a touch input mode to a relative motion input mode.

5. The method of claim 4, further including, in response to changing the operating mode of the personal electronic device from the touch input mode to the relative motion input mode, updating the presented user interface to a relative motion input-based user interface.

6. The method of claim 4, further including, prior to changing the operating mode of the personal electronic device from the touch input mode to the relative motion input mode, displaying an operating mode change notification on the display associated with the personal electronic device.

7. The method of claim 4, further including, prior to changing the operating mode of the personal electronic device from the touch input mode to the relative motion input mode, displaying a prompt message on the display associated with the personal electronic device, wherein the prompt message suggests a change of operating mode;

receiving input indicating user acceptance of the change of operating mode; and

in response to receiving the input indicating user acceptance of the change of operating mode, changing the operating mode of the personal electronic device from the touch input mode to the relative motion input mode.

8. The method of claim 1, wherein the relative motion input represents a change in the personal electronic devices position or rotation.

9. The method of claim 1, wherein the relative motion input represents motion of a user relative to the personal electronic device.

10. The method of claim 1, wherein the relative motion sensors of the personal electronic device include one or more of a gyroscope, an accelerometer, a microphone, and a camera.

11. The method of claim 1, wherein input data associated with a stored command includes a range of possible inputs.

12. The method of claim 11, wherein updating the input data associated with the closest matching command to include the received user input further comprises extending the range of possible inputs to cover the received user input.

20. The method of claim 1, wherein the determining the closest matching command comprises identifying a closest motion input based on a degree of rotation of the motion input.

13. An electronic device comprising:

a storage module to store a list of commands in memory associated with a personal electronic device, wherein each stored command includes a function executable by the electronic device and associated input that causes the command to be executed;

a reception module to receive relative motion input, wherein the relative motion input is received through one or more relative motion sensors of the personal electronic device;

an input analysis module to determine whether the received relative motion input matches input associated with a respective command in a list of reference commands; and

an execution module to;

in accordance with a determination that the received relative motion input does not match stored input associated with a respective command in the list of reference commands, determine and execute a closest matching command;

monitor future user inputs to determine whether an undo command is received after executing the closest matching command; and

in response to receipt of another command after execution of the closest matching command or a determination that an undo command has not been received within a predetermined period of time, update input data associated with the closest matching command to include the received user input.

14. The electronic device of claim 13, further comprising a presentation module to present, on a display associated with the electronic device, a user interface in a relative motion input mode, wherein the user interface in the relative motion mode is divided into a plurality of user interface zones.

15. The electronic device of claim 14, wherein before receiving relative motion input, a first user interface zone of the plurality of user interface zones is visually distinguished as selected, and further comprising:

a change module to change the visually distinguished interface zone from the first user interface zone to a second user interface zone based on the respective command.

16. The electronic device of claim 13, wherein the relative motion sensors of the electronic device include one or more of a gyroscope, an accelerometer, a microphone, and a camera.

17. A non-transitory computer-readable storage medium storing instructions that, when executed by one or more processors of a machine, cause the machine to perform operations comprising:

storing a list of commands in memory associated with a personal electronic device, wherein each stored command includes a function executable by the personal electronic device and associated input that causes the command to be executed;

receiving relative motion input, wherein the relative motion input is received through one or more relative motion sensors of the personal electronic device;

determining whether the received relative motion input matches input associated with a respective command in a list of reference commands;

in accordance with a determination that the received relative motion input does not match stored input associated with a respective command in the list of reference commands, determining and executing a closest matching command;

monitoring future user inputs to determine whether an undo command is received after executing the closest matching command; and

in response to another command being received after executing the closest matching command or determining that an undo command has not been received within a predetermined period of time, updating input data associated with the closest matching command to include the received user input.

18. The non-transitory computer-readable storage medium of claim 17, wherein the operations further comprise presenting, on a display associated with the personal electronic device, a user interface in a relative motion input mode, wherein the user interface in the relative motion mode is divided into a plurality of user interface zones.

19. The non-transitory computer-readable storage medium of claim 18, wherein before receiving relative motion input, a first user interface zone of the plurality of user interface zones is visually distinguished as selected, and wherein executing the respective command comprises:

changing the visually distinguished interface zone from the first user interface zone to a second user interface zone based on the respective command.