Motion-based input method and system for electronic device

• US 9,778,839 B2
• Filed: 07/12/2013
• Issued: 10/03/2017
• Est. Priority Date: 06/09/2013
• Status: Active Grant

• Current Assignee: Apple Inc., SAP SE
• Original Assignee: SAP SE
• Inventors: Wen, Zongzhi
• Primary Examiner(s): Mehmood, Jennifer
• Assistant Examiner(s): Adams, Carl
• Application Number:
  US13/940,745
• Publication Number:
  US 20140361997A1
• Time in Patent Office: 1,544 Days
• Field of Search: 345173
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A method for efficient data input may include displaying a user interface, detecting a plurality of positions of an object, and, controlling a display screen to display a data content, in response to a plurality of movements of the object. If the controller determines the object moved substantially in a first direction, the display screen modifies the data content based on a group of data choices. If the controller determines the object moved substantially in a second direction, the controller stores, into a memory, the data content currently being displayed on the display screen.

Claims

1. An electronic device comprising:

a display screen displaying a user interface;

a memory;

an input device detecting a plurality of positions of an object displayed on the user interface; and

a controller, interactively in response to one or more movements of the object detected on a grid defined by an input touch down point on the display screen, controlling the display screen to display, in real time, a data content, the data content based on a group of data choices, wherein the grid is a Cartesian coordinate system defined by the input touch down point and aligned vertically and horizontally based on the input touch down point,

wherein if the controller determines the object moved substantially in a first direction on the grid relative to the input touch down point, the display screen interactively modifies, in real time, the data content based on a magnitude of the movement relative to a most recently displayed data content,

if the controller determines the object moved substantially in a second direction, the controller stores, into the memory, the data content currently being displayed on the display screen, and after storing the data content currently being displayed on the display screen, controls the display screen to display another data content, and

if the controller determines the object moved substantially in a third direction opposite to the second direction, the controller causes the display screen to highlight and de-commit a previous data content for modification based on a previous group of data choices.

2. The electronic device of claim 1, wherein the first direction is substantially parallel to a vertical edge of the display screen.

3. The electronic device of claim 1, wherein the second direction is substantially parallel to a horizontal edge of the display screen.

4. The electronic device of claim 1, wherein the input device comprises at least one of a touch sensitive surface, a pressure detector, a light detector, a video camera, a sonic detector, and a magnetic field detector.

5. The electronic device of claim 1, wherein the object comprises at least one of a stylus, a user'"'"'s finger, and a wand.

6. The electronic device of claim 1, wherein the data content comprises at least one of a text character, a text string representing a phoneme or a syllable of a word, a date, a month, a weekday, a year, and an emoticon.

7. The electronic device of claim 1, wherein the group of data choices is generated by the controller based upon properties of the data content or a previous data content of the user interface.

8. The electronic device of claim 1, wherein the group of data choices is generated by the controller based upon speech recognition of a segment of user speech.

9. A method comprising:

displaying, by a display screen, a user interface;

detecting, by an input device, a plurality of positions of an object displayed on the user interface; and

controlling, by a controller, the display screen to display, in real time, a content, interactively in response to one or more movements of the object detected on a grid defined by an input touch down point on the display screen, the data content based on a group of data choices, where the grid is a Cartesian coordinate system defined by the input touch down point and aligned vertically and horizontally based on the input touch down point,

wherein if the controller determines the object moved substantially in a first direction on the grid relative to the input touch down point, the display screen interactively modifies, in real time, the data content based on a magnitude of the movement relative to a most recently displayed data content,

if the controller determines the object moved substantially in a second direction, the controller stores, into the memory, the data content currently being displayed on the display screen, and after storing the data content currently being displayed on the display screen, controls the display screen to display another data content, and

if the controller determines the object moved substantially in a third direction opposite to the second direction, the controller causes the display screen to highlight and de-commit a previous data content for modification based on a previous group of data choices.

10. The method of claim 9, wherein the first direction is substantially parallel to a vertical edge of the display screen.

11. The method of claim 9, wherein the second direction is substantially parallel to a horizontal edge of the display screen.

12. The method of claim 9, wherein the input device comprises at least one of a touch sensitive surface, a pressure detector, a light detector, a video camera, a sonic detector, and a magnetic field detector.

13. The method of claim 9, wherein the object comprises at least one of a stylus, a user'"'"'s finger, and a wand.

14. The method of claim 9, wherein the data content comprises at least one of a text character, a text string representing a phoneme or a syllable of a word, a date, a month, a weekday, a year, and an emoticon.

15. The method of claim 9, wherein the group of data choices is generated by the controller based upon properties of the data content or a previous data content of the user interface.

16. The method of claim 9, wherein the group of data choices is generated by the controller based upon speech recognition of a segment of user speech.

17. A non-transitory computer-readable medium storing program instructions that, when executed, cause a processor to perform a method, the method comprising:

displaying, by a display screen, a user interface;

detecting, by an input device, a plurality of positions of an object detected on a grid defined by an input touch down point on the display screen; and

controlling, by a controller, the display screen to display, in real time, a data content based on a group of data choices, interactively in response to one or more movements of the object, wherein the grid is a Cartesian coordinate system defined by the input touch down point and aligned vertically and horizontally based on the input touch down point,

wherein if the controller determines the object moved substantially in a first direction, the display screen interactively modifies, in real time, the data content, the value of the modified data content being based on a magnitude of movement in the first direction,

if the controller determines the object moved substantially in a second direction, the controller stores, into a memory, the data content currently being displayed on the display screen and after storing the data content currently being displayed on the display screen, controls the display screen to display another data content, and

if the controller determines the object moved substantially in a third direction opposite to the second direction, the controller causes the display screen to highlight and de-commit a previous data content for modification based on a previous group of data choices.

18. A method of rendering a graphical user interface, on a client device having a touch sensitive surface, implemented by one or more data processors forming part of at least one computing device, the method comprising:

providing, by at least one data processor, a grid to track a magnitude of movement of an object on the graphical user interface, wherein the grid is defined by an input touch down point on the touch sensitive surface and the grid is a Cartesian coordinate system defined by the input touch down point and aligned vertically and horizontally based on the input touchdown point;

initiating display, by at least one data processor, on the graphical user interface of a plurality of spaces for receiving input via the object;

responsive to receiving a stimulus by the object, enabling, by at least one data processor, modification of a first one of the plurality of input spaces;

modifying, by at least one data processor in real time, content of the first input space based on movement substantially parallel to a first axis of the grid, the content of the first input space correlated with a magnitude of movement along the first axis;

responsive to movement substantially parallel to a second axis of the grid, at least one of;

committing, by at least one data processor, the content to the first input space and/or enabling, by at least one data processor, modification of a second one of the input spaces; and

responsive to movement substantially parallel to the second axis of the grid in an opposite direction, highlighting and de-committing a previous content of a previous input space for modification based on a previous group of content choices,

wherein the display of the graphical user interface is updated substantially in real time with the modification and committing of the content.

19. The method of claim 18, wherein the grid is not displayed on the graphical user interface.