USER INTERFACE FOR TEXT INPUT ON THREE DIMENSIONAL INTERFACE

• US 20140189569A1
• Filed: 03/07/2014
• Published: 07/03/2014
• Est. Priority Date: 07/18/2011
• Status: Abandoned Application

• Current Assignee: Thingthing, Ltd.
• Original Assignee: Syntellia Inc. (Pinterest, Inc.)
• Inventors: Eleftheriou, Kosta, Verdelis, Ioannis
• Application Number:
  US14/200,696
• Publication Number:
  US 20140189569A1
• Time in Patent Office: Days
• US Class Current: 715/773
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0233 Character input methods
• CPC Class Codes: G06F 3/0237 using prediction or retrieval techniques
• CPC Class Codes: G06F 3/0325 using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

A three dimensional data input system includes a space sensor that can input commands and text based upon user gestures within a three dimensional space. The three dimensional space can include a virtual keyboard and the system identifies words input as a set of points input by a user on the virtual keyboard. The intended word is identified by determining an origin and points associated with letters on a log polar coordinate system. The log distances and angles of the points are then compared to log distances and angles for known words stored in a computer memory. The known word having the log distances and angles that most closely match the input points is identified as the intended word.

Claims

1. A text input method comprising:

providing a sensor for detecting positions of portions of the body in a three dimensional space, the sensor transmitting position information to a processor;

detecting by the sensor, a first sequence of input locations of portions of the body in the three dimensional space associated with an intended word;

defining a virtual keyboard plane by a processor, based upon a first three or more inputs of the sequence of input locations;

identifying by the processor, a word stored in a dictionary that most closely matches the relative positions and the sequence of input locations on the virtual keyboard in the three dimensional space; and

inputting by the processor, the word to a sequence of input text.

2. The text input method of claim 1 wherein the identifying step includes:

identifying a first set of radial distances relative to an origin on the virtual keyboard plane associated with letters of the first intended word;

identifying a first set of angular values associated with the letters of the first intended word;

comparing the first set of radial distances to sets of radial distances associated with words stored in a dictionary; and

comparing the first set of angular values to sets of angular values associated with the words stored in the dictionary.

3. The text input method of claim 2 wherein the radial distances relative to the origin associated with letters of the first intended word are measured as log distances.

4. The text input method of claim 3 wherein the identifying step includes:

determining a standard deviation of the log distances.

5. The text input method of claim 3 wherein the identifying step includes:

applying weights to the standard deviation of the log distances.

6. The text input method of claim 1 further comprising:

displaying the intended word stored in the dictionary on a visual display.

7. The text input method of claim 1 further comprising:

detecting by the sensor, a space gesture movement of the body in the three dimensional space; and

inputting by the processor, a space to the sequence of input text.

8. The text input method of claim 1 further comprising:

detecting by the sensor, a punctuation mark gesture movement of the body in the three dimensional space; and

inputting by the processor, a punctuation mark to the sequence of input text.

9. A text input method comprising:

providing a sensor for detecting positions of portions of the body in a three dimensional space;

detecting by the sensor, a first sequence of input locations of portions of the body in the three dimensional space associated with an intended word;

identifying a first set of X, Y and Z coordinate points associated with letters of the first intended word;

converting the first set of X, Y and Z coordinate points into a Cartesian coordinate system with the origin at the weighted average of the first set of X, Y and Z coordinate points;

converting the X, Y and Z coordinate points into log polar coordinate points from an origin, each of the points having ρ and

θ

values;

comparing the first set of radial distances to a set of log polar coordinate points associated with words stored in a dictionary;

comparing the first set of angular values to a set of angular values associated with the words stored in the dictionary; and

identifying the word stored in the dictionary having the radial positions that most closely match the first set of radial distances and the angular values that most closely match the first set of angular values of the first intended word.

10. The text input method of claim 9 wherein the identifying step includes:

identifying a first set of radial distances relative to an origin on the virtual keyboard plane associated with letters of the first intended word;

identifying a first set of angular values associated with the letters of the first intended word;

comparing the first set of radial distances to sets of radial distances associated with words stored in a dictionary; and

comparing the first set of angular values to sets of angular values associated with the words stored in the dictionary.

11. The text input method of claim 10 wherein the radial distances relative to the origin associated with letters of the first intended word are measured as log distances.

12. The text input method of claim 10 wherein the identifying step includes:

determining a standard deviation of the log distances.

13. The text input method of claim 10 wherein the identifying step includes:

applying weights to the standard deviation of the log distances.

14. The text input method of claim 9 further comprising:

displaying the intended word stored in the dictionary on a visual display.

15. The text input method of claim 9 further comprising:

detecting by the sensor, a space gesture movement of the body in the three dimensional space; and

inputting by the processor, a space to the sequence of input text.

16. The text input method of claim 9 further comprising:

detecting by the sensor, a punctuation mark gesture movement of the body in the three dimensional space; and

inputting by the processor, a punctuation mark to the sequence of input text.

17. An text input method comprising:

defining by a processor, a virtual keyboard on a virtual plane in a three dimensional space, where the virtual plane is not on an object;

detecting by a sensor, a location of a portion of a body in the three dimensional space;

detecting by the processor, a sequence of intersections of the portions of the body with the virtual keyboard;

inputting by the processor, a sequence of letters corresponding to the intersections of the portions of the body on the virtual keyboard;

detecting by the processor a gesture in the three dimensional space that is not a letter input; and

performing by the processor a command associated with the gesture.

18. The text input method of claim 17 wherein the gesture is a wave.

19. The text input method of claim 18 wherein the command associated with the gesture is a space input.

20. The text input method of claim 17 wherein the gesture is a thumbs up.

21. The text input method of claim 20 wherein the command associated with the gesture is a backspace.

22. The text input method of claim 17 wherein the gesture is a left swipe and the command associated with the gesture is a back space.

23. The text input method of claim 1 wherein the gesture is a circular hand motion.

24. The text input method of claim 17 wherein the command associated with the gesture is a scrolling through a plurality of suggested words.