Device and method of keyboard input and uses thereof

• US 20060087510A1
• Filed: 08/31/2005
• Published: 04/27/2006
• Est. Priority Date: 09/01/2004
• Status: Abandoned Application

• Current Assignee: Purdue Research Foundation (Purdue University)
• Original Assignee: Purdue Research Foundation (Purdue University)
• Inventors: Beni, Gerardo, Adamo-Villani, Nicoletta
• Application Number:
  US11/216,203
• Publication Number:
  US 20060087510A1
• Time in Patent Office: Days
• US Class Current: 345/474
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2219/2016 Rotation, translation, scaling

Abstract

A method and system of configuring a three-dimensional model using a keyboard. A three-dimensional model is provided that is configurable about a plurality of degrees of freedom in which each respective degree of freedom is associated with a value representing a magnitude of movement from a neutral position. At least one key on a keyboard is associated with each respective degree of freedom of the three-dimensional model. In response to the selection of at least one key on the keyboard, identifying the respective degree of freedom associated with the keyboard selection and adjusting the value associated with the identified degree of freedom. Although keyboard based, this interface allows the user to obtain a desired configuration of the three-dimensional model without prior knowledge of any 3D software and without selecting and applying transformations using a graphical user interface.

Claims

1. A method of configuring a three-dimensional model using a keyboard, the method comprising:

providing a three-dimensional model that is configurable about a plurality of degrees of freedom, where each respective degree of freedom is associated with a value representing a magnitude of movement from a neutral position;

associating at least one key on a keyboard with each respective degree of freedom of the three-dimensional model; and

in response to a selection of at least one key on the keyboard, identifying the respective degree of freedom associated with the keyboard selection and adjusting the value associated with the identified degree of freedom.

2. The method of claim 1, where the value associated with the identified degree of freedom is adjusted by a predetermined step size in response to the keyboard selection.

3. The method of claim 2, where each degree of freedom is associated with a respective predetermined step size.

4. The method of claim 2, where the three-dimensional model is configurable about less than 100 degrees of freedom.

5. The method of claim 2, where the three-dimensional model is configurable about less than 30 degrees of freedom.

6. The method of claim 1, where each respective degree of freedom is associated with a single key on the keyboard.

7. The method of claim 1, further comprising storing the three-dimensional model in a data structure, where the three-dimension model is represented by an alphanumeric string.

8. The method of claim 7, where the alphanumeric string is less than 100 characters.

9. The method of claim 7, where each letter in the alphanumeric string represents a respective degree of freedom in the three-dimensional model.

10. The method of claim 9, where each letter in the alphanumeric string is associated with a number, the number representing a magnitude of movement of a respective degree of freedom from a neutral position.

11. A computer-readable medium having computer-executable instructions for performing a method comprising:

maintaining a data structure including a plurality of elements, where each of the elements represents a degree of freedom associated with movement of either a hand or a face and where each of the elements is associated with a value representing a magnitude of movement from a neutral position;

associating each respective element with at least one key on a keyboard; and

in response to the selection of at least one key on the keyboard, identifying the element associated with the keyboard selection and adjusting the value associated with the identified element.

12. The computer readable medium of claim 11, where the value of the identified element is adjusted by a predetermined step size in response to the keyboard selection.

13. The computer readable medium of claim 11, where each respective element is associated with a single key on the keyboard.

14. The computer readable medium of claim 11, where the data structure includes less than 30 elements.

15. The computer readable medium of claim 14, where the data structure includes 26 elements.

16. The computer readable medium of claim 14, where the value of the identified element is adjusted based on the case of the at least one key on the keyboard.

17. A computer system comprising:

a processor;

a keyboard coupled to the processor; and

memory coupled to the processor, the memory comprising one or more sequences of instructions for building a hand configuration, wherein execution of the one or more sequences of instructions by the processor causes the processor to perform the steps of;

maintaining a data structure including a plurality of elements, where each of the elements represents a degree of freedom of a finger joint and where each of the elements is associated with a value representing a magnitude of movement from a neutral position;

associating at least one key on the keyboard with each of the elements; and

in response to the selection of at least one key on the keyboard, identifying the element associated with the keyboard selection and adjusting the value associated the identified element.

18. The computer system of claim 17, where the value of the identified element is adjusted by a predetermined step size in response to the keyboard selection.

19. The computer system of claim 17, where the predetermined step size is less than approximately ten degrees of movement.

20. The computer system of claim 17, where a portion of the elements represents a pitch motion associated with a finger joint and where a portion of the elements represents a yaw motion associated with a finger joint.

21. The computer system of claim 20, where the predetermined step size for the portion of elements representing the pitch motion associated with a finger joint is greater than the predetermined step size for the portion of elements representing the yaw motion associated with a finger joint.

22. The computer system of claim 17, where the data structure includes elements representing a degree of freedom of a wrist joint.

23. The computer system of claim 22, where the elements representing a degree of freedom of a wrist joint includes a portion of elements representing rotation of a wrist joint and a portion of elements representing translation of a wrist joint.

24. The computer system of claim 17, where the keyboard is substantially hand-shaped.

25. The computer system of claim 17, where the keyboard includes a key layout that is shaped like a hand.

26. The computer system of claim 25, where the key layout is configured such that a key approximately corresponds to each movable joint on a hand.

27. A method of forming a pose of a hand or face on a computer system, said method comprising:

providing a model of a hand or face that is configurable about a plurality degrees of freedom, where each respective degree of freedom is associated with a value representing a magnitude of movement from a neutral position;

associating at least one key on a keyboard with each respective degree of freedom of the model; and

in response to the selection of at least one key on the keyboard, identifying the degree of freedom associated with the keyboard selection and adjusting the value associated with the identified degree of freedom by a predetermined step size.

28. The method of claim 27, where in the associating step a single key on the keyboard is associated with each respective degree of freedom.

29. The method of claim 27, where the value associated with the identified degree of freedom is adjusted based on the case of a letter included in the keyboard selection.

30. The method of claim 29, where the value associated with the identified degree of freedom is incremented if the keyboard selection includes a lower case letter.

31. The method of claim 30, where the value associated with the identified degree of freedom is reduced if the keyboard selection includes an upper case letter.

32. The method of claim 27, where each degree of freedom is associated with a respective predetermined step size.

33. The method of claim 27, where the model is configurable about less than 30 degrees of freedom.

34. The method of claim 27, where each respective degree of freedom is associated with a single key on the keyboard.

35. The method of claim 27, further comprising storing the model in a data structure, where the model is represented by an alphanumeric string.

36. The method of claim 35, where the alphanumeric string is less than 100 characters.

37. The method of claim 36, where each letter in the alphanumeric string represents a respective degree of freedom in the model.

38. The method of claim 37, where each letter in the alphanumeric string is associated with a number, the number representing a magnitude of movement of a respective degree of freedom from a neutral position.

39. A computer-readable medium having stored thereon a data structure comprising:

a first element containing first identification data and first position data, where the first identification data associates the first element with a first degree of freedom of a hand and the first position data represents a magnitude of movement of the first degree of freedom from a neutral position; and

a second element containing second identification data and second position data, where the second identification data associates the second element with a second degree of freedom of a hand and the second position data represents a magnitude of movement of the second degree of freedom from a neutral position.

40. The computer-readable medium of claim 39, where the first identification data and the first position data consist of an alphanumeric sequence.

41. The computer-readable medium of claim 39, where the first identification data is a single character.

42. The computer-readable medium of claim 41, where the first identification data is a letter.

43. The computer-readable medium of claim 42, where the first identification data is a lower case letter, the first degree of freedom is directed in a first direction.

44. The computer-readable medium of claim 43, where the first identification data is an upper case letter, the first degree of freedom is directed in a second direction.

45. The computer-readable medium of claim 42, where the first position data is a number.

46. The computer-readable medium of claim 39, further comprising a third element containing third identification data and third position data, where the third identification data associates the third element with third degree of freedom of a face and the third position data represents a magnitude of movement of the third degree of freedom from a neutral position.

47. A computer-readable medium having stored thereon a data structure comprising:

a plurality of keyframes representing an animation of a sign language communication sequence, each respective keyframe containing expression data and animation time data, where the expression data represents a pose of a hand and where the first animation time data represents a length of time for displaying the expression data, and

where each keyframe is an alphanumeric string.

48. The computer-readable medium of claim 47, where each keyframe is less than 100 characters in length.

49. The computer-readable medium of claim 48, where the expression data represents a pose of a facial expression.

50. The computer-readable medium of claim 48, where the expression data of each keyframe consists of an alphanumeric string representing a pose of a facial expression and a pose of at least one hand.

51. The computer-readable medium of claim 48, where the sign language communication sequence relates to a mathematical lesson.

52. A method of controlling a robotic hand, the method comprising:

providing a robotic hand that is drivable about a plurality of degrees of freedom;

associating at least one key on a keyboard with each respective degree of freedom of the robotic hand; and

in response to a selection of at least one key on the keyboard, identifying the respective degree of freedom associated with the keyboard selection and driving the robotic hand about the identified degree of freedom.

53. The method of claim 52, where the identified degree of freedom is driven a predetermined angular step size in response to the keyboard selection.

54. The method of claim 52, further comprising associating at least one key with a grasping movement of the robotic hand.

55. The method of claim 52, further comprising associating at least one key with a release movement of a robotic hand.

56. A method of communicating in a non-verbal manner, the method comprising:

providing a library of sign language animation sequences, where at least one of the sign language animation sequences consists solely of hand gestures and facial expressions;

retrieving a signed language animation sequence from the library; and

displaying the retrieved sign language animation sequence on a display.