Human interface system

• US 7,218,313 B2
• Filed: 10/31/2003
• Issued: 05/15/2007
• Est. Priority Date: 10/31/2003
• Status: Expired due to Fees

• Current Assignee: Aplix IP Holdings Corporation
• Original Assignee: Zeetoo, Inc.
• Inventors: Lee, W. David, Marcus, Beth
• Primary Examiner(s): Osorio; Ricardo
• Application Number:
  US10/699,555
• Publication Number:
  US 20050093846A1
• Time in Patent Office: 1,292 Days
• Field of Search: 345/156, 345/169, 345/173, 345/168, 400/472, 341/22
• US Class Current: 345/169
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 1/169 the I/O peripheral being an integrated pointing device, e.g. trackball in the palm rest area, mini-joystick integrated between keyboard keys, touch pads or touch stripes G06F1/1643 takes precedence; constructional details of pointing devices G06F3/033
• CPC Class Codes: G06F 2203/04809 Textured surface identifying touch areas, e.g. overlay structure for a virtual keyboard
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0202 Constructional details or processes of manufacture of the input device
• CPC Class Codes: G06F 3/0238 Programmable keyboards key guide holders G06F3/0224
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

A human interface configured to optimize a biomechanical effect of a human user'"'"'s opposing thumb and fingers by including, on one surface, one or more software configurable input elements manipulatable by a user'"'"'s thumb(s) or a stylus, and, on another surface, one or more software configurable selection elements manipulatable by a user'"'"'s finger(s). A selection element may be a pressure sensor pad configurable to represent delineated active areas that are mapped to one or more input functions. Shape changing media may be provided to permit a user to tactilely discriminate between delineated active areas. Tactile feedback may be provided to a user through palpable detents, vibratory or force producing units. Inputting data may include mapping each selection element to a shift function, mapping each input element to text functions, and using the selection elements to shift between text functions associated with an input element to input a desired text function.

Claims

1. A hand-held electronic device comprising:

a memory configured to store a plurality of applications, wherein each application is associated with a set of functions;

a processor configured to process a selected one of the plurality of applications;

a first input assembly having a plurality of input elements on a first surface configured to receive input from a human user through manipulation of the plurality of input elements, wherein at least one of the input elements on the first surface is configured to selectively map to one or more input functions of the set of functions associated with the selected one of the plurality of applications;

a second input assembly having one or more input elements on a second surface configured to be manipulated by one or more of the human user'"'"'s fingers, wherein at least one of the input elements on the second surface is further configured to be selectively mapped to one or more input functions of the set of functions corresponding to the selected one of the plurality of applications, further wherein the plurality of input elements on the first surface and the one or more input elements on the second surface are arranged so as to substantially optimize a biomechanical effect of the human user'"'"'s hand; and

wherein at least one of the input elements of the second input assembly is a sensor pad configured to selectively represent a plurality of delineated active areas, wherein manipulation of a delineated active area causes the input function of one or more input elements of the first input assembly to change.

2. The hand-held electronic device of claim 1, further comprising a shape changing media configured relative to the sensor pad so as to permit the human user to tactilely discriminate between the plurality of delineated active areas.

3. The hand-held electronic device of claim 1, wherein the processor receives signals generated by the input elements of first or second input assemblies when manipulated by the human user.

4. The hand-held electronic device of claim 1 further comprising an input controller, wherein the input controller receives signals generated by the input elements of first or second input assemblies when manipulated by the human user and converts the signals into a form suitable to be interpreted by the processor.

5. The hand-held electronic device of claim 1, wherein at least one of the input elements of the second input assembly is a rotary sensor.

6. The hand-held electronic device of claim 1, wherein at least one of the input elements of second input assembly is a D-pad.

7. The hand-held electronic device of claim 1, further comprising at least one palpable detent, wherein the detent is associated with at least one of the input elements of the first or second input assemblies so as to provide tactile feedback to the human user when the human user manipulates the input element associated with the palpable detent.

8. The hand-held electronic device of claim 1 further comprising one or more vibratory or force producing units, at least one of the vibratory or force producing units configured to provide tactile feedback upon the human user'"'"'s manipulation of at least one of the input elements of the first or second input assemblies.

9. The hand-held electronic device of claim 8, wherein at least one of the vibratory units provide tactile feedback in response to events occurring in the selected application running on the processor.

10. The hand-held electronic device of claim 1, wherein the selected one of the plurality of applications is a text application;

and the one or more input elements on the second surface of the second input assembly comprises one or more selection elements, wherein manipulations of the one or more selection elements causes the input elements on the first surface of the first input assembly to be selectively mapped from one text function to another text function.

11. The hand-held electronic device of claim 1, wherein the selected one of the plurality of application is a game application, and at least one of the plurality of input elements of the first input assembly and at least one of the input elements of the second input assembly are each configured to selectively map to one or more game functions.

12. The hand-held electronic device of claim 1, wherein the processor is further configured to be communicatively coupled to a host electronic device.

13. The hand-held electronic device of claim 1, wherein at least one of the input elements of the second input assembly comprises an accelerometer.

14. The hand-held electronic device of claim 1, wherein at least one of the input elements of the second input assembly comprise a gyroscope.

15. A hand-held electronic device comprising:

a memory configured to store a plurality of applications, wherein each application is associated with a set of functions;

a processor configured to process a selected one of the plurality of applications, wherein the set of functions associated with the selected application includes a plurality of text symbol functions and a plurality of shifting functions;

a first surface having a plurality of input elements configured to receive input from a human user through manipulation of the plurality of input elements, wherein at least one of the input elements of the first surface is further configured to selectively map to more than one text symbol function; and

a second surface having one or more input elements, wherein at least one of the input elements of the second surface having one or more selectable active areas configured to be manipulated by one or more of the human user'"'"'s fingers, each selectable active area configured to selectively map to a different shifting function, wherein manipulation of one of the selectable active area causes the text symbol function of the one or more input elements of the first surface to change, further wherein the plurality of input elements of the first surface and the one or more input elements of the second surface are arranged so as to substantially optimize a biomechanical effect of the human user'"'"'s hand.

16. The hand-held electronic device of claim 15 further comprising a controller, wherein the controller receives signals generated by the human user'"'"'s manipulation of the input elements of the first surface or active areas.

17. The hand-held electronic device of claim 16 further comprising a dome cap positioned above at least one input element of the first surface or the second surface and capable of providing tactile feedback to the human user when the input element associated with the dome cap is manipulated.

18. The hand-held electronic device of claim 16 further comprising one or more vibratory units capable of providing tactile feedback.

19. The hand-held electronic device of claim 16 further comprising one or more force producing units capable of providing tactile feedback.

20. The hand-held electronic device of claim 15, wherein the processor is further configured to be communicatively coupled to a host electronic device.

21. A method for configuring a human interface and input system for use with a hand-held electronic device configured to run a plurality of applications, each application associated with a set of functions, the method comprising:

disposing on a first surface a first input assembly having a plurality of input elements configured to receive input from a human user through manipulation of the plurality of input elements, wherein at least one of the input elements of the first input assembly is further configured to map to more than one input function associated with a selected one of the plurality of applications;

disposing on a second surface a second input assembly having one or more input elements configured to be manipulated by one or more of the human user'"'"'s fingers, wherein at least one of the input elements of the second input assembly is further configured to selectively map to one or more input functions associated with the selected application; and

arranging the plurality of input elements of the first input assembly and the one or more input elements of the second input assembly to substantially optimize a biomechanical effect of the human user'"'"'s hand.

22. The method of claim 21 further comprising:

physically or electronically labeling at least one input element of the first input assembly or the second input assembly so as to visually indicate an input function that can be selectively accessed by actuating the input element.

23. The method of claim 21 further comprising connecting a controller to the input elements of the first input assembly or the second input assembly, wherein the controller is configured to receive signals generated by a manipulation of one or more of the input elements of first input assembly or the second input assembly.

24. The method of claim 23, wherein at least one input element of second input assembly having a plurality of active areas configurable by the controller to form a plurality of delineated active areas.

25. The method of claim 24 further comprising positioning a shape changing media relative to the one input element of second input assembly having a plurality of active areas so as to permit the human user to tactilely discriminate between the plurality of delineated active areas.

26. The method of claim 23, wherein the controller is further configured to be communicatively coupled to a host electronic device.

27. The method of claim 21 further comprising positioning a palpable detent with at least one input element of the first input assembly or the second input assembly so as to provide tactile feedback when manipulated by the human user.

28. The method of claim 21 further comprising disposing on one or more surfaces a second input assembly having one or more input elements configured to be manipulated by one or more of the human user'"'"'s fingers, wherein at least one of the input elements of the second input assembly comprises an accelerometer.

29. The method of claim 21 further comprising disposing on one or more surfaces a second input assembly having one or more input elements configured to be manipulated by one or more of the human user'"'"'s fingers, wherein at least one of the input elements of the second input assembly comprises a gyroscope.

30. A method for inputting data on a hand-held electronic device having a first surface with a plurality of input elements configured to receive input from a human user through manipulation of the plurality of input elements, wherein at least one of the input elements is further configured to map to a plurality of symbols in a data input mode, wherein each of the plurality of symbols is associated with a unique index position identifier, and a second surface having one or more selection elements configured to be manipulated by one or more of the human user'"'"'s fingers, wherein each selection element corresponds to one of the unique index position identifiers, further wherein the plurality of input elements and the one or more selection elements are arranged to substantially optimize a biomechanical effect of the human user'"'"'s hand, the method comprising:

executing a selected application from a plurality of applications, wherein the selected application is associated with a set of functions

determining the index position identifier of a desired symbol to be inputted based on the functions associated with the selected application;

pressing the selection element corresponding to the index position identifier of the desired symbol with any digit or object held in the human user'"'"'s hand; and

pressing the input element configured to map to the desired symbol with any digit or object held in the human user'"'"'s hand. (page 14, lines 2–

27).

31. The method of claim 30, wherein each input element is physically or electronically labeled indicating each symbol that is mapped to the input element and a positional order in which each symbol can be selectively accessed by actuating the input element.

32. The method of claim 30, wherein determining the index position identifier of the desired character to be inputted comprises:

locating the input element configured to map to the desired symbol; and

counting from left to right the number of symbols preceding the desired symbol labeled on the located input element, wherein the index position identifier of the desired symbol is the number of symbols preceding the desired symbol plus one.

33. The method of claim 30, wherein at least one of the input elements or selection elements is further configured to map to a plurality of modes corresponding to the selected application executing on the hand-held electronic device, at least one of the modes is the data input mode, the method further comprising enabling the data input mode.

34. The method of claim 30, wherein the hand-held electronic device is further configured to be communicatively coupled to a host electronic device.

35. A method for a human user to input data on a hand-held electronic device using an interface and input system comprising a plurality of input elements in a thumb-manipulated assembly to substantially optimize a biomechanical effect of the human user'"'"'s thumb and fingers, wherein at least one input element is mapped to more than one text function, and one or more selection elements in a finger-manipulated input assembly, wherein each selection element is mapped to a unique shift position, the method comprising:

executing a selected text application from a plurality of applications, wherein the selected application is associated with a set of functions

pressing a desired selection element of the finger-manipulated input assembly with a human a finger to select a desired shift position the selected text application; and

pressing a desired input element of the thumb-manipulated input assembly with a human thumb to input a desired text character.

36. The method of claim 35, wherein the hand-held electronic device is further configured to interface with a host electronic device.

37. A hand-held electronic device comprising:

a memory configured to store a plurality of applications, wherein each application is associated with a set of functions;

a processor configured to process a selected one of the plurality of applications;

a first input assembly disposed on a first surface of the electronic device, wherein the first input assembly comprises a plurality of input elements configured to be actuated by a human user'"'"'s hand, wherein at least one of the input elements of the first input assembly is configured to map to one or more input functions of the set of functions associated with the selected one of the plurality of applications; and

a second input assembly disposed on a so as to substantially optimize a biomechanical effect of the human user'"'"'s hand, wherein the second input assembly comprises one or more input elements configured to be manipulated by one or more of the human user'"'"'s fingers, wherein at least one of the input elements of the second input assembly is a selectively configurable sensing surface so as to provide a plurality of delineated active areas, further wherein one or more of the delineated active areas is mapped to one or more functions associated with the selected application, further wherein the memory is further configured to store for each application a mapping of the selectively configurable sensing surface to the plurality of delineated active areas.

38. The hand-held electronic device of claim 37, further comprising:

an input controller, wherein the input controller receives a plurality of signals generated by the input elements of the first input assembly and the second input assembly when manipulated by the human user, and converts the plurality of signals into a form suitable to be interpreted by the processor.

39. The hand-held electronic device of claim 38, wherein at least one input element of the first input assembly or the second input assembly is configured to map to one or more input functions associated with the selected application that control a cursor on a screen.

40. The hand-held electronic device of claim 38, wherein the selected one of the plurality of applications is a game application.

41. The hand-held electronic device of claim 40, wherein at least one input element of the first input assembly or the second input assembly is configured to map to one or more input functions associated with the game application that control a game character on a screen.

42. The hand-held electronic device of claim 40, wherein the input controller is further configured to interpret a movement of the human user'"'"'s finger sliding across two or more delineated active areas as a change in the mapped function of the two or more delineated active areas, wherein the mapped function is at least one of a speed control, a size control, a weapon fire control, and a position control. (page 16, lines 4–

30).

43. The hand-held electronic device of claim 40, wherein the input controller is further configured to interpret a pressure applied by the human user'"'"'s finger on a selected one of the delineated active areas as a change in the mapped function of the selected delineated active area, wherein the mapped function is at least one of a speed control, a size control, a weapon fire, and position control. (page 16, lines 4–

30).

44. The hand-held electronic device of claim 40, wherein at least one of the functions mapped to the input element of the first input assembly is a game function that is substantially optimized for actuation by the human user'"'"'s thumb.

45. The hand-held electronic device of claim 44, wherein the game function that is substantially optimized for actuation by the human user'"'"'s thumbs comprises a directional control.

46. The hand-held electronic device of claim 40, wherein at least one of the functions mapped to the delineated active areas is a game function that is substantially optimized for actuation by one or more of the human user'"'"'s fingers.

47. The hand-held electronic device of claim 46, wherein the game function that is substantially optimized for actuation by one or more of the human user'"'"'s fingers comprises a weapon fire control.

48. The hand-held electronic device of claim 46, wherein the game function that is substantially optimized for actuation by one or more of the human user'"'"'s fingers comprises a game character jump control.

49. The hand-held electronic device of claim 37, wherein the processor is further configured to interface with a host electronic device.

50. The hand-held electronic device of claim 37, wherein at least one of the input elements of the second input assembly comprises an accelerometer.

51. The hand-held electronic device of claim 37, wherein at least one of the input elements of the second input assembly comprise a gyroscope.

52. A method for configuring a human interface and input system for use with a hand-held electronic device configured to run a plurality of applications, each application associated with a set of functions, the method comprising:

disposing on a first surface a first input assembly having a plurality of input elements configured to receive input from a human user'"'"'s hand through manipulation of the plurality of input elements, wherein at least one of the input elements of the first input assembly is further configured to map to more than one input function associated with a selected one of the plurality of applications;

disposing on a second surface a second input assembly having one or more input elements configured to be manipulated by one or more of the human user'"'"'s fingers, wherein at least one of the input elements of the second input assembly is further configured to selectively map to one or more input functions associated with the selected application; and

mapping the set of functions of the selected application to the one or more input elements of the first input assembly and the second input assembly to substantially optimize a biomechanical effect of the human user'"'"'s hand.

53. The method of claim 52, wherein the selected application is at least one of a scrolling application, a text application and a game application.

54. The method of claim 53 further comprising:

physically or electronically labeling at least one input element of the first input assembly or the second input assembly so as to visually indicate an input function that can be selectively accessed by actuating the input element.

55. The method of claim 53 further comprising connecting a controller to the input elements of the first input assembly or the second input assembly, wherein the controller is configured to receive signals generated by a manipulation of one or more of the input elements of first input assembly or the second input assembly.

56. The method of claim 55, wherein at least one input element of second input assembly having a plurality of active areas configurable by the controller to form a plurality of delineated active areas.

57. The method of claim 56 further comprising positioning a shape changing media relative to the one input element of second input assembly having a plurality of active areas so as to permit the human user to tactilely discriminate between the plurality of delineated active areas.

58. The method of claim 52, wherein the hand-held electronic device is configured to interface with a host electronic device.

59. The method of claim 52 further comprising disposing on one or more surfaces a second input assembly having one or more input elements configured to be manipulated by one or more of the human user'"'"'s fingers, wherein at least one of the input elements of the second input assembly comprises an accelerometer.

60. The method of claim 52 further comprising disposing on one or more surfaces a second input assembly having one or more input elements configured to be manipulated by one or more of the human user'"'"'s fingers, wherein at least one of the input elements of the second input assembly comprises a gyroscope.