Force feedback computer input and output device with coordinated haptic elements

• US 6,819,312 B2
• Filed: 11/01/2001
• Issued: 11/16/2004
• Est. Priority Date: 07/21/1999
• Status: Expired

• Current Assignee: Apple Inc.
• Original Assignee: Tactiva Incorporated
• Inventors: Fish, Daniel E.
• Primary Examiner(s): AWAD, AMR A
• Application Number:
  US10/003,505
• Publication Number:
  US 20020044132A1
• Time in Patent Office: 1,111 Days
• Field of Search: 345/156, 345/161, 345/157, 345/158, 345/163, 345/173-179
• US Class Current: 345/156
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user

Abstract

A set of haptic elements (haptels) are arranged in a grid. Each haptel is a haptic feedback device with linear motion and a touchable surface substantially perpendicular to the direction of motion. In a preferred embodiment, each haptel has a position sensor which measures the vertical position of the surface within its range of travel, a linear actuator which provides a controllable vertical bi-directional feedback force, and a touch location sensor on the touchable surface. All haptels have their sensors and effectors interfaced to a control processor. The touch location sensor readings are processed and sent to a computer, which returns the type of haptic response to use for each touch in progress. The control processor reads the position sensors, derives velocity, acceleration, net force and applied force measurements, and computes the desired force response for each haptel. The haptels are coordinated such that force feedback for a single touch is distributed across all haptels involved. This enables the feel of the haptic response to be independent of where touch is located and how many haptels are involved in the touch. As a touch moves across the device, haptels are added and removed from the coordination set such that the user experiences an uninterrupted haptic effect. Because the touch surface is comprised of a multiple haptels, the device can provide multiple simultaneous interactions, limited only by the size of the surface and the number of haptels. The size of the haptels determines the minimum distance between independent touches on the surface, but otherwise does not affect the properties of the device. Thus, the device is a pointing device for graphical user interfaces which provides dynamic haptic feedback under application control for multiple simultaneous interactions.

Claims

1. An input/output device comprising:

a plurality of haptic elements, wherein

each one of said haptic elements comprises a contact surface,

said contact surfaces define a surface, and

each haptic element of said haptic elements is configured to provide a haptic effect at a contact surface of said each haptic element upon said contact surface of said each haptic element being touched;

a plurality of sensors, wherein

each one of said sensors is coupled to a contact surface of a corresponding one of said haptic elements, and

each one of said sensors is configured to generate information upon said contact surface of said corresponding one of said haptic elements being touched; and

a processor, wherein

said processor is coupled to said sensors and said haptic elements, and

said processor is configured to control said haptic effect produced by at least one of said haptic elements based on information received from a sensor of said sensors coupled to said at least one of said haptic elements.

2. The input/output device of claim 1, wherein said sensor is further configured to generate information based upon a proximity of a pointing device to said contact surface.

3. The input/output device of claim 1, wherein said sensor is a resistive film sensor.

4. The input/output device of claim 1, wherein said sensor is a capacitive proximity sensor.

5. The input/output device of claim 1, wherein

said processor is configured to control a haptic effect produced by certain ones of said haptic elements based on information received from ones of said sensors corresponding to said certain ones of said haptic elements, and

said certain ones of said haptic elements are ones of said haptic elements being touched.

6. The input/output device of claim 5, wherein said processor is further configured to cause contiguous haptic elements of said certain ones of said plurality of haptic elements to collectively produce the haptic effect.

7. The input/output device of claim 5, wherein said processor is configured to cause contiguous haptic elements of said certain ones of said plurality of haptic elements to collectively produce the haptic effect by virtue of being configured to calculate a weighted average of a force experienced by each one of said contiguous haptic elements.

8. The input/output device of claim 5, wherein new haptic elements of said plurality of haptic elements are added to a set of haptic elements in response to said new haptic elements also being touched and old haptic elements in said set of haptic elements are removed from said set of haptic elements in response to said old haptic elements no longer being touched, wherein said set of haptic elements represents said contiguous haptic elements.

9. The input/output device of claim 1, further comprising:

a display, coupled to said plurality of haptic elements, wherein

said each one of said plurality of haptic elements correspond to one of a plurality of areas displayed on said display, and

said haptic effect provided by said at least one of said plurality of haptic elements is related to a one of said plurality of areas displayed on said display corresponding to said at least one of said plurality of haptic elements.

10. The input/output device of claim 1, wherein

said at least one of said plurality of haptic elements corresponds to one of a plurality of areas displayed on a display;

and

said haptic effect produced by said at least one of said plurality of haptic elements is related to information displayed in said one of said plurality of areas.

11. The input/output device of claim 1, wherein certain ones of said plurality of haptic elements are configured to produced a haptic response at a respective contact surface of said certain ones of said plurality of haptic elements in response to said respective contact surface of said certain ones of said plurality of haptic elements being touched.

12. The input/output device of claim 11, wherein each one of said certain ones of said plurality of haptic elements is configured to provide concurrent input and output when touched concurrently.

13. The input/output device of claim 11, wherein said certain ones of said plurality of haptic elements are configured to provide input from and output to concurrent touches in a plurality of locations.

14. The input/output device of claim 11, wherein each one of said certain ones of said plurality of haptic elements further comprise an actuator coupled to a corresponding contact surface and configured to provide force feedback to said corresponding contact surface.

15. The input/output device of claim 14, wherein said actuator comprises a linear electromagnetic actuator, wherein said contact surface is coupled to said linear electromagnetic actuator.

16. The input/output device of claim 15, wherein said actuator further comprises a spring, wherein said spring is coupled to said contact surface to maintain said actuator in an extended position when said contact surface is not being touched.

17. The input/output device of claim 14, wherein said each one of said plurality of haptic elements further comprises a force sensor coupled between said contact surface and said actuator.

18. The input/output device of claim 17, wherein said force sensor is a piezoelectric force sensor.

19. The input/output device of claim 11, wherein said certain ones of said plurality of haptic elements are further configured to produce a given haptic effect in a cooperative manner.

20. The input/output device of claim 1, wherein said input/output device is included in a computer system.

21. An input/output device comprising:

a plurality of haptic elements, wherein

each one of said haptic elements comprises a contact surface,

said contact surfaces define a surface, and

each haptic element of said haptic elements is configured to provide a haptic effect at the contact surface of said each haptic element upon said contact surface of said each haptic element being touched;

a plurality of sensors, wherein

each one of said sensors includes said contact surface of a corresponding one of said haptic elements, and

each one of said sensors is configured to generate information when said contact surface included in said corresponding one of said haptic elements is touched; and

a processor, coupled to said sensors and said haptic elements.

22. The input/output device of claim 21, wherein a sensor of said sensors is further configured to generate information based upon a proximity of a pointing device to said contact surface.

23. The input/output device of claim 21, wherein a sensor of said sensors is a resistive film sensor.

24. The input/output device of claim 23, wherein said resistive film sensor is a four wire resistive film touch sensor.

25. The input/output device of claim 21, wherein

said processor is configured to control a haptic effect produced by certain ones of said haptic elements based on information received from ones of said sensors corresponding to said certain ones of said haptic elements, and

said certain ones of said haptic elements are ones of said haptic elements being touched.

26. The input/output device of claim 25, wherein said processor is further configured to cause contiguous haptic elements of said certain ones of said plurality of haptic elements to collectively produce the haptic effect.

27. The input/output device of claim 25, wherein said processor is configured to cause contiguous haptic elements of said certain ones of said plurality of haptic elements to collectively produce the haptic effect by virtue of being configured to calculate a weighted average of a force experienced by each one of said contiguous haptic elements.

28. The input/output device of claim 25, wherein new haptic elements of said plurality of haptic elements are added to a set of haptic elements in response to said new haptic elements also being touched and old haptic elements in said set of haptic elements are removed from said set of haptic elements in response to said old haptic elements no longer being touched, wherein said set of haptic elements represents said contiguous haptic elements.

29. The input/output device of claim 21, further comprising:

a display, coupled to said plurality of haptic elements, wherein

said each one of said plurality of haptic elements correspond to one of a plurality of areas displayed on said display; and

said haptic effect provided by at least one of said plurality of haptic elements is related to a one of said plurality of areas displayed on said display corresponding to said at least one of said plurality of haptic elements.

30. The input/output device of claim 21, wherein certain ones of said plurality of haptic elements are configured to produced a haptic response at the respective contact surface included in said certain ones of said plurality of haptic elements in response to said respective contact surface of said certain ones of said plurality of haptic elements being touched.

31. The input/output device of claim 30, wherein each one of said certain ones of said plurality of haptic elements is configured to provide concurrent input and output when touched concurrently.

32. The input/output device of claim 30, wherein said certain ones of said plurality of haptic elements are configured to provide input from and output to concurrent touches in a plurality of locations.

33. The input/output device of claim 30, wherein each one of said certain ones of said plurality of haptic elements further comprise an actuator coupled to a corresponding contact surface of the actuator and configured to provide force feedback to said corresponding contact surface of the actuator.

34. The input/output device of claim 33, wherein said actuator comprises a linear electromagnetic actuator, wherein said contact surface of the actuator is coupled to said linear electromagnetic actuator.

35. The input/output device of claim 34, wherein said actuator further comprises a spring, wherein said spring is coupled to said contact surface of the actuator to maintain said actuator in an extended position when said contact surface of the actuator is not being touched.

36. The input/output device of claim 33, wherein said each one of said plurality of haptic elements further comprises a force sensor coupled between said contact surface of the actuator and said actuator.

37. The input/output device of claim 36, wherein said force sensor is a piezoelectric force sensor.

38. The input/output device of claim 30, wherein said certain ones of said plurality of haptic elements are further configured to produce a given haptic effect in a cooperative manner.

39. The input/output device of claim 30, wherein said certain ones of said plurality of haptic elements produce a given haptic effect in a cooperative manner by summing forces on ones of said certain ones of said plurality of haptic elements being touched, taking a weighted average of positions of said ones of said certain ones of said plurality of haptic elements being touched, and combining this information in order to determine a desired feedback force for each one of said ones of said certain ones of said plurality of haptic elements being touched.

40. The input/output device of claim 21, wherein said input/output device is included in a computer system.

41. An input/output device comprising:

a plurality of haptic elements, wherein

each one of said plurality of haptic elements comprises a contact surface,

said contact surfaces define a surface, and

each haptic element of said plurality of haptic elements is configured to provide a haptic effect at the contact surface of said each haptic element upon said contact surface of said each haptic element being touched;

a plurality of sensors, wherein

each one of said plurality of sensors includes said contact surface of a corresponding one of said plurality of haptic elements,

each one of said plurality of sensors is configured to generate information when said contact surface coupled to said corresponding one of said plurality of haptic elements is touched, and

a sensor of said sensors is selectable from a plurality of sensors configured to measure at least one of touch, position and motion; and

a processor, coupled to said plurality of sensors and said plurality of haptic elements.

42. The input/output device of claim 41, wherein said sensor is further configured to generate information based upon a proximity of a pointing device to said contact surface.

43. The input/output device of claim 41, wherein said sensor is a resistive film sensor.

44. The input/output device of claim 43, wherein said resistive film sensor is a four wire resistive film touch sensor.

45. The input/output device of claim 41, wherein

said processor is configured to control a haptic effect produced by certain ones of said plurality of haptic elements based on information received from ones of said plurality of sensors corresponding to said certain ones of said plurality of haptic elements, and

said certain ones of said plurality of haptic elements are ones of said plurality of haptic elements being touched.

46. The input/output device of claim 45, wherein said processor is further configured to cause contiguous haptic elements of said certain ones of said plurality of haptic elements to collectively produce the haptic effect.

47. The input/output device of claim 46, wherein new haptic elements of said plurality of haptic elements are added to a set of haptic elements in response to said new haptic elements also being touched and old haptic elements in said set of haptic elements are removed from said set of haptic elements in response to said old haptic elements no longer being touched, wherein said set of haptic elements represents said contiguous haptic elements.

48. The input/output device of claim 45, wherein said processor is configured to cause contiguous haptic elements of said certain ones of said plurality of haptic elements to collectively produce the haptic effect by virtue of being configured to calculate a weighted average of a force experienced by each one of said contiguous haptic elements.

49. The input/output device of claim 41, further comprising:

a display, coupled to said plurality of haptic elements, wherein

said each one of said plurality of haptic elements correspond to one of a plurality of areas displayed on said display, and

said haptic effect provided by at least one of said plurality of haptic elements is related to a one of said plurality of areas displayed on said display corresponding to said at least one of said plurality of haptic elements.

50. The input/output device of claim 41, wherein certain ones of said plurality of haptic elements are configured to produced a haptic response at the respective contact surface coupled to said certain ones of said plurality of haptic elements in response to said respective contact surface of said certain ones of said plurality of haptic elements being touched.

51. The input/output device of claim 50, wherein each one of said certain ones of said plurality of haptic elements is configured to provide concurrent input and output when touched concurrently.

52. The input/output device of claim 50, wherein said certain ones of said plurality of haptic elements are configured to provide input from and output to concurrent touches in a plurality of locations.

53. The input/output device of claim 50, wherein each one of said certain ones of said plurality of haptic elements further comprise an actuator coupled to a corresponding contact surface of the actuator and configured to provide force feedback to said corresponding contact surface of the actuator.

54. The input/output device of claim 53, wherein said actuator comprises a linear electromagnetic actuator, wherein said contact surface of the actuator is coupled to said linear electromagnetic actuator.

55. The input/output device of claim 54, wherein said actuator further comprises a spring, wherein said spring is coupled to said contact surface of the actuator to maintain said actuator in an extended position when said contact surface of the actuator is not being touched.

56. The input/output device of claim 53, wherein said each one of said plurality of haptic elements further comprises a force sensor coupled between said contact surface of the actuator and said actuator.

57. The input/output device of claim 56, wherein said force sensor is a piezoelectric force sensor.

58. The input/output device of claim 50, wherein said certain ones of said plurality of haptic elements are further configured to produce a given haptic effect in a cooperative manner.

59. The input/output device of claim 50, wherein said certain ones of said plurality of haptic elements produce a given haptic effect in a cooperative manner by summing forces on ones of said certain ones of said plurality of haptic elements being touched, taking a weighted average of positions of said ones of said certain ones of said plurality of haptic elements being touched, and combining this information in order to determine a desired feedback force for each one of said ones of said certain ones of said plurality of haptic elements being touched.

60. The input/output device of claim 41, wherein said input/output device is included in a computer system.

61. A method of communicating information to and from an input/output device having a plurality of haptic elements, the method comprising:

reading information from a sensor coupled to a contact surface of at least one of the plurality of haptic elements, wherein

each one of said plurality of haptic elements comprises a contact surface,

said contact surfaces define a surface,

said sensor is selectable from a plurality of sensors configured to measure at least one of touch, position and motion, and

said information represents measurement of said at least one of touch, position and motion;

causing said at least one of said plurality of haptic elements to produce a haptic effect in response to reading the information, wherein

each haptic element of said plurality of haptic elements is configured to produce the haptic effect at a contact surface of said haptic element in response to said contact surface of said haptic element being touched and each contact surface has said sensor coupled thereto;

sensing the touch on a contact surface of certain ones of said plurality of haptic elements using corresponding ones of said sensors;

generating information corresponding to said certain ones of said plurality of haptic elements based on said touch; and

controlling said haptic effect provided by said certain ones of said plurality of haptic elements based on said information.

62. The method of claim 61, further comprising:

displaying information in a plurality of areas displayed on a display, wherein each one of said plurality of haptic elements corresponds to one of said plurality of areas.

63. The method of claim 62, wherein said each one of said plurality of haptic elements further comprises an actuator coupled to said contact surface of said each one of said plurality of haptic elements, the method further comprising:

applying force to said contact surface of said each one of said plurality of haptic elements, using said actuator of said each one of said plurality of haptic elements, based on information displayed in a corresponding one of said plurality of areas displayed on said display.

64. The method of claim 61, further comprising:

sensing the touch on said contact surface of said at least one of said plurality of haptic elements using a touch sensor coupled to said contact surface of said at least one of said plurality of haptic elements;

generating information based on said contact surface being touched; and

controlling said haptic effect produced by said at least one of said plurality of haptic elements based on information received from said touch sensor.

65. The method of claim 61, further comprising:

causing said certain ones of said plurality of haptic elements to produce a coordinated haptic effect regardless of a distribution of force of said touch among said certain ones of said plurality of haptic elements.

66. An input/output device comprising:

a plurality of haptic elements, wherein

each one of said plurality of haptic elements comprises

an input, the input being generated by a sensor included in each one of said plurality of haptic elements, the sensor being coupled to a contact surface of said haptic element, and

an output, the output being a feedback transferred to the contact surface in response to the input, and

each haptic element of said plurality of haptic elements is configured to provide a haptic effect at a contact surface of said each haptic element upon said contact surface of said each haptic element being touched;

a plurality of sensors, wherein

said sensor is a one of said plurality of sensors,

each one of said plurality of sensors is coupled to a contact surface of a corresponding one of said plurality of haptic elements, and

each one of said plurality of sensors is configured to generate information upon said contact surface of said corresponding one of said plurality of haptic elements being touched; and

a processor is coupled to said plurality of sensors and said plurality of haptic elements.

67. The input/output device of claim 66, wherein:

said sensor is selectable from a plurality of sensors configured to measure at least one of touch, position and motion.

68. The input/output device of claim 66, wherein said sensor is further configured to generate information based upon a proximity of a pointing device to said contact surface.

69. The input/output device of claim 66, wherein said sensor is a resistive film sensor.

70. The input/output device of claim 66, wherein said sensor is a capacitive proximity sensor.

71. The input/output device of claim 66, wherein

said processor is configured to control a haptic effect produced by certain ones of said plurality of haptic elements based on information received from ones of said plurality of sensors corresponding to said certain ones of said plurality of haptic elements, and

said certain ones of said plurality of haptic elements are ones of said plurality of haptic elements being touched.

72. The input/output device of claim 71, wherein said processor is further configured to cause contiguous haptic elements of said certain ones of said plurality of haptic elements to collectively produce the haptic effect.

73. The input/output device of claim 72, wherein new haptic elements of said plurality of haptic elements are added to a set of haptic elements in response to said new haptic elements also being touched and old haptic elements in said set of haptic elements are removed from said set of haptic elements in response to said old haptic elements no longer being touched, wherein said set of haptic elements represents said contiguous haptic elements.

74. The input/output device of claim 71, wherein said processor is configured to cause contiguous haptic elements of said certain ones of said plurality of haptic elements to collectively produce the haptic effect by virtue of being configured to calculate a weighted average of a force experienced by each one of said contiguous haptic elements.

75. The input/output device of claim 66, further comprising:

a display, coupled to said plurality of haptic elements, wherein

said each one of said plurality of haptic elements correspond to one of a plurality of areas displayed on said display, and

said haptic effect provided by at least one of said plurality of haptic elements is related to a one of said plurality of areas displayed on said display corresponding to said at least one of said plurality of haptic elements.

76. The input/output device of claim 66, wherein certain ones of said plurality of haptic elements are configured to produced a haptic response at a respective contact surface of said certain ones of said plurality of haptic elements in response to said respective contact surface of said certain ones of said plurality of haptic elements being touched.

77. The input/output device of claim 76, wherein each one of said certain ones of said plurality of haptic elements is configured to provide concurrent input and output when touched concurrently.

78. The input/output device of claim 76, wherein said certain ones of said plurality of haptic elements are configured to provide input from and output to concurrent touches in a plurality of locations.

79. The input/output device of claim 76, wherein each one of said certain ones of said plurality of haptic elements further comprise an actuator coupled to a corresponding contact surface and configured to provide force feedback to said corresponding contact surface.

80. The input/output device of claim 79, wherein said actuator comprises a linear electromagnetic actuator, wherein said contact surface is coupled to said linear electromagnetic actuator.

81. The input/output device of claim 79, wherein said actuator further comprises a spring, wherein said spring is coupled to said contact surface to maintain said actuator in an extended position when said contact surface is not being touched.

82. The input/output device of claim 79, wherein said each one of said plurality of haptic elements further comprises a force sensor coupled between said contact surface and said actuator.

83. The input/output device of claim 82, wherein said force sensor is a piezoelectric force sensor.

84. The input/output device of claim 76, wherein said certain ones of said plurality of haptic elements produce a given haptic effect in a cooperative manner by summing forces on ones of said certain ones of said plurality of haptic elements being touched, taking a weighted average of positions of said ones of said certain ones of said plurality of haptic elements being touched, and combining this information in order to determine a desired feedback force for each one of said ones of said certain ones of said plurality of haptic elements being touched.

85. The input/output device of claim 66, wherein said certain ones of said plurality of haptic elements are further configured to produce a given haptic effect in a cooperative manner.

86. The input/output device of claim 66, wherein said input/output device is included in a computer system.

87. A method of operating a plurality of haptic elements, the method comprising:

touching a contact surface of at least one of the plurality of haptic elements, each of the plurality of haptic elements comprising an input and an output;

sensing the touch by a sensor to generate the input to said at least one of the plurality of haptic elements;

preparing a feedback in response to the input;

transferring the feedback to the contact surface as the output, wherein

each haptic element of said plurality of haptic elements is configured to produce the haptic effect at a contact surface of said haptic element in response to said contact surface of said haptic element being touched and each contact surface has said sensor coupled thereto;

sensing the touch on a contact surface of certain ones of said plurality of haptic elements using corresponding ones of said sensors;

generating information corresponding to said certain ones of said plurality of haptic elements based on said touch; and

preparing said feedback for each of said certain ones of said plurality of haptic elements based on said information.

88. The method of claim 87, further comprising:

displaying information represented by the input in a plurality of areas displayed on a display, wherein each one of said plurality of haptic elements corresponds to one of said plurality of areas.

89. The method of claim 87, wherein said at least one of said plurality of haptic elements further comprises an actuator coupled to said contact surface, the method further comprising:

applying force representing the output to said contact surface of said at least one of said plurality of haptic elements, using said actuator of said at least one of said plurality of haptic elements, based on information displayed in a corresponding one of said plurality of areas displayed on said display.

90. The method of claim 87, preparing the feedback further comprises:

reading information representing the input;

generating the information based on said contact surface being touched; and

controlling the feedback prepared based on the information received from said touch sensor.

91. The method of claim 87, further comprising:

causing said certain ones of said plurality of haptic elements to produce a coordinated haptic effect regardless of a distribution of force of said touch among said certain ones of said plurality of haptic elements.

92. An input/output device comprising:

a plurality of haptic elements, wherein

each one of said plurality of haptic elements comprises a contact surface,

said contact surfaces define a surface, and

at least one of said plurality of haptic elements is configured to produce a haptic effect at a contact surface of said at least one of said plurality of haptic elements;

a sensor, wherein

said sensor is coupled to said contact surface of said at least one of said plurality of haptic elements,

said sensor is configured to generate information in response to said contact surface being touched, and

said at least one of said plurality of haptic elements is configured to produce said haptic effect based on said information; and

a processor, coupled to said sensor and said at least one of said plurality of haptic elements, wherein

said processor is configured to control said haptic effect produced by said at least one of said plurality of haptic elements based on information received from said sensor,

certain ones of said plurality of haptic elements are configured to produced a haptic response at a respective contact surface of said certain ones of said plurality of haptic elements in response to said respective contact surface of said certain ones of said plurality of haptic elements being touched, and

said certain ones of said plurality of haptic elements produce a given haptic effect in a cooperative manner by summing forces on ones of said certain ones of said plurality of haptic elements being touched, taking a weighted average of positions of said ones of said certain ones of said plurality of haptic elements being touched, and combining this information in order to determine a desired feedback force for each one of said ones of said certain ones of said plurality of haptic elements being touched.

93. An input/output device comprising:

a plurality of haptic elements, wherein

each one of said plurality of haptic elements comprises a contact surface,

said contact surfaces define a surface, and

at least one of said plurality of haptic elements is configured to produce a haptic effect at a contact surface of said at least one of said plurality of haptic elements; and

a sensor, wherein

said sensor includes said contact surface of said at least one of said plurality of haptic elements,

said sensor is configured to generate information in response to said contact surface being touched,

said at least one of said plurality of haptic elements is configured to produce said haptic effect based on said information,

said at least one of said plurality of haptic elements corresponds to one of a plurality of areas displayed on a display, and

said haptic effect produced by said at least one of said plurality of haptic elements is related to information displayed in said one of said plurality of areas.

94. An input/output device comprising:

a plurality of haptic elements, wherein

each one of said plurality of haptic elements comprises a contact surface,

said contact surfaces define a surface, and

at least one of said plurality of haptic elements is configured to produce a haptic effect at a contact surface of said at least one of said plurality of haptic elements; and

a sensor, wherein

said sensor is coupled to said contact surface of said at least one of said plurality of haptic elements,

said sensor is selectable from a plurality of sensors configured to measure at least one of touch, position and motion,

said sensor is configured to generate information in response to said contact surface being touched,

said at least one of said plurality of haptic elements is configured to produce said haptic effect based on said information,

said at least one of said plurality of haptic elements corresponds to one of a plurality of areas displayed on a display, and

said haptic effect produced by said at least one of said plurality of haptic elements is related to information displayed in said one of said plurality of areas.

95. An input/output device comprising:

a plurality of haptic elements, wherein

each one of said plurality of haptic elements comprises;

an input, the input being generated by a sensor included in each one of said plurality of haptic elements, the sensor being coupled to a contact surface of said haptic element;

an output, the output being a feedback transferred to the contact surface in response to the input,

said at least one of said plurality of haptic elements corresponds to one of a plurality of areas displayed on a display, and

said haptic effect produced by said at least one of said plurality of haptic elements is related to information displayed in said one of said plurality of areas.