Interactive Tangible Interface for Hand Motion

• US 20150054633A1
• Filed: 08/22/2014
• Published: 02/26/2015
• Est. Priority Date: 08/23/2013
• Status: Abandoned Application

• Current Assignee: New York University
• Original Assignee: New York University
• Inventors: Saddik, Abdulmotaleb El, Karime, Ali, Giakoumidis, Nikolaos
• Application Number:
  US14/466,383
• Publication Number:
  US 20150054633A1
• Time in Patent Office: Days
• US Class Current: 340/407.1
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

Abstract

Methods, systems, and apparatuses, including computer programs encoded on computer-readable media are disclosed, for receiving, from an inertial measurement unit (IMU) the motion information of an interactive digital stress ball device and from the force detection sensors the pressure information exerted on each of the sensors attached on the ball surface. A haptic actuator and a haptic simulator are used to generate haptic feedback. The sensory analog signals are converted to digital signals and feed into the kinematic computation to calculate performance metrics. Sensory data is transmitted wirelessly to other digital entities. The interactive digital stress ball can also receive digital commands through wireless communication for the generation of the haptic feedback. The electronically embedded stress ball is able to track the motion of the hand and wirelessly transmit a set of kinematics that can be used to control computer games and other peripheral devices.

Claims

1. A haptic device comprising:

a housing configured conform to a user'"'"'s hand; and

at least one force sensor configured to measure the pressure exerted by at least one figure of a user'"'"'s hand on the exterior portion of the housing;

a microcontroller disposed within the housing and in communication with;

an inertial measurement unit (IMU) disposed within the ball configured to detect motion of the housing; and

a haptic actuator for providing a haptic feedback; and

a wireless communication module for transmitting and receiving data to and from other peripheral devices.

2. The system of claim 1, wherein the housing is an elastic ball.

3. The system of claim 2, wherein the at least one sensor comprises six sensors associated with six corresponding sensors locations spaced about the exterior of the ball to allow for placement of a user'"'"'s hand on the six sensors locations and further wherein, each haptic actuator associated with one of the six sensor the haptic actuator comprises six haptic actuators locations.

4. The system of claim 2, wherein the elastic ball further comprises foam silicone plastic which is elastic and can be squeezed by the human hand.

5. The system of claim 2, where the inertial measurement unit (IMU) is further configured to sense the different accelerations, velocities and gravitational forces to determine the motion information of the hand.

6. The system of claim 5, where the inertial measurement unit (IMU) is further configured to detect the motion of the translational movements on the x, y, and z coordinates.

7. The system of claim 5, where the inertial measurement unit (IMU) is further configured to detect the motion of the three rotational movements on axes called pitch, roll and yaw.

8. The system of claim 1, where the inertial measurement unit (IMU) further comprises a 3 axis accelerometer, gyroscope, magnetometer, any other motion detection device.

9. The system of claim 2, wherein the haptic actuator is associated with the exterior surface of the ball to provide haptic feedback to a user'"'"'s hand positioned to interact with the at least one sensor.

10. The system of claim 1, wherein the microcontroller is further configured to:

acquire and process data from various sensors; and

provide useful information to the wireless communication module.

11. The system of claim 1, wherein the wireless communication module is further configured to interact with other digital entities using wireless technology.

12. A method comprising:

receiving, from an inertial measurement unit (IMU) the motion information of a ball shaped device; and

receiving, from the force detection sensors the pressure information exerted on each of the sensors; and

simulating and generating haptic feedback; and

conditioning signal to convert sensory analog signals to digital signals; and

calculating kinematic performance metrics; and

transmitting sensory data to other digital entities and receiving digital commands for generating the haptic feedback.

13. The method of claim 12, further comprising sending information to and from other digital devices by using wireless technology.

14. The method of claim 12, wherein simulating and generating haptic feedback further comprises using any low power DC vibration or pneumatic actuator.

15. The method of claim 14, further comprising controlling the haptic simulation using the Pulse Width Modulation (PWM) that can increase or decrease the intensity of the vibrations by properly tuning the frequency of the pulses.

16. The method of claim 12, wherein conditioning signal further comprises proper filtration and calibration to produce discrete digital values from analog signals.

17. The method of claim 16, further comprising using a filtering algorithm to produce best estimated digital values.

18. The method of claim 12, wherein computing kinematics is configured to receive sensory digitized and calibrated data;

and

first compute the acceleration and the velocity main parameters on the three axes; and

then calculate performance metrics comprising the ranges of motions, tremor and stress from the main parameters.

19. A non-transitory computer-readable memory having instructions stored thereon, the instructions comprising:

instructions for receiving, from an inertial measurement unit (IMU) the motion information of a device; and

instructions for receiving, from the force detection sensors the pressure information exerted on each of the sensors; and

instructions for simulating and generating haptic feedback; and

instructions for converting sensory analog signals to digital signals; and

instructions for computing kinematic performance metrics; and

instructions for transmitting sensory data to other digital entities and receiving digital commands for generating the haptic feedback.