SYSTEMS AND METHODS FOR CAPTURING AND RECREATING THE FEEL OF SURFACES

• US 20120026180A1
• Filed: 07/29/2011
• Published: 02/02/2012
• Est. Priority Date: 07/30/2010
• Status: Active Grant

• Current Assignee: Trustees Of The University Of Pennsylvania (University of Pennsylvania)
• Original Assignee: Trustees Of The University Of Pennsylvania (University of Pennsylvania)
• Inventors: Kuchenbecker, Katherine J., Romano, Joseph, McMahan, William, Landin, Nils
• Granted Patent: US 8,988,445 B2
• Time in Patent Office: Days
• US Class Current: 345/582
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/0354 with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
• CPC Class Codes: G06F 3/03545 Pens or stylus

Abstract

Systems and methods for capturing and recreating the feel of a surface are disclosed. A method for capturing a feel of a surface comprises contacting the surface with a handheld tool, recording data measured by the tool, and generating a texture model of the surface based on the recorded data. A method for recreating a feel of a surface comprises contacting a virtual surface with a handheld tool, determining an estimated contact force based on the data measured by the tool, generating a vibration waveform from a texture model based on the data measured by the tool; and actuating at least one actuator of the tool according to the vibration waveform. A system for capturing and recreating a feel of a surface comprises a handheld tool, a storage device, and a processor.

Claims

1. A method for capturing a feel of a surface, the method comprising the steps of:

contacting the surface with a handheld tool, the handheld tool including at least one accelerometer configured to measure an acceleration experienced by the tool, at least one force sensor configured to measure a force experienced by the tool, and at least one speed sensor configured to measure a speed of the tool;

recording the acceleration experienced by the tool, the force experienced by the tool, and the speed of the tool while the tool contacts the surface; and

generating a texture model of the surface based on the recorded acceleration, force, and speed.

2. The method of claim 1, wherein the recording step comprises:

recording the acceleration experienced by the tool when the acceleration has a frequency in a range from approximately 20 Hz to approximately 1000 Hz.

3. The method of claim 1, wherein the contacting step comprises:

touching the surface with the tool in a stroking motion.

4. The method of claim 3, further comprising the steps of:

contacting the surface with the tool a plurality of times, the plurality of times having different combinations of force experienced by the tool and speed of the tool.

5. The method of claim 1, further comprising the step of:

determining an average force experienced by the tool and an average speed of the tool for a respective touch of the surface with the tool.

6. The method of claim 1, wherein the generating step comprises:

generating a texture model of the surface using linear predictive coding.

7. A method for recreating a feel of a surface, the method comprising the steps of:

contacting a virtual surface with a handheld tool, the handheld tool including at least one actuator configured to provide an acceleration to the tool, at least one force sensor configured to measure a force experienced by the tool, and at least one speed sensor configured to measure a speed of the tool;

determining an estimated contact force based on the measured force experienced by the tool and an estimated contact speed based on the measured speed of the tool;

generating a vibration waveform from a texture model based on the estimated contact speed and the estimated contact speed of the tool; and

actuating the at least one actuator of the tool according to the vibration waveform.

8. The method of claim 7, wherein the actuating step comprises:

actuating the at least one actuator of the tool according to vibration waveform such that the actuator provides an acceleration to the tool having a frequency in a range from approximately 20 Hz to approximately 1000 Hz.

9. A system for capturing and recreating a feel of a surface comprising:

a handheld tool including at least one accelerometer configured to measure an acceleration experienced by the tool, at least one force sensor configured to measure a force experienced by the tool, and at least one speed sensor configured to measure a speed of the tool;

a storage device in communication with the tool, the storage device operable to store the acceleration experienced by the tool, the force experienced by the tool, and the speed of the tool over a period of time; and

a processor in communication with the storage device, the processor programmed to generate a texture model of the surface based on the acceleration, force, and speed stored in the storage device.

10. The system of claim 9, further comprising:

another handheld tool including at least one actuator configured to provide an acceleration to the tool, at least one force sensor configured to measure a force experienced by the tool, and at least one speed sensor configured to measure a speed of the tool, wherein

the processor is programmed to determine an estimated contact force and an estimated contact speed based of the other tool based on the measured force experienced by the tool and the measured speed of the tool, generate at least one vibration waveform from the texture model based on the estimated contact force and the estimated contact speed, and actuate the at least one actuator of the other tool according to the selected at least one vibration waveform.

11. The system of claim 9, wherein the handheld tool further includes at least one actuator configured to provide an acceleration to the tool, wherein

the processor is programmed to determine an estimated contact force and an estimated contact speed based of the other tool based on the measured force experienced by the tool and the measured speed of the tool, generate at least one vibration waveform from the texture model of the surface based on the estimated contact force and the estimated contact speed, and actuate the at least one actuator of the other tool according to the selected at least one vibration waveform.