Systems and Methods For Physics-Based Tactile Messaging

• US 20100017759A1
• Filed: 07/14/2009
• Published: 01/21/2010
• Est. Priority Date: 07/15/2008
• Status: Active Grant

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Grant, Danny, Ullrich, Chris, Birnbaum, David M.
• Granted Patent: US 10,248,203 B2
• Time in Patent Office: Days
• US Class Current: 715/863
• CPC Class Codes: G06F 1/1613 for portable computers cooling arrangements therefor G06F1/203; constructional details or arrangements for pocket calculators, electronic agendas or books G06F15/0216; constructional details of portable telephone sets: with several bodies H04M1/0202
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04106 Multi-sensing digitiser, i.e. digitiser using at least two different sensing technologies simultaneously or alternatively, e.g. for detecting pen and finger, for saving power or for improving position detection
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G08B 6/00 Tactile signalling systems, e.g. personal calling systems
• CPC Class Codes: H04M 1/72427 for supporting games or graphical animations
• CPC Class Codes: H04M 1/7243 with interactive means for internal management of messages
• CPC Class Codes: H04M 1/72457 : according to geographic location
• CPC Class Codes: H04M 19/047 : Vibrating means for incoming calls
• CPC Class Codes: H04M 2250/12 : including a sensor for measuring a physical value, e.g. temperature or motion telephones including GPS signal receivers H04M2250/10
• CPC Class Codes: H04W 4/21 : for social networking applications

Abstract

Systems and methods for physics-based tactile messaging are disclosed. For example, one disclosed method includes the steps of receiving a sensor signal from a sensor configured to sense a physical interaction with a messaging device; determining an interaction between one or more virtual message objects and a virtual message environment, the interaction based at least in part on the sensor signal and a virtual physical parameter of at least one of the one or more virtual message objects; and determining a haptic effect based at least in part on the interaction. The method additionally includes the step of generating a haptic signal configured to cause an actuator to output the haptic effect.

Claims

1. A method comprising:

receiving a sensor signal from a sensor configured to sense a physical interaction with a messaging device;

determining an interaction between one or more virtual message objects and a virtual message environment, the interaction based at least in part on the sensor signal and a virtual physical parameter of at least one of the one or more virtual message objects;

determining a haptic effect based at least in part on the interaction; and

generating a haptic signal configured to cause an actuator to output the haptic effect.

2. The method of claim 1, further comprising transmitting the haptic signal to an actuator configured to output the haptic effect, and outputting the haptic effect.

3. The method of claim 1, wherein the interaction between the one or more virtual message objects and the virtual message environment comprises a collision.

4. The method of claim 1, wherein the sensor is configured to detect:

contact, pressure, acceleration, inclination, inertia, or location.

5. The method of claim 1, wherein the sensor comprises:

an accelerometer, a gyroscope, a GPS sensor, an inclinometer, an optical sensor such as a camera, audio-spectrum sensors, ultrasonic transmitters and sensors, an infrared or other proximity sensor, or another sensor which can detect orientation or motion.

6. The method of claim 1, wherein the virtual message environment comprises an inbox.

7. The method of claim 1, wherein the virtual physical parameter comprises a size, a mass, a shape, a collision behavior, a texture, or a visual representation.

8. The method of claim 1, wherein the virtual message objects comprise one or more of:

a ball, a tube, or a capsule.

9. The method of claim 1, wherein the virtual message objects comprise one or more of:

a text message, an instant message, an email, or a data file.

10. The method of claim 9, wherein the data file comprises one or more of:

a video file, an audio file, an image file, or a text file.

11. A method comprising:

receiving a new virtual message object signal comprising a new virtual message object;

determining an interaction between the new virtual message object and a virtual message environment, the interaction based at least in part on a virtual physical parameter of the new virtual message object;

determining a haptic effect based at least in part on the interaction; and

generating a haptic signal configured to cause an actuator to output the haptic effect.

12. The method of claim 11, wherein the new virtual message object signal is generated by an alarm or a reminder.

13. The method of claim 11, wherein the new virtual message object signal is received from a remote device.

14. A computer-readable medium comprising program code, the program code comprising:

program code to receive a sensor signal from a sensor configured to sense a physical interaction with a messaging device;

program code to determine an interaction between one or more virtual message objects and a virtual message environment, the interaction based at least in part on the sensor signal and a virtual physical parameter of at least one of the one or more virtual message objects;

program code to determine a haptic effect based at least in part on the interaction; and

program code to generate a haptic signal configured to cause an actuator to output the haptic effect.

15. A computer-readable medium comprising program code, the program code comprising:

program code to receive a new virtual message object signal comprising a new virtual message object;

program code to determine an interaction between the new virtual message object and a virtual message environment, the interaction based at least in part on the sensor signal and a virtual physical parameter of the new virtual message object;

program code to determine a haptic effect based at least in part on the interaction; and

program code to generate a haptic signal configured to cause an actuator to output the haptic effect.

16. A system, comprising:

a processor, configured to;

receive a sensor signal from a sensor configured to sense a physical interaction with a messaging device;

determine an interaction between one or more virtual message objects and a virtual message environment, the interaction based at least in part on the sensor signal and a virtual physical parameter of at least one of the one or more virtual message objects;

determine a haptic effect based at least in part on the interaction; and

generate a haptic signal configured to cause an actuator to output the haptic effect.

17. The system of claim 16, further comprising a sensor in communication with the processor.

18. The system of claim 17, wherein the sensor is configured to detect:

contact, pressure, acceleration, inclination, inertia, or location.

19. The system of claim 17, wherein the sensor comprises:

an accelerometer, a gyroscope, or a GPS sensor.

20. The system of claim 16, further comprising an actuator configured to receive a haptic signal and generate a haptic effect based at least in part on the haptic signal.

21. The system of claim 16, wherein the messaging device further comprises a display configured to show the virtual message environment.

22. The system of claim 21, wherein the display comprises:

a touch screen.

23. The system of claim 16, wherein the messaging device further comprises a speaker configured to generate a sound effect, the sound effect coordinated with the haptic effect.

24. The system of claim 16, wherein the interaction between the one or more virtual message objects and the virtual message environment comprises a collision.

25. The system of claim 16, wherein the virtual message environment comprises an inbox.

26. The system of claim 16, wherein the virtual physical parameter comprises:

a size, a mass, a shape, a collision behavior, a texture, or a visual representation.

27. The system of claim 16, wherein the virtual message objects comprise one or more of:

a ball, a tube, or a capsule.

28. The system of claim 16, wherein the virtual message objects comprise one or more of:

a text message, an instant message, an email, or a data file.

29. The system of claim 28, wherein the data file comprises one or more of:

a video file, an audio file, an image file, or a text file.