Systems and methods for mapping message contents to virtual physical properties for vibrotactile messaging

• US 8,866,602 B2
• Filed: 11/01/2013
• Issued: 10/21/2014
• Est. Priority Date: 07/15/2008
• Status: Active Grant

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Birnbaum, David M., Ullrich, Christopher J., Grant, Danny
• Primary Examiner(s): PHAM, TOAN NGOC
• Application Number:
  US14/069,892
• Publication Number:
  US 20140091914A1
• Time in Patent Office: 354 Days
• Field of Search: 340/407.1, 340/669, 340/686.1, 340/407.2, 455/466, 455/566, 455/567, 345/156, 345/169, 345/173, 715/700, 715/701, 715/702
• US Class Current: 340/407.1
• CPC Class Codes: G06F 1/1613 for portable computers cooling arrangements therefor G06F1/203; constructional details or arrangements for pocket calculators, electronic agendas or books G06F15/0216; constructional details of portable telephone sets: with several bodies H04M1/0202
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 2203/04104 Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
• CPC Class Codes: G06F 2203/04106 Multi-sensing digitiser, i.e. digitiser using at least two different sensing technologies simultaneously or alternatively, e.g. for detecting pen and finger, for saving power or for improving position detection
• CPC Class Codes: G06F 2203/04808 Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G08B 6/00 Tactile signalling systems, e.g. personal calling systems
• CPC Class Codes: H04M 1/72427 for supporting games or graphical animations
• CPC Class Codes: H04M 1/7243 with interactive means for internal management of messages
• CPC Class Codes: H04M 1/72457 : according to geographic location
• CPC Class Codes: H04M 19/047 : Vibrating means for incoming calls
• CPC Class Codes: H04M 2250/12 : including a sensor for measuring a physical value, e.g. temperature or motion telephones including GPS signal receivers H04M2250/10
• CPC Class Codes: H04W 4/21 : for social networking applications

Abstract

Systems and methods for mapping message contents to virtual physical properties for vibrotactile messaging are disclosed. For example, one disclosed method includes the steps of receiving a sensor signal from a sensor, the sensor configured to detect an interaction with a messaging device, determining a virtual physical property of a virtual message object based at least in part on the sensor signal, determining a haptic effect based at least in part on the virtual physical parameter; and generating a haptic signal configured to cause an actuator to output the haptic effect.

Claims

1. A method comprising:

receiving a sensor signal from a sensor configured to sense an interaction with a first messaging device;

determining a first virtual physical parameter based at least in part on the sensor signal;

transmitting a first signal associated with the first virtual physical parameter to a second messaging device;

receiving a second signal associated with a second virtual physical parameter from the second messaging device;

determining a haptic effect based at least in part on the second virtual physical parameter; and

generating a haptic signal configured to cause an actuator to output the haptic effect.

2. The method of claim 1, wherein the sensor is configured to detect:

air movement, contact, pressure, acceleration, inclination, inertia, or location.

3. The method of claim 1, wherein the sensor comprises:

an accelerometer, a gyroscope, a touch-sensitive input device, a camera, or a GPS sensor.

4. The method of claim 1, wherein the sensor signal is associated with environmental features.

5. The method of claim 1, wherein the sensor signal is associated with a gesture.

6. The method of claim 5, wherein the gesture is a two dimensional gesture comprising:

a finger position or a finger gesture.

7. The method of claim 5, wherein the gesture is a three dimensional gesture comprising:

a device gesture or a device orientation.

8. A system comprising:

a sensor configured to sense an interaction with a first messaging device;

a processor coupled to the sensor, the processor configured to;

receive a sensor signal from the sensor;

determine a first virtual physical parameter based at least in part on the sensor signal;

transmit a first signal associated with the virtual physical parameter to a second messaging device;

receive a second signal associated with a second virtual physical parameter from the second messaging device;

determine a haptic effect based at least in part on the second virtual physical parameter; and

generate a haptic signal configured to cause an actuator to output the haptic effect.

9. The system of claim 8, wherein the sensor is configured to detect:

air movement, contact, pressure, acceleration, inclination, inertia, or location.

10. The system of claim 8, wherein the sensor comprises:

an accelerometer, a gyroscope, a touch-sensitive input device, a camera, or a GPS sensor.

11. The system of claim 8, wherein the sensor signal is associated with environmental features.

12. The system of claim 8, wherein the sensor signal is associated with a gesture.

13. The system of claim 12, wherein the gesture is a two dimensional gesture comprising:

a finger position or a finger gesture.

14. The system of claim 12, wherein the gesture is a three dimensional gesture comprising:

a device gesture or a device orientation.

15. A non-transitory computer-readable medium comprising program code, which when executed by a processor is configured to cause the processor to:

receive a sensor signal from a sensor configured to sense an interaction with a first messaging device;

determine a first virtual physical parameter based at least in part on the sensor signal;

transmit a first signal associated with the first virtual physical parameter to a second messaging device;

receive a second signal associated with a second virtual physical parameter from the second messaging device;

determine a haptic effect based at least in part on the second virtual physical parameter; and

generate a haptic signal configured to cause an actuator to output the haptic effect.

16. The non-transitory computer readable medium of claim 15, wherein the sensor is configured to detect:

air movement, contact, pressure, acceleration, inclination, inertia, or location.

17. The non-transitory computer readable medium of claim 15, wherein the sensor comprises:

an accelerometer, a gyroscope, a touch-sensitive input device, a camera, or a GPS sensor.

18. The non-transitory computer readable medium of claim 15, wherein the sensor signal is associated with environmental features.

19. The non-transitory computer readable medium of claim 15, wherein the sensor signal is associated with a gesture.

20. The non-transitory computer readable medium of claim 19, wherein the gesture is a two dimensional gesture comprising:

a finger position or a finger gesture.

21. The non-transitory computer readable medium of claim 19, wherein the gesture is a three dimensional gesture comprising:

a device gesture or a device orientation.