Systems And Methods For Interpreting Physical Interactions With A Graphical User Interface

• US 20140189506A1
• Filed: 03/06/2014
• Published: 07/03/2014
• Est. Priority Date: 07/15/2008
• Status: Abandoned Application

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Birnbaum, David M., Ullrich, Christopher J., Rubin, Peter, Ngo, Phong David, Kopelow, Leo
• Application Number:
  US14/198,884
• Publication Number:
  US 20140189506A1
• Time in Patent Office: Days
• US Class Current: 715/702
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0486 Drag-and-drop
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: H04M 1/72427 for supporting games or graphical animations
• CPC Class Codes: H04M 1/7243 with interactive means for internal management of messages
• CPC Class Codes: H04M 1/72469 for operating the device by selecting functions from two or more displayed items, e.g. menus or icons
• CPC Class Codes: H04M 2250/12 including a sensor for measuring a physical value, e.g. temperature or motion telephones including GPS signal receivers H04M2250/10

Abstract

Embodiments of systems and methods for interpreting physical interactions with a graphical user interface are disclosed. For example, one system for interpreting physical interactions with a graphical user interface is a device having a housing configured to be grasped by a user, a display disposed in the housing, the display configured to display a graphical user interface, and a sensor disposed in the housing, the sensor configured to detect a movement of the housing in a degree of freedom. The device also includes a processor disposed in the housing and in communication with the display and the sensor, the processor configured to receive a sensor signal from the sensor, the sensor signal comprising a parameter associated with the movement, to determine a command associated with the graphical user interface based on the parameter, to determine a function to be executed based on the command, and to execute the function.

Claims

1. A device comprising:

a display configured to display a graphical user interface comprising a shared virtual physical space;

a sensor configured to detect user interaction with the shared virtual physical space;

a processor in communication with the display and the sensor, the processor configured to;

receive a sensor signal from the sensor, the sensor signal comprising data associated with the user interaction;

receive a remote signal from a remote device, the remote signal associated with the shared virtual physical space;

determine a command based, at least in part, on the user interaction;

determine a function to be executed based, at least in part, on the command; and

execute the function.

2. The device of claim 1, wherein the virtual physical space comprises a plurality of virtual physical objects.

3. The device of claim 1, wherein the virtual physical space comprises a two-dimensional virtual physical space.

4. The device of claim 1, wherein the virtual physical space comprises a three-dimensional virtual physical space.

5. The device of claim 1, further comprising an actuator and wherein the processor is further configured to generate an actuator signal based on user interaction and to output the actuator signal to the actuator to cause the actuator to output a haptic effect.

6. The device of claim 1, wherein the remote signal comprises data associated with a second user interaction with the shared virtual physical space.

7. The device of claim 1, wherein the command comprises a command associated with transferring data from the device to the remote device.

8. The device of claim 1, wherein the processor is further configured to determine the command based in part on the remote signal.

9. A method comprising:

displaying a graphical user interface comprising a shared virtual physical space;

receiving a sensor signal from a sensor configured to detect a first user interaction with a first device, the first user interaction associated with the shared virtual physical space;

receiving a remote signal from a remote device, the remote signal associated with the shared virtual physical space;

determining a command based, at least in part, on the user interaction;

determining a function to be executed based, at least in part, on the command; and

executing the function.

10. The method of claim 9, wherein the virtual physical space comprises a plurality of virtual physical objects.

11. The method of claim 9, wherein the virtual physical space comprises a two-dimensional virtual physical space.

12. The method of claim 9, wherein the virtual physical space comprises a three-dimensional virtual physical space.

13. The method of claim 9, further comprising generating an actuator signal based on the user interaction and outputting the actuator signal to an actuator configured to output a haptic effect.

14. The method of claim 9, wherein the remote signal comprises data associated with a second user interaction with the shared virtual physical space.

15. The method of claim 9, wherein the command comprises a command associated with transferring data from the device to the remote device.

16. The method of claim 9, wherein the processor is further configured to determine the command based in part on the remote signal.

17. A non-transitory computer readable medium comprising program code, which when executed by a processor is configured to cause the processor to:

display a graphical user interface comprising a shared virtual physical space;

receive a sensor signal from a sensor configured to detect a first user interaction with a first device, the first user interaction associated with the shared virtual physical space;

receive a remote signal from a remote device, the remote signal associated with the shared virtual physical space;

determine a command based, at least in part, on the user interaction;

determine a function to be executed based, at least in part, on the command; and

execute the function.

18. The computer readable medium of claim 17, wherein the virtual physical space comprises a three-dimensional virtual physical space.

19. The computer readable medium of claim 17, further comprising program code, which when executed by a processor is configured to cause the processor to generate an actuator signal based on the user interaction and outputting the actuator signal to an actuator configured to output a haptic effect.

20. The computer readable medium of claim 17, wherein the remote signal comprises data associated with a second user interaction with the shared virtual physical space.

21. The computer readable medium of claim 17, wherein the processor is further configured to determine the command based in part on the remote signal.