Systems and Methods For Interpreting Physical Interactions With A Graphical User Interface

• US 20100214243A1
• Filed: 01/29/2010
• Published: 08/26/2010
• Est. Priority Date: 07/15/2008
• Status: Abandoned Application

• Current Assignee: Immersion Corporation
• Original Assignee: Immersion Corporation
• Inventors: Ngo, Phong David, Rubin, Peter, Ullrich, Chris, Birnbaum, David M., Kopelow, Leo
• Application Number:
  US12/697,030
• Publication Number:
  US 20100214243A1
• Time in Patent Office: Days
• US Class Current: 345/173
• CPC Class Codes: G06F 2203/014 Force feedback applied to GUI
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0486 Drag-and-drop
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: H04M 1/72427 for supporting games or graphical animations
• CPC Class Codes: H04M 1/7243 with interactive means for internal management of messages
• CPC Class Codes: H04M 1/72469 for operating the device by selecting functions from two or more displayed items, e.g. menus or icons
• CPC Class Codes: H04M 2250/12 including a sensor for measuring a physical value, e.g. temperature or motion telephones including GPS signal receivers H04M2250/10

Abstract

Embodiments of systems and methods for interpreting physical interactions with a graphical user interface are disclosed. For example, one system for interpreting physical interactions with a graphical user interface is a device having a housing configured to be grasped by a user, a display disposed in the housing, the display configured to display a graphical user interface, and a sensor disposed in the housing, the sensor configured to detect a movement of the housing in a degree of freedom. The device also includes a processor disposed in the housing and in communication with the display and the sensor, the processor configured to receive a sensor signal from the sensor, the sensor signal comprising a parameter associated with the movement, to determine a command associated with the graphical user interface based on the parameter, to determine a function to be executed based on the command, and to execute the function.

Claims

1. A device comprising:

a housing configured to be grasped by a user;

a display disposed in the housing, the display configured to display a graphical user interface;

a sensor disposed in the housing, the sensor configured to detect a movement of the housing in a degree of freedom;

a processor disposed in the housing and in communication with the display and the sensor, the processor configured to;

receive a sensor signal from the sensor, the sensor signal comprising a parameter associated with the movement;

determine a command associated with the graphical user interface based, at least in part, on the parameter;

determine a function to be executed based, at least in part, on the command, and

execute the function.

2. The device of claim 1, wherein the graphical user interface comprises a gear shift pattern and a gear shift knob, the gear shift knob moveable within the gear shift pattern.

3. The device of claim 1, wherein the graphical user interface comprises a virtual physical space.

4. The device of claim 3, wherein the virtual physical space comprises a plurality of virtual physical objects.

5. The device of claim 3, wherein the virtual physical space comprises a two-dimensional virtual physical space.

6. The device of claim 3, wherein the virtual physical space comprises a three-dimensional virtual physical space.

7. The device of claim 1, further comprising an actuator and wherein the processor is further configure to generate an actuator signal based on the movement and to output the actuator signal to the actuator to cause the actuator to output a haptic effect.

8. The device of claim 3, wherein the virtual physical space comprises a first virtual physical space, the graphical user interface comprises a first graphical user interface, and processor is further configured to:

receive a signal from a second device indicating a request to connect the second device to the first virtual physical space, the second device executing a second graphical user interface comprising a second virtual physical space;

connect the first virtual physical space to the second virtual physical space;

receive a second sensor signal from the sensor, the second sensor signal indicating a second movement of the device; and

determine an interaction between the first graphical user interface and the second virtual physical space based on the second movement.

9. The device of claim 8, wherein the command comprises a selection of a virtual physical object within the second virtual physical space.

10. The device of claim 9, wherein the function comprises a move function or a copy function to move the virtual physical object from the second virtual physical space to the first virtual physical space or to copy the virtual physical object from the second virtual physical space to the first virtual physical space.

11. The device of claim 9, wherein the function comprises a view function to view the contents of a virtual physical object.

12. A method comprising:

receiving a sensor signal from a sensor, the sensor signal comprising a parameter associated with a movement of a device;

determining a command associated with the graphical user interface based, at least in part, on the parameter;

determining a function to be executed based, at least in part, on the command; and

executing the function.

13. The method of claim 12, wherein the graphical user interface comprises a virtual physical space.

14. The method of claim 13, wherein the virtual physical space comprises a first virtual physical space, the graphical user interface comprises a first graphical user interface further comprising:

receiving a signal from a second device indicating a request to connect the second device to the virtual physical space, the second device executing a second graphical user interface comprising a second virtual physical space;

connecting the virtual physical space to the second virtual physical space;

receiving a second sensor signal from the sensor, the sensor signal indicating a second movement of the device; and

determining an interaction between the first graphical user interface and the second virtual physical space based on the second movement.

15. The method of claim 14, wherein the command comprises a selection of a virtual physical object within the second virtual physical space.

16. The method of claim 14, wherein the function comprises a move function or a copy function to move the virtual physical object from the second virtual physical space to the first virtual physical space or to copy the virtual physical object from the second virtual physical space to the first virtual physical space.

17. The method of claim 14, wherein the function comprises a view function to view the contents of a virtual physical object.

18. A system comprising:

a housing;

a touch-sensitive display disposed in the housing, the touch-sensitive display configured to;

display a graphical user interface comprising a wheel having a plurality of functions arranged on the wheel;

detect a first contact and a second contact with the touch-sensitive display,

generate a first input signal based on the first contact and a second input signal based on the second contact;

a processor disposed in the housing and in communication with the touch-sensitive display, the processor configured to;

receive the first input signal from the touch-sensitive display, the first input signal comprising a first parameter associated with the first contact;

determine a first command from a plurality of commands associated with a graphical user interface based on the parameter, wherein the plurality of commands comprises rotating the wheel clockwise and rotating the wheel counterclockwise;

receive the second input signal from the touch-sensitive display, the second input signal comprising a second parameter associated with the second contact;

determine a function to be executed based on the second command, and

execute the function.

19. A system comprising:

a housing;

a touch-sensitive display disposed in the housing, the touch-sensitive display configured to;

display a graphical user interface comprising a list extending in a simulated depth dimension;

detect a first contact and a second contact with the touch-sensitive display,

generate a first input signal based on the first contact and a second input signal based on the second contact;

a processor disposed in the housing and in communication with the touch-sensitive display, the processor configured to;

receive the first input signal from the touch-sensitive display, the first input signal comprising a first parameter associated with the first contact;

determine a first command from a plurality of commands associated with a graphical user interface based on the parameter, wherein the plurality of commands comprises scrolling in a first direction along the simulated depth dimension and scrolling in a second direction along the simulated depth dimension;

receive the second input signal from the touch-sensitive display, the second input signal comprising a second parameter associated with the second contact;

determine a function to be executed based on the second command, and

execute the function.

20. A system comprising:

a housing;

a touch-sensitive display disposed in the housing, the touch-sensitive display configured to;

display a graphical user interface comprising a drawing pad;

detect a first contact and a second contact with the touch-sensitive display,

generate a first input signal based on the first contact and a second input signal based on the second contact;

a processor disposed in the housing and in communication with the touch-sensitive display, the processor configured to;

receive the first input signal from the touch-sensitive display, the first input signal comprising a first parameter associated with the first contact;

determine a letter based on the first parameter;

identify a plurality of objects based on the first parameter;

receive the second input signal from the touch-sensitive display, the second input signal comprising a second parameter associated with the second contact;

determine a function to be executed based on the second command, and

execute the function.