MULTI-DEVICE GESTURE INTERACTIVITY

• US 20100287513A1
• Filed: 05/05/2009
• Published: 11/11/2010
• Est. Priority Date: 05/05/2009
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Singh, Karan, Abraham, Dalen Mathew, Popp, Bogdan, Kramer, Douglas
• Application Number:
  US12/435,548
• Publication Number:
  US 20100287513A1
• Time in Patent Office: Days
• US Class Current: 715/863
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

A system is provided for enabling cross-device gesture-based interactivity. The system includes a first computing device with a first display operative to display an image item, and a second computing device with a second display. The second display is operative to display a corresponding representation of the image item in response to a gesture which is applied to one of the computing devices and spatially interpreted based on a relative position of the first computing device and the second computing device.

Claims

1. A system for providing cross-device gesture-based interactivity, comprising:

a first computing device with a first display operative to display an image item;

a second computing device with a second display operative to display a corresponding representation of the image item;

a spatial module on one of the first computing device and the second computing device and operative to receive a spatial context based on a relative position of the first computing device and the second computing device;

a gesture interpretation module on one of the first computing device and the second computing device and operative to receive a gesture input and output a cross-device display command which is dependent upon the gesture input and the spatial context, the cross-device display command being wirelessly communicated between the first computing device and the second computing device and operative to control display of the corresponding representation of the image item.

2. The system of claim 1, wherein the cross-device display command is based on a touch gesture applied to the image item at the first display.

3. The system of claim 2, wherein the touch gesture causes the image item to be wirelessly transferred to the second computing device and causes the corresponding representation of the image item to be displayed at a location on the second display, the location being dependent upon a direction of the touch gesture and the relative position of the first computing device and the second computing device.

4. The system of claim 1, wherein the cross-device display command is based on a joining gesture, in which the first computing device and the second computing device are brought together in close proximity.

5. The system of claim 4, wherein when the joining gesture causes the first display and the second display to be in an overlay orientation, the cross-device display command is operative to cause the corresponding representation of the image item to provide an overlay representation of the image item.

6. The system of claim 1, wherein the cross-device display command is based on a separating gesture, in which the first computing device and the second computing device are separated from a state of being in close proximity to each other.

7. The system of claim 6, wherein the separating gesture causes the image item to be wirelessly transferred to the second computing device and causes the second display to display the corresponding representation of the image item.

8. The system of claim 1, wherein the cross-device display command is based on a stamping gesture, in which the first computing device and the second computing device are brought together to, and then separated from, a state of being in close proximity to each other.

9. The system of claim 8, wherein the stamping gesture causes the image item to be wirelessly transferred to the second computing device and causes the second display to display the corresponding representation of the image item.

10. The system of claim 1, wherein one of the first computing device and the second computing device includes a touch interactive display and an optical subsystem operatively coupled with the touch interactive display.

11. The system of claim 10, wherein the optical subsystem is operatively coupled with the spatial module and is configured to optically determine the spatial context.

12. A system for providing cross-device gesture-based interactivity, comprising:

a first computing device, including a first touchscreen interactive display and a first gesture interpretation module, the first gesture interpretation module being operable to receive a gesture input based on a touch gesture applied to the first touchscreen interactive display, and output a cross-device gesture command based on the gesture input for wireless transmission by the first computing device;

a second computing device in spatial proximity with the first computing device and operative to wirelessly receive the cross-device gesture command, the second computing device including a second touchscreen interactive display and a second gesture interpretation module, the second gesture interpretation module operative to receive the cross-device gesture command and output a display command based on the cross-device gesture command, wherein the display command controls a visual output on the second touchscreen interactive display.

13. The system of claim 12, wherein the second gesture interpretation module is operative to receive a gesture input based on a touch gesture applied to the second touchscreen interactive display, and operative to cause the visual output to be controlled based on a combined interpretation of the touch gesture applied to the first touchscreen interactive display and the touch gesture applied to the second touchscreen interactive display.

14. The system of claim 12, wherein the cross-device gesture command is operative to cause wireless transmission of an image item from the first computing device to the second computing device, and wherein the visual output includes a representation of the image item.

15. The system of claim 14, wherein the representation of the image item is displayed at a location on the second touchscreen interactive display, the location being dependent upon a direction of the touch gesture applied to the first touchscreen interactive display.

16. The system of claim 12, further comprising a spatial module on one of the first computing device and the second computing device, the spatial module being operative to receive a spatial context which is based on a relative position of the first computing device and the second computing device, wherein the visual output on the second touchscreen interactive display is dependent upon the spatial context.

17. A method of providing cross-device gesture interaction among multiple computing devices, comprising:

providing a first computing device having a first display;

providing a second computing device having a second display;

displaying an image item on the first display;

receiving a gesture applied to one of the first computing device and the second computing device;

determining a relative position of the first computing device and the second computing device; and

controlling, based on the gesture and the relative position of the first computing device and the second computing device, display of a corresponding representation of the image item on the second display.

18. The method of claim 17, wherein controlling display of a corresponding representation of the image item on the second display includes controlling a location on the second display of the corresponding representation of the image item.

19. The method of claim 18, wherein the location is controlled based on a direction of the gesture.

20. The method of claim 17, wherein controlling display of a corresponding representation of the image item on the second display includes providing, in response to the first display and the second display being placed in an overlay orientation, an overlay representation of the image item on the second display.