Cooperative federation of digital devices via proxemics and device micro-mobility

• US 9,294,539 B2
• Filed: 03/14/2013
• Issued: 03/22/2016
• Est. Priority Date: 03/14/2013
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Hinckley, Kenneth P., Marquardt, Nicolai
• Primary Examiner(s): Mejia, Anthony
• Application Number:
  US13/829,657
• Publication Number:
  US 20140280748A1
• Time in Patent Office: 1,104 Days
• Field of Search: 709/217, 709/218, 709/219
• US Class Current: 1/1
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 69/16 Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]

Abstract

The subject disclosure is directed towards co-located collaboration/data sharing that is based upon detecting the proxemics of people and/or the proxemics of devices. A federation of devices is established based upon proxemics, such as when the users have entered into a formation based upon distance between them and orientation. User devices may share content with other devices in the federation based upon micro-mobility actions performed on the devices, e.g., tilting and/or otherwise interacting with a sending device.

Claims

1. A system comprising:

a sending device; and

a recipient device configured to;

receive content from a sending device, the sending device and the recipient device being participants in a federation established by proxemics between the sending device and the recipient device; and

render the content in partial, increasing amounts over time until the content is fully rendered, the rendering in partial, increasing amounts occurring from one direction based upon a location of the sending device relative to the recipient device to have the content appear to have come from a direction of the sending device relative to the recipient device.

2. The system of claim 1, further comprising a server configured to:

maintain federation data corresponding to;

which digital devices are in the formation, the digital devices comprising the sending device and the recipient device; and

which users associated with the digital devices are facing a particular direction in the formation; and

communicate the federation data to the digital devices in the formation to establish a federation between the digital devices in the formation, the federation between the digital devices in the formation enabling the digital devices in the formation to communicate content with one another based upon one or more micro-mobility actions detected by at least one of the digital devices in the formation, the micro-mobility actions comprising one or more of the following;

device tilting, touch gesture, pen gesture, and multi-touch gesture; and

wherein the server dynamically updates the federation data and the digital devices in the formation upon a change to the formation.

3. The system of claim 2 wherein the images comprise depth data, and wherein the server includes a processing pipeline that determines users within the depth data and the orientation of the users relative to one another.

4. The system of claim 3 wherein the orientation of the users relative to one another comprises a face to face orientation, a side-to-side orientation, or a corner-to-corner orientation.

5. The system of claim 2 wherein the server comprises a central server coupled to one or more cameras that provide the image data.

6. The system of claim 2 further comprising a digital device in the federation that is associated with the federation by proxemics but not associated with any one user.

7. The system of claim 6 wherein the digital device comprises a digital whiteboard or other display mechanism configured to render content.

8. The system of claim 2 further comprising radios having signals that are detected to associate the digital devices to users.

9. A method comprising:

receiving content at a recipient device from a sending device, the sending device and the recipient device being participants in a federation established by proxemics between the sending device and the recipient device; and

rendering the content on the recipient device in partial, increasing amounts over time until the content is fully rendered, the rendering in partial, increasing amounts occurring from one direction based upon a location of the sending device relative to the recipient device to have the content appear to have come from a direction of the sending device relative to the recipient device.

10. The method of claim 9, further comprising:

determining proxemics among a plurality of devices, the plurality of digital devices comprising one or more of the following;

at least two users having digital devices, at least one user and at least two digital devices, and at least two digital devices;

establishing a federation between the plurality of digital devices;

maintaining federation data indicative of the federation; and

using the federation data to determine a set of federated devices that are able to communicate data between one another based upon the federation and one or more micro-mobility actions, the micro-mobility actions comprising one or more of the following;

device tilting, touch gesture, pen gesture, and multi-touch gesture;

wherein maintaining the federation data comprises updating the federation data upon a change to the federation, and wherein using the federation data to determine the set of federated devices comprises communicating the federation data to the devices.

11. The method of claim 10 further comprising associating detected users with the devices.

12. The method of claim 10 wherein one sending device of the federated devices shares content to at least one recipient device of the federated devices based upon the one or more of the micro-mobility actions, the sharing of content comprising moving the content from the sending device to the at least one recipient device or copying the content from the sending device to the at least one recipient device.

13. The method of claim 12 further comprising, at a recipient device, saving a copy of the content shared thereto based upon user interaction with the recipient device.

14. The method of claim 12 further comprising detecting a tilting of the sending device prior to sharing the content.

15. The method of claim 12 further comprising, taking one of a plurality of sharing actions based upon an amount of tilt detected by the sending device.

16. The method of claim 9 further comprising sharing content to one of the plurality of devices that displays the content to a plurality of users.

17. One or more computer-readable storage media having computer-executable instructions, which when executed on at least one processor perform operations comprising:

receiving content at a recipient device from a sending device, the sending device and the recipient device being participants in a federation established by proxemics between the sending device and the recipient device; and

rendering the content on the recipient device in partial, increasing amounts over time until the content is fully rendered, the rendering in partial, increasing amounts occurring from one direction based upon a location of the sending device relative to the recipient device to have the content appear to have come from a direction of the sending device relative to the recipient device.

18. The one or more computer-readable storage media of claim 17 having further computer-executable instructions comprising:

detecting, at the sending device, one of a first micro-mobility action or a second micro-mobility action; and

sharing a full screen of content based on the first micro-mobility action or sharing less than a full screen of content based upon the second micro-mobility action.

19. The one or more computer-readable storage media of claim 18, wherein the first micro-mobility action and the second micro-mobility action comprises one or more of the following:

device tilting, touch gesture, pen gesture, and multi-touch gesture.

20. The one or more computer-readable storage media of claim 19, wherein a difference between the first micro-mobility action and the second micro-mobility action is an amount of tilt detected by the sending device.