Distributed sensing techniques for mobile devices

• US 20050093868A1
• Filed: 10/30/2003
• Published: 05/05/2005
• Est. Priority Date: 10/30/2003
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Hinckley, Kenneth P.
• Granted Patent: US 7,532,196 B2
• Time in Patent Office: Days
• US Class Current: 345/502
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: H04W 4/21 for social networking applications

Abstract

Methods and apparatus of the invention allow the coordination of resources of mobile computing devices to jointly execute tasks. In the method, a first gesture input is received at a first mobile computing device. A second gesture input is received at a second mobile computing device. In response, a determination is made as to whether the first and second gesture inputs form one of a plurality of different synchronous gesture types. If it is determined that the first and second gesture inputs form the one of the plurality of different synchronous gesture types, then resources of the first and second mobile computing devices are combined to jointly execute a particular task associated with the one of the plurality of different synchronous gesture types.

Claims

1. A method of coordinating resources of mobile computing devices to jointly execute tasks, the method comprising:

receiving a first gesture input at a first mobile computing device;

receiving a second gesture input at a second mobile computing device;

determining whether the first and second gesture inputs form one of a plurality of different synchronous gesture types; and

if it is determined that the first and second gesture inputs form the one of the plurality of different synchronous gesture types, then combining resources of the first and second mobile computing devices to jointly execute a particular task associated with the one of the plurality of different synchronous gesture types.

2. The method of claim 1, wherein determining whether the first and second gesture inputs form the one of the plurality of different synchronous gesture types further comprises determining whether the first and second gesture inputs are synchronized in time.

3. The method of claim 2, wherein determining whether the fist and second gesture inputs are synchronized in time further comprises determining whether the first and second gesture inputs are within a predetermined time period of each other.

4. The method of claim 2, wherein determining whether the first and second gesture inputs form the one of the plurality of different synchronous gesture types further comprises determining whether the first and second gesture inputs are of corresponding types.

5. The method of claim 4, wherein receiving the first gesture input further comprises receiving an output of an accelerometer of the first mobile computing device, and wherein receiving the second gesture input further comprises receiving an output of an accelerometer of the second mobile computing device.

6. The method of claim 5, wherein the outputs of the accelerometers of the first and second mobile computing devices are indicative of whether the first and second mobile computing devices have been bumped against one another, thereby forming a bump type synchronous gesture.

7. The method of claim 6, and further comprising:

receiving a touch sensor output from the first mobile computing device indicative of whether the first mobile computing device is being held during a potential bump type synchronous gesture; and

wherein determining whether the first and second gesture inputs form the bump type synchronous gesture comprises determining that the first and second gesture inputs form the bump type synchronous gesture only if the touch sensor output indicates that the first mobile computing device is being held.

8. The method of claim 4, wherein receiving the first gesture input further comprises receiving an input which is indicative of proximity of a stylus to a screen of the first mobile computing device, and wherein receiving the second gesture input further comprises receiving an input which is indicative of proximity of a stylus to a screen on the second mobile computing device.

9. The method of claim 8, wherein proximity of the stylus to one or both of the first and second mobile computing devices includes contact of the stylus with one or both of the first and second mobile computing devices.

10. The method of claim 9, wherein the first and second gesture inputs are indicative of whether a stitch type synchronous gesture has been formed.

11. The method of claim 10, wherein the first and second gesture inputs are indicative of whether a scribble type synchronous gesture has been formed.

12. The method of claim 1, wherein combining resources of the first and second mobile computing devices to jointly execute the task associated with the one of the plurality of different synchronous gesture types further comprises combining resources of the first and second mobile computing devices to share display real estate.

13. The method of claim 12, wherein combining resources of the first and second mobile computing devices to share display real estate further comprises combining resources of the first and second mobile computing devices to jointly display the same image.

14. The method of claim 12, wherein combining resources of the first and second mobile computing devices to share display real estate further comprises combining resources of the first and second mobile computing devices to each display different portions of a single image.

15. The method of claim 1, wherein combining resources of the first and second mobile computing devices to jointly execute the task associated with the one of the plurality of different synchronous gesture types further comprises combining resources of the first and second mobile computing devices to transfer data from the first mobile computing device to the second mobile computing device.

16. A computer readable medium storing computer executable instructions for implementing the steps of claim 1.

17. A system which coordinates resources of mobile computing devices to jointly execute tasks, the system comprising:

a first mobile computing device configured to receive a first gesture input;

a second mobile computing device configured to receive a second gesture input;

processing circuitry configured to determine whether the first and second gesture inputs form one of a plurality of different synchronous gesture types; and

wherein if it is determined that the first and second gesture inputs form the one of the plurality of different synchronous gesture types, then the first and second mobile computing devices being further configured to combine resources to jointly execute a particular task associated with the one of the plurality of different synchronous gesture types.

18. The system of claim 17, and further comprising a network communicatively coupling the first and second mobile computing devices.

19. The system of claim 18, wherein the processing circuitry comprises processing circuitry of one or both of the first and second mobile computing devices.

20. The system of claim 18, wherein the processing circuitry comprises processing circuitry of the network.

21. The system of claim 20, wherein the processing circuitry further comprises a proximity server.

22. The system of claim 17, wherein the processing circuitry is configured to determine whether the first and second gesture inputs form the one of the plurality of different synchronous gesture types by determining whether the first and second gesture inputs are synchronized in time.

23. The system of claim 22, wherein the processing circuitry is configured to determine whether the first and second gesture inputs are synchronized in time by determining whether the first and second gesture inputs are within a predetermined time period of each other.

24. The system of claim 22, wherein the processing circuitry is configured to determine whether the first and second gesture inputs form the one of the plurality of different synchronous gesture types by determining whether the first and second gesture inputs are of corresponding types.

25. The system of claim 24, and further comprising an accelerometer coupled to the first mobile computing device and an accelerometer coupled to the second mobile computing device, wherein the first gesture input is an output of the accelerometer coupled to the first mobile computing device, and wherein the second gesture input is an output of the accelerometer coupled to the second mobile computing device.

26. The system of claim 25, wherein the outputs of the accelerometers coupled to the first and second mobile computing devices are indicative of whether the first and second mobile computing devices have been bumped against one another, thereby forming a bump type synchronous gesture.

27. The system of claim 26, and further comprising:

a touch sensor coupled to the first mobile computing device, the first mobile computing device being further configured to receive a touch sensor output indicative of whether the first mobile computing device is being held during a potential bump type synchronous gesture; and

wherein the processing circuitry is further configured to determine whether the first and second gesture inputs form the bump type synchronous gesture only if the touch sensor output indicates that the first mobile computing device is being held.

28. The system of claim 24, wherein the first mobile computing device is configured to receive the first gesture input by receiving an input which is indicative of proximity of a stylus to a screen of the first mobile computing device, and wherein the second mobile computing device is configured to receive the second gesture input by receiving an input which is indicative of proximity of a stylus to a screen on the second mobile computing device.

29. The system of claim 28, wherein proximity of the stylus to one or both of the first and second mobile computing devices includes contact of the stylus with one or both of the first and second mobile computing devices.

30. The system of claim 29, wherein the first and second gesture inputs are indicative of whether a stitch type synchronous gesture has been formed.

31. The system of claim 30, wherein the first and second gesture inputs are indicative of whether a scribble type synchronous gesture has been formed.

32. The system of claim 17, wherein the first and second mobile computing devices are configured to combine resources by sharing display real estate.

33. The system of claim 32, wherein the first and second mobile computing devices are configured to share display real estate by jointly display the same image.

34. The system of claim 33, wherein the first and second mobile computing devices are configured to jointly display the same image by each displaying different portions of a single image.

35. The system of claim 17, wherein the first and second mobile computing devices are configured to combine resources to transfer data from the first mobile computing device to the second mobile computing device.