INTUITIVE, GESTURE-BASED COMMUNICATIONS WITH PHYSICS METAPHORS

• US 20110163944A1
• Filed: 01/05/2010
• Published: 07/07/2011
• Est. Priority Date: 01/05/2010
• Status: Abandoned Application

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Bilbrey, Brett, King, Nicholas V., Benjamin, Todd
• Application Number:
  US12/652,719
• Publication Number:
  US 20110163944A1
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G01D 21/02 Measuring two or more variables by means not covered by a single other subclass
• CPC Class Codes: G06F 1/1626 with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: H04L 67/06 specially adapted for file transfer, e.g. file transfer protocol [FTP]
• CPC Class Codes: H04L 67/131 Protocols for games, networked simulations or virtual reality
• CPC Class Codes: H04L 67/52 specially adapted for the location of the user terminal
• CPC Class Codes: H04M 1/72412 using two-way short-range wireless interfaces
• CPC Class Codes: H04M 2250/64 file transfer between terminals download of applications H04M1/72406; transfer of messages, e.g. SMS, e-mail or MMS H04M1/7243
• CPC Class Codes: H04W 4/06 Selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS]; Services to user groups; One-way selective calling services
• CPC Class Codes: H04W 76/10 Connection setup

Abstract

A user can make an intuitive, physical gesture with a first device, which can be detected by one or more onboard motion sensors. The detected motion triggers an animation having a “physics metaphor,” where the object appears to react to forces in a real world, physical environment. The first device detects the presence of a second device and a communication link is established allowing a transfer of data represented by the object to the second device. During the transfer, the first device can animate the object to simulate the object leaving the first device and the second device can animate the object to simulate the object entering the second device. In some implementations, in response to an intuitive, gesture made on a touch sensitive surface of a first device or by physically moving the device, an object can be transferred or broadcast to other devices or a network resource based on a direction, velocity or speed of the gesture.

Claims

1. A computer-implemented method, comprising:

presenting an object on an interface of a first device, the object representing data stored or accessible by the first device;

detecting motion based on data from sensors onboard the first device;

receiving input selecting the object;

responsive to the input and the detected motion, animating the object on the interface using a physics metaphor, where the animation dynamically changes in response to the detected motion;

detecting a presence of a second device located in proximity to the first device;

determining that the detected motion results from a physical gesture made by a user of the first device, the physical gesture indicating a request to transfer the data to the second device; and

responsive to the determining and to the detected presence of the second device, initiating data transfer to the second device.

2. The method of claim 1, where presenting an object on an interface, further comprises:

presenting an object on a touch sensitive surface.

3. The method of claim 2, where receiving user input further comprises:

receiving touch input selecting the object through the touch sensitive surface;

determining that the touch input has exceeded a predetermined time or pressure; and

animating the object using the physics metaphor so that the object appears to be detached from the interface and freely moving on the interface in response to motion of the device.

4. The method of claim 3, where the first or second device is an electronic tablet.

5. The method of claim 1, where animating the object on the interface further comprises:

animating the object during data transfer to the second device, where the animating is based on the size of the data represented by the object.

6. The method of claim 5, where an order or speed of data transfer is based on the location of the animated object in the interface or the size of the data being transferred.

7. A computer-implemented method, comprising:

receiving on a first device a request to receive data from a second device proximate to the first device and in communication with the first device;

detecting receipt of data from the second device;

presenting an object on an interface of the first device, the object representing the data received on the first device; and

animating the object on the interface using a physics metaphor.

8. The method of claim 7, where presenting an object on an interface of the first device, further comprises:

presenting an object on a touch sensitive surface of the first device.

9. The method of claim 8, further comprising:

receiving touch input selecting the object through the touch sensitive surface;

determining that the touch input has exceeded a predetermined time or pressure; and

fixing the object to the interface so that the object cannot move freely in the interface in response to motion of the device.

10. The method of claim 7, where the first or second device is an electronic tablet.

11. The method of claim 7, where animating the object on the interface further comprises:

animating the object during data transfer to the first device, where the animating is based on the size of the data represented by the object.

12. The method of claim 11, where an order or speed of data transfer is based on the location of the animated object in the interface or the size of the data being transferred.

13. A computer-implemented method, comprising:

receiving gesture input selecting an object on a touch sensitive surface of a first device, the object representing data to be transferred to at least one other device;

determining a direction of the gesture on the touch sensitive surface;

receiving position information from one or more devices proximate to the first device;

selecting a target device for receiving data, where the target device is determined based on the position information and the sensor data; and

initiating a transfer of the data to the selected target device.

14. The method of claim 13, where selecting a target device further comprises:

determining line of sight vectors from the position vectors;

transforming the line of sight vectors from an inertial coordinate frame to a display coordinate frame associated with the touch sensitive surface;

defining a gesture vector representing the direction of the gesture in the display coordinate frame;

determining an angular separation between the gesture vector and each line of sight vector in the display coordinate frame; and

selecting a target device having a line of sight vector with the smallest angular separation with the gesture vector in the display coordinates.

15. A computer-implemented method comprising:

receiving physical gesture input indicating an intent to broadcast data stored or accessible by a device;

determining two or more target devices for receiving the data from the device, where the target devices are located proximate to the device and in communication with the device; and

broadcasting the data to the two or more target devices.

16. The method of claim 15, where the physical gesture is a clockwise or counterclockwise rotational or sweeping gesture made in the general direction of the target devices by a hand of a user holding the device.

17. A computer-implemented, comprising:

receiving physical gesture input indicating an intent to send data to, or receive data from a network resource; and

responsive to the physical gesture, sending data to, or receiving data from the network resource.

18. A computer-implemented method, comprising:

receiving input through a first interface of a first device, the input requesting data from a second device located proximate to the first device and in communication with the first device, the second device having a second interface displaying an object representing the data requested by the first device;

detecting an orientation and motion of the first device using sensor data output from at least one motion sensor onboard the first device, where the orientation and motion indicate an a request to transfer the data from the second device to the first device; and

responsive to the detecting, initiating a transfer of the data from the second device to the first device, where the initiating of the data transfer includes animating the object in the second interface using a physics metaphor, where the object appears to be scraped or vacuumed out of the second interface.

19. The method of claim 18, where the first or second device is an electronic tablet.

20. A system comprising:

a motion sensor;

a processor;

a computer-readable medium storing instructions, which, when executed by the processor, causes the processor to perform operations comprising;

presenting an object on an interface of the system, the object representing data stored or accessible by the system;

detecting motion based on data from the motion sensor;

receiving input selecting the object;

responsive to the input and the detected motion, animating the object on the interface using a physics metaphor, where the animation dynamically changes in response to the detected motion;

detecting a presence of a device located in proximity to the system;

determining that the detected motion results from a physical gesture made by a user of the system, the physical gesture indicating a request to transfer the data to the device; and

responsive to the determining and to the detected presence of the device, initiating data transfer to the device.

21. The system of claim 20, where receiving user input further comprises:

receiving touch input selecting the object through the interface;

determining that the touch input has exceeded a predetermined time or pressure; and

animating the object using the physics metaphor so that the object appears to be detached from the interface and freely moving on the interface in response to motion of the system.

22. The system of claim 20, where animating the object on the interface further comprises:

animating the object during data transfer to the device, where the animating is based on the size of the data represented by the object.

23. The system of claim 22, where an order or speed of data transfer is based on the location of the animated object in the interface or the size of the data being transferred.

24. A system comprising:

a processor;

a computer-readable medium storing instructions, which, when executed by the processor, causes the processor to perform operations comprising;

receiving a request to receive data from a device proximate to the system and in communication with the system;

detecting receipt of data from the device;

presenting an object on an interface of the system, the object representing the data received on the device; and

animating the object on the interface using a physics metaphor.

25. The system of claim 24, further comprising:

receiving touch input selecting the object through the interface;

determining that the touch input has exceeded a predetermined time or pressure; and

fixing the object to the interface so that the object cannot move freely in the interface in response to motion of the system.

26. The method of claim 24, where animating the object on the interface further comprises:

animating the object during data transfer to the first device, where the animating is based on the size of the data represented by the object.

27. The system of claim 26, where an order or speed of data transfer is based on the location of the animated object in the interface or the size of the data being transferred.