METHOD OF INTERACTING WITH MULTIPLE DEVICES

• US 20150277574A1
• Filed: 03/24/2015
• Published: 10/01/2015
• Est. Priority Date: 03/28/2014
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: JAIN, Saurabh, BUGALIA, Nishant
• Granted Patent: US 10,345,913 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0486 Drag-and-drop
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser

Abstract

The present disclosure provides a method that allows user to select an object on a first device, select a modification in order to modify the object and transferring information so that the modified object may be displayed on another device.

Claims

1. A method of controlling a first terminal to provide a modified object, the method comprising:

detecting a first command to select an object;

detecting a second command to modify the selected object;

modifying the selected object according to the detected second command; and

providing the modified object.

2. The method as claimed in claim 1, wherein the providing the modified object comprises transmitting the modified object to a second terminal in response to detecting a third command to transmit the modified object, and

wherein the detecting the first command, the detecting the second command and the detecting the third command are performed by the first terminal.

3. The method as claimed in claim 1, wherein the modifying the selected object further comprises:

transmitting the second command and the selected object to a second terminal in response to detecting a third command to transmit the object,

wherein the selected object is transmitted in an unmodified state with the second command so that the modifying may be performed by the second terminal.

4. The method as claimed in claim 1, wherein the modifying the selected object further comprises:

transmitting the second command and the selected object to a third terminal in response to detecting a third command to transmit the modified object; and

modifying the selected object in the third terminal according to the second command,

wherein the providing the modified object comprises transmitting the modified object from the third terminal to a second terminal and providing the modified object on the second terminal.

5. The method as claimed in claim 1, wherein the second command is an air gesture that corresponds to a modification.

6. The method as claimed in claim 1, wherein in response to the first command selecting a folder on the first terminal, the selecting the object further comprises selecting the folder,

wherein the modifying of the selected object comprises compressing the folder, and

wherein the providing the modified object comprises providing a compressed file comprising the folder to a second terminal.

7. The method as claimed in claim 1, wherein in response to the first command selecting a content on the first terminal, the selecting the object further comprises selecting the content,

wherein the modifying of the selected object comprises transmitting the selected content to a third terminal in response to a third command to transmit the content and detecting a figure in the content on the third terminal, and

wherein the providing the modified object further comprises transmitting the content from which the figure is detected from the third terminal to a second terminal and displaying the content including the detected figure on the second terminal.

8. The method as claimed in claim 1, wherein in response to the first command selecting a letter displayed on the first terminal, the selecting the object further comprises selecting the letter,

wherein the modifying the selected object further comprises converting the letter into text data, and

wherein the providing the modified object comprises transmitting the text data to a second terminal so that the text data may be displayed on the second terminal.

9. A method of controlling a second terminal to provide a modified object, the method comprising:

detecting an air gesture command comprising a first command to select an object displayed by a first terminal and a second command to modify the selected object,

transmitting a request to the first device to request the selected object;

receiving the selected object;

modifying the received object according to the second command; and

providing the modified object on the first terminal.

10. A system comprising:

a first terminal configured to provide an object and detect a selection command for selecting the object;

a second terminal configured to recognize a user gesture; and

a third terminal configured to change the selected object and provide the modified object according to the recognized user gesture.

11. The system as claimed in claim 10, wherein the first terminal is configured to store a plurality of objects and detect the selection command to select at least one object from among a plurality of stored objects.

12. The system as claimed in claim 10, wherein the second terminal is configured to transmit the recognized user gesture to at least one of the third terminal and the first terminal.

13. The system as claimed in claim 12, wherein the first terminal is configured to modify the selected object and transmit the modified object to the third terminal in response to receiving the recognized user gesture from the second terminal.

14. The system as claimed in claim 10, wherein the first terminal comprises the second terminal.

15. The system as claimed in claim 10, wherein the third terminal comprises a display device,

wherein the third terminal is configured to receive a selected object from the first terminal, receive the recognized user gesture from the second terminal and modify the selected object according to the recognized user gesture, and

wherein the display device is configured to display the object.

16. The system as claimed in claim 10, wherein the first terminal comprises a display,

wherein the display is configured to display a folder,

wherein in response to detecting a gesture selecting the folder, the first terminal is configured to compress the folder to a compressed file and transmit the compressed file to the third terminal, and

wherein the third terminal is configured to provide the compressed file.

17. The system as claimed in claim 10, wherein the third terminal comprises a display device,

wherein the first terminal is configured to store a content, in response to the gesture selecting the content being received from the second terminal, detect a figure included in the content, and transmit the content and the figure to the third terminal, and

wherein the display device is configured to display the content including the figure.

18. The system as claimed in claim 10, wherein the first terminal comprises a first display device and the third terminal comprises a second display device,

wherein the first terminal is configured to display a letter on the first display device, convert the letter into a text file in response to the letter being selected, and transmit the text file to the third terminal, and

wherein the third terminal is configured to display the text data on the third display device.

19. The system as claimed in claim 15, wherein the first terminal comprises a second display device,

wherein the first terminal is configured to display a folder on the second display device, and in response to detecting a gesture selecting the folder, transmit the folder to a cloud server,

wherein the cloud server is configured to generate a compressed file by compressing the folder, and transmit the generated compressed file to the third device, and

wherein the display device is configured to provide the generated compressed file.

20. The system as claimed in claim 15, wherein the first terminal is configured to store a content, and in response to detecting a gesture for selecting the content, transmit the content to a cloud server,

wherein the cloud server is configured to detect a figure from the content and transmit the content and the figure to the display device, and

wherein the display device is configured to display the content and the figure.

21. A device for providing a modified object to an external device, the device comprising:

a display configured to display a user interface;

a gesture recognizer configured to recognize a selection gesture indicating a portion of the user interface as a selected object and a modification gesture indicating a desired modification to the selected object;

a transceiver configured to communicate with the external device; and

a controller configured to modify the selected object in accordance with the desired modification and control the transmitter to transmit the modified object to the external device.

22. A device for providing a modified object received from an external device, the device comprising:

a display configured to display a user interface;

a gesture recognizer configured to recognize a selection gesture selecting an object displayed on the external device as a selected object and a modification gesture indicating a desired modification to the selected object;

a transceiver configured to communicate with the external device; and

a controller configured to control the transceiver to transmit a request to the external device requesting the object and to receive the requested object, and modify the received object in accordance with the desired modification.

23. A method of interacting with a first device and a second device across a cloud computing system, the method comprising:

displaying a graphic user interface comprising a plurality of selectable objects on a first display of the first device;

detecting a selection gesture to select one or more of the plurality of selectable objects, the hand gesture detected by an imaging device of the first device;

detecting a modification gesture indicating one or more desired modifications to the selected one or more objects by the imaging device of the first device;

transmitting the selected one or more objects and the one or more desired modification from the first device to the cloud computing system;

receiving the selected one or more objects and the one or more desired modification from the first device at the cloud computing system;

modifying the received one or more objects on the cloud computing system in accordance with the one or more desired modifications;

transmitting the one or more modified objects from the cloud computing system to the second device;

receiving the one or more modified objects from the cloud computing system on the second device; and

displaying a graphic user interface comprising the one or more modified objects on a second display of the second device.