METHOD OF TRANSMITTING INQUIRY MESSAGE, DISPLAY DEVICE FOR THE METHOD, METHOD OF SHARING INFORMATION, AND MOBILE TERMINAL

• US 20140033050A1
• Filed: 07/25/2013
• Published: 01/30/2014
• Est. Priority Date: 07/26/2012
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: SHIN, In-young, Choi, Won-jong
• Granted Patent: US 10,228,810 B2
• Time in Patent Office: Days
• US Class Current: 715/733
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: H04M 1/72412 using two-way short-range wireless interfaces
• CPC Class Codes: H04N 21/41265 having a remote control device for bidirectional communication between the remote control device and client device unidirectional remote control device H04N21/42204
• CPC Class Codes: H04N 21/42204 User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205
• CPC Class Codes: H04N 21/43637 involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11] arrangements for wireless networking or broadcasting of information in indoor or near-field type systems H04B10/114
• CPC Class Codes: H04N 21/4722 for requesting additional data associated with the content
• CPC Class Codes: H04N 21/4758 for providing answers, e.g. voting
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104

Abstract

A method of transmitting an inquiry message, performed by a display device, includes operations of reproducing content in the display device; receiving an input from a user, wherein the input from the user is related to the content; generating an inquiry message about the content, based on the input from the user; extracting information, which is related to the input from the user, from the content; and transmitting the extracted information and the inquiry message to an external device that is connected with the display device.

Claims

1. A method of transmitting an inquiry message, performed by a display device, the method comprising:

reproducing content in the display device;

receiving an input from a user, wherein the input from the user is related to the content;

generating an inquiry message about the content, based on the input from the user;

extracting information, which is related to the input from the user, from the content; and

transmitting the extracted information and the inquiry message to an external device that is connected with the display device wirelessly or by wire.

2. The method of claim 1, wherein the extracted information comprises at least one of information about a frame of the content that is reproduced when the input from the user is received and additional information about the frame.

3. The method of claim 1, wherein the receiving of the input from the user further comprises analyzing the input from the user and determining whether the input from the user is related to the content.

4. The method of claim 3, wherein the determining comprises:

extracting at least one meaning unit by parsing the input from the user; and

determining a relation between the at least one meaning unit and the content, based on metadata of the content.

5. The method of claim 4, wherein the determining of the relation comprises:

obtaining a meaning unit related to the content from the metadata of the content, by using ontology; and

comparing the meaning unit related to the content with the at least one meaning unit.

6. The method of claim 1, wherein the receiving of the input from the user further comprises determining whether the input from the user corresponds to a predetermined sentence structure.

7. The method of claim 1, wherein the receiving of the input from the user comprises receiving at least one of a touch input, a voice input, a key input, a motion input, and a bending input.

8. The method of claim 1, wherein the receiving of the input from the user comprises obtaining at least one of a text message, a voice message, and an image that occur in response to the input from the user.

9. The method of claim 1, wherein the extracting comprises extracting at least one frame from the content and additional information about the at least one frame, based on at least one of an occurrence time of the input from the user, an elapsed-time of the input from the user, and an end time of the input from the user.

10. The method of claim 1, wherein the extracting comprises extracting a frame corresponding to a point of time at which a reproduction screen of the content is changed during an elapsed-time of the input from the user.

11. The method of claim 2, wherein the additional information about the frame comprises at least one of reproduction position information of the frame, sequence information of the frame, and object information about an object that is comprised in the frame.

12. The method of claim 1, wherein the transmitting further comprises adjusting at least one of a compression rate of a frame, resolution of a frame, and a total number of frames to be transmitted.

13. The method of claim 1, further comprising receiving input information of a user of the external device, from the external device.

14. The method of claim 13, further comprising displaying the inquiry message and the input information of the user of the external device on a share window for sharing information with the external device.

15. The method of claim 14, wherein the share window comprises at least one of a shared memo pad, a shared white board, and a message window.

16. The method of claim 14, further comprising displaying and overlaying the share window on an area that displays the content.

17. The method of claim 14, further comprising displaying the share window on a screen of another device that is connected with the display device.

18. The method of claim 1, wherein the content comprises at least one of broadcasting content, education content, music content, movie content, picture content, and electronic book content.

19. The method of claim 1, wherein the transmitting comprises transmitting the inquiry message by using at least one of a voice call signal, a videotelephony signal, and a message transmission signal.

20. The method of claim 1, further comprising:

receiving a connection request from the external device; and

authenticating a connection with the external device, in response to the connection request.

21. The method of claim 20, wherein the authenticating comprises authenticating the connection with the external device, based on at least one of identification (ID) information of the external device, ID information of a user of the external device, and one-time use authentication information.

22. The method of claim 1, further comprising:

transmitting a connection request to the external device; and

receiving a connection acceptance message from the external device, in response to the connection request.

60. A non-transitory computer-readable recording medium having recorded thereon a program for executing the method of claim 1.

23. A method of sharing, by a mobile device, information with an external display device, the method comprising:

receiving input information of a first user and related information from the external display device, wherein the input information of the first user is obtained while content is reproduced in the external display device, and the related information corresponds to at least one frame of the content that is reproduced in the external display device;

displaying the input information of the first user and the at least one frame;

obtaining input information of a second user that corresponds to the input information of the first user; and

transmitting the input information of the second user, to the external display device.

24. The method of claim 23, wherein the related information that corresponds to the at least one frame comprises a frame that is selected based on a point of time at which the input information of the first user is received, reproduction position information of the selected frame, sequence information of the selected frame, or object information about an object that is comprised in the selected frame.

25. The method of claim 23, further comprising reproducing and displaying content on a screen of the mobile device, wherein the content matches the content that is reproduced in the external display device.

26. The method of claim 23, further comprising displaying the input information of the first user and the input information of the second user on a share window for sharing information with the external display device.

27. The method of claim 26, wherein the share window comprises at least one of a shared memo pad, a shared white board, and a message window.

28. The method of claim 25, further comprising displaying and overlaying the input information of the first user and the input information of the second user on an area that displays the content.

29. The method of claim 26, further comprising displaying the share window comprising the input information of the first user and the input information of the second user on a screen of a device, other than the external display device, that is connected with the mobile device.

30. The method of claim 23, wherein the content comprises at least one of broadcasting content, education content, music content, movie content, picture content, and electronic book content.

31. The method of claim 23, further comprising:

transmitting a connection request to the external display device; and

receiving a connection acceptance message from the external display device, in response to the connection request.

32. The method of claim 23, further comprising:

requesting authentication from the external display device with respect to remote control of the external display device; and

receiving a remote control acceptance message from the external display device, in response to the requesting.

33. The method of claim 32, further comprising controlling at least one of a change of a reproduction position of the content that is reproduced in the external display device, a reproduction stop, an adjustment of reproduction speed, a volume adjustment, and a change of reproduction-target content.

61. A non-transitory computer-readable recording medium having recorded thereon a program for executing the method of claim 23.

34. A display device comprising:

a display for reproducing and displaying content on a screen of the display device;

a user input for receiving an input from a user wherein the input from the user is related to the content, and generating an inquiry message about the content, based on the input from the user;

an extractor for extracting information, which is related to the input from the user, from the content;

a communicator for transmitting the extracted information and the inquiry message to an external device; and

a controller for controlling the display, the user input, the extractor, and the communicator.

35. The display device of claim 34, wherein the extractor extracts at least one of information about a frame of the content that is reproduced when the input from the user is received and additional information about the frame.

36. The display device of claim 34, wherein the controller analyzes the input from the user and determines whether the input from the user is related to the content.

37. The display device of claim 36, wherein the controller extracts at least one meaning unit by parsing the input from the user, and determines a relation between the at least one meaning unit and the content, based on metadata of the content.

38. The display device of claim 37, wherein the controller obtains a meaning unit related to the content from the metadata of the content, by using ontology, and compares the meaning unit related to the content with the at least one meaning unit.

39. The display device of claim 34, wherein the controller determines whether the input from the user corresponds to a predetermined sentence structure.

40. The display device of claim 34, wherein the user input receives at least one of a touch input, a voice input, a key input, a motion input, and a bending input.

41. The display device of claim 34, wherein the extractor extracts at least one frame from the content and additional information about the at least one frame, based on at least one of an occurrence time of the input from user, an elapsed-time of the input from user, and an end time of the input from user.

42. The display device of claim 34, wherein the extractor extracts a frame corresponding to a point of time at which a reproduction screen of the content is changed during an input elapsed-time of the user.

43. The display device of claim 34, wherein the controller adjusts at least one of a compression rate of a frame, resolution of a frame, and a total number of frames to be transmitted.

44. The display device of claim 34, wherein the communicator receives input information of a user of the external device from the external device.

45. The display device of claim 44, wherein the display displays the inquiry message and the input information of the user of the external device on a share window for sharing information with the external device.

46. The display device of claim 45, wherein the display displays and overlays the share window on an area that displays the content.

47. The display device of claim 45, wherein the display displays the share window on a screen of another device that is connected with the display device.

48. The display device of claim 34, wherein the communicator transmits the inquiry message by using at least one of a voice call signal, a videotelephony signal, and a message transmission signal.

49. The display device of claim 34, wherein the communicator receives a connection request from the external device, and

the controller authenticates a connection with the external device, in response to the connection request.

50. The display device of claim 49, wherein the controller authenticates the connection with the external device, based on at least one of identification (ID) information of the external device, ID information of a user of the external device, and one-time use authentication information.

51. The display device of claim 34, wherein the communicator transmits a connection request to the external device, and receives a connection acceptance message from the external device, in response to the connection request.

52. A mobile device for sharing information with an external display device, the mobile device comprising:

a communicator for receiving input information of a first user and related information from the external display device, wherein the input information of the first user is obtained while content is reproduced in the external display device, and the related information corresponds to at least one frame of the content that is reproduced in the external display device, and for transmitting input information of a second user that corresponds to the input information of the first user, to the external display device;

a display for displaying the input information of the first user and the at least one frame;

a user input for obtaining the input information of the second user that corresponds to the input information of the first user; and

a controller for controlling the communicator, the display, and the user input.

53. The mobile device of claim 52, wherein the display reproduces and displays content on a screen of the mobile device, wherein the content matches the content that is reproduced in the external display device.

54. The mobile device of claim 52, wherein the display displays the input information of the first user and the input information of the second user on a share window for sharing information with the external display device.

55. The mobile device of claim 53, wherein the display displays and overlays the input information of the first user and the input information of the second user on an area that displays the content.

56. The mobile device of claim 54, wherein the display displays the share window comprising the input information of the first user and the input information of the second user on a screen of a device, other than the external display device, that is connected with the mobile device.

57. The mobile device of claim 52, wherein the communicator transmits a connection request to the external display device, and receives a connection acceptance message from the external display device, in response to the connection request.

58. The mobile device of claim 52, wherein the communicator requests authentication from the external display device with respect to remote control, and receives a remote control acceptance message from the external display device, in response to the requesting.

59. The mobile device of claim 58, wherein the controller controls at least one of a change of a reproduction position of the content that is reproduced in the external display device, a reproduction stop, an adjustment of reproduction speed, a volume adjustment, and a change of reproduction-target content.

62. A method of sharing, by a mobile device, information with an external display device, the method comprising:

receiving input information of a first user and related information from the external display device, wherein the input information of the first user is obtained while content is reproduced in the external display device, and the related information corresponds to at least one image of the content that is reproduced in the external display device; and

displaying the input information of the first user and the at least one image.

63. The method of claim 62, wherein the related information that corresponds to the at least one image comprises an image that is selected based on a point of time at which the input information of the first user is received, reproduction position information of the selected image, sequence information of the selected image, or object information about an object that is comprised in the selected image.

64. The method of claim 62, further comprising reproducing and displaying content on a screen of the mobile device, wherein the content matches the content that is reproduced in the external display device.

65. The method of claim 62, further comprising:

obtaining input information of a second user that corresponds to the input information of the first user; and

transmitting the input information of the second user, to the external display device.

66. The method of claim 65, further comprising displaying the input information of the first user and the input information of the second user on a share window for sharing information with the external display device.

67. The method of claim 65, further comprising displaying and overlaying the input information of the first user and the input information of the second user on an area that displays the content.

68. The method of claim 62, further comprising controlling at least one of a change of a reproduction position of the content that is reproduced in the external display device, a reproduction stop, an adjustment of reproduction speed, a volume adjustment, and a change of reproduction-target content.

69. The method of claim 62, wherein the image is a frame.