Method and device for controlling screen sharing among plurality of terminals, and recording medium

• US 10,671,336 B2
• Filed: 11/02/2015
• Issued: 06/02/2020
• Est. Priority Date: 11/05/2014
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Kim, Yong-tae
• Primary Examiner(s): Winder, Patrice L
• Application Number:
  US15/524,993
• Publication Number:
  US 20180285054A1
• Time in Patent Office: 1,674 Days
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G06F 3/1462 with means for detecting differences between the image stored in the host and the images displayed on the remote displays
• CPC Class Codes: G09G 2350/00 Solving problems of bandwidth in display systems
• CPC Class Codes: G09G 2360/08 Power processing, i.e. workload management for processors involved in display operations, such as CPUs or GPUs
• CPC Class Codes: H04L 41/5067 Customer-centric QoS measurements
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46

Abstract

The present disclosure relates to technologies for sensor networks, machine to machine (M2M), machine type communication (MTC), and Internet of Things (IoT). The present disclosure may be used in intelligent services based on such technologies (smart homes, smart buildings, smart cities, smart cars or connected cars, health care, digital educations, retail businesses, securities, disaster network communication, and safety-related services). Provided is a method of controlling, by a relay device, screen sharing between a plurality of terminals, the method includes: receiving a screen image of a first terminal from the first terminal; and transmitting the received screen image to at least one second terminal.

Claims

1. A method of controlling, by a relay device, screen sharing between a plurality of terminals, the method comprising:

obtaining capability information of a first terminal for transmitting a screen image, and status information of a network for indicating a degree of congestion of the network between the relay device and at least one second terminal, wherein the capability information comprises at least one of information on CPU usage, an encoding processing time and a frame rate;

determining an encoding quality of the first terminal about the screen image based on the capability information and the status information for indicating the degree of congestion of the network;

transmitting information about the determined encoding quality to the first terminal;

receiving a first screen image, encoded at the first terminal based on the encoding quality; and

transmitting the first screen image to the at least one second terminal,

wherein the determined encoding quality corresponds to one of a plurality of encoding quality levels supported by the first terminal.

2. The method of claim 1, wherein the determining of the encoding quality comprises:

determining a bit rate for transmitting the first screen image to the at least one second terminal, based on the status information; and

determining the encoding quality comprising at least one of resolution and a frame rate, based on the determined bit rate.

3. The method of claim 1, wherein the relay device is selected as the first terminal based on capability information of each of a plurality of second terminals that receives the screen image of the first terminal and the status information of the network to which each of the plurality of second terminals is included.

4. The method of claim 1, wherein the status information of the network for indicating a degree of congestion of the network includes information about at least one of a round trip time (RTT), a data exchange delay time, and a data loss rate.

14. A non-transitory computer-readable recording medium having recorded thereon a program which, when executed by a computer, performs the method of claim 1.

5. A relay device for controlling screen sharing between a plurality of terminals, the relay device comprising:

a communication interface configured to obtain capability information of a first terminal for transmitting a screen image and status information of a network for indicating a degree of congestion of the network between the relay device and at least one second terminal, wherein the capability information comprises at least one of information on CPU usage, an encoding processing time and a frame rate; and

a processor configured to determine an encoding quality of first terminal about the screen image of the first terminal based on the capability information and the status information for indicating the degree of congestion of the network,

wherein the communication interface transmits information about the determined encoding quality to the first terminal, receives a first screen image, encoded at the first terminal based on the encoding quality, and transmits the first screen image to the at least one second terminal, and

wherein the determined encoding quality corresponds to one of a plurality of encoding quality levels supported by the first terminal.

6. The relay device of claim 5, wherein the processor is further configured to determine a bit rate for transmitting the first screen image to the at least one second terminal based on the status information, and determine the encoding quality comprising at least one of resolution and a frame rate based on the determined bit rate.

7. The relay device of claim 5, wherein the relay device is selected at the first terminal based on capability information of each of a plurality of second terminals that receives the screen image of the first terminal and the status information of the network to which each of the plurality of second terminals is included.

8. The relay device of claim 5, wherein the status information of the network for indicating a degree of congestion of the network includes information about at least one of a round trip time (RTT), a data exchange delay time, and a data loss rate.

9. A first terminal for controlling screen sharing between a plurality of terminals, the first terminal comprising:

a communication interface configured to obtain, from a relay device that transmits a screen image of the first terminal to at least one second terminal, information about an encoding quality of the screen image of the first terminal, which is determined based on capability information of the first terminal for transmitting the screen image and status information of a network for indicating a degree of congestion of the network between the relay device and the at least one second terminal, wherein the capability information comprises at least one of information on CPU usage, an encoding processing time and a frame rate;

a processor configured to determine the encoding quality of the screen image of the first terminal based on the obtained information about the encoding quality; and

an encoder configured to encode the screen image of the first terminal based on the determined encoding quality,

wherein the communication interface is further configured to transmit the encoded screen image to the relay device,

the encoded screen image is transmitted to the at least one second terminal through the relay device, and

the determined encoding quality corresponds to one of a plurality of encoding quality levels supported by the first terminal.

10. The first terminal of claim 9, wherein the processor is further configured to select at least one of a plurality of second terminals as the relay device based on capability information of each of the plurality of second terminals that receives the screen image of the first terminal and the status information of the network to which each of the plurality of second terminals is included, and

the communication interface is further configured to transmit a message notifying the selection of the relay device to each of the plurality of second terminals.

11. The first terminal of claim 9, wherein the status information of the network for indicating a degree of congestion of the network includes information about at least one of a round trip time (RTT), a data exchange delay time, and a data loss rate.

12. A second terminal for controlling screen sharing between a plurality of terminals, the second terminal comprising:

a processor configured to obtain, by the second terminal that receives a screen image of a first terminal, status information of a network for indicating a degree of congestion of the network to which the second terminal is included; and

a communication interface configured to transmit the obtained status information, and receive an encoded screen image, encoded at the first terminal, from a relay device, according to an encoding quality determined at the relay device,

wherein the encoding quality is determined based on capability information of a first terminal for transmitting the screen image and the status information of a network for indicating the degree of congestion of the network between the relay device and at least one second terminal, wherein the capability information comprises at least one of information on CPU usage, an encoding processing time and a frame rate.

13. The second terminal of claim 12, wherein the status information of the network for indicating a degree of congestion of the network includes information about at least one of a round trip time (RTT), a data exchange delay time, and a data loss rate.