Method and device for screen mirroring

• US 9,800,919 B2
• Filed: 12/31/2014
• Issued: 10/24/2017
• Est. Priority Date: 01/08/2014
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Hahm, Seong-il
• Primary Examiner(s): Kumar, Pankaj
• Assistant Examiner(s): Tilahun, Alazar
• Application Number:
  US14/587,450
• Publication Number:
  US 20150195601A1
• Time in Patent Office: 1,028 Days
• CPC Class Codes: G06F 3/1462 with means for detecting differences between the image stored in the host and the images displayed on the remote displays
• CPC Class Codes: G09G 2340/04 Changes in size, position or resolution of an image
• CPC Class Codes: G09G 2352/00 Parallel handling of streams of display data
• CPC Class Codes: G09G 5/14 Display of multiple viewports
• CPC Class Codes: H04N 21/2383 Channel coding or modulation of digital bit-stream, e.g. QPSK modulation arrangements for detecting or preventing errors in the information received by adapting the channel coding H04L1/0009; analogue front ends or means for connecting modulators, demodulators or transceivers to a transmission line H04L27/0002
• CPC Class Codes: H04N 21/2393 involving handling client requests scheduling or organising the servicing of application requests H04L67/60
• CPC Class Codes: H04N 21/4122 additional display device, e.g. video projector digital output for controlling a plurality of local displays G06F3/1423
• CPC Class Codes: H04N 21/4126 The peripheral being portable, e.g. PDAs or mobile phones
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/43072 of multiple content streams on the same device
• CPC Class Codes: H04N 21/43076 of the same content streams on multiple devices, e.g. when family members are watching the same movie on different devices
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/43615 Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals home Audio Video Interoperability [HAVI] data switching networks H04L12/2805
• CPC Class Codes: H04N 21/43637 involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11] arrangements for wireless networking or broadcasting of information in indoor or near-field type systems H04B10/114
• CPC Class Codes: H04N 21/47202 for requesting content on demand, e.g. video on demand
• CPC Class Codes: H04N 21/4858 for modifying screen layout parameters, e.g. fonts, size of the windows
• CPC Class Codes: H04N 21/6587 Control parameters, e.g. trick play commands, viewpoint selection

Abstract

A method of reproducing a streaming video received from a source device is provided. The method including reproducing, by a sync device, a first streaming video representing an image on a screen of the source device, the first streaming video being reproduced using a full screen player, when a partial area of the image on the screen of the source device changes, receiving, from the source device, a second streaming video including change information about the partial area, determining a partial screen player to reproduce the second streaming video, and reproducing the second streaming video in an area of a screen of the sync device which corresponds to the partial area of the image on the screen of the source device, the second streaming video being reproduced using the partial screen player.

Claims

1. A method of reproducing a streaming video received from a source device, the method comprising:

reproducing, by a sync device, a first streaming video representing an image on a screen of the source device, the first streaming video being reproduced using a full screen player;

when a partial area of the image on the screen of the source device changes, receiving, from the source device, a second streaming video comprising change information about the partial area, and pausing the full screen player by displaying an image of the full screen player at a moment before the pausing;

determining a partial screen player to reproduce the second streaming video; and

reproducing the second streaming video in an area of a screen of the sync device which corresponds to the partial area of the image on the screen of the source device, wherein the second streaming video is reproduced using the partial screen player and wherein the image of the full screen player at the moment before the pausing is displayed on the screen of the sync device.

2. The method of claim 1, wherein, when a plurality of areas of the image on the screen of the source device change, the determining of the partial screen player comprises determining a plurality of partial screen players.

3. The method of claim 1, wherein the change information of the second streaming video is received from the source device in a form of metadata.

4. The method of claim 1, wherein the reproducing of the second streaming video comprises determining, based on the change information, a position and a size of an area of the screen of the sync device where a reproduction image of the partial screen player is to be displayed.

5. The method of claim 1, wherein the reproducing of the second streaming video further comprises one of pausing or stopping other players from among players executed by the sync device, except for the partial screen player.

6. The method of claim 1, wherein the reproducing of the second streaming video further comprises:

receiving, from the source device, a request to pause the partial screen player;

pausing the partial screen player;

receiving, from the source device, a request to resume the full screen player; and

resuming the full screen player.

7. A non-transitory computer-readable recording medium having a program recorded thereon, the program causing a computer to execute the method of claim 1.

8. A method of transmitting a streaming video to a sync device, the method comprising:

transmitting, by a source device, a first streaming video representing an image displayed on a screen of the source device, the first streaming video being transmitted to the sync device;

determining whether a partial area of the image displayed on the screen of the source device has changed;

extracting change information about the changed partial area;

encoding the partial area of the image into a second streaming video, based on the change information;

transmitting the second streaming video to the sync device; and

stopping the transmitting of the first streaming video to the sync device,

wherein the second streaming video is reproduced, by the sync device, in an area of a screen of the sync device which corresponds to the partial area of the image on the screen of the source device, and

wherein the screen of the sync device displays an image of the first streaming video at a moment before the stopping transmitting the first streaming video.

9. The method of claim 8, wherein the extracting of the change information comprises determining a transmission area comprising the changed partial area, and extracting a pixel value of the transmission area.

10. A sync device for reproducing a streaming video received from a source device, the sync device comprising:

a memory configured to store thereon instructions;

at least one processor executing the instructions being configured to reproduce a first streaming video representing an image on a screen of the source device, the first streaming video being reproduced using a full screen player; and

a communication interface configured to, when a partial area of the image on the screen of the source device changes, receive, from the source device, a second streaming video comprising change information about the partial area;

wherein the at least one processor is further configured to;

pause the full screen player by displaying an image of the full screen player at a moment before the pausing,

determine a partial screen player to reproduce the second streaming video, and

reproduce the second streaming video in an area of a screen of the sync device which corresponds to the partial area of the image on the screen of the source device, the second streaming video being reproduced using the partial screen player, and

wherein the image of the full screen player at the moment before the pausing is displayed on the screen of the sync device.

11. The sync device of claim 10, wherein, when a plurality of areas of the image on the screen of the source device change, the at least one processor is further configured to determine a plurality of partial screen players.

12. The sync device of claim 10, wherein the change information of the second streaming video is received from the source device in a form of metadata.

13. The sync device of claim 10, wherein the at least one processor is further configured to determine, based on the change information, a position and a size of an area of the screen of the sync device where a reproduction image of the partial screen player is to be displayed.

14. The sync device of claim 10, wherein the data communication interface is further configured to receive, from the source device, a request to pause the full screen player.

15. The sync device of claim 14,

wherein the data communication interface is further configured to receive, from the source device, a request to pause the partial screen player and a request to resume the full screen player, and

wherein the at least one processor is further configured to pause the partial screen player and resume the full screen player based on the received request to pause the partial screen player and the received request to resume the full screen player.

16. A source device for transmitting a streaming video to a sync device, the source device comprising:

a data communication interface configured to transmit a first streaming video representing an image displayed on a screen of the source device, the first streaming video being transmitted to the sync device;

at least one processor configured to;

determine whether a partial area of the image displayed on the screen of the source device has changed and to extract change information about the changed partial area, and

encode the partial area of the image into a second streaming video,

based on the change information,

wherein the data communication interface is further configured to transmit the second streaming video to the sync device,

wherein the at least one processor is further configured to stop the transmitting of the first streaming video to the sync device,

wherein the second streaming video is reproduced, by the sync device, in an area of a screen of the sync device which corresponds to the partial area of the image on the screen of the source device, and

wherein the screen of the sync device displays an image of the first streaming video at a moment before the stopping transmitting the first streaming video.

17. The source device of claim 16, wherein the at least one processor is further configured to:

determine a transmission area comprising the changed partial area, and

extract a pixel value of the transmission area.

18. The source device of claim 16, wherein the at least one processor is further configured to transmit, to the sync device, one of a request to pause or a request to resume at least one player from among players that are executed by the sync device.