System for cloud streaming service, method for same using still-image compression technique and apparatus therefor

• US 10,652,591 B2
• Filed: 01/30/2017
• Issued: 05/12/2020
• Est. Priority Date: 07/30/2014
• Status: Active Grant

• Current Assignee: SK Planet Co., Ltd. (SK Telecom Co., Ltd.)
• Original Assignee: SK Planet Co., Ltd. (SK Telecom Co., Ltd.)
• Inventors: Bae, Tae-Meon, Yun, Hong-Seo, Na, Hyun-Sik, Kim, Dong-Gook, Jung, Yoo-Ri, Lee, Dong-Su
• Primary Examiner(s): Bezuayehu, Solomon G
• Application Number:
  US15/420,030
• Publication Number:
  US 20170142452A1
• Time in Patent Office: 1,198 Days
• CPC Class Codes: G06F 3/1415 with means for detecting differences between the image stored in the host and the images displayed on the displays
• CPC Class Codes: G09G 2320/0613 The adjustment depending on the type of the information to be displayed
• CPC Class Codes: G09G 2340/02 Handling of images in compressed format, e.g. JPEG, MPEG
• CPC Class Codes: G09G 2360/08 Power processing, i.e. workload management for processors involved in display operations, such as CPUs or GPUs
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04N 19/12 Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
• CPC Class Codes: H04N 19/129 Scanning of coding units, e.g. zig-zag scan of transform coefficients or flexible macroblock ordering [FMO]
• CPC Class Codes: H04N 19/136 Incoming video signal characteristics or properties
• CPC Class Codes: H04N 19/17 the unit being an image region, e.g. an object
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/182 the unit being a pixel
• CPC Class Codes: H04N 19/507 using conditional replenishment
• CPC Class Codes: H04N 21/222 Secondary servers, e.g. proxy server, cable television Head-end provisioning of proxy services in data packet switching networks H04L67/56
• CPC Class Codes: H04N 21/234 Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
• CPC Class Codes: H04N 21/23605 Creation or processing of packetized elementary streams [PES]

Abstract

The present invention relates to a system for a cloud streaming service, a method for same using a still-image compression technique and an apparatus therefor, particularly the method allowing a still image-based cloud streaming service by comparing the previous frame and current frame to determine and capture the region in the current frame which has changed from the previous frame, and transmitting, to a user, the changed region encoded with the still-image compression technique. By utilizing a still-image compression technique appropriate to the image type when providing the cloud streaming service, the compression efficiency of the still image and the speed of the cloud streaming service can be improved.

Claims

1. A cloud streaming server comprising:

a memory;

a processor configured to execute instructions stored in the memory and to;

communicate with a user device via a network;

determine a changed region of a current frame changed from a previous frame by comparing the current frame with the previous frame;

capture the changed region;

perform a still image encoding of the changed region corresponding to one frame by using a still image compression technique; and

perform a cloud streaming service based on a still image by sending the still-image-encoded changed region to the user device,

wherein the processor is further configured to;

identify an application type of the user device from an input signal of the user device, wherein the application type of the user device comprises a static type and a dynamic type;

detect a section having a less frame change than a predetermined value from among all frames transmitted to the user device when the application type of the user device is identified to be the static type;

capture the changed region in the detected section; and

select the still image compression technique in accordance with an image type determined by considering one or more of the number of colors of an image corresponding to the changed region and a standard deviation of pixel values of the image.

2. The cloud streaming server of claim 1, wherein the processor is further configured to:

calculate a differential frame between the previous frame and the current frame; and

determine the changed region by using the differential frame.

3. The cloud streaming server of claim 2, wherein the processor is further configured to determine the changed region by detecting a changed pixel of the current frame changed from the previous frame through a scanning of the differential frame.

4. The cloud streaming server of claim 3, wherein the processor is further configured to determine the changed region containing changed pixels detected through a horizontal scanning and a vertical scanning of the differential frame.

5. The cloud streaming server of claim 4, wherein the processor is further configured to:

obtain a first vertical coordinate element from a changed pixel firstly detected through the horizontal scanning of the differential frame on row-by-row basis from top to bottom;

obtain a second vertical coordinate element from a changed pixel firstly detected through the horizontal scanning of the differential frame on a row-by-row basis from bottom to top;

obtain a first horizontal coordinate element from a changed pixel firstly detected through the vertical scanning of the differential frame on a column-by-column basis from left to right;

obtain a second horizontal coordinate element from a changed pixel firstly detected through the vertical scanning of the differential frame on a column-by-column basis from right to left; and

determine, as the changed region, a rectangular region containing a changed pixel corresponding to a coordinate formed by a pair of one of the horizontal coordinate elements and one of the vertical coordinate elements.