Video processing system and video processing method

• US 8,989,553 B2
• Filed: 06/19/2013
• Issued: 03/24/2015
• Est. Priority Date: 01/12/2008
• Status: Active Grant

• Current Assignee: N3N Co., Ltd.
• Original Assignee: Innotive Inc, Korea
• Inventors: Chang, Peter Taehwan, Kim, Dae Hee, Kim, Kyung Hun, Lee, Jun Seok, Chung, Jae Sung
• Primary Examiner(s): Vaughn, Jr., William C
• Assistant Examiner(s): ADAMS, EILEEN M
• Application Number:
  US13/921,650
• Publication Number:
  US 20130279871A1
• Time in Patent Office: 643 Days
• Field of Search: None
• US Class Current: 386/224
• CPC Class Codes: H04N 21/2187 Live feed
• CPC Class Codes: H04N 21/2343 involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements video transcoding H04N19/40; media packet handling at the source H04L65/762
• CPC Class Codes: H04N 21/234327 by decomposing into layers, e.g. base layer and one or more enhancement layers
• CPC Class Codes: H04N 21/234363 by altering the spatial resolution, e.g. for clients with a lower screen resolution
• CPC Class Codes: H04N 21/234381 by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping
• CPC Class Codes: H04N 21/258 Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data arrangements for services using the result on the distributing side of broadcast systems H04H60/66; profiles in network data switching protocols H04L67/30
• CPC Class Codes: H04N 21/25808 Management of client data terminal profiles in network data switching protocols H04L67/303
• CPC Class Codes: H04N 21/2665 Gathering content from different sources, e.g. Internet and satellite
• CPC Class Codes: H04N 5/765 Interface circuits between an apparatus for recording and another apparatus
• CPC Class Codes: H04N 5/77 between a recording apparatus and a television camera
• CPC Class Codes: H04N 5/772 the recording apparatus and the television camera being placed in the same enclosure
• CPC Class Codes: H04N 9/8042 involving data reduction

Abstract

A video processing system includes: a merge server configured to decode a plurality of individual videos provided from video providing units, encode the plurality of individual videos by adjusting an amount of data of each of the individual videos to generate a preliminary video, and provide the preliminary video; a display server configured to receive the preliminary video and configure final videos according to output conditions of a display device; and a control server configured to receive the output conditions from the display server and transfer an output control signal with respect to the preliminary video to the merge server. When a user wants, individual videos provided from the plurality of video providing units can be displayed on a display device without sacrificing resolution and a frame rate, and since videos can be zoomed in/out and panned in real time, operational responsiveness and usage efficiency of the video processing system can be enhanced.

Claims

1. A video processing system comprising:

a merge server configured to decode a plurality of individual videos provided from video providing units, encode the plurality of individual videos by adjusting an amount of data of each of the individual videos to generate a preliminary video, and provide the preliminary video;

a display server configured to receive the preliminary video and configure final videos according to output conditions of a display device; and

a control server configured to receive the output conditions from the display server and transfer an output control signal with respect to the preliminary video to the merge server,

wherein the display server provides temporary videos partially satisfying changed output conditions of the display device when the output conditions are changed, to the display device, and when a preliminary video satisfying the changed output conditions is provided, the display server reconfigures final videos by using the preliminary video.

2. The video processing system of claim 1, wherein the preliminary video include first preliminary video obtained by encoding all of the plurality of individual videos such that an amount of data is reduced to be smaller than that of the original data, and second preliminary video obtained by encoding only individual videos to be displayed on the display device, among the plurality of individual videos, according to the output conditions of the display device.

3. The video processing system of claim 2, wherein the first preliminary video is obtained by decoding the plurality of individual videos, merging the decode individual videos into a single video, and subsequently encoding the merged video, wherein the videos included in the merged video have resolution lower than that of the plurality of individual videos, and

the second preliminary video is obtained by encoding the individual videos such that it has resolution different from that of the videos included in the merged video.

4. The video processing system of claim 2, wherein the first preliminary video is obtained by decoding the plurality of individual videos and subsequently encoding them to have low resolution, and

the second preliminary video is obtained by encoding the individual videos to have resolution different from that of the first preliminary video.

5. The video processing system of claim 2, wherein the first preliminary video is data of a base layer obtained by decoding the plurality of individual videos and subsequently encoding them by using SVC (Scalable Video Coding), and

the second preliminary video is data of an enhanced layer with respected to the the first preliminary video.

6. The video processing system of claim 1, wherein the video providing units include one or more cameras and a video server receiving videos from the one or more cameras, processing the received videos, and providing individual videos to the merge server.

7. The video processing system of claim 6, wherein one or more video servers are provided, and the video servers are connected to the merge server via a first network.

8. The video processing system of claim 7, wherein one or more merge servers are provided and connected to the display server via a second network.

9. The video processing system of claim 8, wherein one or more display servers are provided, and the display servers and the merge servers are connected to the control server via a third network.

10. The video processing system of claim 1, wherein the display server converts a plurality of video streams provided from the merge server into YUV frames, stores the YUV frames in a screen-size YUV surface, and converts the screen-size YUV surface into an RGB color space in an RGB screen buffer, and output an entire screen.

11. The video processing system of claim 10, wherein the screen-size YUV surface is converted according to the output conditions.

12. A video processing method of a video processing system, the method comprising:

receiving a plurality of individual videos from video providing units;

encoding the individual videos into a preliminary video according to output conditions of a display device;

receiving the preliminary video and configuring final videos according to the output conditions; and

displaying the final videos on the display device, wherein the preliminary video includes any one of a first preliminary video obtained by encoding all of the plurality of individual videos such that an amount of data thereof is reduced to be smaller than an amount of the original data and a second preliminary video obtained by encoding only individual videos to be displayed on the display device,

among the plurality of individual videos, according to output conditions,

wherein in the configuring of the final videos, when the output conditions of the display device are charged, temporary videos partially satisfying the changed output conditions are configured as final videos, and when the second preliminary video according to the changed output conditions is provided, final videos are reconfigured by using the second preliminary video.

13. The method of claim 12, wherein the first preliminary video is obtained by decoding the plurality of individual videos, merging the decode individual videos into a single video, and subsequently encoding the merged video, wherein the videos included in the merged video have resolution equal to or different from that of the plurality of individual videos, and

the second preliminary video is obtained by encoding the individual videos such that it has resolution different from that of the videos included in the merged video.

14. The method of claim 12, wherein the first preliminary video is obtained by decoding the plurality of individual videos and subsequently encoding them to have low resolution, and

the second preliminary video is obtained by encoding the individual videos to have resolution different from that of the first preliminary video.

15. The method of claim 12, wherein the first preliminary video is data of a base layer obtained by decoding the plurality of individual videos and subsequently encoding them by using SVC (Scalable Video Coding), and

the second preliminary video is data of an enhanced layer with respected to the the first preliminary video.

16. The method of claim 12, wherein in the receiving of the preliminary video and configuring final videos according to the output conditions, the plurality of preliminary videos are converted into a YUV color space and stored in a screen-size YUV plane, and after the YUV surface is converted into an RGB color space in an RGB screen buffer, an entire screen is output.

17. The method of claim 16, wherein the screen-size YUV surface is converted according to the output conditions.