INTELLIGENT IMAGE SURVEILLANCE SYSTEM USING NETWORK CAMERA AND METHOD THEREFOR

• US 20130141543A1
• Filed: 05/23/2012
• Published: 06/06/2013
• Est. Priority Date: 05/26/2011
• Status: Active Grant

• Current Assignee: LG CNS Company Limited (LG Corporation)
• Original Assignee: LG CNS Company Limited (LG Corporation)
• Inventors: CHOI, Sung Hoon, LEE, Sang Jean
• Granted Patent: US 9,143,759 B2
• Time in Patent Office: Days
• US Class Current: 348/47
• CPC Class Codes: G06T 15/00 3D [Three Dimensional] image rendering
• CPC Class Codes: G08B 13/19641 Multiple cameras having overlapping views on a single scene
• CPC Class Codes: G08B 13/19667 Details realated to data compression, encryption or encoding, e.g. resolution modes for reducing data volume to lower transmission bandwidth or memory requirements
• CPC Class Codes: G08B 13/19671 Addition of non-video data, i.e. metadata, to video stream
• CPC Class Codes: G08B 13/19691 Signalling events for better perception by user, e.g. indicating alarms by making display brighter, adding text, creating a sound
• CPC Class Codes: H04N 13/204 using stereoscopic image cameras stereoscopic photography G03B35/00
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

An intelligent control system according to an exemplary embodiment of the present disclosure includes a plurality of network cameras to photograph a surveillance area; an image gate unit to perform image processing of image data, which is input from the plurality of network cameras, according to a specification that is requested by a user; a smart image providing unit to convert a plurality of image streams, which are image processed by the image gate unit, to a single image stream; and an image display unit to generate a three-dimensional (3D) image by segmenting, into a plurality of images, the single image stream that is input from the smart image providing unit and by disposing the segmented images on corresponding positions on a 3D modeling.

Claims

1. An intelligent control system, comprising:

a plurality of network cameras to monitor a surveillance area;

an image gate unit to perform image processing of image data, which is input from the plurality of network cameras, according to a specification that is requested by a user;

a smart image providing unit to convert a plurality of image streams, which is image processed by the image gate unit, to a single image stream; and

an image display unit to generate a three-dimensional (3D) image by segmenting, into a plurality of images, the single image stream that is input from the smart image providing unit and by disposing the segmented images on corresponding positions on a 3D modeling.

2. The system of claim 1, further comprising:

a user providing unit to provide a plurality of users, present in a network, with the plurality of image streams that are image processed by the image gate unit.

3. The system of claim 1, further comprising:

a senior supervisor providing unit to provide a senior supervisor, present in the network, with a final screen that is output by the image display unit.

4. The system of claim 1, wherein the image gate unit includes a plurality of image gates to process image data that is input from a predetermined network camera group among the plurality of network cameras.

5. The system of claim 4, wherein:

each of the plurality of image gates includes a plurality of image processors, and

the plurality of image processors are connected one-to-one with cameras belonging to the network camera group, respectively.

6. The system of claim 4, wherein each of the image processors comprises:

a decoder to decode image data that is input in real time from the plurality of network cameras;

a plurality of processors to perform image processing of the image data, which is decoded by the decoder, according to the specification that is requested by the user;

a plurality of encoders to encode data that is image processed by the plurality of processors; and

a plurality of streamers to perform image streaming of the data that is encoded by the plurality of encoders.

7. The system of claim 1, wherein the smart image providing unit comprises:

a plurality of image allocation units to generate image segmentation information for disposing image data, input from the image gate unit, as different sizes of images on a single screen.

8. The system of claim 7, wherein the plurality of image allocation units dispose the image data, input from the image gate unit, as the different sizes of images according to resolutions of the image data.

9. The system of claim 1, wherein the smart image providing unit comprises:

a plurality of decoders to decode image data that is input from the image gate unit; and

a plurality of encoders to provide a multi-streaming service by encoding and streaming a plurality of images that are decoded by the plurality of decoders.

10. The system of claim 1, wherein the image display unit comprises:

a plurality of image displays to display the plurality of images on different screens in response to a request of the user.

11. The system of claim 10, wherein each of the plurality of image displays comprises:

an image segmentation unit to segment a single image stream, input from the smart image providing unit, into a plurality of images for configuring a single screen;

a 3D model generator to model the surveillance area to a 3D image; and

a rendering processor to generate a 3D image by disposing the images, input from the image segmentation unit, on corresponding positions of the 3D modeling.

12. The system of claim 11, wherein each of the image displays further comprises:

a decoder to decode the single image stream that is input from the smart image providing unit, and to provide the decoded image stream to the image segmentation unit; and

a display unit to display the 3D image that is generated by the rendering processor.

13. The system of claim 1, further comprising:

a user interface unit to calculate resolutions of a plurality of images to be included in a corresponding screen by analyzing the screen expressed by the image display unit, and to provide the calculated resolutions to the image gate unit.

14. The system of claim 1 or 10, further comprising:

a plurality of encoders to encode the screen, finally output by the image display unit in real time, in order to provide the senior supervisor with the finally output screen, and to perform multi-streaming of the encoded screen.

15. The system of claim 1, wherein the image gate unit, the smart image providing unit, and the image display unit encode and decode the image data using H.264 or MPEC 4.

16. An intelligent control method, comprising the computer implemented steps of:

receiving, from a plurality of network cameras, image data in which a surveillance area is monitored;

performing image processing of the received image data according to a specification that is requested by a user;

converting the plurality of image processed image data to a single image stream to be displayed on a single screen; and

generating a 3D image by segmenting the converted single image stream into a plurality of images, and by disposing the segmented images on corresponding positions of a 3D modeling.

17. The method of claim 16, further comprising the computer implemented steps of:

providing a plurality of users, present in a network, with the plurality of image processed image streams; and

providing a senior supervisor, present in the network, with the generated 3D image.

18. The method of claim 16, wherein the performing of the image processing comprises the computer implemented steps of:

decoding the received image data;

performing image processing of the decoded image data according to the specification that is requested by the user; and

encoding the image processed data and performing image streaming of the encoded data.

19. The method of claim 16, wherein the converting comprises the computer implemented steps of:

decoding the plurality of image processed image data;

generating image segmentation information for disposing the plurality of decoded images as different sizes of images on a single screen; and

encoding the plurality of decoded images to convert the plurality of encoded images to a single image stream.

20. The method of claim 16, wherein the generating comprises the computer implemented steps of:

segmenting the converted single image stream into a plurality of images for configuring a single screen;

modeling the surveillance area to a 3D image; and

generating the 3D image by disposing the plurality of segmented images on corresponding positions of the 3D modeling.