Method and system for split-screen video display

• US 8,736,680 B1
• Filed: 05/17/2011
• Issued: 05/27/2014
• Est. Priority Date: 05/18/2010
• Status: Active Grant

• Current Assignee: Watchguard Video Incorporated (Motorola Solutions, Inc.)
• Original Assignee: Enforcement Video Incorporated (Enforcement Technology Group Incorporated)
• Inventors: Cilia, Andrew, Vanman, Robert V.
• Primary Examiner(s): Patel, Jay
• Assistant Examiner(s): MIKESKA, NEIL R
• Application Number:
  US13/109,557
• Time in Patent Office: 1,106 Days
• Field of Search: 348/148, 348/207.1, 345/629
• US Class Current: 348/148
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: H04N 13/243 using three or more 2D image sensors
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 25/443 by reading pixels from selected 2D regions of the array, e.g. for windowing or digital zooming
• CPC Class Codes: H04N 5/2624 for obtaining an image which is composed of whole input images, e.g. splitscreen
• CPC Class Codes: H04N 5/272 Means for inserting a foreground image in a background image, i.e. inlay, outlay
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 9/79 Processing of colour television signals in connection with recording

Abstract

A system includes a first camera operable to capture omnidirectional images and send omnidirectional-image data representing the omnidirectional images, a second camera operable to capture narrow-view images and send narrow-view-image data representing the narrow-view images, a video processor coupled to the first camera and the second camera and operable to form combined-image data using at least part of the omnidirectional-image data and the narrow-view-image data, and a display module interoperably coupled to the video processor and operable to display combined images from the combined-image data. The combined images each comprise a narrow-view-display portion and an omnidirectional-display portion.

Claims

1. A system comprising:

a first camera operable to capture omnidirectional images and send an omnidirectional-image data stream representing the omnidirectional images;

a second camera operable to capture narrow-view images and send a narrow-view-image data stream representing the narrow-view images;

a video processor coupled to the first camera and the second camera and operable to;

as the omnidirectional-image data stream and the narrow-view-image data stream are received, identify a relevant image portion of at least one of the omnidirectional-image data stream and the narrow-view-image data stream;

remove, from the at least one of the omnidirectional-image data stream and the narrow-view-image data stream, image data that is not contained within the relevant image portion;

form a combined-image data stream using at least part of the omnidirectional-image data and the narrow-view-image data; and

wherein the combined-image data stream replaces the removed image data with other image data selected from one or more of the omnidirectional-image data stream and the narrow-view-image data stream;

a display module interoperably coupled to the video processor and operable to display combined images from the combined-image data stream; and

wherein the combined images each comprise a narrow-view-display portion and an omnidirectional-display portion.

2. The system of claim 1, wherein the removed image data comprises image data selected from the omnidirectional-image data.

3. The system of claim 1, wherein the removed image data comprises image data selected from the narrow-view-image data.

4. The system of claim 1, wherein the omnidirectional-display portion is displayed in place of a portion of the narrow-view images.

5. The system of claim 1, wherein the narrow-view images are captured at a greater resolution than the omnidirectional images.

6. A method comprising:

concurrently capturing omnidirectional images and narrow-view images;

storing data representing the captured omnidirectional images as omnidirectional-image data;

storing data representing the captured narrow-view images as narrow-view-image data;

identifying, by a video processor, a relevant image portion in the narrow-view-image data;

the video processor removing, from the narrow-view-image data, image data that is not contained within the relevant image portion, the removing yielding cropped narrow-view-image data;

creating, by the video processor, combined-image data using the cropped narrow-view-image data and at least part of the omnidirectional-image data;

wherein the combined-image data replaces the removed image data with image data selected from the omnidirectional-image data; and

displaying combined images from the combined-image data.

7. The method of claim 6, wherein the omnidirectional images are captured at a greater resolution than the narrow-view images.

8. The method of claim 6, wherein:

the removed image data comprises image data selected from the narrow-view-image data; and

at least a portion of the omnidirectional images are displayed in place of the removed image data.

9. The method of claim 6, wherein the removed image data comprises image data selected from the omnidirectional-image data.

10. The method of claim 9, wherein:

the removing comprises cropping the omnidirectional-image data; and

the creating step uses the cropped omnidirectional-image data.

11. The method of claim 6, wherein the storing steps are performed concurrently.

12. A system comprising:

an omnidirectional sensor operable to capture images and create therefrom image data;

a video processor operable to;

create, from at least part of the image data, combined-image data comprising narrow-view-image data and non-narrow-view-image data; and

wherein the creation comprises;

identification of one or more relevant image portions in the image data;

for at least one relevant image portion of the one or more relevant image portions, removal, from the image data, of at least selected data that is not contained within the at least one relevant image portion;

wherein the combined-image data replaces the at least selected image data with other image data selected from at least one of the narrow-view-image data and the non-narrow-view-image data;

a display module interoperably coupled to the video processor and operable, using the combined-image data, to display combined images comprising narrow-view images and non-narrow-view images; and

wherein the displayed narrow-view images comprise an enlarged version of a portion of images represented by the image data.

13. The system of claim 12, wherein the narrow-view images are displayed in place of the removed at least selected data.

14. The system of claim 12, wherein the video processor downsamples the non-narrow-view-image data.

15. The system of claim 12, wherein, as part of the creation of the combined-image data, the video processor:

wherein the identification comprises identification of the at least one relevant image portions in the non-narrow-view-image data; and

wherein the removal comprises deletion of the at least selected data from the non-narrow-view-image data.

16. The system of claim 12, wherein, as part of the creation of the combined-image data, the video processor:

wherein the identification comprises identification of the at least one relevant image portions in the narrow-view-image data; and

wherein the removal comprises deletion of the at least selected data from the narrow-view-image data.

17. A method comprising:

capturing omnidirectional images;

identifying one or more relevant areas of the omnidirectional images via a video processor;

enlarging at least one relevant area of the one or more relevant areas via the video processor, the enlarging resulting in enlarged relevant-area images;

downsampling and cropping the omnidirectional images via the video processor, the downsampling resulting in downsampled cropped omnidirectional images;

wherein the cropping comprises removing, from the omnidirectional images, at least selected image data that is not contained within the one or more relevant areas;

combining the enlarged relevant-area images and the downsampled cropped omnidirectional images into combined images via the video processor; and

displaying the combined images via a display module.

18. The method of claim 17, wherein the displaying comprises displaying the enlarged relevant-area images at a higher resolution than the downsampled cropped omnidirectional images.

19. The method of claim 17, comprising digitally unfolding the omnidirectional images via the video processor.