Generation of a video mosaic display

• US 9,716,913 B2
• Filed: 12/19/2014
• Issued: 07/25/2017
• Est. Priority Date: 12/19/2014
• Status: Active Grant

• Current Assignee: Texas Instruments, Inc.
• Original Assignee: Texas Instruments, Inc.
• Inventors: Sivasankaran, Shiju Ozhuvinamolath
• Primary Examiner(s): Lee, Michael
• Application Number:
  US14/577,786
• Publication Number:
  US 20160182834A1
• Time in Patent Office: 949 Days
• Field of Search: 348564
• CPC Class Codes: G11B 27/036 Insert-editing
• CPC Class Codes: H04N 21/438 Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving encoded video stream packets from an IP network
• CPC Class Codes: H04N 21/44004 involving video buffer management, e.g. video decoder buffer or video display buffer
• CPC Class Codes: H04N 21/440263 by altering the spatial resolution, e.g. for displaying on a connected PDA
• CPC Class Codes: H04N 21/482 End-user interface for program selection broadcast systems using EPGs H04H60/72
• CPC Class Codes: H04N 5/45 Picture in picture , e.g. displaying simultaneously another television channel in a region of the screen

Abstract

Systems and methods for generating a video mosaic display are disclosed. In an embodiment, an electronic system for generating a video mosaic display of a plurality of video streams includes display buffers, a processor and a display. The processor manages storage of the display buffers for storing video frame windows corresponding to the video streams by scaling resolution of input frames of a first set of video streams that have input frames available and storing the scaled input frames as corresponding video frame windows for the first set of video streams in a first display buffer, and copying, in the first display buffer from a second display buffer, video frame windows corresponding to a second set of video streams for which input frames are not available. The display is configured to display the video mosaic layout based on the video frame windows stored in the display buffers.

Claims

1. An electronic system for generating a video mosaic display of a plurality of video streams, the electronic system comprising:

a plurality of display buffers;

a processor coupled to the plurality of display buffers, the processor configured to manage storage of the plurality of display buffers for storing a plurality of video frame windows corresponding to the plurality of video streams by;

scaling resolution of input frames of a first set of video streams of the plurality of video streams that have input frames available and storing the scaled input frames as corresponding video frame windows for the first set of video streams in a first display buffer of the plurality of display buffers; and

copying video frame windows corresponding to a second set of video streams for which input frames are not available, the video frame windows copied in the first display buffer from a second display buffer of the plurality of display buffers if the video frame windows corresponding to the second set of video streams are different in the first display buffer and in the second display buffer; and

a display coupled to the plurality of display buffers and the processor, the display configured to display the video mosaic layout based on the plurality of video frame windows stored in the plurality of display buffers.

2. The electronic system of claim 1 in which the processor is further configured to manage storage of the plurality of display buffers at an N^th time instance by:

retaining the video frame windows corresponding to the second set of video streams stored in the second display buffer at an N−

1^th time instance if corresponding video frame windows of the second set of video streams is same in the first display buffer and in the second display buffer.

3. The electronic system of claim 1 in which the processor is configured to generate the video mosaic layout by:

displaying the video mosaic layout by accessing the plurality of video frame windows stored in the second display buffer when the scaled input frames of the first set of video streams are stored in the first display buffer; and

displaying the video mosaic layout by accessing the plurality of video frame windows stored in the first display buffer when the scaled input frames of the first set of video streams are stored in the second display buffer.

4. The electronic system of claim 1 in which the video mosaic layout is displayed at a frame rate, the frame rate being equal to or higher than a highest frame rate among frame rates of the plurality of video streams.

5. The electronic system of claim 1 in which the display is configured to display the plurality of video frame windows simultaneously.

6. The electronic system of claim 1 in which scaling the resolution of the input frames of the first set of video streams includes scaling the resolution of the input frames to a pre-determined resolution.

7. The electronic system of claim 6 in which the pre-determined resolution for an input frame of a video stream of the first set of video streams is based on a resolution of the video mosaic layout.

8. The electronic system of claim 2 in which the N^th time instance and the N−

1^th time instance are refresh cycles of the video mosaic layout.

9. A video mosaic display method comprising:

receiving a plurality of video streams, each video stream of the plurality of video streams associated with a corresponding resolution and a corresponding frame rate;

managing storage of a plurality of display buffers for storing a plurality of video frame windows in each of the plurality of display buffers, in which each video frame window of the plurality of video frame windows corresponds to a video stream of the plurality of video streams, in which managing storage of the plurality of display buffers at an N^th time instance includes;

scaling resolution of input frames of a first set of video streams and storing the scaled input frames as corresponding video frame windows for the first set of video streams in a first display buffer of the plurality of display buffers, in which the first set of video streams includes video streams of the plurality of video streams for which the input frames are available at the N^th time instance; and

copying video frame windows corresponding to a second set of video streams that are stored in a second display buffer of the plurality of display buffers at an N−

1^th time instance if corresponding video frame windows for the second set of video streams in the first display buffer and in the second display buffer are different, and storing the copied video frame windows as corresponding video frame windows for the second set of video streams in the first display buffer, in which the second set of video streams includes video streams other than the first set of video streams in the plurality of video streams for which input frames are not available at the N^th time instance; and

generating a video mosaic layout for display based on the plurality of video frame windows stored in the plurality of display buffers.

10. The method of claim 9 in which managing storage of the plurality of display buffers at the N^th time instance includes:

retaining the video frame windows corresponding to the second set of video streams stored in the first display buffer at the N−

1^th time instance if the corresponding video frame windows for the second set of video streams is same in the first display buffer and in the second display buffer.

11. The method of claim 9 in which generating the video mosaic layout includes:

displaying the video mosaic layout by accessing the plurality of video frame windows stored in the second display buffer when the scaled input frames of the first set of video streams are stored in the first display buffer; and

displaying the video mosaic layout by accessing the plurality of video frame windows stored in the first display buffer when the scaled input frames of the first set of video streams are stored in the second display buffer.

12. The method of claim 9 in which the video mosaic layout is displayed at a frame rate, the frame rate being equal to or higher than a highest frame rate among frame rates of the plurality of video streams.

13. The method of claim 9 in which scaling the resolution of the input frames of the first set of video streams includes scaling the resolution of the input frames to a pre-determined resolution.

14. The method of claim 13 in which the pre-determined resolution for an input frame of a video stream of the first set of video streams is based on a resolution of the video mosaic layout.

15. The method of claim 9 in which generating the video mosaic layout includes displaying the plurality of video frame windows simultaneously.

16. The method of claim 9 in which the N^th time instance and the N−

1^th time instance are refresh cycles of display of the video mosaic layout.