Systems and methods for providing high-resolution regions-of-interest

• US 20070024706A1
• Filed: 05/26/2006
• Published: 02/01/2007
• Est. Priority Date: 08/01/2005
• Status: Abandoned Application

• Current Assignee: UTC Fire & Security Americas Corporation, Inc. (Carrier Global Corporation)
• Original Assignee: UTC Fire & Security Americas Corporation, Inc. (Carrier Global Corporation)
• Inventors: Weaver, Jason, Brannon, Robert, Richter, Roger, Friedrichs, Eric, Thyssen, Dane
• Application Number:
  US11/442,658
• Publication Number:
  US 20070024706A1
• Time in Patent Office: Days
• US Class Current: 348/142
• CPC Class Codes: H04N 19/102 characterised by the element, parameter or selection affected or controlled by the adaptive coding
• CPC Class Codes: H04N 19/156 Availability of hardware or computational resources, e.g. encoding based on power-saving criteria
• CPC Class Codes: H04N 19/164 Feedback from the receiver or from the transmission channel
• CPC Class Codes: H04N 19/17 the unit being an image region, e.g. an object
• CPC Class Codes: H04N 21/234363 by altering the spatial resolution, e.g. for clients with a lower screen resolution
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/4438 Window management, e.g. event handling following interaction with the user interface
• CPC Class Codes: H04N 21/4728 for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
• CPC Class Codes: H04N 21/6131 involving transmission via a mobile phone network wireless downlink channel access H04W74/006
• CPC Class Codes: H04N 21/6181 involving transmission via a mobile phone network arrangements for providing broadcast or conference services to substation in data switching networks in combination with wireless systems H04L12/189; wireless uplink channel access H04W74/004
• CPC Class Codes: H04N 21/6587 Control parameters, e.g. trick play commands, viewpoint selection
• CPC Class Codes: H04N 7/17318 Direct or substantially direct transmission and handling of requests
• CPC Class Codes: H04N 7/17336 Handling of requests in head-ends
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

Systems and methods for providing high-quality region of interest (HQ-ROI) viewing within an overall scene by enabling one or more HQ-ROIs to be viewed in a controllable fashion, as higher quality ‘windows-within-a-window’ of regions (spatial subsets) of a scene.

Claims

1. A method of controlling display of at least two video streams over a network connection, comprising:

analyzing video capabilities of a multi-stream video source to determine if said multi-stream video source is capable of providing a first video stream and a second video stream of a high quality region of interest (HQ-ROI) corresponding to said first video stream;

accessing said first and second video streams from said multi-stream video source for delivery over said network connection;

receiving said first and second video streams simultaneously from said multi-stream video source over said network connection; and

simultaneously displaying said received first and second video streams.

2. The method of claim 1, further comprising:

receiving information from said multi-stream video source regarding video capabilities of said multi-stream video source over said network connection; and

analyzing said received information regarding video capabilities of said multi-stream video source to determine if said multi-stream video source is capable of providing said first video stream and said second video stream of a high quality region of interest (HQ-ROI) corresponding to said first video stream.

3. The method of claim 1, further comprising at least partially overlaying said displayed first video stream with said HQ-ROI of said displayed second video stream.

4. The method of claim 1, further comprising displaying said first video stream in a first window;

and displaying said HQ-ROI of said second video stream in a second window;

wherein said second window is smaller than said first window; and

wherein said second window is displayed to overlay said first window.

5. The method of claim 1, further comprising first accessing, receiving and displaying said HQ-ROI of said second video stream as a first spatial subset of said first video stream simultaneously with said first video stream;

and then subsequently accessing, receiving and displaying said HQ-ROI of said second video stream as a second spatial subset of said first video stream simultaneously with said first video stream;

wherein said second spatial subset is a different spatial subset of said first video stream than said first spatial subset.

6. The method of claim 5, further comprising dynamically manipulating said HQ-ROI by subsequently accessing, receiving and displaying said HQ-ROI of said second video stream as said second spatial subset of said first video stream in response to a user action.

7. The method of claim 5, further comprising controlling said multi-stream video source to provide said accessed HQ-ROI of said second video stream as said first spatial subset of said first video stream, and controlling said multi-stream video source to subsequently provide said accessed HQ-ROI of said second video stream as said second spatial subset of said first video stream.

8. The method of claim 7, further comprising providing a pan-tilt-zoom (PTZ) control command to control said multi-stream video source to subsequently provide said HQ-ROI of said second video stream as said second spatial subset of said first video stream.

9. The method of claim 5, wherein said method further comprises at least one of:

zooming said HQ-ROI of said second video stream by controlling said multi-stream video source to change the scaling factor of video images within said second video stream before said multi-stream video source provides said second video stream over said network connection;

resizing said HQ-ROI of said second video stream by controlling said multi-stream video source to change the spatial dimensions associated with video images within said second video stream before said multi-stream video source provides said second video stream over said network connection, or a combination thereof.

10. The method of claim 1, wherein said HQ-ROI of said second video stream has at least one of higher resolution, less video compression, enhanced color format or greater pixel definition than said first video stream.

11. The method of claim 10, wherein said HQ-ROI of said second video stream has a higher resolution than said first video stream.

12. The method of claim 1, wherein said video source is coupled to a video access component;

and wherein said method further comprises receiving said first and second video streams simultaneously from said video source through said video access component over said network connection.

13. A method of providing at least two video streams over a network connection for display, comprising:

communicating information over said network connection to a viewing client regarding video capabilities of a video source, said video source being a multi-stream video source capable of providing at least two video streams over said network connection, said at least two video streams comprising a first video stream and a second video stream of a high quality region of interest (HQ-ROI) corresponding to said first video stream;

receiving at least one request over said network connection from said viewing client for said first and second video streams from said multi-stream video source for delivery over said network connection; and

then

in response to said at least one request, simultaneously communicating said requested first and second video streams from said multi-stream video source to said viewing client over said network connection for simultaneous display.

14. The method of claim 13, further comprising first communicating said HQ-ROI of said second video stream from said multi-stream video source as a first spatial subset of said first video stream simultaneously with said first video stream;

and then subsequently communicating said HQ-ROI of said second video stream from said multi-stream video source as a second spatial subset of said first video stream simultaneously with said first video stream;

wherein said second spatial subset is a different spatial subset of said first video stream than said first spatial subset.

15. The method of claim 14, further comprising subsequently communicating said HQ-ROI of said second video stream from said multi-stream video source as said second spatial subset of said first video stream in response to a control command received over said network connection by said multi-stream video source from said viewing client.

16. The method of claim 14, wherein said method further comprises subsequently communicating said HQ-ROI of said second video stream from said multi-stream video source as said second spatial subset of said first video stream in response to a pan-tilt-zoom (PTZ) control command received over a network connection by said multi-stream video source.

17. The method of claim 14, wherein said method further comprises at least one of:

zooming said HQ-ROI of said second video stream by changing the scaling factor of video images within said second video stream prior to communicating said second video stream from said multi-stream video source to said viewing client over said network connection;

resizing said HQ-ROI of said second video stream by changing the spatial dimensions associated with video images within said second video stream prior to communicating said second video stream from said multi-stream video source to said viewing client over said network connection, or a combination thereof.

18. The method of claim 13, wherein said HQ-ROI of said second video stream has at least one of higher resolution, less video compression, enhanced color format or greater pixel definition than said first video stream.

19. The method of claim 18, wherein said HQ-ROI of said second video stream has a higher resolution than said first video stream.

20. The method of claim 13, wherein said video source is coupled to a video access component;

and wherein said method further comprises simultaneously communicating said requested first and second video streams from said multi-stream video source to said viewing client through said video access component over said network connection.

21. A method of controlling display of at least two video streams over a network connection, comprising:

analyzing video capabilities of at least one video source to determine if said at least one video source is capable of providing a first video stream and a second video stream of a high quality region of interest (HQ-ROI) corresponding to said first video stream;

accessing said first and second video streams from said at least one video source for delivery over said network connection;

receiving said first and second video streams simultaneously from said at least one video source over said network connection; and

simultaneously displaying said received first and second video streams.

22. The method of claim 21, wherein said method further comprises:

receiving information over said network connection from each of at least two video sources regarding video capabilities of said at least two video sources, each of said video sources being capable of providing at least one video stream over said network connection;

analyzing said received information regarding video capabilities of said at least two video sources to determine if one of said video sources is capable of providing a first video stream, and another of said video sources is capable of providing a second video stream of a high quality region of interest (HQ-ROI) corresponding to said first video stream;

selecting and requesting over said network connection said first stream from a first one of said at least two video sources for delivery over said network connection, and selecting and requesting over said network connection said second stream from a second one of said at least two video source for delivery over said network connection;

receiving said first and second video streams simultaneously from said respective first and second video sources over said network connection; and

simultaneously displaying said received first and second video streams.

23. The method of claim 22, wherein said first and second video sources are coupled to a common video access component;

and wherein said method further comprises receiving said first and second video streams simultaneously from each of said first and second video sources through said common video access component over said network connection.

24. The method of claim 22, further comprising at least partially overlaying said displayed first video stream with said HQ-ROI of said displayed second video stream.

25. The method of claim 22, further comprising first accessing, receiving and displaying said HQ-ROI of said second video stream from said second one of said video sources as a first spatial subset of said first video stream simultaneously with receiving and displaying said first video stream from said first one of said video sources;

and then subsequently requesting, receiving and displaying said HQ-ROI of said second video stream from said second one of said video sources as a second spatial subset of said first video stream simultaneously with said first video stream from said first one of said video sources;

wherein said second spatial subset is a different spatial subset of said first video stream than said first spatial subset.

26. The method of claim 25, further comprising dynamically manipulating said HQ-ROI by subsequently requesting, receiving and displaying said HQ-ROI of said second video stream from said second one of said video sources as said second spatial subset of said first video stream from said first one of said video sources in response to a user action.

27. The method of claim 25, further comprising providing a pan-tilt-zoom (PTZ) control command to control said second one of said video sources to subsequently provide said HQ-ROI of said second video stream as said second spatial subset of said first video stream.

28. The method of claim 25, wherein said method further comprises at least one of:

zooming said HQ-ROI of said second video stream by controlling said second one of said video sources to change the scaling factor of video images within said second video stream before said second one of said video sources provides said second video stream over said network connection;

resizing said HQ-ROI of said second video stream by controlling said second one of said video sources to change the spatial dimensions associated with video images within said second video stream before said second one of said video sources provides said second video stream over said network connection, or a combination thereof.

29. The method of claim 21, wherein said HQ-ROI of said second video stream has at least one of higher resolution, less video compression, enhanced color format or greater pixel definition than said first video stream.

30. The method of claim 29, wherein said HQ-ROI of said second video stream has a higher resolution than said first video stream.

31. The method of claim 21, wherein said at least one video source is coupled to a video access component;

and wherein said method further comprises receiving said first and second video streams simultaneously from said at least one video source through said video access component over said network connection.

32. A video display system, comprising a viewing client configured to be coupled to a network connection, said viewing client being further configured to:

analyze video capabilities of a multi-stream video source to determine if said multi-stream video source is capable of providing at least a first video stream and at least a second video stream of a high quality region of interest (HQ-ROI) corresponding to said first video stream;

access over said network connection said first and second video streams from said multi-stream video source for delivery over said network connection;

receive said first and second video streams simultaneously from said multi-stream video source over said network connection; and

simultaneously display said received first and second video streams.

33. The system of claim 32, wherein said viewing client is further configured to:

receive information over said network connection from said multi-stream video regarding video capabilities of said multi-stream video source; and

analyze said received information regarding video capabilities of said multi-stream video source to determine if said multi-stream video source is capable of providing said at least first video stream and said at least second video stream of a high quality region of interest (HQ-ROI) corresponding to said first video stream.

34. The system of claim 33, further comprising a multi-stream video source configured to be coupled to provide said at least first and second video streams over said network connection in response to a request for said first and second video streams from said viewing client, said second video stream being a high quality region of interest (HQ-ROI) corresponding to said first video stream, and said multi-stream video source being further configured to provide said information over said network connection regarding video capabilities of said multi-stream video source.

35. The system of claim 32, wherein said viewing client is further configured to at least partially overlay said displayed first video stream with said HQ-ROI of said displayed second video stream.

36. The system of claim 32, wherein said viewing client is further configured to display said first video stream in a first window;

and to display said HQ-ROI of said second video stream in a second window;

wherein said second window is smaller than said first window; and

wherein said second window overlays said first window.

37. The system of claim 32, wherein said viewing client is further configured to first access, receive and display said HQ-ROI of said second video stream as a first spatial subset of said first video stream simultaneously with said first video stream;

and then to subsequently access, receive and display said HQ-ROI of said second video stream as a second spatial subset of said first video stream simultaneously with said first video stream;

wherein said second spatial subset is a different spatial subset of said first video stream than said first spatial subset.

38. The system of claim 37, wherein said multi-stream video source is further configured to communicate said HQ-ROI of said second video stream over said network connection to said viewing client as said second spatial subset of said first video stream in response to a control command received by said multi-stream video source over said network connection from said viewing client;

and wherein said viewing client is further configured to dynamically manipulate said HQ-ROI by first accessing, receiving and displaying said HQ-ROI of said second video stream as a first spatial subset of said first video stream simultaneously with said first video stream; and

then subsequently accessing, receiving and displaying said HQ-ROI of said second video stream as a second spatial subset of said first video stream simultaneously with said first video stream.

39. The system of claim 37, wherein said multi-stream video source is further configured to subsequently provide said requested HQ-ROI of said second video stream as said second spatial subset of said first video stream in response to a pan-tilt-zoom (PTZ) control command received over a network connection by said multi-stream video source.

40. The system of claim 37, wherein said multi-stream video source is further configured to at least one of:

zoom said HQ-ROI of said second video stream by changing the scaling factor of video images within said second video stream before providing said second video stream over said network connection;

resize said HQ-ROI of said second video stream by changing the spatial dimensions associated with video images within said second video stream before providing said second video stream over said network connection, or

a combination thereof.

41. The system of claim 32, wherein said HQ-ROI of said second video stream has at least one of higher resolution, less video compression, enhanced color format or greater pixel definition than said first video stream.

42. The system of claim 41, wherein said HQ-ROI of said second video stream has a higher resolution than said first video stream.

43. The system of claim 32, wherein said video source is coupled to a video access component;

and wherein said viewing client being is configured to receive said first and second video streams simultaneously from said multi-stream video source through said video access component over said network connection.

44. A video display system, comprising a viewing client configured to be coupled to a network connection, said viewing client being further configured to:

analyze video capabilities of at least one video source to determine if said at least one video source is capable of providing a first video stream and a second video stream of a high quality region of interest (HQ-ROI) corresponding to said first video stream;

request said first and second video streams from said at least one video source for delivery over said network connection;

receive said first and second video streams simultaneously from said at least one video source over said network connection; and

simultaneously display said received first and second video streams.

45. The system of claim 44, wherein said at least one video source comprises at least a first video source and a second video source;

and wherein said viewing client is further configured to;

analyze video capabilities of said first and second video sources to determine if said first video source is capable of providing said first video stream and said second video source is capable of providing said second video stream of a high quality region of interest (HQ-ROI) corresponding to said first video stream;

access over said network connection said first video stream from said first video source for delivery over said network connection, and request over said network connection said second video stream from said second video source for delivery over said network connection;

receive said first and second video streams simultaneously from said respective first and second video sources over said network connection; and

simultaneously display said received first and second video streams.

46. The method of claim 44, wherein said first and second video sources are coupled to a common video access component;

and wherein said viewing client is further configured to receive said first and second video streams simultaneously from each of said first and second video sources through said common video access component over said network connection.

47. The system of claim 44, wherein said at least one video source comprises at least a first video source and a second video source;

and wherein said viewing client is further configured to;

receive information over said network connection from said first video source regarding video capabilities of said first video source;

receive information over said network connection from said second video source regarding video capabilities of said second video source;

analyze said received information regarding video capabilities of said first and second video sources to determine if said first video source is capable of providing said first video stream and said second video source is capable of providing said second video stream of a high quality region of interest (HQ-ROI) corresponding to said first video stream;

access over said network connection said first video stream from said first video source for delivery over said network connection, and access over said network connection said second video stream from said second video source for delivery over said network connection;

receive said first and second video streams simultaneously from said respective first and second video sources over said network connection; and

simultaneously display said received first and second video streams.

48. The system of claim 47, further comprising:

a first video source configured to be coupled to provide said first video stream over said network connection in response to a request for said first video stream from said viewing client, said first video source being further configured to provide said information over said network connection regarding video capabilities of said first video source; and

a second video source configured to be coupled to provide a second video stream over said network connection in response to a request for said second video stream from said viewing client, and said second video source being further configured to provide said information over said network connection regarding video capabilities of said second video source.

49. The system of claim 45, wherein said viewing client is further configured to at least partially overlay said displayed first video stream with said HQ-ROI of said displayed second video stream.

50. The system of claim 45, wherein said viewing client is further configured to display said first video stream in a first window;

and to display said HQ-ROI of said second video stream in a second window;

wherein said second window is smaller than said first window; and

wherein said second window overlays said first window.

51. The system of claim 45, wherein said viewing client is further configured to first access, receive and display said HQ-ROI of said second video stream as a first spatial subset of said first video stream simultaneously with said first video stream;

and then to subsequently access, receive and display said HQ-ROI of said second video stream as a second spatial subset of said first video stream simultaneously with said first video stream;

wherein said second spatial subset is a different spatial subset of said first video stream than said first spatial subset.

52. The system of claim 51, wherein said second video source is further configured to communicate said HQ-ROI of said second video stream over said network connection to said viewing client as said second spatial subset of said first video stream in response to a command received by said second video source over said network connection from said viewing client;

and wherein said viewing client is further configured to dynamically manipulate said HQ-ROI by first receiving and displaying said HQ-ROI of said second video stream as a first spatial subset of said first video stream simultaneously with said first video stream; and

then subsequently receiving and displaying said HQ-ROI of said second video stream as a second spatial subset of said first video stream simultaneously with said first video stream.

53. The system of claim 51, wherein said second video source is further configured to subsequently provide said HQ-ROI of said second video stream as said second spatial subset of said first video stream in response to a pan-tilt-zoom (PTZ) control command received by said second video source over a network connection.

54. The system of claim 51, wherein said second video source is further configured to at least one of:

zoom said HQ-ROI of said second video stream by changing the scaling factor of video images within said second video stream before providing said second video stream over said network connection;

resize said HQ-ROI of said second video stream by changing the spatial dimensions associated with video images within said second video stream before providing said second video stream over said network connection, or a combination thereof.

55. The method of claim 45, wherein said HQ-ROI of said second video stream has at least one of higher resolution, less video compression, enhanced color format or greater pixel definition than said first video stream.

56. The method of claim 55, wherein said HQ-ROI of said second video stream has a higher resolution than said first video stream.

57. The system of claim 44, wherein said at least one video source is coupled to a video access component;

and wherein said viewing client is further configured to receive said first and second video streams simultaneously from said at least one video source through said video access component over said network connection.