Method for video data ranking

• US 20150081721A1
• Filed: 04/04/2012
• Published: 03/19/2015
• Est. Priority Date: 03/21/2012
• Status: Abandoned Application

• Current Assignee: Nikolay Ptitsyn
• Original Assignee: Nikolay Ptitsyn
• Inventors: Ptitsyn, Nikolay
• Application Number:
  US14/369,735
• Publication Number:
  US 20150081721A1
• Time in Patent Office: Days
• US Class Current: 707/748
• CPC Class Codes: G06F 16/78 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06V 20/41 Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items segmenting video sequences G06V20/49
• CPC Class Codes: G06V 20/49 Segmenting video sequences, i.e. computational techniques such as parsing or cutting the sequence, low-level clustering or determining units such as shots or scenes
• CPC Class Codes: H04N 21/2187 Live feed
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

This Invention deals with data processing methods. This method involves the receipt of video data from a video camera and transmission of ranked video data to a user and/or to storage via communication links. Received live video data is first segmented based on at least one object and/or event; then, each segment is analyzed for characteristics that are critical for the priority estimate of a segment and/or used to search for segments in the storage. Each segment is prioritized based on its characteristics. Segments are ranked based on their priority estimates; the resulting priority queue of segments or one segment of the highest priority is transmitted to a user and/or recorded into storage. This Invention reduces load imposed on limited bandwidth communication links and improves video data processing without sacrificing video quality. 25 subclaims; 4 figures; 3 tables.

Claims

1. This video data ranking method involves the receipt of video data from at least from one video camera or sensor and transmission of ranked video data via communication links to at least one user and/or storage. It is characterized as follows:

received live video data is first segmented based on at least one object and/or event;

then, each segment is analyzed for characteristics that are critical for the segment'"'"'s priority and/or used for searching segments in the storage;

then, each segment is prioritized based on its characteristics;

then, segments are ranked according to their estimated priorities;

and the resulting priority queue of segments or one highest-priority segment is transmitted via communication links to at least one user and/or storage.

2. Method of claim 1 wherein video data is segmented based on a motion detector.

3. Method of claim 1 wherein video data is segmented based on video analytics embedded into a network camera or video server.

4. Method of claim 1 wherein video data is segmented based on a server-based video analytics.

5. Method of claim 1 wherein each segment is prioritized based on the regression function.

6. Method of claim 5 wherein the regression function is constructed based on the user'"'"'s request statistics.

7. Method of claim 1 wherein each segment is prioritized using the statistical classifier.

8. Method of claim 7 wherein the statistical classifier is instructed based on the user'"'"'s request statistics.

9. Method of claim 1 wherein each segment is prioritized based on user-defined rules.

10. Method of claim 1 wherein each segment is prioritized based on ongoing user'"'"'s requests.

11. Method of claim 1 wherein each segment is prioritized manually by a user.

12. Method of claim 1 wherein each segment is prioritized based on the priority of a camera that is the source of the video segment.

13. Method of claim 1 wherein each segment is prioritized based on one feature determined by video analytics such as object/event detection accuracy.

14. Method of claim 1 wherein each segment is prioritized based on the priority value pre-defined by a user in a table for each type of an object or event.

15. Method of claim 1 wherein the segment priority estimation process can use the sum of or the maximum priority estimates for individual objects and/or events contained in a given segment.

16. Method of claim 1 wherein the priority estimation process uses data received from external sensors.

17. Method of claim 1 wherein a video segment is a frame sequence.

18. Method of claim 1 wherein a video segment is an alarm frame or any part thereof.

19. Method of claim 1 wherein a user is a video surveillance system operator.

20. Method of claim 1 wherein storage time of a segment recorded into storage depends on the segment'"'"'s priority.

21. Method of claim 1 wherein the highest-priority segments are assigned first for transmission via limited bandwidth communication links.

22. Method of claim 1 wherein the resulting priority queue is displayed at the user interface as the list of resulting segments and segment indications.

23. Method of claim 1 wherein segments or their indications in the resulting priority queue are displayed at the user interface in color or using any other graphic symbols depending on the segment priority.

24. Method of claim 1 wherein actions required to attract the operator'"'"'s attention depend on the segment'"'"'s priority estimate and include a sound alarm and/or SMS-message.

25. Method of claim 1 wherein each segment in the priority queue is transmitted as a single file.

26. Method of claim 1 wherein the priority queue is distributed among a number of users.