METHOD AND SYSTEM FOR SEMI-AUTOMATED VENUE MONITORING

• US 20150220785A1
• Filed: 02/06/2015
• Published: 08/06/2015
• Est. Priority Date: 02/06/2014
• Status: Abandoned Application

• Current Assignee: Suitable Technologies, Inc.
• Original Assignee: RF Spot Inc.
• Inventors: GOLD, Andrew Joseph
• Application Number:
  US14/615,706
• Publication Number:
  US 20150220785A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 18/2178 based on feedback of a supervisor
• CPC Class Codes: G06V 20/10 Terrestrial scenes scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 20/41 Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items segmenting video sequences G06V20/49
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69

Abstract

A method is disclosed including capturing video data relating to a venue, processing the data to extract content therefrom and providing the video data and content via a communication network to a reviewer. The reviewer then reviews the video data and content and provides review results relating to an accuracy of the content. The review data is then relied upon to improve future processing results or data reliability of the content.

Claims

1. A method comprising:

capturing images of a venue and providing first image data;

processing the first image data to detect automatically therein content having an outcome of at least one of a label and an associated action;

storing in association with the image an indication of the content and the outcome;

providing an interface for review of each image and each associated content and outcome, the interlace supporting verification of the content and the outcome and also supporting correction of at least one of the content and the outcome;

receiving at the interface first data comprising a verification to at least one of the content and the outcome; and

storing the verification in association with the at least one of the content and the outcome in response to the first data.

3. A method according to claim 1, wherein processing is performed by a trainable process and comprising providing the first data as training data for further training of the trainable process.

4. A method according to claim 1, further comprising providing a notification in response to the first data indicating that the at least one of the content and the outcome are verified.

5. A method according to claim 1, further comprising providing a reliability estimate with each at least one of a content and outcome.

6. A method according to claim 5, wherein a reliability estimation process for providing the reliability estimate is trained based on the first data.

7. A method according to claim 6, further comprising providing a request fur verification of the least one of a content and outcome when the reliability estimate indicates that the at least one of a content and outcome determination has more than a threshold likelihood of being incorrect.

8. A method according to claim 7, wherein the threshold likelihood x is predetermined.

9. A method according to claim 6, further comprising updating the reliability estimate process in response to the first data,

10. A method according to claim 6, further comprising providing at intervals a request for verification of the least one of a content and outcome.

11. A method according to claim 6, further comprising in response to a user request, providing at intervals a request for verification of the least one of a content and outcome.

12. A method according to claim 6, further comprising when an outcome is at least one of onerous and costly, providing a request for verification of the least one of a content and outcome.

2. A method according to claim l wherein processing is performed by a trainable process and wherein storing comprises providing the first data as training data for further training of the trainable process.

13. A method comprising:

capturing images of a venue and providing first image data;

processing the first image data to detect automatically therein content having an outcome of at least one of a label and an associated action;

storing in association with the image an indication of the content and the outcome;

determining, fur the image and the content a reliability measure fur the content; and

when the reliability measure is below a predetermined threshold, providing an interface for review of each image and each associated content and outcome, the interface supporting verification of the content and the outcome and also supporting correction of at least one of the content and the outcome, receiving at the interface first data cot one or a correction to at least one or the content and tin. outcome and a verification; and

when the first data is indicative of a verification, modifying the reliability estimate associated with the at least one of content and the outcome.

14. A method according to claim 13, wherein the predetermined threshold varies depending upon an estimated cost of an error in the content.

15. A method according to claim 13, further comprising at intervals, providing an interface for review of each image and each associated content and outcome, the interface supporting verification of the content and the outcome and also supporting correction of at least one of the content and the outcome, receiving at the interface first data comprising one of a correction to at least one of the content and the outcome and a verification;

and when the first data is indicative of a verification, storing an indication of the verification in association with the at least one of the content and the outcome.

16. A method according to claim 15, wherein the intervals are random intervals.

17. A method comprising:

processing an image with an automated image processing system to extract in formation therefrom;

providing some of the information for verification via a graphical user interface;

receiving via the graphical user interface first data relating to verification of the information; and

displaying the information visually with an indication distinguishing information that is verified from information resulting solely from the automated process.