METHOD AND SYSTEM FOR SEMI-AUTOMATED VENUE MONITORING

• US 20150220783A1
• Filed: 02/06/2015
• Published: 08/06/2015
• Est. Priority Date: 02/06/2014
• Status: Abandoned Application

• Current Assignee: Suitable Technologies, Inc.
• Original Assignee: RF Spot Inc.
• Inventors: GOLD, Andrew Joseph
• Application Number:
  US14/615,649
• Publication Number:
  US 20150220783A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 18/2178 based on feedback of a supervisor
• CPC Class Codes: G06V 20/10 Terrestrial scenes scenes under surveillance with static cameras G06V20/52; scenes perceived from the exterior of a vehicle G06V20/56; scenes perceived from the interior of a vehicle G06V20/59
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: G06V 20/41 Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items segmenting video sequences G06V20/49
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69

Abstract

A method is disclosed including capturing video data relating to a venue and providing the video data via a communication network to a reviewer. The reviewer then reviews the video data and provides review results relating to specific physical deficiencies at the venue to an input port of a system. Data indicative of the physical deficiencies are then transmitted from the system via the communication network to the venue. The deficiencies and known locations of the video images are correlated with physical locations within the venue. The correlation and data are then used to identify and provide deficiencies and their locations within the venue in a human intelligible form.

Claims

1. A method comprising:

capturing video data relating to a venue;

providing the video data via a communication network to a reviewer, the reviewer for reviewing the video data;

providing from the reviewer, review results relating to specific physical deficiencies at the venue to an input port of a system;

transmitting from the system via the communication network to the venue data indicative of the physical deficiencies;

correlating the deficiencies and known locations of the video images in which the deficiencies are identified with physical locations within the venue; and

using data relating to a map of the venue, identifying deficiencies and their locations within the venue in a human intelligible form.

2. A method according to claim 1 wherein deficiencies include stock outages.

3. A method according to claim 1 wherein deficiencies include safety concerns.

4. A method according to claim 1 comprising labeling each deficiency to indicate a deficiency type.

5. A method according to claim 1 comprising:

capturing location data associated with the video data in order to associate each video frame with a physical location within the venue.

6. A method comprising:

capturing video data relating to a venue;

capturing location data in association with the video data and for identifying a location of capture of the video data;

providing the video data via a communication network to a server;

retrieving the video data by a reviewer from the server, the reviewer for reviewing the video data;

providing from the reviewer, review results relating to specific physical deficiencies at the venue to an Input port of a system;

transmitting from the system via the communication network to the venue data indicative of the physical deficiencies;

correlating the deficiencies and known locations of the video images in which the deficiencies are identified with physical locations within the venue; and

using data relating to a map of the venue, identifying deficiencies and their locations within the venue in a human intelligible form.

7. A method comprising:

capturing video data relating to a venue;

capturing location data in association with the video data and for identifying a location of capture of the video data;

providing the video data via a communication network to a server;

retrieving the video data by a reviewer from the server, the reviewer for reviewing the video data;

providing from the reviewer, review results relating to specific physical deficiencies at the venue to an input port of a system;

transmitting from the system to the server via the communication network data indicative of the physical deficiencies;

correlating the deficiencies and known locations of the video images in which the deficiencies are identified with physical locations within the venue; and

using data relating to a map of the venue, identifying deficiencies and their locations within the venue in a human intelligible form.

8. A method according to claim 7 further comprising using the data to train an automatic deficiency detection process for execution on the video data.

9. A method according to claim 8 further comprising providing a brokering process for brokering the video data to reviewers, the brokering process response to control data.

10. A method according to claim 9 comprising a tendering process for accepting reviewer offers of service and for adjusting the control data to select reviewers in dependence upon each offer of service.

11. A method comprising:

capturing sensor data relating to a venue;

providing the sensor data via a communication network to a reviewer, the reviewer for reviewing the sensor data;

providing from the reviewer, review results relating to specific physical deficiencies at the venue to an input port of a system;

transmitting from the system via the communication network to the venue data indicative of the physical deficiencies;

correlating the deficiencies and known locations of the sensor data in which the deficiencies are identified with physical locations within the venue; and

using data relating to a map of the venue, identifying deficiencies and their locations within the venue in a human intelligible form.

12. A method according to claim 11 comprising capturing location data associated with the sensor data in order to associate sensor datum with a physical location within the venue.

13. A method according to claim 11 comprising:

using the data to train an automatic deficiency detection process for execution on the sensor data.

14. A method comprising:

capturing sensor data relating to a venue;

capturing location data in association with the sensor data and for identifying a location of capture of the sensor data;

providing the sensor data via a communication network to a server;

retrieving the sensor data by a reviewer from the server, the reviewer for reviewing the sensor data;

providing from the reviewer, review results relating to specific physical deficiencies at the venue to an input port of a system;

transmitting from the system via the communication network to the venue data indicative of the physical deficiencies;

correlating the deficiencies and known locations of the sensor images in which the deficiencies are identified with physical locations within the venue; and

using data relating to a map of the venue, identifying deficiencies and their locations within the venue in a human intelligible form.

15. A method according to claim 14 comprising using the data to train an automatic deficiency detection process for execution on the sensor data.

16. A method comprising:

capturing sensor data relating to a venue;

capturing location data in association with the sensor data and for identifying a location of capture of the sensor data;

providing the sensor data via a communication network to a server;

retrieving the sensor data by a reviewer from the server, the reviewer for reviewing the sensor data;

providing from the reviewer, review results relating to specific physical deficiencies at the venue to an input port of a system;

transmitting from the system to the server via the communication network data indicative of the physical deficiencies;

correlating the deficiencies and known locations of the sensor images in which the deficiencies are identified with physical locations within the venue; and

using data relating to a map of the venue, identifying deficiencies and their locations within the venue in a human intelligible form.

17. A method according to claim 16 comprising using the data to train an automatic deficiency detection process for execution on the sensor data.

18. A method according to claim 16 comprising providing a brokering process for brokering the sensor data to reviewers, the brokering process response to control data.

19. A method according to claim 18 comprising a tendering process for accepting reviewer offers of service and for adjusting the control data to select reviewers in dependence upon each offer of service.

20. A system comprising:

a data capture module for capturing image data relating to a venue and location data relating the image data for approximately localising the image data within the venue;

a communication module for communicating the image data; and

a data input module for receiving first data relating to deficiencies within the venue determined based on the image data, the first data relating a deficiency and a location within the venue for said deficiency.

21. A system according to claim 20 comprising a review module comprising a first port for providing image data therefrom and for receiving review data comprising data relating to a location within image content, the review module for supporting review of image data for which first data already exists.

22. A system according to claim 20 comprising a review module comprising a first port for providing image data therefrom and for receiving review data comprising data relating to image content, the review module for supporting review of image data for which first data other than already exists, for use in training of an image processing module for processing the image data to provide first data.

23. A system according to claim 20 comprising a review module comprising a first port for providing image data therefrom and for receiving review data comprising data relating to a location within image content, the review module for supporting review of image data for which first data other than already exists, the first data derived from the review data.

24. A system according to claim 23 wherein the first port comprises a graphical user interface for displaying image data and for receiving indications of deficiencies noted within the displayed images.

25. A method comprising:

using at least a sensor to capture sensor data relating to a venue including image data and location data for the image data to relate the image data to an approximate location within the venue;

analysing the sensor data to determine deficiencies within the venue and locations of said deficiencies;

providing data indicative of the physical deficiencies and the image data within which the physical deficiency is detected;

correlating the physical deficiencies and known approximate locations of the image data in which the deficiencies are detected to associate the physical deficiency and the approximate physical locations within the venue; and

storing geospatial data indicative of the physical deficiency within the venue.

26. A method according to claim 25 wherein the venue is a retail store and wherein the physical deficiencies relate to stock missing from a known location.