Video identification and analytical recognition system

• US 10,432,897 B2
• Filed: 03/27/2017
• Issued: 10/01/2019
• Est. Priority Date: 03/15/2013
• Status: Active Grant

• Current Assignee: James Carey
• Original Assignee: James Carey
• Inventors: Carey, James
• Primary Examiner(s): Aghevli, Reza
• Application Number:
  US15/469,885
• Publication Number:
  US 20170200052A1
• Time in Patent Office: 918 Days
• Field of Search: None
• CPC Class Codes: G06F 18/251 of input or preprocessed data
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30232 Surveillance
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: G06V 10/803 of input or preprocessed data
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 20/53 Recognition of crowd images, e.g. recognition of crowd congestion
• CPC Class Codes: G06V 2201/10 Recognition assisted with metadata
• CPC Class Codes: G06V 40/10 Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: G06V 40/161 Detection; Localisation; Normalisation
• CPC Class Codes: G06V 40/172 Classification, e.g. identification
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training
• CPC Class Codes: G06V 40/25 Recognition of walking or running movements, e.g. gait recognition
• CPC Class Codes: G08B 13/19608 Tracking movement of a target, e.g. by detecting an object predefined as a target, using target direction and or velocity to predict its new position
• CPC Class Codes: G08B 13/19613 Recognition of a predetermined image pattern or behaviour pattern indicating theft or intrusion
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 7/185 from a mobile camera, e.g. for remote control
• CPC Class Codes: H04W 8/005 Discovery of network devices, e.g. terminals

Abstract

An analytical recognition system includes a video camera, an antenna, and a data analytics module. The video camera is configured to capture video data. The antenna is configured to capture mobile communication device data. The data analytics module is configured to correlate the video data and the mobile communication device data to generate a profile of a person associated with the video data and the mobile communication device data. The profile has profile data including any one or a combination of the captured video data and the captured mobile communication data.

Claims

1. An analytical recognition system, comprising:

a video camera configured to capture video data including a video frame that includes an image of a person;

an antenna configured to capture mobile communication device data including an identifier of a mobile communication device associated with the person;

one or more processors; and

one or more memories storing instructions that, when executed by the one or more processors, cause the one or more processors to function as;

a data analytics module configured to;

correlate the video data and the mobile communication device data, wherein the correlating including matching the video frame, which includes the image of the person, to the identifier of the mobile communication device associated with the person;

generate a profile of the person based on a result of the correlating, wherein the generated profile includes;

at least one of an indication of when the video frame was captured or an indicate on of when the mobile communication device data was captured; and

at least one of an indication of a location at which the video data was captured or an indication of a location at which the mobile communication device data was captured;

identify objects associated with the person from at least one of or a combination of the video data and the mobile communication device data; and

track the identified object using at least one of or a combination of the video data and the mobile communication device data.

2. The system of claim 1, wherein the antenna includes any one or a combination of a WiFi antenna, a media access control (MAC) antenna, a Bluetooth antenna, a cellular antenna, a near field communication antenna, and a radio frequency identification antenna.

3. The system of claim 1, wherein the data analytics module is further configured to assign the person to a positive list, an undetermined list, or a negative list based on any of or a combination of the video data, the mobile communication device data, the profile data, and a user-inputted criteria.

4. The system of claim 3, wherein the data analytics module is further configured to assign the person to the positive list based on a determination that any one or a combination of the video data, the mobile communication device data, and the profile corresponds to an employee or to a person on a predetermined list of people.

5. The system of claim 1, wherein the antenna is configured to capture the mobile communication device data by wirelessly receiving data from a mobile communication device located within a range of the antenna.

6. The system of claim 1, wherein the data analytics module is configured to classify the person as a new customer or a repeat customer at the premises based on premises visit data stored in the profile, and add to the profile, or update in the profile, an indicator of whether the person is a new customer or a repeat customer at the premises.

7. The system of claim 1, wherein the antenna is affixed to the video camera and at least one of the plurality of antennae is located remote from the plurality of cameras.

8. The system of claim 1, wherein the profile includes any one or a combination of the captured video data, the captured mobile communication device data, temporal data associated with the captured video data or the captured mobile communication device data, and location data associated with the captured video data or the captured mobile communication device data.

9. The system of claim 8, wherein the captured video data includes any one or a combination of a captured still image and video footage, and the mobile communication device data includes any one or a combination of a WiFi identifier, a media access control (MAC) identifier, a Bluetooth identifier, a cellular identifier, a near field communication identifier, and a radio frequency identifier associated with the mobile communication device in communication with the antenna.

10. The system of claim 8, wherein the temporal data includes any one or a combination of a time the video data is captured and a time the mobile communication device data is captured, and the location data includes any one or a combination of a location at which the video data is captured and a location at which the mobile communication device data is captured.

11. An analytical recognition method, comprising:

capturing, by way of a video camera, video data including a video frame that includes an image of a person;

capturing, by way of an antenna, mobile communication device data including an identifier of a mobile communication device associated with the person;

correlating the video data and the mobile communication device data, wherein the correlating includes matching the video frame that includes the image of the person to the identifier of the mobile communication device associated with the person;

generating a profile of the person based on a result of the correlating, wherein the generated profile includes;

at least one of an indication of when the video frame was captured or an indication of when the mobile communication device data was captured; and

at least one of an indication of a location at which the video data was captured or an indication of a location at which the mobile communication device data was captured;

identifying objects associated with the person from at least one of or a combination of the video data and the mobile communication device data; and

tracking the identified object using at least one of or a combination of the video data and the mobile communication device data.

12. A non-transitory computer-readable medium having stored thereon instructions that, when executed by a computer, cause the computer to execute an analytical recognition method, the method comprising:

capturing, by way of a video camera, video data including a video frame that includes an image of a person;

capturing, by way of an antenna, mobile communication device data including an identifier of a mobile communication device associated with the person;

correlating the video data and the mobile communication device data, wherein the correlating includes matching the video frame that includes the image of the person to the identifier of the mobile communication device associated with the person;

generating a profile of the person based on a result of the correlating, wherein the generated profile includes;

at least one of an indication of when the video frame was captured or an indication of when the mobile communication device data was captured; and

at least one of an indication of a location at which the video data was captured or an indication of a location at which the mobile communication device data was captured;

identifying objects associated with the person from at least one of or a combination of the video data and the mobile communication device data; and

tracking the identified object using at least one of or a combination of the video data and the mobile communication device data.