Inference of timestamp, location, and signature information using statistical signal processing of powerline data

• US 9,965,818 B2
• Filed: 08/14/2014
• Issued: 05/08/2018
• Est. Priority Date: 08/15/2013
• Status: Active Grant

• Current Assignee: Lockheed Martin Corporation (Martin Marietta Corporation)
• Original Assignee: Lockheed Martin Corporation (Martin Marietta Corporation)
• Inventors: Panczenko, Michael, Hrybyk, Alexander Gregory, Tang, Kwok Lee
• Primary Examiner(s): Chevalier, Robert
• Application Number:
  US14/459,915
• Publication Number:
  US 20150052073A1
• Time in Patent Office: 1,363 Days
• Field of Search: 386239, 386240, 386242, 386248, 386323, 386326
• CPC Class Codes: G06F 16/683 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/783 using metadata automatically derived from the content
• CPC Class Codes: G06Q 50/265 Personal security, identity or safety

Abstract

Systems and methods for applying Electric Network Frequency (ENF) forensic techniques to determine characteristics associated with an audio and/or video recording such as when and where the recording was made. In one embodiment, a system that determines at least one of a time and a location associated with a recording includes an ENF forensic database, an ENF extraction processing module and a comparison processing module. The ENF forensic database stores powerline data collected from at least one electrical power grid. The ENF extraction processing module extracts ENF content coupled into the recording. The comparison processing module compares the extracted ENF content with powerline data retrieved from the ENF forensic database and outputs information including one or more of a time during which the recording was made and a location where the recording was made based on the comparison with the powerline data.

Claims

1. A system comprising:

an electric network frequency (ENF) forensic database storing powerline data collected from at least one electrical power grid, the powerline data comprising a plurality of data points representing changes within electric fields associated with at least one electrical power grid over time and including at least one of information indicative of times at which specific data points were obtained and information identifying a location in the at least one electrical power grid from which the specific data points were obtained;

an ENF extraction processing module extracting ENF content coupled into a recording; and

a comparison processing module comparing the extracted ENF content with powerline data retrieved from the ENF forensic database and outputting information including one or more of a time during which the recording was made and a particular location where the recording was made based on the comparison with the powerline data, wherein the comparison processing module further compares the extracted ENF content with the powerline data retrieved from the ENF forensic database to identify a best match between the extracted content and at least a portion of the powerline data and displays a visual representation of the extracted ENF content together with the at least a portion of the powerline data identified as being the best match.

2. The system according to claim 1, wherein the recording comprises one of an audio recording, a video recording and an audio-visual recording.

3. The system according to claim 1, further comprising:

a plurality of ENF sensors collecting the powerline data at different locations within or more electrical power grids, wherein the ENF sensors communicate the collected powerline data to the ENF forensic database.

4. The system according to claim 1, further comprising:

a computer server system including a non-transitory data storage medium on which the ENF forensic database is stored, the computer server system retrieving the powerline data from the ENF forensic database upon request from said comparison module.

5. The system according to claim 4, further comprising:

a monitor communicatively coupled to the computer server system, the monitor displaying the powerline data stored in the ENF forensic database.

6. The system according to claim 1, wherein the ENF extraction processing module comprises:

at least one processor; and

computer program code executable by the at least one processor to receive the recording and to filter the recording to extract the ENF content therefrom.

7. The system according to claim 1, wherein the comparison processing module comprises:

at least one processor.

8. The system according to claim 7, further comprising:

a monitor communicatively coupled to the at least one processor of the comparison processing module, the monitor displaying the visual representation of the extracted ENF content together with the at least a portion of the powerline data identified as being the best match.

9. The system according the claim 7, wherein the computer program code executable by the at least one processor to compare the extracted ENF content with the powerline data retrieved from the ENF forensic database implements a statistical data analysis process to identify the at least a portion of the powerline data that is the best match for the extracted ENF content.

10. The system according the claim 9, wherein the statistical data analysis process comprises at least one of exploitation of cyclostationarity, higher-order statistics, and Principal Components Analysis.

11. A method comprising:

storing powerline data collected from at least one electrical power grid in an electric network frequency (ENF) forensic database, the powerline data comprising a plurality of data points representing changes within electric fields associated with the at least one electrical power grid over time and including at least one of information indicative of times at which specific data points were obtained and information identifying a location in the at least one electrical power grid from which the specific data points were obtained;

processing a recording to extract ENF content coupled into the recording; and

comparing the extracted ENF content with powerline data retrieved from the ENF forensic database, wherein comparing the extracted ENF content with powerline data retrieved from the ENF forensic database further comprises identifying a best match between the extracted content and at least a portion of the powerline data;

outputting information including one or more of a time at which the recording was made and a particular location where the recording was made based on the comparison with the powerline data; and

displaying a visual representation of the extracted ENF content together with the at least a portion of the powerline data identified as being the best match.

12. The method according to claim 11, wherein the recording comprises one of an audio recording, a video recording and an audio-visual recording.

13. The method according to claim 11, further comprising:

collecting the powerline data at different locations within or more electrical power grids using a plurality of ENF sensors; and

communicating the collected powerline data from the plurality of ENF sensors to the ENF forensic database.

14. The method according to claim 11, wherein the ENF forensic database is stored on a non-transitory data storage medium of a computer server system, and wherein the method further comprises:

retrieving the powerline data from the ENF forensic database upon request made to the computer server system.

15. The method according to claim 14, further comprising:

displaying the powerline data stored in the ENF forensic database on a monitor communicatively coupled to the computer server system.

16. The method according to claim 11, wherein the processing the recording to extract ENF content comprises:

executing computer program code with at least one processor to receive the recording and to filter the recording to extract the ENF content therefrom.

17. The method according to claim 11, wherein

the visual representation of the extracted ENF content together with the at least a portion of the powerline data identified as being the best match is displayed on a monitor communicatively coupled to at least one processor.

18. The method according the claim 11, further comprising:

implementing a statistical data analysis process to identify the at least a portion of the powerline data that is the best match for the extracted ENF content.

19. The method according the claim 18, wherein the statistical data analysis process comprises at least one of exploitation of cyclostationarity, higher-order statistics, and Principal Components Analysis.