Method of Adaptive Array Comparison for the Detection and Characterization of Periodic Motion

• US 20160217588A1
• Filed: 12/09/2015
• Published: 07/28/2016
• Est. Priority Date: 12/11/2014
• Status: Abandoned Application

• Current Assignee: Rdi, LLC
• Original Assignee: Rdi, LLC
• Inventors: Hay, Jeffrey R.
• Application Number:
  US14/757,259
• Publication Number:
  US 20160217588A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: A61B 5/0077 Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/01 Measuring temperature of body parts ; Diagnostic temperature sensing, e.g. for malignant or inflamed tissue clinical contact thermometers G01K13/20
• CPC Class Codes: A61B 5/024 Detecting, measuring or recording pulse rate or heart rate A61B5/0205, A61B5/021 take precedence
• CPC Class Codes: A61B 5/0816 Measuring devices for examining respiratory frequency measuring frequency of electric signals G01R23/00
• CPC Class Codes: A61B 5/165 Evaluating the state of mind, e.g. depression, anxiety
• CPC Class Codes: A61B 5/4815 Sleep quality
• CPC Class Codes: A61B 5/7435 Displaying user selection data, e.g. icons in a graphical user interface
• CPC Class Codes: G01N 2291/028 Material parameters
• CPC Class Codes: G01N 29/44 Processing the detected response signal , e.g. electronic circuits specially adapted therefor digital signal processing per se G06F17/00
• CPC Class Codes: G06F 16/7335 Graphical querying, e.g. query-by-region, query-by-sketch, query-by-trajectory, GUIs for designating a person/face/object as a query predicate end-user interface involving hot spots associated with the video H04N21/4725; end-user interface for selecting a Region of Interest H04N21/4728
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/20056 Discrete and fast Fourier transform, [DFT, FFT]
• CPC Class Codes: G06T 2207/20216 Image averaging
• CPC Class Codes: G06T 2207/30004 Biomedical image processing
• CPC Class Codes: G06T 2207/30164 Workpiece; Machine component
• CPC Class Codes: G06T 7/0016 involving temporal comparison
• CPC Class Codes: G06T 7/11 Region-based segmentation
• CPC Class Codes: G06T 7/248 involving reference images or patches
• CPC Class Codes: G06T 7/262 : using transform domain methods, e.g. Fourier domain methods
• CPC Class Codes: G06V 20/52 : Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 40/20 : Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: H04N 7/18 : Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

A system for analyzing periodic motions includes:

• • a device for acquiring video files;
  • a data analysis system including a processor and memory;
  • a computer program to automatically analyze the video images, identify an area in the images where periodic movements may be detected and quantified using an Adaptive Array Comparison method; and,
  • an interface to provide an output signal related to at least one parameter characteristic of said periodic movement.

A graphical user interface may be provided and may display various analytical results along with the video imagery or a single frame therefrom.

Claims

1. A system for analyzing periodic motions comprising:

a device for acquiring video files;

a data analysis system including a processor and memory;

a computer program to automatically analyze the video images, identify an area in the images where periodic movements may be detected and quantified using an Adaptive Array Comparison method; and

,

an interface to provide an output signal related to at least one parameter characteristic of said periodic movement.

2. The system of claim 1 wherein said device for acquiring video files is selected from the group consisting of:

video cameras, optical sensors, IR sensors, smart phones, webcams, digital microscopes, telescopes, and memory devices having video files recorded therein.

3. The system of claim 1 wherein said computer program detects said periodic movements by an adaptive array comparison procedure in which:

starting with a first frame [F₀], the intensity at each respective pixel in the frame is subtracted from its intensity in frame [F_0+x], where x is an integer, the intensities in frame [F_0+x] are subtracted from those in frame [F_0+2x], . . . until reaching a selected end point at frame [F_0+nx] where n is an integer and the product nx is less than the total number of frames in said video file;

the resulting frame differences are summed for each pixel;

the process is repeated for at least two unique values of x, so that an optimal frame spacing x yielding the greatest difference may be found; and

,

a selected number of pixels having the greatest frame-to-frame intensity difference are monitored to determine the rate of said periodic movements.

4. The system of claim 3 wherein said program repeats the adaptive array comparison procedure with other selected starting frames, to determine the phase of said periodic movement.

5. The system of claim 1 wherein said interface comprises a Graphical User Interface (GUI).

6. The system of claim 5 wherein said GUI displays data corresponding to said parameter characteristic of said periodic movement.

7. The system of claim 6 wherein said GUI further displays an image from said video file.

8. The system of claim 5 wherein said GUI further includes an output selected from the group consisting of:

still images containing phase information;

still images containing frequency information;

still images containing edge enhancement;

moving images displaying motion amplification; and

,

audio recordings.

9. The system of claim 5 wherein said GUI allows a user to replay data starting at a selected time so that said user may simultaneously view the video stream and the corresponding calculated data.

10. The system of claim 9 wherein said GUI allows a user to define a perimeter within the video frame and said data analysis system monitors movements within said user-defined perimeter.

11. A method for characterizing periodic motions using video data comprises:

acquiring a video file of a selected object;

providing a data analysis system including a processor and memory operating a computer program to analyze the acquired video file by an adaptive array comparison procedure and calculate a parameter characteristic of the physical displacement of the object as a function of time and determine the periodicity thereof;

time-stamping the video file and the determined periodicity associated therewith; and

,

archiving the time stamped images and the associated physical displacement data in a data storage system for later retrieval.

12. The method of claim 11 wherein said video file is acquired using a means selected from the group consisting of:

video cameras, optical sensors, IR sensors, smart phones, webcams, digital microscopes, telescopes, memory devices having video files recorded therein, and downloading from a server.

13. The method of claim 11 wherein said computer program detects said periodic movements by an adaptive array comparison procedure in which:

starting with a first frame [F₀], the intensity at each respective pixel in the frame is subtracted from its intensity in frame [F_0+x], where x is an integer, the intensities in frame [F_0+x] are subtracted from those in frame [F_0+2x], . . . until reaching a selected end point at frame [F_0+nx] where n is an integer and the product nx is less than the total number of frames in said video file;

the resulting frame differences are summed for each pixel;

the process is repeated for at least two unique values of x, so that an optimal frame spacing x yielding the greatest difference may be found; and

,

a selected number of pixels having the greatest frame-to-frame intensity difference are monitored to determine the rate of said periodic movements.

14. The method of claim 13 wherein said program repeats the adaptive array comparison procedure with other selected starting frames, to determine the phase of said periodic movement.

15. The method of claim 11 wherein said interface comprises a Graphical User Interface (GUI).

16. The method of claim 15 wherein said GUI displays data corresponding to said parameter characteristic of said periodic movement.

17. The method of claim 16 wherein said GUI further displays an image from said video file.

18. The method of claim 15 wherein said GUI further includes an output selected from the group consisting of:

still images containing phase information;

still images containing frequency information;

still images containing edge enhancement;

moving images displaying motion amplification; and

,

audio recordings.

19. The method of claim 15 wherein said GUI allows a user to replay data starting at a selected time so that said user may simultaneously view the video stream and the corresponding calculated data.

20. The method of claim 19 wherein said GUI allows a user to define a perimeter within the video frame and said data analysis system monitors movements within said user-defined perimeter.