APPARATUS AND METHOD FOR REAL TIME IMAGE COMPRESSION FOR PARTICLE TRACKING

• US 20100134631A1
• Filed: 10/25/2007
• Published: 06/03/2010
• Est. Priority Date: 10/30/2006
• Status: Abandoned Application

• Current Assignee: Wesleyan University
• Original Assignee: Wesleyan University
• Inventors: Stich, Dominick, Voth, Greg, Chan, King-Yeung
• Application Number:
  US12/447,792
• Publication Number:
  US 20100134631A1
• Time in Patent Office: Days
• US Class Current: 348/169
• CPC Class Codes: G01N 15/1433 using image recognition
• CPC Class Codes: G01N 15/1459 the analysis being performed on a sample stream
• CPC Class Codes: G01N 2015/1027 Determining speed or velocity of a particle
• CPC Class Codes: H04N 19/132 Sampling, masking or truncation of coding units, e.g. adaptive resampling, frame skipping, frame interpolation or high-frequency transform coefficient masking
• CPC Class Codes: H04N 19/136 Incoming video signal characteristics or properties
• CPC Class Codes: H04N 19/182 the unit being a pixel
• CPC Class Codes: H04N 19/20 using video object coding

Abstract

A real-time image compression method includes identifying pixels in a set of image data that have a brightness value past a predetermined threshold; determining a position of each identified pixel in the image data; and for each of the identified pixels, defining a vector that includes the brightness value and the position of the identified pixel in the image data.

Claims

1. A method of tracking a flow in a fluid medium comprising:

injecting a plurality of particles into the flow;

imaging the particles and fluid using a high speed digital video camera;

compressing images provided by the high speed digital video camera in real-time during the imaging; and

processing the compressed images.

2. The method of claim 1, wherein the compressing comprises filtering video data provided by the high speed digital video camera to remove data related to portions of the images in which there are no imaged particles.

3. The method of claim 1, wherein the compressing comprises thresholding pixels in image data in accordance with respective brightness values for the pixels.

4. The method of claim 3, wherein the compressing includes defining a vector for each pixel that has a brightness value past a predetermined threshold, the vector including the brightness value and a position of the pixel in the image data.

5. The method of claim 4, wherein the pixels have a brightness value above the predetermined threshold.

6. The method of claim 4, wherein the pixels have a brightness value below the predetermined threshold.

7. The method of claim 1, wherein the imaging is performed with a plurality of high speed digital video cameras.

8. The method of claim 1, wherein the compressing includes

identifying pixels in a set of image data that have a brightness value past a predetermined threshold;

determining a position of the identified pixels in the image data; and

for each of the identified pixels, defining a vector that includes the brightness value and the position of the identified pixel in the image data.

9. The method of claim 1, wherein the processing is performed in real-time during the compressing.

10. The method of claim 1, wherein the processing includes storing the compressed images.

11. The method of claim 1, wherein the processing includes reconstructing a motion of the particles in the fluid medium.

12. The method of claim 1, wherein the high speed digital video camera is configured to generate at least one hundred images per second.

13. A method of tracking objects comprising:

imaging the objects using a high speed digital video camera;

compressing images provided by the high speed digital video camera in real-time during the imaging, the compressing including

thresholding pixels in the images in accordance with respective brightness values for the pixels, and

defining a vector for each pixel that has a brightness value past a predetermined threshold, the vector including the brightness value and a position of the pixel in the images; and

processing the compressed images.

14. The method of claim 13, wherein the objects are particles and the compressed images are used to analyze a flow in a fluid medium.

15. A system for tracking a flow in a fluid medium comprising:

a high speed digital video camera configured to image particles and fluid;

a compression circuit configured to compress images provided by the high speed digital video camera in real-time during the imaging, the compression circuit including a processing system that is, configured to filter image data provided by the high speed digital video camera to remove data related to portions of the images in which there are no imaged particles; and

a storage medium configured to store the compressed images.

16. The system of claim 15, wherein the compression circuit is configured to define a vector for each pixel that has a brightness value past a predetermined threshold, the vector including the brightness value and a position of the pixel in an image frame.

17. A real-time image compression method comprising:

identifying pixels in a set of image data that have a brightness value past a predetermined threshold;

determining a position of each identified pixel in the image data; and

for each of the identified pixels, defining a vector that includes the brightness value and the position of the identified pixel in the image data.

18. The method of claim 17, wherein the pixels have a brightness value above the predetermined threshold.

19. The method of claim 17, wherein the pixels have a brightness below the predetermined threshold.

20. The method of claim 17, wherein the set of image data comprises a plurality of groups of pixels and the identifying further includes processing each group of pixels one at a time and wherein the vector has a same number of bytes as a sequence defined by each group of pixels.

21. The method of claim 20, wherein the sequence defined by each group of pixels and the vector each include 10 bytes.

22. The method of claim 17, wherein the identifying includes simultaneously processing a plurality of pixels with a corresponding plurality of filters to identify the one or more pixels that have a brightness value past the predetermined threshold.

23. The method of claim 22, wherein the vector has a same number of bytes as a sequence defined by the plurality of pixels.

24. The method of claim 23, wherein the sequence of bytes defined by the plurality of pixels is determined by a clock cycle of a camera that outputs the image data.

25. The method of claim 22, further comprising storing pixel information for the identified pixels having a brightness value past the predetermined threshold in a corresponding plurality of memory devices before outputting the vector.

26. The method of claim 25, wherein the memory devices are first-in-first-out memory devices.

27. The method of claim 25, wherein the pixel information for each identified pixel includes the brightness value and the position of the identified pixel in the image data.

28. The method of claim 25, further comprising reading out pixel information stored in the plurality of memory devices once all pixels of an image frame have been processed.

29. The method of claim 28, further comprising storing pixel information related to pixels of a subsequent image frame during the reading out of the pixel information of the image frame.

30. The method of claim 17, wherein the set of image data includes a plurality of image frames and wherein determining a position of the identified pixels in the image data includes counting lines in each image frame and determining frame breaks between two consecutives image frames.

31. The method of claim 17, wherein the vector is outputted to a frame grabber that is configured to construct an image frame.

32. The method of claim 17, wherein a compression ratio of an image frame is greater than about 100.

33. The method of claim 32, wherein the compression ratio is in a range between 100 and 1000.

34. The method of claim 17, wherein a compression ratio of an image frame is at least 10 for a bright pixel density greater than about 100.

35. A real-time image compression method comprising:

receiving a plurality of groups of pixels that define an image frame;

processing each of the plurality of groups of pixels, the processing including

identifying pixels in each group of pixels that have a brightness value past a predetermined threshold; and

determining a position of the identified pixels in the image frame; and

for each of the identified pixels, defining a vector that includes the brightness value and the position of the identified pixel in the image frame, the vector having a same number of bytes as a sequence defined by each group of pixels.

36. The method of claim 35, wherein the pixels in each group of pixels are simultaneously filtered.

37. A real-time image compression circuit comprising:

a plurality of filters configured to identify pixels in a set of image data that have a brightness value past a predetermined threshold;

a plurality of memory devices configured to store brightness information related to the identified pixels, the brightness information including a brightness value and a position of each of the identified pixels in the image data; and

a multiplexer configured to define for each identified pixel a vector that includes the brightness value and the position of the identified pixel in the image data.

38. The circuit of claim 37, wherein the plurality of filters are configured to identify pixels that have a brightness value above the predetermined threshold.

39. The circuit of claim 37, wherein the plurality of filters are configured to identify pixels that have a brightness value below the predetermined threshold.

40. The circuit of claim 37, wherein the set of image data comprises a plurality of group of pixels, each group of pixels being inputted to the plurality of filters one at a time and wherein the vector defined by the multiplexer has a same number of bytes as a sequence defined by each group of pixels.

41. The circuit of claim 40, wherein the sequence defined by each group of pixels and the vector each include 10 bytes.

42. The circuit of claim 37, wherein the plurality of filters are configured to simultaneously process a corresponding plurality of pixels to identify pixels in the set of image data that have a brightness value past a predetermined threshold.

43. The circuit of claim 42, wherein the vector has a same number of bytes as a sequence defined by the plurality of pixels.

44. The circuit of claim 43, wherein the sequence of bytes defined by the plurality of pixels is determined by a clock cycle of a camera that outputs the image data.

45. The circuit of claim 42, wherein each memory device of the plurality of memory devices is configured to store brightness information from a corresponding filter of the plurality of filters.

46. The circuit of claim 37, wherein the memory devices are first-in-first-out memory devices.

47. The circuit of claim 37, further comprising an output controller coupled to the plurality of memory devices and the multiplexer, the controller configured to read out brightness information stored in the plurality of memory devices once all pixels of an image frame have been processed.

48. The circuit of claim 47, wherein the plurality of memory devices are configured to store pixel information related to pixels of a subsequent image frame during the reading out of the pixel information of the image frame.

49. The circuit of claim 37, wherein the set of image data includes a plurality of image frames, the circuit further comprising a position counter configured to count lines in each image frame and to determine a frame break between two consecutive image frames.

50. The circuit of claim 37, further comprising an input coupled to an output of a camera and an output coupled to an input of a frame grabber.

51. The circuit of claim 37, wherein the compression ratio of an image frame is greater than about 100.

52. The circuit of claim 51, wherein the compression ratio is in a range between 100 and 1000.

53. The circuit of claim 37, wherein a compression ratio of an image frame is at least 10 for a bright pixel density greater than about 100.

54. A real-time image compression circuit comprising:

an input configured to receive a plurality of groups of pixels that define an image frame;

a plurality of filters configured to process each group of pixels one at a time and to simultaneously identify pixels in each group of pixels that have a brightness value past a predetermined threshold;

a plurality of memory devices configured to store brightness information related to the identified pixels, each memory device in the plurality of memory devices coupled to a corresponding filter of the plurality of filters, the brightness information including a brightness value and a position of each of the identified pixels in the image frame; and

a multiplexer configured to define for each identified pixel a vector that includes the brightness value and the position of the identified pixel in the image data.

55. A camera comprising:

an optical system configured to capture images of a scene;

a processing system configured to output a set of image data based on the captured images; and

an image compression circuit configured to compress the captured images in real time, the circuit comprising;

a plurality of filters configured to identify pixels in the set of image data that have a brightness value past a predetermined threshold;

a plurality of memory devices configured to store brightness information related to the identified pixels, the brightness information including a brightness value and a position of each of the identified pixels in the image data; and

a multiplexer configured to define for each identified pixel a vector that includes the brightness value and the position of the identified pixel in the image data.