Digital imaging system and methods for selective image filtration

• US 7,612,805 B2
• Filed: 07/06/2007
• Issued: 11/03/2009
• Est. Priority Date: 07/11/2006
• Status: Active Grant

• Current Assignee: Optimum Imaging Technologies LLC
• Original Assignee: Neal Solomon
• Inventors: Solomon, Neal
• Primary Examiner(s): Chan; Jason
• Assistant Examiner(s): KHAN, USMAN A
• Application Number:
  US11/825,521
• Publication Number:
  US 20080174678A1
• Time in Patent Office: 851 Days
• Field of Search: 348/222.1, 348/231.99, 348/224.1, 348/273, 348/342, 348/208.11, 348/333.08, 348/335, 348/340
• US Class Current: 348/222.1
• CPC Class Codes: G02B 27/0025 for optical correction, e.g. distorsion, aberration
• CPC Class Codes: G06T 7/194 involving foreground-background segmentation
• CPC Class Codes: H04N 23/45 for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• CPC Class Codes: H04N 23/54 Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils
• CPC Class Codes: H04N 23/55 Optical parts specially adapted for electronic image sensors; Mounting thereof
• CPC Class Codes: H04N 23/66 Remote control of cameras or camera parts, e.g. by remote control devices
• CPC Class Codes: H04N 23/67 Focus control based on electronic image sensor signals
• CPC Class Codes: H04N 23/69 Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
• CPC Class Codes: H04N 23/73 by influencing the exposure time
• CPC Class Codes: H04N 23/75 by influencing optical camera components
• CPC Class Codes: H04N 23/76 by influencing the image signals
• CPC Class Codes: H04N 23/81 for suppressing or minimising disturbance in the image signal generation
• CPC Class Codes: H04N 23/811 by dust removal, e.g. from surfaces of the image sensor or processing of the image signal output by the electronic image sensor
• CPC Class Codes: H04N 23/959 by adjusting depth of field during image capture, e.g. maximising or setting range based on scene characteristics
• CPC Class Codes: H04N 25/585 with pixels having different sensitivities within the sensor, e.g. fast or slow pixels or pixels having different sizes
• CPC Class Codes: H04N 25/61 the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4"
• CPC Class Codes: H04N 25/615 involving a transfer function modelling the optical system, e.g. optical transfer function [OTF], phase transfer function [PhTF] or modulation transfer function [MTF]

Abstract

A system is disclosed for the automated correction of optical and digital aberrations in a digital imaging system. The system includes digital filtration and digital system corrections to optical and digital aberrations. The system addresses issues in still and video photography that are presented in the digital imaging environment.

Claims

1. A digital imaging system for image filtration comprising:

a digital camera mechanism, an optical lens mechanism, a digital sensor, a microprocessor, a digital signal processor, an application specific integrated circuit, system software, a database management system and a memory storage sub-system;

wherein the optical lens mechanism is a fixed focal length;

wherein the aberrations from the optical lens mechanism are corrected by applying digital filtration by using the application specific integrated circuit and the digital signal processor;

wherein the microprocessor is used to provide digital and optical data to the digital signal processor;

wherein the system software is organized to identify specific optical aberrations and to access the database to identify specific corrections to the aberrations;

wherein the system software forwards the data from the digital sensor to the digital processor;

wherein the digital signal processor selects a specific procedure to optimize the image and corrects the aberrations;

wherein the data are forwarded from the digital sensor to the digital signal processor by an application specific integrated circuit;

wherein the digital signal processor applies a fast Fourier transform to a data file in order to satisfy a user specified special effects function;

wherein the digital signal processor modifies the data file by applying the special effects function; and

wherein the modified data file consisting of the digital data optimized from the aberrations that are corrected from the original optical image is stored in memory.

2. The system of claim 1:

wherein the special effects function is a color enhancing function.

3. The system of claim 1:

wherein the special effects function is a diffusion function of soft effect.

4. A digital imaging system for image filtration comprising:

a digital camera mechanism, an optical lens mechanism, a digital sensor, a microprocessor, a digital signal processor, an application specific integrated circuit, system software, a database management system and a memory storage sub-system;

wherein the optical lens mechanism is a fixed focal length;

wherein the aberrations from the optical lens mechanism are corrected by applying digital filtration by using the application specific integrated circuit and digital signal processor;

wherein the microprocessor is used to provide digital and optical data to the digital signal processor;

wherein the system software is organized to identify specific optical aberrations and to access the database to identify specific corrections to the aberrations;

wherein the system software forwards the data from the digital sensor to the digital processor;

wherein the digital signal processor selects a specific procedure to optimize the image and corrects the aberrations;

wherein the data are forwarded from the digital sensor to the digital signal processor;

wherein a data file is analyzed by the microprocessor to separate specific objects in the image using the differentiation of the depth-of-field;

wherein the digital signal processor applies filtration only to specific objects in the image;

wherein the aberrations of the specific objects are corrected; and

wherein the digital signal processor forwards the modified date file to storage in memory.

5. The system of claim 4:

wherein the subject is isolated by focusing on the subject and narrowing the depth of field range by manipulating the aperture.

6. The system of claim 4:

wherein filtration is applied only to the background of an image exclusive of specific selected objects.

7. The system of claim 4:

wherein specific color filtration is applied to objects.

8. The system of claim 4:

wherein specific filtration applied to specific objects is soft effects.

9. A digital imaging system for image filtration comprising:

a digital camera mechanism, an optical lens mechanism, a digital sensor, a microprocessor, a digital signal processor, an application specific integrated circuit, system software, a database management system and a memory storage sub-system;

wherein the aberrations from the optical lens mechanism are corrected by applying digital filtration by using the application specific integrated circuit and the digital signal processor;

wherein the microprocessor is used to provide digital and optical data to the digital signal processor;

wherein the system software is organized to identify specific optical aberrations and to access the database to identify specific corrections to the aberrations;

wherein the system software forwards the data from the digital sensor to the digital processor;

wherein the digital signal processor selects a specific procedure to optimize the image and corrects the aberrations;

wherein the lens type is a zoom lens;

wherein the lens focal length alternates from specific fixed focal length lens settings in a succession of steps;

wherein optical aberrations are corrected with digital filtration to modify multiple images from different focal lengths in a succession of data files; and

wherein the modified data file consisting of the digital data optimized from the aberrations that are corrected from the original optical image is stored in memory.

10. The system of claim 9:

wherein as the zoom lens changes focal length positions, the system anticipates the direction of zoom lens changes to accelerate the filtration modifications.

11. A digital imaging system for image filtration comprising:

a digital camera mechanism, an optical lens mechanism, a digital sensor, a microprocessor, a digital signal processor, an application specific integrated circuit, system software, a database management system and a memory storage sub-system;

wherein the aberrations from the optical lens mechanism are corrected by applying digital filtration by using the application specific integrated circuit and the digital signal processor;

wherein the microprocessor is used to provide digital and optical data to the digital signal processor;

wherein the system software is organized to identify specific optical aberrations and to access the database to identify specific corrections to the aberrations;

wherein the system software forwards the data from the digital sensor to the digital processor;

wherein the digital signal processor selects a specific procedure to optimize the image and corrects the aberrations;

wherein the system uses a video camera to capture moving objects;

wherein the type of filtration applied by the digital signal processor is applied to specific moving objects;

wherein the digital image that is captured is forwarded from the digital sensor to the digital signal processer;

wherein a data file is analyzed by the microprocessor to separate specific objects in the image using the temporal differentiation of caching in which successive images share geometric elements;

wherein the digital signal processor applies filtration only to a specific continuous object that is isolated and is in motion; and

wherein the digital signal processor forwards the modified data file to be stored in memory.

12. The system of claim 11:

wherein a specific continuous object is selectively filtered with soft effects.

13. The system of claim 11:

wherein the background of the image is filtered independently of the moving objects.

14. The system of claim 11:

wherein multiple moving objects arc tracked and differentiation between objects is made by changing the depth of field of the objects.

15. A digital imaging system for image filtration comprising:

a digital camera mechanism, an optical lens mechanism, digital sensors, a microprocessor, a digital signal processor, an application specific integrated circuit, system software, a database management system and a memory storage sub-system;

wherein the aberrations from the optical lens mechanism are corrected by applying digital filtration by using the application specific integrated circuit and digital signal processor;

wherein the microprocessor is used to provide digital and optical data to the digital signal processor;

wherein the system software is organized to identify specific optical aberrations and to access the database to identify specific corrections to the aberrations;

wherein the system software forwards the data from the digital sensor to the digital processor;

wherein the digital signal processor selects a specific procedure to optimize the image and corrects the aberrations;

wherein a network of digital imaging sensors is linked together in a fixed structure;

wherein the network is coordinated to track specific objects that are within its collective field of vision;

wherein the network captures images of objects using the digital imaging sensors;

wherein the individual digital imaging sensors forward the imaging data to a central digital signal processor;

wherein the digital signal processor selects a specific procedure to optimize the imaging data and corrects the aberrations;

wherein a data file is analyzed by the microprocessor to separate specific objects in the image using the temporal differentiation of caching in which successive images share geometric elements;

wherein the digital signal processor applies filtration only to specific continuous objects that are isolated and are in motion; and

wherein the modified data file consisting of the data optimized from the aberrations that are corrected from the original optical image is stored in memory.

16. The system of claim 15:

wherein as an object moves through the sensor network, the system sensors are coordinated to hand off the object to other sensors on the grid.

17. The system of claim 15:

wherein the background of the image in the sensor network is selectively filtered.

18. A method of image filtration which comprises:

a digital camera mechanism, an optical lens mechanism, a digital sensor, a microprocessor, a digital signal processor, an application specific integrated circuit, system software, a database management system and a memory storage sub-system;

wherein the aberrations from the optical lens mechanism are corrected by applying digital filtration by using the application specific integrated circuit and the digital signal processor, the method consisting of;

forwarding the data from a digital sensor to a digital signal processor by an application specific integrated circuit;

providing digital and optical data to the digital signal processor;

identifying specific optical aberrations and accessing a database to identify specific corrections to the aberrations;

selecting a specific procedure from the database using the microprocessor to optimize the image and correct the aberrations;

applying digital filtration by using the application specific integrated circuit and digital signal processor to correct digital or optical aberrations;

applying a fast Fourier transform to a data file in order to satisfy a user specified special effects function;

modifying the data file by applying the special effects function using the digital signal processor; and

storing the data file in memory.

19. The method of claim 18 further comprising the step of:

applying the special effects function as a color enhancing function.

20. The method of claim 18 further comprising the step of:

applying the special effects function as a diffusion function of soft effect.

21. A method of image filtration which comprises:

a digital camera mechanism, an optical lens mechanism, a digital sensor, a microprocessor, a digital signal processor, an application specific integrated circuit, system software, a database management system and a memory storage sub-system;

wherein the aberrations from the optical lens mechanism are corrected by applying digital filtration by using the application specific integrated circuit and digital signal processor, the method consisting of;

forwarding the data from a digital sensor to a digital signal processor;

analyzing a data file by the microprocessor to separate specific objects it the image using the differentiation of the depth-of-field;

providing digital and optical data to the digital signal processor;

identifying specific optical aberrations and accessing a database to identify specific corrections to the aberrations;

selecting a specific procedure from the database using the microprocessor to optimize the image and correct the aberrations;

applying digital filtration by using the application specific integrated circuit and digital signal processor to correct digital or optical aberrations;

correcting the aberrations of the specific objects in the image by applying the digital signal processor filtration; and

forwarding the modified data file from the digital signal process to storage in memory.

23. The method of claim 21 further comprising the step of:

applying soft effects filtration to specific objects.

22. The method of clam 21 further comprising the step of:

applying specific color filtration to objects.

24. A method of image filtration comprising:

a digital camera mechanism, an optical lens mechanism, a digital sensor, a microprocessor, a digital signal processor, an application specific integrated circuit, system software, a database management system and a memory storage sub-system;

wherein the aberrations from the optical lens mechanism are corrected by applying digital filtration by using the application specific integrated circuit and digital signal processor, the method consisting of;

alternating the lens focal length of a zoom lens from specific fixed focal length lens settings in a succession of steps;

creating data files corresponding to each focal length lens setting;

forwarding the data from a digital sensor to the digital signal processor;

providing digital and optical data to a digital signal processor;

identifying specific optical aberrations and accessing a database to identify specific corrections to the aberrations;

selecting a specific procedure from the database using the microprocessor to optimize the image and correct the aberrations;

applying digital filtration by using the application specific integrated circuit and digital signal processor to correct digital or optical aberrations;

correcting optical aberrations with digital filtration to modify multiple images from different focal lengths in a succession of data files; and

storing the modified data files in memory.

25. The method of claim 24 further comprising:

wherein as the zoom lens changes focal length positions, anticipating the direction of zoom lens changes to accelerate the filtration modifications.

26. A method for image filtration comprising:

digital camera mechanism, an optical lens mechanism, a digital sensor, a microprocessor, a digital signal processor, an application specific integrated circuit, system software, a database management system and a memory storage sub-system;

wherein the aberrations from the optical lens mechanism are corrected by applying digital filtration by using the application specific integrated circuit and digital signal processor, the method consisting of;

capturing moving objects using a video camera;

forwarding the data that are captured from the digital sensor to a digital signal processor;

providing digital and optical data to a digital signal processor;

identifying specific optical aberrations and accessing a database to identify specific corrections to the aberrations;

selecting a specific procedure from the database using the microprocessor to optimize the image and correct the aberrations;

analyzing a data file by the microprocessor to separate specific objects in the image;

using the temporal differentiation of caching in which successive images share geometric elements;

applying filtration only to a specific continuous object that is isolated and is in motion by using the digital signal processor;

correcting optical aberrations with digital filtration; and

storing the modified data file in memory by forwarding the data file from the digital signal processor.

27. The method of claim 26 further comprising the step of:

filtering with soft effects a specific continuous object.

28. The method of claim 26 further comprising the step of:

filtering the background of the image independently of the moving objects.

29. The method of claim 26 further comprising:

tracking multiple moving objects; and

differentiating between objects by changing the depth of field of the objects.

30. A method for image filtration comprising:

a digital camera mechanism, an optical lens mechanism, digital sensors, a microprocessor, a digital signal processor, an application specific integrated circuit, system software, a database management system and a memory storage sub-system;

wherein the aberrations from the optical system are corrected by applying digital filtration by using the application specific integrated circuit and digital signal processor, the method consisting of;

linking a network of digital imaging sensors together in a fixed structure;

coordinating the network to track specific objects that are within its collective field of vision;

capturing the network images of objects using the digital imaging sensors;

forwarding the imaging data from individual digital imaging sensors to a central digital signal processor;

analyzing the data in the images in the digital signal processor by using the microprocessor to separate specific images in the network;

providing digital and optical data to the digital signal processor;

identifying specific optical aberrations and accessing a database to identify specific corrections to the aberrations;

selecting a specific procedure to optimize the image and correct the aberrations;

applying digital filtration by using the application specific integrated circuit and digital signal processor to correct digital or optical aberrations;

modifying a data file by correcting optical aberrations with digital filtration;

analyzing the data file by using the microprocessor to separate specific objects in the image using the temporal differentiation of caching in which successive images share geometric elements;

applying filtration by the digital signal processor only to specific continuous objects that are isolated and are in motion; and

forwarding the consolidated data file to storage in memory.

31. The method of claim 30 further comprising the step of:

coordinating the hand off of the object to other sensors on the grid as objects move through the sensor network.

32. The method of claim 30 further comprising the step of:

filtering the background of the image in the sensor network by differentiating the objects.