Method for monitoring nitrogen status using a multi-spectral imaging system

• US 6,160,902 A
• Filed: 10/10/1997
• Issued: 12/12/2000
• Est. Priority Date: 10/10/1997
• Status: Expired due to Term

• Current Assignee: Blue Leaf IP Incorporated (CNH Industrial N.V.), CNH America Llc (CNH Industrial N.V.)
• Original Assignee: Case Corporation (CNH Industrial N.V.)
• Inventors: Hendrickson, Larry Lee, Dickson, Monte Andre, Reid, John F.
• Primary Examiner(s): Au, Amelia
• Assistant Examiner(s): Wu, Jingge
• Application Number:
  US08/948,637
• Time in Patent Office: 1,159 Days
• Field of Search: 382/110, 382/286, 382/164, 348/144, 47/1.01 R, 47/58.1
• US Class Current: 382/110
• CPC Class Codes: G01J 3/2803 using photoelectric array detector
• CPC Class Codes: G01J 3/2823 Imaging spectrometer
• CPC Class Codes: G06T 2207/10036 Multispectral image; Hyperspectral image
• CPC Class Codes: G06T 7/0002 Inspection of images, e.g. flaw detection
• CPC Class Codes: G06T 7/90 Determination of colour characteristics
• CPC Class Codes: G06V 10/143 Sensing or illuminating at different wavelengths
• CPC Class Codes: G06V 20/188 Vegetation
• CPC Class Codes: H04N 23/11 for generating image signals from visible and infrared light wavelengths

Abstract

A multi-spectral imaging system and method for producing an image is disclosed. More specifically, the imaging system produces an image of vegetation for analysis of crop characteristics, such as nitrogen levels, from an area having vegetation and a non-vegetation background. A light sensing unit detects light reflected at multiple wavelengths. The image is segmented into images at different wavelengths such as at the red, green and near infrared wavelengths. The images are combined into a multi-spectral image and segmented into a vegetation image by eliminating all non-vegetation images by using the images at two wavelengths. The vegetation image is analyzed for nitrogen levels by calculating reflectance values at the green wavelength. The images may be stored for further analysis of crop characteristics.

Claims

1. An imaging system usable with a ground based vehicle for analyzing an image in real time of vegetation from an area having vegetation and a non-vegetation background, the imaging system comprising:

a light receiving unit mounted on the ground-based vehicle for receiving light reflected from the vegetation and non-vegetation background at a plurality of wavelength ranges;

an ambient light sensor mounted on the ground-based vehicle to quantify changes in ambient light intensity;

a multi-spectral sensor mounted on the ground-based vehicle and coupled to the light receiving unit and the ambient light sensor to produce an image of the vegetation and non-vegetation based on the light reflected at the plurality of wavelength ranges;

an image processor mounted on the ground-based vehicle and coupled to the multi-spectral sensor to produce a vegetation image by separating the non-vegetation portion of the image from the vegetation portion as a function of light reflected at a first wavelength and corrected for changes in ambient light intensity;

a material application device configured to apply a fertilizer and coupled for movement with the vehicle;

a means for analyzing the vegetation image to determine a nitrogen status of the crop-based on light reflected from the crop corrected for changes in ambient light intensity at a wavelength range in the green spectrum before the material application device has moved past the area; and

a controller coupled to the material application device and the means for analyzing, wherein the controller is configured to determine corrective fertilizer treatments for the area based on the determined nitrogen status of the crop and to control the material application device to apply the corrective fertilizer treatments to the area.

2. The imaging system of claim 1 further comprising:

a storage device coupled to the image analyzer for storing the vegetation image; and

a geographic information system to produce location data corresponding to the stored vegetation images.

3. The imaging system of claim 2 further comprising a position sensor coupled to the geographic information system.

4. The imaging system of claim 3, wherein the position sensor is a global positioning system receiver.

5. The imaging system of claim 1 wherein the image processor produces a vegetation images by separating the non-vegetation portion of the image from the vegetation portion as a function of light reflected at a second wavelength range.

6. The imaging system of claim 5 wherein the first wavelength range is in the near infrared spectrum and the second wavelength range is in the red spectrum.

24. The imaging system of claim 1 wherein the vegetation includes only a first part of a plant being imaged, and the non-vegetation includes a second part of the plant being imaged.

7. An image system for analyzing an image of vegetation from an area having vegetation and a non-vegetation background, the imaging system comprising:

a light receiving unit for receiving light reflected from the vegetation and non-vegetation background at a plurality of wavelength ranges;

an ambient light sensor to quantify ambient light intensity in the area;

a multi-spectral sensor coupled to the light receiving unit and the ambient light sensor to produce an image of the vegetation and non-vegetation based on the light reflected at the plurality of wavelength ranges;

an image processor coupled to the multi-spectral sensor to produce a vegetation image by separating the non-vegetation portion of the image from the vegetation portion as a function of light reflected at a first wavelength and corrected for changes in ambient light intensity; and

a means for analyzing the vegetation image in real-time to determine crop characteristics, wherein the means for analyzing the vegetation image determines a nitrogen status of the vegetation based on light reflected from the vegetation at a third wavelength range in the green spectrum, the nitrogen status being based upon only green parts of the vegetation exposed to light in the vegetation image.

8. The imaging system of claim 7 wherein the light receiving unit, the ambient light sensor, the multi-spectral sensor and the processor are mounted on a vehicle.

9. The imaging system of claim 7 wherein the light receiving unit, the ambient light sensor, the multi-spectral sensor and the processor are mounted on an airplane.

10. The imaging system of claim 7 wherein the light receiving unit, the multi-spectral sensor and the processor are mounted on a satellite and the ambient light sensor remains on the ground.

11. A method usable on a ground-based vehicle coupled to a material application device for determining crop nitrogen status in real time for an area with vegetation and non-vegetation, the method comprising the steps of:

sensing light reflected from the area at a plurality of wavelength ranges, the reflected light being sensed using a light receiving unit mounted on the vehicle;

sensing ambient light intensity in the area at a plurality of wavelength ranges, the ambient light being sensed using an ambient light sensor mounted on a vehicle;

forming an image based on the sensed light at the plurality of wavelength ranges, the image being formed using a multi-spectral sensor mounted on the vehicle;

correcting the sensed light from the light receiving unit for changes in the ambient light intensity to maintain the sensed light in a dynamic range;

separating a vegetation image from the image by analyzing light reflected at a first wavelength range, the image being separated using an image processor mounted on the vehicle; and

calculating crop nitrogen status in the vegetation image, the crop nitrogen status being calculated before the application device has moved past the area.

19. The method of claim 11 further comprising the steps of:

repeating the steps of sensing light reflected from the area and sensing ambient light intensity after a set time interval;

forming a second image based on the detected light at the plurality of wavelength ranges;

separating a second vegetation image from the second image by analyzing light reflected at the first and second wavelength ranges;

determining vegetation growth over the set time interval by comparing the vegetation image with the second vegetation image.

20. The method of claim 11 further comprising the step of determining a vegetation population from the vegetation image.

21. The method of claim 11 further comprising the step of determining positions of individual plants from the vegetation image.

22. The method of claim 11 further comprising the steps of:

storing the vegetation images;

storing location coordinates corresponding with the stored vegetation images; and

combining the vegetation image with other vegetation images to form a vegetation map of a larger area.

23. The method of claim 11 further comprising the step of isolating an image of a specific row of vegetation.

12. A method for determining crop nitrogen status in an area with vegetation and non-vegetation, the method comprising the steps of

sensing light reflected from the area at a plurality of wavelength ranges;

sensing ambient light intensity changes in the area at a plurality of wavelength ranges;

forming an image based on the sensed light and connected for ambient light intensity changes at the plurality of wavelength ranges;

separating a vegetation image from the image by analyzing light reflected at a first wavelength range;

calculating crop nitrogen status in real-time for the vegetation image; and

determining the light reflected by the vegetation image at a third wavelength range; and

wherein the step of calculating crop nitrogen status includes determining the a nitrogen status of the vegetation as a function of the light reflected by the vegetation at a third wavelength range, wherein the nitrogen status being based upon only green parts of plants exposed to light in the vegetation image.

13. The method of claim 12 wherein the first wavelength range includes near infrared light and the second wavelength range includes red light and the third wavelength range includes green light.

14. The method of claim 13 further comprising the step of:

estimating the nitrogen status for a selected area of the vegetation image by calculating the ratio of the third wavelength measurement to the measurement of the first wavelength band for a selected area of the vegetation image.

15. The method of claim 14 further comprising the steps of:

sensing a reference strip of vegetation having a non-limiting supply of nitrogen;

calculating a reference N reflectance value from the reference strip;

determining the relative nitrogen content as a function of the reference N reflectance value.

16. The method of claim 13 further comprising the steps of:

calculating an average reflective value G_avg.sbsb.n at the third wavelength for a selected area of the vegetation image based on the formula;

##EQU1## wherein G_n designates the reflectance values at the third wavelength for each of the elements (x_c, y_c) in the vegetation area and c_n is the total number of elements in the vegetation area; and

determining the nitrogen content for the selected area of the vegetation image based on the average reflective value.

17. The method of claim 13 wherein the step of separating a vegetation image from the image by analyzing light reflected at a first wavelength range and light reflected at a second wavelength range includes the steps of:

calculating a normalized difference vegetative index (NDVI) by subtracting the red value from the near infrared value and dividing the result from the addition of the red value and the near infrared value for each element of the image;

computing a threshold value based on the NDVI data for each pixel in the image;

comparing the NDVI value of each element with the threshold value;

producing a vegetation image by setting the reflectance values for all three wavelengths of each pixel to zero if the NDVI value of that pixel is below the threshold.

18. The method of claim 17 wherein the threshold value is computed by:

calculating a histogram of the NDVI values for all the pixels in the image; and

selecting a point that separates the vegetation from non-vegetation areas.