Grain quality sensor

• US 10,085,379 B2
• Filed: 09/12/2017
• Issued: 10/02/2018
• Est. Priority Date: 09/12/2014
• Status: Active Grant

• Current Assignee: Intelligent Agricultural Solutions LLC
• Original Assignee: Appareo Systems LLC (AGCO Corporation)
• Inventors: Schleusner, Bradley K., Bremer, Marshall T., Butts, Nicholas L.
• Primary Examiner(s): Lu, Tom Y
• Application Number:
  US15/702,621
• Publication Number:
  US 20180000011A1
• Time in Patent Office: 385 Days
• CPC Class Codes: A01D 41/02 Self-propelled combines
• CPC Class Codes: A01D 41/1271 for measuring crop flow
• CPC Class Codes: A01D 41/1272 for measuring grain flow
• CPC Class Codes: A01D 41/1273 for measuring grain loss
• CPC Class Codes: A01D 41/1274 for drives
• CPC Class Codes: A01D 41/1276 for cleaning mechanisms
• CPC Class Codes: A01D 41/1277 for measuring grain quality
• CPC Class Codes: A01D 41/141 Automatic header control
• CPC Class Codes: G01N 33/02 Food
• CPC Class Codes: G01S 13/865 Combination of radar systems with lidar systems
• CPC Class Codes: G01S 13/867 Combination of radar systems with cameras
• CPC Class Codes: G01S 13/87 Combinations of radar systems, e.g. primary radar and secondary radar
• CPC Class Codes: G01S 13/88 Radar or analogous systems specially adapted for specific applications electromagnetic prospecting or detecting of objects, e.g. near-field detection, G01V3/00
• CPC Class Codes: G01S 17/88 Lidar systems specially adapted for specific applications
• CPC Class Codes: G01S 17/89 for mapping or imaging
• CPC Class Codes: G01S 7/411 Identification of targets based on measurements of radar reflectivity G01S7/415 takes precedence
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/30128 Food products
• CPC Class Codes: G06T 7/0004 Industrial image inspection
• CPC Class Codes: G06T 7/11 Region-based segmentation
• CPC Class Codes: G06T 7/136 : involving thresholding
• CPC Class Codes: G06V 20/56 : exterior to a vehicle by using sensors mounted on the vehicle
• CPC Class Codes: G06V 20/66 : Trinkets, e.g. shirt buttons or jewellery items recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 20/68 : Food, e.g. fruit or vegetables
• CPC Class Codes: G06V 40/1388 : using image processing
• CPC Class Codes: H04N 23/80 : Camera processing pipelines; Components thereof

Abstract

A grain quality sensor comprising a photosite array, an illumination source, a filter, and an electronics module, wherein the illumination source directs light onto a crop sample, wherein the filter limits passage of light into different parts of the photosite array such that certain locations on the photosite array only receive certain wavelengths of light reflected or fluoresced by the crop sample, wherein an electronics module is electrically connected to the photosite array and capable of determining which parts of the photosite array received light and the wavelengths of the light received, wherein the electronics module can analyze the optical data received by the photosite array, and wherein the analysis of the optical data is used to determine the composition of the crop sample.

Claims

1. A grain quality sensor comprising:

a photosite array;

an illumination source configured for directing light onto a crop sample;

a filter configured for placement between said crop sample and said photosite array;

wherein said filter is configured for limiting passage of light into different parts of said photosite array such that certain locations on said photosite array only receive certain wavelengths of light from said crop sample;

an electronics module electrically connected to said photosite array and configured for analyzing optical data received by said photosite array; and

wherein said analysis of said optical data includes splitting said optical data into subsets;

transforming said optical data into a color space;

determining distributions of light pixels in each subset in each dimension of said color space;

ranking said subsets from the narrowest distribution of light pixels to the widest distribution of light pixels; and

using said ranked distributions to distinguish between characteristics of said crop sample.

2. The grain quality sensor according to claim 1, further comprising:

a lens configured for placement between said crop sample and said filter and for picking up light from said crop sample and directing said crop sample light into said filter.

3. The grain quality sensor according to claim 1, wherein said distinguishing between characteristics of said crop sample comprises determining the proportions of clean grain, damaged grain, and MOG within said crop sample.

4. The grain quality sensor according to claim 3, wherein said using said ranked distributions to distinguish between characteristics of said crop sample further comprises:

selecting a representative number of said subsets having the narrowest distributions and identifying the pixels within said representative subsets as pixels representing clean grain;

identifying any light pixels outside said clean grain distributions as pixels representing damaged grain or MOG; and

distinguishing damaged grain pixels from MOG pixels based on the particular wavelengths of said light pixels.

5. The grain quality sensor according to claim 1, wherein said crop sample light comprises light reflected or fluoresced by said crop sample.

6. The grain quality sensor according to claim 1, wherein:

said illumination source is configured for producing narrow wavelength hands of a known set of wavelengths of said light directed onto said crop sample; and

said known set of wavelengths comprises wavelengths of light selected from the group consisting of;

red light;

green light;

ultraviolet light; and

combinations thereof.

7. The grain quality sensor according to claim 1, wherein said color space is selected from the group consisting of:

hue, saturation, and lightness (HSL) color space;

hue, saturation, and value (HSV) color space; and

red, green, blue (RGB) color space.

8. The grain quality sensor according to claim 1, wherein said analysis of said optical data further includes:

calculating visual masks for said optical data; and

applying said visual masks to said optical data.

9. The grain quality sensor according to claim 1, wherein:

said analysis of said optical data further includes performing a mathematical morphological transformation of said optical data; and

said mathematical morphological transformation is selected from the group consisting of;

morphological filtering, erosion, dilation, skeletonization, segregation, and combinations thereof.

10. The grain quality sensor according to claim 4, wherein said analysis of said optical data further includes removing isolated pixels with values outside the main distribution of said crop material from consideration.

11. The grain quality sensor according to claim 1, further comprising an acoustic triggering component comprising:

a microphone configured for placement in proximity to a flow path of said crop material and configured for connection to said electronics module;

wherein said microphone is configured for detecting sound waves from said crop material in said flow path, for transforming said sound waves into electrical signals, and for sending said electrical signals to said electronics module; and

wherein said electronics module is configured for analyzing said electrical signals, for determining a pattern of crop material delivery, for calculating a timing offset for optical data capture, and for triggering optical data capture at said timing offset upon receiving an electrical signal from said microphone.

12. The grain quality sensor according to claim 11, wherein said electronics module is further configured for using a feedback loop to adjust said timing offset to improve optical data quality.

13. The grain quality sensor according to claim 11, wherein said analyzing said electrical signals comprises downsampling filtering said electrical signals and determining beat frequency and phase.

14. A grain quality system for a harvesting machine having a flow path for harvested grain material, which system comprises:

a computer associated with said harvesting machine and including a processor, an input, and an output;

said grain material flow path including a grain conveyor located internally within said harvesting machine;

an illumination source configured for placement within said harvesting machine adjacent to said grain material flow path and configured for illuminating grain material in said flow path;

an optical data capture sensor mounted within said harvesting machine and including a photosite array configured to be oriented towards said grain flow path and an electronics module connected to said photosite array;

wherein said electronics module is configured for providing an output to said computer input representing a visual characteristic of grain material in said flow path;

wherein said processor is configured for providing an output representing characteristics of said grain material in said flow path;

a filter configured for placement between said grain material and said photosite array;

wherein said illumination source is configured for directing light onto said grain material; and

wherein said filter is configured for limiting passage of light into different parts of said photosite array such that certain locations on said photosite array only receive certain wavelengths of light from said grain material.

15. The grain quality system according to claim 14, further comprising:

a lens configured for placement within said harvesting machine in proximity to said grain material flow path; and

wherein said lens is configured for picking up light from said grain material and directing said grain material light into said filter.

16. The grain quality system according to claim 14, wherein said grain material visual characteristic is selected from the group consisting of:

clean grain;

damaged grain;

material other than grain (MOG); and

combinations thereof.

17. The grain quality system according to claim 14, which includes:

said harvesting machine having an adjustable operating parameter; and

said computer being programmed for controlling said harvesting machine operating parameter with said output responsive to said grain material visual characteristic detected by said optical data capture sensor.

18. The grain quality system according to claim 14, wherein said conveyor includes:

upper and lower ends within said harvesting machine; and

wherein said illumination source and said optical data capture sensor are configured for placement in proximity to said conveyor upper end.

19. A method of determining grain quality using a grain quality sensor including a photosite array;

an illumination source configured for directing light onto a crop sample;

a filter configured for placement between the crop sample and the photosite array; and

an electronics module electrically connected to the photosite array, the method comprising the steps of;

said illumination source directing light onto said crop sample;

said filter limiting passage of light into different parts of said photosite array such that certain locations only receive certain wavelengths of light from said crop sample;

said electronics module receiving crop sample optical data from said photosite array;

said electronics module splitting said optical data into subsets;

said electronics module transforming said optical data into a color space;

said electronics module determining distributions of light pixels in each subset in each dimension of said color space;

said electronics module ranking said subsets from the narrowest distribution of light pixels to the widest distribution of light pixels; and

said electronics module using said ranked distributions to distinguish between characteristics of said crop sample.