SENSOR SYSTEM, METHOD, AND COMPUTER PROGRAM PRODUCT FOR PLANT PHENOTYPE MEASUREMENT IN AGRICULTURAL ENVIRONMENTS

• US 20070044445A1
• Filed: 07/31/2006
• Published: 03/01/2007
• Est. Priority Date: 08/01/2005
• Status: Active Grant

• Current Assignee: Pioneer Hi Bred International Inc (Corteva, Inc.), University of Applied Sciences
• Original Assignee: Pioneer Hi Bred International Inc (Corteva, Inc.)
• Inventors: Spicer, Mark, Linz, Andreas, Ruckelshausen, Arno, Dzinaj, Timur
• Granted Patent: US 7,412,330 B2
• Time in Patent Office: Days
• US Class Current: 56/10.100
• CPC Class Codes: A01G 7/00 Botany in general
• CPC Class Codes: G01B 11/24 for measuring contours or curvatures

Abstract

A sensor system, method, and computer program product for determining physical characteristics of individual plants within a row located in an agricultural environment is provided. Embodiments of the present invention include, but are not limited to, a sensor assembly including a plurality of emitters and a corresponding plurality of receivers disposed substantially opposite one another such that the receivers may receive a plurality of signals emitted by said emitters to generate a binary profile image of each plant within a row of plants positioned along a row axis. Embodiments of the present invention also include supplementary sensors for determining other plant characteristics including leaf pattern and plant location along the row axis. The method and computer program product embodiments of the present invention may also differentiate selected plants of interest from invasive or weed species using the outputs of the sensor device of the present invention.

Claims

1. A system for measuring physical characteristics of a plant in an agricultural environment, the system comprising:

a sensor assembly including a plurality of emitters and a plurality of receivers disposed substantially opposite and parallel to said plurality of emitters for receiving a plurality of signals emitted by said emitters such that said receivers and said emitters may be positioned on opposite sides of the plant;

a computer device in communication with said sensor assembly for detecting the reception of signals by said receivers;

wherein said emitters emit the plurality of signals such that a portion of the plant obscures at least a portion of the plurality of signals;

wherein said computer device receives a plant profile data set generated by said plurality of receivers comprising a plurality of positive data points corresponding to a received signal and a plurality of negative data points corresponding to the portion of the plurality of signals obscured by the plant; and

wherein said computer device generates a plant characteristic data set containing plant characteristic data based at least in part on the plant profile data received from said plurality of receivers such that the plant characteristic data set may be used to measure the physical characteristics of the plant.

2. A system according to claim 1, wherein said computer device further controls said emitters to emit the plurality of signals.

3. A system according to claim 1, wherein said sensor assembly comprises at least one of:

an industrial light curtain;

a plurality of photodiodes substantially aligned with a corresponding plurality of optical sensors; and

combinations thereof.

4. A system according to claim 1, further comprising a movable assembly operably engaged with said sensor assembly for advancing said sensor assembly along a row of plants including the plant and defining a row axis, and wherein said computer device further controls said emitters to repeatedly emit the signals at a selected rate and wherein said computer device further generates a two-dimensional profile of the plant by compiling the plant profile data set generated by said receivers at a plurality of longitudinal points along the row axis, and wherein said computer device further adds the generated two-dimensional profile of the plant to the plant characteristic data set.

5. A system according to claim 1, wherein said movable assembly comprises at least one of:

a wheeled carriage;

a trailer;

an attachment for carriage by a mobile agricultural mechanism; and

combinations thereof.

6. A system according to claim 1, further comprising a user interface in communication with said computer device and wherein said computer device further generates a binary image based on the plant characteristic data set and displays the binary image to a user via said user interface and wherein said computer device further adds the binary image to the plant characteristic data set.

7. A system according to claim 1, further comprising a distance sensor disposed on the sensor assembly such that the distance sensor measures a distance to a portion of the plant, and wherein said computer device is in communication with said distance sensor for locating a position of the portion relative to said sensor assembly and wherein said computer device further adds the located position of the portion of the plant to the plant characteristic data set.

8. A system according to claim 1, further comprising a multi-spectral device operably engaged with a top portion of said sensor assembly for capturing a multi-spectral image of the plant from a position above the plant so as to differentiate the plant from a plurality of surrounding materials, and wherein said computer device is in communication with said multi-spectral device for receiving the multi-spectral image, and wherein said computer device further adds the multi-spectral image to the plant characteristic data set.

9. A system according to claim 1, wherein said sensor assembly further comprises a locator device in communication with said computer device for transmitting a location data set to said computer device to determine a location of the plant, and wherein said computer device further adds the location data set to the plant characteristic data set.

10. A system according to claim 9, wherein said locator device is at least one of:

an optical encoder;

a laser encoder;

a dead-reckoning device comprising a gyroscope and/or an accelerometer;

a global positioning system device; and

combinations thereof.

11. A system according to claim 4, wherein said movable assembly comprises at least one axle and wherein said sensor assembly further comprises a shaft encoder operably engaged with said axle and in communication with said computer device for transmitting a location data set to said computer device to determine a distance along the row of plants, and wherein said computer device further adds the location data set to the plant characteristic data set.

12. A system according to claim 1, further comprising a global positioning system device in communication with said computer device for determining a position of the plant using a global positioning system, and wherein said computer device further adds the position of the plant to the plant characteristic data set.

13. A system according to claim 1, further comprising a memory device in communication with said computer device for storing the plant characteristic data set of a known plant of interest in the memory device.

14. A system according to claim 13, wherein said computer device further identifies the plant by comparing the generated plant characteristic data set with the stored plant characteristic data set of the known plant of interest.

15. A system according to claim 1, wherein said computer device further maintains a count of a number of a plurality of plants for which a corresponding plurality of plant characteristic data sets are generated.

16. A system according to claim 15, wherein said computer device further determines the count of the number of the plurality of plants located in at least one physical unit based at least in part on the corresponding plurality of plant characteristic data sets.

17. A system according to claim 16, wherein the at least one physical unit is selected from the group consisting of:

a row;

an agricultural plot; and

combinations thereof.

18. A method for measuring physical characteristics of a plant in an agricultural environment, the method comprising:

providing a sensor assembly including a plurality of emitters and a plurality of receivers disposed substantially opposite and parallel to said plurality of emitters for receiving a plurality of signals emitted by said emitters and a computer device in communication with said profile sensor assembly;

positioning said sensor assembly relative to the plant such that said receivers and said emitters are positioned on opposite sides of the plant;

emitting the plurality of signals from said emitters such that a portion of the plant obscures at least a portion of the plurality of signals;

receiving a portion of the plurality of signals at said receivers such that said receivers generate a plant profile data set comprising a plurality of positive data points corresponding to a received signal and a plurality of negative data points corresponding to the signals obscured by the portion of the plant; and

,

generating a plant characteristic data set containing plant characteristic data based at least in part on the plant profile data received from said plurality of receivers such that the plant characteristic data set may be used to measure the physical characteristics the plant.

19. A method according to claim 18, further comprising:

advancing said sensor assembly along a row of plants including the plant and defining a row axis, wherein the emitting step further comprises repeatedly emitting the signals at a selected rate, and wherein the generating step further comprises generating a two-dimensional profile of the plant by compiling the plant profile data set generated by said receivers at a plurality of longitudinal points along the row axis; and

adding the generated two-dimensional profile of the plant to the plant characteristic data set.

20. A method according to claim 18, wherein said providing step further comprises providing said plurality of emitters extending substantially parallel to a stem axis of the plant.

21. A method according to claim 18, wherein the providing step further comprises providing a user interface in communication with said computer device, the method further comprising:

generating a binary image based on the plant characteristic data set;

displaying the binary image to a user via said user interface; and

adding the binary image to the plant characteristic data set.

22. A method according to claim 18, wherein said sensor assembly further comprises a distance sensor, the method further comprising:

locating a position of the portion of the plant relative to said sensor assembly using said distance sensor; and

adding the located position of the portion of the plant to the plant characteristic data set.

23. A method according to claim 18, wherein said sensor assembly further comprises a multi-spectral device, the method further comprising:

capturing a multi-spectral image of the plants from a position above the plant so as to differentiate the plant from a plurality of surrounding materials; and

adding the multi-spectral image to the plant characteristic data set.

24. A method according to claim 18, wherein said sensor assembly further comprises a locator device in communication with said computer device;

the method further comprising;

transmitting a location data set from said locator device to said computer device to determine a location of the plant; and

adding the location data set to the plant characteristic data set.

25. A method according to claim 19, wherein said sensor assembly is carried by a movable assembly having at least one axle and wherein said sensor assembly further comprises a shaft encoder operably engaged with said axle, the method further comprising:

transmitting a location data set from said shaft encoder to said computer device to determine a distance along the row of plants; and

adding the location data set to the plant characteristic data set.

26. A method according to claim 18, wherein said sensor assembly further comprises a global positioning system device, the method further comprising:

determining a position of the plant using a global positioning system; and

adding the determined position of the plant to the plant characteristic data set.

27. A method according to claim 18, wherein the providing step further comprises providing a memory device in communication with said computer device, the method further comprising storing the plant characteristic data set of a known plant of interest in the memory device.

28. A method according to claim 27, further comprising identifying the plant by comparing the generated plant characteristic data set with the stored plant characteristic data set of the known plant of interest.

29. A method according to claim 18, further comprising:

counting of a number of a plurality of plants for which a corresponding plurality of plant characteristic data sets are generated; and

storing the counted number of the plurality of plants.

30. A method according to claim 29, further comprising determining the number of the plurality of plants located in at least one physical unit based at least in part on the corresponding plurality of plant characteristic data sets.

31. A method according to claim 30, wherein the at least one physical unit is selected from the group consisting of:

a row;

an agricultural plot; and

combinations thereof.

32. A computer program product for controlling a computer device in communication with a sensor assembly comprising a plurality of emitters and a corresponding plurality of receivers disposed substantially opposite and parallel to said emitters for receiving a plurality of signals emitted by said emitters to determine physical characteristics of a plant in an agricultural environment, wherein a portion of a plant obscures at least a portion of the plurality of signals, the computer program product comprising a computer-readable storage medium having computer-readable program code instructions stored therein comprising:

a first set of computer instructions for receiving a portion of the plurality of signals at said receivers such that said receivers generate a plant profile data set comprising a plurality of positive data points corresponding to a received signal and a plurality of negative data points corresponding to the signals obscured by the portion of the plant; and

,

a second set of computer instructions for generating a plant characteristic data set containing plant characteristic data based at least in part on the plant profile data received from said plurality of receivers such that the plant characteristic data set may be used to measure the physical characteristics of the plant.

33. A computer program product according to claim 32, wherein said sensor assembly is advanced along a row of plants including the plant and defining a row axis, the computer program product further comprising:

a third set of computer instructions for controlling said emitters to repeatedly emit the signals at a selected rate, and wherein said second set of computer instructions further comprises a fourth set of computer instructions for generating a two-dimensional profile of the plant by compiling the data generated by said first set of computer instructions at a plurality of longitudinal points along the row axis; and

a fifth set of computer instructions for adding the generated two-dimensional profile of the plant to the plant characteristic data set.

34. A computer program product according to claim 32, further comprising:

a sixth set of computer instructions for generating a binary image based on the plant characteristic data set;

a seventh set of computer instructions displaying the binary image to a user via said user interface; and

an eighth set of computer instructions for adding the binary image to the plant characteristic data set.

35. A computer program product according to claim 32, wherein said sensor assembly further comprises a distance sensor, the computer program product further comprising:

a ninth set of computer instructions for locating a position of the portion of the plant relative to said sensor assembly using said distance sensor; and

a tenth set of computer instructions for adding the located position of the portion of the plant to the plant characteristic data set.

36. A computer program product according to claim 32, wherein said sensor assembly further comprises a multi-spectral device, the computer program product further comprising:

an eleventh set of computer instructions for capturing a multi-spectral image of the plants from a position above the plant so as to differentiate the plant from a plurality of surrounding materials; and

a twelfth set of computer instructions for adding the multi-spectral image to the plant characteristic data set.

37. A computer program product according to claim 32, wherein said sensor assembly further comprises a locator device in communication with said computer device;

the method further comprising;

a thirteenth set of computer instructions for transmitting a location data set from said locator device to said computer device to determine a location of the plant; and

a fourteenth set of computer instructions for adding the location data set to the plant characteristic data set.

38. A computer program product according to claim 33, wherein said sensor assembly is carried by a movable assembly having at least one axle and wherein said sensor assembly further comprises a shaft encoder operably engaged with said axle and in communication with said computer device, the computer program product further comprising:

a fifteenth set of computer instructions for transmitting a location data set from said shaft encoder to said computer device to determine a distance along the row of plants; and

a sixteenth set of computer instructions for adding the location data set to the plant characteristic data set.

39. A computer program product according to claim 32, wherein said sensor assembly further comprises a global positioning system device, the computer program product further comprising:

a seventeenth set of computer instructions for determining a position of the plant using a global positioning system; and

an eighteenth set of computer instructions for adding the determined position of the plant to the plant characteristic data set.

40. A computer program product according to claim 32, wherein said computer device further comprises a memory device, the computer program product further comprising a nineteenth set of computer instructions for storing the plant characteristic data set of a known plant of interest in the memory device.

41. A computer program product according to claim 40, further comprising a twentieth set of computer instructions for identifying the plant by comparing the generated plant characteristic data set with the stored plant characteristic data set of the known plant of interest.

42. A computer program product according to claim 32, further comprising:

a twenty-first set of computer instructions for counting of a number of a plurality of plants for which a corresponding plurality of plant characteristic data sets are generated; and

a twenty-second set of computer instructions for storing the counted number of the plurality of plants.

43. A computer program product according to claim 42, further comprising a twenty-third set of computer instructions for determining the number of the plurality of plants located in at least one physical unit based at least in part on the corresponding plurality of plant characteristic data sets.

44. A computer program product according to claim 43, wherein the at least one physical unit is selected from the group consisting of:

a row;

an agricultural plot; and

combinations thereof.