User interface performance graph for operation of a mobile machine

• US 10,426,087 B2
• Filed: 04/11/2014
• Issued: 10/01/2019
• Est. Priority Date: 04/11/2014
• Status: Active Grant

• Current Assignee: Deere & Company
• Original Assignee: Deere & Company
• Inventors: Bruns, Aaron J., Hunt, Timothy S., Gilmore, Brian J.
• Primary Examiner(s): Aguilera, Todd
• Application Number:
  US14/251,161
• Publication Number:
  US 20150293507A1
• Time in Patent Office: 1,999 Days
• Field of Search: 700 83, 701 50
• CPC Class Codes: A01D 41/127 Control or measuring arrangements specially adapted for combines
• CPC Class Codes: B60W 2300/158 Harvesters
• CPC Class Codes: G07C 5/0825 using optical means

Abstract

A machine control system receives sensor signals indicative of sensed variables on a mobile machine and calculates performance metric values for the mobile machine based upon the sensed variables. The machine control system displays information indicative of the performance metric value for the mobile machine on a time continuous user interface display.

Claims

1. A computer-implemented method, comprising:

detecting a first set of sensor signals output by at least one of a grain loss sensor and a yield sensor implemented with an agricultural machine;

generating productivity performance metric values, based on the first set of sensor signals;

detecting a second set of sensor signals output by an image processing system implemented with the agricultural machine;

generating quality performance metric values, based on the second set of sensor signals;

displaying, on a user interface display, a time continuous display including;

a productivity strip chart that visually identifies the productivity performance metric values along a timeline of operation of the agricultural machine, and

a set of quality strip charts, each quality strip chart visually identifying one of the quality performance metric values along the timeline of operation;

defining a productivity performance window including a range of productivity threshold values, based on the productivity performance metric values;

defining a quality performance window including a range of quality threshold values, based on the quality performance metric values;

displaying, on the user interface display, the productivity performance window along the productivity strip chart and the quality performance window along the set of quality strip charts of the time continuous display;

automatically generating a control signal that controls operation of the agricultural machine, with a corresponding adjustment that is automatically applied to one or more settings of a controlled system to maintain a desired level of operating performance, based on a determination that at least one of the productivity performance metric values deviates outside of the range of productivity threshold values or a determination that at least one of the quality performance metric values deviates outside of the range of quality threshold values;

displaying, on the user interface display, an indication of where, along the time continuous display, the control signal is automatically generated along the timeline of operation of the agricultural machine;

based on receiving a drill input, selecting one of the quality performance metric values and displaying a more detailed display indicative of more detailed information corresponding to the selected quality performance metric value derived from the second set of sensor signals, and wherein displaying a more detailed display comprises;

displaying, along the timeline and with one or more of the quality strip charts, a time continuous display for each of a plurality of additional metric values derived from the second set of sensor signals and associated with the selected quality performance metric value.

2. The method of claim 1 wherein defining the productivity performance window and the quality performance window comprises:

receiving an indication of a user calibration input; and

generating the range of productivity threshold values as a range around the productivity performance metric values when the user calibration input is received and generating the range of quality threshold values as a range around the quality performance metric values, when the user calibration input is received along the timeline of operation of the agricultural machine.

3. The method of claim 1 and further comprising:

displaying, on the user interface display, an action identifier identifying an action taken in response to the control signal, wherein the action identifier is indicative of a characteristic of the action taken and is indicative of a time, along the timeline, that the action was taken.

4. The method of claim 1 wherein automatically generating the control signal comprises:

generating an adjustment to a machine setting, based on a comparison of the productivity performance metric values to the range of productivity performance threshold values and a comparison of the quality performance metric values to the range of quality threshold values;

displaying an indication of the adjustment on the user interface display;

determining whether an operator override input is received; and

if no operator override input is received, automatically generating the control signal to make the adjustment to the machine setting.

5. The method of claim 1 wherein displaying a more detailed display comprises:

displaying a video image corresponding to the second set of sensor signals sensed by the image processing system.

6. The method of claim 1 and further comprising at least one of:

panning the time continuous display horizontally along the timeline in response to the pan input;

or

scrolling the time continuous display vertically to show a third strip chart with the time continuous display, the third strip chart indicating additional metric values, in response to the scroll input.

7. The method of claim 1 and further comprising:

receiving a zoom input; and

changing a time scale of the timeline, of operation of the agricultural machine, displayed in the time continuous display.

8. A computing system on an agricultural machine, comprising:

a sensor system comprising;

at least one of a loss sensor and a yield sensor that detects a first set of sensor signals based on sensed operation of the agricultural machine, and

a quality sensor that detects a second set of sensor signals based on sensed operation of the agricultural machine;

a control system comprising a processor that generates productivity performance metric values, based on the first set of sensor signals, and generates quality performance metric values, based on the second set of sensor signals;

wherein the control system;

generates a time continuous display comprising;

a productivity strip chart that visually identifies the productivity performance metric values, as the first set of sensor signals are sensed, along a timeline of operation of the agricultural machine, and

a set of quality strip charts, each quality strip chart visually identifying one of the quality performance metric values, as the second set of sensor signals are sensed, along the timeline of operation of the agricultural machine;

selects one of the quality performance metric values based on a detected drill user input,

displays a more detailed display indicative of more detailed information corresponding to the selected quality performance metric value derived from the second set of sensor signals,

the more detailed display displaying, along the timeline and with one or more of the quality strip charts, a time continuous display for each of the plurality of additional metric values derived from the second set of sensor signal values and associated with the selected quality performance metric value;

generates productivity threshold values and quality threshold values,

detects deviation of at least one of;

the productivity performance metric values outside of the productivity threshold values, and

the quality performance metric values outside of the quality threshold values, and

automatically generates a control signal that controls operation of the agricultural machine with a corresponding adjustment that is automatically applied to one or more settings of a controlled system to meet a particular level of operating performance of the agricultural machine; and

displays an indication on the time continuous display, along the timeline of operation, that indicates;

when the control signal is automatically generated to control operation of the agricultural machine with a corresponding automatic adjustment that is applied to one or more settings of a controlled system of the agricultural machine, and

a type of the corresponding automatic adjustment.

9. The computing system of claim 8 wherein the control system receives a user interaction input indicative of a user interacting with the time continuous display and modifies the time continuous display based on the user interaction input.

10. The computing system of claim 9 wherein the control system modifies the time continuous display to show a more detailed display including detailed information corresponding to the time continuous display based on the user interaction input.