Engineering Papers⌕ Search

Engineering topics

Chowdhary, Girish

Publications and source records attributed to Chowdhary, Girish.

Herbicide‐resistant weed management with robots: A weed ecological–economic model

The heavy reliance on herbicides for weed control has led to an increase in resistant weeds in the United States. Robotic weed control is emerging as an alternative technology for removing weeds mechanically using artificial intelligence. We develop an integrated weed ecological and economic dynamic (I‐WEED) model to examine the biophysical and economic drivers of adopting robotic weed management and simulate the optimal timing and intensity of robotic adoption within and across growing seasons. We specify a cohort‐based weed growth model that relates yield damages to effective weed density and treats the susceptibility of weeds to herbicides as a renewable resource that can be regenerated by using mechanical weeding robots, due to a fitness cost that makes resistant weeds less prolific. Compared to myopic weed management which ignores resistance development, forward‐looking management leads to earlier adoption of robots and treating robots as complements instead of substitutes to herbicides. This weed management results in adopting fewer robots, deploying robots on a smaller portion of the land, higher profitability, and lower yield loss in the long run, relative to myopic management. Counterintuitively, myopic management leads to a lower resistance level through its higher robot adoption intensity. We also find that a lower level of initial weed seed resistance and/or a higher fitness cost result in a higher level of resistance because they create incentives for farmers to delay the adoption of robotic weed control. Our analysis shows the importance of jointly considering the interactions between weed ecology and economics in analyzing the incentives and effects of robotic weed management on weed resistance.

agricultural robotics↗

Apparatus and method for agricultural data collection and agricultural operations

Aspects of the subject disclosure may include, for example, obtaining video data from a single monocular camera, wherein the video data comprises a plurality of frames, wherein the camera is attached to a mobile robot that is travelling along a lane defined by a row of crops, wherein the row of crops comprises a first plant stem, and wherein the plurality of frames include a depiction of the first plant stem; obtaining robot velocity data from encoder(s), wherein the encoder(s) are attached to the robot; performing foreground extraction on each of the plurality of frames of the video data, wherein the foreground extraction results in a plurality of foreground images; and determining, based upon the plurality of foreground images and based upon the robot velocity data, an estimated width of the first plant stem. Additional embodiments are disclosed.

Chowdhary, Girish↗

High precision control and deep learning-based corn stand counting algorithms for agricultural robot

This paper presents high precision control and deep learning-based corn stand counting algorithms for a low-cost, ultra-compact 3D printed and autonomous field robot for agricultural operations. Currently, plant traits, such as emergence rate, biomass, vigor, and stand counting, are measured manually. This is highly labor-intensive and prone to errors. The robot, termed TerraSentia, is designed to automate the measurement of plant traits for efficient phenotyping as an alternative to manual measurements. In this paper, we formulate a Nonlinear Moving Horizon Estimator that identifies key terrain parameters using onboard robot sensors and a learning-based Nonlinear Model Predictive Control that ensures high precision path tracking in the presence of unknown wheel-terrain interaction. Moreover, we develop a machine vision algorithm designed to enable an ultra-compact ground robot to count corn stands by driving through the fields autonomously. The algorithm leverages a deep network to detect corn plants in images, and a visual tracking model to re-identify detected objects at different time steps. We collected data from 53 corn plots in various fields for corn plants around 14 days after emergence (stage V3 - V4). The robot predictions have agreed well with the ground truth with C robot =1.02×C human -0.86 and a correlation coefficient R=0.96. The mean relative error given by the algorithm is -3.78%, and the standard deviation is 6.76%. These results indicate a first and significant step towards autonomous robot-based real-time phenotyping using low-cost, ultra-compact ground robots for corn and potentially other crops.

97 MATHEMATICS AND COMPUTING↗

In-Field Whole-Plant Maize Architecture Characterized by Subcanopy Rovers and Latent Space Phenotyping

Core Ideas * Subcanopy rovers enabled 3D characterization of thousands of hybrid maize plots. * Machine learning produces heritable latent traits that describe plant architecture. * Rover-based phenotyping is far more efficient than manual phenotyping. * Latent phenotypes from rovers are ready for application to plant biology and breeding. Collecting useful, interpretable, and biologically relevant phenotypes in a resource-efficient manner is a bottleneck to plant breeding, genetic mapping, and genomic prediction. Autonomous and affordable subcanopy rovers are an efficient and scalable way to generate sensor-based datasets of in-field crop plants. Rovers equipped with lidar can produce three-dimensional reconstructions of entire hybrid maize (Zea mays L.) fields. In this study, we collected 2103 lidar scans of hybrid maize field plots and extracted phenotypic data from them by latent space phenotyping. We performed latent space phenotyping by two methods, principal component analysis and a convolutional autoencoder, to extract meaningful, quantitative latent space phenotypes (LSPs) describing whole-plant architecture and biomass distribution. The LSPs had heritabilities of up to 0.44, similar to some manually measured traits, indicating that they can be selected on or genetically mapped. Manually measured traits can be successfully predicted by using LSPs as explanatory variables in partial least squares regression, indicating that the LSPs contain biologically relevant information about plant architecture. These techniques can be used to assess crop architecture at a reduced cost and in an automated fashion for breeding, research, or extension purposes, as well as to create or inform crop growth models.

59 BASIC BIOLOGICAL SCIENCES↗

Under canopy light detection and ranging–based autonomous navigation

This study describes a light detection and ranging (LiDAR)–based autonomous navigation system for an ultralightweight ground robot in agricultural fields. The system is designed for reliable navigation under cluttered canopies using only a 2D Hokuyo UTM–30LX LiDAR sensor as the single source for perception. Its purpose is to ensure that the robot can navigate through rows of crops without damaging the plants in narrow row–based and high–leaf–cover semistructured crop plantations, such as corn ( Zea mays ) and sorghum ( Sorghum bicolor ). The key contribution of our work is a LiDAR–based navigation algorithm capable of rejecting outlying measurements in the point cloud due to plants in adjacent rows, low–hanging leaf cover or weeds. The algorithm addresses this challenge using a set of heuristics that are designed to filter out outlying measurements in a computationally efficient manner, and linear least squares are applied to estimate within–row distance using the filtered data. Moreover, a crucial step is the estimate validation, which is achieved through a heuristic that grades and validates the fitted row–lines based on current and previous information. The proposed LiDAR–based perception subsystem has been extensively tested in production/breeding corn and sorghum fields. In such variety of highly cluttered real field environments, the robot logged more than 6 km of autonomous run in straight rows. These results demonstrate highly promising advances to LiDAR–based navigation in realistic field environments for small under–canopy robots.

42 ENGINEERING↗

Crop Stem Width Estimation in Highly Cluttered Field Environment

We present two methods for estimation of crop stem width on small mobile robots. Stem width is an important phenotype needed by breeders and plant-biologists to measure plant growth, however, its manual measurement is cumbersome, in-accurate, and inefficient. The presented methods use a common image processing core that is designed to extract the foreground in the presence of significant leaf and stem clutter, view of other rows, and varying lighting, from a side-facing USB camera mounted on a small mobile robot. Using the extracted foreground, one approach uses estimates of robot velocity from wheel encoders and dense optical flow to estimate depth, while the other employs filtering of the LIDAR 2-D point cloud to estimate the depth. Both methods have been exhaustively validated against available hand-measurements on biomass sorghum (Sorghum bicolor) in real experimental fields. Experiments indicate that both methods are also applicable to other crops with cylindrical stems without significant modifications. The width estimation match on sorghum is 92.5% (using vision) and 98.2% (using vision and LIDAR) when compared against manual measurements by trained agronomists. Thus, our results clearly establish the feasibility of using small robots for stem-width estimation in realistic field settings. Furthermore, the techniques presented here can be utilized for automating other phenotypic measurements.

Choudhuri, Anwesa↗

Tracking Error Learning Control for Precise Mobile Robot Path Tracking in Outdoor Environment

This article presents a Tracking-Error Learning Control (TELC) algorithm for precise mobile robot path tracking in off-road terrain. In traditional tracking error-based control approaches, feedback and feedforward controllers are designed based on the nominal model which cannot capture the uncertainties, disturbances and changing working conditions so that they cannot ensure precise path tracking performance in the outdoor environment. In TELC algorithm, the feedforward control actions are updated by using the tracking error dynamics and the plant-model mismatch problem is thus discarded. Therefore, the feedforward controller gradually eliminates the feedback controller from the control of the system once the mobile robot has been ontrack. In addition to the proof of the stability, it is proven that the cost functions do not have local minima so that the coefficients in TELC algorithm guarantee that the global minimum is reached. The experimental results show that the TELC algorithm results in better path tracking performance than the traditional tracking error-based control method. The mobile robot controlled by TELC algorithm can track a target path precisely with less than 10 cm error in off-road terrain.

42 ENGINEERING↗

High-precision control of tracked field robots in the presence of unknown traction coefficients

Accurate steering through crop rows that avoids crop damage is one of the most important tasks for agricultural robots utilized in various field operations, such as monitoring, mechanical weeding, or spraying. In practice, varying soil conditions can result in off-track navigation due to unknown traction coefficients so that it can cause crop damage. To address this problem, this work presents the development, application, and experimental results of a real-time receding horizon estimation and control (RHEC) framework applied to a fully autonomous mobile robotic platform to increase its steering accuracy. Recent advances in cheap and fast microprocessors, as well as advances in solution methods for nonlinear optimization problems, have made nonlinear receding horizon control (RHC) and receding horizon estimation (RHE) methods suitable for field robots that require high-frequency (milliseconds) updates. A real-time RHEC framework is developed and applied to a fully autonomous mobile robotic platform designed by the authors for in-field phenotyping applications in sorghum fields. Nonlinear RHE is used to estimate constrained states and parameters, and nonlinear RHC is designed based on an adaptive system model that contains time-varying parameters. The capabilities of the real-time RHEC framework are verified experimentally, and the results show an accurate tracking performance on a bumpy and wet soil field. Finally, the mean values of the Euclidean error and required computation time of the RHEC framework are equal to 0.0423 m and 0.88 ms, respectively.

42 ENGINEERING↗

A self-learning disturbance observer for nonlinear systems in feedback-error learning scheme

Here this paper represents a novel online self-learning disturbance observer (SLDO) by benefiting from the combination of a type-2 neuro-fuzzy structure (T2NFS), feedback-error learning scheme and sliding mode control (SMC) theory. The SLDO is developed within a framework of feedback-error learning scheme in which a conventional estimation law and a T2NFS work in parallel. In this scheme, the latter learns uncertainties and becomes the leading estimator whereas the former provides the learning error to the T2NFS for learning system dynamics. A learning algorithm established on SMC theory is derived for an interval type-2 fuzzy logic system. In addition to the stability of the learning algorithm, the stability of the SLDO and the stability of the overall system are proven in the presence of time-varying disturbances. Thanks to learning process by the T2NFS, the simulation results show that the SLDO is able to estimate time-varying disturbances precisely as distinct from the basic nonlinear disturbance observer (BNDO) so that the controller based on the SLDO ensures robust control performance for systems with time-varying uncertainties, and maintains nominal performance in the absence of uncertainties.

42 ENGINEERING↗