Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “aerial inspection”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

National Campaign Development Test Executive Summary

NASA’s vision for Advanced Air Mobility (AAM) is to provide safe, sustainable, accessible, and affordable aviation for transformational local and intraregional missions and includes the transportation of passengers and cargo as well as aerial work missions, such as infrastructure inspection or search and rescue operations. NASA’s technical expertise, intergovernmental relationships, and high level of public trust will help this technology come to market concurrent with infrastructure readiness, public acceptance, and constructive regulation. By advising and integrating disparate AAM efforts across the country and working collaboratively with the FAA, the National Campaign (NC) objective is to motivate industry progress and support the development of policy, regulatory, and technical standards in a manner that best ensures public safety and benefit to the American people. NC began with the Dry Run and Developmental Test (NC-DT), which served as a pathfinder for collaboration and direct involvement with industry partners in integrated simulation exercises and flight tests. NC-DT culminated with an acoustics-gathering flight test in September 2021 with industry partner Joby’s prototype S4 2.0 air vehicle, which delivered the first foundational baseline of noise levels present in Electric Vertical Takeoff and Landing (eVTOL) vehicles. Through the DT phase, the NC team built and tested the airspace and range infrastructure while assessing the readiness level of industry partners leading up to future NC events. The purpose of this paper is to provide an overview of NC-DT.

National Campaign↗

Achromatical Optical Correlator

Signal-to-noise ratio exceeds that of monochromatic correlator. Achromatical optical correlator uses multiple-pinhole diffraction of dispersed white light to form superposed multiple correlations of input and reference images in output plane. Set of matched spatial filters made by multiple-exposure holographic process, each exposure using suitably-scaled input image and suitable angle of reference beam. Recording-aperture mask translated to appropriate horizontal position for each exposure. Noncoherent illumination suitable for applications involving recognition of color and determination of scale. When fully developed achromatical correlators will be useful for recognition of patterns; for example, in industrial inspection and search for selected features in aerial photographs.

Chao, Tien-Hsin↗

Multi-Resolution UAV Path Replanning for Inspection of Tailings Dams

Autonomous inspection of large and complex structures with a commercial unmanned aerial vehicle (UAV) is a challenging problem that has been addressed in recent years. In this paper, we address the global motion planning problem of creating autonomous inspection missions for UAVs considering photogrammetry constraints. We focus on the inspection of large tailings dams, which are dam structures used to store waste byproducts of mining. Our method uses a prior sparse point cloud of the dam to generate a voxel grid, where paths satisfying photogrammetry constraints are tested for collisions. We then apply the A* algorithm as a local planner to avoid obstacles within the global mission. Moreover, we address the problem of changing routes online by using octree-based multi-resolution grids for efficient and fast pathfinding. Our results, obtained using tridimensional maps of an actual coal mine tailings dam, show that using octrees for multi-resolution motion planning is faster than using a fixed voxel grid in online missions while inspecting large structures.

42 ENGINEERING↗

Heliostat optical error inspection with polarimetric imaging drone

On a Concentrated Solar Power (CSP) field, optical errors have significant impacts on the collection efficiency of heliostats. Fast, cost-effective, labor-efficient, and non-intrusive autonomous field inspection remains a challenge. Approaches using imaging drone, i.e., Unmanned Aerial Vehicle (UAV) system integrated with high resolution visible imaging sensors, have been developed to address these challenges; however, these approaches are often limited by insufficient imaging contrast. Here, in this study, we report a polarimetry-based method with a polarization imaging system integrated on UAV to enhance imaging contrast for in-situ detection of heliostat mirrors without interrupting field operation. We developed an optical model for skylight polarization pattern to simulate the polarization images of heliostat mirrors and obtained optimized waypoints for polarimetric imaging drone flight path to capture images with enhanced contrast. The polarimetric imaging-based method improved the success rate of edge detections in scenarios which were challenging for mirror edge detection with conventional imaging sensors. We have performed field tests to achieve significantly enhanced heliostat edge detection success rate and investigate the feasibility of integrating polarimetric imaging method with existing imaging-based heliostat inspection methods, i.e., Polarimetric Imaging Heliostat Inspection Method (PIHIM). Our preliminary field test results suggest that the PIHIM hold the promise to enable sufficient imaging contrast for real-time autonomous imaging and detection of heliostat field, thus suitable for non-interruptive fast CSP field inspection during its operation.

CSP Field↗

Cost‐benefit assessment framework for robotics‐driven inspection of floating offshore wind farms

Abstract Operations and maintenance (O&M) of floating offshore wind farms (FOWFs) poses various challenges in terms of greater distances from the shore, harsher weather conditions, and restricted mobility options. Robotic systems have the potential to automate some parts of the O&M leading to continuous feature‐rich data acquisition, operational efficiency, along with health and safety improvements. There remains a gap in assessing the techno‐economic feasibility of robotics in the FOWF sector. This paper investigates the costs and benefits of incorporating robotics into the O&M of a FOWF. A bottom‐up cost model is used to estimate the costs for a proposed multi‐robot platform (MRP). The MRP houses unmanned aerial vehicle (UAV) and remotely operated vehicle (ROV) to conduct the inspection of specific FOWF components. Emphasis is laid on the most conducive O&M activities for robotization and the associated technical and cost aspects. The simulation is conducted in Windfarm Operations and Maintenance cost‐Benefit Analysis Tool (WOMBAT), where the metrics of incurred operational expenditure (OPEX) and the inspection time are calculated and compared with those of a baseline case consisting of crew transfer vessels, rope‐access technicians, and divers. Results show that the MRP can reduce the inspection time incurred, but this reduction has dependency on the efficacy of the robotic system and the associated parameterization e.g., cost elements and the inspection rates. Conversely, the increased MRP day rate results in a higher annualized OPEX. Residual risk is calculated to assess the net benefit of incorporating the MRP. Furthermore, sensitivity analysis is conducted to find the key parameters influencing the OPEX and the inspection time variation. A key output of this work is a robust and realistic framework which can be used for the cost‐benefit assessment of future MRP systems for specific FOWF activities.

17 WIND ENERGY↗

UAV Inspection of Electrical Transmission Infrastructure with Path Conformance Autonomy and Lidar-Based Geofences NASA Report on UTM Reference Mission Flights at Southern Company Flights November 2016

Flights at low altitudes in close proximity to electrical transmission infrastructure present serious navigational challenges: GPS and radio communication quality is variable and yet tight position control is needed to measure defects while avoiding collisions with ground structures. To advance unmanned aerial vehicle (UAV) navigation technology while accomplishing a task with economic and societal benefit, a high voltage electrical infrastructure inspection reference mission was designed. An integrated air-ground platform was developed for this mission and tested in two days of experimental flights to determine whether navigational augmentation was needed to successfully conduct a controlled inspection experiment. The airborne component of the platform was a multirotor UAV built from commercial off-the-shelf hardware and software, and the ground component was a commercial laptop running open source software. A compact ultraviolet sensor mounted on the UAV can locate 'hot spots' (potential failure points in the electric grid), so long as the UAV flight path adequately samples the airspace near the power grid structures. To improve navigation, the platform was supplemented with two navigation technologies: lidar-to-polyhedron preflight processing for obstacle demarcation and inspection distance planning, and trajectory management software to enforce inspection standoff distance. Both navigation technologies were essential to obtaining useful results from the hot spot sensor in this obstacle-rich, low-altitude airspace. Because the electrical grid extends into crowded airspaces, the UAV position was tracked with NASA unmanned aerial system traffic management (UTM) technology. The following results were obtained: (1) Inspection of high-voltage electrical transmission infrastructure to locate 'hot spots' of ultraviolet emission requires navigation methods that are not broadly available and are not needed at higher altitude flights above ground structures. (2) The sensing capability of a novel airborne UV detector was verified with a standard ground-based instrument. Flights with this sensor showed that UAV measurement operations and recording methods are viable. With improved sensor range, UAVs equipped with compact UV sensors could serve as the detection elements in a self-diagnosing power grid. (3) Simplification of rich lidar maps to polyhedral obstacle maps reduces data volume by orders of magnitude, so that computation with the resultant maps in real time is possible. This enables real-time obstacle avoidance autonomy. Stable navigation may be feasible in the GPS-deprived environment near transmission lines by a UAV that senses ground structures and compares them to these simplified maps. (4) A new, formally verified path conformance software system that runs onboard a UAV was demonstrated in flight for the first time. It successfully maneuvered the aircraft after a sudden lateral perturbation that models a gust of wind, and processed lidar-derived polyhedral obstacle maps in real time. (5) Tracking of the UAV in the national airspace using the NASA UTM technology was a key safety component of this reference mission, since the flights were conducted beneath the landing approach to a heavily used runway. Comparison to autopilot tracking showed that UTM tracking accurately records the UAV position throughout the flight path.

Moore, Andrew J.↗

Second International Airborne Remote Sensing Conference and Exhibition

The conference provided four days of displays and scientific presentations on applications, technology, a science of sub-orbital data gathering and analysis. The twelve displayed aircraft equipped with sophisticated instrumentation represented a wide range of environmental and reconnaissance missions,including marine pollution control, fire detection, Open Skies Treaty verification, thermal mapping, hydrographical measurements, military research, ecological and agricultural observations, geophysical research, atmospheric and meterological observations, and aerial photography. The U.S. Air Force and the On-Site Inspection Agency displayed the new Open Skies Treaty verification Boeing OC 135B that promotes international monitoring of military forces and activities. SRl's Jetstream uses foliage and ground penetrating SAR for forest inventories, toxic waste delineation, and concealed target and buried unexploded ordnance detection. Earth Search Sciences's Gulfstream 1 with prototype miniaturized airborne hyperspectral imaging equipment specializes in accurate mineral differentiation, low-cost hydrocarbon exploration, and nonproliferation applications. John E. Chance and the U.S. Army Corps of Engineers displayed the Bell 2 helicopter with SHOALS that performs hydrographic surveying of navigation projects, coastal environment assessment, and nautical charting surveys. Bechtel Nevada and U.S. DOE displayed both the Beech King AIR B-200 platform equipped to provide first response to nuclear accidents and routine environmental surveillance, and the MBB BO-105 helicopter used in spectral analysis for environmental assessment and military appraisal. NASA Ames Research Center's high-altitude Lockheed ER-2 assists in earth resources monitoring research in atmospheric chemistry, oceanography, and electronic sensors; ozone and greenhouse studies and satellite calibration and data validation. Ames also showcased the Learjet 24 Airborne Observatory that completed missions in Venus cloud cover analysis, Quadantid meteor shower studies, extra-solar far infrared ionic structure lines measurement, Cape Kennedy launch support, and studies in air pollution, The Products and Services Exhibit showcased new sensor and image processing technologies, aircraft data collection services, unmanned vehicle technology, platform equipment, turn-key services, software a workstations, GPS services, publications, and processing and integration systems by 58 exhibitors. The participation of aircraft users and crews provided unique dialogue between those who plan data collection a operate the remote sensing technology, and those who supply the data processing and integration equipment. Research results using hyperspectral imagery, radar and optical sensors, lidar, digital aerial photography, a integrated systems were presented. Major research and development programs and campaigns we reviewed, including CNR's LARA Project and European Space Agency's 1991-1995 Airborne Campaign. The pre-conference short courses addressed airborne video, photogrammetry, hyperspectral data analysis, digital orthophotography, imagery and GIS integration, IFSAR, GPS, and spectrometer calibration.

Source record↗

The Use of a Geographic Information System and Remote Sensing Technology for Monitoring Land Use and Soil Carbon Change in the Subtropical Dry Forest Life Zone of Puerto Rico

Aerial photography, one of the first form of remote sensing technology, has long been an invaluable means to monitor activities and conditions at the Earth's surface. Geographic Information Systems or GIS is the use of computers in showing and manipulating spatial data. This report will present the use of geographic information systems and remote sensing technology for monitoring land use and soil carbon change in the subtropical dry forest life zone of Puerto Rico. This research included the south of Puerto Rico that belongs to the subtropical dry forest life zone. The Guanica Commonwealth Forest Biosphere Reserve and the Jobos Bay National Estuarine Research Reserve are studied in detail, because of their location in the subtropical dry forest life zone. Aerial photography, digital multispectral imagery, soil samples, soil survey maps, field inspections, and differential global positioning system (DGPS) observations were used.

Velez-Rodriguez, Linda L.↗

FPV Video Adaptation for UAV Collision Avoidance

First person view (FPV) technology for unmanned aerial vehicles (UAVs) provides an immersive experience for pilots and enables various personal and commercial applications such as aerial photography, drone racing, search and rescue operations, agricultural surveillance, and structural inspection. While real time video streaming from a UAV and vision-based collision avoidance strategies have been studied in literature as separate topics, in this paper we tackle collision avoidance in FPV scenarios, taking into account network delays and real time video parameters. We present a theoretical model for obstacle collisions that considers the current communication channel conditions, the real time video parameters, and the UAV's position relative to the closest obstacle. A video adaptation algorithm is then designed, using this metric, to tune the FPV video resolution, number of re-transmission attempts, and the modulation scheme to maximize the probability of avoiding collisions. This algorithm also takes into account specific latency constraints of the application. This video algorithm was evaluated in various scenarios and its ability to respond to both distances to the obstacle as well as the communication channel conditions was demonstrated. It was found that, for the considered scenarios, the performance of the proposed adaptive algorithm was, on an average, 58.63% higher than the closest non-adaptive one in terms of maximizing the probability of avoiding collision. Such collision avoidance strategies could be used to make UAV FPV applications safer and more reliable.

47 OTHER INSTRUMENTATION↗

Robotics Plan in Support of DOME Testbed Operations

Various robotic tooling options have been evaluated for the NRIC DOME concept of operations (ConOps). Framatome was contracted to develop a wide-ranging list of commercial off the shelf (COTS) and custom robotic systems to be considered for performing the DOME ConOps functions. Subsequent project tasks from Framatome narrowed down the list and scored the most viable options. The abbreviated list, and associated scoring, has been reviewed and assessed to provide formal recommendations for the robotic ConOps functions of DOME. The overhead telescoping mast & Kraft arm assembly is recommended as the primary system for reactor demobilization and removal. The estimated cost is $\$700$K with a timeline to develop and deliver of about 2.5 years. The mast & Kraft arm would still require an overhead lift system for mobilization and installation. Either the refurbished polar crane or a new gantry crane delivery platform could both serve as the overhead lift and delivery system. The estimated costs for the refurbishment polar crane and new gantry crane systems are, respectively, $\$4.4$M and $\$3$M with about 2.5 years to develop and deliver. A Brokk + Kraft crawler & arm is recommended as a secondary robotic system to support the overhead mast & Kraft arm system. The Brokk + Kraft crawler & arm would cost an estimated $\$726$k and would take about 1.5 years to develop and deliver. The Boston Dynamics SPOT robot is also recommended for the in-service monitoring during experimentation operations. The estimated cost is $\$220$K with a timeline to deliver of 8-14 months. The Elios 3 aerial drone is recommended to perform large area radiation dose rate mapping and visual inspections. The estimated cost is a $\$100$K and will also need about 8-14 months to develop and deliver. A mockup rig is also recommended to be procured an employed to test & verify the robotic capabilities as well as provide needed training for operations personnel. It is estimated that a mockup rig would cost about $\$500$k and would take up to a year to develop and build.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Proposal for a study of computer mapping of terrain using multispectral data from ERTS-A for the Yellowstone National Park test site

The author has identified the following significant results. A terrain map of Yellowstone National Park showed plant community types and other classes of ground cover in what is basically a wild land. The map comprised 12 classes, six of which were mapped with accuracies of 70 to 95%. The remaining six classes had spectral reflectances that overlapped appreciably, and hence, those were mapped less accurately. Techniques were devised for quantitatively comparing the recognition map of the park with control data acquired from ground inspection and from analysis of sidelooking radar images, a thermal IR mosaic, and IR aerial photos of several scales. Quantitative analyses were made in ten 40 sq km test areas. Comparison mechanics were performed by computer with the final results displayed on line printer output. Forested areas were mapped by computer using ERTS data for less than 1/4 the cost of the conventional forest mapping technique for topographic base maps.

Smedes, H. W.↗

Initial Developments Toward an Active Noise Control System for Small Unmanned Aerial Systems

Small unmanned aerial systems have the potential to expand commercial markets from package delivery to infrastructure inspection. Many missions, however, require the vehicles to operate in close proximity to people, where community noise concerns could ultimately limit vehicle acceptability. Therefore, noise control technologies may be needed to achieve an acceptable noise signature and enable widespread use of these vehicles. The purpose of this paper is to assess the feasibility of using loudspeakers attached to the vehicle to actively reduce noise. More specifically, this initial study explores the possibility of using a single loudspeaker to reduce the noise from an isolated rotor. Tests performed in an anechoic chamber with a 7.6 cm diameter speaker and 23.9 cm diameter rotor are used to demonstrate the potential benefits and limitations of the concept. Results confirm that active noise control can work in this application with measured tonal reductions of over 30 dB in specific directions. However, since the radiation characteristics of the speaker are different than the rotor, amplification is observed in other directions. This technology has the potential to create a “cone of silence”, which could be steered during flight operations to minimize the impact on noise sensitive areas.

Schiller, Noah H.↗

Autonomous Spacecraft Inspection with Free-Flying Drones

This paper describes a proof-of-concept mission demonstrating a multi-agent system performing visual inspection of damage sustained by a spacecraft. Free-flying satellites, simulated by unmanned aerial vehicles (UAVs), autonomously fly around a mock space module maximizing the search space for damage detection. The free-flyers are responsible for independently coordinating their flights to avoid collision with the space module and each other, while executing mission tasks. Damage analysis on the surface of the mock space module is performed in real-time using video from each free-flyer. Three-dimensional modeling is deployed offline to supplement and improve damage detection. This approach demonstrates the feasibility of deploying real space systems for damage detection, where 2D analysis can quickly determine region of interest and 3D visualization can produce a human-navigable virtual environment with depth perspective for further investigation.

unmanned aerial vehicle (UAV)↗

Fundamental Noise Characterization of a Ducted Propeller in Hover

Unmanned aerial vehicles (UAVs) are currently being used for reconnaissance missions, tactical surveillance, and infrastructure inspection. When legislation allows it, these devices will provide additional services close to inhabited areas, which could lead to noise complaints. On most UAVs, the propellers are the dominant source of noise. As a result, researchers have studied the impact of propeller shape and blade count on noise. Much of this work, however, has focused on isolated propellers. While different UAV concepts are equipped with ducts for aerodynamic and protection reasons, few studies focus on the acoustic benefit of ducts, as is achieved, for example, on turbofan aircraft. The objectives of this paper are: first, to simulate the noise radiation of a UAV propeller in static conditions based on its location in a hard wall duct; second, to analyze the contribution of the different acoustic source components (i.e., thrust, torque, and thickness); and third, to validate the approach with experiments conducted in the NASA Small Hover Anechoic Chamber over a range of propeller rotation rates. For the propeller and duct geometries considered in this experiment, it is shown that the best attenuation is achieved when the propeller is centered axially in the duct because of interference between upstream and downstream radiated waves.

ducted propeller↗

Utilization of Unmanned Aircraft Systems for Environmental Purposes at the Savannah River Site – 26578

Born in the 1950s, the Savannah River Plant was constructed as a plutonium and tritium production plant. As the Cold War era came and went, a change of direction was signaled when the name of the facility changed from Savannah River Plant to Savannah River Site (1989) – the main mission at Savannah River shifted from “production” to “cleanup.” The Department of Energy is responsible for managing the 310 square miles of land that is the Savannah River Site and the cleanup/remediation activities that occur. The Savannah River National Laboratory utilizes unmanned aircraft systems to assist with some of those environmental monitoring and remediation activities. One function of unmanned aircraft systems at the Savannah River National Laboratory is conducting aerial photography and videography. Various infrastructure evaluations have been performed with unmanned aircraft – facility rooftop inspections, water tower lock verifications, earthen dam surveys, etc. An unmanned aircraft system has been used for progress footage of remediation projects – Dunbarton Bay remediation, Saltstone Disposal Unit construction, etc. Thermal cameras on an unmanned aircraft system are used to help identify cracks/leaks in structures from vantage points not readily accessible by personnel. Virtual tours of different waste units are conducted with unmanned aircraft systems for Site groups and federal/state regulators to save costs and travel time. Additionally, advanced remote sensing technologies are used on unmanned aircraft systems at the Savannah River Site. Light Detection and Ranging uses laser pulses to measure distances to the Earth's surface or other targets to create highly detailed topographic maps that accurately portray terrain (e.g., elevation changes, slopes, and contours). Data collection with a Light Detection and Ranging unit mounted on an unmanned aircraft system is quick and efficient – large-area surveys are conducted in shorter time frames. Because Light Detection and Ranging can penetrate through foliage and vegetation to ground level, it is being used in conjunction with a watershed model to study the General Separations Area of the Site to determine stormwater flow volume and direction, monitor stream stability, and forecast river flow behavior. A hyperspectral camera captures a wide spectrum of electromagnetic wavelengths across numerous narrow bands, beyond what the human eye can see. It provides detailed spectral information about the objects or surfaces in an image, which can be used to identify and analyze materials based on their spectral signatures. A hyperspectral camera mounted on an unmanned aircraft system has been used at the Savannah River Site for non-destructive evaluation of concrete and concrete structures. Unmanned aircraft systems at the Savannah River Site are also used for the application of herbicide on identified rooftops. P-Reactor and R-Reactor are entombed nuclear reactors at the Savannah River Site. Unwanted vegetation is often present on these rooftops – over time roots can penetrate seams, cracks, and joints of the general roof and concrete caps, leading to water ingress and deterioration of the structural components. For time and cost efficiencies as well as in the interest of personnel safety, an unmanned aircraft is used to dispense herbicide on rooftop areas where vegetation is noticed to help alleviate the issues/hazards.

Lorier, Troy [Savannah River National Laboratory (↗

Aerial Crosspolarized NQR-NMR: Buried Explosive Detection From a Safe Distance

Nuclear quadrupole resonance is a non-destructive detection and inspection technique with potential as a non-destructive test (NDT) tool. Establishment of the capability opens the door to its use in furthering the mission of the labs. There are many possible uses of the capability: explosive detection and stress/strain detection in epoxies are two of the more obvious and are the main results of this work. Enhancement of the signal-to-noise ratio (SNR) and improvements in the acquisition time of the experiment were key focuses of this work. These were achieved by combing special spin-lock pulse sequences with cross-polarization (CP) schemes to improve the signals with shorter acquisition times. A novel rotating magnetic field device was created to facilitate CP in the field. Implementation of these schemes provided a significant reduction in SNR/time.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Breaking the barrier of human-annotated training data for machine learning-aided plant research using aerial imagery

Machine learning (ML) can accelerate biological research. However, the adoption of such tools to facilitate phenotyping based on sensor data has been limited by (i) the need for a large amount of human-annotated training data for each context in which the tool is used and (ii) phenotypes varying across contexts defined in terms of genetics and environment. This is a major bottleneck because acquiring training data is generally costly and time-consuming. This study demonstrates how a ML approach can address these challenges by minimizing the amount of human supervision needed for tool building. A case study was performed to compare ML approaches that examine images collected by an uncrewed aerial vehicle to determine the presence/absence of panicles (i.e. “heading”) across thousands of field plots containing genetically diverse breeding populations of 2 Miscanthus species. Automated analysis of aerial imagery enabled the identification of heading approximately 9 times faster than in-field visual inspection by humans. Leveraging an Efficiently Supervised Generative Adversarial Network (ESGAN) learning strategy reduced the requirement for human-annotated data by 1 to 2 orders of magnitude compared to traditional, fully supervised learning approaches. The ESGAN model learned the salient features of the data set by using thousands of unlabeled images to inform the discriminative ability of a classifier so that it required minimal human-labeled training data. This method can accelerate the phenotyping of heading date as a measure of flowering time in Miscanthus across diverse contexts (e.g. in multistate trials) and opens avenues to promote the broad adoption of ML tools.

59 BASIC BIOLOGICAL SCIENCES↗

pixelvar79/ESGAN-Flowering-Detection-paper

Machine learning (ML) can accelerate biological research. However, the adoption of such tools to facilitate phenotyping based on sensor data has been limited by (i) the need for a large amount of human-annotated training data for each context in which the tool is used and (ii) phenotypes varying across contexts defined in terms of genetics and environment. This is a major bottleneck because acquiring training data is generally costly and time-consuming. This study demonstrates how a ML approach can address these challenges by minimizing the amount of human supervision needed for tool building. A case study was performed to compare ML approaches that examine images collected by an uncrewed aerial vehicle to determine the presence/absence of panicles (i.e. “heading”) across thousands of field plots containing genetically diverse breeding populations of 2 Miscanthus species. Automated analysis of aerial imagery enabled the identification of heading approximately 9 times faster than in-field visual inspection by humans. Leveraging an Efficiently Supervised Generative Adversarial Network (ESGAN) learning strategy reduced the requirement for human-annotated data by 1 to 2 orders of magnitude compared to traditional, fully supervised learning approaches. The ESGAN model learned the salient features of the data set by using thousands of unlabeled images to inform the discriminative ability of a classifier so that it required minimal human-labeled training data. This method can accelerate the phenotyping of heading date as a measure of flowering time in Miscanthus across diverse contexts (e.g. in multistate trials) and opens avenues to promote the broad adoption of ML tools.

Varela, Sebastian↗