Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “sensing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30

Metabolic multireactor: Practical considerations for using simple oxygen sensing optodes for high-throughput batch reactor metabolism experiments

We present a system for carrying out small batch reactor oxygen consumption experiments on water and sediment samples for environmental questions. In general, it provides several advantages that can help researchers achieve impactful experiments at relatively low costs and high data quality. In particular, it allows for multiple reactors to be operated and their oxygen concentrations to be measured simultaneously, providing high throughput and high time-resolution data, which can be advantageous. Most existing literature on similar small batch-reactor metabolic studies is limited to either only a few samples, or only a few time points per sample, which can restrict the ability for researchers to learn from their experiments. The oxygen sensing system is based very directly on the work of Larsen, et al. [2011], and similar oxygen sensing technology is widely used in the literature. As such we do not delve deeply into the specifics of the fluorescent dye sensing mechanism. Instead, we focus on practical considerations. We describe the construction and operation of the calibration and experimental systems, and answer many of the questions likely to come up when other researchers choose to build and operate a similar system themselves (questions we ourselves had when we first built the system). In this way, we hope to provide an approachable and easy to use research article that can help other researchers construct and operate a similar system that can be tailored to ask their own research questions, with a minimum of confusion and missteps along the way.

3D printing↗

Optode performance data associated with: Metabolic Multireactor: practical considerations for using simple oxygen sensing optodes for high-throughput batch reactor metabolism experiments

This data package is associated with the publication “Metabolic Multireactor: practical considerations for using simple oxygen sensing optodes for high-throughput batch reactor metabolism experiments”, submitted to PlosONE (Kaufman et al. 2023; 10.1101/2023.03.28.534656).We carried out many testing and calibration experiments on a system of small oxygen consumption batch reactors designed for use with water and sediment samples for environmental questions. The oxygen sensing system is based very directly on the work of Larsen, et al. [2011], and similar oxygen sensing technology is widely used in the literature. Our primary focus was on practical considerations, such as temperature effects, lighting angle effects, sterilization, and other similar situations that a user may find useful. Most of the tests required comparing “base” calibration curves to “treatment” calibration curves to determine the extent to which the treatment impacted the reported measurements. This data package contains the performance and calibration data collected for that purpose.This dataset is comprised of one data folder containing (1) file-level metadata; (2) data dictionary; (3) readme; (4) diffusion test result files; (5) limit of detection test result files; (6) temperature impact files; (7) a main data file that contains test results for all other tests; and (8) an R script that uses Kolmogorov-Smirnov tests to determine whether treatment calibrations are significantly different from their respective base calibrations. All files are .csv, .txt, .Rmd, or .pdf.

54 ENVIRONMENTAL SCIENCES↗

Classification and Localization of Fracture-Hit Events in Low-Frequency Distributed Acoustic Sensing Strain Rate with Convolutional Neural Networks

Summary Distributed acoustic sensing (DAS) has been used in the oil and gas industry as an advanced technology for surveillance and diagnostics. Operators use DAS to monitor hydraulic fracturing activities, examine well stimulation efficacy, and estimate complex fracture system geometries. Particularly, low-frequency DAS can detect geomechanical events such as fracture hits because hydraulic fractures propagate and create strain rate variations in the rock. Analysis of DAS data today is mostly done post-job and subject to interpretation methods. However, the continuous and dense data stream generated live by DAS poses the opportunity for more efficient and accurate real-time data-driven analysis. The objective of this study is to develop a machine learning-based workflow that can identify and locate fracture-hit events in simulated strain rate responses correlated with low-frequency DAS data. In this paper, “fracture hit” refers to a hydraulic fracture originating from a stimulated well intersecting an offset well. We start with building a single fracture propagation model to produce strain rate patterns observed at a hypothetical monitoring well. This model is used to generate two sets of strain rate responses with one set containing fracture-hit events. The labeled synthetic data are then used to train a custom convolutional neural network (CNN) model for identifying the presence of fracture-hit events. The same model is trained again for locating the event with the output layer of the model replaced with linear units. We achieved near-perfect predictions for both event classification and localization. These promising results prove the feasibility of using CNN for real-time event detection from fiber-optic sensing data. Additionally, we use edge detection techniques to recognize fracture-hit event patterns in strain rate images. The fracture-hit location can be identified using recognized pixels in the image. The accuracy of edge detection-based location identification is also plausible, but edge detection is dependent on the assumption of pattern shape and image quality, hence it is less robust compared to CNN models. This comparison further supports the need for CNN applications in image-based real-time fiber-optic sensing event detection.

Engineering↗

Interpretation of Fracture Initiation Points by In-Well Low-Frequency Distributed Acoustic Sensing in Horizontal Wells

Summary Low-frequency distributed acoustic sensing (LF-DAS) exploits the optical phase shift of Rayleigh backscatter in fiber-optic cables to obtain distributed measurements of changes in strain and temperature. Fiber-optic cables are often installed for multistage hydraulic fracture diagnostics in horizontal wells. LF-DAS in an untreated well provides far-field strain measurements, while offset wells are hydraulically fractured. Such a configuration is called crosswell LF-DAS sensing. Crosswell LF-DAS measurements have proved useful in diagnosing fracture hits, fracture azimuth, planarity, cluster efficiency, fracture propagation rates, and the dynamic distance to the fracture front. In contrast, in-well LF-DAS is conducted on the actively fractured well. Due to cool fracture fluid being injected at high injection rates, the strain component of the LF-DAS response is largely obscured by temperature changes. In permanent fiber-optic cable installations, distributed temperature sensing (DTS) is often conducted simultaneously with LF-DAS. An opportunity exists to decouple the temperature and strain components of LF-DAS sensors to observe strain changes on in-well LF-DAS. The LF-DAS response is modeled as linearly dependent on strain and temperature changes. Theoretical LF-DAS temperature and strain sensitivity coefficients are derived based on the changes to the index of refraction and length of the fiber. Using the DTS measurements, temperature changes are computed, smoothed, filtered, and compared to the LF-DAS response. Crossplots of the in-well LF-DAS measurements and temperature changes from DTS measurements far from the actively fractured region are used to validate the theoretical sensitivity coefficients. Uncertainty in the temperature component of the LF-DAS response is quantified. The difficulty in corresponding the different spatial and temporal resolutions of the DTS and LF-DAS measurements is overcome by comparing the responses over a moving temporal and spatial window. If the LF-DAS response at the center of the window agrees with the DTS response within uncertainty, the measurement is filtered out. After filtering, the remaining nonzero in-well LF-DAS measurements are due to changes in strain. The data are then visualized in waterfall plots. The results indicate that the theoretical and observed strain and temperature coefficients agree within 10%. After the temperature component of the in-well LF-DAS response is extracted, the remaining nonzero measurements are located primarily within the actively treated region. Locations with peaks in the strain response are interpreted to indicate fracture initiation points. These fracture initiation points are compared with in-well DTS and high-frequency DAS noise measurements across multiple stages to better understand fracture initiation along the horizontal well.

Engineering↗

First Annual Report on Development of Microwave Resonant Cavity Transducer for Fluid Flow Sensing: Development of Sensor Performance Model of Microwave Cavity Flow Meter for Advanced Reactor High Temperature Fluids

We are investigating a microwave cavity-based transducer for in-core high-temperature fluid flow sensing in molten salt cooled reactors (MSCR) and sodium fast reactors (SFR). This sensor is a hollow metallic cylindrical cavity, which can be fabricated from stainless steel, and as such is expected to be resilient to radiation, high temperature and corrosive environment of MSCR and SFR. The principle of sensing consists of making one wall of the cylindrical cavity flexible enough so that dynamic pressure, which is proportional to fluid velocity, will cause membrane deflection. Membrane deflection causes cavity volume change, which leads to a shift in the resonant frequency. Feasibility of the sensor was initially investigated with analytical derivations and with COMSOL RF Module computer simulations of resonant frequency spectral shift due to uniform load. We also investigated the mechanical integrity of the flowmeter’s membrane through analytical modelling and COMSOL Structural Mechanics Module computer simulations. Both the analytic model and COMSOL model showed that maximum stresses on the plate, which are at the radial boundary of the plate, are three orders of magnitude smaller than the material’s yield strength and ultimate tensile strength. This indicates that the sensor is at a low risk of mechanical failure. Using results from models, we have developed an initial design for a microwave K-band sensor. A cylindrical resonator prototype was fabricated from brass for the initial tests. The external dimensions of the cavity are matched to the flange of a standard WR-42 waveguide. Microwave field is coupled into the resonant cavity through a subwavelength-size aperture. A test article was developed consisting of a piping Tee with a bulkhead WR-42 microwave waveguide installed in a leak-proof assembly. A microwave waveguide circulator was installed in the setup to suppress the effect of reflections at the cavity entrance by increasing the isolation between the input and the output port. Preliminary spectral characterization of cavity spectral response was performed with a portable PXIe chassis microwave VNA with a custom GUI. Preliminary dry tests of the transducer response were conducted with a set of calibrated weights. Transducer frequency shift was shown to be monotonically increasing with increasing pressure. The next steps will involve investigation of the transducer performance for water flow sensing.

42 ENGINEERING↗

Demonstration of Microwave Resonant Cavity Transducer Performance in Fluid Flow Sensing: Development of Sensor Performance Model of Microwave Cavity Flow Meter for Advanced Reactor High Temperature Fluids

We are investigating a microwave cavity-based transducer for in-core high-temperature fluid flow sensing in molten salt cooled reactors (MSCR) and sodium fast reactors (SFR). This sensor is a hollow metallic cylindrical cavity. The principle of sensing consists of making one wall of the cylindrical cavity flexible enough so that dynamic pressure, which is proportional to fluid velocity, will cause membrane deflection. Membrane deflection causes cavity volume change, which leads to a shift in the resonant frequency. To validate sensor physics, we have performed proof-of-principle test of flow sensing in water. For this test, we have developed a cylindrical resonator for K-band, which was machined from brass. The cavity was excited through WR-42 waveguide through a subwavelength hole on the side of the wall of the cylinder. To increase the spectral signal visibility, we developed a signal processing method for baseline subtraction. A flow loop for proof-of-principle test of transducer performance in water was assembled. A commercial flow meter was installed in the loop for reference measurements. Cylindrical cavity was excited in the TEM 011 mode with resonant frequency f ≈ 17.8GHz. Frequency shift of cavity spectral response was obtained by gradually increasing water flow rate from 0 to 60gpm. Corresponding monotonic increase of resonant frequency shift by several MHz was observed.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

Development of self-sensing materials for extreme environments based on metamaterial concept and additive manufacturing

Structural health monitoring of an engineered component in a harsh environment is critical for multiple DOE missions including nuclear fuel cycle, subsurface energy production/storage, and energy conversion. Supported by a seeding Laboratory Directed Research & Development (LDRD) project, we have explored a new concept for structural health monitoring by introducing a self-sensing capability into structural components. The concept is based on two recent technological advances: metamaterials and additive manufacturing. A self-sensing capability can be engineered by embedding a metastructure, for example, a sheet of electromagnetic resonators, either metallic or dielectric, into a material component. This embedment can now be realized using 3-D printing. The precise geometry of the embedded metastructure determines how the material interacts with an incident electromagnetic wave. Any change in the structure of the material (e.g., straining, degradation, etc.) would inevitably perturbate the embedded metastructures or metasurface array and therefore alter the electromagnetic response of the material, thus resulting in a frequency shift of a reflection spectrum that can be detected passively and remotely. This new sensing approach eliminates complicated environmental shielding, in-situ power supply, and wire routing that are generally required by the existing active-circuit-based sensors. The work documented in this report has preliminarily demonstrated the feasibility of the proposed concept. The work has established the needed simulation tools and experimental capabilities for future studies.

36 MATERIALS SCIENCE↗

Demonstration of Microwave Cavity Transducer Performance in High Temperature Fluid Flow Sensing: Development of Microwave Cavity Flow Meter for Advanced Reactor High Temperature Fluids

We are investigating a microwave resonant cavity transducer for flow sensing in the vessel of a high temperature fluid advanced reactor (AR), such as a molten salt cooled reactor (MSCR) or a sodium fast reactor (SFR). This transducer is a hollow metallic cylindrical cavity, with one of the flat walls of the cylinder flexible enough to undergo microscopic deflection due to dynamic fluid pressure. Membrane deflection leads to a shift in the microwave resonant frequency, which can be detected with a spectrum analyzer. We have performed a preliminary proof-of-principle test of flow sensing in high temperature liquid sodium in environment, which is similar to that of an advanced reactor. The liquid sodium setup consists of a cylindrical vessel with a center feed line, where a transducer inserted through the top cap of the vessel measures velocity of the impinging liquid jet. For this test, we have developed a cylindrical resonator, which was machined from stainless steel 316 and electroplated with silver on the interior surfaces. Outer diameter of the cylindrical cavity is approximately 3cm, and the thin wall is approximately 200µm thick. We have also developed and insertion probe consisting of a 50cm WR-42 brass waveguide enclosed in a protective SS316 tube. The cavity was excited through a WR-42 waveguide through a subwavelength hole on the side of the wall of the cylinder in the TE 011 mode with resonant frequency f ≈ 17.8GHz. As a calibration experiment, we have assembled a water vessel with a center feed, and with dimensions similar to those of the liquid sodium setup. Frequency shift of the cavity spectral response was obtained at room temperature and ambient pressure by gradually increasing water flow rate from 0 to 25GPM (gallons per minute). Corresponding monotonic increase of resonant frequency by several hundred KHz was observed. Next, a sodium flow rate sensing study was performed in a liquid sodium vessel at 340° C temperature and ambient pressure. The flow rate was changed by varying sodium pump power, and a frequency shift of several hundred KHz was observed.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Quantum sensing for fundamental physics efforts at SQMS

One of the areas of research of the Superconducting Quantum Systems and Materials (SQMS) center is the application of quantum sensing to fundamental physics searches, demonstrating that quantum sensors can greatly improve the sensitivity of experiments searching for Beyond the Standard Model (BSM) physics, or performing high-precision measurements. Theorists have developed many ideas for BSM physics that would result in interactions that can in principle be detected, but with signals small enough that they haven t been observed yet. In this field, the capability to lower the detector s thermal noise to few or dozens of mK, and to use QIS technologies such as Josephson Parametric Amplifiers and photon counters (in-situ or itinerant) enable us to reach unprecedented sensitivities and faster scan rates. Here is presented an overview of the quantum sensing efforts at SQMS [1], focusing on theoretical advancements and experimental searches for Dark Sector particles (as dark matter candidates and not), gravitational waves, and precision measurements. The experiments conducted, or under preparation, include axion dark matter (DM) [2, 3], dark photon DM searches [4,5], light-shining-through-wall experiments [6], cavity-based searches for high frequency gravitational waves [7], and measurements of the electron magnetic moment [8]. [1] Berlin, A., et al. "Searches for new particles, dark matter, and gravitational waves with SRF cavities." arXiv preprint arXiv:2203.12714 (2022). [2] Giaccone, B., et al. "Design of axion and axion dark matter searches based on ultra high Q SRF cavities." arXiv preprint arXiv:2207.11346 (2022). [3] Braggio, C., et al. "Quantum-enhanced sensing of axion dark matter with a transmon-based single microwave photon counter." arXiv preprint arXiv:2403.02321 (2024). [4] Fan, X., et al. "One-electron quantum cyclotron as a milli-eV dark-photon detector." Physical review letters 129.26 (2022): 261801. [5] Cervantes, R., et al. "Deepest sensitivity to wavelike dark photon dark matter with superconducting radio frequency cavities." Physical Review D 110.4 (2024): 043022. [6] Romanenko, A., et al. "Search for dark photons with superconducting radio frequency cavities." Physical review letters 130.26 (2023): 261801. [7] Berlin, A., et al. "Electromagnetic cavities as mechanical bars for gravitational waves." Physical Review D 108.8 (2023): 084058. [8] Fan, X., et al. "Measurement of the electron magnetic moment." Physical review letters 130.7 (2023): 071801.

Giaccone, Bianca↗

Super Resolving Unrolled Neural Networks for Remote Sensing

In remote sensing systems, the capabilities of the system are constrained by the complex interactions between size, weight, and power (SWAP) of potential designs. In electro-optical (EO) systems, examples of these critical parameters include the system’s sensitivity and resolution. Those parameters can be increased by ever larger optical apertures and focal planes but at the cost of more SWAP. Multi-image super resolution (MISR) techniques allow resolution to be enhanced via computation rather than more sophisticated optical hardware. These algorithms combine multiple images together into a single, higher resolution image, trading temporal resolution and computation for spatial resolution. Fielded MISR techniques, such as Drizzle, can require several hundred images to create a single super resolved image, implying reduced temporal resolution, increased data acquisition load, and limiting mission applications. Iterative techniques, such as model-based image reconstruction and compressive sensing, have been shown to create super resolved images using fewer images than Drizzle. They do this by posing an optimization problem that balances accuracy between a highly accurate physical model and an image model. In the case of super resolution, the physical model is defined by the relation between low resolution input images and the desired high resolution output image. The image model encodes some assumptions about the super resolved image. These assumptions are meant to suppress reconstruction artifacts that arise due to deterministic physical model error, stochastic measurement noise, and potential undersampling. In practice, the performance of iterative methods are limited by imaging models compatible with optimization. Deep learning-based methods can effectively learn image models of arbitrary complexity, but lack the theoretical explainability and robustness of iterative techniques. Consensus equilibrium (CE) generalizes the iterative techniques beyond optimization, enabling blackbox algorithms such as traditional and neural image denoisers to be used as the image model. CE-based approaches retain much of the explainability and robustness of iterative techniques while allowing the expressiveness of machine learning image models to be used. Additionally, by unrolling iterations of CE with an embedded image denoiser, the image denoiser can be further trained and specialized to the specific application with potentially higher quality reconstructions. Under this project, we demonstrated the feasibility of training an unrolled neural network based upon CE. While we didn’t train one, we showed that the CE process is differentiable and its gradient can be tractably computed. We also explored the usage of a variants of CE akin to generative neural works. Most importantly, we applied the CE framework to a number of problems including non-blind deconvolution, upsampling, single-image super resolution, MISR, event-based sensing, and saturated deconvolution. Our MISR prototype creates high quality reconstructions with an order of magnitude fewer images than previous approaches and, critically, produces these reconstructions fast enough for practical usage.

47 OTHER INSTRUMENTATION↗

Quantum Sensing Enhanced by Squeezing and Non-Hermitian Physics

We find extraordinary enhancement of sensitivity by integrating non-Hermitian and squeezing effects in a general framework for quantum sensing. When a bosonic-mode sensor operates at the parametric oscillation (PO) threshold and an exceptional point (EP), the sensing precision exhibits a quartic scaling with the perturbation strength, leading to ultrahigh sensitivity. The result generalizes to multimode squeezed-state sensors with higher-order EPs, with potential applicability across a wide range of quantum sensing platforms.

Wang, Changqing [Fermilab]↗

FY 2026 Midyear Report: Seismic Monitoring of Underground Vibration Sources Using Distributed Acoustic Sensing and Seismometers

Safeguards-relevant temporal changes in underground facilities can be observed using geophysical monitoring techniques. Seismic waves, in particular, provide valuable insights into subsurface activities and can serve as an important tool for detecting anomalous events that may indicate containment breaches at geological repositories. This midyear report summarizes ongoing efforts to automatically and rapidly detect and locate anomalous vibration signals that could be indicative of potential containment breaches. Previous work during FY25 focused on compiling continuous seismic datasets from two underground sites and developing a database of continuous waveforms and ground-truth event data derived from multiple sensing modalities. Building on this foundation, we are adapting anomaly detection and geolocation algorithms to explore methods for monitoring underground activities using two relatively low-maintenance sensing technologies: a dense surface geophone array deployed at the Pleasant Gap mine in Pennsylvania, and a three-dimensional fiber-optic cable array for distributed acoustic sensing (DAS) installed in the subsurface at the Sanford Underground Research Facility (SURF) in South Dakota. This report summarizes work conducted during the first two quarters of FY26, during which we refined a dynamic power spectral density (PSD)-based detector, applied it independently to each geophone station, and then combined the per‑station detections with density-based spatial clustering of applications with noise (DBSCAN) to cluster events and produce spatial maps over a nine‑day interval. In addition, we outline plans for a field trial at the Waste Isolation Pilot Plant (WIPP) in New Mexico to compare traditional seismic monitoring approaches with DAS techniques and to evaluate the benefits of combined data analysis. Activities during the past two quarters have included the preparation and submission of a Field Test Plan to WIPP for approval, as well as submission to headquarters for review and feedback.

58 GEOSCIENCES↗

Short Circuit Detection and Voltage Sense for High Voltage Ionization Tube Power Supplies

Fermilab's PIP-II upgrade requires new rack-mounted power supplies for Beam Loss Monitor (BLM) ionization tubes compatible with the microTCA 4.1 standard, supporting high-side current measurement for short circuit detection, voltage sense telemetry, and low-side current measurement for beam loss readout. This work presents the design and preliminary schematic of such a supply. A resistive current sensing approach was chosen over inductive, optical, and Hall-effect alternatives for its independence from cable length and component availability. A 500 mΩ inline shunt steps the 2 kV common mode voltage down to roughly 70 V, producing a ~27 μV pulse during a short, which is amplified 500x, compared against a 14-bit DAC threshold, and latched to drive a fault line. Voltage sense steps the 2 kV output down at a 1V/1000V ratio, buffers it with a low bias current amplifier, and digitizes it via a 24-bit ADC over SPI. Onboard power is regulated from 12 V down to isolated 5 V and 3.3 V rails, with capacitive isolation on FPGA communication lines. Lumped parameter models were developed for the ionization tube (0.327 nF, 20 to 200 GΩ dynamic resistance) and the RG-58 coaxial cable to support the design. Component selection is complete and a preliminary schematic has been drawn in Altium Designer, forming the foundation for future prototyping and validation.

Yu, Kellen [Cornell U.]↗

The Utility of Satellites and Autonomous Remote Sensing Platforms for Monitoring Offshore Aquaculture Farms: A Case Study for Canopy Forming Kelps

The emerging sector of offshore kelp aquaculture represents an opportunity to produce biofuel feedstock to help meet growing energy demand. Giant kelp represents an attractive aquaculture crop due to its rapid growth and production, however precision farming over large scales is required to make this crop economically viable. These demands necessitate high frequency monitoring to ensure outplant success, maximum production, and optimum quality of harvested biomass, while the long distance from shore and large necessary scales of production makes in person monitoring impractical. Remote sensing offers a practical monitoring solution and nascent imaging technologies could be leveraged to provide daily products of the kelp canopy and subsurface structures over unprecedented spatial scales. Here, we evaluate the efficacy of remote sensing from satellites and aerial and underwater autonomous vehicles as potential monitoring platforms for offshore kelp aquaculture farms. Decadal-scale analyses of the Southern California Bight showed that high offshore summertime cloud cover restricts the ability of satellite sensors to provide high frequency direct monitoring of these farms. By contrast, daily monitoring of offshore farms using sensors mounted to aerial and underwater drones seems promising. Small Unoccupied Aircraft Systems (sUAS) carrying lightweight optical sensors can provide estimates of canopy area, density, and tissue nitrogen content on the time and space scales necessary for observing changes in this highly dynamic species. Underwater color imagery can be rapidly classified using deep learning models to identify kelp outplants on a longline farm and high acoustic returns of kelp pneumatocysts from side scan sonar imagery signal an ability to monitor the subsurface development of kelp fronds. Current sensing technologies can be used to develop additional machine learning and spectral algorithms to monitor outplant health and canopy macromolecular content, however future developments in vehicle and infrastructure technologies are necessary to reduce costs and transcend operational limitations for continuous deployment in an offshore setting.

54 ENVIRONMENTAL SCIENCES↗

A novel transfer learning framework for sorghum biomass prediction using UAV-based remote sensing data and genetic markers

Yield for biofuel crops is measured in terms of biomass, so measurements throughout the growing season are crucial in breeding programs, yet traditionally time- and labor-consuming since they involve destructive sampling. Modern remote sensing platforms, such as unmanned aerial vehicles (UAVs), can carry multiple sensors and collect numerous phenotypic traits with efficient, non-invasive field surveys. However, modeling the complex relationships between the observed phenotypic traits and biomass remains a challenging task, as the ground reference data are very limited for each genotype in the breeding experiment. In this study, a Long Short-Term Memory (LSTM) based Recurrent Neural Network (RNN) model is proposed for sorghum biomass prediction. The architecture is designed to exploit the time series remote sensing and weather data, as well as static genotypic information. As a large number of features have been derived from the remote sensing data, feature importance analysis is conducted to identify and remove redundant features. A strategy to extract representative information from high-dimensional genetic markers is proposed. To enhance generalization and minimize the need for ground reference data, transfer learning strategies are proposed for selecting the most informative training samples from the target domain. Consequently, a pre-trained model can be refined with limited training samples. Field experiments were conducted over a sorghum breeding trial planted in multiple years with more than 600 testcross hybrids. The results show that the proposed LSTM-based RNN model can achieve high accuracies for single year prediction. Further, with the proposed transfer learning strategies, a pre-trained model can be refined with limited training samples from the target domain and predict biomass with an accuracy comparable to that from a trained-from-scratch model for both multiple experiments within a given year and across multiple years.

36 MATERIALS SCIENCE↗

Integrating multi-modal remote sensing, deep learning, and attention mechanisms for yield prediction in plant breeding experiments

In both plant breeding and crop management, interpretability plays a crucial role in instilling trust in AI-driven approaches and enabling the provision of actionable insights. The primary objective of this research is to explore and evaluate the potential contributions of deep learning network architectures that employ stacked LSTM for end-of-season maize grain yield prediction. A secondary aim is to expand the capabilities of these networks by adapting them to better accommodate and leverage the multi-modality properties of remote sensing data. In this study, a multi-modal deep learning architecture that assimilates inputs from heterogeneous data streams, including high-resolution hyperspectral imagery, LiDAR point clouds, and environmental data, is proposed to forecast maize crop yields. The architecture includes attention mechanisms that assign varying levels of importance to different modalities and temporal features that, reflect the dynamics of plant growth and environmental interactions. The interpretability of the attention weights is investigated in multi-modal networks that seek to both improve predictions and attribute crop yield outcomes to genetic and environmental variables. This approach also contributes to increased interpretability of the model's predictions. The temporal attention weight distributions highlighted relevant factors and critical growth stages that contribute to the predictions. The results of this study affirm that the attention weights are consistent with recognized biological growth stages, thereby substantiating the network's capability to learn biologically interpretable features. Accuracies of the model's predictions of yield ranged from 0.82-0.93 R 2 ref in this genetics-focused study, further highlighting the potential of attention-based models. Further, this research facilitates understanding of how multi-modality remote sensing aligns with the physiological stages of maize. The proposed architecture shows promise in improving predictions and offering interpretable insights into the factors affecting maize crop yields, while demonstrating the impact of data collection by different modalities through the growing season. By identifying relevant factors and critical growth stages, the model's attention weights provide valuable information that can be used in both plant breeding and crop management. The consistency of attention weights with biological growth stages reinforces the potential of deep learning networks in agricultural applications, particularly in leveraging remote sensing data for yield prediction. To the best of our knowledge, this is the first study that investigates the use of hyperspectral and LiDAR UAV time series data for explaining/interpreting plant growth stages within deep learning networks and forecasting plot-level maize grain yield using late fusion modalities with attention mechanisms.

59 BASIC BIOLOGICAL SCIENCES↗

In-Situ Sensing and Dynamics Predictions for Electrothermally-Actuated Soft Robot Limbs

Untethered soft robots that locomote using electrothermally-responsive materials like shape memory alloy (SMA) face challenging design constraints for sensing actuator states. At the same time, modeling of actuator behaviors faces steep challenges, even with available sensor data, due to complex electrical-thermal-mechanical interactions and hysteresis. This article proposes a framework for in-situ sensing and dynamics modeling of actuator states, particularly temperature of SMA wires, which is used to predict robot motions. A planar soft limb is developed, actuated by a pair of SMA coils, that includes compact and robust sensors for temperature and angular deflection. Data from these sensors are used to train a neural network-based on the long short-term memory (LSTM) architecture to model both unidirectional (single SMA) and bidirectional (both SMAs) motion. Predictions from the model demonstrate that data from the temperature sensor, combined with control inputs, allow for dynamics predictions over extraordinarily long open-loop timescales (10 min) with little drift. Prediction errors are on the order of the soft deflection sensor’s accuracy. This architecture allows for compact designs of electrothermally-actuated soft robots that include sensing sufficient for motion predictions, helping to bring these robots into practical application.

Sabelhaus, Andrew P.↗