Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Machine Learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,675 records · Page 93

Real-time machine-learning-driven control system of a deformable mirror for achieving aberration-free X-ray wavefronts

A neural-network machine learning model is developed to control a bimorph adaptive mirror to achieve and preserve aberration-free coherent X-ray wavefronts at synchrotron radiation and free electron laser beamlines. The controller is trained on a mirror actuator response directly measured at a beamline with a real-time single-shot wavefront sensor, which uses a coded mask and wavelet-transform analysis. The system has been successfully tested on a bimorph deformable mirror at the 28-ID IDEA beamline of the Advanced Photon Source at Argonne National Laboratory. It achieved a response time of a few seconds and maintained desired wavefront shapes (e.g., a spherical wavefront) with sub-wavelength accuracy at 20 keV of X-ray energy. This result is significantly better than what can be obtained using a linear model of the mirror’s response. The developed system has not been tailored to a specific mirror and can be applied, in principle, to different kinds of bending mechanisms and actuators.

47 OTHER INSTRUMENTATION↗

Path Sampling for Rare Events Boosted by Machine Learning

The study by Jung et al. introduced Artificial Intelligence for Molecular Mechanism Discovery (AIMMD), a novel sampling algorithm that integrates machine learning to enhance the efficiency of transition path sampling (TPS). By enabling on-the-fly estimation of the committor probability and simultaneously deriving a human-interpretable reaction coordinate, AIMMD offers a robust framework for elucidating the mechanistic pathways of complex molecular processes. Here, this commentary provides a discussion and critical analysis of the core AIMMD framework, explores its recent extensions, and offers an assessment of the method’s potential impact and limitations.

Minh, Porhouy [Univ. of Minnesota, Minneapolis, MN↗

Optimizing Earthquake Nowcasting With Machine Learning: The Role of Strain Hardening in the Earthquake Cycle

Abstract Nowcasting is a term originating from economics, finance, and meteorology. It refers to the process of determining the uncertain state of the economy, markets or the weather at the current time by indirect means. In this paper, we describe a simple two‐parameter data analysis that reveals hidden order in otherwise seemingly chaotic earthquake seismicity. One of these parameters relates to a mechanism of seismic quiescence arising from the physics of strain‐hardening of the crust prior to major events. We observe an earthquake cycle associated with major earthquakes in California, similar to what has long been postulated. An estimate of the earthquake hazard revealed by this state variable time series can be optimized by the use of machine learning in the form of the Receiver Operating Characteristic skill score. The ROC skill is used here as a loss function in a supervised learning mode. Our analysis is conducted in the region of 5° × 5° in latitude‐longitude centered on Los Angeles, a region which we used in previous papers to build similar time series using more involved methods (Rundle & Donnellan, 2020, https://doi.org/10.1029/2020EA001097 ; Rundle, Donnellan et al., 2021, https://doi.org/10.1029/2021EA001757 ; Rundle, Stein et al., 2021, https://doi.org/10.1088/1361-6633/abf893 ). Here we show that not only does the state variable time series have forecast skill, the associated spatial probability densities have skill as well. In addition, use of the standard ROC and Precision (PPV) metrics allow probabilities of current earthquake hazard to be defined in a simple, straightforward, and rigorous way.

58 GEOSCIENCES↗

Revealing Variable Dependences in Hexagonal Boron Nitride Synthesis via Machine Learning

Wafer-scale monolayer two-dimensional (2D) materials have been realized by epitaxial chemical vapor deposition (CVD) in recent years. To scale up the synthesis of 2D materials, a systematic analysis of how the growth dynamics depend on the growth parameters is essential to unravel its mechanisms. However, the studies of CVD-grown 2D materials mostly adopted the control variate method and considered each parameter as an independent variable, which is not comprehensive for 2D materials growth optimization. Herein, we synthesized a representative 2D material, monolayer hexagonal boron nitride (hBN), on single-crystalline Cu (111) by epitaxial chemical vapor deposition and varied the growth parameters to regulate the hBN domain sizes. Furthermore, we explored the correlation between two growth parameters and provided the growth windows for large flake sizes by the Gaussian process. Here, this new analysis approach based on machine learning provides a more comprehensive understanding of the growth mechanism for 2D materials.

36 MATERIALS SCIENCE↗

Accelerating the discovery of low-energy structure configurations: A computational approach that integrates first-principles calculations, Monte Carlo sampling, and Machine Learning

Finding Minimum Energy Configurations (MECs) is essential in fields such as physics, chemistry, and materials science, as they represent the most stable states of the systems. In particular, identifying such MECs in multi-component alloys considered candidate PFMs is key because it determines the most stable arrangement of atoms within the alloy, directly influencing its phase stability, structural integrity, and thermo-mechanical properties. However, since the search space grows exponentially with the number of atoms considered, obtaining such MECs using computationally expensive first-principles DFT calculations often results in a cumbersome task. To escape the above compromise between physical fidelity and computational efficiency, we have developed a novel physics-based data-driven approach that combines Monte Carlo sampling, first-principles DFT calculations, and Machine Learning to accelerate the discovery of MECs in multi-component alloys. More specifically, we have leveraged well-established Cluster Expansion (CE) techniques with Local Outlier Factor models to establish strategies that enhance the reliability of the CE method. In this work, we demonstrated the capabilities of the proposed approach for the particular case of a tungsten-based quaternary high-entropy alloy. However, the method is applicable to other types of alloys and enables a wide range of applications.

36 MATERIALS SCIENCE↗

Battery calendar aging and machine learning

Batteries continue to attract immense attention due to the critical need for new energy technologies that can help humankind transition to a net-zero future. To meet global goals for implementation of new batteries, the research community needs to more coherently consider how to go about the process of innovation, development, and validation of new technologies. Current practices for bringing a new battery technology from the benchtop to deployment can be very time consuming and complex, given that batteries can have distinct aging pathways based on both how they are cycled and their storage conditions. In nearly all use cases, batteries experience periods of active cycling and also extended periods of rest. Thus, calendar time often occurs when a battery is close to fully charged. Currently, the combined cycle and calendar life aspects receive inconsistent attention during most stages of research and development. For batteries to fulfill the critical role envisioned to meet global energy demands, greater uniformity in practice is needed to alleviate potential delays caused by the inconsistent acquisition of aging data. In this study, we present our thoughts and recommendations on the need to further advance commonality and availability of calendar aging data for emerging high-energy and long-duration batteries. While there is a broad need to adopt best practices for both calendar and cycle life assessment, a push to greater uniformity in approach and reporting is sorely needed to allow calendar life predictions to harness many of the advances that have recently been seen for cycle life prediction using machine learning (ML) and other techniques.

25 ENERGY STORAGE↗

Evaluation of antifouling surfaces using a method that employs mussel larvae settlement quantified by machine learning

Antifouling coating development requires extensive performance testing. Coatings that prevent aquatic larval settlement are of interest because many forms of macrofouling begin at the larval stage. However, field testing can be time consuming and poorly controlled. Herein is reported a screening tool, Settlement of Larvae Assay using Mussels (SLAM), for down-selecting materials prior to field testing. The method entails using a dense concentration of mussel larvae that are allowed to settle on submerged test surfaces. Settled larvae are then quantified to provide a measure of antifouling performance. The SLAM test differentiated coatings with only slight differences in formulation. To enable efficient quantification of dense larvae settlement, an automated counting method was developed that combines two analyses: a color thresholding identifies larvae clumps, and a machine learning algorithm identifies non-clumped larvae. Finally, this automated ‘hybrid’ approach rapidly quantifies settled larvae as effectively as manual counting but in a fraction of the time.

Mytilus↗

Spread spectrum time domain reflectometry (SSTDR) and frequency domain reflectometry (FDR) cable inspection using machine learning

Cables are initially qualified for nuclear power plant use for 40 years. As plants extend their operating license to 60 and 80 years, justification for continued cable use must shift to a condition-based approach since it is cost prohibitive to completely replace cables that are likely still capable of performing their design function. The Pacific Northwest National Laboratory (PNNL) Accelerated and Real Time Experimental Nodal Analysis (ARENA) cable motor test bed was used to test the response of a commercial spread spectrum time domain reflectometry (SSTDR) system, a laboratory instrument software-controlled SSTDR, and a vector network analyzer-based frequency domain reflectometry (FDR) system to various cable anomalies. The three instrument systems were able to interrogate cables over a range of frequency bandwidths that can be helpful for human data analysis. Data were subjected to supervised and unsupervised machine learning (ML) analyses to distinguish normal undamaged cable responses from anomalous cable responses. Both supervised and unsupervised ML approaches produced encouraging results with an undamaged/anomalous prediction accuracy from 0.69% to 0.87%. Recommendations for further development and field implementation include increased and more balanced sample sets particularly including more training data.

SSTDR, FDR, Reflectometry, Machine Learning, ARENA↗

Machine-Learning Assisted Identification of Battery Life Models

Predictive battery life models are commonly utilized to extrapolate degradation trends observed during accelerated aging tests for simulation of degradation in real-world applications. Thus, fitting accelerated aging data as accurately as possible and with low uncertainty is crucial for making believable projections of battery lifetime, but it is challenging to identify algebraic expressions that accurately fit multivariate degradation trends. A review of models published in literature reveal some common expressions for fitting calendar aging data, which is only dependent on temperature and state-of-charge, but no consistency across many models for fitting cycle aging data, indicating the need for a statistically rigorous data driven approach for developing empirical models. This talk will describe a machine-learning assisted method for identification of predictive battery life models utilizing bilevel optimization and symbolic regression. Bilevel optimization with cross-validation is used to statistically determine cell- and stress-dependent model parameters, while symbolic regression identifies both linear and multiplicative candidate expressions to predict stress-dependent degradation rates by selecting low-order subsets of features from a generated feature library. Because model expressions are identified empirically, it is crucial to ensure resulting models behave according to physical expectations, so the stability of models for interpolation or extrapolation is interrogated qualitatively through simulation and quantitatively through cross-validation and uncertainty quantification via bootstrap resampling. This model identification approach substantially improves upon models identified purely using expert judgement in terms of both accuracy and uncertainty. Model simulation and validation is then conducted by deriving a state-equation form of the predictive model, enabling simulation of battery aging under dynamic stresses. This enables validation of the predictive battery model on lab-based tests with varying conditions or on drive-cycle or application-cycle testing protocols. Parameter uncertainty can be carried forward into model simulation, giving lifetime estimates and confidence windows for cell- or system-level lifetime. The financial impact of battery model uncertainty can be estimated by incorporating uncertainty into a technoeconomic model.

battery↗

Pd–Methyl Bond Energy─Property Correlations, Noncorrelations, Machine Learning Models, and Application to Polymerization Catalysis

Metal–carbon bonds are a key intermediate in a variety of homogeneous organometallic transformations and often determine the critical thermodynamics and kinetics of catalytic processes. Surprisingly, the influence of different ligands on metal–carbon bond strengths has been largely overlooked. Here, in this study, we evaluated nearly 700 experimental Pd–methyl complexes by calculating their bond dissociation energies using density functional theory (DFT) and compared these bond strengths to several fundamental molecular properties, and this revealed several surprising correlations and noncorrelations. Most surprising was that several fundamental properties, such as the bond length, bond force constant, and bond electron density, have no correlation with bond strength, despite these correlations often holding for main-group compounds. We were indeed able to identify key ligand-dependent chemical features/descriptors that provided a highly accurate machine learning model and provided insight into the general factors that control the Pd–carbon bond strength, such as radical delocalization and nucleophilicity. Insights gained from the Pd–Me bond energy analysis were then applied to CO migratory insertion steps that are part of copolymerization reactions.

binding energy↗

Sieving Hydrogen Isotopes via Machine Learning Assisted Chemical Vapor Deposition (CVD) of High‐Quality Monolayer Hexagonal Boron Nitride (h‐BN) on Iron Foils

Atomically thin two-dimensional (2D) ceramics, such as monolayer hexagonal boron nitride (h-BN), present potential for disruptive advances in separations. However, sub-atomic scale separation of hydrogen isotopes (H + /D + ) require near pristine 2D material membranes, and scalable synthesis of such high-quality h-BN comparable to mechanically exfoliated crystals remains a significant challenge. Here, we report a scalable Fe-catalyzed chemical vapor deposition (CVD) process for bottom-up synthesis of large-area, high-quality monolayer h-BN films, overcoming key limitations of conventional ammonia-based routes. By leveraging mechanistic insights and higher CVD temperatures, we suppress multilayer formation and achieve uniform monolayer h-BN coverage on commercially available Fe foils. Machine learning enables systematic exploration of the complex, multi-dimensional CVD parameter space (growth time, temperature, precursor temperature, multilayer faction, coverage), providing data-driven approaches to visualize and identify process regimes facilitating predominantly monolayer h-BN growth with minimal secondary nuclei/ad-layers. The optimized Fe-catalyzed CVD h-BN membranes show high-quality as observed by proton/deuteron (H + /D + ) selectivity ≈8.45, approaching the highest quality benchmark of mechanically exfoliated h-BN (H + /D + selectivity ≈10) as well as significantly outperforming Cu-catalyzed CVD h-BN membranes (H + /D + selectivity ≈3.62, control selectivity ≈1.7). Our work provides a scalable cost-effective route for high-quality monolayer h-BN synthesis for sub-atomic scale separations (H + /D + ) and demonstrates the broader potential of machine learning-guided optimization of CVD for advancing synthesis of 2D materials.

36 MATERIALS SCIENCE↗

A machine learning approach to water quality forecasts and sensor network expansion: Case study in the Wabash River Basin, United States

Abstract Midwestern cities require forecasts of surface nitrate loads to bring additional treatment processes online or activate alternative water supplies. Concurrently, networks of nitrate monitoring stations are being deployed in river basins, co‐locating water quality observations with established stream gauges. However, tools to evaluate the future value of expanded networks to improve water quality forecasts remains challenging. Here, we construct a synthetic data set of stream discharge and nitrate for the Wabash River Basin—one of the United States’ most nutrient polluted basins—using the established Agro‐IBIS and THMB models. Synthetic data enables rapid, unbiased and low‐cost assessment of potential sensor placements to support management objectives, such as near‐term forecasting. Using the synthetic data, we established baseline 1‐day forecasts for surface water nitrate at 12 cities in the basin using support vector machine regression (SVMR; RMSE 0.48–3.3 ppm). Next, we used the SVMRs to evaluate the improvement in forecast performance associated with deployment of additional nitrate sensors. We identified the optimal sensor placement to improve forecasts at each city, and the relative value of sensors at each candidate location. Finally, we assessed the co‐benefit realized by other cities when a sensor is deployed to optimize a forecast at one city, finding significant positive externalities in all cases. Ultimately, our study explores the potential for machine learning to make near‐term predictions and critically evaluate the improvement realized by expanding a monitoring network. While we use nitrate pollution in the Wabash River Basin as a case study, this approach could be readily applied to any problem where the future value of sensors and network design are being evaluated.

54 ENVIRONMENTAL SCIENCES↗

Spatial Mapping of Riverbed Grain-Size Distribution Using Machine Learning

Recent alluvial sediments in riverbeds play a significant role in controlling hydrologic exchange flows (HEFs) in river systems. The alluvial layer is usually associated with strong heterogeneity in physical properties (e.g., permeability and hydraulic conductivity), which affects local HEFs and therefore biogeochemical processes. The spatial distribution of these physical properties needs to be determined to inform the numerical models used to reveal the realistic hydro-biogeochemical behaviors. Such information can be obtained based on the intrinsic link between sediment grain-size distribution and hydraulic properties where sediment texture information is available. However, grain-size measurements are usually spatially sparse and do not have adequate coverage and resolution, particularly for a relatively large domain such as the Hanford Reach of the Columbia River. In this paper, we adopted machine learning (ML) approaches for categorizing and mapping the spatial distributions of riverbed substrate grain size and filling in missing areas of substrate data using the ML models along the reach. Such ML models for substrate size mapping were trained at 13,372 locations using measured substrate sizes along with observed and simulated attributes, including bathymetric attributes (e.g., elevation, slope, and aspect ratio) from LIDAR and bathymetric surveys, and hydrodynamic properties (e.g., water depth, velocity, shear stress, and their statistical moments). An ensemble bagging-based ML technique, Random Forest, was adopted to identify the most influential factors as predictors to develop the predictive models with over-fitting issues addressed. The models were evaluated with respect to each individual substrate size class and the lumped group, and then used to generate the final substrate size maps covering all the grid cells in the numerical modeling domain.

54 ENVIRONMENTAL SCIENCES↗

Combining synchrotron X-ray diffraction, mechanistic modeling and machine learning for in situ subsurface temperature quantification during laser melting

Laser melting, such as that encountered during additive manufacturing, produces extreme gradients of temperature in both space and time, which in turn influence microstructural development in the material. Qualification and model validation of the process itself and the resulting material necessitate the ability to characterize these temperature fields. However, well established means to directly probe the material temperature below the surface of an alloy while it is being processed are limited. To address this gap in characterization capabilities, a novel means is presented to extract subsurface temperature-distribution metrics, with uncertainty, from in situ synchrotron X-ray diffraction measurements to provide quantitative temperature evolution data during laser melting. Temperature-distribution metrics are determined using Gaussian process regression supervised machine-learning surrogate models trained with a combination of mechanistic modeling (heat transfer and fluid flow) and X-ray diffraction simulation. The trained surrogate model uncertainties are found to range from 5 to 15% depending on the metric and current temperature. The surrogate models are then applied to experimental data to extract temperature metrics from an Inconel 625 nickel superalloy wall specimen during laser melting. The maximum temperatures of the solid phase in the diffraction volume through melting and cooling are found to reach the solidus temperature as expected, with the mean and minimum temperatures found to be several hundred degrees less. The extracted temperature metrics near melting are determined to be more accurate because of the lower relative levels of mechanical elastic strains. However, uncertainties for temperature metrics during cooling are increased due to the effects of thermomechanical stress.

36 MATERIALS SCIENCE↗

Reducing Southern Ocean Shortwave Radiation Errors in the ERA5 Reanalysis with Machine Learning and 25 Years of Surface Observations

Earth system models struggle to simulate clouds and their radiative effects over the Southern Ocean, partly due to a lack of measurements and targeted cloud microphysics knowledge. We have evaluated biases of downwelling shortwave radiation in the ERA5 climate reanalysis using 25 years (1995–2019) of summertime surface measurements, collected on the Research and Supply Vessel (RSV) Aurora Australis, the Research Vessel (R/V) Investigator, and at Macquarie Island. During October–March daylight hours, the ERA5 simulation of SW down exhibited large errors (mean bias = 54 W m -2 , mean absolute error = 82 W m -2 , root-mean-square error = 132 W m -2 , and R 2 = 0.71). To determine whether we could improve these statistics, we bypassed ERA5’s radiative transfer model for SW down with machine learning–based models using a number of ERA5’s gridscale meteorological variables as predictors. These models were trained and tested with the surface measurements of SW down using a 10-fold shuffle split. An extreme gradient boosting (XGBoost) and a random forest–based model setup had the best performance relative to ERA5, both with a near complete reduction of the mean bias error, a decrease in the mean absolute error and root-mean-square error by 25% ± 3%, and an increase in the R 2 value of 5% ± 1% over the 10 splits. Large improvements occurred at higher latitudes and cyclone cold sectors, where ERA5 performed most poorly. We further interpret our methods using Shapley additive explanations. Our results indicate that data-driven techniques could have an important role in simulating surface radiation fluxes and in improving reanalysis products.

54 ENVIRONMENTAL SCIENCES↗

Revealing the Galaxy–Halo Connection through Machine Learning

Abstract Understanding the connections between galaxy stellar mass, star formation rate, and dark matter halo mass represents a key goal of the theory of galaxy formation. Cosmological simulations that include hydrodynamics, physical treatments of star formation, feedback from supernovae, and the radiative transfer of ionizing photons can capture the processes relevant for establishing these connections. The complexity of these physics can prove difficult to disentangle and obfuscate how mass-dependent trends in the galaxy population originate. Here, we train a machine-learning method called Explainable Boosting Machines (EBMs) to infer how the stellar mass and star formation rate of nearly 6 million galaxies simulated by the Cosmic Reionization on Computers project depend on the physical properties of halo mass, the peak circular velocity of the galaxy during its formation history v peak , cosmic environment, and redshift. The resulting EBM models reveal the relative importance of these properties in setting galaxy stellar mass and star formation rate, with v peak providing the most dominant contribution. Environmental properties provide substantial improvements for modeling the stellar mass and star formation rate in only ≲10% of the simulated galaxies. We also provide alternative formulations of EBM models that enable low-resolution simulations, which cannot track the interior structure of dark matter halos, to predict the stellar mass and star formation rate of galaxies computed by high-resolution simulations with detailed baryonic physics.

79 ASTRONOMY AND ASTROPHYSICS↗

Using mechanistic models and machine learning to design single-color multiplexed nascent chain tracking experiments

mRNA translation is the ubiquitous cellular process of reading messenger-RNA strands into functional proteins. Over the past decade, large strides in microscopy techniques have allowed observation of mRNA translation at a single-molecule resolution for self-consistent time-series measurements in live cells. Dubbed Nascent chain tracking (NCT), these methods have explored many temporal dynamics in mRNA translation uncaptured by other experimental methods such as ribosomal profiling, smFISH, pSILAC, BONCAT, or FUNCAT-PLA. However, NCT is currently restricted to the observation of one or two mRNA species at a time due to limits in the number of resolvable fluorescent tags. In this work, we propose a hybrid computational pipeline, where detailed mechanistic simulations produce realistic NCT videos, and machine learning is used to assess potential experimental designs for their ability to resolve multiple mRNA species using a single fluorescent color for all species. Our simulation results show that with careful application this hybrid design strategy could in principle be used to extend the number of mRNA species that could be watched simultaneously within the same cell. We present a simulated example NCT experiment with seven different mRNA species within the same simulated cell and use our ML labeling to identify these spots with 90% accuracy using only two distinct fluorescent tags. We conclude that the proposed extension to the NCT color palette should allow experimentalists to access a plethora of new experimental design possibilities, especially for cell Signaling applications requiring simultaneous study of multiple mRNAs.

59 BASIC BIOLOGICAL SCIENCES↗

Protection System Validation with Machine Learning Anomaly Classification

A poster for the Early Career Poster Session. Power system protection devices have transitioned over the past few decades from mechanical to analog devices, then to solid state and finally digital. Relays and their associated critical network of equipment have significantly increased in complexity. Even internally, relays have gained significant intricacy, with relatively simple overcurrent or differential functions now being assisted by a myriad of other functions. This is necessary as the grid becomes more complex, but it brings increased difficulty in monitoring and upkeep. Misoperation caused by improper relay settings or malicious actions is a constant challenge faced by all utilities. These improper settings can be difficult to identify and may require exhaustive post-mortem analysis, typically after a major outage event has already occurred. A mechanism is needed for monitoring the behavior of protection systems to validate that they act and perform as expected. This work presents a concept for a machine learning (ML) system capable of validating the performance of protection systems by classifying anomalous events and characterizing protection system responses based solely on available current and voltage measurements. As a first step in its development, an experimental dataset is generated, and a random forest model is implemented with high accuracy in distinguishing four power system scenarios.

24 - POWER TRANSMISSION AND DISTRIBUTION↗