Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “generalizability”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

ML-based Micro-CT SOFC Microstructure Models (from Kent 2026 Microstructural Augmentation paper)

Overview -------------------------- This repository contains datasets from the manuscript **"Enhanced Generalizability to Deep-Learning Quantification of 3D Microstructural Characteristics through Microstructurally Aware Augmentation of Scarce Data"** (*William F. Kent, Rochan Bajpai, Rachel C. Kurchin, William K. Epting, Harry W. Abernathy, Paul A. Salvador. Submitted 2026*). The methods are also described in the dissertation **Data Intensive Analysis of Solid Oxide Cell Microstructures** (*Doctoral dissertation, Carnegie Mellon University, 2025*). The datasets here are trained convolutional neural network (CNN) models for predicting key microstructural properties of solid oxide cell (SOC) electrodes from low-res, 2-channel 3D images, as well as some helpful code. The parameters for input images are provided in the paper. Sample data is provided in the file `Combined_anode_aug_dual_1k_examples` - that particular data was used to train `anode_all_aug.pth` and will work most accurately with that model. Please familiarize yourself with all caveats on accuracy and applicability, as detailed in the associated paper. Usage -------------------------- The basic usage is as follows, assuming `model_fn` is the path to the .pth file, and `X` is 2-channel input image(s) of the proper dimensions (either one image of shape `[2,12,24,24]`, or a batch of N input images of shape `[N,2,12,24,24]`): from CNN_inferencer import load_model_for_inference model = load_model_for_inference(model_fn) y_predicted = model(X) The model object automatically handles input scaling and output de-scaling based on the way the models were trained - in other words, pass in a 2-channel micro-CT image, and it will output microstructural property values in real units. ## Other model object attributes Note that model has useful attributes other than its forward pass model(X). * `model.output_descaler` - returns the output descaler object. Model does the de-scaling when generating inferences, but you may want to re-use this de-scaler on other values to e.g. compare predictions to ground truth from already-scaled training data. * `model.prop_names` - Gives the property names of the predicted y values, in order. Only exists if there's an output scaler as part of the model object, which there will be in the models provided here. ## Usage with sample data Here is a short script to use with the included sample data. from CNN_inferencer import display_predictions, load_model_for_inference, calculate_mape, parity_plot import h5py import numpy as np model_fn = 'anode_all_aug.pth' data_fn = 'Combined_anode_aug_dual_1k_examples.h5' N_samples = 200 figure_outdir = '.' model = load_model_for_inference(model_fn) with h5py.File(data_fn,'r') as f: XX = f['X'] #These are the 2-channel 3D images yy = f['y'] #These are the ground-truth microstructural properties, but they have been scaled for training - need to de-scale below N = XX.shape[0] #How many images total in the input data file #Run inferences on N_samples random samples from XX. #Run in a batch, much more efficient than one at a time. ii = np.random.choice(N,N_samples,replace=False) ii.sort() y_pred = model(XX[ii]) #Get the original/true (but normalized/scaled) values from the training dataset... #Because they were normalized, they are not in real units yet. So let's also de-scale them using model.output_scaler. y_true = model.output_scaler.transform(yy[ii]) #Let's display actual values for just 5 random ones for i in np.random.choice(N_samples,5,replace=False): display_predictions(y_true[i], y_pred[i], model.prop_names) #Make parity plots for each property (ground truth vs predicted values) #Also label each plot with the mean abs. percent error (MAPE) of the predicted values for i,key in enumerate(model.prop_names): mape = calculate_mape(y_true[:,i], y_pred[:,i]) parity_plot(y_true[:,i], y_pred[:,i], figure_outdir, key, extra_title=f' ({mape:.2f}% MAPE)')

3D microstructure↗

Modeling of the Optical Stochastic Cooling at the IOTA Storage Ring Using ELEGANT

In support of the Optical Stochastic Cooling (OSC) experiment at IOTA, we implemented a high-fidelity model of OSC in ELEGANT. The element is generalizable to any OSC experiment and captures three main behaviors; (i) the longitudinal time of flight OSC, (ii) the effects between the transverse motion of particles in the beam and the transverse distribution of undulator radiation, and (iii) the incoherent contributions of neighboring particles. Together these produce a highly accurate model of OSC and were benchmarked using the results from the IOTA OSC experiment.

43 PARTICLE ACCELERATORS↗

Automated RF Phase Adjustment for Beam Stabilization in the Fermilab Linac

The Fermilab Linac experiences longitudinal beam phase drift, leading to increased particle loss, conventionally corrected through labor-intensive manual RF adjustments. This project explores machine learning-based automation for drift correction, employing a prototype-based classification approach. Our model utilizes a 34-dimensional feature set (RF settings and BPM readings) and leverages a 7x27 response matrix for system modeling. To overcome limited real-world data, we generate synthetic data, enhancing model training and generalizability. Custom loss functions, including a surrogate energy-consistent loss and a temporal smoothness constraint, ensure physically plausible drift predictions. The goal is a robust system for autonomous phase adjustments, ensuring stable beam acceleration and reduced manual intervention.

Chichili, R. R. [Illinois U., Chicago]↗

CrossCheck: Rapid, Reproducible, and Interpretable Model Evaluation

Evaluation beyond aggregate performance metrics, e.g. F1-score, is crucial to both establish an appropriate level of trust in machine learning models and identify future model improvements. In this paper we demonstrate CrossCheck, an interactive visualization tool for rapid crossmodel comparison and reproducible error analysis. We describe the tool and discuss design and implementation details. We then present three use cases (named entity recognition, reading comprehension, and clickbait detection) that show the benefits of using the tool for model evaluation. CrossCheck allows data scientists to make informed decisions to choose between multiple models, identify when the models are correct and for which examples, investigate whether the models are making the same mistakes as humans, evaluate models’ generalizability and highlight models’ limitations, strengths and weaknesses. Furthermore, CrossCheck is implemented as a Jupyter widget, which allows rapid and convenient integration into data scientists’ model development workflows.

Arendt, Dustin L.↗

Discovery of Innovative Polymers for Next-Generation Gas-Separation Membranes using Interpretable Machine Learning

Polymer membranes perform innumerable separations with far-reaching environmental implications. Despite decades of research on membrane technologies, design of new membrane materials remains a largely Edisonian process. To address this shortcoming, we demonstrate a generalizable, accurate machine-learning (ML) implementation for the discovery of innovative polymers with ideal separation performance. Specifically, multitask ML models are trained on available experimental data to link polymer chemistry to gas permeabilities of He, H2, O2, N2, CO2, and CH4. Here, we interpret the ML models and extract chemical heuristics for membrane design, through Shapley Additive exPlanations (SHAP) analysis. We then screen over nine million hypothetical polymers through our models and identify thousands of candidates that lie well above current performance upper bounds. Notably, we discover hundreds of never-before-seen ultrapermeable polymer membranes with O2 and CO2 permeability greater than 104 and 105 Barrer, respectively. These hypothetical polymers are capable of overcoming undesirable trade-off relationship between permeability and selectivity, thus significantly expanding the currently limited library of polymer membranes for highly efficient gas separations. High-fidelity molecular dynamics simulations confirm the ML-predicted gas permeabilities of the promising candidates, which suggests that many can be translated to reality.

Yang, Jason↗

Conditional Generative Adversarial Networks for Solving Heat Transfer Problems

Generative Adversarial Networks (GANs) have been used as a deep learning approach to solving physics and engineering problems. Using deep learning for these problems is attractive in that reasonably accurate models can be inferred from only raw data, eliminating the need to define the exact physical equations governing a problem. We expand on previous work using GANs to generate steady-state solutions to the two-dimensional heat equation. Using a basic conditional GAN (cGAN), we generate accurate solutions for rectangular domains conditioned on four edge boundary conditions (MAE < 0.5%). For finding steady-state solutions over arbitrary two-dimensional domains (not constrained to rectangles), we use a cGAN designed for image-to-image translation. We train this GAN on various types of geometric domains (circles, squares, triangles, shapes with one circular or rectangular hole), achieving accurate results on test data made up of geometries similar to those in training (MAE < 1%). For both of these GANs, we experiment with different loss function terms, showing that a term using the gradients of solution images significantly improves the basic cGAN but not the image-to-image GAN. Lastly, we show that the image-to-image GAN performs poorly when applied to two-dimensional geometries that vary in structure from training data (MAE < 8% for shapes with multiple holes or different shaped holes). This demonstrates the cGAN's lack of generalizability. While the cGAN is an accurate and computationally efficient method when trained and tested on similarly structured data, it is a much less reliable method when applied to data that is slightly different in structure from the training data.

97 MATHEMATICS AND COMPUTING↗

Modeling Photovoltaics Innovation and Deployment Dynamics

PV’s historically rapid cost reduction is exceptional among technologies. Further cost reductions could play a major role in increasing deployment in the future. To enable such cost reductions, new modeling frameworks are needed to understand the determinants of innovation in PV. In this project, we study the mechanisms driving PV module and system cost reductions, delving deeply into the specific technological innovations that have occurred in the past and the policies that encouraged them, and also opportunities for future cost reduction and widespread deployment. The project contributes new fundamental insight on the determinants of technological innovation by developing novel methods and insights that are generalizable and can therefore be applied to other technologies. The results will allow policy makers, engineers, and other stakeholders to better prioritize their efforts and investments in the future. The project is organized around four journal articles as described below. The first article [1] identifies ‘low-level’ (e.g. conversion efficiency improvement) and ‘high- level’ (e.g. R&D efforts) mechanisms of cost reduction in PV systems (Tasks 1-4). This work builds on a previous DOE grant, where we developed a framework for technological innovation leading to PV module cost reduction [2]. We advance a method to disentangle the contributions of physical (‘hardware’) and non-physical (‘soft technology’) changes. Our results uncover reasons behind the relatively slow evolution of soft technology and can inform new innovation approaches to these technologies. The second article [3] identifies specific engineering or institutional innovations that enabled the low-level mechanisms of cost reduction in PV module and balance-of-systems (BOS) (Tasks 5, 9, 10). We identify 85 innovations and connect them to the cost variables they affected. By developing an innovations typology, this study shows the differences between the types of innovations affecting PV modules and BOS components. Finally, by analyzing the industry origins of innovations, this study also finds that PV was well-positioned within an ecosystem of continuously advancing technologies. The third article [4] studies prospective cost reduction opportunities (Task 10). We explore how design approaches that emphasize standardization and automation, such as plug-and-play PV systems, can create cost reduction opportunities by reducing interactions and speeding up activities with high process costs. We show that this can lead to cost reduction in cost components with the most untapped opportunity for improvement such as installation labor, overhead, electrical BOS, and customer acquisition. The fourth article [5] analyzes how various policies supporting PV deployment and R&D contributed to PV’s cost improvement by enabling high-level mechanisms, specific innovations, and ultimately low-level mechanisms of cost reduction (Tasks 8, 13, 14). We investigate examples from different countries and connect these policies to quantifiable cost change mechanisms. Our study sheds light on the roles that different nations played over time, through a diverse set of policy approaches.

14 SOLAR ENERGY↗

Effects of Jacobian Matrix Regularization on the Detectability of Adversarial Samples

The well-known vulnerability of Deep Neural Networks to adversarial samples has led to a rapid cycle of increasingly sophisticated attack algorithms and proposed defenses. While most contemporary defenses have been shown to be vulnerable to carefully configured attacks, methods based on gradient regularization and out-of-distribution detection have attracted much interest recently by demonstrating higher resilience to a broad range of attack algorithms. However, no study has yet investigated the effect of combining these techniques. In this paper, we consider the effect of Jacobian matrix regularization on the detectability of adversarial samples on the CIFAR-10 image benchmark dataset. We find that regularization has a significant effect on detectability, and in some cases can make an undetectable attack on a baseline model detectable. In addition, we give evidence that regularization may mitigate the known weaknesses of detectors to high-confidence adversarial samples. The defenses we consider here are highly generalizable, and we believe they will be useful for further investigations to transfer machine learning robustness to other data domains.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Physics-Informed Machine Learning from Observations for Clouds, Convection, and Precipitation Parameterizations and Analysis

Fusing learning from Earth observations from space and from the ground (e.g., ARM) with newly developed interpretable and generalizable physics-informed model structures to improve the parameterization of clouds and convection and advance the simulation, understanding and analysis of hydrological extreme events. This covers the prescribed foci of (2) predictive modeling using a hierarchy of models and (3) insight gleaned from complex data.

54 ENVIRONMENTAL SCIENCES↗

Semi-automated Design of Artificial Intelligence Earth Systems Models

Prediction and observation of water cycles at various scales involve not only patterns isolated in space and time, but also modeling of complex spatio-temporal relationships across multiple domains. For instance, evapotranspiration (ET) and leaf area indexes (LAI) are two parameters that are needed to accurately model and understand land-atmosphere processes. Accurate assessments of ET and LAI are critical for understanding hydrological processes, deforestation, crop yield, and irrigation impacts. However, ET estimates for global simulations are available at very coarse spatial resolution. They are usually derived from satellite data based on broad plant functional types (PFTs), which fail to capture fine-scale variations because of changes in vegetation type across the globe. Similarly LAI estimates have typically been derived from vegetation indices at global scales or estimated locally using physical models, both of which suffer from a range of uncertainties that impact model sensitivity. The new era of AI model development for Earth systems (ES) calls for data-driven methods that provide domain scientists with uncertainty-aware estimations of biophysical parameters such as ET and LAI in a generalizable, interpretable, and discoverable manner.

54 ENVIRONMENTAL SCIENCES↗

CIS Project 22359, Final Technical Report. Discretized Posterior Approximation in High Dimensions

Our primary aim in this work is to understand how to efficiently obtain reliable uncertainty quantification in automatic learning algorithms with limited training datasets. Standard approaches rely on cross-validation to tune hyper parameters. Unfortunately, when our datasets are too small, holdout datasets become unreliable—albeit unbiased—measures of prediction quality due to the lack of adequate sample size. We should not place confidence in holdout estimators under conditions wherein the sample variance is both large and unknown. More poigniantly, our training experiments on limited data (Duersch and Catanach, 2021) show that even if we could improve estimator quality under these conditions, the typical training trajectory may never even encounter generalizable models.

97 MATHEMATICS AND COMPUTING↗

Developing Multi-Gene CRISPRa/I Programs to Accelerate DBTL Cycles in ABF Hosts Engineered for Chemical Production (CRADA 468)

Bacterial metabolism is comprised of large and complex gene networks that can produce valuable chemical products. Sophisticated organism engineering efforts are required to optimize production of high-value compounds from these networks. In principle, synthetic multi-gene transcriptional programs could be constructed to reengineer these networks for efficient industrial chemical production. In practice, however, our incomplete ability to understand and model the underlying networks, combined with our limited ability to predictably control the expression of multiple genes makes achieving this goal difficult. To overcome these challenges, we will combine new CRISPR-Cas multi-gene expression programs with computational modeling, machine learning, and multi-omics data to enhance the efficacy of design-build-test-learn (DBTL) cycles. For industrially promising microorganisms in early stages of development, creating technologies for rapidly engineering complex multi-gene programs could be transformative for accelerating data- and model-driven strain design. New CRISPR-Cas tools allow programmable gene activation (CRISPRa) or repression (CRISPRi) at multiple genes simultaneously, using the catalytically inactive Cas9 protein (dCas9) with guide RNAs that recognize DNA targets through predictable Watson-Crick base pairing. To enable accelerated DBTL cycles, we will combine these technologies with advanced Agile BioFoundry (ABF) capabilities for multi-omics data collection and machine learning. We will demonstrate the immediate applicability of these tools by rapidly improving the production of an industrial aromatic in multiple ABF organisms. We recently identified and optimized new transcriptional activators that can be linked to programmable CRISPR-Cas DNA binding domains to activate gene expression in E. coli. We can now use these CRISPRa tools as generalizable trans-acting regulators for combinatorial multi-gene expression tuning that can be easily transferred to new pathways and networks without additional genome engineering. We anticipate these tools will also transfer to new hosts. We have recently found that CRISPRa systems developed in E. coli can be readily ported to Pseudomonas putida, suggesting that multi-gene CRISPRa/i programs for diverse ABF organisms may be within reach.

59 BASIC BIOLOGICAL SCIENCES↗

Discovering new governing equations using ML

A hallmark of the scientific process since the time of Newton has been the derivation of mathematical equations meant to capture relationships between observables. As the field of mathematical modeling evolved, practitioners specifically emphasized mathematical formulations that were predictive, generalizable, and interpretable. Machine learning’s ability to interrogate complex processes is particularly useful for the analysis of highly heterogeneous, anisotropic materials where idealized descriptions often fail. As we move into this new era, we anticipate the need to leverage machine learning to aid scientists in extracting meaningful, but yet sometimes elusive, relationships between observed quantities.

97 MATHEMATICS AND COMPUTING↗

MIDAS: Modeling Individual Differences using Advanced Statistics

This research explores novel methods for extracting relevant information from EEG data to characterize individual differences in cognitive processing. Our approach combines expertise in machine learning, statistics, and cognitive science, advancing the state-of-the art in all three domains. Specifically, by using cognitive science expertise to interpret results and inform algorithm development, we have developed a generalizable and interpretable machine learning method that can accurately predict individual differences in cognition. The output of the machine learning method revealed surprising features of the EEG data that, when interpreted by the cognitive science experts, provided novel insights to the underlying cognitive task. Additionally, the outputs of the statistical methods show promise as a principled approach to quickly find regions within the EEG data where individual differences lie, thereby supporting cognitive science analysis and informing machine learning models. This work lays methodological ground work for applying the large body of cognitive science literature on individual differences to high consequence mission applications.

97 MATHEMATICS AND COMPUTING↗

Mirostructure Characterization of Friction Consolidated Copper-Nickel using a Machine Learning Approach: Developing Process to Microstructure Associations

Friction consolidation (FC) is a solid phase processing approach where discrete material forms such as powders, chips, nuggets, etc. are densified via shear deformation. The precursors are placed in a billet container and brought in contact with a rotating tool that applying the desirable amount of normal force. Under the combined action of the rotation and normal pressure, the discrete precursor is consolidated through porosity reduction and shear deformation. FC is increasingly being studied as an attractive approach to manufacturing fully dense parts from powder forms owing to its ability to mix, alloy and consolidate difficult-to-process precursors in minimal number of process steps. Material consolidation and deformation in shear consolidation processes have been studied extensively previously for different material combinations previously. However, despite the extensive research in this area, understanding of the mechanistic processes in pore consolidation, deformation-induced mixing and material solubility during FC is still evolving. Material development using solid phase processing approaches such as FC is often performed based on research experience/education, which can be biased. Conventional analysis and simulation tools in this area tend to be successful only when material thermodynamic pathways and microstructural evolution sequences resulting from processing are clearly defined or known. They are not as effective for emerging advanced manufacturing technologies where material evolution pathways are not well established. The ability to predict optimal process parameters based on material chemistry and bulk properties is essential to accelerate materials design and processing, as are an understanding of the relevant structure-processing-property relationships. These structure-processing-property-performance relationships are at the core of materials science research. Microstructure characterization provides the link to these four core areas, often through visualizing material microstructure using imaging techniques. However, linking microstructure image data (i.e., micrographs) to variables of interest (e.g., processing parameters, material chemistry) in a reproducible, generalizable, and quantitative manner is a significant challenge. Typically, quantitatively linking image data to processing history relies on significant domain knowledge and manual or subject matter expert (SME)-heuristic based image analysis. Such an approach to image analysis has the potential to be biased, inefficient, and difficult to replicate.

36 MATERIALS SCIENCE↗

Flexible FlueCO2

Carbon dioxide (CO2) emission reductions remain a significant challenge on the path to clean energy. There are increasing legislative, social, and environmental factors motivating CO2 emissions reduction from power plants with carbon capture and storage (CCS). CCS in natural gas combined cycle (NGCC) power plants is critical to achieve a net-zero carbon electricity grid. Enhanced 45Q tax credits provide new incentives, but currently available technologies are unable to profitably operate in grids with deep variable renewable penetration which require flexible NGCC operation. Luna Labs has developed the FlueCO2 membrane to enable a profitable NGCC-CCS process. The FlueCO2 membrane couples steam transport across the membrane to CO2 transport in the opposite direction, enabling high capture efficiencies and low energy costs even at low CO2 concentrations. The dual-phase membrane can operate in the range of typical flue gas temperatures and pressures and does not require temperature or pressure cycling. Luna Labs’ FlueCO2 technology enables flexible and profitable operation of NGCC plants with lower capital investment and impact on electricity prices. In this Phase 1 project, Luna Labs utilized experimental testing, modeling, process simulation, and standardized costing methodologies to evaluate the techno-economic value of a 650 MW greenfield NGCC plant with FlueCO2 (NGCC-FlueCO2). Key design requirements for operation were established and plant performance under load-leveling conditions was validated through computational fluid dynamics and process modeling. Luna Labs developed a dynamic modeling tool which modeled plant operational modes across a variety of tax structures and electricity pricing scenarios to project the overall Net Present Value (NPV) of the NGCC-FlueCO2. FlueCO2 minimizes the impact of CCS integration on plant operation by integrating directly into the NGCC heat recovery steam generator (HRSG). By tapping into the plant’s low-pressure (LP) steam, operators can divert LP steam to the greenfield NGCC and/or CCS process in response to dynamic markets. Since FlueCO2 will not significantly affect HRSG (or NGCC) operation, CCS only turns off during peak power demand (>$250/MWh). Under baseload conditions, FlueCO2 lowers the capital (37%), energy (36%) and carbon capture (<$40/tonne) costs and can increase the overall plant lifetime NPV by approximately ~$1B in comparison with NGCC solvent-based capture reference cases (NETL Case 31B). Luna Labs has shared its costing tools with several interested partners and customers, which follows a generalizable approach to costing analysis.

Kelly, Jesse↗

Electrochemical aptamer-based sensors: leveraging the sensing platform for minimally-invasive microneedle measurements and fundamental exploration of sensor biofouling dynamics

The ability to track the concentrations of specific molecules in the body in real time would significantly improve our ability to study, monitor, and respond to diseases. To achieve this, we require sensors that can withstand the complex environment inside the body. Electrochemical aptamer-based sensors are particularly promising for in vivo sensing, as they are among the only generalizable sensing technologies that can achieve real-time molecular monitoring directly in blood and the living body. In this project, we first focused on extending the application space of aptamer sensors to support minimally-invasive wearable measurements. To achieve this, we developed individually-addressable sensors with commercial off-the-shelf microneedles. We demonstrated sensor function in buffer, blood, and porcine skin (a common proxy for human skin). In addition to the applied sensing project, we also worked to improve fundamental understanding of the aptamer sensing platform and how it responds to biomolecular interferents. Specifically, we explored the interfacial dynamics of biofouling – a process impacting sensors placed in complex fluids, such as blood.

59 BASIC BIOLOGICAL SCIENCES↗

Review of In Situ Sensing for Directed Energy Deposition for Industrial Part Quality Assessment

As the use additive manufacturing (AM) processes continues to grow in critical industries, improved quality assurance methods are becoming increasingly sought after for qualification and certification of AM components. Traditional nondestructive evaluation of printed components is often unable to supply the required confidence in print quality to justify qualification and certification, but the layer-by-layer nature of AM provides unprecedented opportunities for in situ quality inspection. This document summarizes recent developments in process monitoring research specifically related to Directed Energy Deposition (DED). Particular attention is given to three aspects of the highlighted manuscripts: (1) the type of sensors used, (2) features extracted from each sensor modality, and (3) analysis of extracted features for AM quality assessment. Based on the review of the state-of-the-art, several observations have been made. First, none of the reviewed works have applied their trained models to real part geometries, with many of the works relying on single track experiments, thin-walled structures, and cubes. Similarly, there have not been any works demonstrating model generalizability, i.e., a model trained on data from one build allows for fruitful analysis of data from another build. Many works used machine learning techniques to distinguish different process regimes (i.e., normal, keyholing, lack-of-fusion), but very few papers have investigated stochastic variation in an already “optimized” process. Sensor fusion approaches are also limited in the DED sensing literature, but the few works that have employed such techniques have demonstrated the benefits. Finally, registration of in situ data to the build coordinate system is of paramount importance to producing industrially relevant in situ monitoring systems. Data registration allows direct correlations between process anomalies detected in the process monitoring data to localized departures in part quality, but such techniques are generally lacking in the current literature.

36 MATERIALS SCIENCE↗