Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model interpretability”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

Application of artificial intelligence methods in the international roughness index prediction of rigid and composite pavements: a systematic review

The International Roughness Index (IRI) is a widely adopted metric for quantifying pavement roughness, directly influencing vehicle safety, ride comfort, and overall roadway performance. In recent years, the use of Machine Learning (ML) models for IRI prediction has gained momentum, with the goal of improving the allocation of maintenance and rehabilitation resources by enabling accurate assessments of pavement conditions. Most prior reviews, however, have concentrated on flexible pavements, leaving a notable gap regarding rigid and composite pavements. To address this gap, the present study conducts a systematic review of Artificial Intelligence (AI) methods applied to IRI prediction for rigid and composite pavements. Literature published between 2004 and 2025 is synthesized to highlight prevailing trends, methodological contributions, and directions for future research. Particular attention is given to the types of models employed, the datasets used for training and validation, and the role of input variables and data-processing strategies. Across the included studies, ensemble learning methods (especially gradient boosting variants such as XGBoost), artificial neural networks, and hybrid architectures frequently achieved high predictive skill, with several models reporting test-set coefficients of determination approaching 0.9–0.96, indicating strong potential for capturing the influence of traffic, pavement structure, and climatic factors. Since these results are obtained from heterogeneous datasets and evaluation protocols, they are interpreted qualitatively rather than as strict cross-study rankings. Analysis of input variables revealed that pavement age and initial IRI were included in 91% (21 of 23) and 78% (18 of 23) of studies, respectively. Climatic variables such as the freezing index appeared in 57% (13 of 23), while traffic-related factors were considered in 65% (15 of 23). The findings underscore the importance of standardized, high-quality datasets, such as those from the Long-Term Pavement Performance (LTPP) program, along with data consistency, model interpretability, computational efficiency, and replicability in enhancing IRI prediction. Future research should focus on incorporating input variable selection techniques to identify the most influential predictors, thereby improving accuracy and robustness. Integrating these approaches with advanced non-linear data-driven models, coupled with robust hyperparameter optimization, holds considerable promise for strengthening the reliability of IRI prediction and supporting resilient pavement management strategies.

42 ENGINEERING↗

Assessing Impacts on Pressure Stabilization and Leasing Acreage for CO 2 Storage Utilizing Oil Migration Concepts

Favorable geological storage for CO 2 has long been pictured as large anticlines with thick sandstones, similar to oil reservoirs in the petroleum system. Unlike oil, however, stored CO 2 does not need to be recoverable, which raises the possibility of using dissolution and residual trapping to augment the capacity of buoyant traps and tap more of the bulk rock volume. The work presented builds on that idea, asking the following question: If we inject CO 2 down to a syncline – analogous to the carrier bed in the petroleum system – how would this injection mechanism impact storage capacity and plume shape, migration, and stabilization? To address this question, we built a reservoir model, based on seismic interpretation of Middle Miocene strata, offshore Galveston, Texas. 3-D seismic and well logs were used to characterize key intervals. Reservoirs chosen for modeling are progradational-aggradational sands with mud intercalation. They have a higher degree of heterogeneity than the more conventional reservoirs commonly targeted for CO 2 storage. Modeling investigated how far the CO 2 plume would migrate under two scenarios: (1) injecting CO 2 at the base of the salt withdrawal basin (syncline scenario) and (2) injecting CO 2 at the base of the structural closure, similar to a common injection well location for EOR purposes (base scenario). For each scenario, we separately simulated injection of 30 MT of CO 2 and 60 MT of CO 2 continuously for 30 years and observe the plume and pressure evolution for 100 years after the injection stops. The simulation shows that injecting the CO 2 into a syncline limits the vertical migration of CO 2 , thus making synclinal injection more secure. In the syncline scenario, the geological layer around the injection point is more heterogeneous than the layer in the base scenario; thus, the CO 2 tends to migrate laterally. Additionally, in the syncline scenario, the plume does not even reach the upper part of the anticline, allowing us to safely store an additional amount of CO 2 into the reservoir. Furthermore, the simulation also shows that in the syncline scenario, the times needed for the reservoir to reach its stabilized pressure after the end of injections are faster. To summarize, CO 2 injection at the base of a syncline could provide additional storage, increase the safety of the project from the limited vertical plume migration, and expedite plume stabilization, which could result in the decrease of monitoring frequency as the project runs, thus lowering the operating cost of the project in the long run.

58 GEOSCIENCES↗

Search for a light CP-odd Higgs boson decaying into a pair of τ -leptons in proton-proton collisions at $\sqrt{s}$ = 13 TeV with the ATLAS detector

This paper reports a search for a light CP-odd scalar resonance with a mass of 20 GeV to 90 GeV in 13 TeV proton-proton collision data with an integrated luminosity of 140 fb -1 collected with the ATLAS detector at the Large Hadron Collider. The analysis assumes the resonance is produced via gluon-gluon fusion and decays into a $τ^+ τ^-$ pair which subsequently decays into a fully leptonic $µ^+ ν_µ \overline{ν}_τ e^- \overline{ν}_ e ν_τ$ or $e^+ ν_e \overline{ν}_τ µ^- \overline{ν}_µ ν_τ$ final state. No significant excess of events above the predicted Standard Model background is observed. The results are interpreted within a favour-aligned two-Higgs-doublet model, and a model independent cross-section interpretation is also given. Upper limits at 95% confidence level between 3.0 pb and 68 pb are set on the cross-section for producing a CP-odd Higgs boson that decays into a $τ^+ τ^-$ pair.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Automatic Loss Factor Modeling and Attribution on Unlabeled PV Energy Data

We present a novel approach for modeling the loss factors of photovoltaic power generation systems (PV systems). This method is a white-box machine learning model built on convex optimization that is fast, interpretable, and auditable. It takes as an input the measured daily energy produced by the system, over a multi-year period, and returns a multiplicative decomposition model of the daily energy signal and full attribution of the total energy loss to each feature. The methods section of this paper has two major components: (1) the description of the signal decomposition (SD) model, expressed in the SD framework, and (2) the attribution of total energy losses via Shapley values. We validate the method on synthetic and open-source data sets and compare to similar methods from the literature.

artificial intelligence↗

Survival analysis of localized prostate cancer with deep learning

In recent years, data-driven, deep-learning-based models have shown great promise in medical risk prediction. By utilizing the large-scale Electronic Health Record data found in the U.S. Department of Veterans Affairs, the largest integrated healthcare system in the United States, we have developed an automated, personalized risk prediction model to support the clinical decision-making process for localized prostate cancer patients. This method combines the representative power of deep learning and the analytical interpretability of parametric regression models and can implement both time-dependent and static input data. To collect a comprehensive evaluation of model performances, we calculate time-dependent C-statistics C td over 2-, 5-, and 10-year time horizons using either a composite outcome or prostate cancer mortality as the target event. The composite outcome combines the Prostate-Specific Antigen (PSA) test, metastasis, and prostate cancer mortality. Our longitudinal model Recurrent Deep Survival Machine (RDSM) achieved C td 0.85 (0.83), 0.80 (0.83), and 0.76 (0.81), while the cross-sectional model Deep Survival Machine (DSM) attained C td 0.85 (0.82), 0.80 (0.82), and 0.76 (0.79) for the 2-, 5-, and 10-year composite (mortality) outcomes, respectively. In addition to estimating the survival probability, our method can quantify the uncertainty associated with the prediction. The uncertainty scores show a consistent correlation with the prediction accuracy. We find PSA and prostate cancer stage information are the most important indicators in risk prediction. Our work demonstrates the utility of the data-driven machine learning model in prostate cancer risk prediction, which can play a critical role in the clinical decision system.

60 APPLIED LIFE SCIENCES↗

Revisiting Reentry Roll Resonance

Here, this paper revisits the subject of reentry roll resonance, which occurs when the roll rate and pitch frequency become equal in a spinning reentry vehicle. A first-principles model is developed and analyzed numerically and by using a reduced-order pendulum model for the relative phase of the roll and pitch/yaw axes. The results show good qualitative agreement with recent flight data and provide a natural physical interpretation. Based on the model it is suggested that sustained roll resonance depends primarily on the initial phase relationship between the pitch and roll axes, in addition to the vehicle moments of inertia and the vehicle symmetry. Finally the model is used to propose a mechanism for sustained resonance in vehicles spinning about a major axis, a condition previously thought to be forbidden.

33 ADVANCED PROPULSION SYSTEMS↗

Model fusion with physics-guided machine learning: Projection-based reduced-order modeling

The unprecedented amount of data generated from experiments, field observations, and large-scale numerical simulations at a wide range of spatiotemporal scales has enabled the rapid advancement of data-driven and especially deep learning models in the field of fluid mechanics. Although these methods are proven successful for many applications, there is a grand challenge of improving their generalizability. This is particularly essential when data-driven models are employed within outer-loop applications like optimization. In this work, we put forth a physics-guided machine learning (PGML) framework that leverages the interpretable physics-based model with a deep learning model. Leveraging a concatenated neural network design from multi-modal data sources, the PGML framework is capable of enhancing the generalizability of data-driven models and effectively protects against or inform about the inaccurate predictions resulting from extrapolation. We apply the PGML framework as a novel model fusion approach combining the physics-based Galerkin projection model and long- to short-term memory (LSTM) network for parametric model order reduction of fluid flows. We demonstrate the improved generalizability of the PGML framework against a purely data-driven approach through the injection of physics features into intermediate LSTM layers. Our quantitative analysis shows that the overall model uncertainty can be reduced through the PGML approach, especially for test data coming from a distribution different than the training data. Moreover, we demonstrate that our approach can be used as an inverse diagnostic tool providing a confidence score associated with models and observations. The proposed framework also allows for multi-fidelity computing by making use of low-fidelity models in the online deployment of quantified data-driven models.

42 ENGINEERING↗

Linking transportation agent-based model ($\mathrm{ABM}$) outputs with micro-urban social types ($\mathrm{MUSTs}$) via typology transfer for improved community relevance

The human relationship with transportation is shaped by social, economic, demographic, and urban form variables, or socio-spatial factors. The spatial dynamics of these are key to generating and interpreting outputs of transportation models that are most relevant for a community and the diverse mobility needs of its members. Here we present a typology transfer framework, grounded in socio-spatial dynamics shaping people's mobility, to take transportation-themed regional mobility model outcomes, in this case from two agent-based models (ABMs), and extrapolate them to other cities, with less time and resource intensity than new ABM development. The typology transfer process first identifies micro-urban social types (MUSTs) using socio-spatial factors, then defines city types based on spatial patterns of MUSTs to assess across which cities transfer results are likely to best hold. Lastly, a typology transfer multiplier matrix extrapolates a given variable, in our case the Mobility Energy Productivity (MEP) metric, to another city. The full process demonstration uses ABM results from Chicago (POLARIS model) and San Francisco (BEAM model), applying them to New York City. We discuss how MEP or other outputs can be appropriately estimated and used for integrated, human-centered mobility analysis. Key findings include that this MUST framework of user-defined dependent and independent variables allows tailoring ABM results and interpretations to specific community needs and data availability. Findings clarify that positive outcomes can be targeted towards user groups, based on sociospatial characteristics, using a typology approach, such as inclusive access to mobility choices, transportation affordability, and greater efficiency in resource use.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Harnessing Neural Networks for Elucidating X-ray Absorption Structure–Spectrum Relationships in Amorphous Carbon

Improved understanding of structural and chemical properties through local experimental probes, such as X-ray absorption near-edge structure (XANES) spectroscopy, is crucial for the understanding and design of functional materials. In recent years, significant advancements have been made in the development of data science approaches for the automated interpretation of XANES structure–spectrum relationships. However, existing studies have primarily focused on crystalline solids and small molecules, while fewer efforts have been devoted to disordered systems. Thus, in this work, we demonstrate the development of neural network models for predicting and interpreting XANES spectra of amorphous carbon (a-C) from local structural descriptors. Comparison between different structural descriptors expectedly shows that the inclusion of both bond length and bond angle information is necessary for an accurate prediction of the spectra. Among the descriptors considered in this work, we find that the local many-body tensor representation yields the highest accuracy and greatest interpretability so that it can be leveraged to understand the importance of structural motifs in determining XANES spectra. Furthermore, we also discuss performance of neural network models for predicting both local structure features, such as bond lengths and bond angles, and global chemical composition, such as the sp:sp 2 :sp 3 ratio.

36 MATERIALS SCIENCE↗

Interpretable Deep Learning for Advancing Field-Enhanced Catalysis

This DOE Early Career project developed a physics-informed, interpretable AI-and-modeling framework to understand and exploit electric-field effects in heterogeneous catalysis, with ammonia cracking and synthesis as a representative pathway. The team built and validated methods to map local electric fields on metal surfaces and nanoparticles, showing that low-coordination features (tips/edges/corners) can concentrate fields by several-fold relative to flat facets. Using DFT-generated datasets, the project created physics-guided machine learning models that rapidly predict local electric fields and field-dependent adsorption energetics with near-DFT accuracy while reducing computational cost by orders of magnitude. These predictions were integrated with microkinetic modeling to quantify how field-dipole interactions reshape reaction energetics and mechanisms, enabling large increases in predicted catalytic rates and substantial reductions in operating temperature under favorable field conditions. To accelerate discovery of earth-abundant catalysts, the project combined interpretable ML screening (with electronic-structure descriptors identified as key drivers) with a generative inverse-design workflow based on diffusion models and physics constraints. The resulting closed-loop approach, linking simulation, mechanistic modeling, and AI, provides reusable tools and datasets for designing catalysts and operating conditions in field-enhanced catalysis, with broad relevance to electrostatic catalysis, plasma catalysis, electrocatalysis, and other energy-related chemical transformations.

30 DIRECT ENERGY CONVERSION↗

Search for pair production of squarks or gluinos decaying via sleptons or weak bosons in final states with two same-sign or three leptons with the ATLAS detector

A search for pair production of squarks or gluinos decaying via sleptons or weak bosons is reported. The search targets a final state with exactly two leptons with same-sign electric charge or at least three leptons without any charge requirement. The analysed data set corresponds to an integrated luminosity of 139 fb –1 of proton-proton collisions collected at a centre-of-mass energy of 13 TeV with the ATLAS detector at the LHC. Multiple signal regions are defined, targeting several SUSY simplified models yielding the desired final states. A single control region is used to constrain the normalisation of the WZ + jets background. No significant excess of events over the Standard Model expectation is observed. The results are interpreted in the context of several supersymmetric models featuring R-parity conservation or R-parity violation, yielding exclusion limits surpassing those from previous searches. In models considering gluino (squark) pair production, gluino (squark) masses up to 2.2 (1.7) TeV are excluded at 95% confidence level.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Search for dark photons in Higgs boson production via vector boson fusion in proton-proton collisions at $ \sqrt{s} $ = 13 TeV

A search is presented for a Higgs boson that is produced via vector boson fusion and that decays to an undetected particle and an isolated photon. The search is performed by the CMS collaboration at the LHC, using a data set corresponding to an integrated luminosity of 130 fb$^{−1}$, recorded at a center-of-mass energy of 13 TeV in 2016–2018. No significant excess of events above the expectation from the standard model background is found. The results are interpreted in the context of a theoretical model in which the undetected particle is a massless dark photon. An upper limit is set on the product of the cross section for production via vector boson fusion and the branching fraction for such a Higgs boson decay, as a function of the Higgs boson mass. For a Higgs boson mass of 125 GeV, assuming the standard model production rates, the observed (expected) 95% confidence level upper limit on the branching fraction is 3.5 (2.8)%. This is the first search for such decays in the vector boson fusion channel. Combination with a previous search for Higgs bosons produced in association with a Z boson results in an observed (expected) upper limit on the branching fraction of 2.9 (2.1)% at 95% confidence level.[graphic not available: see fulltext]

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Keeping it simple: simplified frameworks for long-lived particles at neutrino facilities

Modern-day accelerator neutrino facilities are excellent venues for searches for new-physics particles. Many distinct new-physics models predict overlapping signatures and phenomenology in these experiments. In this work, we advocate for the adoption of simplified frameworks when studying these types of new-physics signatures, which are characterized by a small number of primary variables, including particle masses, lifetimes, and production and decay modes/rates that most directly control signal event rates and kinematics. In particular, taking the example of long-lived particles that decay inside a neutrino detector as a test case, we study formulate and study simplified frameworks in the context of light scalars/fermions produced in kaon decays which then decay into final states containing an electron-positron pair. We show that using these simplified frameworks can allow for individual experimental analyses to be applicable to a wide variety of specific model scenarios. As a side benefit, we demonstrate that using this approach can allow for the T2K collaboration, by reinterpreting its search for Heavy Neutral Leptons, to be capable of setting world-leading limits on the Higgs-Portal Scalar model. Furthermore, we argue the simplified framework interpretation can serve as a bridge to model identification in the hopeful detection of a new-physics signal. As an illustration, we perform a first determination of the likelihood that, in the presence of a new-physics signal in a detector like the DUNE ND-GAr, multiple different new-physics hypotheses (such as the Higgs-Portal Scalar and Heavy Neutral Lepton ones) can be disentangled. We demonstrate that this model discrimination is favorable for some portions of detectable new-physics parameter space but for others, it is more challenging.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Search for dark matter in events with missing transverse momentum and a Higgs boson decaying into two photons in pp collisions at $$ \sqrt{s} $$ = 13 TeV with the ATLAS detector

A search for dark-matter particles in events with large missing transverse momentum and a Higgs boson candidate decaying into two photons is reported. The search uses 139 fb - 1 of proton-proton collision data collected at $$ \sqrt{s} $$ s = 13 TeV with the ATLAS detector at the CERN LHC between 2015 and 2018. No significant excess of events over the Standard Model predictions is observed. The results are interpreted by extracting limits on three simplified models that include either vector or pseudoscalar mediators and predict a final state with a pair of dark-matter candidates and a Higgs boson decaying into two photons.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Skin factor and potential formation damage from chemical and mechanical processes in a naturally fractured carbonate aquifer with implications to CO 2 sequestration

Here, in this study, we investigate formation damage due to acidization and water injection tests into the naturally fractured carbonate Middle Duperow Formation at Kevin Dome, Montana, potentially diminishing the chance of a future successful Geological Carbon Sequestration (GCS) project. Multiple well-test analytical models, correlated with core description and lithology data, are used to determine flow behavior and communication between the water injection interval and surrounding formations. An improved three-dimensional (3D) geologic model with dual-continuum matrix and fracture properties is constructed based on most recent seismic, core, and water sample measurements. Brine injection is simulated to verify the interpretation from the analytical models, followed by CO 2 injection simulation. Geochemical calculations are performed to understand the in-situ processes that led to formation damage. Our findings suggest: (1) there are two possible scenarios that could lead to a positive total effective skin factor and permeability decline: partial penetration and formation damage; (2) analytical models indicate a positive total skin factor, contradicting results of a previous study suggesting that the well was mildly stimulated; (3) numerical simulation supports the formation damage hypothesis by matching the pressure buildup observed during the latter two brine injection tests; (4) several mechanical and chemical processes may have occurred during injection to clog the matrix/fracture system: anhydrite fines migration and/or calcite precipitation. We then make preventative suggestions for future GCS projects into carbonate reservoirs and remediation recommendations for GCS operation at the Kevin Dome.

54 ENVIRONMENTAL SCIENCES↗

Physics-informed, empirically constrained machine learning for designing Fe-9Cr alloys

<span style="font-family: Calibri, sans-serif; font-size: 12pt;">Materials data analytics can be used to significantly shorten development time of specialized alloys needed for next generation energy applications. Incorporation of the domain knowledge into deep-learning graph structure via fuzzy pre-training and causal process imitation presents a viable approach to developing accurate data-driven models and reliable alloy design tools, with limited datasets. It was demonstrated that the domain knowledge-based empirical constraints not only inhibit overfitting but also allow training more accurate and reliable ML models with improved transparency of the output interpretation. In this study, alloy tensile properties were interpreted with three competing virtual-microstructure models.</span>

Romanov, Vyacheslav↗

Deciphering enhancer sequence using thermodynamics-based models and convolutional neural networks

Abstract Deciphering the sequence-function relationship encoded in enhancers holds the key to interpreting non-coding variants and understanding mechanisms of transcriptomic variation. Several quantitative models exist for predicting enhancer function and underlying mechanisms; however, there has been no systematic comparison of these models characterizing their relative strengths and shortcomings. Here, we interrogated a rich data set of neuroectodermal enhancers in Drosophila, representing cis- and trans- sources of expression variation, with a suite of biophysical and machine learning models. We performed rigorous comparisons of thermodynamics-based models implementing different mechanisms of activation, repression and cooperativity. Moreover, we developed a convolutional neural network (CNN) model, called CoNSEPT, that learns enhancer ‘grammar’ in an unbiased manner. CoNSEPT is the first general-purpose CNN tool for predicting enhancer function in varying conditions, such as different cell types and experimental conditions, and we show that such complex models can suggest interpretable mechanisms. We found model-based evidence for mechanisms previously established for the studied system, including cooperative activation and short-range repression. The data also favored one hypothesized activation mechanism over another and suggested an intriguing role for a direct, distance-independent repression mechanism. Our modeling shows that while fundamentally different models can yield similar fits to data, they vary in their utility for mechanistic inference. CoNSEPT is freely available at: https://github.com/PayamDiba/CoNSEPT.

59 BASIC BIOLOGICAL SCIENCES↗

Importance of Engineered and Learned Molecular Representations in Predicting Organic Reactivity, Selectivity, and Chemical Properties

Machine-readable chemical structure representations are foundational in all attempts to harness machine learning for the prediction of reactivities, selectivities, and chemical properties directly from molecular structure. The featurization of discrete chemical structures into a continuous vector space is a critical phase undertaken before model selection, and the development of new ways to quantitatively encode molecules is an active area of research. Here, we highlight the application and suitability of different representations, from expert-guided “engineered” descriptors to automatically “learned” features, in different prediction tasks relevant to organic and organometallic chemistry, where differing amounts of training data are available. These tasks include statistical models of stereo- and enantioselectivity, thermochemistry, and kinetics developed using experimental and quantum chemical data. The use of expert-guided molecular descriptors provides an opportunity to incorporate chemical knowledge, domain expertise, and physical constraints into statistical modeling. In applications to stereoselective organic and organometallic catalysis, where data sets may be relatively small and 3D-geometries and conformations play an important role, mechanistically informed features can be used successfully to obtain predictive statistical models that are also chemically interpretable. We provide an overview of several recent applications of this approach to obtain quantitative models for reactivity and selectivity, where topological descriptors, quantum mechanical calculations of electronic and steric properties, along with conformational ensembles, all feature as essential ingredients of the molecular representations used. Alternatively, more flexible, general-purpose molecular representations such as attributed molecular graphs can be used with machine learning approaches to learn the complex relationship between a structure and prediction target. This approach has the potential to out-perform more traditional representation methods such as “hand-crafted” molecular descriptors, particularly as data set sizes grow. One area where this is particularly relevant is in the use of large sets of quantum mechanical data to train quantitative structure–property relationships. A general approach toward curating useful data sets and training highly accurate graph neural network models is discussed in the context of organic bond dissociation enthalpies, where this strategy outperforms regression using precomputed descriptors. Finally, we describe how graph neural network predictions can be incorporated into mechanistically informed statistical models of chemical reactivity and selectivity. Once trained, this approach avoids the expensive computational overhead associated with quantum mechanical calculations, while maintaining chemical interpretability. We illustrate examples for which fast predictions of bond dissociation enthalpy and of the identities of radicals formed through cleavage of a molecule’s weakest bond are used in simple physical models of site-selectivity and reactivity.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗