Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model interpretability”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,045 records · Page 58

Scaling laws in jet classification

We demonstrate the emergence of scaling laws in the benchmark top versus QCD jet classification problem in collider physics. Six distinct physically-motivated classifiers exhibit power-law scaling of the binary cross-entropy test loss as a function of training set size, with distinct power law indices. This result highlights the importance of comparing classifiers as a function of dataset size rather than for a fixed training set, as the optimal classifier may change considerably as the dataset is scaled up. We speculate on the interpretation of our results in terms of previous models of scaling laws observed in natural language and image datasets.

Batson, Joshua↗

Multitask Recommender Systems for Cancer Drug Response

The problem we are currently trying to address is that there are many types of cancer drugs and many types of cancers and there is not always experimental data for a specific cancer type and cancer drug interaction. While there is a large possible set of feasible drug and cancer combinations, testing each pair is not realistic due to the high monetary cost of cell-based assays. Thus, this leaves researchers with a difficult choice of what drugs they should test on specific cancer types. This issue is known as the cold-start problem. Our focus is on developing recommender systems capable of addressing the cold-start problem as it relates to interaction between cancer types and cancer drugs. One of the most effective ways to address the cold-start problem is through large data analysis, however due to the cost prohibitive nature of cancer research the largest available data set size is the Genomics of Drug Sensitivity in Cancer with 494,973 genomic associations. To achieve optimal model performance on the cold-start problem, it is advantageous to employ multitask algorithms that are capable of transferring information between cancer datasets. The aim of this report is to draw from adaptations and state of the art developments in both algorithms for recommender systems and multitask learning to model the interaction between cancer cell lines and cancer drugs. Cancer cell lines are defined by the US National Cancer Institute as "cancer cells that keep dividing and growing over time, under certain conditions in a laboratory". This paper will focus on evaluating the performance of Neural Collaborative Filtering and Gaussian Processes, as well as their multitask adaptations, on cancer datasets from CCLE, NCI60, GDSC and CTRP. These methods will be evaluated on model performance in regression prediction but also in interpretability.

60 APPLIED LIFE SCIENCES↗

Model-Form Epistemic Uncertainty Quantification for Modeling with Differential Equations: Application to Epidemiology

Modeling real-world phenomena to any degree of accuracy is a challenge that the scientific research community has navigated since its foundation. Lack of information and limited computational and observational resources necessitate modeling assumptions which, when invalid, lead to model-form error (MFE). The work reported herein explored a novel method to represent model-form uncertainty (MFU) that combines Bayesian statistics with the emerging field of universal differential equations (UDEs). The fundamental principle behind UDEs is simple: use known equational forms that govern a dynamical system when you have them; then incorporate data-driven approaches – in this case neural networks (NNs) – embedded within the governing equations to learn the interacting terms that were underrepresented. Utilizing epidemiology as our motivating exemplar, this report will highlight the challenges of modeling novel infectious diseases while introducing ways to incorporate NN approximations to MFE. Prior to embarking on a Bayesian calibration, we first explored methods to augment the standard (non-Bayesian) UDE training procedure to account for uncertainty and increase robustness of training. In addition, it is often the case that uncertainty in observations is significant; this may be due to randomness or lack of precision in the measurement process. This uncertainty typically manifests as “noisy” observations which deviate from a true underlying signal. To account for such variability, the NN approximation to MFE is endowed with a probabilistic representation and is updated using available observational data in a Bayesian framework. By representing the MFU explicitly and deploying an embedded, data-driven model, this approach enables an agile, expressive, and interpretable method for representing MFU. In this report we will provide evidence that Bayesian UDEs show promise as a novel framework for any science-based, data-driven MFU representation; while emphasizing that significant advances must be made in the calibration of Bayesian NNs to ensure a robust calibration procedure.

97 MATHEMATICS AND COMPUTING↗

Application of Machine Learning Algorithms to Identify Problematic Nuclear Data

In this work we aim to show that Machine learning algorithms are promising tools for the identification of nuclear data that contribute to increased errors in transport simulations. We demonstrate this through an application of a machine learning algorithm (Random Forest) to the Whisper/MCNP6 criticality validation library to identify nuclear data that are associated with an increase of the bias (simulated - experimental $k_{eff}$) in the calculations. Specifically, the $k_{eff}$ sensitivity profiles (w.r.t. nuclear data) of 233 U solution benchmarks are used to predict the bias and Shapley Additive Explanations (SHAP) are used to explain how the sensitivities are related to the predicted bias. The SHAP values can be interpreted as sensitivity coefficients of the machine learning model to the $k_{eff}$ sensitivities which are used to make predictions of bias. Using the SHAP values we can identify specific subsets of nuclear data which have the highest probability of influencing bias. We demonstrate the utility of this method by showing how SHAP values were used to identify an inconsistency in the 19 F inelastic scattering nuclear data. The methodology presented here is not limited to transport problems and can be applied to other simulations if there are experimental measurements to compare against, simulations of those experimental measurements, and the ability to calculate sensitivities of the model output with respect to the data inputs.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Hyaloscypha finlandica Metabolome Repository

This repository provides the curated data tables, manuscript figure and table exports, dependency records, and workflow scripts supporting an integrated comparative genomics and untargeted LC-MS/MS metabolomics analysis of Hyaloscypha finlandica strain PMI 746, a root-associated dark septate endophyte of poplar. The repository includes genome-mining summaries from antiSMASH, FunBGCeX, BGC-Prophet, and BiG-SCAPE; processed metabolomics inputs; metabolite annotation evidence; statistical outputs; and publication-facing figures and tables. Raw LC-MS/MS spectra, full genome/protein downloads, and large generated tool outputs are referenced through public archive/accession records and are not stored in Git.

59 BASIC BIOLOGICAL SCIENCES↗

The Molecular Structures of Liquid and Glassy Nifedipine and Felodipine and Their Incorporation into PVP

Background: Amorphous drug formulations are commonly used to improve the solubility and bioavailability of poorly soluble molecular pharmaceuticals, yet less is known about their molecular conformations and local bonding interactions than their crystalline phases. Methods: High-energy X-ray diffraction structure factor measurements have been made on liquid and glassy nifedipine (NIF), felodipine (FEL), NIF 1:3 polyvinylpyrrolidone (PVP), and FEL 1:3 PVP wt.% mixtures. The corresponding X-ray pair distribution functions have been interpreted using empirical potential structure refinement using different models and density functional theory conformer calculations. Results: In both NIF and FEL, the NH···O inter-molecular hydrogen bonds between the pyridyl nitrogen and ester carbonyls are found to be considerably weaker than those observed in the crystalline polymorphs. For nifedipine, it is proposed that either inter-molecular NH…ON nitro bonds are present and/or a fraction (<20%) of conformational changes, with the aryl ring flipped, occur in the liquid state. For felodipine, the models indicate significant disorder associated with the methyl and ethyl side chains in the liquid state, with the main peak intensity at 3.0 Å arising from intra-molecular Cl-Cl atom pairs. When nifedipine molecules are incorporated into PVP, our models show they possess stronger NH···O bonds to the PVP polymer than felodipine molecules, which have stronger affinity for bonding to the polymer than to other felodipine molecules. Conclusions: The amorphous forms of both NIF and FEL show much weaker hydrogen bonding than found in their crystalline phases. Liquid NIF also exhibits configurations which are not observed in the crystal phases.

Amorphous Solid Dispersion↗

Phase-curve Pollution of Exoplanet Transit Depths

The next generation of space telescopes will enable transformative science to understand the nature and origin of exoplanets. In particular, transit spectroscopy will reveal the chemical composition of the exoplanet atmospheres with unprecedented detail thanks to precise measurements of the visible-to-infrared transit depths down to 10 parts per million. Such a level of instrumental precision raises the challenge to obtain even more precise astrophysical models so as not to significantly influence the interpretation of the observed data. We must therefore critically revisit some of the commonly accepted assumptions that were adequate for analyzing past and current observations. A common approximation in the analysis of exoplanetary primary transits is that the planet does not contribute to the recorded flux, so-called dark planet hypothesis. In this paper, we investigate the impact of the dark planet hypothesis on the parameters obtained from the analysis of transits with particular attention to the transit depth. We develop mathematical formulae and release new software to estimate the magnitude of the potential bias. These tools will be useful in the preparation of observing proposals, as well as within the scientific consortia of the James Webb Space Telescope (JWST) and the Atmospheric Remote-sensing Infrared Exoplanet Large-survey (ARIEL) missions. We probe the accuracy of the mathematical formulae through the analysis of synthetic observations with the JWST Mid-InfraRed Instrument. We find that self-blending from nightside emission attenuates the transit depth by >3σ for some of the known exoplanet systems, in agreement with previous work. An additional unreported effect caused by the nightside rotating into view can also impart a significant effect, but in the opposite direction (increasing the transit depth); this effect can largely be removed with conventional detrending practices, at the expense of a slight increase in noise, and mixing astrophysical variations and instrumental drifts.

79 ASTRONOMY AND ASTROPHYSICS↗

Constraining aerosol–cloud adjustments by uniting surface observations with a perturbed parameter ensemble

Abstract. Aerosol–cloud interactions (ACIs) are the largest source of uncertainty in inferring the magnitude of future warming consistent with the observational record. The effective radiative forcing due to ACI (ERFaci) is dominated by liquid clouds and is composed of two terms: the change in cloud albedo due to redistributing liquid over a larger number of cloud droplets (Nd) and the change in cloud macrophysical properties due to changes in cloud microphysics. These terms are, respectively, referred to as the radiative forcing due to ACI (RFaci) and aerosol–cloud adjustments. While the magnitude of RFaci is uncertain, its sign is confidently negative and results in a cooling in the historical record. In contrast, the adjustment of cloud liquid water path (LWP) to enhanced Nd and associated radiative forcing is uncertain in sign. Increased LWP in response to increased Nd is consistent with precipitation suppression, while decreased LWP in response to increased Nd is consistent with enhanced evaporation from cloud top. Observational constraints of these processes are poor in part because of causal ambiguity in the relationship between Nd and LWP. To better understand this relationship, precipitation (P), Nd, and LWP surface observations from the Eastern North Atlantic (ENA) atmospheric observatory are combined with the output from a perturbed parameter ensemble (PPE) hosted in the Community Atmosphere Model version 6 (CAM6). This allows for causal interpretation of observed covariability. Observations of precipitation and cloud from ENA constrain the range of possible LWP aerosol–cloud adjustments relative to the prior from the PPE by 15 %, resulting in a global value that is confidently positive (a historical cooling) ranging from 2.1 to 6.9 g m−2. It is found that observed covariability between Nd and LWP is dominated by coalescence scavenging and that this observed covariability is not strongly related to aerosol–cloud adjustments.

54 ENVIRONMENTAL SCIENCES↗

Replication Data for: Deconstructing Chirality: Probing Local and Non-local Effects in Azobenzene Derivatives with X-ray Circular Dichroism

Resolving molecular chirality at the atomic scale remains a critical challenge in chemistry. Conventional Optical Circular Dichroism spectroscopy often overlooks subtle and localized structural features. Here, we computationally investigate site-specific X-ray Circular Dichroism (XCD) across a series of trans-azobenzene derivatives to deconstruct and interpret chiroptical signals at the atomic level. Our modeling reveals that XCD is capable of distinguishing dichroic contributions arising from both a local chiral center and global molecular twist, revealing their intricate interplay and potential for constructive or destructive interference. We show that sterically-induced global distortions can dominate the XCD signal in some cases, even suppressing the response from the chiral center itself. This insight suggests a new molecular design principle for tuning chiroptical activity, which we extend by proposing strategies to achieve unidirectional photoisomerization through steric gearing. Altogether, this work establishes a quantitative framework for engineering chiroptical responses, laying the foundation for the design of functional chiral systems utilizing principles of unidirectional molecular motor-like conformational dynamics.

Chemistry↗

Effective Field Theory Analysis of CDMSlite Run 2 Data

CDMSlite Run 2 was a search for weakly interacting massive particles (WIMPs) with a cryogenic 600 g Ge detector operated in a high-voltage mode to optimize sensitivity to WIMPs of relatively low mass from 2 - 20 GeV/$c^2$. In this article, we present an effective field theory (EFT) analysis of the CDMSlite Run 2 data using an extended energy range and a comprehensive treatment of the expected background. A binned likelihood Bayesian analysis was performed on the recoil energy data, taking into account the parameters of the EFT interactions and optimizing the data selection with respect to the dominant background components. Energy regions within 5$\sigma$ of known activation peaks were removed from the analysis. The Bayesian evidences resulting from the different operator hypotheses show that the CDMSlite Run 2 data are consistent with the background-only models and do not allow for a signal interpretation assuming any additional EFT interaction. Consequently, upper limits on the WIMP mass and coupling-coefficient amplitudes and phases are presented for each EFT operator. These limits improve previous CDMSlite Run 2 bounds for WIMP masses above 5 GeV/$c^2$.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Quantitative Power System Resilience Metrics and Evaluation Approach: Preprint

Power system resilience is an emerging topic and plays an essential role in helping power industry understand and respond to the increasing threats of extreme weather events. The first step of power system resilience analysis is to introduce metrics to quantify the resilience reasonably. Existing resilience metrics are typically restrained by the limited data for extreme event modeling and fall short in terms of physical interpretation and comparability. This paper develops novel quantitative metrics to evaluate power system resilience in pre- and post-event contexts. The developed metrics illustrate clear physical meanings and can be effectively used to compare resilience across different systems under different extreme events. Moreover, the developed metrics can be applied to both transmission and distribution systems. Simulation on a distribution system is employed to validate the effectiveness of the proposed resilience metrics and resilience evaluation approach.

power system resilience↗

Role of Ocean and Atmosphere Variability in Scale-Dependent Thermodynamic Air-Sea Interactions

This study investigates the influence of oceanic and atmospheric processes in extratropical thermodynamic air-sea interactions resolved by satellite observations (OBS) and by two climate model simulations run with eddy-resolving high-resolution (HR) and eddy-parameterized low-resolution (LR) ocean components. Here, in this work, spectral methods are used to characterize the sea surface temperature (SST) and turbulent heat flux (THF) variability and co-variability over scales between 50 and 10,000 km and 60 days to 80 years in the Pacific Ocean. The relative roles of the ocean and atmosphere are interpreted using a stochastic upper-ocean temperature evolution model forced by noise terms representing intrinsic variability in each medium, defined using climate model data to produce realistic rather than white spectral power density distributions. The analysis of all datasets shows that the atmosphere dominates the SST and THF variability over zonal wavelengths larger than ~2,000–2,500 km. In HR and OBS, ocean processes dominate the variability of both quantities at scales smaller than the atmospheric first internal Rossby radius of deformation (R 1 , ~600–2,000 km) due to a substantial ocean forcing coinciding with a weaker atmospheric modulation of THF (and consequently of SST) than at larger scales. The ocean forcing also induces oscillations in SST and THF with periods ranging from intraseasonal to multidecadal, reflecting a red spectrum response to ocean forcing similar to that driven by atmospheric forcing. Such features are virtually absent in LR due to a weaker ocean forcing relative to HR.

54 ENVIRONMENTAL SCIENCES↗

An Experimental Kinetics Study of Isopropanol Pyrolysis and Oxidation behind Reflected Shock Waves

Isopropanol has potential as a future bio-derived fuel and is a promising substitute for ethanol in gasoline blends. Even so, little has been done in terms of high-temperature chemical kinetic speciation studies of this molecule. To this end, experiments were conducted in a shock tube using simultaneous CO and H2O laser absorption measurements. Water and CO formation during isopropanol pyrolysis was also examined at temperatures between 1127 and 2162 K at an average pressure of 1.42 atm. Species profiles were collected at temperatures between 1332 and 1728 K and at an average pressure of 1.26 atm for equivalence ratios of 0.5, 1.0, and 2.0 in highly diluted mixtures of 20% helium and 79.5% argon. Species profiles were also compared to four modern C3 alcohol mechanisms, including the impact of recent rate constant measurements. The Li et al. (2019) and Saggese et al. (2021) models both best predict CO and water production under pyrolysis conditions, while the AramcoMech 3.0 and Capriolo and Konnov models better predict the oxidation experimental profiles. Additionally, previous studies have collected ignition delay time (τign) data for isopropanol but are limited to low pressures in highly dilute mixtures. Therefore, real fuel–air experiments were conducted in a heated shock tube with isopropanol for stoichiometric and lean conditions at 10 and 25 atm between 942 and 1428 K. Comparisons to previous experimental results highlight the need for real fuel–air experiments and proper interpretation of shock-tube data. The AramcoMech 3.0 model over predicts τign values, while the Li et al. model severely under predicts τign. The models by Capriolo and Konnov and Saggese et al. show good agreement with experimental τign values. A sensitivity analysis using these two models highlights the underlying chemistry for isopropanol combustion at 25 atm. Additionally, modifying the Li et al. model with a recently measured reaction rate shows improvement in the model’s ability to predict CO and water profiles during dilute oxidation. Finally, a regression analysis was performed to quantify τign results from this study.

09 BIOMASS FUELS↗

On the role of symmetry in quenching OH tunneling in 2,6-dimethylphenol

Here, we model the spectroscopy of the two methyl torsional degrees of freedom coupled to the OH torsional motion in 2,6-dimethylphenol. Recent gas-phase rotational transitions [Welsh et al ., J. Phys. Chem. Lett. 17 , 3749–3758 (2026)] have been interpreted to be the result of certain symmetry states of the methyl groups leading to the quenching of the OH torsional motion. Both a three-dimensional model and an adiabatic model, in which the OH torsion is treated as the slow mode, are developed to test these conjectures. Good agreement is found between the exact and approximate adiabatic models. The adiabatic model is developed to interpret and elucidate the key couplings leading to the quenching of the tunneling splitting.

Sibert, III, Edwin L. [Univ. of Wisconsin, Madison↗

Imaginary-time correlation function thermometry: A new, high-accuracy and model-free temperature analysis technique for x-ray Thomson scattering data

The accurate interpretation of experiments with matter at extreme densities and pressures is a notoriously difficult challenge. In a recent work [Dornheim et al., Nat. Commun. 13, 7911 (2022)], we have introduced a formally exact methodology that allows extracting the temperature of arbitrary complex materials without any model assumptions or simulations. Here, we provide a more detailed introduction to this approach and analyze the impact of experimental noise on the extracted temperatures. In particular, we extensively apply our method both to synthetic scattering data and to previous experimental measurements over a broad range of temperatures and wave numbers. We expect that our approach will be of high interest to a gamut of applications, including inertial confinement fusion, laboratory astrophysics, and the compilation of highly accurate equation-of-state databases.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

The suitability of differentiable, physics-informed machine learning hydrologic models for ungauged regions and climate change impact assessment

As a genre of physics-informed machine learning, differentiable process-based hydrologic models (abbreviated as δ or delta models) with regionalized deep-network-based parameterization pipelines were recently shown to provide daily streamflow prediction performance closely approaching that of state-of-the-art long short-term memory (LSTM) deep networks. Meanwhile, δ models provide a full suite of diagnostic physical variables and guaranteed mass conservation. Here, we ran experiments to test (1) their ability to extrapolate to regions far from streamflow gauges and (2) their ability to make credible predictions of long-term (decadal-scale) change trends. We evaluated the models based on daily hydrograph metrics (Nash–Sutcliffe model efficiency coefficient, etc.) and predicted decadal streamflow trends. For prediction in ungauged basins (PUB; randomly sampled ungauged basins representing spatial interpolation), δ models either approached or surpassed the performance of LSTM in daily hydrograph metrics, depending on the meteorological forcing data used. They presented a comparable trend performance to LSTM for annual mean flow and high flow but worse trends for low flow. For prediction in ungauged regions (PUR; regional holdout test representing spatial extrapolation in a highly data-sparse scenario), δ models surpassed LSTM in daily hydrograph metrics, and their advantages in mean and high flow trends became prominent. In addition, an untrained variable, evapotranspiration, retained good seasonality even for extrapolated cases. The δ models' deep-network-based parameterization pipeline produced parameter fields that maintain remarkably stable spatial patterns even in highly data-scarce scenarios, which explains their robustness. Combined with their interpretability and ability to assimilate multi-source observations, the δ models are strong candidates for regional and global-scale hydrologic simulations and climate change impact assessment.

54 ENVIRONMENTAL SCIENCES↗

Data-driven prediction of geometry- and toolpath sequence-dependent intra-layer process conditions variations in laser powder bed fusion

Geometrical features and toolpath sequence are two important factors that cause process condition variations, such as variations in the meltpool temperature or meltpool size, that might lead to undesired material properties in the laser powder bed fusion (LPBF) process. Due to the high dynamics and complex physics of the LPBF process, it is difficult to predict variations in process conditions with simulations alone. Advances in measurement technology and computational technologies open up new possibilities for smart manufacturing. In this paper, a data-driven method to predict intra-layer variations in the processing conditions that source from the toolpath sequence and part geometry is presented. The approach is demonstrated using two-color on-axis pyrometer measurements. Three demonstration cases are presented in which it is demonstrated (1) how the trained predictive model can be used as a filter to ease the interpretation of process variations and discover patterns related to toolpath and part geometry, and (2) how to generate predictions that can be used for feedforward control, i.e., for adjusting laser power or scanning speed along the toolpath using a meltpool temperature prediction model generated based on on-axis measurements. Results show that the developed prediction model is able to meaningfully predict process variations resulted from toolpath sequence and geometry. Predictions are aligned with the results from the related work of others and for the case of 180° laser path turnarounds in our high-speed X-ray imaging experiments. In conclusion, the potential issues related to the current maturity status of the process and measuring equipment that could in practice affect the performance of the proposed solutions are also discussed.

42 ENGINEERING↗