Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model interpretability”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34

Systematic study of the validity of the eikonal model including uncertainties

Nuclear reactions at intermediate beam energies are often interpreted using the eikonal model. In the analysis of complex reaction probes, where few-body reaction methods are needed, the eikonal method may be used as an efficient way for describing the fragment-target reaction process. In this work, we perform a systematic study to test the validity of the eikonal approximation for nucleon-nucleus reactions. We also quantify uncertainties due to the nucleon optical potential on reaction observables. We inspect the validity of the eikonal model and its semiclassical correction by comparing it to exact solutions (obtained from solving the optical-model equation with a finite-differences method) for a wide range of reactions. We also study the effect of relativistic corrections, both kinematic and dynamic, by effectively incorporating the relativistic effects at intermediate energies. The uncertainties from a Bayesian global optical potential (KDUQ) are propagated to the observables of interest. Our study includes neutron and proton reactions on 27 Al , 40 Ca , 90 Zr , and 208 Pb , for a wide range of energies 𝐸 lab = 0–400 MeV. We calculate neutron-total cross sections (elastic and reactions) as well as proton-absorption cross sections as a function of beam energy, using the eikonal model, the eikonal model with a semiclassical correction, and the exact solution. Here, we also compute angular distributions for the methods above. Our results show that for the proton-absorption cross section, the eikonal model can be used down to around 60 MeV and the semiclassical correction extends its use to 30 MeV. However, the validity of the eikonal model for the neutron-total cross section only goes down to ≈120 MeV, a range extended to ≈ 50 MeV when using the semiclassical correction. We find the semiclassical correction to the eikonal model to be less effective in describing the angular distributions. The 1⁢𝜎 uncertainty intervals on the observables we studied is less than 5% for most of the energies considered, but increases rapidly for higher energies, namely energies outside the range of KDUQ (𝐸 lab > 200MeV).

Cluster models↗

Differentiable physics-enabled closure modeling for Burgers’ turbulence

Abstract Data-driven turbulence modeling is experiencing a surge in interest following algorithmic and hardware developments in the data sciences. We discuss an approach using the differentiable physics paradigm that combines known physics with machine learning to develop closure models for Burgers’ turbulence. We consider the one-dimensional Burgers system as a prototypical test problem for modeling the unresolved terms in advection-dominated turbulence problems. We train a series of models that incorporate varying degrees of physical assumptions on an a posteriori loss function to test the efficacy of models across a range of system parameters, including viscosity, time, and grid resolution. We find that constraining models with inductive biases in the form of partial differential equations that contain known physics or existing closure approaches produces highly data-efficient, accurate, and generalizable models, outperforming state-of-the-art baselines. Addition of structure in the form of physics information also brings a level of interpretability to the models, potentially offering a stepping stone to the future of closure modeling.

97 MATHEMATICS AND COMPUTING↗

Code for the manuscript titled "Blackout Diffusion: Generative Diffusion Models in Discrete-State Spaces"

We would like to disclose two scripts, written in Jupyter notebook, in which we implement the "Blackout Diffusion Process" described in the manuscript "Blackout Diffusion: Generative Diffusion Models in Discrete-State Spaces" (LA-UR-23-20509), to be submitted to the International Conference of Machine Learning (ICML). The abstract of the manuscript is append below. == Typical generative diffusion models rely on a Gaussian diffusion process for training the backward transformations, which can then be used generate samples from Gaussian noise. However, real world data often takes place in discrete-state spaces, which occur in many scientific applications. Here, we develop a theoretical formulation for arbitrary discrete-state Markov processes in the forward diffusion process. We relate the theory to the existing continuous-state Gaussian diffusion and identify the corresponding reverse-time stochastic process and score function in the continuous-time setting, and the reverse-time mapping in the discrete-time setting. As an example of this framework, we introduce "Blackout Diffusion", which learns to produce samples from an empty image instead of from noise. Numerical experiments on the CIFAR-10 dataset confirm the feasibility of generative diffusion modeling in a discrete space. Generalizing from specific (Gaussian) forward processes to a more general framework also sheds light on how to interpret generative diffusion models and their mathematical structure, which we comment on.

Lin, Yen Ting↗

Genetic programming for understanding cognitive biases that generate polarization in social networks

Recent studies have applied agent-based models to infer human-interpretable explanations of individual-scale behaviors that generate macro-scale patterns in complex social systems. Genetic programming has proven to be an ideal explainable AI tool for this purpose, where primitives may be expressed in an interpretable fashion and assembled into agent rules. Evolutionary model discovery (EMD) is a tool that combines genetic programming and random forest feature importance analysis, to infer individual-scale, human-interpretable explanations from agent-based models. We deploy EMD to investigate the cognitive biases behind the emergence of ideological polarization within a population. An agent-based model is developed to simulate a social network, where agents are able to create or sever links with one another, and update an internal ideological stance based on their neighbors' stances. Agent rules govern these actions and constitute of cognitive biases. A set of 7 cognitive biases are included as genetic program primitives in the search for rules that generate hyper-polarization among the population of agents. We find that heterogeneity in cognitive biases is more likely to generate polarized social networks. Highly polarized social networks are likely to emerge when individuals with confirmation bias are exposed to those with either attentional bias, egocentric bias, or cognitive dissonance.

Gunaratne, Chathika↗

Shuttle applications in tropospheric air quality observations

The role which might be played by the space shuttle in obtaining data which describes the air quality of the north-eastern United States was investigated. The data requirements of users, a model for statistical interpretation of the observations, the influence of orbit parameters on the spatial and temporal sampling and an example of application of the the model were considered.

Friedman, E.↗

The ezSpectra suite: An easy‐to‐use toolkit for spectroscopy modeling

Abstract A molecule's spectrum encodes information about its structure and electronic properties. It is a unique fingerprint that can serve as a molecular ID. Quantum chemistry calculations provide key ingredients for interpreting spectra, but modeling the spectra rarely ends there; it requires additional steps that entail combined treatments of electronic and nuclear degrees of freedom and account for specifics of the experimental setup (light energy, polarization, averaging over molecular orientations, temperature, etc.). This Software Focus article describes the ezSpectra suite, which currently comprises two stand‐alone open‐source codes: ezFCF and ezDyson . ezFCF calculates Franck–Condon factors, which yield vibrational progressions for polyatomic molecules, within the double‐harmonic approximation. ezDyson calculates absolute cross‐sections for photodetachment/photoionization processes and photoelectron angular distributions using Dyson orbitals computed by a quantum chemistry program. This article is categorized under: Electronic Structure Theory > Ab Initio Electronic Structure Methods Theoretical and Physical Chemistry > Spectroscopy Software > Simulation Methods

Gozem, Samer↗

Predicting the Evolution of Shallow Cumulus Clouds With a Lotka‐Volterra Like Model

Abstract In numerical weather prediction and climate models, boundary‐layer clouds are controlled by a wide range of subgrid‐scale processes. However, understanding the nature of these processes and their role in the evolution of the cloud size distribution as a whole has been elusive. To address this issue, we adopt a novel empirical framework from the field of population dynamics to model the evolution of cloud size statistics by using the shallow cumulus properties obtained from a large‐eddy simulation (LES). Our approach involves representing the cloud size distribution and the total cloud area using a revised Lotka‐Volterra model and ridge linear model, respectively. The physical interpretation of the total cloud area and coefficients obtained from the optimization of the models reveals three stages probably interpreted by dominant processes: the formation of new clouds, the growth of single clouds, and a steady state with organized transitions involving the growth and decay of multiple clouds. Furthermore, we showcase the potential of this framework to serve as a component of scale‐aware parameterizations of shallow‐convective clouds in atmospheric models.

54 ENVIRONMENTAL SCIENCES↗

An interpretation of the spectral properties of hot hydrogen-rich white dwarfs with stratified H/He model atmospheres

A grid of stratified H/He model atmospheres applicable to the interpretation of the spectral properties of hot H-rich white dwarfs (WDs) is computed. Samples of hot DA WDs observed with Exosat and Einstein are analyzed using the models. Six out of six objects with T(eff) = 35,000 K or less do not show a EUV/soft X-ray flux deficiency and therefore can be understood solely in terms of pure hydrogen atmospheres. A majority of DA WDs hotter than this value do show a flux deficiency and thus require the presence of some absorbers in their atmospheres. It is shown that the Exosat broadband photometry of Feige 24 and G191 B2B cannot be explained in terms of stratified atmospheres. Absorption by heavy elements is certainly responsible for the required EUV/soft X-ray opacity source in these cases. However, the Exosat data are consistent with the hypothesis of stratified atmospheres in the four remaining objects.

Vennes, Stephane↗

Interpreting asteroid photometry and polarimetry using a model of shadowing and coherent backscattering

The shadow-hiding models for the opposition effect and negative polarization of atmosphereless solar system bodies do not explain some experimental findings, such as the enhancing opposition effect and negative polarization with decreasing particle size down to wavelength scales. The enhancement for laboratory photometric and polarimetric data on artificial glass samples with different particle size is shown. These results are in agreement with the so-called coherent backscattering or interference mechanism proposed for the interpretation of the opposition effect and negative polarization. Two different approaches for describing the opposition effect and negative polarization produced by the shadow-interference mechanism were developed. One is based on exact electromagnetic solutions for simple scattering systems that include dipole-dipole and dipole-surface coupling; The other is based on a point-scatterer approximation characterized by model photometric and polarimetric phase functions, and the mutual shadowing effect is derived using virtual volumes associated with the point-scatterers. Both approaches yield qualitatively similar results, although neither is entirely satisfactory. We regard them as prototypes for a future unified model of shadowing and coherent backscattering. The sharp opposition effect of 44 Nysa and the asteroid albedo-polarization rule are here explained using the point-scatterer approach.

Shkuratov, Y. G.↗

Search for chargino-neutralino production in events with Higgs and W bosons using 137 fb$^{−1}$ of proton-proton collisions at $ \sqrt{s} $ = 13 TeV

A search for electroweak production of supersymmetric (SUSY) particles in final states with one lepton, a Higgs boson decaying to a pair of bottom quarks, and large missing transverse momentum is presented. The search uses data from proton-proton collisions at a center-of-mass energy of 13 TeV collected using the CMS detector at the LHC, corresponding to an integrated luminosity of 137 fb$^{−1}$. The observed yields are consistent with backgrounds expected from the standard model. The results are interpreted in the context of a simplified SUSY model of chargino-neutralino production, with the chargino decaying to a W boson and the lightest SUSY particle (LSP) and the neutralino decaying to a Higgs boson and the LSP. Charginos and neutralinos with masses up to 820 GeV are excluded at 95% confidence level when the LSP mass is small, and LSPs with mass up to 350 GeV are excluded when the masses of the chargino and neutralino are approximately 700 GeV.[graphic not available: see fulltext]

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

A Rapid Approach to Modeling Species-Habitat Relationships

A growing number of species require conservation or management efforts. Success of these activities requires knowledge of the species' occurrence pattern. Species-habitat models developed from GIS data sources are commonly used to predict species occurrence but commonly used data sources are often developed for purposes other than predicting species occurrence and are of inappropriate scale and the techniques used to extract predictor variables are often time consuming and cannot be repeated easily and thus cannot efficiently reflect changing conditions. We used digital orthophotographs and a grid cell classification scheme to develop an efficient technique to extract predictor variables. We combined our classification scheme with a priori hypothesis development using expert knowledge and a previously published habitat suitability index and used an objective model selection procedure to choose candidate models. We were able to classify a large area (57,000 ha) in a fraction of the time that would be required to map vegetation and were able to test models at varying scales using a windowing process. Interpretation of the selected models confirmed existing knowledge of factors important to Florida scrub-jay habitat occupancy. The potential uses and advantages of using a grid cell classification scheme in conjunction with expert knowledge or an habitat suitability index (HSI) and an objective model selection procedure are discussed.

Carter, Geoffrey M.↗

A comparison of computational models for predicting yield sooting index

Sooting propensity, a measurement of how much particulate matter is produced when a fuel is burned, is a property of significant interest among researchers who are striving to discover the next generation of cleaner, more efficient fuels and fuel additives. Many compounds are not viable as fuels and/or fuel additives, and as a result, designing cleaner-burning biofuels using only experimental techniques is inefficient. Predictive models have been instrumental in reducing this inherent difficulty, providing researchers with a tool to preemptively screen compounds before production and testing. The present work compares the accuracies and interpretabilities of existing models used to predict a particular measure of sooting propensity, Yield Sooting Index (YSI). These models include artificial neural networks, graph neural networks, and multivariate equations. A novel equation for predicting YSI based on atom path count and bond order is proposed, which can highlight key structural components that contribute to YSI. It was found that artificial neural networks slightly outperform graph neural networks and greatly outperform multivariate equations in blind (test set) prediction accuracy; however, graph neural networks and multivariate equations provide significantly more interpretability as to how compound structure relates to YSI. Predictions of YSI are compared to experimental measurements for previously un-tested compounds with cetane numbers comparable to diesel fuel (50-60) (butyl decanoate, ethyl decanoate, 1,4-bis(ethenoxymethyl)cyclohexane, and 5-heptyloxolan-2-one), and it was found that these compounds produce significantly less soot compared to diesel fuel.

09 BIOMASS FUELS↗

A reduced model for the ITER divertor based on SOLPS solutions for ITER Q = 10 baseline conditions: B. A reduced model based on reversed-direction two point modeling

Edge codes such as SOLPS coupled to neutral codes such as EIRENE have become so comprehensive and sophisticated that they now constitute, in effect, 'code-experiments' that, as for actual experiments, can benefit from interpretation using simple models and conceptual frameworks, i.e. reduced models. The first task is the identification of options for the reduced model control parameters that are best suited for control of the action of the divertor, i.e. for control of target power loading and sputter–erosion, primarily. A strong correlation between the electron temperature at the divertor target, T e,t , and the neutral deuterium D 2 density at the target, n D2,t , flux-tube resolved, has recently been reported for a number of code studies including SOLPS-4.3 modeling of a set of ~50 ITER baseline cases: Q DT = 10, q 95 = 3, P SOL = 100 MW, metallic walls, and Ne seeding (Pitts et al 2019). Part A of the present study reports new results for largely the same ITER cases, confirming the strong correlation reported earlier between local values of T e,t , and (i) n D2,t , and (ii) normalized volumetric losses of power and pressure in the divertor. Strong correlations have now also been found, and are reported here for the first time, between T e,t and all of the divertor target quantities of practical interest. A physical explanation for this surprising result has not as yet been fully identified; nevertheless it has encouraging implications for reduced modeling of the ITER divertor. For such ITER conditions, (i) the global Ne injection rate, Inj Ne (Ne s –1 ), and (ii) the electron temperature at the location on the target where the peak power deposition occurs, T e,t @q ⊥,pk (eV), are found to be promising reduced model control parameters. In this part B, a reduced model for the ITER divertor is developed and described in detail, based on reversed-direction two point modeling, Rev2PM. The input to the reduced model is a value of the variable pair (T e,t @q ⊥,pk , Inj Ne )for a chosen case and the output are values of the various target as well as divertor-entrance quantities of practical interest, e.g. q ⊥,pk , the electron density at the X-point, n e,Xpt , etc. The reduced model was quantitatively characterized using one half of the code cases; it was then used to successfully predict (replicate) the code values of e.g. n e,Xpt for the other half.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

A systematic method for selecting molecular descriptors as features when training models for predicting physiochemical properties

Machine learning has proven to be a powerful tool for accelerating biofuel development. Although numerous models are available to predict a range of properties using chemical descriptors, there is a trade-off between interpretability and performance. Neural networks provide predictive models with high accuracy at the expense of some interpretability, while simpler models such as linear regression often lack in accuracy. In addition to model architecture, feature selection is also critical for developing interpretable and accurate predictive models. We present a method for systematically selecting molecular descriptor features and developing interpretable machine learning models without sacrificing accuracy. Our method simplifies the process of selecting features by reducing feature multicollinearity and enables discoveries of new relationships between global properties and molecular descriptors. To demonstrate our approach, we developed models for predicting melting point, boiling point, flash point, yield sooting index, and net heat of combustion with the help of the Tree-based Pipeline Optimization Tool (TPOT). For training, we used publicly available experimental data for up to 8351 molecules. Our models accurately predict various molecular properties for organic molecules (mean absolute percent error (MAPE) ranges from 3.3% to 10.5%) and provide a set of features that are well-correlated to the property. This method enables researchers to explore sets of features that significantly contribute to the prediction of the property, offering new scientific insights. To help accelerate early stage biofuel research and development, we also integrated the data and models into a open-source, interactive web tool.

09 BIOMASS FUELS↗

Presenting Model-Based Systems Engineering Information to Non-Modelers

NASA’s Human Research Program’s (HRP) Exploration Medical Capability (ExMC) Element adopted Systems Engineering (SE) principles and Model Based Systems Engineering (MBSE) tools to capture the system functions, system architecture, requirements, interfaces, and clinical capabilities for a future exploration medical system. There are many different stakeholders who may use the information in the model: systems engineers, requirement engineers, clinicians (doctors, nurses, and pharmacists), scientists, and program managers. Many of these individuals do not have access to MBSE modeling toolsor have never used these tools. Many of these individuals (clinicians, scientists, even program managers)may have no experience with SE in general let alone interpreting a systems model. The challenge faced by ExMC was how to present the content in the model to non-modelers in a way they could understand with limited to no training in MBSE or the Systems Modeling Language (SysML) without using the modeling tool. Therefore, from the model, ExMC created an HTML report that is accessible to anyone with a browser. When creating the HTML report, the ExMC SE team talked to stakeholders and received their feedback on what content they wanted and how to display this content. Factoring in feedback, the report arranges the content in a way that not only directs readers through the SE process taken to derive the requirements, but also helps them to understand the fundamental steps in an SE approach. The report includes links to source information (i.e., NASA documentation that describes levels of care) and other SE deliverables (e.g., Concept of Operations). These links were provided to aid in the understanding of how the team created this content through a methodical SE approach. This paper outlines the process used to develop the model, the data chosen to share with stakeholders, many of the model elements used in the report, the review process stakeholders followed, the comments received from the stakeholders, and the lessons ExMC learned through producing this HTML report.

Jeff Cohen↗

Combining artificial intelligence and physics-based modeling to directly assess atomic site stabilities: from sub-nanometer clusters to extended surfaces

The performance of functional materials is dictated by chemical and structural properties of individual atomic sites. In catalysts, for instance, the thermodynamic stability of constituting atomic sites is a key descriptor from which more complex properties, such as molecular adsorption energies and reaction rates, can be derived. In this study, we present a widely applicable machine learning (ML) approach to instantaneously compute the stability of individual atomic sites in structurally and electronically complex nano-materials. Conventionally, we determine such site stabilities using computationally intensive first-principles calculations. With our approach, we predict the stability of atomic sites in sub-nanometer metal clusters of 3–55 atoms with mean absolute errors in the range of 0.11–0.14 eV. To extract physical insights from the ML model, we introduce a genetic algorithm (GA) for feature selection. This algorithm distills the key structural and chemical properties governing the stability of atomic sites in size-selected nanoparticles, allowing for physical interpretability of the models and revealing structure–property relationships. The results of the GA are generally model and materials specific. In the limit of large nanoparticles, the GA identifies features consistent with physics-based models for metal–metal interactions. By combining the ML model with the physics-based model, we predict atomic site stabilities in real time for structures ranging from sub-nanometer metal clusters (3–55 atom) to larger nanoparticles (147 to 309 atoms) to extended surfaces using a physically interpretable framework. Finally, we present a proof of principle showcasing how our approach can determine stable and active nanocatalysts across a generic materials space of structure and composition.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Machine learning assisted modeling of mixing timescale for LES/PDF of high-Karlovitz turbulent premixed combustion

Accurate modeling of mixing in the transported probability density function (PDF) method remains a great challenge, especially for turbulent premixed combustion under extreme conditions such as high Karlovitz number Ka. Recently, a power-law based mixing timescale model was developed for the large-eddy simulations (LES)/PDF modeling of high-Ka number turbulent premixed flames. It is found in this work that the power-law mixing timescale model is highly sensitive to the model parameters. It is thus critically needed to develop accurate calibration of these model parameters. The empirical specification of the model parameters developed in Zhang et. al. is found to be inadequate for accurate modeling of the mixing timescale. Here, machine learning is introduced as an attractive alternative in this work for the specification of the model parameters. A high-Ka number DNS jet flame is used as the training and validation of the machine learning models. The choices of the input parameters are discussed and compared for the machine learning models. The effect of differential molecular diffusion on mixing is examined by including the effect of the Lewis number in the training of the machine learning models. The performance of different machine learning algorithms is compared for the specification of the mixing model parameters. Overall, excellent performance of the machine learning models is observed for assisting the mixing modeling. The feasibility, interpretability, applicability, generality, and portability of using machine learning are discussed in general to provide a perspective on applying data-driven machine learning for turbulent combustion modeling studies.

42 ENGINEERING↗

Evidence for 200 second variability in the X-ray flux of the quasar 1525 + 227

Sixteen hundred seconds of Einstein Observatory IPC data for 1525 + 227, a bright, nearby quasar show significant intensity fluctuations on a time scale of 200 seconds. Similar fluctuations were not detected 13 months later during a follow-up 12,500 second observation. Interpretation of the time variations requires a Hubble constant equal to or greater than 100 km/s per Mpc to obtain even marginal consistency with standard isotropic emission models. An alternative interpretation invokes anisotropic emission probably due to the presence of relativistic motions with associated beaming effects.

Matilsky, T.↗