Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model interpretability”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Learning Physically Interpretable Atmospheric Models From Data With WSINDy

The multiscale and turbulent nature of Earth's atmosphere has historically rendered accurate weather modeling a hard problem. Recently, there has been an explosion of interest surrounding data-driven approaches to weather modeling, which in many cases show improved forecasting accuracy and computational efficiency when compared to traditional methods. However, many of the current data-driven approaches employ highly parameterized neural networks, often resulting in uninterpretable models and limited gains in scientific understanding. In this work, we address the interpretability problem by explicitly discovering partial differential equations governing atmospheric phenomena, identifying symbolic mathematical models with direct physical interpretations. The purpose of this paper is to demonstrate that, in particular, the weak-form sparse identification of nonlinear dynamics (WSINDy) algorithm can learn effective atmospheric models from both simulated and assimilated data. Our approach adapts the standard WSINDy algorithm to work with high-dimensional fluid data of arbitrary spatial dimension.

58 GEOSCIENCES↗

Guiding center model to interpret neutral particle analyzer results

An attempt is made to model the essential features of ion motion in a plasma. A guiding center model is hypothesized for a plasma heating device whose radial electric fields and axial magnetic fields are crossed. The guiding center model is shown to give results which agree with experimental data from four different plasma heating devices and are helpful for the interpretation of neutral particle analyzer results.

Englert, G. W.↗

Investigation to develop a multistage forest sampling inventory system using ERTS-1 imagery

The author has identified the following significant results. The annotation system produced a RMSE of about 200 m ground distance in the MSS data system with the control data used. All the analytical MSS interpretation models tried were highly significant. However, the gains in forest sampling efficiency that can be achieved by using the models vary from zero to over 50 percent depending on the area to which they are applied and the sampling method used. Among the sampling methods tried, regression sampling yielded substantial and the most consistent gains. The single most significant variable in the interpretation model was the difference between bands 5 and 7. The contrast variable, computed by the Hadamard transform was significant but did not contribute much to the interpretation model. Forest areas containing very large timber volumes because of large tree sizes were not separable from areas of similar crown cover but containing smaller trees using ERTS image interpretation only. All correlations between space derived timber volume predictions and estimates obtained from aerial and ground sampling were relatively low but significant and stable. There was a much stronger relationship between variables derived from MSS and U2 data than between U2 and ground data.

Langley, P. G.↗

Understanding the Impact of Unobservable Variables on the Performance of Predictive Models: The Need for Feature Space Partitioning and Fusion

When developing predictive models over a dataset, the model is globally optimized across the entire feature space to learn a decision boundary. However, when unobservable variables—which cannot be measured or estimated—interact with the observable variables, this can negatively impact the optimization applied to the decision boundary since the data samples introduced by unobservable variables may have little to no association with the applied global optimization. This, consequently, penalizes the entire decision boundary and model performance. This paper examines some of the detrimental effects of unobservable variables, particularly their role in creating new modes in the distribution of observable variables and reducing the separability of class distributions. Such challenges result in skewed or warped decision boundaries and decreased accuracy of model predictions, particularly for interpretable models like logistic regression and decision trees. Through two illustrative case examples, we highlight the need to address the challenges imposed by unobservable variables. We propose a strategy to mitigate these challenges by creating local regions within the feature space through partitioning. This enables the optimization of local models within the regions to overcome the impact of unobservability in different feature space localities. Research into a more sophisticated partitioning strategy and where the partition should be relative to the sample of interest is left as future work. Through the analysis of the impact of unobservability and the development of a partitioning method, we demonstrate the clear need for a partitioning strategy that integrates knowledge from multiple local models to estimate risk factors using information fusion. Thus, we establish the foundation and motivation for using partitioning and information fusion to overcome the effects of unobservability in predictive models. Formal fusion methods, such as Dempster-Shafer theory, can better leverage the information from local regions to improve the performance of interpretable predictive models in the presence of unobservable variables.

Time Series Data↗

Accelerated Materials Design for Molten Salt Technologies Using Innovative High-Throughput Methods

The focus of the project is on building an innovative accelerated materials design platform for molten salt technologies using novel high-throughput methods coupled to data analytics. The main objectives is to predict a FeCrMnNi alloy compositional space with better corrosion resistance than stainless steel 316 and identify new molten salt corrosion mechanisms. The project demonstrates the feasibility to use high-throughput methods coupled to data analytics to accelerate alloy design for extreme environments applications. Using a trained and tested machine learning (ML) model, 2000 FeCrMnNi alloy corrosion rate in molten chloride salts were predicted and a compositional field with corrosion rate lower than 316 stainless steel was identified. The ML model interpretability unveiled multiple features of importance in the model prediction. Some features were expected to be of relative significance, such as work function, surface energy and alloy electronegativity, and the ML model interpretability analysis confirmed those. On the other hand, the most important feature is the diffusion coefficient of Ni in the bulk alloy which indicates that a surface diffusion mechanism plays an important role in the overall corrosion mechanism in molten salts.

36 MATERIALS SCIENCE↗

Interpretable Machine Learning for Characterizing Electric Vehicle Charging Behavior: Insights from Real-World Data

As electric vehicle (EV) adoption rises globally, concerns about the impact on aging electrical grids grow, particularly regarding the charging behavior of EV drivers. This study analyzes real-world driving and charging data from Ford battery electric vehicles (BEVs) collected between 2018 and 2019 to develop interpretable models that characterize charging behavior and quantify influencing factors. Prior research has relied on assumptions regarding driver behavior, often overlooking actual charging patterns. By employing generalized linear mixed models (GLMMs), this work offers insights into how various elements, such as next trip distance and state of charge (SOC), influence charging decisions. The dataset comprises over three million park-trip pairs from 1,997 vehicles, revealing that features related to driving behavior significantly dictate charging behavior, while infrastructure and regional factors have lesser impacts. The findings suggest that existing simulation models may oversimplify EV charging behavior assumptions. This work utilizes real-world EV driving and charging data to train interpretable models that describe charging behavior and quantify the factors most associated with how drivers use charging infrastructure. This research underscores the need for interpretable, data-driven methodologies to inform future EV infrastructure planning and grid management.

29 - ENERGY PLANNING, POLICY AND ECONOMY↗

A semiempirical model for interpreting microwave emission from semiarid land surfaces as seen from space

A radiative-transfer model for simulating microwave brightness temperatures over land surfaces is described. The model takes into account sensor viewing conditions (spacecraft altitude, viewing angle, frequency, and polarization) and atmospheric parameters over a soil surface characterized by its moisture, roughness, and temperature and covered with a layer of vegetation characterized by its temperature, water content, single scattering albedo, structure, and percent coverage. In order to reduce the influence of atmospheric and surface temperature effects, the brightness temperatures are expressed as polarization ratios that depend primarily on the soil moisture and roughness, canopy water content, and percentage of cover. The sensitivity of the polarization ratio to these parameters is investigated. Simulation of the temporal evolution of the microwave signal over semiarid areas in the African Sahel is presented and compared to actual satellite data from the SMMR instrument on Nimbus-7.

Kerr, Yann H.↗

Dust Model Sensitivity to Dust Source Mask, Sandblasting Efficiency, Air Density, and Land Use: Implications for Model Improvement

This study compares dust storm simulations using two commonly adopted methods for representing four important dust emission parameters. Compared to a dynamic dust source mask based on land use and vegetation cover, a static mask based solely on land use overestimates dust concentration and optical depth by a factor of 2, besides generating spurious emissions. The results reinforce that seasonal variations in vegetation cover can significantly affect dust emissions. For sandblasting efficiency, a clay-dependent semiempirical expression produces 10 times more dust than a physics-based expression. Simulations using model-predicted versus a fixed constant for air density differ by only 8%. However, this difference could range between 12 and 22% for annual simulations over global dust source regions. Simulations with updated versus old land use data, using the same dust source mask, differ twofold, indicating the significant impact of land use change on regional dust emission in central Arizona. The differences in the pairs of these simulations are generally larger than the uncertainty due to meteorology. The simulations align better with observation when using the dynamic dust source mask, the physics-based sandblasting efficiency, and the up-to-date land use data. Given the high sensitivity of dust to surface conditions, the results discussed have implications for improving the dust cycle in weather and climate models and for interpreting model intercomparisons.

Dust-emission source↗

Modeling and interpretation of the optical and HST UV spectrum of SN 1993J

We present spherically symmetric, non-local thermodynamic equilibrium (non-LTE), expanding model atmosphere synthetic spectra of SN 1993J and compare them to the ultraviolet and optical spectra obtained simultaneously on 1993 April 15 by the Hubble Space Telescope (HST) and at Lick Observatory. We are able to fit the optical and HST near-UV spectra with a variety of compositions, but find that our best fits are obtained with an enhanced helium abundance (Y = 0.8) and significant nonthermal ionization due to gamma rays produced by the decay of Ni-56. We find the effects of X-rays produced by thermal bremsstrahlung in the circumstellar material to have little effect on the spectrum. Our current models are unable to fit the HST far-UV region, predicting too little flux and strong, unseen Fe II features.

Baron, E.↗

Design of Digital Twin Sensing Strategies Via Predictive Modeling and Interpretable Machine Learning

This work develops a methodology for sensor placement and dynamic sensor scheduling decisions for digital twins. The digital twin data assimilation is posed as a classification problem, and predictive models are used to train optimal classification trees that represent the map from observed data to estimated digital twin states. In addition to providing a rapid digital twin updating capability, the resulting classification trees yield an interpretable mathematical representation that can be queried to inform sensor placement and sensor scheduling decisions. The proposed approach is demonstrated for a structural digital twin of a 12 ft wingspan unmanned aerial vehicle. Offline, training data are generated by simulating scenarios using predictive reduced-order models of the vehicle in a range of structural states. Furthermore, these training data can be further augmented using experimental or other historical data. In operation, the trained classifier is applied to observational data from the physical vehicle, enabling rapid adaptation of the digital twin in response to changes in structural health. Within this context, we study the performance of the optimal tree classifiers and demonstrate how they enable explainable structural assessments from sparse sensor measurements and also inform optimal sensor placement.

47 OTHER INSTRUMENTATION↗

ERTS data user investigation to develop a multistage forest sampling inventory system

The author has identified the following significant results. A unique digital timber volume estimation system was developed for use with the MSS CCT tapes. The system was tested on a 64-square mile area in Northern California's Trinity Alps. The outcome of a systematic experiment, in which several possible combinations of bands 5 and 7 and a contrast measure were tried, showed that an estimated gain in precision of 50% can be obtained in a multistage sampling design. The difference between bands 5 and 7 proved to be of special importance for the estimation of biomass in the form of timber volume. In addition, an interpretation model for high flight U2 photographs was developed. A maximum multiple correlation coefficient of 0.74 was obtained for the regression model, explaining 55% of the variation in timber volume as estimated from aerial photos and ground measurments. An interpretation model for MSS color composites is in the testing stage.

Langley, P. G.↗

Stability analysis of WEST L-mode discharges with improved confinement from boron powder injection

WEST L-mode plasmas with dominant electron heating and no core torque source have observed improvements in confinement during boron (B) powder injection. These results are reminiscent of previous powder injection experiments on other devices and gaseous impurity seeding experiments on WEST. During powder injection, the stored energy increased up to 25% due to enhanced ion and electron heat and particle confinement. The improvements in confinement were not indicative of an L-H transition. To identify the dominant mechanisms and the causality chain behind these improvements in confinement, we employ interpretative modeling using METIS, predictive integrated modeling using a high-fidelity plasma simulator (HFPS), and stand-alone gyrokinetic simulations using quasi-linear gyrokinetic code. Interpretative modeling with METIS allowed for the estimation of missing data while maintaining good overall consistency with experiment. These results provided the initial conditions for fully predictive flux driven simulations using the HFPS. From these simulations, quasi-linear gyrokinetic analysis was performed at ρ = 0.5 and ρ = 0.65. Collisionality was found to be a strong candidate for the turbulence suppression mechanism at ρ = 0.5, while a combination of collisionality and the T e /T i ratio was found to be the likely mechanism at ρ = 0.65. The results additionally suggested that increased Z eff (through main ion dilution) could play a role in the improved confinement, but this could not be confirmed due to a lack of experimental measurements. The modeling framework established here can now be used to evaluate and exploit a variety of future powder injection experiments.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Evaluation of Deep Learning Model Architectures for Point-of-Care Ultrasound Diagnostics

Point-of-care ultrasound imaging is a critical tool for patient triage during trauma for diagnosing injuries and prioritizing limited medical evacuation resources. Specifically, an eFAST exam evaluates if there are free fluids in the chest or abdomen but this is only possible if ultrasound scans can be accurately interpreted, a challenge in the pre-hospital setting. In this effort, we evaluated the use of artificial intelligent eFAST image interpretation models. Widely used deep learning model architectures were evaluated as well as Bayesian models optimized for six different diagnostic models: pneumothorax (i) B- or (ii) M-mode, hemothorax (iii) B- or (iv) M-mode, (v) pelvic or bladder abdominal hemorrhage and (vi) right upper quadrant abdominal hemorrhage. Models were trained using images captured in 27 swine. Using a leave-one-subject-out training approach, the MobileNetV2 and DarkNet53 models surpassed 85% accuracy for each M-mode scan site. The different B-mode models performed worse with accuracies between 68% and 74% except for the pelvic hemorrhage model, which only reached 62% accuracy for all model architectures. These results highlight which eFAST scan sites can be easily automated with image interpretation models, while other scan sites, such as the bladder hemorrhage model, will require more robust model development or data augmentation to improve performance. With these additional improvements, the skill threshold for ultrasound-based triage can be reduced, thus expanding its utility in the pre-hospital setting.

47 OTHER INSTRUMENTATION↗

A Model-based Interpretation of Low-frequency Changes in the Carbon Cycle during the Last 120,000 years and its Implications for the Reconstruction of Atmospheric (delta) 14-C

A main caveat in the interpretation of observed changes in atmospheric (Delta)C-l4 during the last 50,000 years is the unknown variability of the carbon cycle, which together with changes in the C-14 production rates determines the C-14 dynamics. A plausible scenario explaining glacial/interglacial dynamics seen in atmospheric CO2 and (delta)C-13 was proposed recently (Kohler et al., 2005a). A similar approach that expands its interpretation to the C-14 cycle is an important step toward a deeper understanding of (Delta)C-14 variability. This approach is based on an ocean/atmosphere/biosphere box model of the global carbon cycle (BICYCLE) to reproduce low-frequency changes in atmospheric CO2 as seen in Antarctic ice cores. The model is forced forward in time by various paleoclimatic records derived from ice and sediment cores. The simulation results of our proposed scenario match a compiled CO2 record from various ice cores during the last 120,000 years with high accuracy (r(sup 2) = 0.89). We analyze scenarios with different C-14 production rates, which are either constant or based on Be-10 measured in Greenland ice cores or the recent high-resolution geomagnetic field reconstruction GLOPIS-75 and compare them with the available (Delta)C-14 data covering the last 50,000 years. Our results suggest that during the last glacial cycle in general less than 110%0o f the increased atmospheric (Delta)C-14 is based on variations in the carbon cycle, while the largest part (5/6) of the variations has to be explained by other factors. Glacial atmospheric (Delta)C-14 larger than 700% cannot not be explained within our framework, neither through carbon cycle-based changes nor through variable C-14 production. Superimposed on these general trends might lie positive anomalies in atmospheric (Delta)C-14 of approx. 50% caused by millennial-scale variability of the northern deep water production during Heinrich events and Dansgaard/Oeschger climate fluctuations. According to our model, the dominant processes that increase glacial (Delta)C-14 are a reduced glacial ocean circulation (+ approx.40%0), a restricted glacial gas exchange between the atmosphere and the surface ocean through sea ice coverage (+ approx. 20%), and the enrichment of dissolved inorganic carbon with C-14 in the surface waters through isotopic fractionation during higher glacial marine export production caused by iron fertilization (+ approx.10%).

Koehler, Peter↗

A statistical model for interpreting computerized dynamic posturography data

Computerized dynamic posturography (CDP) is widely used for assessment of altered balance control. CDP trials are quantified using the equilibrium score (ES), which ranges from zero to 100, as a decreasing function of peak sway angle. The problem of how best to model and analyze ESs from a controlled study is considered. The ES often exhibits a skewed distribution in repeated trials, which can lead to incorrect inference when applying standard regression or analysis of variance models. Furthermore, CDP trials are terminated when a patient loses balance. In these situations, the ES is not observable, but is assigned the lowest possible score--zero. As a result, the response variable has a mixed discrete-continuous distribution, further compromising inference obtained by standard statistical methods. Here, we develop alternative methodology for analyzing ESs under a stochastic model extending the ES to a continuous latent random variable that always exists, but is unobserved in the event of a fall. Loss of balance occurs conditionally, with probability depending on the realized latent ES. After fitting the model by a form of quasi-maximum-likelihood, one may perform statistical inference to assess the effects of explanatory variables. An example is provided, using data from the NIH/NIA Baltimore Longitudinal Study on Aging.

NASA Discipline Neuroscience↗

Deep learning models for interpretation of point of care ultrasound in military working dogs

Introduction: Military working dogs (MWDs) are essential for military operations in a wide range of missions. With this pivotal role, MWDs can become casualties requiring specialized veterinary care that may not always be available far forward on the battlefield. Some injuries such as pneumothorax, hemothorax, or abdominal hemorrhage can be diagnosed using point of care ultrasound (POCUS) such as the Global FAST® exam. This presents a unique opportunity for artificial intelligence (AI) to aid in the interpretation of ultrasound images. In this article, deep learning classification neural networks were developed for POCUS assessment in MWDs. Methods: Images were collected in five MWDs under general anesthesia or deep sedation for all scan points in the Global FAST® exam. For representative injuries, a cadaver model was used from which positive and negative injury images were captured. A total of 327 ultrasound clips were captured and split across scan points for training three different AI network architectures: MobileNetV2, DarkNet-19, and ShrapML. Gradient class activation mapping (GradCAM) overlays were generated for representative images to better explain AI predictions. Results: Performance of AI models reached over 82% accuracy for all scan points. The model with the highest performance was trained with the MobileNetV2 network for the cystocolic scan point achieving 99.8% accuracy. Across all trained networks the diaphragmatic hepatorenal scan point had the best overall performance. However, GradCAM overlays showed that the models with highest accuracy, like MobileNetV2, were not always identifying relevant features. Conversely, the GradCAM heatmaps for ShrapML show general agreement with regions most indicative of fluid accumulation. Discussion: Overall, the AI models developed can automate POCUS predictions in MWDs. Preliminarily, ShrapML had the strongest performance and prediction rate paired with accurately tracking fluid accumulation sites, making it the most suitable option for eventual real-time deployment with ultrasound systems. Further integration of this technology with imaging technologies will expand use of POCUS-based triage of MWDs.

59 BASIC BIOLOGICAL SCIENCES↗

Model‐Based Interpretation of Solute Exports and Carbon Partitioning During Shale Weathering in a Mountainous Hillslope

The weathering of sedimentary rocks in high-elevation catchments influences freshwater quality and the global carbon cycle. While individual biogeochemical mechanisms involved in this process are relatively well understood, quantifying their contributions to solute export and carbon fluxes under natural, transient conditions remains challenging. Here, we implement a numerical multidimensional and multiphase model to simulate coupled hydrological and biogeochemical processes in a shale-underlain, snow-dominated hillslope in the Rocky Mountains, Colorado. The model captures the dynamic interplay between soil respiration, mineral weathering, and climate-driven hydrological forcing, reproducing observed soil CO 2 dynamics, groundwater chemistry, and subsurface flow. Our results reveal that seasonal snowmelt enhances carbonate weathering by promoting the infiltration of CO 2 -rich water to depth, while pyrite oxidation is primarily sensitive to low water saturation that facilitates O 2 diffusion through the regolith. Topography modulates the spatial distribution of shale weathering, as steeper slopes enhance lateral drainage, favoring the delivery of reactants to greater depths. While shale weathering at our site acts as a transient carbon sink, with silicates and carbonates buffering acidity and promoting atmospheric CO 2 consumption (1% of soil-derived CO 2 ), the exported dissolved inorganic carbon is predominantly geogenic (∼73%). Consequently, when accounting for long-term marine carbonate precipitation. The current weathering regime represents a net source of carbon to the atmosphere. The oxidation of pyrite and petrogenic organic carbon together release approximately 0.9 mol·m −2 ·yr −1 of CO 2 . Our findings highlight the role of topography, hydroclimate, and the coupling between acid-base reactions in shaping the carbon balance and the solute exports in mountainous critical zones.

carbon cycling↗

Machine Learning for Improving Surface-Layer-Flux Estimates

Abstract Flows in the atmospheric boundary layer are turbulent, characterized by a large Reynolds number, the existence of a roughness sublayer and the absence of a well-defined viscous layer. Exchanges with the surface are therefore dominated by turbulent fluxes. In numerical models for atmospheric flows, turbulent fluxes must be specified at the surface; however, surface fluxes are not known a priori and therefore must be parametrized. Atmospheric flow models, including global circulation, limited area models, and large-eddy simulation, employ Monin–Obukhov similarity theory (MOST) to parametrize surface fluxes. The MOST approach is a semi-empirical formulation that accounts for atmospheric stability effects through universal stability functions. The stability functions are determined based on limited observations using simple regression as a function of the non-dimensional stability parameter representing a ratio of distance from the surface and the Obukhov length scale (Obukhov in Trudy Inst Theor Geofiz AN SSSR 1:95–115, 1946), $$z/L$$ z / L . However, simple regression cannot capture the relationship between governing parameters and surface-layer structure under the wide range of conditions to which MOST is commonly applied. We therefore develop, train, and test two machine-learning models, an artificial neural network (ANN) and random forest (RF), to estimate surface fluxes of momentum, sensible heat, and moisture based on surface and near-surface observations. To train and test these machine-learning algorithms, we use several years of observations from the Cabauw mast in the Netherlands and from the National Oceanic and Atmospheric Administration’s Field Research Division tower in Idaho. The RF and ANN models outperform MOST. Even when we train the RF and ANN on one set of data and apply them to the second set, they provide more accurate estimates of all of the fluxes compared to MOST. Estimates of sensible heat and moisture fluxes are significantly improved, and model interpretability techniques highlight the logical physical relationships we expect in surface-layer processes.

Meteorology & Atmospheric Sciences↗