SEARCH · Engineering Papers
Results for “interpretable models”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
A comparison between residential relocation timing of Sydney and Chicago residents: A Bayesian survival analysis
We report that understanding households' behaviour in residential relocation timing is of great importance in the field of transport engineering and economics. This research aims to develop a residential relocation model by considering the potential dynamic impacts of other households' decisions and variables, including economic and demographic attributes, housing features, intra-household decision-making structures, travel mode choice, and other life-course attributes. A multivariate parametric survival model with both fixed and time-varying covariates is developed. To the best of the authors' knowledge, this study is the first paper in the literature of residential relocation timing to propose the use of a Bayesian model in contrast to the widely used classic frequentist approach and have conducted a discussion on its advantages. An emerging residential relocation dataset collected for two cities in Australia and the USA (Sydney and Chicago cities) has been used, which covers residence, vehicle ownership, occupation, education, economic and demographic attributes of respondents. A comprehensive comparison between the results of two cities and a comparison between two Bayesian and frequentist approaches are made. This study confirms the impact of life-course variables, intra-household decision-making behaviours, and sociodemographic attributes on home mobility. According to the model outputs, the accelerating or decelerating impact of explanatory variables on the relocation timing has been almost the same in the two cities. The Bayesian model was confirmed to have some advantages over the frequentist model, including being straightforward to interpret, availability of making inferences on the results, and ease of handling complex models, and optimisation convergence complexities.
JAX-CanVeg: A Differentiable Land Surface Model
Land surface models consider the exchange of water, energy, and carbon along the soil-canopy-atmosphere continuum, which is challenging to model due to their complex interdependency and associated challenges in representing and parameterizing them. Differentiable modeling provides a new opportunity to capture these complex interactions by seamlessly hybridizing process-based models with deep neural networks (DNNs), benefiting both worlds, that is, the physical interpretation of process-based models and the learning power of DNNs. Here, we developed a differentiable land model, JAX-CanVeg. The new model builds on the legacy CanVeg by incorporating advanced functionalities through JAX in the graphic processing unit support, automatic differentiation, and integration with DNNs. We demonstrated JAX-CanVeg's hybrid modeling capability by applying the model at four flux tower sites with varying aridity. To this end, we developed a hybrid version of the Ball-Berry equation that emulates the water stress impact on stomatal closure to explore the capability of the hybrid model in (a) improving the simulations of latent heat fluxes (LE) and net ecosystem exchange (NEE), (b) improving the optimization trade-off when learning observations of both LE and NEE, and (c) benefiting a multi-layer canopy model setup. Our results show that the proposed hybrid model improved the simulations of LE and NEE at all sites, with an improved optimization trade-off over the process-based model. Additionally, the multi-layer canopy set benefited hybrid modeling at some sites. Anchored in differentiable modeling, our study provides a new avenue for modeling land-atmosphere interactions by leveraging the benefits of both data-driven learning and process-based modeling.
Spatiotemporal Downscaling Model for Solar Irradiance Forecast Using Nearest-Neighbor Random Forest and Gaussian Process
Accurate solar photovoltaic (PV) capacity estimation requires high-resolution, site-specific solar irradiance data to account for localized variability. However, global datasets, such as the National Solar Radiation Database (NSRDB), provide regional averages that fail to capture the fine-scale fluctuations critical for large-scale grid integration. This limitation is particularly relevant in the context of increasing distributed energy resources (DERs) penetration, such as rooftop PV. Additionally, it is critical to the implementation of the U.S. Federal Energy Regulatory Commission (FERC) Order 2222, which facilitates DER participation in U.S. bulk power markets. To address this challenge, this study evaluates Nearest-Neighbor Random Forest (NNRF) and Nearest-Neighbor Gaussian Process (NNGP) models for spatiotemporal downscaling of global solar irradiance data. By leveraging historical irradiance and meteorological data, these models incorporate spatial, temporal, and feature-based correlations to enhance local irradiance predictions. The NNRF model, a machine-learning approach, prioritizes computational efficiency and predictive accuracy, while the NNGP model offers a level of interpretability and prediction uncertainty by numerically quantifying correlations and dependencies in the data. Model validation was conducted using day-ahead predictions. The results showed that the average Goodness of Fit (GoF) of the NNRF model of 90.61% across all eight sites outperformed the GoF of the NNGP of 85.88%. Additionally, the computational speed of NNRF was 2.5 times faster than the NNGP. Finally, the NNGP displayed polynomial scaling while the NNRF scaled linearly with increasing number of nearest neighbors. Additional validation of the model on five sites in Puerto Rico further confirmed the superiority of the NNRF model over the NNGP model. These findings highlight the robustness and computational efficiency of NNRF for large-scale solar irradiance downscaling, making it a strong candidate for improving PV capacity estimation and real-time electricity market integration for DERs.
A crystal plasticity finite element model embedding strain-rate sensitivities inherent to deformation mechanisms: Application to alloy AZ31
We report the fundamental power-law relationship representing the flow rule in crystal visco-plasticity ensures uniqueness in the selection of slip systems accommodating imposed plastic strain-rates. The power-law relationship also introduces an artificially high strain-rate sensitivity in crystal plasticity simulations, unless a high value of the power-law exponent is used. However, the use of high values for the exponent is limited by numerical tractability. This paper presents a numerical method implemented in a crystal plasticity finite element (CPFE) model for embedding any value of the power-law exponent reflecting the true material strain-rate sensitivity. Importantly, the method does not increase computation time involved in the simulations. The enhanced CPFE model is used to interpret and predict a complex strain-rate sensitive response and microstructural evolution of AZ31 Mg alloy. Measured values of strain-rate sensitivity for slip and twinning modes are used in the simulations. Calculations show that the model successfully captures the phenomena pertaining to the effect of changing applied strain-rate on the mechanical response including flow stress and evolution of texture and twinning for a broad range of strain-rates ranging from 10 -3 s -1 to 10 3 s -1 and loading orientations in tension and compression. It is shown that such predictions are a consequence of not only relative amounts of slip and twinning activities driven by a set of accurately characterized hardening law parameters but also values of the strain-rate sensitivities inherent to individual deformation mechanisms. Besides, the model validates the measured strain-rate dependency of deformation mechanisms while accurately reproducing the mechanical data. Hence, the model can be used to verify and further refine or infer measured strain-rate sensitivity per deformation mechanism by reproducing experimental data.
Factors Governing Oxygen Vacancy Formation in Oxide Perovskites
The control of oxygen vacancy (V O ) formation is critical to advancing multiple metal-oxide-perovskite-based technologies. In this work, we report the construction of a compact linear model for the neutral V O formation energy in ABO 3 perovskites that reproduces, with reasonable fidelity, Hubbard-U-corrected density functional theory calculations based on the state-of-the-art, strongly constrained and appropriately normed exchange-correlation functional. We obtain a mean absolute error of 0.45 eV for perovskites stable at 298 K, an accuracy that holds across a large, electronically diverse set of ABO 3 perovskites. Our model considers perovskites containing alkaline-earth metals (Ca, Sr, and Ba) and lanthanides (La and Ce) on the A-site and 3d transition metals (Ti, V, Cr, Mn, Fe, Co, and Ni) on the B-site in six different crystal systems (cubic, tetragonal, orthorhombic, hexagonal, rhombohedral, and monoclinic) common to perovskites. Physically intuitive metrics easily extracted from existing experimental thermochemical data or via inexpensive quantum mechanical calculations, including crystal bond dissociation energies and (solid phase) reduction potentials, are key components of the model. Beyond validation of the model against known experimental trends in materials used in solid oxide fuel cells, the model yields new candidate perovskites not contained in our training data set, such as (Bi,Y)(Fe,Co)O 3 , which we predict may have favorable thermochemical water-splitting properties. The confluence of sufficient accuracy, efficiency, and interpretability afforded by our model not only facilitates high-throughput computational screening for any application that requires the precise control of V O concentrations but also provides a clear picture of the dominant physics governing V O formation in metal-oxide perovskites.
A mechanistic understanding of oxygen isotopic changes in the Western United States at the Last Glacial Maximum
At the Last Glacial Maximum (LGM), records suggest drier conditions in the northwest United States and wetter conditions in the southwest United States relative to present-day as well as widespread changes in the isotopic composition of water. However, the mechanisms responsible for these changes remain ambiguous. Here, we explore differences in western United States hydroclimate between the LGM and preindustrial with a water isotope tracer enabled Earth System Model. We then use proxy forward models to compare simulated and recorded δ 18 O in speleothems. We find that the pattern of hydroclimate response in the western United States at the LGM relates to a combination of 1) increased frequency and southward shifted wintertime extratropical cyclones in the North Pacific, 2) greater rainout of moisture as it moves over the continent, and 3) reduced evaporation in the cooler LGM climate. The simulated lower δ 18 O of precipitation at the LGM relates predominantly to an increase in cool season moisture removal efficiency, with a secondary contribution from relatively more cool season precipitation. Both surface temperatures and North American ice sheets contribute to these hydroclimate changes at the LGM. Comparisons between δ 18 O from proxy forward models and speleothem records in the western United States show general agreement at the LGM, with increasing depletion moving towards the continental interior. Finally, this study highlights the similarities and differences between hydrologic and δ 18 O changes at the LGM and emphasizes the utility of model-proxy comparison for interpretation.
Rapid data-driven model reduction of nonlinear dynamical systems including chemical reaction networks using ℓ 1 -regularization
We develop a new data-driven paradigm for efficient model reduction of a broad class of nonlinear dynamical systems. Our model reduction method directly enables the interpretation of key components of the dynamical system, unlike traditional projection-based model reduction methods that focus on reducing computational complexity more than interpretability. Our method is not application specific and is simple to implement on nonlinear dynamical systems arising from a variety of different fields. It requires minimal parameterization using a single parameter to trade-off between model complexity and estimation error. We use a data-driven paradigm to formulate model reduction as an efficient convex optimization problem that scales polynomially in the original size of the complex system, enabling systems with as many as thousands of components to be reduced in a matter of minutes.
Dislocation loop evolution in Kr-irradiated ThO 2
Here, the early stage of microstructural evolution of ThO 2 , under krypton irradiation at 600, 800, and 1000°C, was investigated using in situ transmission electron microscopy (TEM). Dislocation loops grew faster, whereas their number density decreased with increasing irradiation temperature. Loop density was found to decrease with ion dose. Interstitial dislocation loops, including Frank loops with Burgers vector of $\textit{a}/3\langle111\rangle$ and perfect loops with Burgers vector of $\textit{a}/2\langle110\rangle$, were determined by traditional TEM and atomic resolution–scanning TEM techniques. Atomistic and mesoscale level modeling are performed to interpret experimental observations. The migration energy barriers of defects in ThO 2 were calculated using density-functional theory. The energetics of different dislocation loop types were studied using molecular dynamics simulations. Loop density and diameter were analyzed using a kinetic rate theory model that considers stoichiometric loop evolution. This analysis reveals that loop growth is governed by the mobility of cation interstitials, whereas loop nucleation is determined by the mobility of anion defects. Lastly, a rate theory model was used to extract the diffusion coefficients of thorium interstitials, oxygen interstitials, and vacancies.
Modern chemical graph theory
Abstract Graph theory has a long history in chemistry. Yet as the breadth and variety of chemical data is rapidly changing, so too do graph encoding methods and analyses that yield qualitative and quantitative insights. Using illustrative cases within a basic mathematical framework, we showcase modern chemical graph theory's utility in Chemists' analysis and model development toolkit. The encoding of both experimental and simulation data is discussed at various levels of granularity of information. This is followed by a discussion of the two major classes of graph theoretical analyses: identifying connectivity patterns and partitioning methods. Measures, metrics, descriptors, and topological indices are then introduced with an emphasis upon enhancing interpretability and incorporation into physical models. Challenging data cases are described that include strategies for studying time dependence. Throughout, we incorporate recent advancements in computer science and applied mathematics that are propelling chemical graph theory into new domains of chemical study. This article is categorized under: Molecular and Statistical Mechanics > Molecular Dynamics and Monte‐Carlo Methods Structure and Mechanism > Computational Materials Science Structure and Mechanism > Molecular Structures
Use of Rig Parameter Data in Bit Constraint Models for Improved Drilling Performance at The Geysers
Surface parameter measurements are routinely used during deep well construction to monitor and guide drilling conditions for improved performance and reduced costs. However, these measurements are of reduced value without a standard to aid in evaluation and decision making. A method is demonstrated whereby drill bit constraint models are used to interpret drilling response parameters. Drill rig parameter data for well GDC-36 at the Geysers Geothermal Field Power were acquired by Geysers Power Company and drilling contractor Kenai Drilling using Pason US DataHub and evaluated. Drilling parameters are evaluated using laboratory-validated rock reduction models for predicting the phenomenological response of drag bits (Detournay and Defourny, 1992) along with other model constraints in computational algorithms. The method is used to evaluate overall bit performance, monitor bit integrity, and detect the presence of drillstring vibrations and other conditions contributing to bit failure; comparisons are made to observations of bit wear and damage. The method will be applied in real-time to improve decision-making on subsequent wells and has applicability to development of advanced analytics on future geothermal wells using real-time electronic drilling recorder (EDR) data for improved performance and reduced drilling costs.
Leveraging public AI tools to explore systems biology resources in mathematical modeling
Predictive mathematical modeling is an essential part of systems biology and is interconnected with information management. Systems biology information is often stored in specialized formats to facilitate data storage and analysis. These formats are not designed for easy human readability and thus require specialized software to visualize and interpret results. Therefore, comprehending modeling and underlying networks and pathways is contingent on mastering systems biology tools, which is particularly challenging for users with no or little background in data science or system biology. To address this challenge, we investigated the usage of public Artificial Intelligence (AI) tools in exploring systems biology resources in mathematical modeling. We tested public AI’s understanding of mathematics in models, related systems biology data, and the complexity of model structures. Our approach can enhance the accessibility of systems biology for non-system biologists and help them understand systems biology without a deep learning curve.
Unsupervised Process Anomaly Detection and Identification Using the Leave-One-Variable-Out Approach
Automated anomaly detection and identification can signal equipment issues and pinpoint causes in large-scale industrial systems. For systems with limited failure history, unsupervised machine learning methods can be utilized as they do not require past failures. This study introduces the leave-one-variable-out (LOVO) model, which masks one variable at a time to predict the others, learning underlying process correlations. Detection performance was assessed with synthetic and experimental data, while identification performance used only synthetic data due to its ability to generate labeled anomaly types. For detection using synthetic data, the LOVO model generally outperformed comparative models; while using experimental data, the comparative methods outperformed the LOVO model. However, the comparative methods required selecting a latent size, and these conclusions pertain to using the optimal size. In practice, it would not be feasible to always select the optimal value, and incorrect selections impacted performance. In contrast, the LOVO model does not require a latent space. For identification using synthetic data, the LOVO model was slightly outperformed in interpretability and repeatability but still demonstrated impressive results. These outcomes suggest that the LOVO model is an effective model and may be more easily implemented without the challenging tuning process of selecting a latent size.
Q -score as a reliability measure for protein, nucleic acid and small-molecule atomic coordinate models derived from 3DEM maps
Atomic coordinate models are important for the interpretation of 3D maps produced with cryoEM and cryoET (3D electron microscopy; 3DEM). In addition to visual inspection of such maps and models, quantitative metrics can inform about the reliability of the atomic coordinates, in particular how well the model is supported by the experimentally determined 3DEM map. A recently introduced metric, Q-score, was shown to correlate well with the reported resolution of the map for well fitted models. Here, we present new statistical analyses of Q-score based on its application to ∼10 000 maps and models archived in the EMDB (Electron Microscopy Data Bank) and PDB (Protein Data Bank). Further, we introduce two new metrics based on Q-score to represent each map and model relative to all entries in the EMDB and those with similar resolution. We explore through illustrative examples of proteins, nucleic acids and small molecules how Q-scores can indicate whether the atomic coordinates are well fitted to 3DEM maps and also whether some parts of a map may be poorly resolved due to factors such as molecular flexibility, radiation damage and/or conformational heterogeneity. These examples and statistical analyses provide a basis for how Q-scores can be interpreted effectively in order to evaluate 3DEM maps and atomic coordinate models prior to publication and archiving.
Integrating multimodal data through interpretable heterogeneous ensembles
Motivation: Integrating multimodal data represents an effective approach to predicting biomedical characteristics, such as protein functions and disease outcomes. However, existing data integration approaches do not sufficiently address the heterogeneous semantics of multimodal data. In particular, early and intermediate approaches that rely on a uniform integrated representation reinforce the consensus among the modalities but may lose exclusive local information. The alternative late integration approach that can address this challenge has not been systematically studied for biomedical problems. Results: We propose Ensemble Integration (EI) as a novel systematic implementation of the late integration approach. EI infers local predictive models from the individual data modalities using appropriate algorithms and uses heterogeneous ensemble algorithms to integrate these local models into a global predictive model. We also propose a novel interpretation method for EI models. We tested EI on the problems of predicting protein function from multimodal STRING data and mortality due to coronavirus disease 2019 (COVID-19) from multimodal data in electronic health records. We found that EI accomplished its goal of producing significantly more accurate predictions than each individual modality. It also performed better than several established early integration methods for each of these problems. The interpretation of a representative EI model for COVID-19 mortality prediction identified several disease-relevant features, such as laboratory test (blood urea nitrogen and calcium) and vital sign measurements (minimum oxygen saturation) and demographics (age). These results demonstrated the effectiveness of the EI framework for biomedical data integration and predictive modeling.
SMART Deliverable 6.1.2a: Application of the ORION tool to the IBDP Carbon Storage Site
Forecasting and managing potential induced seismic activity is one of the challenges facing commercialscale geologic carbon sequestration (GCS), as well as other geologic energy extraction and byproduct disposal technologies. Historically, the process to develop robust, science-based forecasts of induced seismicity has required an integrated effort from experts in seismology, geomechanics, and reservoir engineering to manage data, develop and evaluate models of subsurface processes, and to calibrate and interpret the results from a range of models to understand site behavior relative to prescribed standards and in the context of uncertainty in geologic characterization data, forecasting models, and operational scenario uncertainty. The Operational Forecasting of Induced Seismicity (ORION) toolkit is an open-source, observation-based forecasting toolkit that is being co-developed by two U.S. DOE-funded initiatives: the National Risk Assessment Partnership (NRAP) and the Scienceinformed Machine Learning for Accelerating Real Time Decisions in Subsurface Applications (SMART) Initiative. ORION is designed to provide functionality to support decision making about seismic hazard analysis and risk management for GCS stakeholders ranging from the public to site operators to expert seismologists. The tool, which is written as open-source code in the Python programming language, is composed of a desktop graphical user interface (GUI) and an underlying forecasting engine. The forecasting engine uses available reservoir properties, well and fluid injection scenario details, and observed seismic catalog data as inputs to produce a set of temporal and spatio-temporal seismic forecasts.
Numerical Evaluation of Effective Thermal Conductivity of PCM with Metal Foam Incorporating Buoyancy Effects for Thermal Energy Storage
The thermal energy storage (TES) system has the capability to efficiently preserve thermal energy directly derived from the energy source, minimizing any conversion losses. Especially latent heat storage offers distinct advantages, including a substantial increase in energy storage density and minimization of temperature fluctuations within the plants. However, the phase change material (PCM) employed in latent heat storage has low thermal conductivity. Consequently, various studies are being conducted to enhance heat transfer. One approach to enhance heat transfer involves utilizing metal foam to maximize the heat transfer area. However, modeling metal foam with its intricate structure is a challenging task in numerical analysis. For this reason, ongoing research focuses on simplifying the modeling of metal foam. Nevertheless, fully encompassing all the characteristics of actual metal foam proves to be a challenging task for the simplified analytical model. The objective of this paper is to interpret the simple lattice metal foam analysis model from the perspective of behavior induced by buoyancy. When comparing the analysis results of solid PCM and liquid PCM with the same thermal conductivity under changes in porosity and gravity direction, we conducted an analysis to discern the trends in effective thermal conductivity that are overestimated due to convection. In the analysis, a constant heat flux of 10 kW and a constant surface boundary condition of 350 K were applied, and a sensitivity study regarding the mesh was conducted. The results indicate that, from the perspective of gravity in the simple lattice model, the solid analysis yields an effective thermal conductivity 29-47% higher compared to the liquid analysis. Additionally, as porosity increases, there is an observed increase of 24-33% in effective thermal conductivity.
Simple holographic models of black hole evaporation
Several recent papers have shown a close relationship between entanglement wedge reconstruction and the unitarity of black hole evaporation in AdS/CFT. The analysis of these papers however has a rather puzzling feature: all calculations are done using bulk dynamics which are essentially those Hawking used to predict information loss, but applying ideas from entanglement wedge reconstruction seems to suggest a Page curve which is consistent with information conservation. Why should two different calculations in the same model give different answers for the Page curve? In this note we present a new pair of models which clarify this situation. Our first model gives a holographic illustration of unitary black hole evaporation, in which the analogue of the Hawking radiation purifies itself as expected, and this purification is reproduced by the entanglement wedge analysis. Moreover a smooth black hole interior persists until the last stages the evaporation process. Our second model gives an alternative holographic interpretation of the situation where the bulk evolution leads to information loss: unlike in the models proposed so far, this bulk information loss is correctly reproduced by the entanglement wedge analysis. This serves as an illustration that quantum extremal surfaces are in some sense kinematic: the time-dependence of the entropy they compute depends on the choice of bulk dynamics. In both models no bulk quantum corrections need to be considered: classical extremal surfaces are enough to do the job. We argue that our first model is the one which gives the right analogy for what actually happens to evaporating black holes, but we also emphasize that any complete resolution of the information problem will require an understanding of non-perturbative bulk dynamics.