SEARCH · Engineering Papers

Results for “STATISTICAL MODELS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

All sources NASA NTRS DOE OSTI

DOE OSTI2024

Predictive Indicators of the Performance of Large Language Models

In several mission contexts, it is desirable to estimate the performance of large language models (LLMs) on tasks that we cannot run directly. In light of published “scaling laws” our hypothesis is that some tasks should be consistently more challenging than others based on characteristics of the task. The goal of this project was to begin quantifying how much information about LLM performance can be gained from the features of a model and a task. Two of our statistical models struggled to converge. Pass/fail test results may provide limited information for inference beyond model quality and task difficulty, but we see no evidence at this time for significant feature interaction effect sizes, arguing for simple models. Future work extending the models to capitalize on perplexity of ground truth answers is suggested. This project also introduces “Depth of Knowledge Variant Testing” as a strategy for more finely assessing language models on open domain question and answer tasks. We developed sets of questions that ask a language model to produce similar information while demonstrating increasing depth of knowledge, and also relabeled existing Q&A test questions with their depth of knowledge. Our results suggest further consideration of Bloom’s taxonomy and further refinement of prompts to properly elicit information at varying depths. In the course of this work, we set up a basic infrastructure for standardizing tasks and testing many language models on these tasks. In addition to testing the predictive quality of model features and performance across test suites, with this project we have introduced two new task features to contextualize each test question: the Dewey Classification main category of information covered, and the Bloom’s taxonomy level that corresponds to the depth of knowledge probed by the question. Splits across these and other features produced over five hundred task subtypes with distinct feature vectors, which we tested on half a dozen models.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2026

Bayesian chain graph models to characterize microbe-environment dynamics

Microbiome data require statistical models that can simultaneously decode microbes' reaction to the environment and interactions among microbes. While a multiresponse linear regression model seems like a straight-forward solution, we argue that treating it as a graphical model is problematic given that the regression coefficient matrix does not encode the conditional dependence structure between response and predictor nodes. This observation is especially important in biological settings when we have prior knowledge on the edges from specific experimental interventions that can only be properly encoded under a conditional dependence model. Here, we propose a chain graph model with two sets of nodes (predictors and responses) whose solution yields a graph with edges that indeed represent conditional dependence, thus agreeing with the experimenter's intuition on the average behavior of nodes under treatment. The solution to our model is sparse via the Bayesian linear regression (LASSO). In addition, we propose an adaptive extension so that different shrinkages can be applied to different edges to incorporate edge-specific prior knowledge. Our model is computationally inexpensive through an efficient Gibbs sampling algorithm and can account for binary, counting, and compositional responses via an appropriate hierarchical structure. We test the performance of our model in a variety of simulated datasets, thereby showing superior performance to state-of-the-art approaches. We further apply our model to human gut and soil microbial compositional datasets, and we highlight that CG-LASSO can estimate biologically meaningful network structures in the data.

compositional data↗

DOE OSTI2021

Lithium-ion battery physics and statistics-based state of health model

A pseudo-2d model using COMSOL Multiphysics® software is developed to simulate performance and performance degradation of Li-ion batteries consisting of layered and olivine cathodes with graphite anode when subjected to peak shaving grid service. Multiple degradation pathways are considered, including solid electrolyte interphase (SEI) formation and breakdown at the anode, cathode dissolution and its synergistic effect on SEI formation at the anode. The model is validated by simulating commercial cylindrical cell performance. A global model is developed to simulate performance across all chemistries, along with individual chemistry models using global model parameters as initial values. There is good agreement between these models for various optimization parameters such as SEI equilibrium potential, cathode dissolution exchange current density, solvent diffusivity in the SEI and SEI ionic conductivity. To circumvent time constraints related to the COMSOL model, a 0d global model is developed which fits data well and provides more clarity on differences in cathode dissolution exchange current density. Again, good agreement for various optimization parameters is obtained among the COMSOL global & individual chemistry models and the 0-d model. The lessons learned from the physics-based model is used to develop a top down statistics-based model using current, voltage and anode volumetric change per mole lithium intercalated, along with their interactions as degradation predictors. This model predicts out of sample degradation for multiple grid services and electric vehicle drive cycle with high accuracy and provides the pathway to develop an efficient battery management system combining machine learning and findings from physics-based computationally intensive algorithms.

Crawford, Aladsair J.↗

DOE OSTI2024

Using data-science approaches to unravel insights for enhanced transport of lithium ions in single-ion conducting polymer electrolyte

Solid polymer electrolytes have yet to achieve the an ionic conductivity > 1 mS/cm at room temperature for realistic applications. This target implies the need to reduce the effective energy barriers of ion transport in polymer electrolytes to around 20 kJ/mol. In this work, we combine information extracted from existing experimental results with theoretical calculations to provide insights into ion transport in single-ion conductors (SICs) with a focus on lithium ion SICs. Through the analysis of temperature-dependent ionic conductivity data obtained from the literature, we evaluate different methods of extracting energy barriers for lithium transport. The traditional Arrhenius fit to the temperature-dependent ionic conductivity data indicates that the Meyer-Neldel rule holds for SICs. However, the values of the fitting parameters remain unphysical. Our modified approach based on recent work (Macromolecules, 56, 15, 6051(2023)), which incorporates a fixed pre-exponential factor, reveals that the energy barriers exhibit temperature dependence over a wide range of temperatures. Using this approach, we identify a series of anions leading to the energy barriers less than 30 kJ/mol, which include trifluoromethane sulfonimide (TFSI), fluoromethane sulfonimide (FSI), and boron-based organic anions. In our efforts to design the next generation of anions, which can exhibit the energy barriers less than 20 kJ/mol, we focused on boron-containing SICs, and performed density functional theory (DFT) based calculations to connect the chemical structures via the binding energy of cation (lithium)-anion pairs with the experimentally derived effective energy barriers for ion transport. Not only have we identified a correlation between the binding energy and the energy barriers, but we also propose a strategy to design new boron-based anions by using the correlation. This combined approach involving experiments and theoretical calculations is capable of facilitating the identification of promising new anions, which can exhibit ionic conductivity $> 1$ mS/cm near room temperature, thereby expediting the development of novel superionic single-ion conducting polymer electrolytes. The published datasets include all the temperature-dependent ionic conductivity collected from the literature with literature DOIs, DFT calculated binding energies, and python scripts to analyze data, construct statistical models, and generate plots.

36 MATERIALS SCIENCE↗

DOE OSTI2021

Exact representations of many-body interactions with restricted-Boltzmann-machine neural networks

Restricted Boltzmann machines (RBMs) are simple statistical models defined on a bipartite graph which have been successfully used in studying more complicated many-body systems, both classical and quantum. In this work, we exploit the representation power of RBMs to provide an exact decomposition of many-body contact interactions into one-body operators coupled to discrete auxiliary fields. This construction generalizes the well known Hirsch's transform used for the Hubbard model to more complicated theories such as pionless effective field theory in nuclear physics, which we analyze in detail. Finally, we also discuss possible applications of our mapping for quantum annealing applications and conclude with some implications for RBM parameter optimization through machine learning.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2021

Use of Physics to Improve Solar Forecast: Physics-Informed Persistence Models for Simultaneously Forecasting GHI, DNI, and DHI

Observation-based statistical models have been widely used in forecasting solar energy; however, existing models often lack a clear relation to physics and are limited largely to global horizontal irradiance (GHI) forecasts over relatively short time horizons (< 1 hour). Incorporating physics into observation-based models, increasing forecast time horizons and developing a model system for forecasting not only GHI but also direct normal irradiance (DNI) and diffuse horizontal irradiance (DHI) remain challenging, especially under cloudy conditions because of complex cloud-radiation interactions. This work attempts to address these challenges by developing a hierarchy of four new physics-informed persistence models that can be used to simultaneously forecast GHI, DNI and DHI. The decade-long measurements (1998 to 2014) at the U.S. Department of Energy's Atmospheric Radiation Measurement (ARM)'s Southern Great Plains (SGP) Central Facility site are used to evaluate the performance of the new models. Overall, the results show that the new physics-informed forecast models generally outperform the simple and smart persistence models, and improve the forecast accuracy at lead times from 1.25 hours up to 6 hours. Further analysis reveals that the forecast error is highly related to the error and temporal variability of the assumed cloud predictor. The best model for forecasting different radiative components can be explained by the relationship between solar irradiances and cloud properties.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Artificial Intelligence Application to D and D - 20492

As aging facilities across the DOE complex await decommissioning, there is an ongoing need to understand any changes in the structural conditions. Many of these facilities were built over 50 years ago and, in some cases, these facilities have gone beyond the expected operational lifetime. Many facilities have been placed in a state of 'cold and dark,' sitting unused and awaiting decommissioning. Especially challenging are the aging facilities that provide unique operational/production capabilities to support critical DOE missions and cannot be shut down. In any of these scenarios, the structural integrity of these facilities may become compromised as time passes. It is critical that adequate inspections be performed on a continual basis and that the data collected undergoes sufficient analysis to support timely identification of any new or worsening structural issues as well as prompt needed maintenance and repairs to maintain the facilities in a safe condition. In recent days, Artificial Intelligence (AI) [1] and its application to various domains are growing at fast speed. FIU is performing research in this area and exploring the associated technologies to solve nuclear decommissioning problems. Artificial intelligence refers to the capability of a program to autonomously act, react and adapt to the working environment. AI enables the machine to behave like humans and perform the cognitive functions such as 'learning' and 'problem solving'. AI systems gradually moving from traditional approaches (algorithms and expert systems) towards more efficient and advanced technologies (machine learning [1] and deep learning [2] [3]). AI is the study of algorithms and statistical models that is being used by computers to perform specific tasks without using explicit instructions. FIU is working to develop a pilot-scale infrastructure to implement structural health monitoring using AI technologies with focus on machine learning, deep learning. This research is focused on Computer Vision/Image Classification area of AI applications. This can also be expanded to other areas of AI related to Object Recognition and Character Recognition in images. In addition to utilizing existing data sets, FIU will collect and investigate image and video data using FIU test-bed mockups to monitor structural health of the facility. Resulting data will be processed and analyzed using machine learning/deep learning technologies. The proposed pilot system is intended to serve as a starting point to engage the DOE field sites on related data sets and their decision making needs. It is anticipated that proposed machine learning/deep learning technologies can be effectively employed using anomaly detection to solve EM challenges in surveillance and maintenance of the D and D facilities. FIU will work with research stakeholders to identify applications at various sites and other DOE facilities. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

DOE OSTI2025

First 𝛽-Delayed Two-Neutron Spectroscopy of the 𝑟-Process Nucleus 134 In and Observation of the 𝑖 13/2 Single-Particle Neutron State in 133 Sn

This manuscript reports on the direct observation of a 𝛽-delayed two-neutron emission in a study of 134 In at the ISOLDE Decay Station using neutron spectroscopy. We also report on the first measurement in 𝛽 − decay of the long-sought 13/2 + excited state in 133 Sn, attributed to be the neutron single-particle 𝑖 13/2 orbital. The observation of sequential neutron emission is used to extract the relative population of the 𝑖 13/2 state, which was found to be much smaller than the predictions of the statistical model. The experiment was possible because of the innovative use of a neutron array with neutron discrimination and interaction tracking capabilities. This is the first study of the details of the two-neutron emission for a nucleus, which belongs to the 𝑟-process path. Understanding 𝛽-delayed two-neutron emission probabilities is essential to validate models used in astrophysical 𝑟-process nucleosynthesis calculations. Observing two-neutron emissions in 𝛽 − decay paves the way for new experiments to study energy and angular correlations for 𝛽-delayed multineutron emitters.

Beta decay↗

DOE OSTI2021

Comparing Emulation Methods for Computer Models with High Dimensional Output

This Master’s Capstone project will present a comparison of statistical models for computer simulation studies. The four models included in this comparison study were chosen for both their proven and diverse methodologies. We will present a case study on hurricane flood data in the Delaware bay which highlights the strengths and weaknesses of each model when applied to a very large spatial field. As computers have gotten faster, we have become interested in modeling increasingly large spatial fields in both size and resolution. Statistical algorithms that are able to efficiently handle these fields have never been more important. We therefore find this comparison to be extremely topical.

42 ENGINEERING↗

DOE OSTI2020

A Bayesian approach to evaluation of soil biogeochemical models

Abstract. To make predictions about the carbon cycling consequences of rising global surface temperatures, Earth system scientists rely on mathematical soil biogeochemical models (SBMs). However, it is not clear which models have better predictive accuracy, and a rigorous quantitative approach for comparing and validating the predictions has yet to be established. In this study, we present a Bayesian approach to SBM comparison that can be incorporated into a statistical model selection framework. We compared the fits of linear and nonlinear SBMs to soil respiration data compiled in a recent meta-analysis of soil warming field experiments. Fit quality was quantified using Bayesian goodness-of-fit metrics, including the widely applicable information criterion (WAIC) and leave-one-out cross validation (LOO). We found that the linear model generally outperformed the nonlinear model at fitting the meta-analysis data set. Both WAIC and LOO computed higher overfitting risk and effective numbers of parameters for the nonlinear model compared to the linear model, conditional on the data set. Goodness of fit for both models generally improved when they were initialized with lower and more realistic steady-state soil organic carbon densities. Still, testing whether linear models offer definitively superior predictive performance over nonlinear models on a global scale will require comparisons with additional site-specific data sets of suitable size and dimensionality. Such comparisons can build upon the approach defined in this study to make more rigorous statistical determinations about model accuracy while leveraging emerging data sets, such as those from long-term ecological research experiments.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Late-formed haloes prefer to host quiescent central galaxies – I. Observational results

ABSTRACT The star formation and quenching of central galaxies are regulated by the assembly histories of their host haloes. In this work, we use the central stellar mass to halo mass ratio as a proxy of halo formation time, and we devise three different models, from the physical hydrodynamical simulation to the empirical statistical model, to demonstrate its robustness. With this proxy, we inferred the dependence of the central galaxy properties on the formation time of their host haloes using the SDSS main galaxy sample, where central galaxies are identified with the halo-based group finder. We found that central galaxies living in late-formed haloes have higher quiescent fractions and lower spiral fractions than their early-formed counterparts by $\lesssim 8~{{\ \rm per\ cent}}$ . Finally, we demonstrate that the group finding algorithm has a negligible impact on our results.

Astronomy & Astrophysics↗

DOE OSTI2020

Joint Estimation of Behind-the-Meter Solar Generation in a Community

Distribution grid planning, control, and optimization require accurate estimation of solar photovoltaic (PV) generation and electric load in the system. Most of the small residential solar PV systems are installed behind-the-meter making only the net load readings available to the utilities. This paper presents an unsupervised framework for joint disaggregation of the net load readings of a group of customers into the solar PV generation and electric load. Our algorithm synergistically combines a physical PV system performance model for individual solar PV generation estimation with a statistical model for joint load estimation. The electric loads for a group of customers are estimated jointly by a mixed hidden Markov model (MHMM) which enables modeling the general load consumption behavior present in all customers while acknowledging the individual differences. At the same time, the model can capture the change in load patterns over a time period by the hidden Markov states. The proposed algorithm is also capable of estimating the key technical parameters of the solar PV systems. Our proposed method is evaluated using the net load, electric load, and solar PV generation data gathered from residential customers located in Austin, Texas. Testing results show that our proposed method reduces the mean squared error of state-of-the-art net-load disaggregation algorithms by 67%.

behind-the-meter solar generation↗

DOE OSTI2022

A Process-based Model with Temperature, Water, and Lab-derived Data Improves Predictions of Daily Culex pipiens/restuans Mosquito Density

While the number of human cases of mosquito-borne diseases has increased in North America in the last decade, accurate modeling of mosquito population density has remained a challenge. Longitudinal mosquito trap data over the many years needed for model calibration, and validation is relatively rare. In particular, capturing the relative changes in mosquito abundance across seasons is necessary for predicting the risk of disease spread as it varies from year to year. We developed a discrete, semi-stochastic, mechanistic process-based mosquito population model that captures life-cycle egg, larva, pupa, adult stages, and diapause for Culex pipiens (Diptera, Culicidae) and Culex restuans (Diptera, Culicidae) mosquito populations. This model combines known models for development and survival into a fully connected age-structured model that can reproduce mosquito population dynamics. Mosquito development through these stages is a function of time, temperature, daylight hours, and aquatic habitat availability. The time-dependent parameters are informed by both laboratory studies and mosquito trap data from the Greater Toronto Area. The model incorporates city-wide water-body gauge and precipitation data as a proxy for aquatic habitat. This approach accounts for the nonlinear interaction of temperature and aquatic habitat variability on the mosquito life stages. We demonstrate that the full model predicts the yearly variations in mosquito populations better than a statistical model using the same data sources. This improvement in modeling mosquito abundance can help guide interventions for reducing mosquito abundance in mitigating mosquito-borne diseases like West Nile virus.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2024

Harmonizing tau positron emission tomography in Alzheimer's disease: The CenTauR scale and the joint propagation model

Abstract INTRODUCTION Tau‐positron emission tomography (PET) outcome data of patients with Alzheimer's disease (AD) cannot currently be meaningfully compared or combined when different tracers are used due to differences in tracer properties, instrumentation, and methods of analysis. METHODS Using head‐to‐head data from five cohorts with tau PET radiotracers designed to target tau deposition in AD, we tested a joint propagation model (JPM) to harmonize quantification (units termed “CenTauR” [CTR]). JPM is a statistical model that simultaneously models the relationships between head‐to‐head and anchor point data. JPM was compared to a linear regression approach analogous to the one used in the amyloid PET Centiloid scale. RESULTS A strong linear relationship was observed between CTR values across brain regions. Using the JPM approach, CTR estimates were similar to, but more accurate than, those derived using the linear regression approach. DISCUSSION Preliminary findings using the JPM support the development and adoption of a universal scale for tau‐PET quantification. Highlights Tested a novel joint propagation model (JPM) to harmonize quantification of tau PET. Units of common scale are termed “CenTauRs”. Tested a Centiloid‐like linear regression approach. Using five cohorts with head‐to‐head tau PET, JPM outperformed linearregressionbased approach. Strong linear relationship was observed between CenTauRs values across brain regions.

Neurosciences & Neurology↗

DOE OSTI2021

Pro‐ L * ‐ A Probabilistic L * Mapping Tool for Ground Observations

Abstract Both ground and space observations are used extensively in the modeling of space weather processes within the Earth’s magnetosphere. In radiation belt physics modeling, one of the key phase‐space coordinates is L *, which indicates the location of the drift paths of energetic electrons. Global magnetic field models allow a subset of locations on the ground (mainly subauroral) to be mapped along field lines to a location in space and transformed into L *, provided that the initial ground location maps to a closed drift path. This allows observations from ground, or low‐altitude space‐based platforms to be mapped into space in order to inform radiation belt modeling. Many data‐based magnetic field models exist; however, these models can significantly disagree on mapped L * values for a single point on the ground, during both quiet times and storms. We present a state of the art probabilistic L * mapping tool, Pro‐ L *, which produces probability distributions for L * corresponding to a given ground location. Pro‐ L * has been calculated for a high resolution magnetic latitude by magnetic local time grid in the Earth’s Northern Hemisphere. We have developed the probabilistic model using 11 years of L * calculations for seven widely used magnetic field models. Usage of the tool is highlighted for both event studies and statistical models, and we demonstrate a number of potential applications.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2025

Ponderosa pine hydraulic stress predicts more extreme wildfire behavior under future conditions in Bandelier National Monument, New Mexico

Background Live fuel moisture contributes to wildfire spread and reflects plant stress and physiological traits. The anticipated change in live fuel moisture under future conditions is likely non-linear, owing to physiological plant thresholds in water hydraulics. We constructed a mechanistic model of live fuel moisture’s response to water stress to understand the impact of future climate on live fuel moisture. We first gathered data on plant physiology and live fuel moisture for Pinus ponderosa at Bandelier National Monument, NM, USA, and modeled their relationship. We then parameterized a mechanistic plant hydrodynamics model (FATES-HYDRO) to simulate changes in plant stress and a statistical model to simulate the resulting impact on live fuel moisture. We then simulated FATES-HYDRO under future climate anomalies (SSP2-4.5 and SSP5-8.5: 2080–2100) to understand the change in plant stress and estimate its impact on live fuel moisture. Results We found that the number of days below crucial thresholds of live fuel moisture (100% and 79%) increased from contemporary levels (< 100%: 72 days, < 79%: 1.4 days) under SSP2-4.5 (< 100%: 185 days, < 79%: 10.2 day) and increased exponentially under SSP5-8.5 (< 100%: 215 days, < 79%: 65 days). We found that gross primary productivity decreased under both future climate scenarios (contemporary: 336 g C m −2 , SSP2-4.5: 203 g C m −2 , SSP5-8.5: 243 g C m −2 ); however, spring productivity increased under SSP5-8.5, potentially altering fuel loading. We additionally see a potentially lethal loss of conductivity in hydraulic P. ponderosa under SSP5-8.5. Conclusions The overall increase in plant water stress (as represented by loss of hydraulic conductivity and leaf water potential) and lower live fuel moisture appear to be driven by reduced precipitation during late summer monsoons typical of the region, extending the fire season later in the year. We predict increasing variability in the P. ponderosa wildfire regime under both climate projections driven by changing productivity, rising mortality, and an overall decrease in live fuel moisture.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Deterministic Calibration of MFiX-PIC, Part 1: Settling Bed

The Particle-in-cell (PIC) numerical approach for modeling granular solids in fluid flow has gained significant interest in recent years. Valued for its often shorter time-to-solution, the PIC formulation relies on modeling statistical groupings of particles called parcels in cooperation with a solids stress model to affect local solids velocity. This is in contrast to the discrete element model (DEM) where every particle in a system is modelled individually and directly coupled to local solids velocity through Newtonian mechanics. The U.S. Department of Energy (DOE), National Energy Technology Laboratory (NETL) develops and maintains Multiphase Flow with Interphase eXchanges (MFiX), a collection of open-source computational fluid dynamics (CFD) solvers. Included in the MFiX suite are traditional two-fluid model (TFM) and DEM solvers, and a recently added PIC solver (NETL, 2021). In general, PIC methodologies offer an accuracy trade-off in lieu of computational speed; and therefore, it is important to assess the credibility of MFiX-PIC simulations. For this purpose, a systematic verification, validation and uncertainty quantification (VVUQ) effort was initiated at NETL to assess the new PIC solver

42 ENGINEERING↗

DOE OSTI2023

Improving and Assessing the Quality of Uncertainty Quantification in Deep Learning

Deep learning (DL) models have enjoyed increased attention in recent years because of their powerful predictive capabilities. While many successes have been achieved, standard deep learning methods suffer from a lack of uncertainty quantification (UQ). While the development of methods for producing UQ from DL models is an active area of current research, little attention has been given to the quality of the UQ produced by such methods. In order to deploy DL models to high-consequence applications, high-quality UQ is necessary. This report details the research and development conducted as part of a Laboratory Directed Research and Development (LDRD) project at Sandia National Laboratories. The focus of this project is to develop a framework of methods and metrics for the principled assessment of UQ quality in DL models. This report presents an overview of UQ quality assessment in traditional statistical modeling and describes why this approach is difficult to apply in DL contexts. An assessment on relatively simple simulated data is presented to demonstrate that UQ quality can differ greatly between DL models trained on the same data. A method for simulating image data that can then be used for UQ quality assessment is described. A general method for simulating realistic data for the purpose of assessing a model’s UQ quality is also presented. A Bayesian uncertainty framework for understanding uncertainty and existing metrics is described. Research that came out of collaborations with two university partners are discussed along with a software toolkit that is currently being developed to implement the UQ quality assessment framework as well as serve as a general guide to incorporating UQ into DL applications.

97 MATHEMATICS AND COMPUTING↗