SEARCH · Engineering Papers

Results for “hierarchical models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

All sources NASA NTRS DOE OSTI

DOE OSTI2021

Water Cycle-Driven Infectious Diseases as Multiscale, Reliable, Continuously Updating Water Cycle Sensors

We propose a novel synthesis of observational and simulated data (climatological and biological) to enhance understanding of the real-world interplay between climate (here, the water cycle) and the epidemiology of water cycle-driven infectious disease. Aligning with Focal Area 2, predictive modeling using AI techniques, we will develop systems of hierarchical models to discover latent features of the water cycle. Our approach will leverage state-of-the-art in Artificial Intelligence (AI) to measure the degree to which climate change-driven shifts in water cycle can be predicted by supplementing sparse and irregular climate data with water cycle-driven infectious disease resources.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

Hot Droughts and Forest Tree Dynamics in the Amazon - Statistical Models, Scripts, Data, and Outputs

This package contains data, outputs, equations, and R scripts for analyses for manuscript entitled "Hot droughts in the Amazon: A window to a future hypertropical climate" by J. Chambers et al., in particular it contains statistical models and analyses for the INPA BIONTE tree mortality study. The Models folder contains details for all statistical models in PDF files. The Scripts folder contains the R scripts for Bayesian Hierarchical Models (two text files) and SEMs (one text file) are separate and reasonably annotated. All data associated with these scripts are in the data folder. The Data folder contains two of the three CSV files used for the analyses and are called by the R scripts. Two of them are part of published datasets (`BIONTE_mortality-rates.csv` from Lima et al. 2024, DOI:10.15486/ngt/1898910 and `SPEI.csv` from Pastorello et al. 2023 DOI:10.15486/ngt/1958257) and also provided in this package for convenience (please see the corresponding datasets for usage and citation terms). The third dataset (`BIONTE_gapfilled_wd.csv`) contains sensitive information and can be obtained by contacting the manuscript lead author. The Outputs folder contains the two output files that provide extra information about the analyses. The file `figuresFeb2025d.pdf` contains all the figures from the manuscript - captions are in the manuscript. The file `ChambersMS.pdf` contains primary results from Bayesian statistical models, regression analyses, and validation steps applied to the tree mortality data from the INPA experiments. The document includes visual summaries, model diagnostics, and leave-one-out (LOO) validation results. A breakdown of file contents can be found in the README file that is part of this package.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Spatial Bayesian models project shifts in suitable habitat for Pacific Northwest tree species under climate change

Abstract We developed spatial Bayesian hierarchical models to assess potential climate change impacts on suitable habitat for five important tree species in the Pacific northwestern United States (California, Oregon, and Washington). Individual‐species models were fit with presence–absence data from forest inventory field plots and spatial relationships were specified through a conditional autoregressive model. This modeling approach allowed us to visualize uncertainty in response curves, map current and future prediction uncertainty, and provide interval estimates for change. Upward elevational or northward latitudinal shifts in climatically suitable habitat were projected for all species. Climate change impacts were the most damaging for noble fir ( Abies procera ), for which 79%–100% of the current range was projected to become climatically unsuitable by the 2080s. Although coastal Douglas‐fir ( Pseudotsuga menziesii var. menziesii ) has been projected by others to gain habitat in Canada, within our study area we projected a net loss of climatically suitable habitat (ca. 8000–31,400 km 2 ) under three of four future climate scenarios. A net loss in habitat was also projected for Oregon white oak ( Quercus garryana ) under three of four scenarios, with 40%–60% of the current range becoming unsuitable. Although there was no net loss of habitat for forest land blue oak under any scenario, other factors like competition may inhibit blue oak ( Quercus douglasii ) and white oak from occupying areas projected to increase in climatic suitability. Additionally, between 13% and 32% of blue oak's current range was projected to become unsuitable; some of these areas aligned with dieback following the 2012–2015 California drought, which our data set predates. Unlike the other four species, we projected a 17%–25% increase in climatically suitable habitat for California black oak ( Quercus kelloggii ), although 1%–20% of the current range was still projected to become unsuitable. Our findings indicate that, although some species will face more pressure in tracking climatically suitable habitat than others, climate change will impact the location of suitable habitat for many species.

Kralicek, Karin↗

DOE OSTI2023

Development of a wind turbine model and simulation platform using an acausal approach: Multiphysics modeling, validation, and control

This article presents the development of the Control-oriented, Reconfigurable, and Acausal Floating Turbine Simulator (CRAFTS). CRAFTS has a modular, hierarchical model architecture that enables rapid and accurate simulation of wind turbines. The architecture facilitates the incorporation of model variants, and its system reconfiguration features help simulate multiple design variants. CRAFTS also supports the integration of models developed on a causality-free platform (e.g., Modelica®) with existing causal models. This article focuses on the validation of a land-based wind turbine models against OpenFAST, an industry-standard platform, for several test cases. Closed-loop scenarios are also tested using the standard ROSCO controller and compared against OpenFAST. In addition, a nonlinear controller developed in our prior work is also evaluated. The test cases demonstrate the user-friendly and computationally efficient capabilities of CRAFTS to facilitate control co-design, assist in incorporating multiphysics models, be adaptable to design variants, and allow for rapid simulations to validate models and evaluate controllers.

17 WIND ENERGY↗

DOE OSTI2021

Understanding implications of cathode architecture on energy density of solid-state batteries

Next generation solid-state batteries (SSB) will need to leverage high voltage cathodes, as well as metallic anodes to achieve the realistic performance targets necessary to replace liquid electrolyte-based batteries in cutting-edge applications including electric vehicles. However, limitations arising from mass and charge transports, kinetics and chemo-mechanical degradation at the electrode | electrolyte interface limit the performance of present day SSBs. Optimizing composite cathode architecture, which is an integral part of solid-state batteries, is vital to realize the high-energy density and high-performance goals for next-generation solid-state batteries. Additionally, cathode architecture needs to be optimized for high loadings of active material, well-percolated ion and electron transport pathways and increased resilience against electrochemical stresses. This paper provides a first report of framework for geometric modeling of composite cathode architectures and evaluates the impact of cathode architecture on cell-level energy density using hierarchical models. Packing around primary and secondary active material particles are simulated for a range of active material particle size and solid electrolyte size distributions in the composite cathode. Impact of packing architecture on processing parameters of a given cathode composition and thickness, as well as on achievable energy density is evaluated for a range of commonly used solid electrolyte and cathode materials. Overall, the proposed framework offers a facile exploratory methodology for establishing initial metrics for scalable processing of practical and competent SSBs.

25 ENERGY STORAGE↗

DOE OSTI2021

Using Radiative Convective Equilibrium to Explore Clouds and Climate in the Community Atmosphere Model

Abstract Characteristics of, and fundamental differences between, the radiative‐convective equilibrium (RCE) climate states following the Radiative‐Convective Equilibrium Model Intercomparison Project (RCEMIP) protocols in the Community Atmosphere Model version 5 (CAM5) and version 6 (CAM6) are presented. This paper explores the characteristics of clouds, moisture, precipitation and circulation in the RCE state, as well as the tropical response to surface warming, in CAM5 and CAM6 with different parameterizations. Overall, CAM5 simulates higher precipitation rates that result in larger global average precipitation, despite lower outgoing longwave radiation compared to CAM6. Differences in the structure of clouds, particularly the amount and vertical location of cloud liquid, exist between the CAM versions and can, in part, be related to distinct representations of shallow convection and boundary layer processes. Both CAM5 and CAM6 simulate similar peaks in cloud fraction, relative humidity, and cloud ice, linked to the usage of a similar deep convection parameterization. These anvil clouds rise and decrease in extent in response to surface warming. More generally, extreme precipitation, aggregation of convection, and climate sensitivity increase with warming in both CAM5 and CAM6. This analysis provides a benchmark for future studies that explore clouds, convection, and climate in CAM with the RCEMIP protocols now available in the Community Earth System Model. These results are discussed within the context of realistic climate simulations using CAM5 and CAM6, highlighting the usefulness of a hierarchical modeling approach to understanding model and parameterization sensitivities to inform model development efforts.

Reed, Kevin A.↗

DOE OSTI2021

Automating Bayesian inference and design to quantify acoustic particle levitation

Self-propulsion of micro- and nanoparticles powered by ultrasound provides an attractive strategy for the remote manipulation of colloidal matter using biocompatible energy inputs. Quantitative understanding of particle motion and its dependence on size, shape, and composition requires accurate characterization of the acoustic field, which depends sensitively on the experimental setup. Here, we show how automated experiments based on Bayesian inference and design can accurately and efficiently characterize the acoustic field within resonant chambers used to propel acoustic nanomotors. Repeated cycles of observation, inference, and design (OID) are guided by a physical model that describes the rate at which levitating particles approach the nodal plane. Using video microscopy, we observe the relaxation of tracer particles to this plane following the application of the acoustic field. We use sequential Monte Carlo methods to infer model parameters such as the amplitude and frequency of the resonant chamber while accounting for particle-level measurement noise and population-level heterogeneity in the field. Guided by simulated outcomes, we select the optimal design for the next experiment as to maximize the information gain in the relevant parameters. We show how this iterative process serves to discriminate between competing hypotheses and efficiently converges to accurate parameter estimates using only few automated experiments. We discuss the need for model criticism to ensure the validity of the guiding model throughout automated cycles of observation, inference, and design. Furthermore, this work demonstrates how Bayesian methods can learn the parameters of nonlinear, hierarchical models used to describe video microscopy data of active colloids.

42 ENGINEERING↗

DOE OSTI2022

A Variational Inference Approach to Inverse Problems with Gamma Hyperpriors

Hierarchical models with gamma hyperpriors provide a flexible, sparse-promoting framework to bridge L 1 and L 2 regularizations in Bayesian formulations to inverse problems. Despite the Bayesian motivation for these models, existing methodologies are limited to maximum a posteriori estimation. The potential to perform uncertainty quantification has not yet been realized. This paper introduces a variational iterative alternating scheme for hierarchical inverse problems with gamma hyperpriors. The proposed variational inference approach yields accurate reconstruction, provides meaningful uncertainty quantification, and is easy to implement. In addition, it lends itself naturally to conduct model selection for the choice of hyperparameters. Here, we illustrate the performance of our methodology in several computed examples, including a deconvolution problem and sparse identification of dynamical systems from time series data.

Bayesian shrinkage↗

DOE OSTI2024

The Digital Engineering Vision for DOME: Facilitating Design, Deployment, and Operations [Poster]

DOME is a planned microreactor test facility at INL’s Materials and Fuels Complex. It is a complex system with several interdependent sub-systems such as the reactor (up to 20 MWth), radioactive confinement, temperature and pressure regulation system, ventilation system, etc. The engineering design process for such a system traditionally involves several documents from various sources and the system information is scattered across these documents. Digital engineering represents a paradigm shift through which systems are designed using digital models and integrated data. The digital engineering vision for DOME utilizes a model-based systems engineering (MBSE) approach. The system architecture, physical components, control logic, and verification experiments are all designed using MathWorks MATLAB and Simulink. This hierarchical model can combine data from multiple sources at various levels of abstraction. It can be used to simulate the facility’s operations and to test the system using different sets of parameters. Its capabilities can be expanded by interfacing it with high-fidelity multi-physics models, risk analysis tools, etc. The same model can evolve into a digital twin that can monitor operations and conduct predictive analysis using real-time sensor data from the facility. The eventual goal of this effort is to transform the end-to-end engineering of nuclear facilities in every phase of their lifecycle, including design, deployment, and operations.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

DOE OSTI2024

SinhaRoy_TechPresentation_2024 [Slides]

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

DOE OSTI2025

Persistent Sampling: Enhancing the Efficiency of Sequential Monte Carlo

Sequential Monte Carlo (SMC) samplers are powerful tools for Bayesian inference but suffer from high computational costs due to their reliance on large particle ensembles for accurate estimates. We introduce persistent sampling (PS), an extension of SMC that systematically retains and reuses particles from all prior iterations to construct a growing, weighted ensemble. By leveraging multiple importance sampling and resampling from a mixture of historical distributions, PS mitigates the need for excessively large particle counts, directly addressing key limitations of SMC such as particle impoverishment and mode collapse. Crucially, PS achieves this without additional likelihood evaluations-weights for persistent particles are computed using cached likelihood values. This framework not only yields more accurate posterior approximations but also produces marginal likelihood estimates with significantly lower variance, enhancing reliability in model comparison. Furthermore, the persistent ensemble enables efficient adaptation of transition kernels by leveraging a larger, decorrelated particle pool. Experiments on high-dimensional Gaussian mixtures, hierarchical models, and non-convex targets demonstrate that PS consistently outperforms standard SMC and related variants, including recycled and waste-free SMC, achieving substantial reductions in mean squared error for posterior expectations and evidence estimates, all at reduced computational cost. PS thus establishes itself as a robust, scalable, and efficient alternative for complex Bayesian inference tasks.

Karamanis, Minas↗

DOE OSTI2025

Machine learning-enabled multiscale modeling of mechanical deformation of aluminum and Al-SiC nanocomposites

A machine learning-enabled multiscale framework is developed for modeling the mechanical response of both pure metal and nanoparticle-reinforced metal matrix nanocomposites (MMNCs). Using aluminum–silicon carbide (Al-SiC) as an example MMNC, atomistic simulations reveal three distinct deformation mechanisms (i.e., defect-free, dislocation-based, and interface separation) governed by the interfaces between the Al matrix and SiC nanoparticles. As compared with single crystal Al, the lattice undergoes a more abrupt failure once the dislocation network becomes extensive and void nucleation initiates, whereas in Al-SiC, nanoparticle interfaces enable a more gradual progression of damage. These mechanisms are captured through a combined classification-regression neural network surrogate model that bridges atomic-scale insights with continuum-scale finite element analysis. Machine learning-enabled multiscale modeling of pure Al accurately predicted strain localization and confirmed by in-situ scanning electron microscopic tensile testing on perforated Al specimens. This study underscores the promise of integrating physics-informed machine learning with hierarchical modeling to capture the interface dominated phenomena and guide the design of advanced MMNCs.

Al-SiC↗

DOE OSTI2021

Machine Learning Assisted Safety Modeling and Analysis of Advanced Reactors

With the advances in computational power and numerical methods, analysts can now rely on first-principle simulations to predict ultra-fine details in a variety of applications. Advances in machine learning (ML) have produced algorithms that can now learn high-level abstractions via hierarchical models. This project aims to leverage advances in ML techniques and the available high-resolution simulation data to develop a novel modeling and simulation (M\&S) methodology for reactor safety analysis. While application-agnostic ML techniques are available, complex physics constraints need to be incorporated into ML techniques to build ML-based closures for computationally efficient predictive simulations. This project intends to develop a physics-guided data-driven multi-scale methodology for M\&S of advanced reactors. The project focuses on thermal fluid (T/F) phenomena, which play major roles in advanced reactor safety. Specifically, we propose a data-driven coarse-mesh turbulence model based on local flow features for the transient analysis of thermal mixing and stratification in a sodium-cooled fast reactor (SFR). The model has a coarse-mesh setup to ensure computational efficiency, while it is trained by fine-mesh computational fluid dynamics (CFD) data with Reynolds-averaged Navier-Stokes (RANS) turbulence model to ensure accuracy. Three different neural networks are developed and tested for loss-of-flow transients in the hot pool of SFR, i.e. the densely connected convolutional neural network (DCNN), long-short-term-memory network based on proper orthogonal decomposition (POD-LSTM), and the DCNN informed by LSTM (DCNN-LSTM). The performances of these three neural networks are evaluated based on baseline models. The DCNN-LSTM model has been chosen for further hyperparameter optimization. Furthermore, based on a simplified two-dimensional case, uncertainty quantification (UQ) of the developed ML-based closure are investigated with three methods, i.e. Monte Carlo dropout, deep ensemble, and Bayesian neural network. The developed ML-based turbulent viscosity closure relation based on deep ensemble is then integrated into the system analysis module SAM and serves as a term in the conservation equations. Such a SAM-ML based procedure guarantees that the obtained results are consistent with the physical constraints of the thermal-fluid system. The SAM-ML simulation on the same loss-of-flow transient showed comparable accuracy with the CFD simulation but with a much coarser mesh setup. Last but not least, the ML-based closure improvement with the support of higher-fidelity data from large eddy simulation (LES) is discussed. As a first step towards this direction, a baseline LES simulation is performed to obtain comparable data with RANS results. Based on the early results, future investigation on further improving the ML-based closure is discussed. We believe the developed approach that combines scientific machine learning with nuclear system analysis code can benefit the advanced reactor community as more accurate safety analyses will better characterize reactor safety margins and reduce licensing efforts.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2020

Perfect quantum state transfer on diamond fractal graphs

In the quest for designing novel protocols for quantum information and quantum computation, an important goal is to achieve perfect quantum state transfer for systems beyond the well-known one- dimensional cases, such as 1D spin chains. Here, we use methods from fractal analysis and probability to find a new class of quantum spin chains on fractal-like graphs (known as diamond fractals) which support perfect quantum state transfer and which have a wide range of different Hausdorff and spectral dimensions. The resulting systems are spin networks combining Dyson hierarchical model structure with transverse permutation symmetries of varying order.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Formation and evolution of protostellar accretion discs – II. From 3D simulation to a simple semi-analytic model of Class 0/I discs

Here we use a 3D radiative non-ideal magnetohydrodynamic simulation to investigate the formation and evolution of a young protostellar disc from a magnetized pre-stellar core. The simulation covers the first ${\sim }10\, {\rm kyr}$ after protostar formation and shows a massive, weakly magnetized disc with radius that initially grows and then saturates at ${\sim }30\, {\rm au}$. The disc is gravitationally unstable with prominent large-amplitude spiral arms. We use our simulation results and a series of physical arguments to construct a predictive and quantitative physical picture of Class 0/I protostellar disc evolution from several aspects, including (i) the angular-momentum redistribution in the disc, self-regulated by gravitational instability to make most of the disc marginally unstable; (ii) the thermal profile of the disc, well-approximated by a balance between radiative cooling and accretion heating; and (iii) the magnetic-field strength and magnetic-braking rate inside the disc, regulated by non-ideal magnetic diffusion. Using these physical insights, we build a simple 1D semi-analytic model of disc evolution. We show that this 1D model, when coupled to a computationally inexpensive simulation for the evolution of the surrounding pseudo-disc, can be used reliably to predict disc evolution in the Class 0/I phase. The predicted long-term evolution of disc size, which saturates at ${\sim }30\, {\rm au}$ and eventually shrinks, is consistent with a recent observational survey of Class 0/I discs. Such hierarchical modelling of disc evolution circumvents the computational difficulty of tracing disc evolution through Class 0/I phase with direct, numerically converged simulations.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2022

Spatiotemporal Modeling of Real World Backsheets Field Survey Data: Hierarchical (Multilevel) Generalized Additive Models

Assessing photovoltaic module backsheet durability is critical to increasing module lifetime. Laboratory-based accelerating testing has recently failed to predict large scale failures of widely adopted polymeric materials. Additionally, there is a growing concern on characterizing the non-uniformity of field exposure. Therefore, data from field surveys are critical to assess the performance of component lifetimes. Using a documented field survey protocol, 19 field surveys were conducted. The focus of this survey strategy is to investigate spatial continuity in degradation modes. By combining field survey data with real-time satellite weather data, stressor / response models have been trained. Generalized additive Models (GAM) model was created to predict the value of degradation based on measured predictors. Two different GAM constructions were testing using different implementations of basis splines. The model includes variables on the environmental stressors of the system and the location of each measurement in the PV mounting structure. The incorporation of hierarchical structure into the models allowed for material specific degradation rates, while maintaining the assumption of a global trend. The model performed well with an adjusted R2 of 0.975 for yellowness index prediction.

backsheet↗

DOE OSTI2026

A Statistician’s Overview of Physics-Informed Neural Networks for Spatio-Temporal Data

The recent success of deep neural network models with physical constraints (so-called, Physics-Informed Neural Networks, PINNs) has led to renewed interest in the incorporation of mechanistic information in predictive models. Statisticians and others have long been interested in this problem, which has led to several practical and innovative solutions dating back decades. In this overview, we focus on the problem of data-driven prediction and inference of dynamic spatio-temporal processes that include mechanistic information, such as would be available from partial differential equations, with a strong focus on the quantification of uncertainty associated with data, process, and parameters. Here, we give a brief review of several paradigms and focus our attention on Bayesian implementations given they naturally accommodate uncertainty quantification. We then show that it is straight-forward to include the Bayesian PINN (B-PINN) within the Bayesian hierarchical model (BHM) framework that has long been considered for modeling dynamic spatio-temporal processes. Such a BHM-PINN is illustrated via a simulation study in which a latent nonlinear Burgers’ equation PDE governs the dynamics of Poisson distributed spatio-temporal data. Supplementary materials for this article are available online, including a standardized description of the materials available for reproducing the work.

Bayesian↗

DOE OSTI2026

MTL_TX: A Multi-Task Transformer Model for Improved Radiation Time-Series Estimation

Controlling radiation doses at potential radioactive facilities is critical to ensuring the safety of both personnel and the public. At the Thomas Jefferson National Accelerator Facility (JLab), multiple sensors are deployed around the three experimental halls to monitor key parameters, including single-beam current, energy levels, current leakage, and radiation values during accelerator operations. In this study, we developed a Multi-task Transformer model, MTL_TX, to accurately estimate radiation doses at sensor locations based on historical data, with the aim of enhancing safety in accelerator facilities and surrounding public areas. To improve estimation accuracy, we integrated two innovative components into the proposed model: hierarchical feature embedding (HFE) and multi-level decomposition attention (MDA). Additionally, the multi-task learning (MTL) framework effectively leverages correlations among multiple sensors, enabling individual estimations for each sensor. MTL_TX achieved outstanding results on data collected in 2018, with an MSE of 0.1464, an RMSE of 0.2353, and an R 2 score of 0.8584. Furthermore, when trained on 2018 data, MTL_TX exhibited excellent generalization capability to unseen datasets from 2016 to 2019, achieving an MSE of 0.1407, an RMSE of 0.2263, and an R 2 score of 0.8831. These results demonstrate a significant improvement over existing state-of-the-art models.

Transformer↗