Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “variational analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

CMOS-Based Single-Cycle in-Memory XOR/XNOR

Big data applications are on the rise, and so is the number of data centers. The ever-increasing massive data pool needs to be periodically backed up in a secure environment. Moreover, a massive amount of securely backed-up data is required for training binary convolutional neural networks for image classification. XOR and XNOR operations are essential for large-scale data copy verification, encryption, and classification algorithms. The disproportionate speed of existing compute and memory units makes the von Neumann architecture inefficient to perform these Boolean operations. Compute-in-memory (CiM) has proved to be an optimum approach for such bulk computations. The existing CiM-based XOR/XNOR techniques either require multiple cycles for computing or add to the complexity of the fabrication process. Here, we propose a CMOS-based hardware topology for single-cycle in-memory XOR/XNOR operations. Our design provides at least 2× improvement in the latency compared with other existing CMOS-compatible solutions. We verify the proposed system through circuit/system-level simulations and evaluate its robustness using a 5000-point Monte Carlo variation analysis. This all-CMOS design paves the way for practical implementation of CiM XOR/XNOR at scaled technology nodes.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Quasi-stationary Planetary Scale Waves in Modern Climate Models

We evaluate climate model simulations of geopotential height at the largest space-time scales, considering the first Fourier components (in longitude) of long-term climatological means. Quasi-stationary planetary scale waves emerge from this analysis. Variations of these waves are important components of climate change, for example associated with regional drought. Systematic examination of their long-term climatology provides context for understanding their evolution in time. We compare four reanalysis datasets with “historical runs” from the latest version of the Coupled Model Intercomparison Project (CMIP) and find general agreement, but we also identify model errors outside the range of both observational uncertainty and the uncertainty implied by interannual variability. Errors in wave phase have possible implications for climate model projections of regional climate and of shifting weather patterns. One model in the set we examine, originally created nearly 20 years before the others, exhibits noticeably greater errors.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

CMDV-RRM: Representation of Clouds and Convection Across Scales in E3SM (Final Report)

We have made three accomplishments as a participant of the LLNL-led CMDV-RRM project. The first is the derivation of 3D high-resolution atmospheric variational analysis (VAR) at 2 x 2 km resolution by integrating ARM data and operational analysis for a domain of approximately 450 x 400 km centered at the ARM SGP facility for several MC3E convective events and used the analyzed data to evaluate E3SM RRM and as forcing data for E3SM SCM. The second accomplishment is the demonstration of elevated maximum moist static energy during the night over the ARM SGP that was not accounted for in the default E3SM convection scheme. The third accomplishment is the explanation of the cause of the dry and warm biases over the SGP common to many climate models by using ARM data. We found that the precipitation deficit associated with lack of strong rainfall events in the summer is the main cause of the warm bias over the SGP.

42 ENGINEERING↗
DOE OSTI2024

Development of the ARM Lagrangian Large-Scale Forcing Data (ARMLAGTRAJ) Value-Added Product Based on the lagtraj Framework

The Atmospheric Radiation Measurement (ARM) large-scale forcing data developed based on the constrained variational analysis (VARANAL) value-added product (VAP) (Zhang and Lin 1997, Zhang et al. 2001, Xie et al. 2004, Tang et al. 2019) has been widely used for single-column models (SCMs), cloud-resolving models (CRMs), and large-eddy simulation models (LESs) to understand and improve physical processes in models. Recently, the U.S. Department of Energy (DOE) ARM user facility conducted several major field campaigns using ship-based moving observational platforms. For example, the Marine ARM GPCI Investigation of Clouds (MAGIC) field campaign focused on the role of subtropical marine-boundary layer (MBL) clouds, and the Multidisciplinary Drifting Observatory for the Study of Arctic Climate (MOSAiC) field campaign aimed to improve understanding of the coupled climate systems in the Arctic. Observations from moving platforms are critical to provide a comprehensive characterization of coupled-system processes associated with all stages of the cloud and/or sea-ice life cycle. Traditional ARM large-scale forcing data have been developed at fixed locations. They need to be extended to include these moving platforms to address data needs for ship-based field campaigns or to support LES modeling in a Lagrangian framework. With these considerations in mind, we develop ARM-type Lagrangian large-scale forcing data sets based on the lagtraj framework (Boeing et al. 2020) with notable enhancements in generating forcings that are more suitable for ARM field campaigns. The lagtraj is a novel tool that generates forcings for LES and SCM simulation in both Lagrangian and Eulerian perspective. This technical report focuses on the major changes we performed on the lagtraj algorithm and provides an overview of the ARM Lagrangian Large-Scale Forcing Data (ARMLAGTRAJ) value-added products.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Instability of Nagaoka State and Quantum Phase Transition via Kinetic Frustration Control

We investigate the Nagaoka-Thouless (NT) ferromagnetic instability in the strongly interacting t-t' Hubbard model by continuously breaking particle-hole symmetry on a tunable square-triangular lattice geometry. We use an analytic approach to show that the fully spin-polarized state becomes unstable to a metastable spin-polaron when the kinetic frustration t'/t exceeds a critical, dimension-dependent value. Large-scale density matrix renormalization group (DMRG) simulations reveal a quantum phase transition from the NT ferromagnet to a spiral spin-density wave, which evolves continuously into the Haerter-Shastry antiferromagnet in the large-frustration limit. Remarkably, this transition remains robust at low but finite hole density, making it accessible in cold-atom and moiré Hubbard platforms under strong interactions. A variational analysis further captures the instability mechanism at finite density via frustration-induced magnon band deformation.

FOS: Physical sciences↗
DOE OSTI2024

Environmental controls on isolated convection during the Amazonian wet season

The Amazon rainforest is a vital component of the global climate system, influencing the hydrological cycle and tropical circulation. However, understanding and modeling the evolution of convection in this region remain a scientific challenge. Here, we assess the environmental conditions associated with shallow, congestus, and isolated deep convection days during the wet season (December to April), employing measurements from the Green Ocean Amazon 2014–2015 (GoAmazon2014/5) experiment and large-scale wind fields from the constrained variational analysis. Composites of deep days show moister than average conditions below 3 km early in the morning. Analyzing the water budget at the surface through observations only, we estimated the water vapor convergence term as a residual of the water balance closure. Convergence remains nearly zero during the deep days until early afternoon (13:00 LST), when it becomes a dominant factor in the water budget. At 14:00 LST, the deep days experience a robust upward large-scale vertical velocity, especially above 4 km, which supports the shallow-to-deep convective transition occurring around 16:00–17:00 LST. In contrast, shallow and congestus days exhibit drier pre-convective conditions, along with diurnal water vapor divergence and large-scale subsidence that extend from the surface to the lower free troposphere. Moreover, afternoon precipitation exhibits the strongest linear correlation (0.6) with large-scale vertical velocity, nearly double the magnitude observed for other environmental factors, even moisture, at different levels and periods of the day. Precipitation also exhibits a moderate increase with low-level wind shear, while upper-level shear has a relatively minor negative impact on convection.

Environmental Sciences & Ecology↗
DOE OSTI2024

Physics and chemistry from parsimonious representations: image analysis via invariant variational autoencoders

Electron, optical, and scanning probe microscopy methods are generating ever increasing volume of image data containing information on atomic and mesoscale structures and functionalities. This necessitates the development of the machine learning methods for discovery of physical and chemical phenomena from the data, such as manifestations of symmetry breaking phenomena in electron and scanning tunneling microscopy images, or variability of the nanoparticles. Variational autoencoders (VAEs) are emerging as a powerful paradigm for the unsupervised data analysis, allowing to disentangle the factors of variability and discover optimal parsimonious representation. Here, we summarize recent developments in VAEs, covering the basic principles and intuition behind the VAEs. The invariant VAEs are introduced as an approach to accommodate scale and translation invariances present in imaging data and separate known factors of variations from the ones to be discovered. We further describe the opportunities enabled by the control over VAE architecture, including conditional, semi-supervised, and joint VAEs. Several case studies of VAE applications for toy models and experimental datasets in Scanning Transmission Electron Microscopy are discussed, emphasizing the deep connection between VAE and basic physical principles. Python codes and datasets discussed in this article are available at https://github.com/saimani5/VAE-tutorials and can be used by researchers as an application guide when applying these to their own datasets.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Modeling and Analysis of Climate Variation Effects on Fixed-Bed Direct Air Capture Systems

This poster was presented at the 2024 FECM/ NETL Carbon Management Research Project Review Meeting held August 5th-9th in Pittsburgh, PA. The poster discusses the modeling, optimization, and analysis of a solid sorbent based direct air capture process. Analysis of the performance of the system when exposed to varying ambient conditions is also presented.

Hughes, Ryan↗
DOE OSTI2022

Variational encoder geostatistical analysis (VEGAS) with an application to large scale riverine bathymetry

Estimation of riverbed profiles, also known as bathymetry, plays a vital role in many applications, such as safe and efficient inland navigation, prediction of bank erosion, land subsidence, and flood risk management. The high cost and complex logistics of direct bathymetry surveys, i.e, depth imaging, have encouraged the use of indirect measurements such as surface flow velocities. However, estimating high-resolution bathymetry from indirect measurements is an inverse problem that can be computationally challenging. Here, we propose a reduced-order model (ROM) based approach that utilizes a variational autoencoder (VAE), a type of deep neural network with a narrow layer in the middle, to compress bathymetry and flow velocity information and accelerate bathymetry inverse problems from flow velocity measurements. In our application, the shallow-water equations (SWE) with appropriate boundary conditions (BCs), e.g., the discharge and/or the free surface elevation, constitute the forward problem, to predict flow velocity. Then, ROMs of the SWEs are constructed on a nonlinear manifold of low dimensionality through a variational encoder and the bathymetry inversion problem is derived on the low-dimensional latent space in a Hierarchical Bayesian setting. Further, the reformulation allows variational inference with a small number (e.g., $\mathscr{O}$ (100) of ROM runs and efficient uncertainty quantification. We have tested our inversion approach on a one-mile reach of the Savannah River, GA, USA. Once the neural network is trained (offline stage), the proposed technique can perform the inversion operation orders of magnitude faster than traditional inversion methods that are commonly based on linear projections, such as principal component analysis (PCA), or the principal component geostatistical approach (PCGA). Furthermore, tests show that the algorithm can estimate the bathymetry with good accuracy even with sparse flow velocity measurements.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Comprehensive Genome-Wide Natural Variation and Expression Analysis of Tubby-like Proteins Gene Family in Brachypodium distachyon

The Tubby-like proteins (TLPs) gene family is a group of transcription factors found in both animals and plants. In this study, we identified twelve B. distachyon TLPs, divided into six groups based on conserved domains and evolutionary relationships. We predicted cis-regulatory elements involved in light, hormone, and biotic and abiotic stresses. The expression patterns in response to light and hormones revealed that BdTLP3, 4, 7, and 14 are involved in light responses, and BdTLP1 is involved in ABA responses. Furthermore, BdTLP2, 7, 9, and 13 are expressed throughout vegetative and reproductive stages, whereas BdTLP1, 3, 5, and 14 are expressed at germinating grains and early vegetative development, and BdTLP4, 6, 8, and 10 are expressed at the early reproduction stage. The natural variation in the eleven most diverged B. distachyon lines revealed high conservation levels of BdTLP1-6 to high variation in BdTLP7-14 proteins. Based on diversifying selection, we identified amino acids in BdTLP1, 3, 8, and 13, potentially substantially affecting protein functions. This analysis provided valuable information for further functional studies to understand the regulation, pathways involved, and mechanism of BdTLPs.

Plant Sciences↗
DOE OSTI2023

Industrial PLC Network Modeling and Parameter Identification Using Sensitivity Analysis and Mean Field Variational Inference

A multiple input multiple output (MIMO) power line communication (PLC) model for industrial facilities was developed that uses the physics of a bottom-up model but can be calibrated like top-down models. The PLC model considers 4-conductor cables (three-phase conductors and a ground conductor) and has several load types, including motor loads. The model is calibrated to data using mean field variational inference with a sensitivity analysis to reduce the parameter space. The results show that the inference method can accurately identify many of the model parameters, and the model is accurate even when the network is modified.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

From Intermolecular Interaction Energies and Observable Shifts to Component Contributions and Back Again: A Tale of Variational Energy Decomposition Analysis

Quantum chemistry in the form of density functional theory (DFT) calculations is a powerful numerical experiment for predicting intermolecular interaction energies. However, no chemical insight is gained in this way beyond predictions of observables. Energy decomposition analysis (EDA) can quantitatively bridge this gap by providing values for the chemical drivers of the interactions, such as permanent electrostatics, Pauli repulsion, dispersion, and charge transfer. These energetic contributions are identified by performing DFT calculations with constraints that disable components of the interaction. This review describes the second-generation version of the absolutely localized molecular orbital EDA (ALMO-EDA-II). The effects of different physical contributions on changes in observables such as structure and vibrational frequencies upon complex formation are characterized via the adiabatic EDA. Example applications include red- versus blue-shifting hydrogen bonds; the bonding and frequency shifts of CO, N 2 , and BF bound to a [Ru(II)(NH 3 ) 5 ] 2 + moiety; and the nature of the strongly bound complexes between pyridine and the benzene and naphthalene radical cations. Additionally, the use of ALMO-EDA-II to benchmark and guide the development of advanced force fields for molecular simulation is illustrated with the recent, very promising, MB-UCB potential.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

Data analytics for leak detection in a subcritical boiler

For decades, boiler leaks have been the leading cause of forced outages in the coal-fired unit. The leak occurrences are currently escalating since the existing plants must satisfy faster-ramping rates to support grid operation. Data analytics including Principal Component Analysis, Canonical Variate, and Fisher Discriminant Analysis were combined for detecting and characterizing the leak in a commercial 650 MW subcritical coal-fired power plant. The combined approach was shown to be highly effective in the fault investigation that would not have been easily achieved by an individual technique. The variability in both training and validation datasets was first evaluated using PCA. Then, the CV-FDA was employed to discriminate among faults, and to categorize the processed data into two main groups: no-leak (0) and leak (1), providing the timeframe and location of the leak occurrence. Furthermore, about 8,014 observations from 81 process variables were initially included in the calculation, while the variable count was reduced to 4 with less than 1% misclassification rate in total observations. Finally, the leak was isolated in the waterwall section. Thus, the outcome of this research may provide early detection and isolation of faulty operations in the coal-fired power plant that involves a considerable number of process variables.

20 FOSSIL-FUELED POWER PLANTS↗
DOE OSTI2024

Implementing Superresolution of Nonstationary Tides with Wavelets: An Introduction to CWT_Multi

Abstract Tides are often nonstationary due to nonastronomical influences. Investigating variable tidal properties implies a trade-off between separating adjacent frequencies (using long analysis windows) and resolving their time variations (short analysis windows). Previous continuous wavelet transform (CWT) tidal methods resolved tidal species. Here, we present CWT_Multi, a MATLAB code that 1) uses CWT linearity (via the “response coefficient method”) to implement superresolution, i.e., resolving tidal constituents beyond the Rayleigh criterion; 2) provides a Munk–Hasselmann constituent selection criterion appropriate for superresolution; and 3) introduces an objective, time-variable form of inference (“dynamic inference”) based on time-varying data properties. CWT_Multi resolves tidal species on time scales of days, and multiple constituents per species with fortnightly filters. It outputs astronomical phase lags and admittances, analyzes multiple records, and provides power spectra of the signal(s), residual(s), and reconstruction(s); confidence limits; and signal-to-noise ratios. Artificial data and water levels from the Lower Columbia River Estuary (LCRE) and San Francisco Bay Delta (SFBD) are used to test CWT_Multi and compare it to harmonic analysis programs NS_Tide and UTide. CWT_Multi provides superior reconstruction, detiding, dynamic analysis utility, and time resolution of constituents (but with broader confidence limits). Dynamic inference resolves closely spaced constituents (like K 1 , S 1 , and P 1 ) on fortnightly time scales, quantifying impacts of diel power peaking (with a 24-h period, like S 1 ) on water levels in the LCRE. CWT_Multi also helps quantify the impacts of high flows and a salt barrier closing on tidal properties in the SFBD. On the other hand, CWT_Multi does not excel at prediction, and results depend on analysis details, as for any method applied to nonstationary data. Significance Statement Ocean tides, especially in coastal and estuarine systems, are often nonstationary, in the sense that the mean and standard deviation of tidal properties vary over time, usually in response to some nontidal process. We introduce here a MATLAB code, CWT_Multi, that uses wavelet transforms to resolve both tidal species and constituents on time scales from a few days to months. Our code accommodates multiple scalar time series and has typical tidal analysis features like constituent selection and inference, plus two forms of uncertainty analyses. It is flexible, allowing the user to adapt analysis properties to diverse datasets. CWT_Multi is applicable to many problems involving time-variable tides, including sea level rise, compound flooding, sediment transport, and wetland habitat analyses. Application to vector data is a straightforward extension, but further development of our uncertainty analysis is merited. Because nonstationary tidal analysis is rapidly advancing, we also define the features of a “well-formed” analysis code.

Lobo, Matthew↗
DOE OSTI2026

The Sensitivity of Variational Bayesian Neural Network Performance to Hyperparameters

In scientific applications, predictive modeling is often of limited use without accurate uncertainty quantification (UQ) to indicate when a model may be extrapolating or when more data needs to be collected. Bayesian Neural Networks (BNNs) produce predictive uncertainty by propagating uncertainty in neural network (NN) weights and offer the promise of obtaining not only an accurate predictive model but also accurate UQ. However, in practice, obtaining accurate UQ with BNNs is difficult due in part to the approximations used for model training (such as those made in variational inference) and in part to the need to choose a suitable set of hyperparameters; these hyperparameters outnumber those needed for traditional NNs and often have opaque effects on the results. We aim to shed light on the effects of hyperparameter choices for variational BNNs by performing a global sensitivity analysis of variational BNN performance under varying hyperparameter settings. Our results indicate that many of the hyperparameters interact with each other to affect both predictive accuracy and UQ. For improved usage of variational BNNs in real-world applications, we suggest that thorough hyperparameter tuning, including tuning of prior hyperparameters and loss function parameters, is essential for accurate UQ in variational BNNs.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Monte Carlo Perturbation Analysis of Fuel Temperature Variations in the MCNP Model of the Annular Core Research Reactor

The Annular Core Research Reactor (ACRR) Monte Carlo N-Particle (MCNP) model is used by ACRR reactor operators and experiment designers at Sandia National Laboratories for a variety of computational calculations ranging from reactor kinetics parameter estimates and safety analyses to experimental planning. To understand the dominant source of uncertainty within the MCNP model, perturbations in temperature were applied to individual ACRR MCNP fuel rods. Fuel rod temperatures were randomly sampled from a uniform distribution from operational temperatures to quantify temperature-related uncertainty effects. Stochastic mixing was used to blend the cross sections of the desired temperatures using the MCNP continuous and Thermal Neutron Scattering Treatment [S(α,β)] libraries in ENDF/B-VII.1. Furthermore, this uncertainty analysis produced a 640 row × 640 column correlation and covariance matrix of the neutron energy spectra. Positive covariance was produced around the 1-MeV region and the 0.2-eV region. Correlation was found in the thermal and fast energy regions, but no correlation was observed in the slowing-down energy region because interactions in this region are not dominated by fuel.

ACRR↗
DOE OSTI2022

Variational and phase response analysis for limit cycles with hard boundaries, with applications to neuromechanical control problems

Motor systems show an overall robustness, but because they are highly nonlinear, understanding how they achieve robustness is difficult. In many rhythmic systems, robustness against perturbations involves response of both the shape and the timing of the trajectory. This makes the study of robustness even more challenging. To understand how a motor system produces robust behaviors in a variable environment, we consider a neuromechanical model of motor patterns in the feeding apparatus of the marine mollusk Aplysia californica (Shaw et al. in J Comput Neurosci 38(1):25–51, 2015; Lyttle et al. in Biol Cybern 111(1):25–47, 2017). We established in (Wang et al. in SIAM J Appl Dyn Syst 20(2):701–744, 2021. https://doi.org/10.1137/20M1344974) the tools for studying combined shape and timing responses of limit cycle systems under sustained perturbations and here apply them to study robustness of the neuromechanical model against increased mechanical load during swallowing. Interestingly, we discover that nonlinear biomechanical properties confer resilience by immediately increasing resistance to applied loads. In contrast, the effect of changed sensory feedback signal is significantly delayed by the firing rates’ hard boundary properties. Our analysis suggests that sensory feedback contributes to robustness in swallowing primarily by shifting the timing of neural activation involved in the power stroke of the motor cycle (retraction). This effect enables the system to generate stronger retractor muscle forces to compensate for the increased load, and hence achieve strong robustness. The approaches that we are applying to understanding a neuromechanical model in Aplysia, and the results that we have obtained, are likely to provide insights into the function of other motor systems that encounter changing mechanical loads and hard boundaries, both due to mechanical and neuronal firing properties.

59 BASIC BIOLOGICAL SCIENCES↗