Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “variational analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Long‐Term Large‐Scale Atmospheric Forcing Data From Three‐Dimensional Constrained Variational Analysis for the ARM SGP Site

Here, this study presents a long‐term three‐dimensional large‐scale forcing data set (VARANAL3D) derived from the three‐dimensional constrained variational analysis (3DCVA) method at the Atmospheric Radiation Measurement (ARM) program Southern Great Plains (SGP) site from 2004 to 2018. Building on the same input data sets as the conventional continuous forcing data set (VARANAL), VARANAL3D maintains overall consistency in domain‐averaged fields while introducing spatial variability, offering critical insights into the influence of mesoscale synoptic systems on cloud‐related processes. Evaluations are conducted across four cloud and precipitation regimes: Clear‐sky, Shallow‐clouds, Afternoon‐precipitation, and Nocturnal‐precipitation, presenting high consistency of the domain‐mean forcing data sets while emphasizing the role of subdomain forcing variability particularly in precipitating regimes. Single column model (SCM) simulations demonstrate that subdomain VARANAL3D forcing improves cloud and precipitation representation, with the ensemble outperforming domain‐mean forcing in three cloudy and precipitating regimes. Overall, these results highlight VARANAL3D's value for investigating the impacts of spatial variability of large‐scale forcing on atmospheric processes. The VARANAL3D data set provides new opportunities for evaluating model physics, advancing the development of scale‐aware parameterizations and deepening our understanding of cloud and precipitation dynamics.

Environmental sciences↗
DOE OSTI2025

3D Continuous Forcing Dataset from 3D Constrained Variational Analysis at SGP

The continuous 3D large-scale forcing (VARANAL3D) data set derived from 3D constrained variational analysis (3DCVA) extends the conventional constrained variational analysis method by incorporating multiple sub-columns within the analysis domain. This advancement introduces spatial variability into the large-scale forcing fields, thereby enriching the data set’s applicability. The VARANAL3D data set spans from 2004 to 2018 and covers a region of 5˚×4.5˚ domain around the ARM SGP site. The analysis domain is divided into 10×9 sub-columns with 0.5˚ resolution. The 3D large-scale forcing data provides necessary variables to drive and evaluate single-column models (SCM), cloud-resolving models (CRM) ,and large-eddy simulations (LES), as well as information for testing model sensitivity to spatial variability of the large-scale forcing data, facilitating more rigorous testing and refinement of physical processes in SCM/CRM/LES.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Developing High-Resolution Constrained Variational Analysis of Vertical Velocity and Advective Tendencies within the Range of ARM Scanning Radars at the SGP

Research progress has been made in two areas. One is about the incorporation of the ARM variationally constrained objective analysis method into the WRF GSI data assimilation system. The other is the development of high resolution ARM data and its applications. Specially, we developed a new data assimilation algorithm by adding dynamical constraints to the WRF GSI data assimilation system using hybrid ensemble variational system to derive 3-D fields of atmospheric dynamics and thermodynamics over the ARM SGP sites. We also developed 4x4 km high-resolution constrained variational analysis data over the SGP during the PECAN and made them available to the community. Details are in the attached report.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Inverse Analysis with Variational Autoencoders: A Comparison of Shallow and Deep Networks

Inverse problems are applied to determine unknown properties by matching observational data with a physical model that often takes many parameters as input. To overcome the underconstrained nature of inverse problems and achieve good performance, an approach is presented involving regularization with a technique known as a variational autoencoder (VAE), which is trained to map a high-dimensional parameter space with a complex structure to a low-dimensional latent space with a simple structure. We apply this approach to unconditioned realizations of the parameters (heterogeneous hydraulic fields) for a hydrogeological inverse problem. Two types of hydraulic conductivity fields are used to evaluate the characterization for the different levels of heterogeneity complexity of the physical inputs. This approach keeps the computational cost of generating the training data low. The reason is unconditioned realizations neither rely on the observational data used to perform the inverse analysis nor require any groundwater flow model forward runs. In addition, this approach applies regularization on a low-dimensional latent space from the VAE and increases optimization efficiency through automatic differentiation. Furthermore, two different neural network (NN) structures are tested for their utility in using the VAE for inverse analysis. The performance of a deep, convolutional neural network strongly depends on the dimensionality of the latent space, which requires tuning. In contrast, a shallow, dense neural network provides consistently accurate characterization without tuning. Furthermore, our approach evaluates the advantages of the shallow, dense neural network over the deep, convolutional one and enables future application to a wide range of inverse problems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Cluster Variation Method Analysis of Correlations and Entropy in BCC Solid Solutions

Solid solutions occur when multiple chemical species share sites of a common crystal lattice. Although the single site occupation is random, chemical interaction preferences bias the occupation probabilities of neighboring sites, and this bias reduced the entropy of mixing below its ideal value. Sufficiently strong bias leads to symmetry-breaking phase transitions. Here, we apply the cluster variation method to explore solid solutions on body centered cubic lattices in the context of two specific compounds that exhibit opposite ordering trends. Employing density functional theory to model the energetics, we show that CuZn exhibits an order-disorder transition to the CsCl prototype structure, while AlLi instead takes the NaTl prototype structure, and we evaluate their temperature-dependent order parameters, correlations and entropies.

36 MATERIALS SCIENCE↗
DOE OSTI2025

DESI DR1 Ly$α$ forest: 3D full-shape analysis and cosmological constraints

We perform an analysis of the full shapes of Lyman-$α$ (Ly$α$) forest correlation functions measured from the first data release (DR1) of the Dark Energy Spectroscopic Instrument (DESI). Our analysis focuses on measuring the Alcock-Paczynski (AP) effect and the cosmic growth rate times the amplitude of matter fluctuations in spheres of $8$$h^{-1}\text{Mpc}$, $fσ_8$. We validate our measurements using two different sets of mocks, a series of data splits, and a large set of analysis variations, which were first performed blinded. Our analysis constrains the ratio $D_M/D_H(z_\mathrm{eff})=4.525\pm0.071$, where $D_H=c/H(z)$ is the Hubble distance, $D_M$ is the transverse comoving distance, and the effective redshift is $z_\mathrm{eff}=2.33$. This is a factor of $2.4$ tighter than the Baryon Acoustic Oscillation (BAO) constraint from the same data. When combining with Ly$α$ BAO constraints from DESI DR2, we obtain the ratios $D_H(z_\mathrm{eff})/r_d=8.646\pm0.077$ and $D_M(z_\mathrm{eff})/r_d=38.90\pm0.38$, where $r_d$ is the sound horizon at the drag epoch. We also measure $fσ_8(z_\mathrm{eff}) = 0.37\; ^{+0.055}_{-0.065} \,(\mathrm{stat})\, \pm 0.033 \,(\mathrm{sys})$, but we do not use it for cosmological inference due to difficulties in its validation with mocks. In $Λ$CDM, our measurements are consistent with both cosmic microwave background (CMB) and galaxy clustering constraints. Using a nucleosynthesis prior but no CMB anisotropy information, we measure the Hubble constant to be $H_0 = 68.3\pm 1.6\;\,{\rm km\,s^{-1}\,Mpc^{-1}}$ within $Λ$CDM. Finally, we show that Ly$α$ forest AP measurements can help improve constraints on the dark energy equation of state, and are expected to play an important role in upcoming DESI analyses.

Cuceu, Andrei [LBL, Berkeley; Chicago U., KICP] (O↗
DOE OSTI2022

Neural simulation-based inference approach for characterizing the Galactic Center γ-ray excess

The nature of the Fermi γ-ray Galactic Center Excess (GCE) has remained a persistent mystery for over a decade. Although the excess is broadly compatible with emission expected due to dark matter annihilation, an explanation in terms of a population of unresolved astrophysical point sources e.g., millisecond pulsars, remains viable. The effort to uncover the origin of the GCE is hampered in particular by an incomplete understanding of diffuse emission of Galactic origin. This can lead to spurious features that make it difficult to robustly differentiate smooth emission, as expected for a dark matter origin, from more “clumpy” emission expected from a population of relatively bright, unresolved point sources. Here, we use recent advancements in the field of simulation-based inference, in particular density estimation techniques using normalizing flows, in order to characterize the contribution of modeled components, including unresolved point source populations, to the GCE. Compared to traditional techniques based on the statistical distribution of photon counts, our machine learning-based method is able to utilize more of the information contained in a given model of the Galactic Center emission, and in particular can perform posterior parameter estimation while accounting for pixel-to-pixel spatial correlations in the γ-ray map. This makes the method demonstrably more resilient to certain forms of model misspecification. On application to Fermi data, the method generically attributes a smaller fraction of the GCE flux to unresolved point sources when compared to traditional approaches. We nevertheless infer such a contribution to make up a non-negligible fraction of the GCE across all analysis variations considered, with at least $38^{+9}_{-19}$% of the excess attributed to unresolved point sources in our baseline analysis.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Gradient-Based Novelty Detection Boosted by Self-Supervised Binary Classification

Novelty detection aims to automatically identify out-of-distribution (OOD) data, without any prior knowledge of them. It is a critical step in data monitoring, behavior analysis and other applications, helping enable continual learning in the field. Conventional methods of OOD detection perform multi-variate analysis on an ensemble of data or features, and usually resort to the supervision with OOD data to improve the accuracy. In reality, such supervision is impractical as one cannot anticipate the anomalous data. In this paper, we propose a novel, self-supervised approach that does not rely on any pre-defined OOD data: (1) The new method evaluates the Mahalanobis distance of the gradients between the in-distribution and OOD data. (2) It is assisted by a self-supervised binary classifier to guide the label selection to generate the gradients, and maximize the Mahalanobis distance. In the evaluation with multiple datasets, such as CIFAR-10, CIFAR-100, SVHN and TinyImageNet, the proposed approach consistently outperforms state-of-the-art supervised and unsupervised methods in the area under the receiver operating characteristic (AUROC) and area under the precision-recall curve (AUPR) metrics. We further demonstrate that this detector is able to accurately learn one OOD class in continual learning.

Sun, Jingbo↗
DOE OSTI2023

Acute stress reduces population-level metabolic and proteomic variation

Abstract Background Variation in omics data due to intrinsic biological stochasticity is often viewed as a challenging and undesirable feature of complex systems analyses. In fact, numerous statistical methods are utilized to minimize the variation among biological replicates. Results We demonstrate that the common statistics relative standard deviation (RSD) and coefficient of variation (CV), which are often used for quality control or part of a larger pipeline in omics analyses, can also be used as a metric of a physiological stress response. Using an approach we term Replicate Variation Analysis (RVA), we demonstrate that acute physiological stress leads to feature-wide canalization of CV profiles of metabolomes and proteomes across biological replicates. Canalization is the repression of variation between replicates, which increases phenotypic similarity. Multiple in-house mass spectrometry omics datasets in addition to publicly available data were analyzed to assess changes in CV profiles in plants, animals, and microorganisms. In addition, proteomics data sets were evaluated utilizing RVA to identify functionality of reduced CV proteins. Conclusions RVA provides a foundation for understanding omics level shifts that occur in response to cellular stress. This approach to data analysis helps characterize stress response and recovery, and could be deployed to detect populations under stress, monitor health status, and conduct environmental monitoring.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Blackout Diffusion: Generative Diffusion Models in Discrete-State Spaces

Typical generative diffusion models rely on a Gaussian diffusion process for training the backward transformations, which can then be used to generate samples from Gaussian noise. However, real world data often takes place in discrete-state spaces, including many scientific applications. Here, we develop a theoretical formulation for arbitrary discrete-state Markov processes in the forward diffusion process using exact (as opposed to variational) analysis. We relate the theory to the existing continuous-state Gaussian diffusion as well as other approaches to discrete diffusion, and identify the corresponding reverse-time stochastic process and score function in the continuous-time setting, and the reverse-time mapping in the discrete-time setting. As an example of this framework, we introduce “Blackout Diffusion”, which learns to produce samples from an empty image instead of from noise. Numerical experiments on the CIFAR-10, Binarized MNIST, and CelebA datasets confirm the feasibility of our approach. Generalizing from specific (Gaussian) forward processes to discrete-state processes without a variational approximation sheds light on how to interpret diffusion models, which we discuss.

Santos, Javier E.↗
DOE OSTI2025

Domain Decomposition for Integer Optimal Control with Total Variation Regularization

Total variation integer optimal control problems admit solutions and necessary optimality conditions via geometric variational analysis. In spite of the existence of said solutions, algorithms which solve the discretized objective suffer from high numerical cost associated with the combinatorial nature of integer programming. Hence, such methods are often limited to small and medium-sized problems. We propose a globally convergent, coordinate descent–inspired algorithm that allows tractable subproblem solutions restricted to a partition of the domain. Our decomposition method solves relatively small trust-region subproblems that modify the control variable on a subdomain only. Given nontrivial subdomain overlap, we prove that a global first-order necessary optimality condition is equivalent to a first-order necessary optimality condition per subdomain. We additionally show that a sufficient decrease is achieved on a single subdomain by way of a trust-region subproblem solver using geometric measure–theoretic arguments, which we integrate with a greedy patch selection to prove convergence of our algorithm. In conclusion, we demonstrate the practicality of our algorithm on a benchmark large-scale, PDE-constrained integer optimal control problem and find that our method is faster than the state of the art.

domain decomposition↗
DOE OSTI2021

Curvature Energetics Determined by Alchemical Simulation on Four Topologically Distinct Lipid Phases

The relative curvature energetics of two lipids are tested using thermodynamic integration (TI) on four topologically distinct lipid phases. Simulations use TI to switch between choline headgroup lipids (POPC; that prefers to be flat) and ethanolamine headgroup lipids (POPE; that prefer, for example, the inner monolayer of vesicles). Here, the thermodynamical moving of the lipids between planar, inverse hexagonal (H II ), cubic (Q II ; Pn3m space group), and vesicle topologies reveals differences in material parameters that were previously challenging to access. The methodology allows for predictions of two important lipid material properties: the difference in POPC/POPE monolayer intrinsic curvature (ΔJ 0 ) and the difference in POPC/POPE monolayer Gaussian curvature modulus (Δ$\bar{κ_m}$), both of which are connected to the energetics of topological variation. Analysis of the TI data indicates that, consistent with previous experiment and simulation, the J 0 of POPE is more negative than POPC (ΔJ 0 = –0.018 ± 0.001 Å –1 ). The theoretical framework extracts significant differences in $\bar{κ_m}$ of which POPE is less negative than POPC by 2.0 to 4.0 kcal/mol. The range of these values is determined by considering subsets of the simulations, and disagreement between these subsets suggests separate mechanical parameters at very high curvature. Finally, the fit of the TI data to the model indicates that the position of the pivotal plane of curvature is not constant across topologies at high curvature. Overall, the results offer insights into lipid material properties, the limits of a single HC model, and how to test them using simulation.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Improving Convection Trigger Functions in Deep Convective Parameterization Schemes Using Machine Learning

Abstract Deficiencies in convection trigger functions, used in deep convection parameterizations in General Circulation Models (GCMs), have critical impacts on climate simulations. A novel convection trigger function is developed using the machine learning (ML) classification model XGBoost. The large‐scale environmental information associated with convective events is obtained from the long‐term constrained variational analysis forcing data from the Atmospheric Radiation Measurement (ARM) program at its Southern Great Plains (SGP) and Manaus (MAO) sites representing, respectively, continental mid‐latitude and tropical convection. The ML trigger is separately trained and evaluated per site, and jointly trained and evaluated at both sites as a unified trigger. The performance of the ML trigger is compared with four convective trigger functions commonly used in GCMs: dilute convective available potential energy (CAPE), undilute CAPE, dilute dynamic CAPE (dCAPE), and undilute dCAPE. The ML trigger substantially outperforms the four CAPE‐based triggers in terms of the F 1 score metric, widely used to estimate the performance of ML methods. The site‐specific ML trigger functions can achieve, respectively, 91% and 93% F 1 scores at SGP and MAO. The unified trigger also has a 91% F 1 score, with virtually no degradation from the site‐specific training, suggesting the potential of a global ML trigger function. The ML trigger alleviates a GCM deficiency regarding the overprediction of convection occurrence, offering a promising improvement to the simulation of the diurnal cycle of precipitation. Furthermore, to overcome the black box issue of the ML methods, insights derived from the ML model are discussed, which may be leveraged to improve traditional CAPE‐based triggers.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Comparison of Conventional and Constrained Variational Methods for Computing Large-Scale Budgets and Forcing Fields

Analyses of atmospheric heat and moisture budgets serve as an effective tool to study convective characteristics over a region and to provide large-scale forcing fields for various modeling applications. This paper examines two popular methods for computing large-scale atmospheric budgets: the conventional budget method (CBM) using objectively gridded analyses based primarily on radiosonde data and the constrained variational analysis (CVA) approach which supplements vertical profiles of atmospheric fields with measurements at the top of the atmosphere and at the surface to conserve mass, water, energy, and momentum. Successful budget computations are dependent on accurate sampling and analyses of the thermodynamic state of the atmosphere and the divergence field associated with convection and the large-scale circulation that influences it. Utilizing analyses generated from data taken during Dynamics of the Madden-Julian Oscillation (DYNAMO) field campaign conducted over the central Indian Ocean from October to December 2011, we evaluate the merits of these budget approaches and examine their limitations. While many of the shortcomings of the CBM, in particular effects of sampling errors in sounding data, are effectively minimized with CVA, accurate large-scale diagnostics in CVA are dependent on reliable background fields and rainfall constraints. Finally, for the DYNAMO analyses examined, the operational model fields used as the CVA background state provided wind fields that accurately resolved the vertical structure of convection in the vicinity of Gan Island. However, biases in the model thermodynamic fields were somewhat amplified in CVA resulting in a convective environment much weaker than observed.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Sensitivity of the Shallow‐To‐Deep Convective Transition to Moisture and Wind Shear in the Amazon

Deep convection is the primary influence on weather and climate in tropical regions. However, understanding and simulating the shallow‐to‐deep (STD) convective transition has long been challenging. Here, we conduct high‐resolution numerical simulations to assess the environmental controls on the evolution of isolated convection in the Amazon during the wet season. The large‐scale forcing derived through a constrained variational analysis approach for the GoAmazon2014/5 Experiment is used in the simulations. Through sensitivity experiments, we examine the relative importance of moisture and wind shear in controlling the shallow‐to‐deep convective transition for isolated convective events. Convection exhibits the greatest sensitivity to humidity within the lowest 1.5 km, where a 4 mm reduction in column water vapor nearly suppresses ice water formation on deep convective days. In contrast, a reduction in column water vapor in the free troposphere by a factor of two or more is necessary to produce a comparable impact on convection. Increasing low‐level wind speed from 6 to 9 m s -1 enhances afternoon deep convection, raising the cloud ice mixing ratio by approximately 25%. Conversely, upper‐level wind shear reveals the weakest correlation with daytime convection in our simulations. Our results help characterize the role of moisture and wind shear on the STD transition and our understanding of the underlying mechanisms.

environmental controls↗
DOE OSTI2026

Cosmological analysis of the DESI DR1 Lyα 1D power spectrum

We present the cosmological analysis of the one-dimensional Lyman-α flux power spectrum from the first data release of the Dark Energy Spectroscopic Instrument (DESI). We capture the dependence of the signal on cosmology and intergalactic medium physics using an emulator trained on a cosmological suite of hydrodynamical simulations, and we correct its predictions for the impact of astrophysical contaminants and systematics, many of these not considered in previous analyses. We employ this framework to constrain the amplitude and logarithmic slope of the linear matter power spectrum at k ★ = 0.009 km -1 s and redshift z = 3, obtaining Δ 2 ★ = 0.379 ± 0.032 and n ★ = -2.309 ± 0.019 https://github.com/igmhub/cobaya_lya_p1d. The robustness of these constraints is validated through the analysis of mocks and a large number of alternative data analysis variations, with cosmological parameters kept blinded throughout the validation process. We then combine our results with constraints from DESI BAO and temperature, polarization, and lensing measurements from Planck, ACT, and SPT-3G to set constraints on ΛCDM extensions. While our measurements do not significantly tighten the limits on the sum of neutrino masses from the combination of these probes, they sharpen the constraints on the effective number of relativistic species, N eff = 3.02 ± 0.10, the running of the spectral index, α s = 0.0014 ± 0.0041, and the running of the running, β s = -0.0006 ± 0.0048, by a factor of 1.18, 1.27, and 1.90, respectively. We conclude by outlining the improvements needed to fully reach the level of confidence implied by these uncertainties.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Two-nucleon 𝑆-wave interactions at the SU(3) flavor-symmetric point with 𝑚 𝑢⁢𝑑 ≈ 𝑚$^{phys}_𝑠$: A first lattice QCD calculation with the stochastic Laplacian Heaviside method

We report on the first application of the stochastic Laplacian Heaviside method for computing multiparticle interactions with lattice QCD to the two-nucleon system. Like the Laplacian Heaviside method, this method allows for the construction of interpolating operators which can be used to construct a set of positive-definite two-nucleon correlation functions, unlike nearly all other applications of lattice QCD to two nucleons in the literature. It also allows for a variational analysis in which optimal linear combinations of the interpolating operators are formed that couple predominantly to the eigenstates of the system. Utilizing such methods has become of paramount importance to help resolve the discrepancy in the literature on whether two nucleons in either isospin channel form a bound state at pion masses heavier than physical, with the discrepancy persisting even in the SU(3)-flavor-symmetric point with all quark masses near the physical strange quark mass. This is the first in a series of papers aimed at resolving this discrepancy. In the present work, we employ the stochastic Laplacian Heaviside method without a hexaquark operator in the basis at a lattice spacing of 𝑎 ≈0.086 fm, lattice volume of 𝐿 = 48⁢𝑎 ≈ 4.1 fm and pion mass 𝑚 𝜋 ≈ 714 MeV. With this setup, the observed spectrum of two-nucleon energy levels strongly disfavors the presence of a bound state in either the deuteron or dineutron channel.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗