SEARCH · Engineering Papers

Results for “Variational”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,513 records · Page 84

All sources NASA NTRS DOE OSTI

DOE OSTI2025

Explainable AI for Multivariate Time Series Pattern Exploration: Latent Space Visual Analytics With Temporal Fusion Transformer and Variational Autoencoders in Power Grid Event Diagnosis

Detecting and analyzing complex patterns in multivariate time-series data is crucial for decision-making in urban and environmental system operations. However, challenges arise from the high dimensionality, intricate complexity, and interconnected nature of complex patterns, which hinder the understanding of their underlying physical processes. Existing AI methods often face limitations in interpretability, computational efficiency, and scalability, reducing their applicability in real-world scenarios. This paper proposes a novel visual analytics framework that integrates two generative AI models, Temporal Fusion Transformer (TFT) and Variational Autoencoders (VAEs), to reduce complex patterns into lower-dimensional latent spaces and visualize them in 2D using dimensionality reduction techniques such as PCA, t-SNE, and UMAP with DBSCAN. These visualizations, presented through coordinated and interactive views and tailored glyphs, enable intuitive exploration of complex multivariate temporal patterns, identifying patterns’ similarities and uncover their potential correlations for a better interpretability of the AI outputs. The framework is demonstrated through a case study on power grid signal data, where it identifies multi-label grid event signatures, including faults and anomalies with diverse root causes. Additionally, novel metrics and visualizations are introduced to validate the models and assess the performance, efficiency, and consistency of latent maps generated by VAE, which have been utilized in prior studies for latent space cartography and used as a benchmark in this study, and the emerging TFT architecture under various configurations. These analyses provide actionable insights for model parameter tuning and reliability improvements. Comparative results highlight that TFT achieves shorter run times and superior scalability to diverse time-series data shapes compared to VAE. This work advances fault diagnosis in multivariate time series, fostering explainable AI to support critical system operations.

Explainable AI↗

DOE OSTI2020

Optimization of Simultaneous Measurement for Variational Quantum Eigensolver Applications

Variational quantum eigensolver (VQE) is a promising algorithm suitable for near-term quantum computers. VQE aims to approximate solutions to exponentially-sized optimization problems by executing a polynomial number of quantum sub-problems. However, the number of subproblems scales as N-4 for typical problems of interest-a daunting growth rate that poses a serious limitation for emerging applications such as quantum computational chemistry. We mitigate this issue by exploiting the simultaneous measurability of subproblems corresponding to commuting terms. Our technique transpiles VQE instances into a format optimized for simultaneous measurement, ultimately yielding 8-30x lower cost. Our work also encompasses a synthesis tool for compiling simultaneous measurement circuits with minimal overhead. We demonstrate experimental validation of our techniques by estimating the ground state energy of deuteron with a quantum computer. We also investigate the underlying statistics of simultaneous measurement and devise an adaptive strategy for mitigating harmful covariance terms.

quantum computing↗

DOE OSTI2022

Dynamic Frequency Regulation Improvement in Hydropower-Hybrid System using Variational Mode Decomposition

Providing frequency response, especially fast frequency response such as Red D in the Pennsylvania-New Jersey-Maryland Interconnection (PJM) market, is challenging for many generation plants to deliver on their own. If they have adequate flexibility, hydropower plants are typically able to provide slower regulation support (e.g., Reg A in PJM), but do not respond fast enough to provide Reg D. The ability to provide Reg D would improve their revenue because this service is typically more valuable. This work presents a control approach to use hydropower, battery, and ultracapacitor systems to provide fast regulation in a way that uses the response contribution of each asset. In particular, the proposed control architecture applies a variational mode decomposition (VMD) technique on the incoming Reg D signal to extract multiple dynamic-regulation components with non-overlapping frequencies. With the response-speed dependent alignment, these regulation components are fed to the hydrogenator and hybrid energy storage system (HESS). The paper evaluates the proposed approach on a direct-current (DC)-coupled active system by computing several performance measures and analyzing sensitivity based on HESS component proportional capacities. The results reveal that the proposed VMD-based signal conditioning performs well and that optimizing the sizing of the battery and ultracapacitor components further enhances performance.

13 HYDRO ENERGY↗

DOE OSTI2025

Improved Guarantees for Optimal Nash Equilibrium Seeking and Bilevel Variational Inequalities

We consider a class of hierarchical variational inequality (VI) problems that subsumes VI-constrained optimization and several other problem classes, including the optimal solution selection problem and the optimal Nash equilibrium (NE) seeking problem. Our main contribution is threefold. (i) We consider bilevel VIs with monotone and Lipschitz continuous mappings and devise a single-timescale iteratively regularized extragradient method, named IR-EG 𝚖,𝚖 . We improve the existing iteration complexity results for addressing both bilevel VI and VI-constrained convex optimization problems. (ii) Under the strong monotonicity of the outer-level mapping, we develop a method named IR-EG 𝚜,𝚖 and derive faster guarantees than those in (i). We also study the iteration complexity of this method under a constant regularization parameter. These results appear to be new for both bilevel VIs and VI-constrained optimization. (iii) To our knowledge, complexity guarantees for computing the optimal NE in nonconvex settings do not exist. Motivated by this lacuna, we consider VI-constrained nonconvex optimization problems and devise an inexactly projected gradient method, named IPR-EG, where the projection onto the unknown set of equilibria is performed using IR-EG 𝚜,𝚖 with a prescribed termination criterion and an adaptive regularization parameter. We obtain new complexity guarantees in terms of a residual map and an infeasibility metric for computing a stationary point. Here, we validate the theoretical findings using preliminary numerical experiments for computing the best and the worst NEs.

bilevel optimization↗

DOE OSTI2022

Intra-canopy leaf trait variation facilitates high LAI and compensatory growth in a clonal woody encroaching shrub in the tallgrass prairie

This data package contains the data for Tooley et al. (2022) Intra-canopy leaf trait variation facilitates high leaf area index and compensatory growth in a clonal woody encroaching shrub. The purpose of this project was to evaluate the leaf ecophysiological traits of Cornus drummondii C.A. Mey to better understand how C. drummondii maximizes photosynthetic rates across large gradients of light availability in its short, dense canopies. We also evaluate how C. drummondii modifies its allocation of leaf traits in response to grassland disturbance. High LAI canopies and a compensatory growth response to disturbance are two key factors contributing to the success of C. drummondii and other woody species responsible for the encroachment of grasslands.The data package contains ecophysiological measurements, including leaf morphological, physiological, and chemical traits; photosynthetic measurements, leaf carbon and nitrogen stable isotopes, leaf area index, and photosynthetically active radiation. All measurements were taken vertically across canopies of the clonal woody-encroaching shrub Cornus drummondii under browsed, grazed, and control (unbrowsed and ungrazed) conditions.Files:SeasonalMeasurements_Archive.csv - Data for all seasonal measurements used in the study.LeafPhotoSeasonalRaw_Archive.zip - zip file containing raw data from an li-6400 for each sampling period in the study.LAI_Archive.xlsx - Data for LAI Measurements.ACiandLightCurveResults_Archive.xlsx - Contains parameters extracted from A-ci and Light Response curves along with the morphological and chemical traits for each leaf.ACiRaw Archive.xlsx - Raw data from Li-6400 for A-ci response curvesLightCurves_Raw.zip - zip file containing raw data for Li-6400 light response curves. Excel file format: "IslandID"-"Depth"-lc.xlsx (or .csv)DataCollectionMethods.docx - file containing the methods of data collection, processing, and QA/QC for all data files. File also contains a list of excel file headers, abbreviations, and their units.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Inverse Analysis with Variational Autoencoders: A Comparison of Shallow and Deep Networks

Inverse problems are applied to determine unknown properties by matching observational data with a physical model that often takes many parameters as input. To overcome the underconstrained nature of inverse problems and achieve good performance, an approach is presented involving regularization with a technique known as a variational autoencoder (VAE), which is trained to map a high-dimensional parameter space with a complex structure to a low-dimensional latent space with a simple structure. We apply this approach to unconditioned realizations of the parameters (heterogeneous hydraulic fields) for a hydrogeological inverse problem. Two types of hydraulic conductivity fields are used to evaluate the characterization for the different levels of heterogeneity complexity of the physical inputs. This approach keeps the computational cost of generating the training data low. The reason is unconditioned realizations neither rely on the observational data used to perform the inverse analysis nor require any groundwater flow model forward runs. In addition, this approach applies regularization on a low-dimensional latent space from the VAE and increases optimization efficiency through automatic differentiation. Furthermore, two different neural network (NN) structures are tested for their utility in using the VAE for inverse analysis. The performance of a deep, convolutional neural network strongly depends on the dimensionality of the latent space, which requires tuning. In contrast, a shallow, dense neural network provides consistently accurate characterization without tuning. Furthermore, our approach evaluates the advantages of the shallow, dense neural network over the deep, convolutional one and enables future application to a wide range of inverse problems.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

CONCURRENT, CONDENSED STEIN VARIATIONAL GRADIENT DESCENT FOR UNCERTAINTY QUANTIFICATION OF NEURAL NETWORKS

In this work, we propose a Stein variational gradient descent (SVGD) method to concurrently sparsify, train, and provide uncertainty quantification (UQ) of a complexly parameterized model, such as a neural network (NN). It employs a graph reconciliation and condensation process to reduce complexity and increase similarity in the Stein ensemble of parameterizations. Therefore, the proposed concurrent, condensed SVGD (ccSVGD) method can provide UQ on parameters, not just outputs. Furthermore, the parameter reduction speeds up the convergence of the Stein gradient descent as it reduces the combinatorial complexity by aligning and differentiating the sensitivity to parameters. These properties are demonstrated with an illustrative example and an application to a mechanical response representation problem in solid mechanics.

42 ENGINEERING↗

DOE OSTI2022

Natural variation in growth and leaf ion homeostasis in response to salinity stress in Panicum hallii

Soil salinity can negatively impact plants growth, development and fitness. Natural plant populations restricted to coastal environments may evolve in response to saline habitats and therefore provide insights into the process of salinity adaptation. We investigated the growth and physiological responses of coastal and inland populations of Panicum hallii to experimental salinity treatments. Coastal genotypes demonstrated less growth reduction and superior ion homeostasis compared to the inland genotypes in response to saline conditions, supporting a hypothesis of local adaptation. We identified several QTL associated with the plasticity of belowground biomass, leaf sodium and potassium content, and their ratio which underscores the genetic variation present in this species for salinity responses. Genome-wide transcriptome analysis in leaf and root tissue revealed tissue specific overexpression of genes including several cation transporters in the coastal genotype. These transporters mediate sodium ion compartmentalization and potassium ion retention and thus suggests that maintenance of ionic homeostasis of the coastal genotypes might be due to the regulation of these ion transporters. These findings contribute to our understanding of the genetics and molecular mechanisms of salinity adaptation in natural populations, and widens the scope for genetic manipulation of these candidate genes to design plants more resilient to climate change.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2023

Industrial PLC Network Modeling and Parameter Identification Using Sensitivity Analysis and Mean Field Variational Inference

A multiple input multiple output (MIMO) power line communication (PLC) model for industrial facilities was developed that uses the physics of a bottom-up model but can be calibrated like top-down models. The PLC model considers 4-conductor cables (three-phase conductors and a ground conductor) and has several load types, including motor loads. The model is calibrated to data using mean field variational inference with a sensitivity analysis to reduce the parameter space. The results show that the inference method can accurately identify many of the model parameters, and the model is accurate even when the network is modified.

47 OTHER INSTRUMENTATION↗

NASA NTRS1962