Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Generative models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

A Graphical Model for Fusing Diverse Microbiome Data

This paper develops a Bayesian graphical model for fusing disparate types of count data. The motivating application is the study of bacterial communities from diverse high-dimensional features, in this case, transcripts, collected from different treatments. In such datasets, there are no explicit correspondences between the communities and each corresponds to different factors, making data fusion challenging. We introduce a flexible multinomial-Gaussian generative model for jointly modeling such count data. This latent variable model jointly characterizes the observed data through a common multivariate Gaussian latent space that parameterizes the set of multinomial probabilities of the transcriptome counts. The covariance matrix of the latent variables induces a covariance matrix of co-dependencies between all the transcripts, effectively fusing multiple data sources. We present a computationally scalable variational Expectation-Maximization (EM) algorithm for inferring the latent variables and the parameters of the model. Here, the inferred latent variables provide a common dimensionality reduction for visualizing the data and the inferred parameters provide a predictive posterior distribution. In addition to simulation studies that demonstrate the variational EM procedure, we apply our model to a bacterial microbiome dataset.

59 BASIC BIOLOGICAL SCIENCES↗

Generative AI in Supply Chain Management: Applications, Challenges, and Future Directions

Supply chain management (SCM) is undergoing rapid transformation due to increasing global complexity, demand volatility, and operational disruptions. Generative Artificial Intelligence (GenAI) has emerged as a powerful paradigm capable of synthesizing data, simulating operational scenarios, and enabling adaptive decision-making across supply chain networks. This paper presents a survey of GenAI’s role in SCM, focusing on its applications in predictive analytics, autonomous logistics, and fraud detection. Unlike traditional AI systems that rely primarily on predictive analytics, GenAI models, including large language models, generative adversarial networks, and diffusion-based architectures, enable the creation of synthetic supply chain scenarios and autonomous optimization strategies. This survey provides (1) a taxonomy of GenAI techniques for supply chain applications, (2) a comparative analysis of generative AI approaches with traditional machine learning, reinforcement learning, and blockchain-based methods, and (3) a discussion of key challenges such as data privacy, interpretability, and integration with legacy enterprise systems. Furthermore, we outline open research problems and propose directions for future research toward autonomous, resilient, and sustainable AI-driven supply chains.

15 - GEOTHERMAL ENERGY↗

Machine-learning interatomic potentials for interfaces in all-solid-state batteries: Perspectives on training data, model selection, and validation

Interfaces play a pivotal role in dictating the performance and reliability of all-solid-state batteries (ASSBs), where complex electro-chemo-mechanical phenomena at grain boundaries (GBs) and interfaces can lead to degradation and failure. Traditional atomistic simulation methods, such as first-principles calculations and classical molecular dynamics, face limitations in modeling these interfaces due to either high computational cost or insufficient transferability to the diverse atomic environments evolving at interfaces. Machine-learning interatomic potentials (MLIPs) have emerged as a transformative approach, enabling large-scale, high-accuracy simulations of disordered and chemically complex systems by leveraging the predictability of machine learning models trained on first-principles data. Recent applications of MLIPs have demonstrated their ability to capture intricate behaviors at ASSB interfaces, including ion transport, interfacial evolution, and degradation mechanisms, with accuracy and efficiency unattainable by conventional methods. This prospective paper presents comprehensive analysis and practical guidance for MLIP development for GBs and interfaces in ASSBs, with a focus on three key pillars: data generation, model selection, and validation. Here, we review the current state of MLIP applications for GBs and interfaces in both general and ASSB-specific materials, highlighting best practices and challenges in constructing diverse and representative datasets, choosing appropriate machine learning architectures, and rigorously validating model performance. We also discuss emerging strategies and opportunities for improved reliability and efficiency of MLIPs to simulate realistic interfaces in ASSBs.

Energy - Storage↗

Trust Your Gut: Comparing Human and Machine Inference from Noisy Visualizations

People commonly utilize visualizations not only to examine a given dataset, but also to draw generalizable conclusions about the underlying models or phenomena. Prior research has compared human visual inference to that of an optimal Bayesian agent, with deviations from rational analysis viewed as problematic. However, human reliance on non-normative heuristics may prove advantageous in certain circumstances. We investigate scenarios where human intuition might surpass idealized statistical rationality. In two experiments, we examine individuals’ accuracy in characterizing the parameters of known data-generating models from bivariate visualizations. Our findings indicate that, although participants generally exhibited lower accuracy compared to statistical models, they frequently outperformed Bayesian agents, particularly when faced with extreme samples. Participants appeared to rely on their internal models to filter out noisy visualizations, thus improving their resilience against spurious data. However, participants displayed overconfidence and struggled with uncertainty estimation. They also exhibited higher variance than statistical machines. Our findings suggest that analyst gut reactions to visualizations may provide an advantage, even when departing from rationality. These results carry implications for designing visual analytics tools, offering new perspectives on how to integrate statistical models and analyst intuition for improved inference and decision-making. The data and materials for this paper are available at https://osf.io/qmfv6

human-machine collaboration↗

Modeling Spatial Asymmetries in Teleconnected Extreme Temperatures

Abstract Combining strengths from deep learning and extreme value theory can help describe complex relationships between variables where extreme events have significant impacts (e.g., environmental or financial applications). Neural networks learn complicated nonlinear relationships from large datasets under limited parametric assumptions. By definition, the number of occurrences of extreme events is small, which limits the ability of the data-hungry, nonparametric neural network to describe rare events. Inspired by recent extreme cold winter weather events in North America caused by atmospheric blocking, we examine several probabilistic generative models for the entire multivariate probability distribution of daily boreal winter surface air temperature. We propose metrics to measure spatial asymmetries, such as long-range anticorrelated patterns that commonly appear in temperature fields during blocking events. Compared to vine copulas, the statistical standard for multivariate copula modeling, deep learning methods show improved ability to reproduce complicated asymmetries in the spatial distribution of ERA5 temperature reanalysis, including the spatial extent of in-sample extreme events.

Krock, Mitchell L.↗

Chromium-doped uranium dioxide fuels: A review

UO 2 doped with parts per million CR 2 O 3 powder is considered a potential near term accident tolerant fuel candidate. Here, the results of decades of industry and academic research into Cr-doped UO 2 are analyzed and their shortcomings are critiqued. Focusing on the incorporation mechanisms of Cr into the fuel matrix, we explore a mechanistic understanding of the characteristic properties of Cr-doped UO 2 , notably, enhanced fission gas retention attributed to enlarged grain sizes following sintering, along with marginal improvements in the thermophysical properties. The findings of recent X-ray Adsorption Near Edge Spectroscopy studies were compared and put into conversation with historic data regarding the incorporation of Cr in UO 2 . On the basis of defect mechanisms, the case is made for the substitutional incorporation of Cr governing the lattice solubility but not the enhanced U diffusivity. Instead, Cr/CR 2 O 3 redox chemistry in a well-defined oxygen potential explains the differences in the U diffusivity and O/M ratio. The primary mechanism of doping enhanced grain growth is found to be liquid assisted sintering due to a CRO (1) eutectic phase at the grain boundaries. The role of inhomogeneities in Cr concentration in UO 2 at various length scales across the materials microstructure is highlighted and connected to promising experimental and modeling work to fill in the gaps in the current understanding of Cr-doped UO 2 . The review considers both the open scientific questions and engineering applications to illustrate the deep connections between the practice and theory in the design of accident tolerant nuclear fuels. In conclusion, the review ends with an outline of future works that combine meticulous irradiation studies and high resolution experiments with next generation modeling and simulations techniques empowered by machine learning advances to accelerate the fabrication and adoption of Cr-doped UO 2 light water reactors.

Cleveland, Mack Wesley [Massachusetts Inst. of Tec↗

Invertible neural networks for E3SM land model calibration and simulation

We apply an invertible neural network (INN) for E3SM land model calibration and simulation with eight parameters at the Missouri Ozark AmeriFlux forest site. INN provides bijective (two-way) mappings between inputs and outputs, thus it can solve probabilistic inverse problems and forward approximations simultaneously. We demonstrate INN's inverse and forward capability in both synthetic and real-data applications. Results indicate that INN produces accurate parameter posterior distributions similar to Markov Chain Monte Carlo sampling and it generates model outputs close to the forward model simulations. Additionally, both the inverse and forward evaluations in INN are computationally efficient which allows for rapid integration of observations for parameter estimation and fast model predictions.

Lu, Dan↗

Efficient sampling of constrained high-dimensional theoretical spaces with machine learning

Abstract Models of physics beyond the Standard Model often contain a large number of parameters. These form a high-dimensional space that is computationally intractable to fully explore. Experimental results project onto a subspace of parameters that are consistent with those observations, but mapping these constraints to the underlying parameters is also typically intractable. Instead, physicists often resort to scanning small subsets of the full parameter space and testing for experimental consistency. We propose an alternative approach that uses generative models to significantly improve the computational efficiency of sampling high-dimensional parameter spaces. To demonstrate this, we sample the constrained and phenomenological Minimal Supersymmetric Standard Models subject to the requirement that the sampled points are consistent with the measured Higgs boson mass. Our method achieves orders of magnitude improvements in sampling efficiency compared to a brute force search.

Hollingsworth, Jacob↗

Certification and prediction of post-disturbance states in dynamic security assessment

Dynamic security assessment usually involves the simulation of system dynamics under large disturbances. The instant large disturbance occurs, the post-disturbance state of the system could deviate significantly from the pre-disturbance one. It is desirable and necessary to develop an efficient method to certify the existence of state and predict the approximate post-disturbance state because: (1) faster warning can be made in online assessment; and (2) the dynamic simulator can be given better initial values to calculate precise solutions, which prevents convergence failure brought on by poor initial values. We propose a novel approach for efficiently certifying and predicting the post-disturbance states in dynamic security assessment. Based on the fixed-point power flow mapping approach applied to salient pole generator models, the criterion for determining the existence and uniqueness of the post-disturbance solution is derived, and the bounds of post-disturbance solution can be rigorously characterized.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Resolving Mixtures of Soot Characterized by SP-AMS Spectra Using a Latent Dirichlet Allocation Model

Soot produced by detonation or combustion events exhibits different chemical properties depending on the fuel, device construction, and environmental conditions in which the event occurs. These properties can be useful for defining relevant signatures for probabilistically identifying the different types of events that occurred, based on the soot that is produced from these events. However, it is rare to observe samples of soot from a detonation or combustion that are not contaminated by outside particles. In this paper, we present a method for resolving mixtures of soot to determine the contributions of sources that may be present in samples of recovered soot. We use Latent Dirichlet Allocation to describe the generative process for a sample of recovered soot, and use Variational Bayesian Inference to learn about the parameters associated with the generative model. We demonstrate the utility of this method by considering real samples of mixtures of soot under various frameworks to show that the model is able to identify the different components present in a sample of soot as well as their mixing proportions.

54 ENVIRONMENTAL SCIENCES↗

VpROM: a novel variational autoencoder-boosted reduced order model for the treatment of parametric dependencies in nonlinear systems

Reduced Order Models (ROMs) are of considerable importance in many areas of engineering in which computational time presents difficulties. Established approaches employ projection-based reduction, such as Proper Orthogonal Decomposition. The limitation of the linear nature of such operators is typically tackled via a library of local reduction subspaces, which requires the assembly of numerous local ROMs to address parametric dependencies. Our work attempts to define a more generalisable mapping between parametric inputs and reduced bases for the purpose of generative modeling. We propose the use of Variational Autoencoders (VAEs) in place of the typically utilised clustering or interpolation operations, for inferring the fundamental vectors, termed as modes, which approximate the manifold of the model response for any and each parametric input state. The derived ROM still relies on projection bases, built on the basis of full-order model simulations, thus retaining the imprinted physical connotation. However, it additionally exploits a matrix of coefficients that relates each local sample response and dynamics to the global phenomena across the parametric input domain. The VAE scheme is utilised for approximating these coefficients for any input state. This coupling leads to a high-precision low-order representation, which is particularly suited for problems where model dependencies or excitation traits cause the dynamic behavior to span multiple response regimes. Moreover, the probabilistic treatment of the VAE representation allows for uncertainty quantification on the reduction bases, which may then be propagated to the ROM response. The performance of the proposed approach is validated on an open-source simulation benchmark featuring hysteresis and multi-parametric dependencies, and on a large-scale wind turbine tower characterised by nonlinear material behavior and model uncertainty.

Conditional VAEs↗

Random Quantum Circuits

Quantum circuits—built from local unitary gates and local measurements—are a new playground for quantum many-body physics and a tractable setting to explore universal collective phenomena far from equilibrium. These models have shed light on longstanding questions about thermalization and chaos, and on the underlying universal dynamics of quantum information and entanglement. In addition, such models generate new sets of questions and give rise to phenomena with no traditional analog, such as dynamical phase transitions in quantum systems that are monitored by an external observer. Quantum circuit dynamics is also topical in view of experimental progress in building digital quantum simulators that allow control of precisely these ingredients. Randomness in the circuit elements allows a high level of theoretical control, with a key theme being mappings between real-time quantum dynamics and effective classical lattice models or dynamical processes. Many of the universal phenomena that can be identified in this tractable setting apply to much wider classes of more structured many-body dynamics.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

NLR CSP Optical Facilities: Illuminating the Path Forward Through Innovation and Impact: Agreement 38490

This initiative is a multi-faceted project at the National Laboratory of the Rockies (NLR) aimed at strengthening its Concentrating Solar Power (CSP) Optical Facilities to advance the development of low-cost, high-performance materials for solar and other applications. The project's strategy is built on three pillars: strategic stakeholder engagement, diligent facility maintenance and utilization, and the development of new research capabilities. The overarching goal is to ensure the facilities remain state-of-the-art resources for industry and academia, thereby accelerating the conversion of concentrated sunlight into energy. A key driver of the project is an international Advisory Board, which provides critical guidance on research priorities and industry needs, leading to new collaborations and secured funding. This external engagement, combined with proactive outreach to industry partners, ensures the lab's work remains aligned with real-world challenges, including materials durability and performance certification. Significant efforts in facility maintenance have addressed challenges with aging infrastructure. Notable achievements include the complete refurbishment of the hail-damaged Ultra-Accelerated Weathering System (UAWS) and the successful replacement of a failing 15-year-old Lambda 1050 spectrophotometer with a new-generation model, substantially upgrading material characterization capabilities. These maintenance activities were complemented by achieving a prestigious ISO 9001:2015 certification for the Advanced Optical Materials Labs, formally recognizing the quality and reliability of NLR's measurement capabilities. Despite these successes, challenges remain, including high demand for the High Flux Solar Furnace (HFSF) and intermittent failures of other key instruments. The project has delivered major advancements in research techniques and capabilities. At the Flatirons campus, a new indoor laboratory, was established to house advanced deflectometry and photogrammetry systems for heliostat characterization. For on-sun testing, a novel, actively cooled turning mirror was developed for the HFSF, enabling more realistic testing of particle receivers and components. A collaboration with Virginia Tech successfully demonstrated the high-temperature durability of a new solar absorber coating through extensive cyclic testing. Concurrently, new modeling took place to better predict material degradation on rough, fractal surfaces. In summary, this project has systematically enhanced NLR's CSP Optical Facilities through strategic upgrades, rigorous maintenance, and stakeholder-guided research. By overcoming equipment failures, budgetary constraints, and logistical hurdles, the project has reinforced NLR's role as a central hub for CSP innovation and materials testing. Future work will focus on securing diverse funding, expanding collaborations, and continuing to provide the critical infrastructure needed to accelerate the development and deployment of next-generation technologies.

14 SOLAR ENERGY↗

Large-scale parametric modeling of spent nuclear fuel dynamics in the 30 cm package drop scenario

Packages used to transport spent nuclear fuel (SNF) are required by the U.S. Code of Federal Regulations 10 CFR 71.71 to demonstrate satisfactory performance during a drop scenario. While the CFR is meant to ensure safe package function, it does not evaluate survival of the SNF within. The U.S. Department of Energy Spent Fuel and Waste Science and Technology program is working on closing the knowledge gap related to the response of SNF to external mechanical loads, including the hypothetical 30 cm package drop scenario in the CFR. In support of this effort, LS-DYNA finite element simulations were developed by Pacific Northwest National Laboratory (PNNL) to model generic drop scenarios at both the package and fuel assembly level. The models were validated against one-third scale package and full scale fuel assembly drop test data and were exercised to predict fuel cladding strains in a narrow range of model configurations. This work describes a large-scale parametric study conducted by PNNL using the previously developed and validated PWR finite element model, with the addition of a new generic BWR assembly model. The motivation for the parametric study was to characterize the broad range of SNF responses in the 30 cm package drop scenario. This was accomplished by varying the drop orientation, fuel assembly type (17x17 PWR and 10x10 BWR), burnup, cladding temperature, spacer grid buckling load, package mass, impact limiter stiffness, and mechanical gap conditions within the basket. A MATLAB framework was developed to automate LS-DYNA model generation and execution on PNNL institutional computing resources. In total, over 2000 simulations were performed. For each simulation, the SNF response was quantified in terms of permanent grid deformation, fuel rod contact pressure, and strains within the fuel rods, guide tubes, and water rods. The results provide valuable insight into the range of responses that could be reasonably expected from SNF in the hypothetical drop scenario, as well as the sensitivity to each input parameter. The results of this parametric study are a key component of the testing and modeling strategy the Spent Fuel and Waste Science and Technology program is using to close the external loads knowledge gap.

Kadooka, Kevin↗

Better together: Elements of successful scientific software development in a distributed collaborative community

Many scientific disciplines rely on computational methods for data analysis, model generation, and prediction. Implementing these methods is often accomplished by researchers with domain expertise but without formal training in software engineering or computer science. This arrangement has led to underappreciation of sustainability and maintainability of scientific software tools developed in academic environments. Some software tools have avoided this fate, including the scientific library Rosetta. We use this software and its community as a case study to show how modern software development can be accomplished successfully, irrespective of subject area. Rosetta is one of the largest software suites for macromolecular modeling, with 3.1 million lines of code and many state-of-the-art applications. Since the mid 1990s, the software has been developed collaboratively by the RosettaCommons, a community of academics from over 60 institutions worldwide with diverse backgrounds including chemistry, biology, physiology, physics, engineering, mathematics, and computer science. Developing this software suite has provided us with more than two decades of experience in how to effectively develop advanced scientific software in a global community with hundreds of contributors. Here we illustrate the functioning of this development community by addressing technical aspects (like version control, testing, and maintenance), community-building strategies, diversity efforts, software dissemination, and user support. We demonstrate how modern computational research can thrive in a distributed collaborative community. The practices described here are independent of subject area and can be readily adopted by other software development communities

97 MATHEMATICS AND COMPUTING↗

DFT Analysis of the Binding of Rare Earth Nitrates at Internal and External Surfaces of MCM-22

MCM-22-type zeolites constitute a well-characterized tunable class of aluminosilicates suitable for elucidating the fundamental aspects of the binding of rare earth elements (REEs) in layered materials. Starting from the pure silica version ITQ-1 with a unit cell of Si 72 O 144 , a model for periodic bulk crystalline MCM-22 with a finite Al concentration is provided by replacing a Si atom with an Al atom in the unit cell at suitable tetrahedral sites near an internal pore surface. Then, a H atom is added to an O atom bridging Si and Al atoms to create a Brønsted acid site (BAS). There are no internal silanol groups in this bulk model. To generate a model for an external surface, we adopt the fully hydroxylated surface structure of a layer within the ITQ-1 precursor with two silanols per lateral unit cell. A BAS on the external surface can be generated by replacing a near-surface Si atom with an Al atom and adding a H atom, as above. The strength of binding at a BAS of REE, X, taken to be present in the solution phase as nitrates, is determined from the energy change in the reaction X(NO 3 ) 3 + ≡Si–{OH}–Al≡ → ≡Si–{OX(NO 3 ) 2 }–Al≡+ HNO 3 . The strength of binding at the silanols is determined similarly. Binding energies are determined from two approaches. The first performs periodic plane-wave density functional theory (DFT) total energy analysis for an entire unit cell of MCM-22. The second utilizes cluster models capturing the local environment of REE binding sites and performs DFT analysis with localized basis sets. The two approaches yield consistent results for Nd, revealing similarly strong binding at either an external or internal BAS, but much weaker binding at a silanol site. This is consistent with the picture deduced from recent experiments. Here, we also comment on binding at Al-bridged siloxane sites, which have been suggested as alternative binding sites to BAS.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Geothermal-integrated thermally anisotropic building envelope for energy and peak-demand reduction

Buildings consume large amounts of energy for heating and cooling, while peak electricity demand places significant stress on the power grid. This paper presents a reduced-order co-simulation framework and load-oriented supervisory control strategy for a geothermal-integrated thermally anisotropic building envelope with a ground loop (TABE+GL). In TABE+GL, a hydronic loop embedded in the building envelope is directly coupled with a geothermal ground loop, allowing for bidirectional heat exchange between the envelope, the ground, and the indoor environment. A hybrid co-simulation framework was established by coupling a reduced-order resistor–capacitor (RC) thermal network model with EnergyPlus augmented with GHEDesigner modules. The RC model generated feasible heat flux options under three operating modes, and EnergyPlus predicted sensible loads, energy use, and pump energy demand. At each simulation step, a supervisory control algorithm selected the optimal loop configuration and duty factor that maximizes useful TABE geothermal utilization without exceeding the predicted sensible load, thereby avoiding overheating or cooling. Case studies were conducted for Los Angeles, California, Charleston, South Carolina, and Denver, Colorado. Results showed that the proposed framework reduced HVAC electricity consumption by 43%–67%, natural gas use for space heating by 11%–38%, and peak electricity demand by 43%–88%. These results highlight the potential of combining reduced-order envelope modeling, direct geothermal coupling, and load-oriented supervisory control to improve whole building energy performance and reduce peak demand across diverse weather conditions.

Howard, Daniel [Southern Adventist University]↗

Machine Intelligence to Detect, Characterise, and Defend against Influence Operations in the Information Environment

Social media has enabled a new era of manipulation in the information and cognitive domains. Deceptive content—misleading, falsified, and fabricated—is routinely created and spread in the modern social media environment with the intent to create confusion and widen political and social divides, and exploit the societal conflict exacerbated by these divides in the real-world (aka physical domain). Such disinformation campaigns demonstrate a threat to the integrity of economic, political, cultural, public health, and national security institutions around the world. In this work we overview our artificial intelligence (AI) capabilities to detect, describe, and defend against information operations on Twitter as an example social platform to understand the influence of misleading and falsified content diffusion and better enable those charged with defending against such manipulation to enable responsive parties to counter it. We first present novel linguistically-informed deep learning (DL) models for misinformation and disinformation detection, and present an in-depth linguistic analysis of psycho-linguistic markers across broad deception categories. We then demonstrate how our models perform in the multilingual and multimodal setting and categorize falsified and misleading content based on the intent to deceive. We also provide a large-scale analysis to describe user behavior and spread patterns while engaging with deceptive content and report novel findings about the immediate diffusion of deceptive content by characterizing the vulnerable sub-populations and their demographics, and explicitly measuring speed and scale of deception spread to uncover who shares deceptive content, how quickly, how much, and how evenly. In addition, we measure audience reactions to misinformation and disinformation at scale, distinguishing the reactions of users identified as bots versus humans. Finally, we take advantage of deep translation and generation models to create unique solutions for real-time defense against digital deception and discuss how to apply causal inference to prescribe and intervene into strategic communications jointly across information, cognitive, and physical domains.

artificial intelligence, deep learning, neural lan↗