Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Generative Model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

Hierarchical semi-Markov models with duration-aware dynamics for activity sequences

Residential electricity demand at granular scales is driven by what people do and for how long. Accurately forecasting this demand for applications like microgrid management and demand response therefore requires generative models for activities that can produce realistic daily activity sequences, capturing both the timing and duration of human behavior. This paper develops a generative model of human activity sequences using nationally representative time-use diaries at a 10-min resolution. We use this model to quantify which demographic factors are most critical for improving predictive performance. We propose a hierarchical semi-Markov framework that addresses two key modeling challenges. First, a time-inhomogeneous Markov router learns the patterns of “which activity comes next.” Second, a semi-Markov hazard component explicitly models activity durations, capturing “how long” activities realistically last. To ensure statistical stability when data are sparse, the model pools information across related demographic groups and time blocks. The entire framework is trained and evaluated using survey design weights to ensure our findings are representative of the U.S. population. On a held-out test set, we demonstrate that explicitly modeling durations with the hazard component provides a substantial and statistically significant improvement over purely Markovian models. Furthermore, our analysis reveals a clear hierarchy of demographic factors: Sex, Day-Type, and Household Size provide the largest predictive gains, while Region and Season, though important for energy calculations, contribute little to predicting the activity sequence itself. The result is an interpretable and robust generator of synthetic activity traces, providing a high-fidelity foundation for downstream energy systems modeling.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Targeting tissues via dynamic human systems modeling in generative design

Drug discovery is a complex, costly process with high failure rates. A successful drug should bind to a target, be deliverable to an intended site of activity, and promote a desired pharmacological effect without causing toxicity. Typically, these factors are evaluated in series over the course of a pipeline where the number of candidates is sequentially whittled down from a very large initial pool. One promise of AI-driven discovery is the opportunity to evaluate multiple facets of drug performance in parallel. However, despite ML-driven advancements, current models for pharmacological property prediction are exclusively trained to predict molecular properties, ignoring important, dynamic biodistribution and bioactivity effects. Here, we present our progress towards incorporating quantitative systems physiology models into an AI-enabled drug design and molecular generation pipeline. Within a genetic algorithm, we include human-relevant physiologically based pharmacokinetic (PBPK) models. These PBPK models leverage properties that are predicted by a fine-tuned molecular language model. Together, these models will aid in capturing the mapping between molecules and therapeutic outcomes that is necessary to accelerate the drug discovery process.

Fox, Zach↗

MENT-Flow: maximum-entropy phase space tomography using normalizing flows

Generative models can be trained to reproduce low-dimensional projections of high-dimensional phase space distributions. Normalizing flows are generative models that parameterize invertible transformations, allowing exact probability density evaluation and sampling. Consequently, flows are unbiased entropy estimators and could be used to solve the high-dimensional maximum-entropy tomography (MENT) problem. In this work, we evaluate a flow-based MENT solver (MENT-Flow) against exact maximum-entropy solutions and Minerbo's iterative MENT algorithm in two dimensions.

Hoover, Austin↗

Experimental comparison of residual stresses for a thermomechanical model for the simulation of selective laser melting

Selective laser melting (SLM) is an additive manufacturing process in which multiple, successive layers of metal powders are heated via laser in order to build a part. Modeling of SLM requires consideration of the complex interaction between heat transfer and solid mechanics. Here, the present work describes the authors initial efforts to validate their first generation model. In particular, the comparison of model-generated solid mechanics results, including both deformation and stresses, is presented. Additionally, results of various perturbations of the process parameters and modeling strategies are discussed.

42 ENGINEERING↗

CoarsenConf: Equivariant Coarsening with Aggregated Attention for Molecular Conformer Generation

Molecular conformer generation (MCG) is an important task in cheminformatics and drug discovery. The ability to efficiently generate low-energy 3D structures can avoid expensive quantum mechanical simulations, leading to accelerated virtual screenings and enhanced structural exploration. Several generative models have been developed for MCG, but many struggle to consistently produce high-quality conformers for meaningful downstream applications. To address these issues, we introduce CoarsenConf, which coarse-grains molecular graphs based on torsional angles and integrates them into an SE(3)-equivariant hierarchical variational autoencoder. Through equivariant coarse-graining, we aggregate the fine-grained atomic coordinates of subgraphs connected via rotatable bonds, creating a variable-length coarse-grained latent representation. Our model uses a novel aggregated attention mechanism to restore fine-grained coordinates from the coarse-grained latent representation, enabling efficient generation of accurate conformers. Furthermore, we evaluate the chemical and biochemical quality of our generated conformers on multiple downstream applications, including property prediction and large-scale oracle-based protein docking. Overall, CoarsenConf generates more accurate conformer ensembles compared to prior generative models.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Modeling Electric Generation Capital Costs with Uncertain Future CO 2 Pricing

As new environmental regulations are reevaluated and various tax subsidies begin to expire, the outlook for investors in power generation may be more uncertain than ever. There are many electric power generation studies and forecasts published by a wide array of entities from private consulting firms to government agencies and national labs. These studies show which power generation technologies are favored to be constructed under the assumptions within each future scenario, and many people in businesses and government use these studies for planning purposes and decision-making. One common need for assumptions in these studies is the rate of return investors will require for constructing new generation. It is shown in this paper that for each one percent added to the cost of capital (CoC) above a base level, the levelized cost of electricity (LCOE) increases by 1-to-4 percent for generation with a 30-year life and debt term, a length commonly used for conventional generation. Therefore, if analysts make a distinction in the CoC for different technologies without quantitative support, it could result in misleading technologies being chosen as favored when facing regulatory uncertainty. The practice of adding a penalty (percentage adder) to the CoC was initially discovered in the Annual Energy Outlook, published by the U.S. Energy Information Administration (EIA). This paper presents the framework typically used in scenario analysis for selecting a CoC, consistent with the practice in long-range planning models that seek to identify the best future generation technologies for meeting electricity demand. Examples are provided on why full specification and consistency is necessary to obtain accurate results for any scenario. It is also shown in this paper how the mischaracterization of regulatory uncertainty to address the uncertainty about CO2 mitigation in a scenario can lead to a misleading outcome when applying a risk penalty to the CoC. The analysis presented shows that applying a 3-percentage penalty to the CoC for fossil generation implies a different price per ton for each generation technology, which suggests the uncertainty about CO2 regulations would best be addressed through pricing sensitivity analyses rather than penalties added to the CoC.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

AIMSim : An accessible cheminformatics platform for similarity operations on chemicals datasets

The recent advances in deep learning, generative modeling, and statistical learning have ushered in a renewed interest in traditional cheminformatics tools and methods. Quantifying molecular similarity is essential in molecular generative modeling, exploratory molecular synthesis campaigns, and drug-discovery applications to assess how new molecules differ from existing ones. Further, most tools target advanced users and lack general implementations accessible to the larger community. In this work, we introduce Artificial Intelligence Molecular Similarity (AIMSim), an accessible cheminformatics platform for performing similarity operations on collections of molecules called molecular datasets. AIMSim provides a unified platform to perform similarity-based tasks on molecular datasets, such as diversity quantification, outlier and novelty analysis, clustering, dimensionality reduction, and inter-molecular comparisons. AIMSim implements all major binary similarity metrics and molecular fingerprints and is provided as a Python package that includes support for command-line use as well as a Graphical User Interface for code-free utilization with fully interactive plots.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Unifying simulation and inference with normalizing flows

There have been many applications of deep neural networks to detector calibrations and a growing number of studies that propose deep generative models as automated fast detector simulators. We show that these two tasks can be unified by using maximum likelihood estimation (MLE) from conditional generative models for energy regression. Unlike direct regression techniques, the MLE approach is prior independent and non-Gaussian resolutions can be determined from the shape of the likelihood near the maximum. Using an ATLAS-like calorimeter simulation, we demonstrate this concept in the context of calorimeter energy calibration. Published by the American Physical Society 2025

Hadronic calorimiters↗

RNA language models predict mutations that improve RNA function

Structured RNA lies at the heart of many central biological processes, from gene expression to catalysis. RNA structure prediction is not yet possible due to a lack of high-quality reference data associated with organismal phenotypes that could inform RNA function. We present GARNET (Gtdb Acquired RNa with Environmental Temperatures), a new database for RNA structural and functional analysis anchored to the Genome Taxonomy Database (GTDB). GARNET links RNA sequences to experimental and predicted optimal growth temperatures of GTDB reference organisms. Using GARNET, we develop sequence- and structure-aware RNA generative models, with overlapping triplet tokenization providing optimal encoding for a GPT-like model. Leveraging hyperthermophilic RNAs in GARNET and these RNA generative models, we identify mutations in ribosomal RNA that confer increased thermostability to the Escherichia coli ribosome. The GTDB-derived data and deep learning models presented here provide a foundation for understanding the connections between RNA sequence, structure, and function.

59 BASIC BIOLOGICAL SCIENCES↗

Can Simple Machine Learning Tools Extend and Improve Temperature-Based Methods to Infer Streambed Flux?

Temperature-based methods have been developed to infer 1D vertical exchange flux between a stream and the subsurface. Current analyses rely on fitting physically based analytical and numerical models to temperature time series measured at multiple depths to infer daily average flux. These methods have seen wide use in hydrologic science despite strong simplifying assumptions including a lack of consideration of model structural error or the impacts of multidimensional flow or the impacts of transient streambed hydraulic properties. We performed a “perfect-model experiment” investigation to examine whether regression trees, with and without gradient boosting, can extract sufficient information from model-generated subsurface temperature time series, with and without added measurement error, to infer the corresponding exchange flux time series at the streambed surface. Using model-generated, synthetic data allowed us to assess the basic limitations to the use of machine learning; further examination of real data is only warranted if the method can be shown to perform well under these ideal conditions. We also examined whether the inherent feature importance analyses of tree-based machine learning methods can be used to optimize monitoring networks for exchange flux inference.

54 ENVIRONMENTAL SCIENCES↗

Higgs Boson Production via Gluon Fusion in the Standard Model with four Generations

Higgs bosons can be produced copiously at the LHC via gluon fusion induced by top and bottom quark loops, and can be enhanced strongly if extra heavy quarks exist. We present results for Higgs+zero-, one- and two-jet production at the LHC operating at 7 and 14 TeV collision energy, in both the standard model and the 4th generation model, by evaluating the corresponding heavy quark triangle, box, and pentagon Feynman diagrams. We compare the results by using the effective Higgs-gluon interactions in the limit of heavy quarks with the cross sections including the full mass dependences. NLO effects on Higgs+zero-jet production rate with full mass dependence are presented for the first time consistently in the 4th generation model. Our results improve the theoretical basis for fourth generation effects on the Higgs boson search at the LHC.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

$\mathrm{D}$ark$\mathrm{F}$lux: A new tool to analyze indirect-detection spectra of next-generation dark matter models

Here we present DarkFlux, a software tool designed to analyze indirect-detection signatures for next-generation models of dark matter (DM) with multiple annihilation channels. Version 1.0 of this tool accepts user-generated models with 2→2 tree-level dark matter annihilation to pairs of Standard Model (SM) particles and analyzes DM annihilation to γ rays. The tool consists of three modules, which can be run in a loop in order to scan over DM mass if desired: The annihilation fraction module calls an internal installation of MadDM, a dark matter phenomenology plugin for the Monte Carlo event generator MadGraph5 _ aMC@NLO, to compute the thermally averaged cross section $\langle σv\rangle_i$ for each annihilation channel $χχ$ ($\bar{χ}$,$χ^†$)→ i $\∈{SM, SM}. . The module then computes the fractional annihilation rate (annihilation fraction) into each channel. The flux module combines the flux spectrum from each annihilation channel, weighted by the appropriate annihilation fractions, to compute the total flux at Earth due to DM annihilation. In DarkFlux v1.0, this module specifically computes the γ-ray flux for each channel using the publicly available PPPC4DMID tables. The analysis module compares the total flux to observational data and computes the upper limit at 95% confidence level (CL) on the total thermally averaged DM annihilation cross section. In DarkFlux v1.0, this module compares the total γ-ray flux to a joint-likelihood analysis of fifteen dwarf spheroidal galaxies (dSphs) analyzed by the Fermi-LAT collaboration. DarkFlux v1.0 automatically provides data tables and can plot the output of these three modules. In this manual, we briefly motivate this indirect-detection computer tool and review the essential DM physics. We then describe the several modules of DarkFlux in greater detail. Finally, we show how to install and run DarkFlux and provide two worked examples demonstrating its capabilities.

79 ASTRONOMY AND ASTROPHYSICS↗

Accelerating accurate simulations of calorimeter showers with normalizing flows and probability density distillation

Recently, we introduced caloflow, a high-fidelity generative model for GEANT4 calorimeter shower emulation based on normalizing flows. Here, we present caloflow v2, an improvement on our original framework that speeds up shower generation by a further factor of 500 relative to the original. The improvement is based on a technique called probability density distillation, originally developed for speech synthesis in the machine learning literature, and which we develop further by introducing a set of powerful new loss terms. We demonstrate that caloflow v2 preserves the same high fidelity as the original using qualitative (average images, histograms of high-level features) and quantitative (classifier metric between geant4 and generated samples) measures. The result is a generative model for calorimeter showers that matches the state of the art in speed (a factor of 10 4 faster than GEANT4) and greatly surpasses the previous state of the art in fidelity.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Double-lepton polarization asymmetries in B{yields}K{sub 0}*(1430)l{sup +}l{sup -} decay in the fourth-generation standard model

In this paper, by deriving the expressions for double-lepton polarization asymmetries for B to a scalar meson transition in SM and SM4 and considering the corresponding uncertainties in SM we investigate the indirect effects of the fourth generation of quarks on such asymmetries in the B{yields}K{sub 0}*(1430)l{sup +}l{sup -} decay. We also compare these asymmetries with those of B{yields}Kl{sup +}l{sup -} decay and find out that most of these asymmetries behave similarly to the corresponding asymmetries for B{yields}Kl{sup +}l{sup -} decay. We finally show that in the {mu} channel all asymmetries, except <P{sub LL}>, and in {tau} channel only <P{sub LN}> can manifest the influence of the fourth generation at the minimum value of m{sub t}{sup '} around 200 GeV. In addition, it is shown that for the {tau} channel the asymmetries such as <P{sub LL}>, <P{sub NN}>, and <P{sub TT}> can indicate the effect of such new physics at m{sub t}{sup '}{>=}300 GeV. Hence, the B{yields}K{sub 0}{sup *}(1430)l{sup +}l{sup -} decay is a valuable tool for probing new physics beyond SM, especially in the indirect searches of the fourth generation of quarks (t{sup '},b{sup '}) via its manifestations in loop diagrams.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Equivalent Test Bed in PSCAD and PSLF for Studying Advanced Power Systems Controller Performance

With increasing popularity of sustainable energy resources, research on power electronic-based renewable generation modeling is gaining impetus to enhance reliability of electric grids with high penetrations of renewable energy. A set of generic and public models for renewable energy are available in commercial positive sequence power system simulation software. However, advanced controller models applicable for renewable resources are typically not included in these tools. To ensure the integrity of the newly developed controller models for renewables in positive sequence simulators for large power systems, it is necessary to validate the dynamic performance of the proposed model with detailed electromagnetic models. This paper creates an equivalent test bed in PSCAD and PSLF for validating the performance of advanced controllers associated with renewable energy sources. To demonstrate the usefulness of the test-bed, a user-defined synthetic inertia (SI) controller model was developed in PSLF and validated through the proposed test bed.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Ensemble flow reconstruction in the atmospheric boundary layer from spatially limited measurements through latent diffusion models

Due to costs and practical constraints, field campaigns in the atmospheric boundary layer typically only measure a fraction of the atmospheric volume of interest. Machine learning techniques have previously successfully reconstructed unobserved regions of flow in canonical fluid mechanics problems and two-dimensional geophysical flows, but these techniques have not yet been demonstrated in the three-dimensional atmospheric boundary layer. Here, we conduct a numerical analogue of a field campaign with spatially limited measurements using large-eddy simulation. We pose flow reconstruction as an inpainting problem, and reconstruct realistic samples of turbulent, three-dimensional flow with the use of a latent diffusion model. The diffusion model generates physically plausible turbulent structures on larger spatial scales, even when input observations cover less than 1% of the volume. Through a combination of qualitative visualization and quantitative assessment, we demonstrate that the diffusion model generates meaningfully diverse samples when conditioned on just one observation. These samples successfully serve as initial conditions for a large-eddy simulation code. We find that diffusion models show promise and potential for other applications for other turbulent flow reconstruction problems.

17 WIND ENERGY↗

Product component genealogy modeling and field-failure prediction

Many industrial products consist of multiple components that are necessary for system operation. There is an abundance of literature on modeling the lifetime of such components through competing risks models. During the life-cycle of a product, it is common for there to be incremental design changes to improve reliability, to reduce costs, or due to changes in availability of certain part numbers. These changes can affect product reliability but are often ignored in system lifetime modeling. By incorporating this information about changes in part numbers over time (information that is readily available in most production databases), better accuracy can be achieved in predicting time to failure, thus yielding more accurate field-failure predictions. This paper presents methods for estimating parameters and predictions for this generational model and a comparison with existing methods through the use of simulation. Our results indicate that the generational model has important practical advantages and outperforms the existing methods in predicting field failures.

42 ENGINEERING↗