Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Generative models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

LENS: Learning Enabled Network Synthesis

RTRC and UMD have developed novel machine learning based methods under the ARPA-E DIFFERENTIATE program for rapid acceleration of hypothesis generation in complex architecture design spaces involving both discrete choices of component inclusion and interconnection and continuous parametric decisions. The project named Learning Enabled Network Synthesis (LENS) further demonstrated the developed methods on challenging electrical power converter design problems by identifying the most suitable circuit topologies and simultaneously selecting the most appropriate components to achieve optimized design of power converter with improved performances. We demonstrated that LENS could enable exploration of very large design space of circuit topologies and components by addressing the limitations of conventional design process in non-linear, high switching speed, multi-dimensional power converter design and optimization. The key innovation developed in LENS is the seamless integration of statistical learning and logical reasoning techniques and building on the individual strengths of these techniques for rapid hypothesis discovery. The main component of LENS comprises of: 1) Graph Reasoning Engine (GRE) to enforce composition rules that rapidly reject all discrete architectures that are composed incorrectly and generates an adaptive database of feasible designs which can be used by ML modules, 2) Graph Generative Learning module which is a deep neural network based generative model for graph architectures which can enable design space exploration beyond the dataset generated by the GRE, 3) Graph Reduced Order Model (ROM) for graph domains for accelerating computation of output metrics, and 4) Active learning and Rule Discovery module for sample efficient learning and extracting logical rules from the learned ML models which will be integrated in the GRE to enhance the filtering effectiveness. LENS approach can be applied to any design domains where designs can be represented as multi-attribute graphs. The LENS team integrated the various technical innovations listed above into an optimization pipeline and exercised the optimization pipeline on the converter design problem. The LENS project demonstrated that the developed AI/ML technologies can be used to generate novel converter circuits >45x faster than experts on chosen use-cases. This can enable faster design space exploration and identification of new designs which are not considered by experts due to the increasing design space complexity. This has significant potential impact on the public and energy needs of the country. It is currently estimated that 30% of all electrical powers generated passes through power converters. The future estimate is that 80% of all power generated would be passing through converters. LENS fills a critical gap in this space since by accelerating the design process the designers would be able to generate more efficient converters which can lead to significant energy savings for the country.

42 ENGINEERING↗
DOE OSTI2021

Noise Robustness and Experimental Demonstration of a Quantum Generative Adversarial Network for Continuous Distributions

Abstract The potential advantage of machine learning in quantum computers is a topic of intense discussion in the literature. Theoretical, numerical, and experimental explorations will most likely be required to understand its power. There have been different algorithms proposed to exploit the probabilistic nature of variational quantum circuits for generative modeling. In this paper, a hybrid architecture for quantum generative adversarial networks (QGANs) is employed and their robustness in the presence of noise is studied. A simple way of adding different types of noise to the quantum generator circuit is devised, and the noisy hybrid QGANs (HQGANs) are simulated numerically to learn continuous probability distributions, and to show that the performance of HQGANs remains unaffected. The effect of different parameters on the training time is also investigated to reduce the computational scaling of the algorithm and simplify its deployment on a quantum computer. The training on Rigetti's Aspen‐4‐2Q‐A quantum processing unit is then performed, and the results from the training are presented. The authors' results pave the way for experimental exploration of different quantum machine learning algorithms on noisy intermediate‐scale quantum devices.

Anand, Abhinav↗
DOE OSTI2024

Systematic and objective evaluation of Earth system models: PCMDI Metrics Package (PMP) version 3

Systematic, routine, and comprehensive evaluation of Earth system models (ESMs) facilitates benchmarking improvement across model generations and identifying the strengths and weaknesses of different model configurations. By gauging the consistency between models and observations, this endeavor is becoming increasingly necessary to objectively synthesize the thousands of simulations contributed to the Coupled Model Intercomparison Project (CMIP) to date. The Program for Climate Model Diagnosis and Intercomparison (PCMDI) Metrics Package (PMP) is an open-source Python software package that provides quick-look objective comparisons of ESMs with one another and with observations. The comparisons include metrics of large- to global-scale climatologies, tropical inter-annual and intra-seasonal variability modes such as the El Niño–Southern Oscillation (ENSO) and Madden–Julian Oscillation (MJO), extratropical modes of variability, regional monsoons, cloud radiative feedbacks, and high-frequency characteristics of simulated precipitation, including its extremes. The PMP comparison results are produced using all model simulations contributed to CMIP6 and earlier CMIP phases. An important objective of the PMP is to document the performance of ESMs participating in the recent phases of CMIP, together with providing version-controlled information for all datasets, software packages, and analysis codes being used in the evaluation process. Among other purposes, this also enables modeling groups to assess performance changes during the ESM development cycle in the context of the error distribution of the multi-model ensemble. Quantitative model evaluation provided by the PMP can assist modelers in their development priorities. In this paper, we provide an overview of the PMP, including its latest capabilities, and discuss its future direction.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Dynamic consensus and extended high gain observers as a tool to achieve practical frequency synchronization in power systems under unknown time-varying power demand

In this paper, we consider the frequency synchronization problem in a network of lossless, connected, and network-reduced power system. Frequency synchronization is an important problem in power systems as frequency deviation can lead to degraded power quality, tripping of generators, etc. We present a load-estimator-based consensus algorithm in a network of fourth-order generator models that achieves practical frequency synchronization in the presence of unknown time-varying power demand. We do not assume that the demand is generated by a known model. We follow a multiple time-scale approach for the stability analysis. It is shown that synchronization is achieved for the case of constant power demand, by showing that the system is exponentially stable. Furthermore, for the case of time-varying power demand, we show the error trajectories are ultimately bounded, and the synchronization error is proportional to an upper bound on the derivative of the time-varying power demand. We simulate the controller performance on a four area network which is equivalent to the IEEE New England 39-Bus system.

42 ENGINEERING↗
DOE OSTI2021

Association‐based activity coefficient model for electrolyte solutions

Abstract This work presents an association‐based activity coefficient model that explicitly considers the solution nonideality due to associations among ions and solvent species. Built upon the electrolyte nonrandom two‐liquid (eNRTL) model, the model greatly improves the accuracy of eNRTL model for strongly associating electrolyte solutions due to presence of ionic species with high surface charge density. The model successfully correlates mean ionic activity coefficients of 46 aqueous single‐salt systems from 10 cations and 5 anions at 298.15 K up to their solubility limits. With the ion‐specific association parameters identified, the model accurately predicts activity and osmotic coefficients for aqueous mixed‐salt systems at 298.15 K. The temperature dependence of the model results has also been examined at 273–373 K. With superior accuracy over a wide range of concentration and temperature, the model represents a major advancement over eNRTL model and has a great potential to be a next‐generation model for electrolyte solutions.

Lin, Yu‐Jeng↗
DOE OSTI2023

Assembly of JAZ–JAZ and JAZ–NINJA complexes in jasmonate signaling

Jasmonates (JAs) are plant hormones with crucial roles in development and stress resilience. They activate MYC transcription factors by mediating the proteolysis of MYC inhibitors called JAZ proteins. In the absence of JA, JAZ proteins bind and inhibit MYC through the assembly of MYC–JAZ–Novel Interactor of JAZ (NINJA)–TPL repressor complexes. However, JAZ and NINJA are predicted to be largely intrinsically unstructured, which has precluded their experimental structure determination. Through a combination of biochemical, mutational, and biophysical analyses and AlphaFold-derived ColabFold modeling, we characterized JAZ–JAZ and JAZ–NINJA interactions and generated models with detailed, high-confidence domain interfaces. We demonstrate that JAZ, NINJA, and MYC interface domains are dynamic in isolation and become stabilized in a stepwise order upon complex assembly. By contrast, most JAZ and NINJA regions outside of the interfaces remain highly dynamic and cannot be modeled in a single conformation. Our data indicate that the small JAZ Zinc finger expressed in Inflorescence Meristem (ZIM) motif mediates JAZ–JAZ and JAZ–NINJA interactions through separate surfaces, and our data further suggest that NINJA modulates JAZ dimerization. This study advances our understanding of JA signaling by providing insights into the dynamics, interactions, and structure of the JAZ–NINJA core of the JA repressor complex.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

AI-Improved Resolution Projections of Population Characteristics and Imperviousness Can Improve Resolution and Accuracy of Urban Flood Predictions

Focal Area: (2) Predictive modeling through the use of AI techniques and AI-derived model components. Specifically, we call for the use of deep generative models from ML for providing high-resolution projections of impervious surface area, as well as neural network solvers for fast approximation of urban hydrodynamics to provide greatly enhanced forecasts of future urban flood dynamics.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

A guide on modeling electrostatics of semiconductor detectors in COMSOL Multiphysics ® for DRiFT

Adding a new semiconductor detector into the detector response function toolkit (DRiFT) requires a model of the electric potential and the electric field. To get an accurate electrostatics model, the geometry of the detector should be modeled as closely to the real geometry as feasible, including the semiconductor materials, doping layers and concentrations, and contacts. Since the electric field and potential are used to calculate the induced signal, the results of the detector response functions are largely influenced by the electrostatics models. Initial electrostatics models were completed using Silvaco, however, this document provides guidance on using COMSOL Mulitphysics ® (COMSOL) to model the detectors to give users additional flexibility. Guidance on using COMSOL and its user interface are mostly left out of this document, but best practices for geometry, modeling methods, and data format/exporting are included to help users generate models that are compatible with DRiFT, prevents bugs, issues, and inaccuracies during charge collection calculations. The following summary provides an overview of the document.

42 ENGINEERING↗
DOE OSTI2023

Fast and accurate simulations of calorimeter showers with normalizing flows

In this study, we introduce caloflow, a fast detector simulation framework based on normalizing flows. For the first time, we demonstrate that normalizing flows can reproduce many-channel calorimeter showers with extremely high fidelity, providing a fresh alternative to computationally expensive geant4 simulations, as well as other state-of-the-art fast simulation frameworks based on generative adversarial networks (GANs) or variational autoencoders (VAEs). In addition to the usual histograms of physical features and images of calorimeter showers, we introduce a new metric for judging the quality of generative modeling: the performance of a classifier trained to differentiate real from generated images. We show that GAN-generated images can be identified by the classifier with nearly 100% accuracy, while images generated from caloflow are better able to fool the classifier. More broadly, normalizing flows offer several advantages compared to other state-of-the-art approaches (GANs and VAEs), including tractable likelihoods, stable and convergent training, and principled model selection. Normalizing flows also provide a bijective mapping between data and the latent space, which could have other applications beyond simulation, for example, to detector unfolding.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

Contrasting Time-Frequency Representations for Unknown Waveform Detection

Identifying unseen electromagnetic waveforms is critical for many applications, like interference management, electronic warfare and spectrum management. Traditionally this is done using statistical methods for anomaly detection, which has evolved to deep learning models for identifying the unseen data, formally termed as open set recognition. Some prior methods use a generative model to emulate open set data, which face challenges in generating synthetic samples for open set while simultaneously selecting an optimal discriminator for accurate classification. To alleviate this issue, we propose a discriminative model that effectively combines time and frequency domain features of communication signals for accurate predictions. We further introduce a cosine similarity loss that makes the domain specific features unique to enhance the prediction rate. Additionally, our model avoids generic feature vectors by extracting class-specific features during training, resulting in improved class representation. The experiment results show that this combined feature approach with cosine loss outperforms single-domain models and improves accuracy by 10% over models without cosine loss.

99 - GENERAL AND MISCELLANEOUS↗
DOE OSTI2026

Hierarchical transfer learning: an agile and equitable strategy for machine-learning interatomic models

Machine-learned interatomic models are growing in popularity due to their ability to afford near quantum-accurate predictions for complex phenomena with orders-of-magnitude greater computational efficiency. However, these models struggle when applied to systems of many element types due to the approximately exponential increase in number of parameters that must be determined. To mitigate this challenge, we present a new hierarchical transfer learning approach that allows the fitting problem to be decomposed into smaller independent and reusable parameter blocks that enable development of explicitly chemically extensible ML-IAM. Application of this strategy is demonstrated for C and N mixtures under conditions ranging from nominally ambient to ~10,000 K and 200 GPa for compositions from 0 to 100% N. Ultimately, this strategy makes model generation for chemically complex systems more tractable and efficient, facilitates comprehensive model validation, and makes ML-IAM development for problems of this nature more accessible to users with limited access to extreme computing infrastructure.

Lindsey, Rebecca K. [Univ. of Michigan, Ann Arbor,↗
DOE OSTI2024

ATAT: Astronomical Transformer for time series and Tabular data

Context. The advent of next-generation survey instruments, such as theVera C. RubinObservatory and its Legacy Survey of Space and Time (LSST), is opening a window for new research in time-domain astronomy. The Extended LSST Astronomical Time-Series Classification Challenge (ELAsTiCC) was created to test the capacity of brokers to deal with a simulated LSST stream. Aims. Our aim is to develop a next-generation model for the classification of variable astronomical objects. We describe ATAT, the Astronomical Transformer for time series And Tabular data, a classification model conceived by the ALeRCE alert broker to classify light curves from next-generation alert streams. ATAT was tested in production during the first round of the ELAsTiCC campaigns. Methods. ATAT consists of two transformer models that encode light curves and features using novel time modulation and quantile feature tokenizer mechanisms, respectively. ATAT was trained on different combinations of light curves, metadata, and features calculated over the light curves. We compare ATAT against the current ALeRCE classifier, a balanced hierarchical random forest (BHRF) trained on human-engineered features derived from light curves and metadata. Results. When trained on light curves and metadata, ATAT achieves a macro F1 score of 82.9 ± 0.4 in 20 classes, outperforming the BHRF model trained on 429 features, which achieves a macro F1 score of 79.4 ± 0.1. Conclusions. The use of transformer multimodal architectures, combining light curves and tabular data, opens new possibilities for classifying alerts from a new generation of large etendue telescopes, such as theVera C. RubinObservatory, in real-world brokering scenarios.

Astronomy & Astrophysics↗
DOE OSTI2021

Thresholding Analysis and Feature Extraction from 3D Ground Penetrating Radar Data for Noninvasive Assessment of Peanut Yield

This study explores the efficacy of utilizing a novel ground penetrating radar (GPR) acquisition platform and data analysis methods to quantify peanut yield for breeding selection, agronomic research, and producer management and harvest applications. Sixty plots comprising different peanut market types were scanned with a multichannel, air-launched GPR antenna. Image thresholding analysis was performed on 3D GPR data from four of the channels to extract features that were correlated to peanut yield with the objective of developing a noninvasive high-throughput peanut phenotyping and yield-monitoring methodology. Plot-level GPR data were summarized using mean, standard deviation, sum, and the number of nonzero values (counts) below or above different percentile threshold values. Best results were obtained for data below the percentile threshold for mean, standard deviation and sum. Data both below and above the percentile threshold generated good correlations for count. Correlating individual GPR features to yield generated correlations of up to 39% explained variability, while combining GPR features in multiple linear regression models generated up to 51% explained variability. The correlations increased when regression models were developed separately for each peanut type. This research demonstrates that a systematic search of thresholding range, analysis window size, and data summary statistics is necessary for successful application of this type of analysis. The results also establish that thresholding analysis of GPR data is an appropriate methodology for noninvasive assessment of peanut yield, which could be further developed for high-throughput phenotyping and yield-monitoring, adding a new sensor and new capabilities to the growing set of digital agriculture technologies.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Stochastic representation and conditioning of process-based geological model by deep generative and recognition networks

Accurate and realistic geological modeling is the core of oil and gas development and production. In recent years, process-based methods are developed to produce highly realistic geological models by simulating the physical processes that reproduce the sedimentary events and develop the geometry. However, the complex dynamic processes are extremely expensive to simulate, making process-based models difficult to be conditioned to field data. In this work, we propose a comprehensive generative adversarial network framework as a machine-learning-assisted approach for mimicking the outputs of process-based geological models with fast generation. The main objective of our work is to obtain a continuous parametrization of the highly realistic process-based geological models which enables us to calibrate the models and condition the models to data. Numerical results are presented to illustrate the capability of our proposed methodology.

58 GEOSCIENCES↗
DOE OSTI2021

The impact of coupled air–sea interaction on extreme East Asian summer monsoon simulation in CMIP5 models

Abstract In this study, the relationship between the ability to simulate air–sea interactions over the western North Pacific (WNP), and to reproduce the extreme East Asian summer monsoon (EASM), were investigated by comparing the performances of several global climate models (GCMs). High ranked in air–sea interaction simulation (HRA) and low ranked in air–sea interaction simulation (LRA) models were selected, according to their performance in simulating relations between sea surface temperature (SST) and precipitation over the WNP, from the ensemble of models that participated in the third and fifth phases of the Coupled Model Intercomparison Project (CMIP3, CMIP5). Compared with CMIP3 models, CMIP5 models exhibited improved simulations of the distinctive air–sea interaction over the WNP, namely, the strong atmospheric forcing on the ocean. Among CMIP5 models, HRA models, which reproduced intrinsic negative correlations between precipitation and SST over the WNP, could simulate the extreme EASM better than LRA models. In particular, HRA models generated a more realistic spatial distribution of the extreme EASM compared with LRA models. The defects of the LRA models resulted from distorted synoptic fields, including underestimated geopotential height and overestimated low‐level wind over the WNP, inducing unrealistic moisture supply and convection due to the exaggerated SST forcing. In contrast, reasonable air–sea interactions represented in HRA models lead to realistic synoptic fields over the WNP, and proper simulation of the extreme EASM.

Kim, Taehyung↗
DOE OSTI2024

Feasibility of Formulating Ecosystem Biogeochemical Models From Established Physical Rules

Abstract To improve the predictive capability of ecosystem biogeochemical models (EBMs), we discuss the feasibility of formulating biogeochemical processes using physical rules that have underpinned the many successes in computational physics and chemistry. We argue that the currently popular empirically based approaches, such as multiplicative empirical response functions and the law of the minimum, will not lead to EBM formulations that can be continuously refined to incorporate improved mechanistic understanding and empirical observations of biogeochemical processes. Instead, we propose that EBM parameterizations, as a lossy data compression problem, can be better formulated using established physical rules widely used in computational physics and chemistry, and different biogeochemical processes can be more robustly integrated within a reactive‐transport framework. Through several examples, we demonstrate how mathematical representations derived from physical rules can improve understanding of relevant biogeochemical processes and enable more effective communication between modelers, observationalists, and experimentalists regarding essential questions, such as what measurements are needed to meaningfully inform models and how can models generate new process‐level hypotheses to test in empirical studies. Finally, while empirical models with more parameters are often less robust, physical rules‐based models can be more robust and show lower predictive equifinality, stemming from their enhanced consistency in representations of processes, interactions and spatial scaling.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Physics-informed semantic inpainting: Application to geostatistical modeling

A fundamental problem in geostatistical modeling is to infer the heterogeneous geological field based on limited measurements and some prior spatial statistics. Semantic inpainting, a technique for image processing using deep generative models, has been recently applied for this purpose, demonstrating its effectiveness in dealing with complex spatial patterns. However, the original semantic inpainting framework incorporates only information from direct measurements, while in geostatistics indirect measurements are often plentiful. In this work, to overcome this limitation, we propose a physics-informed semantic inpainting framework, employing the Wasserstein Generative Adversarial Network with Gradient Penalty (WGAN-GP) and jointly incorporating the direct and indirect measurements by exploiting the underlying physical laws. Our simulation results for a high-dimensional problem with 512 dimensions show that in the new method, the physical conservation laws are satisfied and contribute in enhancing the inpainting performance compared to using only the direct measurements.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Modeling household-level party composition behavior for multiparty activities: a random parameter nested logit modeling approach

This study presents findings of a household-level party composition model for multiparty activities. It exploits data from a comprehensive Household Travel Survey conducted by Chicago Metropolitan Agency of Planning. The study estimates a random parameter nested logit model to capture households’ unobserved preference heterogeneity and non-proportional substitution patterns in terms of activity party composition for multiparty activities. A wide variety of household demographics, activity attributes and residential neighborhood characteristics are examined in this paper. The magnitude of the impacts of the determinants are tested in this study by analyzing the elasticity of the variables, which suggests that household demographics and attributes of the multiparty activities have significant effects on the household-level activity party composition. Residential neighborhood characteristics, although somewhat less impactful, still play a meaningful role. This model will be implemented within the POLARIS transportation systems simulator to improve the activity generation modeling workflow, and the prediction accuracy of various activity-travel components.

activity party composition↗