Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Generative Model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Unsupervised probabilistic models for sequential Electronic Health Records

We develop an unsupervised probabilistic model for heterogeneous Electronic Health Record (EHR) data. Utilizing a mixture model formulation, our approach directly models sequences of arbitrary length, such as medications and laboratory results. This allows for subgrouping and incorporation of the dynamics underlying heterogeneous data types. The model consists of a layered set of latent variables that encode underlying structure in the data. These variables represent subject subgroups at the top layer, and unobserved states for sequences in the second layer. We train this model on episodic data from subjects receiving medical care in the Kaiser Permanente Northern California integrated healthcare delivery system. The resulting properties of the trained model generate novel insight from these complex and multifaceted data. In addition, we show how the model can be used to analyze sequences that contribute to assessment of mortality likelihood.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Application of the Metabolic Modeling Pipeline in KBase to Categorize Reactions, Predict Essential Genes, and Predict Pathways in an Isolate Genome

The DOE Systems Biology Knowledgebase (KBase) platform offers a range of powerful tools for the reconstruction, refinement, and analysis of genome-scale metabolic models built from microbial isolate genomes. In this chapter, we describe and demonstrate these tools in action with an analysis of isoprene production in the Bacillus subtilis DSM genome. Two different methods are applied to build initial metabolic models for the DSM genome, then the models are gapfilled in three different growth conditions. Next, flux balance analysis (FBA) and flux variability analysis (FVA) techniques are applied to both study the growth of these models in minimal media and classify reactions within each model based on essentiality and functionality. The models are applied with the FBA method to predict essential genes, which are then compared to an updated list of essential genes obtained for B. subtilis 168, a very similar strain to the DSM isolate. The models are also applied to simulate Biolog growth conditions, and these results are compared with Biolog data collected for B. subtilis 168. Finally, the DSM metabolic models are applied to explore the pathways and genes responsible for producing isoprene in this strain. These studies demonstrate the accuracy and utility of models generated from the KBase pipelines, as well as exploring the tools available for analyzing these models.

Allen, Benjamin↗
DOE OSTI2019

Bayesian and LASSO Regressions for Comparative Permeability Modeling of Sandstone Reservoirs

In this research, Bayesian model averaging (BMA) and least absolute shrinkage and selection operator regression (LASSO) algorithms were adopted for the core permeability modeling as a function of well log and core measurements. More specifically, the core permeability (dependent factor) was modeled given the well log and core data (independent variables) and then predicted in non-cored intervals of a well in a sandstone formation. The BMA is a stochastic linear modeling and a Bayesian parameter selection. Among 50 linear models generated as a function of the independent variables and depicted in Occam’s window, the best model of the highest posterior probability is determined. The best model has the optimal subset parameters that most influences the response factor. The core permeability modeling was again conducted using the LASSO algorithm, which adopts a completely different way of modeling and subset selection by using the penalized least-squared equation. Both BMA and LASSO resulted in a very accurate prediction of the core permeability by achieving perfect measured and calculated permeability matching. Matches for the two algorithms were quantified by computing the adjusted R-squared and root-mean-squared prediction error. In addition, results of the BMA and LASSO were compared to the conventional multiple linear regression (LM). The LASSO algorithm led to an accurate matching similar to LM, but slightly better than BMA. Therefore, both BMA and LASSO represent integrated procedures for accurate permeability estimation similar to conventional regression analysis.

58 GEOSCIENCES↗
DOE OSTI2018

A New Research Approach for Observing and Characterizing Land–Atmosphere Feedback

Forecast errors with respect to wind, temperature, moisture, clouds, and precipitation largely correspond to the limited capability of current earth system models to capture and simulate and-atmosphere feedback. To facilitate its realistic simulation in next generation models, an improved process understanding of the related complex interactions is essential. To this end, accurate 3D observations of key variables in the land-atmosphere (L-A) system with high vertical and temporal resolution from the surface to the free troposphere are indispensable. Recently, we developed a synergy of innovative ground-based, scanning active remote sensing systems for 2D to 3D measurements of wind, temperature, and water vapor from the surface to the lower troposphere that is able to provide comprehensive data sets for characterizing L-A feedback independently of any model input. Several new applications are introduced such as the mapping of surface momentum, sensible heat, and latent heat fluxes in heterogeneous terrain, the testing of Monin-Obukhov similarity theory and turbulence parameterizations, the direct measurement of entrainment fluxes, and the development of new flux-gradient relationships. An experimental design taking advantage of the sensors’ synergy and advanced capabilities was realized for the first time during the Land Atmosphere Feedback Experiment (LAFE), conducted at the Atmospheric Radiation Measurement Program Southern Great Plains site in August 2017. The scientific goals and the strategy of achieving them with the LAFE data set are introduced. We envision the initiation of innovative L-A feedback studies in different climate regions to improve weather forecast, climate, and earth system models worldwide.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Changes in Annual Extremes of Daily Temperature and Precipitation in CMIP6 Models

This study presents an analysis of daily temperature and precipitation extremes with return periods ranging from 2 to 50 years in phase 6 of the Coupled Model Intercomparison Project (CMIP6) multimodel ensemble of simulations. Judged by similarity with reanalyses, the new-generation models simulate the present-day temperature and precipitation extremes reasonably well. In line with previous CMIP simulations, the new simulations continue to project a large-scale picture of more frequent and more intense hot temperature extremes and precipitation extremes and vanishing cold extremes under continued global warming. Changes in temperature extremes outpace changes in global annual mean surface air temperature (GSAT) over most landmasses, while changes in precipitation extremes follow changes in GSAT globally at roughly the Clausius–Clapeyron rate of ~7% °C –1 . Changes in temperature and precipitation extremes normalized with respect to GSAT do not depend strongly on the choice of forcing scenario or model climate sensitivity, and do not vary strongly over time, but with notable regional variations. Over the majority of land regions, the projected intensity increases and relative frequency increases tend to be larger for more extreme hot temperature and precipitation events than for weaker events. To obtain robust estimates of these changes at local scales, large initial-condition ensemble simulations are needed. Appropriate spatial pooling of data from neighboring grid cells within individual simulations can, to some extent, reduce the needed ensemble size.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2010

A model of the effects of heavy ion radiation on human tissue

In heavy ion radiotherapy and space travel humans are exposed to energetic heavy ions (C, Si, Fe and others). This type of irradiation often produces more severe biological effects per unit dose than more common X-rays. A new Monte Carlo model generates a physical space with the complex geometry of human tissue or a cell culture based model of tissue, which is affected by the passage of ionizing radiation. For irradiation, the model relies on a physical code for the ion track structure; for tissues, cellular maps are derived from two- or three-dimensional confocal microscopy images using image segmentation algorithm, which defines cells as pixilated volumes. The model is used to study tissue-specific statistics of direct ion hits and the remote ion action on cells. As an application of the technique, we considered the spatial pattern of apoptotic cells after heavy ion irradiation. The pattern of apoptosis is modeled as a stochastic process, which is defined by the action cross section taken from available experimental data. To characterize the degree of apoptosis, an autocorrelation function that describes the spatial correlation of apoptotic cells is introduced. The values of the autocorrelation function demonstrate the effect of the directionality of the radiation track on the spatial arrangements of inactivated cells in tissue. This effect is intrinsic only to high linear-energy-transfer radiation.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

A Diffusion‐Based Uncertainty Quantification Method to Advance E3SM Land Model Calibration

Abstract Calibrating land surface models and accurately quantifying their uncertainty are crucial for improving the reliability of simulations of complex environmental processes. This, in turn, advances our predictive understanding of ecosystems and supports climate‐resilient decision‐making. Traditional calibration methods, however, face challenges of high computational costs and difficulties in accurately quantifying parameter uncertainties. To address these issues, we develop a diffusion‐based uncertainty quantification (DBUQ) method. Unlike conventional generative diffusion methods, which are computationally expensive and memory‐intensive, DBUQ innovates by formulating a parameterized generative model and approximates this model through supervised learning, which enables quick generation of parameter posterior samples to quantify its uncertainty. DBUQ is effective, efficient, and general‐purpose, making it suitable for site‐specific ecosystem model calibration and broadly applicable for parameter uncertainty quantification across various earth system models. In this study, we applied DBUQ to calibrate the Energy Exascale Earth System Model land model at the Missouri Ozark AmeriFlux forest site. Results indicated that DBUQ produced accurate parameter posterior distributions similar to those from Markov Chain Monte Carlo sampling but with 30 times less computing time. This significant improvement in efficiency suggests that DBUQ can enable rapid, site‐level model calibration at a global scale, enhancing our predictive understanding of climate impacts on terrestrial ecosystems.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2019

Design and analysis of machine learning exchange-correlation functionals via rotationally invariant convolutional descriptors

Here, we explore the potential of a data-driven approach to the design of exchange-correlation (xc) functionals. The approach, inspired by convolutional filters in computer vision and surrogate functions from optimization, utilizes convolutions of the electron density to form a feature space to represent local electronic environments and neural networks to map the features to the exchange-correlation energy density. These features are orbital free, and provide a systematic route to including information at various length scales. This work shows that convolutional descriptors are theoretically capable of an exact representation of the electron density, and proposes Maxwell-Cartesian spherical harmonic kernels as a class of rotationally invariant descriptors for the construction of machine learned functionals. The approach is demonstrated using data from the B3LYP functional on a number of small molecules containing C, H, O, and N along with a neural network regression model. The machine learned functionals are compared to standard physical approximations and the accuracy is assessed for the absolute energy of each molecular system as well as formation energies. The results indicate that it is possible to reproduce the exchange-correlation portion of B3LYP formation energies to within chemical accuracy using orbital-free descriptors with a spatial extent of 0.2 Å. The findings provide empirical insight into the spatial range of electron exchange, and suggest that the combination of convolutional descriptors and machine learning regression models is a promising framework for xc functional design, although challenges remain in obtaining training data and generating models consistent with pseudopotentials.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Training a Quantum Annealing Based Restricted Boltzmann Machine on Cybersecurity Data

A restricted Boltzmann machine (RBM) is a generative model that could be used in effectively balancing a cybersecurity dataset because the synthetic data a RBM generates follows the probability distribution of the training data. RBM training can be performed using contrastive divergence (CD) and quantum annealing (QA). QA-based RBM training is fundamentally different from CD and requires samples from a quantum computer. We present a real-world application that uses a quantum computer. Specifically, we train a RBM using QA for cybersecurity applications. The D-Wave 2000Q has been used to implement QA. RBMs are trained on the ISCX data, which is a benchmark dataset for cybersecurity. For comparison, RBMs are also trained using CD. CD is a commonly used method for RBM training. Our analysis of the ISCX data shows that the dataset is imbalanced. We present two different schemes to balance the training dataset before feeding it to a classifier. The first scheme is based on the undersampling of benign instances. The imbalanced training dataset is divided into five sub-datasets that are trained separately. A majority voting is then performed to get the result. Our results show the majority vote increases the classification accuracy up from 90.24% to 95.68%, in the case of CD. For the case of QA, the classification accuracy increases from 74.14% to 80.04%. In the second scheme, a RBM is used to generate synthetic data to balance the training dataset. We show that both QA and CD-trained RBM can be used to generate useful synthetic data. Balanced training data is used to evaluate several classifiers. Among the classifiers investigated, K-Nearest Neighbor (KNN) and Neural Network (NN) perform better than other classifiers. They both show an accuracy of 93%. Our results show a proof-of-concept that a QA-based RBM can be trained on a 64-bit binary dataset. The illustrative example suggests the possibility to migrate many practical classification problems to QA-based techniques. Further, we show that synthetic data generated from a RBM can be used to balance the original dataset.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2010

Integrating Ion Mobility Mass Spectrometry with Molecular Modelling to Determine the Architecture of Multiprotein Complexes

Current challenges in the field of structural genomics point to the need for new tools and technologies for obtaining structures of macromolecular protein complexes. Here, we present an integrative computational method that uses molecular modelling, ion mobility-mass spectrometry (IM-MS) and incomplete atomic structures, usually from X-ray crystallography, to generate models of the subunit architecture of protein complexes. We begin by analyzing protein complexes using IM-MS, and by taking measurements of both intact complexes and sub-complexes that are generated in solution. We then examine available high resolution structural data and use a suite of computational methods to account for missing residues at the subunit and/or domain level. High-order complexes and sub-complexes are then constructed that conform to distance and connectivity constraints imposed by IM-MS data. We illustrate our method by applying it to multimeric protein complexes within the Escherichia coli replisome: the sliding clamp, (β 2 ), the γ complex (γ 3 δδ'), the DnaB helicase (DnaB 6 ) and the Single-Stranded Binding Protein (SSB 4 ).

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Explicit physics-informed neural networks for nonlinear closure: The case of transport in tissues

In upscaling methods, closures for nonlinear problems present a well-known challenge. While a number of theoretical methods have been proposed for handling such closures, nonlinearities still remain a significant obstacle for many problems. In this work, we use a combination of formal upscaling and data-driven machine learning for explicitly closing a nonlinear transport and reaction process in multiscale tissues. The classical effectiveness factor model is used to formulate the macroscale reaction kinetics. We train a multilayer perceptron network using training data generated by direct numerical simulations over microscale examples. Once trained, the network is used in an algorithm for numerically solving the upscaled (coarse-grained) differential equation describing mass transport and reaction in two example tissues. The network is described as being explicit in the sense that the network is trained using macroscale concentrations and gradients of concentration as components of the feature space rather than incorporating them as part of a constraint in the optimization process. Network training and solutions to the macroscale transport equations were computed for two different tissues. The two tissue types (brain and liver) exhibit markedly different geometrical complexity and spatial scale (cell size and sample size). The upscaled solutions for the average concentration are compared with numerical solutions derived from the microscale concentration fields by a posteriori averaging. There are three outcomes of this work of particular note. 1) Our overall approach results in an upscaled nonlinear PDE. The PDE is closed using a neural network, and our approach results in the definition of the classical effectiveness factor for effecting closure. 2) We identify particular source terms for the closure problem that are important for representing the structure of the closure. These source terms involve macroscale concentrations and their gradients. We adopt these source terms to use as explicit features in the learning algorithm. We find the trained networks that include the macroscale source terms generate models that are able to predict the correction factor with increased fidelity over those that do not. 3) We find that the trained network exhibits good generalizability, and it is able to predict the effectiveness factor with high fidelity for realistically-structured tissues despite the significantly different scale and geometrical complexity of the two example tissue types. This latter result emphasizes our purposeful connection between conventional averaging methods with the use of machine learning for closure; this contrasts with some machine learning methods for upscaling where the exact form of the macroscale equation remains unknown.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2015

Generative electronic background music system

In this short paper-extended abstract the new approach to generation of electronic background music has been presented. The Generative Electronic Background Music System (GEBMS) has been located between other related approaches within the musical algorithm positioning framework proposed by Woller et al. The music composition process is performed by a number of mini-models parameterized by further described properties. The mini-models generate fragments of musical patterns used in output composition. Musical pattern and output generation are controlled by container for the mini-models - a host-model. General mechanism has been presented including the example of the synthesized output compositions.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

pyflowline: a mesh-independent river network generator for hydrologic models

River networks are crucial in hydrologic and Earth system models. Accurately representing river networks in spatially distributed hydrologic models requires considering the model's spatial discretization and computational mesh. However, current methods of generating river networks for hydrologic models do not typically support unstructured meshes. Unstructured meshes offer numerous advantages over traditional, structured meshes. To overcome this limitation, we developed PyFlowline, a Python package that generates mesh-independent river networks. With PyFlowline, hydrologic modelers can generate conceptual river networks and their topological relationships for both structured and unstructured meshes.

47 OTHER INSTRUMENTATION↗
DOE OSTI2016

Elementary particles in the early Universe

The high-temperature limit of the Standard Model generated by the contractions of gauge groups is discussed. Contraction parameters of gauge group SU(2) of the Electroweak Model and gauge group SU(3) of Quantum Chromodynamics are taken identical and tending to zero when the temperature increases. Properties of the elementary particles change drastically at the infinite temperature limit: all particles lose masses, all quarks are monochromatic. Electroweak interactions become long-range and are mediated by neutral currents. Particles of different kind do not interact. It looks like some stratification with only one sort of particles in each stratum. The Standard Model passes in this limit through several stages, which are distinguished by the powers of the contraction parameter. For any stage intermediate models are constructed and the exact expressions for the respective Lagrangians are presented. The developed approach describes the evolution of the Standard Model in the early Universe from the Big Bang up to the end of several nanoseconds.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

Spatiotemporal forecasting of the edge localized modes in tokamak plasmas using neural networks

Artificial intelligence techniques have been increasingly adopted by the plasma and fusion science to address problems like plasma reconstruction, surrogate modeling, and tokamak/stellarator optimization. A key focus in sustained fusion research is the prediction and mitigation of edge-localized-modes (ELMs), instabilities that occur in short, periodic bursts and can cause erosion to the tokamak vessel wall. Recent research has demonstrated the power of neural networks in approximating continuous functions. In this work, we build spatiotemporal forecasting models that can predict the onset of ELMs and their evolution at early stages. We leverage recent advances in generative modeling, sequence-to-sequence modeling, and Fourier neural operators to propose architectures and training strategies that can learn to forecast short to long term dynamics of the noisy signals due to ELMs. We benchmark the developed model against a state-of-the-art foundation model using the beam emission spectroscopy (BES) data that captures the plasma fluctuations due to ELMs over a 8 x 8 spatial grid. Our models demonstrate high accuracy, outperforming the baselines, in predicting the evolution of BES signals during ELM events. Furthermore, the developed models exhibit high accuracy in predicting the rapid rise and relaxation of the signals due to ELMs within 30–80 µs.

edge localized modes↗
DOE OSTI2014

Numerical modeling of carrier gas flow in atomic layer deposition vacuum reactor: A comparative study of lattice Boltzmann models

This paper characterizes the carrier gas flow in the atomic layer deposition (ALD) vacuum reactor by introducing Lattice Boltzmann Method (LBM) to the ALD simulation through a comparative study of two LBM models. Numerical models of gas flow are constructed and implemented in two-dimensional geometry based on lattice Bhatnagar–Gross–Krook (LBGK)-D2Q9 model and two-relaxation-time (TRT) model. Both incompressible and compressible scenarios are simulated and the two models are compared in the aspects of flow features, stability, and efficiency. Our simulation outcome reveals that, for our specific ALD vacuum reactor, TRT model generates better steady laminar flow features all over the domain with better stability and reliability than LBGK-D2Q9 model especially when considering the compressible effects of the gas flow. The LBM-TRT is verified indirectly by comparing the numerical result with conventional continuum-based computational fluid dynamics solvers, and it shows very good agreement with these conventional methods. The velocity field of carrier gas flow through ALD vacuum reactor was characterized by LBM-TRT model finally. The flow in ALD is in a laminar steady state with velocity concentrated at the corners and around the wafer. The effects of flow fields on precursor distributions, surface absorptions, and surface reactions are discussed in detail. Steady and evenly distributed velocity field contribute to higher precursor concentration near the wafer and relatively lower particle velocities help to achieve better surface adsorption and deposition. The ALD reactor geometry needs to be considered carefully if a steady and laminar flow field around the wafer and better surface deposition are desired.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2025

PNNL-CompBio/3D_Scaffold

A domain-aware generative framework that takes 3D coordinates of the molecule and scaffold as an input and generates 3D coordinates of novel therapeutic candidates as an output while preserving the desired scaffolds. We show that our model generates predominantly valid, unique, novel, and experimentally synthesizable molecules that have drug-like properties similar to the molecules in the training set

Kumar, Neeraj [Pacific Northwest National Laborato↗
DOE OSTI2021

BETO 2021 Peer Review - WBS 4.1.2.32: Bioeconomy Scenario Analysis

The Bioeconomy Scenario Analysis project uses systems thinking and analysis to assess current and/or prospective techno-economics, research and development, deployment strategies, policy, and market conditions and their impact on the potential development trajectories of the bioenergy industry over time. Results from this project include identification of opportunities and constraints to industrial development, quantification of multiple metrics (energy, economic, environmental) and informing researchers, decision makers, and industry of the steps needed for a sustainable, nationwide biofuels industry. Analyses from this project enable the creation of a bioenergy industry by (1) inciting policy-makers to explore scenarios for nationwide biofuels production, identifying policy actions consistent with pathways for growth; (2) improving industry’s understanding of industry growth potential under different technology and investment conditions, better targeting their development efforts; and (3) providing universities and other interested stakeholders with tools and analyses that can be adapted to meet research and teaching objectives, connecting students with careers that build the industry. One of the many modeling tools used in this project, the Biomass Scenario Model (BSM) is a publicly-available, unique, validated, state-of-the-art, award-winning, fourth-generation model of the domestic biofuels supply chain which explicitly focuses on how and under what conditions biofuel technologies might be deployed to contribute to the U.S. transportation energy sector. We use models like the BSM to examine the implications of policies and incentives as well as their potential side-effects. The BSM uses a system-dynamics simulation to model dynamic interactions and transitions across the supply chain; it tracks the deployment of biofuels given industrial learning and the reaction of the investment community in the context of land availability, projected oil markets, consumer demand for biofuels, and government policies over time. Under expected market conditions, analyses using the BSM suggest that the biofuels industry may require significant external actions in the early years to thrive. Interventions that accelerate the industrial learning process (e.g. operation of pre-commercial and commercial facilities) have been identified as having strong influence in starting the growth of a commercial biofuel industry. Policies which are coordinated across the whole supply chain in BSM foster the growth of the biofuels industry and production of tens of billions of gallons of biofuels may occur under sufficiently favorable conditions.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗