Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Generative models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 775 records · Page 43
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Minnesota Solar Pathways: Illuminating Pathways to 10% Solar (Final Technical Report)

The Minnesota Solar Pathways project, funded in part by the Department of Energy’s Solar Energy Technologies Office, was a three-year project designed to explore least-risk, best-value strategies for meeting the State of Minnesota’s solar goals. As part of this aim, the Pathways Team modeled renewable generation costs, examined ways to streamline interconnection, and evaluated technologies that can increase solar hosting capacity on the distribution grid. Midway through the project period, the Pathways Team expanded the scope of study using the same modeling framework from the Minnesota Solar Potential Analysis to estimate and compare generation costs for high renewables penetration scenarios across the Midcontinent Independent System Operator (MISO) region. The analysis concludes that it can be cheaper to overbuild solar + wind and curtail surplus than to store all generation. In addition, the analysis of individual MISO subregions compared with the whole region highlights the opportunities of enabling market potential compared with impact of ongoing transmission constraints. Beyond the analysis of future scenarios, the partnerships initiated and supported through this project underscored the ongoing need for work with stakeholders to address key issues, particularly around siting, and leverage symbiotic strategies to meet state goals.

14 SOLAR ENERGY↗
DOE OSTI2023

Predictive model for real-time energy disaggregation using long short-term memory

To provide affordable energy-saving solutions for the small and medium-sized manufacturers (SMMs), we propose a unified framework for generating predictive models that support real-time disaggregation of power consumption from combined inputs, enabling automatic machine state identification simultaneously for joint analysis of energy usage patterns. Further, the proposed framework transforms raw power consumption into a time series with look-back and bootstrap capabilities for historical pattern detection, while a learning architecture utilizes the stacked long short-term memory (LSTM) layers as encoders for embedding generation with sequential awareness. Experimental results demonstrate 93.65% minimum accuracy in ideal case of real-time energy usage and machine state prediction.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2020

iPNHOT: a knowledge-based approach for identifying protein-nucleic acid interaction hot spots

The interaction between proteins and nucleic acids plays pivotal roles in various biological processes such as transcription, translation, and gene regulation. Hot spots are a small set of residues that contribute most to the binding affinity of a protein-nucleic acid interaction. Compared to the extensive studies of the hot spots on protein-protein interfaces, the hot spot residues within protein-nucleic acids interfaces remain less well-studied, in part because mutagenesis data for protein-nucleic acids interaction are not as abundant as that for protein-protein interactions. In this study, we built a new computational model, iPNHOT, to effectively predict hot spot residues on protein-nucleic acids interfaces. One training data set and an independent test set were collected from dbAMEPNI and some recent literature, respectively. To build our model, we generated 97 different sequential and structural features and used a two-step strategy to select the relevant features. The final model was built based only on 7 features using a support vector machine (SVM). The features include two unique features such as ΔSASsa 1/2 and esp3, which are newly proposed in this study. Based on the cross validation results, our model gave F1 score and AUROC as 0.725 and 0.807 on the subset collected from ProNIT, respectively, compared to 0.407 and 0.670 of mCSM-NA, a state-of-the art model to predict the thermodynamic effects of protein-nucleic acid interaction. The iPNHOT model was further tested on the independent test set, which showed that our model outperformed other methods. Here, by collecting data from a recently published database dbAMEPNI, we proposed a new model, iPNHOT, to predict hotspots on both protein-DNA and protein-RNA interfaces. The results show that our model outperforms the existing state-of-art models. Our model is available for users through a webserver: http://zhulab.ahu.edu.cn/iPNHOT/.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Processing MCNP Elemental Edit Outputs

The Los Alamos National Laboratory's (LANL) Monte Carlo N-Particle® (MCNP®) transport code version 6 has the capability for tracking particles on unstructured mesh (UM) geometry models. The MCNP UM feature was originally designed for the UM models created by the Abaqus/CAE software product. The MCNP version 6.2.0 and later recognizes the UM models read from Abaqus INP files or MCNPUM files converted from Abaqus INP files. Other finite element analysis software packages may generate UM models and then convert these models into Abaqus INP formats.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Uncertainty in Annual Energy Resulting from Uncertain Irradiance Measurements

We report an analysis quantifying the contribution to uncertainty in annual energy projections from uncertainty in ground-measured irradiance. Uncertainty in measured irradiance is quantified for eight instruments by the difference from a well maintained, secondary standard pyranometer which is regarded as truthful. We construct a statistical model of irradiance uncertainty and apply the model to generate a sample of 100 annual time series of irradiance for each instrument. The sample is propagated through a common performance model for a reference photovoltaic system to quantify variation in annual energy. Although the measured irradiance varies from the reference by a few percent (standard deviation of 1-2%) the uncertainty in annual energy is on the order of a fraction of one percent. We propose a model for a factor that represents uncertainty in modeled annual energy that arises from uncertainty in ground-measured irradiance.

14 SOLAR ENERGY↗
DOE OSTI2024

Physical Correlations and Predictions Emerging from Modern Core-collapse Supernova Theory

Abstract In this paper, we derive correlations between core-collapse supernova observables and progenitor core structures that emerge from our suite of 20 state-of-the-art 3D core-collapse supernova simulations carried to late times. This is the largest such collection of 3D supernova models ever generated and allows one to witness and derive testable patterns that might otherwise be obscured when studying one or a few models in isolation. From this panoramic perspective, we have discovered correlations between explosion energy, neutron star gravitational birth masses, 56 Ni and α -rich freezeout yields, and pulsar kicks and theoretically important correlations with the compactness parameter of progenitor structure. We find a correlation between explosion energy and progenitor mantle binding energy, suggesting that such explosions are self-regulating. We also find a testable correlation between explosion energy and measures of explosion asymmetry, such as the ejecta energy and mass dipoles. While the correlations between two observables are roughly independent of the progenitor zero-age main-sequence (ZAMS) mass, the many correlations we derive with compactness cannot unambiguously be tied to a particular progenitor ZAMS mass. This relationship depends on the compactness/ZAMS mass mapping associated with the massive star progenitor models employed. Therefore, our derived correlations between compactness and observables may be more robust than with ZAMS mass but can nevertheless be used in the future once massive star modeling has converged.

Astronomy & Astrophysics↗
DOE OSTI2022

Industry Level Feasibility of LiDAR Data into Fire Modeling Using Fire Risk Investigation in 3D (FRI3D)

Many evaluation, assessment, and modeling tasks at nuclear power plants require spatial information this often requires physical visits to locations within the facility because the 2D or 3D schematics and current models do not contain enough detail or do not capture as-built and real-world conditions. These visits require extensive manual labor for not only the requesting party, but support groups such as security. LIDAR mapping is trying to solve that problem by providing very detailed 3D models for low costs. However, the use of these models can be very limited because either component reference information is missing and too costly to add, or there is no way to extract specific spatial data needed for other tools. This report presents Idaho National Lab's work with Environmental Intellect (Ei) covering two main efforts. First, to reduce the effort of "tagging" data in large 3D models. By using both existing plant database information, and artificial intelligence (AI) to find and read equipment labels. This research explores the ability of to provide a simple way for the user to tag items and verify plant data, capturing both the speed of AI and human verification. The second part of the work is the development of an interface for importing pieces needed for Modeling & Simulation. Analysis work such as that for fire, flood, or physical security all require spatial or 3D models in various levels of detail. This interface will allow for the retrieval of item location or boundaries, enabling the auto generation of models for varying tools. The application program interface (API) of the fire risk investigation in 3D (FRI3D) was used to test feasibility of exporting the LiDAR tagged spatial information. Outcomes from this work provide preliminary data to determine if the tools and methods could provide substantial industry benefit if fully matured.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Hydrogen Leak Modeling for Development of Smart Distributed Monitoring Under Unintended Releases

Hydrogen is a versatile and clean energy carrier that can be produced from various renewable sources such as wind, solar, and hydropower. Hydrogen has the potential to play a crucial role in decarbonizing industrial processes that are currently reliant on fossil fuels and provide long-duration and/or seasonal energy storage to enable electricity decarbonization. Hydrogen can also be used as a fuel for fuel cell vehicles, providing a zero-emission alternative to traditional internal combustion engines. DOE launched the Hydrogen Energy Earthshot (Hydrogen Shot) in June 2021 to reduce the cost of clean hydrogen by 80% to $1 per 1 kilogram in 1 decade ("1 1 1"). While promising, Hydrogen is highly-flammable, and in the presence of oxygen, it can form explosive mixtures. . Therefore, understanding leak scenarios is essential to evaluate and mitigate the safety risks associated with potential hydrogen leaks. An increased understanding of leak behavior, and having tools to model leaks, can help assess how hydrogen would disperse in different environments, influencing emergency response plans and safety measures, and identify potential issues with materials and design systems that can withstand the challenges posed by hydrogen. Recently, researchers have attempted to study hydrogen leaks for development of risk management strategies. However, the focus has been on closed or semi-closed spaces like storage rooms, vehicles, garages, and fueling stations - all promising locations for future hydrogen infrastructure. In this presentation, the modeling environment extends the span of research further by modeling hydrogen leak in an outdoor, open space. We will present the key challenges with modeling hydrogen leaks in an uncontrollable environment, how they were handled, and how modeling results informed sensor selection and placement. A Hydrogen research facility at the National Renewable Energy Laboratory (NREL) was used as a case study to model hydrogen leaks. In the future, Hydrogen wide area detection methodologies will be developed and tested at this site to monitor for unintended and operational hydrogen releases. The data generated from modeling will be used to develop a predictive model to detect hydrogen leak location based on concentration measured by sensors in this open space. Furthermore, the facility was also chosen because controlled hydrogen releases can be performed. A computational fluid dynamics (CFD) based modeling approach was taken to model hydrogen leak. The full-scale hydrogen facility was modeled with a large ambient domain. The electrolyzer at the facility can produce a controlled release rate of 27 kg-H2/hr. Site-specific atmospheric and weather condition data such as wind direction, wind speed at various altitudes, and temperature were used as inputs to the model. To capture the variability of weather conditions, a subset of the weather conditions experienced during daytime hours without precipitation over the course of three months was generated; using established data clustering techniques, a total of 100 condition sets were chosen. The results show statistical distributions and ranges of hydrogen concentrations at locations throughout the domain. These distributions are compared to experimental data from a constant mass flow, controlled hydrogen release at the facility. The stochastic wind conditions of the release make direct validation difficult, therefore, statistical comparison approaches were used. Wind conditions are found to significantly impact the release behavior, including direction and concentration. Sensor selection and placement is proposed for the facility and is now based on release behavior predicted for the facility given its weather patterns; this is much more informed than without the modeling results. The methodology and analysis procedure can be translated to other facilities using modified geometries and site-specific weather conditions. Hydrogen holds great promise as a renewable energy fuel, but ensuring safety in its production, storage, and use is paramount. Studying potential leak scenarios in an open space will help develop sensors to detect hydrogen on a large spectrum of concentration and eventually build a smart distributed monitoring system.

CFD↗
DOE OSTI2022

Molecular structure models of amorphous bismuth and cerium carboxylate catalyst precursors

As our societal need for materials and energy has grown, so has our need for catalyst processes in hydrogen production. A major function in these applications, for both homogenous and heterogeneous catalysis processes, is the synthesis of an active metal catalyst. It must first be soluble to control the physical properties of the metal being used. Recent work in metal precursors has begun to turn toward these metal carboxylate types of material. Here, structural models are proposed for bismuth 2-ethylhexanoate and 2,2-dimethyloctanoate and cerium 2-ethylhexanoate. The bismuth compounds have been characterized at different ratios of bismuth to carboxylate as solutions of the free acids. Their structures are most consistent with a Bi 4 (RCO 2 ) 12 motif where the Bi ions are arranged in a flattened tetrahedron with Bi – Bi distances of about 4.3 Å. There is evidence for Bi – O – Bi linkages at low free acid concentrations. The cerium compound is most consistent with a linear tetracerium molecule where the Ce – Ce distances repeat at about 4.3 Å out to 16.4 Å. The models were generated by analogy with known crystal structures and compared to high-energy x-ray scattering data. To further evaluate the models, DFT calculations were made, and the equilibrium geometries were compared. The vibrational spectra calculated from those geometries are presented and compared to the experimental results. Magnetization vs. temperature data was collected on the cerium compound, and its behavior was consistent with the proposed model. A geometrical approach to determining the dimensionality and relative positions of the metal ions in these structures is presented.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Design-time performance modeling of compositional parallel programs

Performance models are powerful instruments for understanding the performance of parallel systems and uncovering their bottlenecks. Already during system design, performance models can help ponder alternative development options. However, creating a performance model – whether theoretically or empirically – for an entire application that does not exist yet is challenging. In this paper, we propose to generate performance models of full programs from performance models of their components using formal composition operators derived from parallel design patterns. As long as the design of the overall system follows such a pattern, its performance model can be predicted with reasonable accuracy without an actual implementation. In conclusion, we demonstrate our approach with design patterns of varying complexity, including pipeline, task pool, and eventually MapReduce, which is representative of a broad class of data-analytics applications.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

A Variational Autoencoder Model Toward Molecular Structure Representation Learning of Fuels

Here, in this work, a Variational Autoencoder (VAE)-based data-driven modeling framework is developed with the overarching goal of enabling fuel design. The VAE model is trained on a large dataset with several chemical species to learn a compressed latent space molecular representation. Chemical structure in the form of Simplified Molecular Input Line Entry System (SMILES) string is fed as input, encoded into the VAE latent space, and decoded back to the SMILES string using Long Short-Term Memory (LSTM) networks. Complexities of the VAE training loss function are thoroughly examined by varying the weightage (beta (𝜷) parameter) of the latent space regularization term, thereby assessing the balance between reconstruction accuracy and validity, and focusing on both accurate molecular structure reconstruction and latent space consistency. Two different strategies for 𝜷 variation are evaluated: linear annealing and cyclic annealing. In addition, the impact of total correlation adjustment and hierarchical priors is also studied with regard to the balance between reconstruction fidelity and latent space regularization, and potential issues such as posterior collapse, over-regularization, and poor disentanglement of latent variables. Overall, the best performance of the model is achieved with hierarchical priors and incrementally increasing 𝜷 from 0 to a threshold value of 0.25 over 75 epochs. The generative VAE model can be readily coupled with Quantitative Structure–Property Relationship (QSPR) analysis to develop an integrated end-to-end framework for fuel-property prediction and molecular design of novel promising fuels.

fuel design↗
DOE OSTI2024

A Compound Data Poisoning Technique with Significant Adversarial Effects on Transformer-based Sentiment Classification Tasks

Transformer-based models have demonstrated much success in various natural language processing tasks. However, they are often vulnerable to adversarial attacks, such as data poisoning, which can intentionally fool the model into generating incorrect results. In this article, we present a novel, compound variant of a data poisoning attack on a transformer-based model that maximizes the poisoning effect while minimizing the scope of poisoning. Here we do so by combining the established data poisoning technique (label flipping) with a novel adversarial artifact selection and insertion technique aimed at minimizing detectability and the scope of the poisoning footprint. We find that by using a combination of these two techniques, we achieve a state-of-the-art attack success rate of approximately 90% while poisoning only 0.5% of the original training set, thus minimizing the scope and detectability of the poisoning action. These findings have the potential to advance the development of better data poisoning detection methods.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Engineering of increased L-Threonine production in bacteria by combinatorial cloning and machine learning

The goal of this study is to develop a general strategy for bacterial engineering using an integrated synthetic biology and machine learning (ML) approach. This strategy was developed in the context of increasing L-threonine production in Escherichia coli ATCC 21277. A set of 16 genes was initially selected based on metabolic pathway relevance to threonine biosynthesis and used for combinatorial cloning to construct a set of 385 strains to generate training data (i.e., a range of L-threonine titers linked to each of the specific gene combinations). Hybrid (regression/classification) deep learning (DL) models were developed and used to predict additional gene combinations in subsequent rounds of combinatorial cloning for increased L-threonine production based on the training data. As a result, E. coli strains built after just three rounds of iterative combinatorial cloning and model prediction generated higher L-threonine titers (from 2.7 g/L to 8.4 g/L) than those of patented L-threonine strains being used as controls (4-5 g/L). Interesting combinations of genes in L-threonine production included deletions of the tdh, metL, dapA, and dhaM genes as well as overexpression of the pntAB, ppc, and aspC genes. Mechanistic analysis of the metabolic system constraints for the best performing constructs offers ways to improve the models by adjusting weights for specific gene combinations. Graph theory analysis of pairwise gene modifications and corresponding levels of L-threonine production also suggests additional rules that can be incorporated into future ML models.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2026

Prairie State Generating Company Static and Dynamic Modeling

A reservoir modeling study was conducted to assess the feasibility of storing 162.5 million tonnes (8.125 million tonnes annually) of industrially sourced carbon dioxide (CO 2 ) in the St. Peter – Everton and Knox storage complexes at the Prairie State Generating Company’s (PSGC) site near Marissa, Washington County, Illinois (PSGC site). Two separate models were constructed for the St. Peter – Everton and the Knox storage complexes. The St. Peter and Everton sandstones are the target storage units for the St. Peter – Everton storage complex. The Knox Group formations are the target storage units for the Knox storage complex. The Maquoketa Shale is the primary confining unit for both storage complexes. The static reservoir models used as input to the dynamic reservoir models of the storage complexes were developed from interpretations of logs (e.g., gamma ray, resistivity, porosity, photoelectric, and sonic), structure surfaces using data from 36 wells, thickness maps, well test data, seismic data, and permeability data in PetrelTM.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2025

Mechanical separations of corn stover anatomical fractions in an integrated feedstock preprocessing system: An experimental and data-driven modeling study

High variabilities of material attributes in lignocellulosic biomass present risks for biofuel and biochemical productions and must be mitigated via preprocessing. Since almost no mechanical device is originally designed for processing biomass, how to operate existing apparatuses with efficient performance has not been investigated extensively. This work presents a study on an integrated screening and air classification to separate cobs and stalks from husks and leaves in corn stover. Prototype machine learning models were developed to assess the feasibility of predicting the process outcome based on the measurable parameters. The models trained upon limited experimental data rendered decent predictive accuracy of yield and purity. The experimental data and modeling results collectively suggest decreasing throughput leads to a higher purity. To the contrary, if throughput increases, a lower purity is likely. A possible trade-off between yield and purity of the separated streams indicates the need for optimal combinations of feedstock size, moisture, and throughput to achieve optimized separations. The results of this study also suggest the need to further improve model predictability by developing more accurate formulations for physics governing the integrated unit operations. To accomplish this, additional experimental data needs to be generated for model training.

09 - BIOMASS FUELS↗
DOE OSTI2021

A Machine Learning-Based Vulnerability Analysis for Cascading Failures of Integrated Power-Gas Systems

This article proposes a cascading failure simulation (CFS) method and a hybrid machine learning method for vulnerability analysis of integrated power-gas systems (IPGSs). The CFS method is designed to study the propagating process of cascading failures between the two systems, generating data for machine learning with initial states randomly sampled. The proposed method considers generator and gas well ramping, transmission line and gas pipeline tripping, island issue handling and load shedding strategies. Then, a hybrid machine learning model with a combined random forest (RF) classification and regression algorithms is proposed to investigate the impact of random initial states on the vulnerability metrics of IPGSs. Extensive case studies are carried out on three test IPGSs to verify the proposed models and algorithms. Simulation results show that the proposed models and algorithms can achieve high accuracy for the vulnerability analysis of IPGSs.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

DeepLensSBI: Deep inference of simulated strong lenses in ground-based surveys

This code is used to train and test machine learning models and generate results and plots presented in 2501.08524 [astro-ph.IM]. The code is written in python. The goal of this work is to train ML models trained on simulated images of strong gravitational lenses. The trained model can then quickly infer properties of the lensed objects with uncertainty quantification.

Poh, Jason [Univ. of Chicago, IL (United States)] ↗