Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Generative models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,315 records · Page 73

Entropy generation from hydrodynamic mixing in inertial confinement fusion indirect-drive targets

The increase in entropy from the physical mixing of two adjacent materials in inertial confinement fusion (ICF) implosions and gas-filled hohlraums is analytically assessed. An idealized model of entropy generation from the mixing of identical ideal-gas particles across a material interface in the presence of pressure and temperature gradients is applied. Physically, mix-driven entropy generation refers to the work done by the gases in expanding into a larger common volume from atomic mixing under the condition of no internal energy change, or work needed to restore the initial unmixed state. Furthermore, the effect of a mix-generated entropy increase is analytically shown to lead to less compression of the composite ICF fluid under adiabatic conditions. The amount of entropy generation is estimated to be ~10 J for a Rayleigh–Taylor-induced micrometer-scale annular mixing layer between the solid deuterium–tritium fuel and (undoped) high-density carbon pusher of an imploding capsule at the National Ignition Facility (NIF). This level of entropy generation is consistent with lower-than-expected fuel compressions measured on the NIF [Hurricane et al., Phys. Plasmas 26, 052704 (2019)]. The degree of entropy increase from mixing of high-Z hohlraum wall material and low-Z, moderate- to high-density gas fills is estimated to lead to ~100 kJ of heat generation for NIF-scale experiments [Moody et al., Phys. Plasmas 21, 056317 (2014)]. This value represents a significant fraction of the inferred missing x-ray drive energy based on observed delays in capsule implosion times compared with mainline simulations [Jones et al., Phys. Plasmas 19, 056315 (2012)].

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Novel Technique for Developing Linearized Convex System Models from Experimentally Derived Data

This paper presents a novel technique for generating a convex system model from an experimentally derived data set which features variance among repeated measurements. The convex system model developed as a test case characterizes the dynamic system losses of a vanadium redox flow battery as a function of the active power output and the battery state of charge. The technique hinges on a pre-cleaning via clustering procedure which precedes the formation of a planar convex hull comprised of triangular simplices. The clustering procedure efficiently reduces the experimental data set while mitigating variance among repeated measurements and removes outliers. Ultimately, the lower evelope of the planar convex hull serves as the desired convex system model. The proposed technique reduces systematic model error which is otherwise present when directly developing a planar convex hull model based on an unreduced data set.

24 POWER TRANSMISSION AND DISTRIBUTION↗

ChatBLAS: The First AI-Generated and Portable BLAS Library

We present ChatBLAS, the first AI-generated and portable Basic Linear Algebra Subprograms (BLAS) library on different CPU/GPU configurations. The purpose of this study is (i) to evaluate the capabilities of current large language models (LLMs) to generate a portable and HPC library for BLAS operations and (ii) to define the fundamental practices and criteria to interact with LLMs for HPC targets to elevate the trustworthiness and performance levels of the AI-generated HPC codes. The generated C/C++ codes must be highly optimized using device-specific solutions to reach high levels of performance. Additionally, these codes are very algorithm-dependent, thereby adding an extra dimension of complexity to this study. We used OpenAI’s LLM ChatGPT and focused on vector-vector BLAS level-1 operations. ChatBLAS can generate functional and correct codes, achieving high-trustworthiness levels, and can compete or even provide better performance against vendor libraries.

Valero Lara, Pedro↗

Updated Baseline Cost Model for Hydropower (2023)

The "Updated Baseline Cost Model (BCM) for Hydropower" is an empirical model for estimating the costs of US hydropower projects in six categories (Non-Powered Dam (NPD), New Stream Development (NSD), Canal/Conduit, Pumped Storage Hydro (PSH), Capacity Expansion, Generator Rewind). The model equations have been estimated with data on existing or planned projects obtained from various sources. NOTE: This is a macro-enabled workbook, so Excel may block it on the first opening. In that case: 1. Save the workbook to a local directory 2. Right-click on the workbook in the local directory and select “Properties” 3. Then check “Unblock” at the bottom of the “General” tab.

13 HYDRO ENERGY↗

diyepw: A Python package for Do-It-Yourself EnergyPlus weather file generation

diyepw allows for quick and easy generation of a set of EnergyPlus weather (EPW) files for a given location over a given historical period. The user can obtain weather files using an open-source, automated workflow by simply specifying the location of interest using the World Meteorological Organization weather station ID number, and specifying a year or set of years for which to generate EPW files. Building energy modelers can use these auto-generated weather files in building performance simulations to represent the actual observed weather conditions in the location(s) of interest, based on meteorological observations obtained from the National Oceanic and Atmospheric Administration's Integrated Surface Database. Because observed weather data are not available for every meteorological variable specified in the EPW format, diyepw starts with a widely-used set of typical meteorological year (TMY) files, using them as the template to generate new EPW files by substituting in the observed values of selected meteorological variables that are known to affect building energy performance. Its output is a weather file or group of weather files that conform to the data standards associated with the EPW format so they can be used with any building performance simulation software employing EnergyPlus as its simulation engine.

97 MATHEMATICS AND COMPUTING↗

Computational Workflow for Accelerated Molecular Design Using Quantum Chemical Simulations and Deep Learning Models

Efficient methods for searching the chemical space of molecular compounds are needed to automate and accelerate the design of new functional molecules such as pharmaceuticals. Given the high cost in both resources and time for experimental efforts, computational approaches play a key role in guiding the selection of promising molecules for further investigation. Here, we construct a workflow to accelerate design by combining approximate quantum chemical methods [i.e. density-functional tight-binding (DFTB)], a graph convolutional neural network (GCNN) surrogate model for chemical property prediction, and a masked language model (MLM) for molecule generation. Property data from the DFTB calculations are used to train the surrogate model; the surrogate model is used to score candidates generated by the MLM. The surrogate reduces computation time by orders of magnitude compared to the DFTB calculations, enabling an increased search of chemical space. Furthermore, the MLM generates a diverse set of chemical modifications based on pre-training from a large compound library. We utilize the workflow to search for near-infrared photoactive molecules by minimizing the predicted HOMO-LUMO gap as the target property. Our results show that the workflow can generate optimized molecules outside of the original training set, which suggests that iterations of the workflow could be useful for searching vast chemical spaces in a wide range of design problems.

Blanchard, Andrew↗

Quadrupolar NMR crystallography guided crystal structure prediction (QNMRX-CSP) of zwitterionic organic HCl salts

In this work, we benchmark quadrupolar NMR crystallography guided crystal structure prediction (QNMRX-CSP) for determining the crystal structures of two zwitterionic organic HCl salts, L-ornithine HCl ( Orn ) and L-histidine HCl·H 2 O ( Hist ). These salts present an interesting challenge for QNMRX-CSP, as gas-phase geometry optimizations used to generate starting structures for the organic zwitterionic fragments fail to capture their correct solid-state geometries. To overcome this limitation, geometry optimizations using the COSMO water-solvation model are employed to generate initial structural models. Using this approach, QNMRX-CSP yields structural models of the two zwitterionic organic HCl salts that closely match experimentally determined crystal structures. In addition, the application of QNMRX-CSP to Hist represents a further step toward the de novo structural determination of solvated organic HCl salts, as Hist is the first benchmark system of this type to include a water molecule as a component of its crystal structure. This work is significant for its potential application to the structural determination of active pharmaceutical ingredients, which often feature complex organic components and solvated solid forms.

Fleischer, Carl H. [Florida State Univ., Tallahass↗

Quantifying the Impact of Vertical Resolution on the Representation of Marine Boundary Layer Physics for Global-Scale Models

Abstract While GCM horizontal resolution has received the majority of scale improvements in recent years, ample evidence suggests that a model’s vertical resolution exerts a strong control on its ability to accurately simulate the physics of the marine boundary layer. Here we show that, regardless of parameter tuning, the ability of a single-column model (SCM) to simulate the subtropical marine boundary layer improves when its vertical resolution is improved. We introduce a novel objective tuning technique to optimize the parameters of an SCM against profiles of temperature and moisture and their turbulent fluxes, horizontal winds, cloud water, and rainwater from large-eddy simulations (LES). We use this method to identify optimal parameters for simulating marine stratocumulus and shallow cumulus. The novel tuning method utilizes an objective performance metric that accounts for the uncertainty in the LES output, including the covariability between model variables. Optimization is performed independently for different vertical grid spacings and value of time step, ranging from coarse scales often used in current global models (120 m, 180 s) to fine scales often used in parameterization development and large-eddy simulations (10 m, 15 s). Uncertainty-weighted disagreement between the SCM and LES decreases by a factor of ∼5 when vertical grid spacing is improved from 120 to 10 m, with time step reductions being of secondary importance. Model performance is shown to converge at a vertical grid spacing of 20 m, with further refinements to 10 m leading to little further improvement. Significance Statement In successive generations of computer models that simulate Earth’s atmosphere, improvements have been mainly accomplished by reducing the horizontal sizes of discretized grid boxes, while the vertical grid spacing has seen comparatively lesser refinements. Here we advocate for additional attention to be paid to the number of vertical layers in these models, especially in the model layers closest to Earth’s surface where climatologically important marine stratocumulus and shallow cumulus clouds reside. Our experiments show that the ability of a one-dimensional model to represent physical processes important to these clouds is strongly dependent on the model’s vertical grid spacing.

Meteorology & Atmospheric Sciences↗

Predicting electrical conductivity in Cu/Nb composites: A combined model-experiment study

The generation of high magnetic fields requires materials with high electric conductivity and good strength properties. Cu/Nb composites are considered to be good candidates for this purpose. In this work, we aim to predict, from theory, the dependence of electric conductivity on the microstructure, most notably on the layer thickness and grain sizes. We also conducted experiments to calibrate and validate our simulations. Bimetal interfaces and grain boundaries are confirmed to have the largest impact on conductivity in this composite material. In this approach, a distribution of the layer thickness is accounted for in order to better model the experimentally observed microstructure. Because layer thicknesses below the mean free path of Cu significantly degrade the conductivity, an average layer thickness larger than expected may be needed to meet conductivity requirements in order to minimize these smaller layers in the distribution. We also investigate the effect of variations in volume fraction of Nb and temperature on the material’s conductivity.

36 MATERIALS SCIENCE↗

Stress Testing California's Hydroclimatic Whiplash: Potential Challenges, Trade‐Offs and Adaptations in Water Management and Hydropower Generation

Abstract Inter‐annual precipitation in California is highly variable, and future projections indicate an increase in the intensity and frequency of hydroclimatic “whiplash.” Understanding the implications of these shocks on California's water system and its degree of resiliency is critical from a planning perspective. Therefore, we quantify the resilience of reservoir services provided by water and hydropower systems in four basins in the western Sierra Nevada. Using downscaled runoff from 10 climate model outputs, we generated 200 synthetic hydrologic whiplash sequences of alternating dry and wet years to represent a wide range of extremes and transitional conditions used as inputs to a water system simulation model. Sequences were derived from upper (wet) and lower (dry) quintiles of future streamflow projections (2030–2060). Results show that carryover storage was negatively affected in all basins, particularly in those with lower storage capacity. All basins experienced negative impacts on hydropower generation, with losses ranging from 5% to nearly 90%. Reservoir sizes and inflexible operating rules are a particular challenge for flood control, as in extremely wet years spillage averaged nearly the annual basins' total discharge. The reliability of environmental flows and agricultural deliveries varied depending on the basin, intensity, and duration of whiplash sequences. Overall, wet years temporarily rebound negative drought effects, and greater storage capacity results in higher reliability and resiliency, and lesser volatility in services. We highlight potential policy changes to improve flexibility, increase resilience, and better equip managers to face challenges posed by whiplash while meeting human and environmental needs.

Environmental Sciences & Ecology↗

Accelerated version of NUBEAM capabilities in DIII-D using neural networks

A neural network model of the effects of neutral beam injection on DIII-D has been developed. The training and testing data used by the model have been generated by the NUBEAM module of TRANSP for experimental discharges from the 2018 DIII-D campaign. Using a principle component analysis to reduce the dimensionality of profile data, the model has been shown to reproduce the results of the Monte Carlo code NUBEAM with a high level of accuracy and an execution time orders of magnitude faster than the execution time of NUBEAM. Furthermore, this makes the neural network model uniquely suited to applications in model-based scenario planning (off-line) and active control (on-line), where a large number of simulation runs are required by the associated optimization tasks that need to be performed before and during the discharge.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Generative AI for design of nanoporous materials: review and future prospects

Generative artificial intelligence (AI) is emerging as a powerful tool for advancing the design of nanoporous materials such as metal–organic frameworks, covalent–organic frameworks, and zeolites. These materials have potential application in important areas such as carbon capture, catalysis, gas storage, chemical separation, and drug delivery due to their modular, tunable structures, and their performance in these areas depends on precise control over their structure, chemical functionalities, and properties. Herein, we provide a review of generative AI algorithms that are emerging as powerful tools for the design of nanoporous materials, namely generative adversarial networks, variational autoencoders, diffusion models, genetic algorithms, reinforcement learning, and large language models. Some models are particularly good at generating diverse and high-quality designs, while others excel at exploring large design spaces or optimizing materials with desired properties. Certain algorithms also allow for efficient transitions between different designs, and some offer versatility in generating materials based on textual input. We discuss the advantages, limitations, and applications of these algorithms in porous material design and emphasize the future potential of integrating AI with experimental workflows to accelerate the development and validation of AI-generated materials.

36 MATERIALS SCIENCE↗

Transformer quantum state: A multipurpose model for quantum many-body problems

Here, inspired by the advancements in large language models based on transformers, we introduce the transformer quantum state (TQS): a versatile machine learning model for quantum many-body problems. In sharp contrast to Hamiltonian/task specific models, TQS can generate the entire phase diagram, predict field strengths with experimental measurements, and transfer such a knowledge to new systems it has never been trained on before, all within a single model. With specific tasks, fine-tuning the TQS produces accurate results with small computational cost. Versatile by design, TQS can be easily adapted to new tasks, thereby pointing towards a general-purpose model for various challenging quantum problems.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

AlphaFold -assisted structure determination of a bacterial protein of unknown function using X-ray and electron crystallography

Macromolecular crystallography generally requires the recovery of missing phase information from diffraction data to reconstruct an electron-density map of the crystallized molecule. Most recent structures have been solved using molecular replacement as a phasing method, requiring an a priori structure that is closely related to the target protein to serve as a search model; when no such search model exists, molecular replacement is not possible. New advances in computational machine-learning methods, however, have resulted in major advances in protein structure predictions from sequence information. Methods that generate predicted structural models of sufficient accuracy provide a powerful approach to molecular replacement. Taking advantage of these advances, AlphaFold predictions were applied to enable structure determination of a bacterial protein of unknown function (UniProtKB Q63NT7, NCBI locus BPSS0212) based on diffraction data that had evaded phasing attempts using MIR and anomalous scattering methods. Using both X-ray and micro-electron (microED) diffraction data, it was possible to solve the structure of the main fragment of the protein using a predicted model of that domain as a starting point. The use of predicted structural models importantly expands the promise of electron diffraction, where structure determination relies critically on molecular replacement.

molecular replacement↗

LAMP RFQ vane tip macro-based 3D modeling

This report covers the workflow and the demonstration of modeling the radiofrequency quadrupole (RFQ) vane tip geometry in 3D, for the Front End Upgrade of the LANSCE Modernization Project (LAMP). The goal is to develop an automated procedure to generate the 3D model of the LAMP RFQ vane tip geometry, so as to eliminate the need to manually enter the design parameters for each RFQ cell, when building the 3D model. With the developed procedure, the LAMP RFQ design optimization work can be significantly more efficient.

43 PARTICLE ACCELERATORS↗

Results and lessons learned from accelerating radio frequency modeling using machine learning [slides]

The “advanced tokamak” reactor concept is a leading candidate for a steady state fusion pilot plant. An advanced tokamak (AT) sustains a majority of the required plasma current with effects resulting from maintenance of the peaked pressure at the device center. This current is augmented by auxiliary current drive sources. These auxiliary actuators may consist of neutral particle beams and/or radio frequency (RF) systems such as lower hybrid current drive (LHCD) and high harmonic fast wave (HHFW) current drive using radio and microwaves from antennas. The primary focus of this work is to develop models of RF current profile control suitable for use in integrated modeling frameworks and for real-time control in experiments. Direct physics models of RF current drive can be computationally intensive. In order to achieve predictive times appropriate for the thousands of calls needed in real-time control of experiments and for use in integrated models, we will apply modern machine learning (ML) techniques to accelerate these models and interpolate their results. To generate the fast and accurate models for use in control level algorithms and integrated modeling we need to replace present models with high dimensional interpolation of their results. We will perform additional simulations across a broader parameter range for EAST and other tokamaks in different physics regimes (Alcator C-Mod, DIII-D, WEST, CFETR, ARC, ITER) and combine them into a larger database for training and testing of the ML models. Further testing of the control level models with experimental current profile data from EAST and C-Mod tokamaks will provide additional confirmation of the control level model before integration in a tokamak control system or integrated modeling suite. ML will be used to optimize the selection of training data consisting of RF current driven at different values of density profile, temperature profile, plasma current, and wavenumber. ML will also be used to facilitate classification of current drive from these input data. The output of this effort will be a validated classifier capable of determining the current drive profiles for HHFW CD and LHCD on a mille-second timescale. This will provide a breakthrough capability enabling real-time control of RF driven current profiles in experiments including ITER ICRF and use integrated modeling frameworks requiring thousands of current profile calculations in discharge simulations.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Expanding the Domain of Applicability of Machine Learning Models with Limited Data for Drug Property Prediction

Accurate machine learning models for predicting small molecule interactions with biological targets are essential for therapeutic discovery, biothreat response, and computational drug design, but their performance is often limited for understudied targets with sparse experimental data. To address this challenge, we developed and evaluated methods to improve molecular property prediction under low-data conditions, using the NimA-related kinase (NEK) family as a proof-of-concept. This work focused on two complementary goals within the ATOM Modeling PipeLine (AMPL) and the Generative Molecular Design (GMD) loop: expanding model applicability through transfer learning, representation learning, feature scaling, sampling strategies, and active-learning-inspired compound selection; and enabling efficient virtual screening to prioritize compounds that balance predicted activity, design objectives, and synthetic accessibility.

organic↗

Generation and evaluation of synthetic patient data

Background: Machine learning (ML) has made a significant impact in medicine and cancer research; however, its impact in these areas has been undeniably slower and more limited than in other application domains. A major reason for this has been the lack of availability of patient data to the broader ML research community, in large part due to patient privacy protection concerns. High-quality, realistic, synthetic datasets can be leveraged to accelerate methodological developments in medicine. By and large, medical data is high dimensional and often categorical. These characteristics pose multiple modeling challenges. Methods: In this paper, we evaluate three classes of synthetic data generation approaches; probabilistic models, classification-based imputation models, and generative adversarial neural networks. Metrics for evaluating the quality of the generated synthetic datasets are presented and discussed. Results: While the results and discussions are broadly applicable to medical data, for demonstration purposes we generate synthetic datasets for cancer based on the publicly available cancer registry data from the Surveillance Epidemiology and End Results (SEER) program. Specifically, our cohort consists of breast, respiratory, and non-solid cancer cases diagnosed between 2010 and 2015, which includes over 360,000 individual cases. Conclusions: We discuss the trade-offs of the different methods and metrics, providing guidance on considerations for the generation and usage of medical synthetic data.

59 BASIC BIOLOGICAL SCIENCES↗