Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “generative machine learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,477 records · Page 82

Recent trends in all-organic polymer dielectrics for high-temperature electrostatic energy storage capacitors

Electrostatic energy storage (EES) capacitors are critical for renewable energy and high-power systems, driving the search for dielectric materials that combine superior electrical insulation, mechanical flexibility, low density, cost-effectiveness, and processability. Polymer-based dielectrics have emerged as leading candidates, particularly for high electric field applications. However, conventional polymers often fail to meet the demands of high-temperature environments due to increased electrical conductivity and reduced discharged energy density at elevated temperatures, resulting in energy loss and reduced performance. High glass transition temperature (T g) polymers show promise but require further optimization to enhance their energy storage capabilities under thermal and electrical stress. This review provides a comprehensive update on recent advancements in high-T g polymer-based dielectrics for EES capacitors, focusing on both intrinsic polymers and all-organic composites. It outlines key design principles, critical performance parameters, and innovative strategies—such as nanofiller doping, layered architectures, physical blending, and chemical crosslinking—to improve electrical, thermal, and mechanical properties. The review also highlights emerging trends, including the integration of machine learning algorithms to explore novel polymer structures and expand the chemical design space. By bridging the gap between academic research and industrial application, this review aims to accelerate the development of next-generation dielectric materials capable of balancing multiple performance metrics for high-temperature EES capacitors.

Xie, Zongliang↗

Online accelerator optimization with a machine learning-based stochastic algorithm

Abstract Online optimization is critical for realizing the design performance of accelerators. Highly efficient stochastic optimization algorithms are needed for many online accelerator optimization problems in order to find the global optimum in the non-linear, coupled parameter space. In this study, we propose to use the multi-generation Gaussian process optimizer for online accelerator optimization and demonstrate that the algorithm is significantly more efficient than other stochastic algorithms that are commonly used in the accelerator community.

Zhang, Zhe (ORCID:0000000281430381)↗

An evaluation of GPT models for phenotype concept recognition

Clinical deep phenotyping and phenotype annotation play a critical role in both the diagnosis of patients with rare disorders as well as in building computationally-tractable knowledge in the rare disorders field. These processes rely on using ontology concepts, often from the Human Phenotype Ontology, in conjunction with a phenotype concept recognition task (supported usually by machine learning methods) to curate patient profiles or existing scientific literature. With the significant shift in the use of large language models (LLMs) for most NLP tasks, we examine the performance of the latest Generative Pre-trained Transformer (GPT) models underpinning ChatGPT as a foundation for the tasks of clinical phenotyping and phenotype annotation. The experimental setup of the study included seven prompts of various levels of specificity, two GPT models (gpt-3.5-turbo and gpt-4.0) and two established gold standard corpora for phenotype recognition, one consisting of publication abstracts and the other clinical observations. The best run, using in-context learning, achieved 0.58 document-level F1 score on publication abstracts and 0.75 document-level F1 score on clinical observations, as well as a mention-level F1 score of 0.7, which surpasses the current best in class tool. Without in-context learning, however, performance is significantly below the existing approaches. Our experiments show that gpt-4.0 surpasses the state of the art performance if the task is constrained to a subset of the target ontology where there is prior knowledge of the terms that are expected to be matched. While the results are promising, the non-deterministic nature of the outcomes, the high cost and the lack of concordance between different runs using the same prompt and input make the use of these LLMs challenging for this particular task.

59 BASIC BIOLOGICAL SCIENCES↗

Model-informed, Adaptive Physical Vapor Deposition to Fabricate Hierarchical Binary-alloy Thin-films

Designing next generation thin films, tailor-made for specific applications, relies on the availability of robust processing-structure-property relationships. Traditional structure zone diagrams are limited to low-dimensional mappings, with machine-learning methods only recently attempting to relate multiple processing parameters to the final microstructure. Despite this progress, structure-processing relationships are unknown for processing conditions that vary during thin-film deposition, limiting the range of microstructures and properties achievable. In this project, we employed a phase-field computational model combined with a genetic algorithm (GA) to identify and design time-dependent processing protocols that achieve tailor-made microstructures. We simulate the physical vapor deposition of a binary-alloy thin film by employing a phase-field model, where deposition rates and diffusivities are controlled via the genetic algorithm. Our GA-guided protocols achieve targeted microstructures with lateral and vertical concentration modulations, as well as more complex, hierarchical microstructures previously not described in simple structure zone diagrams. Our algorithm provides insight to experimentalists looking for additional avenues to design novel thin-film microstructures.

36 MATERIALS SCIENCE↗

A Novel Hollow Fiber Membrane Reactor for High Purity H 2 Generation from Thermal Catalytic NH 3 Decomposition (Final Report)

Ammonia (NH 3 ), as a promising carbon neutral liquid fuel (CNLF) and an effective H 2 source, can be synthesized from air and water (N 2 extracted from air and H 2 from water) using renewable energy sources. To produce H 2 as an intermediate, it is essential to develop effective and economic NH 3 decomposition technologies. We have been developing an innovative hollow fiber membrane reactor for high purity H 2 generation from thermal catalytic NH 3 decomposition. The objective of the proposed research is to fabricate a compact and robust prototype with high energy efficiency (>80%) to deliver high purity (>99%) H2 at high rate per volume (>0.15 g H 2 /h/cm 3 ) from NH3 decomposition at low temperature (<450 °C) and high conversion (>99%). Our overall technical approach is to effectively combine an active catalyst for NH 3 decomposition with a selective H 2 membrane separation process in a novel, compact modular system to generate high purity H 2 and simultaneously achieve high NH 3 conversion and optimize the entire system energy efficiency. This novel integrated membrane reactor design, together with low-cost, highly active Ru-based catalyst, makes it most appropriate for the project objective. The proposed applied research and development work, therefore, represents an innovative and transformational solution to H 2 generation from thermal catalytic NH 3 decomposition. During the course of our research we i) synthesized and characterized ruthenium(Ru)-based catalysts, evaluated their catalytic performance for NH 3 decomposition and optimized the catalyst composition and performance based on machine learning, ii) prepared SAPO-34, MFI membranes on α-alumina hollow fibers and measured their performance for H 2 /N 2 , H 2 /N 2 /NH 3 separation and evaluated carbon molecular sieve (CMS) and Pd/Ag membranes for H 2 /N 2 , H 2 /N 2 /NH 3 separation at different conditions, iii) designed and evaluated several types of membrane reactors for H 2 production from NH 3 decomposition, and iv) evaluated the H 2 delivery cost base on catalysts development, membrane development and membrane reactor. For 3,1,12 RuYK catalyst, H 2 productivity of 6.35 mmol/min/gcat with NH 3 conversion of 95~98% was achieved at 5 bar and 400 °C; for SAPO-34 membrane, the best membrane showed H 2 permeance of 7.56×10 -7 mol/(m 2 ∙s∙Pa) and H 2 /N 2 selectivity of 23.1 at 20 °C; For CMS and Pd/Ag membranes, both showed superior stability for 71%H 2 /24%N 2 /5%NH 3 mixture separation at 450 °C and 7 bar for over 120 h; for the membrane reactor, high H 2 purity of >99.99% with NH 3 conversion of >99.4% were achieved in Pd/Ag membrane reactor at 450 °C, and the NH 3 concentration was always below 10 ppb in H 2 product. The H 2 generation rate was calculated to be as high as 0.47 g/h/cm 3 and the energy efficiency was calculated to be 88%. The membrane reactor showed superior stability for over 370 h and high H 2 purity, H 2 production rate and NH 3 conversion. Based on calculation, the H 2 delivery cost can be as low as $3.66/kg.

08 HYDROGEN↗

Challenging Practices of Algebraic Battery Life Models through Statistical Validation and Model Identification via Machine-Learning

Various modeling techniques are used to predict the capacity fade of Li-ion batteries. Algebraic reduced-order models, which are inherently interpretable and computationally fast, are ideal for use in battery controllers, technoeconomic models, and multi-objective optimizations. For Li-ion batteries with graphite anodes, solid-electrolyte-interphase (SEI) growth on the graphite surface dominates fade. This fade is often modeled using physically informed equations, such as square-root of time for predicting solvent-diffusion limited SEI growth, and Arrhenius and Tafel-like equations predicting the temperature and state-of-charge rate dependencies. In some cases, completely empirical relationships are proposed. However, statistical validation is rarely conducted to evaluate model optimality, and only a handful of possible models are usually investigated. This article demonstrates a novel procedure for automatically identifying reduced-order degradation models from millions of algorithmically generated equations via bi-level optimization and symbolic regression. Identified models are statistically validated using cross-validation, sensitivity analysis, and uncertainty quantification via bootstrapping. On a LiFePO 4 /Graphite cell calendar aging data set, automatically identified models utilizing square-root, power law, stretched exponential, and sigmoidal functions result in greater accuracy and lower uncertainty than models identified by human experts, and demonstrate that previously known physical relationships can be empirically "rediscovered" using machine learning.

25 ENERGY STORAGE↗

Illuminating the Material World: Autonomous Microscopy to Understand Order, Disorder, and Everything In Between

Artificial intelligence (AI) holds immense promise for revolutionizing microscopy, yet its widespread adoption has been hindered by challenges ranging from user inexperience to limited model transferability and difficulties in operationalizing machine learning. This presentation showcases our approach to developing practical autonomy for materials discovery, aiming to accelerate the integration of AI into everyday microscopy workflows. As shown in Fig. 1, I will focus on three key areas: understanding order-disorder transitions, quantifying point defects, and achieving truly device-scale microscopy. First, I will demonstrate the power of multi-modal knowledge graphs for integrating diverse microscopy data. By combining imaging, spectroscopy, and diffraction data, these graphs provide a holistic view of material behavior, capturing the intricate relationships between different modalities [1,2]. I will present a case study on how these models illuminate the structural and chemical changes associated with irradiation in oxide thin films, revealing critical insights for designing materials for extreme environments like spaceflight and nuclear energy. Specifically, I will show how multi-modal analysis clarifies the evolution of order-disorder transitions under irradiation, a key factor influencing material performance in these applications. Next, I will address the challenge of quantifying point defects in 2D materials. We demonstrate the application of computer vision and transfer learning to accurately identify and classify various defect types, such as vacancies and substitutional atoms, and to quantify their concentrations. This information is crucial for understanding and tailoring the properties of 2D materials for applications in electronics, optoelectronics, and catalysis. For example, I will show how our models can characterize the topological distribution of point defects in MXene transition metal carbides, providing valuable insights for optimizing their performance in energy storage and separation science. Finally, I will discuss our progress toward autonomous device-scale microscopy [3,4]. We are fundamentally redesigning electron microscopes around the principles of machine reasoning, enabling automation beyond basic tasks like sample navigation and data acquisition to include sophisticated experimental design. This approach paves the way for truly reproducible and massively scaled analysis campaigns. I will emphasize the importance of autonomous microscopy platforms for high-throughput materials discovery and characterization, facilitating the rapid screening of materials for a broad range of applications and accelerating the development of next-generation technologies.

36 MATERIALS SCIENCE↗

DuctGPT: A Generative Transformer for Forward Screening of Ductile Refractory Multi-Principal Element Alloys

Designing ductile materials for extreme environments such as fusion reactors requires a deep understanding of the complex interplay between electronic structure, mechanical stability, and wide compositional space. Here, in this work, we introduce DuctGPT, a physics-informed, GPT-powered machine learning platform that enables rapid and accurate prediction of ductility across a wide range of refractory multi-principal element alloys (MPEAs). Trained on both experimental and high-fidelity computational data, DuctGPT integrates descriptors such as density of states at the Fermi level, elastic constants, and valence electron concentration to capture the fundamental mechanisms governing ductile versus brittle behavior. Using this framework, we screen over 1000 compositions in of body-centered cubic (BCC) MPEAs, including two new alloy classes, i.e., NbTa-rich (NbTa $>$ 50 at.%) NbTa-Ti-V and W-rich ($>$ 50 at.%) W-Ti-V MPEAs, to rapidly identify promising alloy compositions with enhanced ductility. Validation against experimental data confirms the model's ability to predict ductility with high fidelity and low uncertainty. By leveraging conversational AI and robust physical modeling, DuctGPT provides a blueprint for the next generation of alloy design assistants, enabling human-AI collaboration in the accelerated discovery of ductile, high-performance materials for fusion, aerospace, and advanced manufacturing.

AI/ML↗

Universal Monte Carlo Event Generator

With the Jefferson Lab 12 GeV physics program underway and plans for the future Electron-Ion Collider (EIC), the nuclear physics community is entering a new era of exploration of QCD phenomena involving extensive data taking and event-level processing. This brings with it the potential for unprecedented access to multidimensional particle momentum distributions (PMDs) that can be connected to various theoretical frameworks by unfolding the emergent quantum mechanical properties of QCD using the PMDs. In practice, the PMDs are rendered as discretized histograms (typically one- or two-dimensional projections), and detector effects must be taken into account to unfold the pure detector effect-free PMDs that can be connected with theory. One of the challenges in this new era is obtaining faithful reconstructions of the multidimensional PMDs that preserve all of the inherent particle correlations. In this LDRD project we developed a novel approach using machine learning (ML) that solves this challenge, by avoiding entirely the need to use histograms as the main numerical technique to obtain the detector effect-free PMDs. The new approach is, moreover, scalable to higher dimensional PMDs. The central idea involves training neural networks (NNs) to generate synthetic event-level data (momenta 4-vectors of final state particles) to preserve all correlations among the particles. This is achieved by converting the trial synthetic vertex-level events to detector-level events using detector simulators. The NNs are then tuned using a specialized distance metric between the synthetic detector events and the real detector events.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Observational process data analytics using causal inference

Voluminous process data are available with the paradigm shift toward smart manufacturing. However, most historical data are observational, containing noncausal correlations due to confounders and mediators. Estimating causal effects from observational data remains a bottleneck in leveraging them for active applications such as optimization and control. Further, this work aims to introduce a causal modeling framework for analyzing observational process data and extracting quantitative causal information. We demonstrate a real-world application in steel manufacturing where causal inference is used to analyze observational production data and improve the steelmaking process. Additionally, we propose a novel formulation for identifying critical process parameters from observational data, where causal inference is combined with variance-based methods to estimate corresponding risks of interventions to the manufacturing system. The proposed methods are compared with statistical ones to illustrate that causally interpreting statistical correlation leads to problematic results, while the provided workflow generates satisfactory strategies for process improvement.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

GrainNN: A neighbor-aware long short-term memory network for predicting microstructure evolution during polycrystalline grain formation

High fidelity simulations of grain formation in alloys are an indispensable tool for process-to-mechanical-properties characterization. Such simulations, however, can be computationally expensive as they require fine spatial and temporal discretizations. Their cost becomes an obstacle to parametric studies and ensemble runs and ultimately makes downstream tasks like optimal control and uncertainty quantification challenging. To enable such downstream tasks, we introduce GrainNN, an efficient and accurate reduced-order model for epitaxial grain growth in additive manufacturing conditions. GrainNN is a sequence-to-sequence long-short-term-memory (LSTM) deep neural network that evolves the dynamics of manually crafted features. Its innovations are (1) an attention mechanism with grain-microstructure-specific transformer architecture; and (2) an overlapping combination of several clones of the network to generalize to grain configurations that are different from those used for training. This design enables GrainNN to predict grain formation for unseen physical parameters, grain number, domain size and geometry. Furthermore, GrainNN not only reconstructs the quantities of interest but also can be pointwise accurate. In our numerical experiments, we use a polycrystalline phase field method to both generate the training data and assess GrainNN. For multiparametric, ensemble simulations with many grains, GrainNN can be orders of magnitude faster than phase field simulations, while delivering 5%–15% pointwise error. Additionally, this speedup includes the cost of the phase field simulations for generating training data.

36 MATERIALS SCIENCE↗

Hybrid Quantum-Classical Neural Network for Calculating Ground State Energies of Molecules

We present a hybrid quantum-classical neural network that can be trained to perform electronic structure calculation and generate potential energy curves of simple molecules. The method is based on the combination of parameterized quantum circuits and measurements. With unsupervised training, the neural network can generate electronic potential energy curves based on training at certain bond lengths. To demonstrate the power of the proposed new method, we present the results of using the quantum-classical hybrid neural network to calculate ground state potential energy curves of simple molecules such as H 2 , LiH, and BeH 2 . The results are very accurate and the approach could potentially be used to generate complex molecular potential energy surfaces.

74 ATOMIC AND MOLECULAR PHYSICS↗

Joint ptycho-tomography with deep generative priors

Abstract Joint ptycho-tomography is a powerful computational imaging framework to recover the refractive properties of a 3D object while relaxing the requirements for probe overlap that is common in conventional phase retrieval. We use an augmented Lagrangian scheme for formulating the constrained optimization problem and employ an alternating direction method of multipliers (ADMM) for the joint solution. ADMM allows the problem to be split into smaller and computationally more efficient subproblems: ptychographic phase retrieval, tomographic reconstruction, and regularization of the solution. We extend our ADMM framework with plug-and-play (PnP) denoisers by replacing the regularization subproblem with a general denoising operator based on machine learning. While the PnP framework enables integrating such learned priors as denoising operators, tuning of the denoiser prior remains challenging. To overcome this challenge, we propose a denoiser parameter to control the effect of the denoiser and to accelerate the solution. In our simulations, we demonstrate that our proposed framework with parameter tuning and learned priors generates high-quality reconstructions under limited and noisy measurement data.

97 MATHEMATICS AND COMPUTING↗

Machine Learning for Advanced Building Construction

High-efficiency retrofits can play a key role in reducing carbon emissions associated with buildings if processes can be scaled-up to reduce cost, time, and disruption. Here we demonstrate an artificial intelligence/computer vision (AI/CV)-enabled framework for converting exterior build scans and dimensional data directly into manufacturing and installation specifications for overclad panels. In our workflow point clouds associated with LiDAR-scanned buildings are segmented into a facade feature space, vectorized features are extracted using an iterative random-sampling consensus algorithm, and from this representation an optimal panel design plan satisfying manufacturing constraints is generated. This system and the corresponding construction process is demonstrated on a test facade structure constructed at the National Renewable Energy Laboratory (NREL). We also include a brief summary of a techno-economic study designed to estimate the potential energy and cost impact of this new system.

build scans↗

Process Anomaly Detection for Sparsely Labeled Events in Nuclear Power Plants

An essential aspect of online monitoring, subtle anomaly detection increases the detection lead time for equipment failure and enables a nuclear power plant (NPP) to mitigate unexpected partial or full outages, resulting in significant cost saving to the plant. Once an anomaly is detected by plant staff, its cause and severity are investigated. Because the vast majority of anomalies require some level of investigation, including some that require time-consuming examination, before they are passed over to the engineering organization for further analysis, plants are often equipped with tools to assist the staff in performing anomaly detection. Those tools operate as a black box and are often based on statistical methods that establish sensor correlations using preconfigured mathematical models and flag correlation deviations as anomalies. Due to the number of anomalies detected at a given NPP on a daily basis, a significant number of flagged anomalies usually await examination for days or weeks. A primary cause of this backlog is that the methods used by the tools generate many false positives. Though this is usually attributed to oversensitive model settings due to very narrow normal operation bands, it can also be associated with the model development being inadequate for the process being monitored, or with missing model inputs that could have explained misclassified positives. The performance of anomaly detection tools impacts their plant acceptance and utilization, especially when the effort to address false positives generated by the tool depletes the value or cost saved by using that tool. Thus, means to advance anomaly detection performance have been investigated by the Department of Energy’s Light Water Reactor Sustainability program. Previous and ongoing efforts have targeted unsupervised machine-learning (ML) methods, which do not require the labeling of any data fed into the ML model. By contrast, in supervised anomaly detection methods, every data point is labeled as either a normal or abnormal process condition, and the model is trained to replicate the classification process. Supervised methods usually outperform unsupervised methods, due to the added value in differentiating normal from anomalous states of the monitored process. An NPP’s corrective action program requires it to track and document, via a dedicated report, the resolution of any issues that occur within the plant. Once created, each report is reviewed by a plant screening committee, and several classifications and decisions are made. Recently, a collaborating NPP developed an artificial intelligence and ML-based classifier to categorize a condition report (CR) into classes that can serve to label the data as normal or anomalous. Applying CRs as labels represents a semi-supervised use case. Semi-supervised ML assumes that labels exist for some data points (i.e., labeled anomalies, in this case) but not for the rest. In this effort, semi-supervised ML methods were used to fuse data from CRs with anomaly detection methods in order to test the hypothesis that partially labeled anomalies would improve the accuracy of the anomaly detection methods. Specifically, two methods were used. The first is the deep Semi-supervised Anomaly Detection (deep SAD) method, which can handle labels ranging from fully unsupervised to fully supervised cases. The second is a newly designed ML method developed specifically for this effort and referred to as the high-order feature (HOF)-based method. To evaluate these two methods in controlled environments, synthetic data generators were developed and used. The first datasets used a spring-mass-damper (SMD) system simulator commonly found in mechanical engineering references. This was used to create two use cases: a one- and a three-mass system. Anomalies were introduced by changing the spring and damper coefficients while the system was actuated by random forces. The second datasets used the commercial Dymola-Modelica software to build a simplified nuclear reactor model. Anomalies were added in the form of corrupted sensor readings and/or control commands. The deep SAD method was tested using the SMD system, while the HOF method was tested using both datasets. Application of the deep SAD semi-supervised ML method demonstrated that labels can generate increased confidence in detecting true anomalies. This helped increase the number of true positives and decrease the number of false negatives—something that would aid in addressing the backlog of possible anomalies. Application of the HOF method demonstrated that labels can aid in down selecting from a candidate set of features to a more optimal subset in order to better differentiate between normal and anomalous conditions.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Machine learning-assisted early ignition prediction in a complex flow

Machine learning methods are used to improve the efficiency by which turbulence-resolved simulations predict whether a hydrogen jet in air crossflow will successfully ignite. The flush-mounted jet issues perpendicularly from the wall of a low-speed wind tunnel into a turbulent boundary layer wherein a laser-induced optical breakdown (LIB) hotspot is deposited. A detailed hydrogen chemical mechanism is used to model the radicals and any subsequent chemical reactions. A dielectric-barrier discharge actuator generates body forces and hydrogen radicals near the jet orifice. Here we focus on the success or not of the ignition based on LIB location. A challenge is that definitive determination of this requires long simulations, up to 440 µs after the LIB deposition. This is particularly expensive since multiple simulations are required to find the threshold. To reduce the computational effort, three short-time (91 µs) criteria are proposed, evaluated, and compared: a constructed criterion based on detailed observations of radicals near the stoichiometric surface and two machine learning approaches, each trained on 38 realizations. The constructed criterion provides a low-cost estimate of the ignition boundary that is unambiguous in 45 of the 50 training and test trials, so only 10% of them would need to be simulated longer. The trained neural networks correctly predict outcomes in all cases evaluated, with the more automated procedure—a convolutional neural network (CNN) trained on two-dimensional images—providing the most definitive outcome prediction. From the CNN, a sensitivity analysis is used to determine which kernel features from the two-dimensional input data, as defined by intermediate-layer network weights, are important for identifying ignition.

42 ENGINEERING↗

A Multidimensional Holistic Framework for the Security of Distributed Energy and Control Systems

The digitization of smart grid distributed generation and industrial control systems has prompted utilities to deploy tools with ubiquitous communications that potentially widen the attack surface. The utilities still continue to rely on the traditional cybersecurity technologies, such as firewalls, anti-malware tools, and passwords that do not ensure security across all dimensions of the information assurance model required for a strong cybersecurity business process. This paper proposes a multidimensional holistic framework that addresses this gap through advanced technologies, intelligent algorithms, and continued assessments. To show proof, the layered defense model, a solution dimension of the framework, is integrated into the National Renewable Energy Laboratory's Security and Resilience Testbed to replicate a utility's enterprise and substation networks. The model is used to evaluate the security and resilience of microgrid control systems, and, based on the insights gathered, recommend best practices for utility cybersecurity analysts for a strong business process. Here, with this baseline, the paper conceptually introduces intelligence-driven solutions comprising contextual data analysis and machine learning to respond to advanced persistent threats sponsored by campaign efforts.

24 POWER TRANSMISSION AND DISTRIBUTION↗