Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “material training”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Compute in‐Memory with Non‐Volatile Elements for Neural Networks: A Review from a Co‐Design Perspective

Abstract Deep learning has become ubiquitous, touching daily lives across the globe. Today, traditional computer architectures are stressed to their limits in efficiently executing the growing complexity of data and models. Compute‐in‐memory (CIM) can potentially play an important role in developing efficient hardware solutions that reduce data movement from compute‐unit to memory, known as the von Neumann bottleneck. At its heart is a cross‐bar architecture with nodal non‐volatile‐memory elements that performs an analog multiply‐and‐accumulate operation, enabling the matrix‐vector‐multiplications repeatedly used in all neural network workloads. The memory materials can significantly influence final system‐level characteristics and chip performance, including speed, power, and classification accuracy. With an over‐arching co‐design viewpoint, this review assesses the use of cross‐bar based CIM for neural networks, connecting the material properties and the associated design constraints and demands to application, architecture, and performance. Both digital and analog memory are considered, assessing the status for training and inference, and providing metrics for the collective set of properties non‐volatile memory materials will need to demonstrate for a successful CIM technology.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Selected advances in small-angle scattering and applications they serve in manufacturing, energy and climate change

Innovations in small-angle X-ray and neutron scattering (SAXS and SANS) at major X-ray and neutron facilities offer new characterization tools for researching materials phenomena relevant to advanced applications. For SAXS, the new generation of diffraction-limited storage rings, incorporating multi-bend achromat concepts, dramatically decrease electron beam emittance and significantly increase X-ray brilliance over previous third-generation sources. This results in intense X-ray incident beams that are more compact in the horizontal plane, allowing significantly improved spatial resolution, better time resolution, and a new era for coherent-beam SAXS methods such as X-ray photon correlation spectroscopy. Elsewhere, X-ray free-electron laser sources provide extremely bright, fully coherent, X-ray pulses of <100 fs and can support SAXS studies of material processes where entire SAXS data sets are collected in a single pulse train. Meanwhile, SANS at both steady-state reactor and pulsed spallation neutron sources has significantly evolved. Developments in neutron optics and multiple detector carriages now enable data collection in a few minutes for materials characterization over nanometre-to-micrometre scale ranges, opening up real-time studies of multi-scale materials phenomena. SANS at pulsed neutron sources is becoming more integrated with neutron diffraction methods for simultaneous structure characterization of complex materials. In this paper, selected developments are highlighted and some recent state-of-the-art studies discussed, relevant to hard matter applications in advanced manufacturing, energy and climate change.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Machine Learning for Mapping Multipactor Susceptibility in RF Systems: Capabilities and Generalization Constraints

Multipactor is a surface-driven electron avalanche phenomenon that degrades the performance and reliability of radio-frequency (RF) systems in particle accelerator and vacuum electronics applications. Multipactor behavior in a given device structure is conventionally assessed through susceptibility charts, which provide a parameter-space characterization of the instability. In this work, we assess the capabilities of machine-learning (ML) models to learn and predict such susceptibility charts and analyze the constraints governing their generalization across materials. Using a simulation-derived dataset spanning six distinct secondary-electron-yield material profiles in a canonical two-surface planar geometry, we train supervised regression models and artificial neural networks to predict the time-averaged electron growth rate, δavg, across the relevant parameter space. Model performance is evaluated using metrics that explicitly probe the structure of susceptibility charts, including Intersection over Union, Structural Similarity Index, and correlation analysis. Tree-based ensemble models outperform neural-network models in reconstructing susceptibility regions and in generalizing across material domains. Principal-component analysis reveals disjoint material feature distributions, indicating that the piecewise mode structure of multipactor susceptibility is difficult to represent with a single global model and that generalization is constrained by data coverage rather than by model complexity. An exhaustive reduced-coverage study further shows that sparse material-space coverage can yield mean performance in the same general range but producing large variability in the susceptibility-region overlap. These results clarify the capabilities of ML-based surrogate models for parameter-space characterization of multipactor discharge. They also provide guidance for their appropriate use in RF system design.

43 PARTICLE ACCELERATORS↗
DOE OSTI2024

Mixture-of-Experts for Multi-Domain Defect Identification in Non-Destructive Inspection

Composite materials are widely used in aircraft structures because of their superior mechanical properties. However, their complex failure modes require sophisticated inspection methods to ensure structural integrity. Ultrasonic testing (UT) is a common non-destructive inspection (NDI) technique for aircraft composites that can detect internal and external defects with high resolution and accuracy. Despite their effectiveness, traditional UT methods rely on the manual interpretation of ultrasonic signals, which is time-consuming, labor-intensive, and subjective. Furthermore, processing such large-scale data, particularly across materials of varying thicknesses, significantly increases the computational demands of deep learning model optimization. To overcome these challenges, we propose an efficient sparse mixture-of-experts (MoE) model with a multi-level loss function and introduce four novel training objectives to improve computational efficiency and accuracy in identifying surface defects in composite aircraft materials. Here, we evaluated our approach on material with multiple thicknesses or domains comprising various defects. Our experimental results demonstrate higher accuracy and F1-Score, with only 10% training epochs compared to baseline MoE.

composite materials↗
DOE OSTI2023

An autonomous laboratory for the accelerated synthesis of novel materials

To close the gap between the rates of computational screening and experimental realization of novel materials, we introduce the A-Lab, an autonomous laboratory for the solid-state synthesis of inorganic powders. This platform uses computations, historical data from the literature, machine learning (ML) and active learning to plan and interpret the outcomes of experiments performed using robotics. Over 17 days of continuous operation, the A-Lab realized 41 novel compounds from a set of 58 targets including a variety of oxides and phosphates that were identified using large-scale ab initio phase-stability data from the Materials Project and Google DeepMind. Synthesis recipes were proposed by natural-language models trained on the literature and optimized using an active-learning approach grounded in thermodynamics. Analysis of the failed syntheses provides direct and actionable suggestions to improve current techniques for materials screening and synthesis design. The high success rate demonstrates the effectiveness of artificial-intelligence-driven platforms for autonomous materials discovery and motivates further integration of computations, historical knowledge and robotics.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Deep Learning Analysis of Polaritonic Wave Images

Deep learning (DL) is an emerging analysis tool across the sciences and engineering. Encouraged by the successes of DL in revealing quantitative trends in massive imaging data, we applied this approach to nanoscale deeply subdiffractional images of propagating polaritonic waves in complex materials. Utilizing the convolutional neural network (CNN), we developed a practical protocol for the rapid regression of images that quantifies the wavelength and the quality factor of polaritonic waves. Using simulated near-field images as training data, the CNN can be made to simultaneously extract polaritonic characteristics and material parameters in a time scale that is at least 3 orders of magnitude faster than common fitting/processing procedures. The CNN-based analysis was validated by examining the experimental near-field images of charge-transfer plasmon polaritons at graphene/α-RuCl3 interfaces. Our work provides a general framework for extracting quantitative information from images generated with a variety of scanning probe methods.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Accurate and scalable graph neural network force field and molecular dynamics with direct force architecture

Abstract Recently, machine learning (ML) has been used to address the computational cost that has been limiting ab initio molecular dynamics (AIMD). Here, we present GNNFF, a graph neural network framework to directly predict atomic forces from automatically extracted features of the local atomic environment that are translationally-invariant, but rotationally-covariant to the coordinate of the atoms. We demonstrate that GNNFF not only achieves high performance in terms of force prediction accuracy and computational speed on various materials systems, but also accurately predicts the forces of a large MD system after being trained on forces obtained from a smaller system. Finally, we use our framework to perform an MD simulation of Li 7 P 3 S 11 , a superionic conductor, and show that resulting Li diffusion coefficient is within 14% of that obtained directly from AIMD. The high performance exhibited by GNNFF can be easily generalized to study atomistic level dynamics of other material systems.

Chemistry↗
DOE OSTI2024

Structure-aware graph neural network based deep transfer learning framework for enhanced predictive analytics on diverse materials datasets

Abstract Modern data mining methods have demonstrated effectiveness in comprehending and predicting materials properties. An essential component in the process of materials discovery is to know which material(s) will possess desirable properties. For many materials properties, performing experiments and density functional theory computations are costly and time-consuming. Hence, it is challenging to build accurate predictive models for such properties using conventional data mining methods due to the small amount of available data. Here we present a framework for materials property prediction tasks using structure information that leverages graph neural network-based architecture along with deep-transfer-learning techniques to drastically improve the model’s predictive ability on diverse materials (3D/2D, inorganic/organic, computational/experimental) data. We evaluated the proposed framework in cross-property and cross-materials class scenarios using 115 datasets to find that transfer learning models outperform the models trained from scratch in 104 cases, i.e., ≈90%, with additional benefits in performance for extrapolation problems. We believe the proposed framework can be widely useful in accelerating materials discovery in materials science.

Chemistry↗
DOE OSTI2026

A multimodal large language model for materials science

Understanding and predicting the properties of inorganic materials is crucial for accelerating advancements in materials science and driving applications in energy, electronics and beyond. Integrating material structure data with language-based information through multimodal large language models (LLMs) offers great potential to support these efforts by enhancing human–artificial intelligence interaction. However, a key challenge lies in integrating atomic structures at full resolution into LLMs. In this work, we introduce MatterChat, a versatile structure-aware multimodal LLM that unifies material structural data and textual inputs into a single cohesive model. MatterChat uses a bridging module to effectively align a pretrained universal machine learning interatomic potential with a pretrained LLM, reducing training costs and enhancing flexibility. Our results demonstrate that MatterChat greatly improves performance in material property prediction and human–artificial intelligence interaction, surpassing general-purpose LLMs such as GPT-4. We also demonstrate its usefulness in applications such as more advanced scientific reasoning and step-by-step material synthesis.

Tang, Yingheng [Lawrence Berkeley National Laborat↗
DOE OSTI2022

The Power of Priors: Improved Enrichment Safeguards

International safeguards currently rely on material accountancy to verify that declared nuclear material is present and unmodified. Although effective, material accountancy for large bulk facilities can be expensive to implement due to the high precision instrumentation required to meet regulatory targets. Process monitoring has long been considered to improve material accountancy. However, effective integration of process monitoring has been met with mixed results. Given the large successes in other domains, machine learning may present a solution for process monitoring integration. Past work has shown that unsupervised approaches struggle due to measurement error. Although not studied in depth for a safeguards context, supervised approaches often have poor generalization for unseen classes of data (e.g., unseen material loss patterns). This work shows that engineered datasets, when used for training, can improve the generalization of supervised approaches. Further, the underlying models needed to generate these datasets need only accurately model certain high importance features.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

Residual-based error correction for neural operator accelerated infinite-dimensional Bayesian inverse problems

We explore using neural operators, or neural network representations of nonlinear maps between function spaces, to accelerate infinite-dimensional Bayesian inverse problems (BIPs) with models governed by nonlinear parametric partial differential equations (PDEs). Neural operators have gained significant attention in recent years for their ability to approximate the parameter-to-solution maps defined by PDEs using as training data solutions of PDEs at a limited number of parameter samples. The computational cost of BIPs can be drastically reduced if the large number of PDE solves required for posterior characterization are replaced with evaluations of trained neural operators. However, reducing error in the resulting BIP solutions via reducing the approximation error of the neural operators in training can be challenging and unreliable. We provide an a priori error bound result that implies certain BIPs can be ill-conditioned to the approximation error of neural operators, thus leading to inaccessible accuracy requirements in training. To reliably deploy neural operators in BIPs, we consider a strategy for enhancing the performance of neural operators: correcting the prediction of a trained neural operator by solving a linear variational problem based on the PDE residual. We show that a trained neural operator with error correction can achieve a quadratic reduction of its approximation error, all while retaining substantial computational speedups of posterior sampling when models are governed by highly nonlinear PDEs. The strategy is applied to two numerical examples of BIPs based on a nonlinear reaction–diffusion problem and deformation of hyperelastic materials. We demonstrate that posterior representations of the two BIPs produced using trained neural operators are greatly and consistently enhanced by error correction.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Two-Dimensional Energy Histograms as Features for Machine Learning to Predict Adsorption in Diverse Nanoporous Materials

A major obstacle for machine learning (ML) in chemical science is the lack of physically informed feature representations that provide both accurate prediction and easy interpretability of the ML model. In this work, we describe adsorption systems using novel two-dimensional energy histogram (2D-EH) features, which are obtained from the probe-adsorbent energies and energy gradients at grid points located throughout the adsorbent. The 2D-EH features encode both energetic and structural information of the material and lead to highly accurate ML models (coefficient of determination R2 ~ 0.94–0.99) for predicting single-component adsorption capacity in metal–organic frameworks (MOFs). Here, we consider the adsorption of spherical molecules (Kr and Xe), linear alkanes with a wide range of aspect ratios (ethane, propane, n-butane, and n-hexane), and a branched alkane (2,2-dimethylbutane) over a wide range of temperatures and pressures. The interpretable 2D-EH features enable the ML model to learn the basic physics of adsorption in pores from the training data. We show that these MOF-data-trained ML models are transferrable to different families of amorphous nanoporous materials. We also identify several adsorption systems where capillary condensation occurs, and ML predictions are more challenging. Nevertheless, our 2D-EH features still outperform structural features including those derived from persistent homology. The novel 2D-EH features may help accelerate the discovery and design of advanced nanoporous materials using ML for gas storage and separation in the future.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Stakeholder Training for IEEE 1547-2018 (Abbreviated Final Technical Report)

This project identifies and makes publicly available educational materials to assist stakeholders in adopting the revised IEEE Std 1547-2018, Standard for Interconnection and Interoperability of Distributed Energy Resources with Associated Electric Power Systems Interfaces. The new standard is significantly different than the previous 2003 version, contains new concepts and new technical requirements, and requires educational material on the application of these changes. NREL had a principal role in accelerating the revision process though its chairmanship of the IEEE Std 1547 working group to revise the standard and through technical support provided to the working group. Under this project, NREL and partners compiled and developed publicly available educational materials for IEEE Std 1547-2018, including webinars, white papers, and other resources on related topics.

14 SOLAR ENERGY↗
DOE OSTI2022

Acoustic Properties of Aerogels: Current Status and Prospects

Noise reduction remains an important priority in the modern society, in particular, for urban areas and highly populated cities. Insulation of buildings and transport systems such as cars, trains, and airplanes has accelerated the need to develop advanced materials. Various porous materials, such as commercially available foams and granular and fibrous materials, are commonly used for sound mitigating applications. In this review, a special class of advanced porous materials, aerogels, is examined, and an overview of the current experimental and theoretical status of their acoustic properties is provided. Aerogels can be composed of inorganic matter, synthetic or natural polymers, as well as organic/inorganic composites and hybrids. Aerogels are highly porous nanostructured materials with a large number of meso‐ and small macropores; the mechanisms of sound absorption partly differ from those of traditional porous absorbers possessing large macropores. The understanding of the acoustic properties of aerogels is far from being complete, and experimental results remain scattered. It is demonstrated that the structure of the aerogel provides a complex three‐dimensional architecture ideally suited for promising high‐performance materials for acoustic mitigation systems. This is in addition to the numerous other desirable properties that include low density, low thermal conductivity, and low refractive index.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Computational scanning tunneling microscope image database

We introduce the systematic database of scanning tunneling microscope (STM) images obtained using density functional theory (DFT) for two-dimensional (2D) materials, calculated using the Tersoff-Hamann method. It currently contains data for 716 exfoliable 2D materials. Examples of the five possible Bravais lattice types for 2D materials and their Fourier-transforms are discussed. All the computational STM images generated in this work are made available on the JARVIS-STM website ( https://jarvis.nist.gov/jarvisstm ). We find excellent qualitative agreement between the computational and experimental STM images for selected materials. As a first example application of this database, we train a convolution neural network model to identify the Bravais lattice from the STM images. We believe the model can aid high-throughput experimental data analysis. These computational STM images can directly aid the identification of phases, analyzing defects and lattice-distortions in experimental STM images, as well as be incorporated in the autonomous experiment workflows.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Nuclear Forensics

Nuclear forensics is a key part of the nuclear security strategy for the United States and the international community. The NACS Division is central to the leadership role that LLNL has had in nuclear forensics over the past 25 years. Our current nuclear forensic program includes conducting R&D on provenance and attribution signatures, collaborating with international partners, training the next generation of nuclear forensic experts, developing test materials for verification and validation exercises, and providing expert advice to national and international policy makers. Key to our success in these areas has been the strong and continuing involvement in nuclear forensic casework obtained through law enforcement and intelligence channels as well as our outstanding analytical capabilities. NACS must continue to conduct forward-thinking R&D in nuclear forensics that supports operational programs and addresses intelligence gaps. To maintain leadership in nuclear forensics, we must attract, develop, and retain the best talent. The NNSA has a central leadership role in developing educational initiatives for nuclear forensics. In concert with the Glenn T. Seaborg Institute, the NACS Division will continue to participate in all nuclear forensic educational initiatives (undergraduate, graduate, postdoctoral) and incorporate LLNL’s D&I vision into its student and postdoc recruitment efforts. We will continue to build formal relationships with key academic partners and institutions with active and emerging nuclear forensic research interests. We will also strengthen relationships with NNSA DNN and SSAA funded university consortia (e.g. NSSC, ACE, CNEC, CVT, ETI, MTV), helping them conduct research of interest and relevance to nuclear forensics, while at the same time evaluating and recruiting promising talent from these programs.

07 ISOTOPE AND RADIATION SOURCES↗
DOE OSTI2022

Performance Testing of Software Upgrade for SRNL CPC Instrument at the Nuclear Material Laboratory, Office of Safeguards Analytical Services, International Atomic Energy Agency

This report summarizes the performance testing for the Software upgrade for the Savannah River National Laboratory (SRNL) Controlled Potential Coulometry (CPC) instrument. This upgrade is specifically to meet the needs of the Nuclear Material Laboratory, Office of Safeguards Analytical Services, International Atomic Energy Agency at Seibersdorf, Austria. The instrument hardware was upgraded in 2010, but the software continued to operate on a Windows platform using a High Tech Basic (HT Basic) application. HT Basic usage is declining. The IAEA requested an upgrade to the existing coulometer software to Laboratory Virtual Instrument Engineering Workbench (LabVIEW), an object-oriented programming language in wide use and one the NML staff is familiar with. The software was developed by SRNL Software Engineer, with assistance from Electrical Engineer and Scientist. Once developed, the new LabVIEW software was validated, tested with Iron (surrogate for plutonium) and plutonium. Once testing was completed, the software was installed at the International Atomic Energy Agency Nuclear Material Laboratory (IAEA NML) coulometer, and SRNL provided hands on training to NML staff on using the new software.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

NCSP – AWE Collaboration [Slides]

Several points of collaboration between NCSP and AWE are noted, including the CIDAAS IS589 installation plan, CIDAAS testing, nuclear verification and detector physics, nuclear material control and nuclear security, and hands on criticality safety training.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗