Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “DNN”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

NuTools: Exploring Practical Roles for Neutrinos in Nuclear Energy and Security

For decades, physicists have used neutrinos from nuclear reactors to advance basic science. These pursuits have inspired many ideas for application of neutrino detectors in nuclear energy and security. While developments in neutrino detectors are now making some of these ideas technically feasible, their value in the context of real needs and constraints has been unclear. This report seeks to help focus the picture of where neutrino technology may find practical roles in nuclear energy and security. This report is the final product of the Nu Tools study, commissioned in 2019 by the DOE National Nuclear Security Administration (NNSA) Office of Defense Nuclear Nonproliferation Research and Development (DNN R\&D). The study was conducted over two years by a group of neutrino physicists and nuclear engineers. A central theme of the study and this report is that useful application of neutrinos will depend not only on advancing physics and technology but also on understanding the needs and constraints of potential end-users.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

FY21 Progress Report: SRNL Analysis of ICCWR LCM and WAMS data for Corrosion and Cracking

The development of algorithms for machine learning and data analysis for the 3013 Surveillance Program is a collaborative effort by the Savannah River National Laboratory (SRNL) and the University of South Carolina (USC). For corrosion detection, Laser Confocal Microscope (LCM) or Wide Area 3D Measurement System (WAMS) data is extracted from large binary files, with software written to convert the data to physical attributes (e.g., height, color and grayscale values; all as functions of a location in a plane projection). A user-friendly Matlab Graphical User Interface (GUI) that reads data from either LCM or WAMS files was developed to integrate input data with software developed for processing and evaluation. The GUI can selectively download binary data, interrogate data attributes, label data, flag significant features, execute Machine Learning (ML) algorithms, output parameters for trained ML algorithms, report ML model accuracy with respect to labeled data, and generate graphical representations for various analyses. Features can be called out by user-specified thresholds, manual labeling or machine learning algorithms when they have been completed. The ability to rapidly label data is important because of the volume of data required for training machine learning algorithms. The GUI has the flexibility to allow addition of improved ML algorithms, methods for data visualization, and statistical computations. Statistical analyses via the GUI include areas of pits within a defined range of pit depths, correlations between Red-Green-Blue (RGB) or grayscale intensity and relative surface height, covariances between values associated with features, and feature histograms. The development of supervised machine learning algorithms, however, has been hindered by a lack of training data. The machine learning algorithms for crack identification are being refined but require improvements to the true positive rate for crack detection. This shortcoming is an artifact of the limited training data currently available, perhaps more so than the structure of the neural networks. At present, the best results are had from a consensus over an ensemble of randomly generated Deep Neural Network (DNN) or Convolutional Neural Network (CNN) algorithms. Although the consensus accuracy method has yielded optimum true positive and true negative rates in excess of 80%, additional validation testing is necessary. In addition to the suite of LCM data that was initially used, and which represents the majority of the work presented in this report, WAMS image data was also reviewed at a preliminary level. The review included a comparison between image resolution and dynamic range for each method. WAMS (ZON file) image data was found to have a pixel pitch of 3.69μm compared to 1 μm for the LCM (vk4 file) data, which implies a lower resolution for the WAMS images. Conversely, the ratio of dynamic range of the WAMS data to the LCM data was approximately 41:20 for height data, suggesting that information from WAMS should more accurately determine the depth of pits. At present, the significance of the greater dynamic range of the WAMS data relative to the LCM data has not yet been evaluated.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Nuclear Forensics

Nuclear forensics is a key part of the nuclear security strategy for the United States and the international community. The NACS Division is central to the leadership role that LLNL has had in nuclear forensics over the past 25 years. Our current nuclear forensic program includes conducting R&D on provenance and attribution signatures, collaborating with international partners, training the next generation of nuclear forensic experts, developing test materials for verification and validation exercises, and providing expert advice to national and international policy makers. Key to our success in these areas has been the strong and continuing involvement in nuclear forensic casework obtained through law enforcement and intelligence channels as well as our outstanding analytical capabilities. NACS must continue to conduct forward-thinking R&D in nuclear forensics that supports operational programs and addresses intelligence gaps. To maintain leadership in nuclear forensics, we must attract, develop, and retain the best talent. The NNSA has a central leadership role in developing educational initiatives for nuclear forensics. In concert with the Glenn T. Seaborg Institute, the NACS Division will continue to participate in all nuclear forensic educational initiatives (undergraduate, graduate, postdoctoral) and incorporate LLNL’s D&I vision into its student and postdoc recruitment efforts. We will continue to build formal relationships with key academic partners and institutions with active and emerging nuclear forensic research interests. We will also strengthen relationships with NNSA DNN and SSAA funded university consortia (e.g. NSSC, ACE, CNEC, CVT, ETI, MTV), helping them conduct research of interest and relevance to nuclear forensics, while at the same time evaluating and recruiting promising talent from these programs.

07 ISOTOPE AND RADIATION SOURCES↗

Deep Learning Accelerated History Matching and Forecasting in Geologic CO 2 Sequestration [Slides]

We have successfully developed a predictive workflow for the Geologic CO 2 Sequestration using a deep learning model based on the Fourier Neural Operator. The workflow has high accuracy for predicting pressure & saturation during the injection and post-injection periods and has decent accuracy for predicting water and CO 2 production rates during injection period. It is necessary to train exclusive DNN models for pressure prediction in long term GCS, but for saturation prediction, we can use a single model to predict it.

58 GEOSCIENCES↗

Digital Signal Processing Using Deep Neural Networks

Currently there is great interest in the utility of deep neural networks (DNNs) for the physical layer of radio frequency (RF) communications. In this manuscript we describe a custom DNN specially designed to solve problems in the RF domain. Our model leverages the mechanisms of feature extraction and attention through the combination of an autoencoder convolutional network with a transformer network, to accomplish several important communications network and digital signals processing (DSP) tasks. We also present a new open dataset and physical data augmentation model that enables training of DNNs that can perform automatic modulation classification, infer, and correct transmission channel effects, and directly demodulate baseband RF signals.

42 ENGINEERING↗

NCERC Provides Unique Opportunities for University Student Researchers

Five students and one faculty member - sponsored by the Defense Nuclear Nonproliferation (DNN, NA 22) university consortia - visited the National Criticality Experiments Research Center (NCERC) in July of 2023 to measure radiation signatures from Category I Special Nuclear Material (SNM) in a week-long measurement campaign organized by staff at Los Alamos National Laboratory. Participants included University of Florida, University of Michigan, and University of Illinois-Champaign Urbana. The measurement campaign was organized on behalf of the Consortium for Monitoring, Testing, and Verification (MTV), the Nuclear Science and Security Consortium (NSSC), and the Consortium for Enabling Technologies and Innovation (ETI).

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Report on Next-Gen AI for Proliferation Detection Workshop: Domain-Aware Methods

The emergence of artificial intelligence (AI) and machine learning (ML) in the modern world has impacted nearly every application imaginable. This includes nuclear proliferation detection, which offers the potential to improve existing capabilities as well as create new ones. Proliferation detection seeks to detect and characterize attempts by state and non-state actors to acquire nuclear weapons or associated technology, materials, or knowledge. Such a mission is vitally important for global stability and security but is notoriously difficult. By leveraging advances in AI, exciting opportunities exist to enhance the proliferation detection regime. The Data Science and AI portfolio within the National Nuclear Security Administration’s Office of Defense Nuclear Nonproliferation Research and Development (DNN R&D) seeks to leverage the capabilities of the Department of Energy’s (DOE’s) national laboratories and other partners to develop AI systems that can accomplish otherwise impossible tasks in support of proliferation detection. As part of its efforts, the portfolio has created a series of workshops on Next-Gen AI for Proliferation Detection to help define the requirements for suitable AI systems, share successful research and best practices, and foster connection and understanding between the relevant parties including researchers and end-users. Each workshop in the series focuses on a specific and critical aspect of AI to enable it to accomplish proliferation detection objectives. The first workshop focused on explainability techniques; the second workshop and the topic of this report, covers methods for incorporating domain awareness into AI. The Next-Gen AI for Proliferation Detection Workshop: Domain-Aware Methods took place virtually over two days in February 2021 and included four keynote presentations, 22 technical presentations, and a concluding panel. The presentations, discussions, and workshop findings are summarized in this report.

97 MATHEMATICS AND COMPUTING↗

Multi-phenomenology Yield Characterization

This report serves as the first delivery of a four-year applied science effort to transform and advance the error bounds for the yield estimate of an explosion. Each year’s delivery will be in this form, culminating in the submission of this work for peer review to a scientific journal. Importantly, the yearly progress reports can then also be viewed as expanding drafts working towards a formal journal article submission. For the first tranche of funding, we collaborated with Air Force Technical Applications Center (AFTAC) scientists to identify unclassified real-world data that demonstrate and validate our advanced error propagation methods. Collaboration includes visits to AFTAC and telecons. For this development, we illustrate the fusion of seismic, acoustic, optical, and surface effect signatures from an explosion. The mathematics and code being adapted to this specific application (Williams et al., 2021) involves physics models of multiple sensor signatures. We have also identified related physics models and have integrated them into code. Current methods of underground explosion yield estimation for the Threshold Test Ban Treaty (TTBT) have served the US treaty monitoring mission well for decades. A research objective of the Defense Nuclear Nonproliferation Research and Development (DNN R&D) office of the National Nuclear Security Administration (NNSA) has always been to provide new technical capabilities for monitoring lower thresholds. The general model and error propagation code to be developed in this project is based on significant advances in error modeling and propagation needed to analyze data at lower detection thresholds. The second tranche of funding for this project began on May 1, 2022, and planned work for the second tranche includes: i) completing the integration of physical model code into the general error model framework; this code accommodates a wide range of linear/nonlinear source models, fixed/ random effects, and frequentist/Bayesian analyses (the purpose of which is not to dictate to users how to analyze data, but instead to allow users the maximum flexibility in their work); ii) illustrative application of code to identified data, and; iii) initial planning with AFTAC researchers on delivery of code to the Common Development Environment at AFTAC, and continued writing of the planned final journal article submission (year two of this progress report), with particular emphasis on descriptions of data identified for this effort.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Towards Three-Dimensional Neutron Imaging with Light-field Technology

A broad range of applications in nuclear safeguards and security can benefit from compact, fast neutron imagers with large angular acceptance. However, accurate 3D multi-vertex reconstruction in a monolithic detector remains a significant barrier to realization. Current approaches, such as the centroiding approach and the use of shadow masks, have not yet resulted in a successful demonstration in a light-starved environment. This project explored the use of cutting-edge technology—a light field camera—which inherently preserves both the spatial and directional information of incident light. Such technology can, in principle, resolve multi-vertex events and offer accurate position reconstruction in 3D with relatively simple readout electronics. Since the project's inception in May 2023, we have built an experimental setup to calibrate and characterize a commercial light-field camera (Lytro Illum). We assessed its 3D event reconstruction capability in a relatively low-light intensity environment by analyzing the cross-correlation of a series of 2D images of a characterized tunable light source taken at various distances. A sub-cm resolution, lower than typical neutron interaction separations in a compact scintillator volume, was observed with the LED light source, suggesting the promising capability of its nominal optics design to provide the adequate resolution required for a compact monolithic neutron directional detector. However, using a light-field-based readout for a neutron camera requires incorporating an ultra-low-noise light sensor, which is beyond the scope of this project. We also initiated the development of a 3D light-field-based reconstruction algorithm tailored to sparse scenes, as expected from particle interactions in a scintillator medium. Additionally, we demonstrated the capability of the algorithm to replicate the ground truth. Finally, we began the development of a neutron directional detector simulation to determine the performance criteria for light-field-based reconstruction that allows for good neutron directional reconstruction. This Feasibility Study has led to a successful follow-up project under the DNN R&D innovation portfolio starting May 2024.

42 ENGINEERING↗

Women as a force multiplier for bringing nuclear forensic capabilities to the international stage

In 2009, the U.S. Department of Energy / National Nuclear Security Administration’s (DOE/NNSA) Defense Nuclear Nonproliferation (DNN) Program initiated a new nuclear forensics outreach effort under its Confidence Building Measures Program. Little did they know that the timing could not have been better. This article focuses on the early years (2009-2015) of the NNSA’s international nuclear forensics outreach, specifically the efforts and experiences of the women who helped establish this program, building it from a fledgling bilateral effort into an enduring technical capacity provider engaging with dozens of countries and multilateral organizations. At the onset of the program, nuclear forensics was an emerging priority within the U.S. Government and receiving increased focus from international organizations through high-level diplomatic efforts such as the Nuclear Security Summit and Global Initiative to Combat Nuclear Terrorism. Additionally, working-level initiatives were gaining traction through the International Atomic Energy Agency and the Nuclear Forensics International Technical Working Group. Over the next six years, a small team comprised of a uniquely large number of women NNSA federal, contract, and national laboratory staff served as key leaders engaging with the international community to strengthen global technical nuclear forensics capacity and best practices. The program continues today under the Nuclear Smuggling Detection and Deterrence Program as Investigation Support. The experiences shared here detail a unique time period when the new technical discipline of nuclear forensics was beginning to mature and gain international traction. The authors have made every effort to remember history correctly and be as inclusive as possible. A wealth of training, guidance, and exercises documentation was developed in the 2009-2015 timeframe, much of which still serves as the foundation for today’s even more extensive program and community of dedicated technical and diplomatic practitioners.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Assessment of Machine Learning for Ultrasonic Nondestructive Evaluation of Alkali–Silica Reaction in Concrete

Alkali–silica reaction (ASR) is a type of material degradation in concrete structures that leads to concrete cracking and rebar corrosion, thereby reducing the material’s structural integrity and the overall structure’s lifetime and raising safety concerns. Ultrasonic nondestructive evaluation (NDE) has been proven to be a valuable technique for assessing concrete properties and monitoring ASR progression in concrete. However, the deployment and analysis of ultrasonic NDE and its data requires specialized expertise, often relying on the engineer’s subjective interpretation. With the surge in computational power, artificial intelligence (AI) and machine learning (ML) algorithms have become popular in automating NDE data analysis. Various industrial sectors are increasingly adopting ML algorithms for NDE data analysis with a growing emphasis on AI–assisted automation. Regulatory agencies are also preparing for this technological shift, anticipating corresponding revisions in standards. Thus, there is an urgent need to identify the capabilities and limitations of current ML technologies for the evaluation of concrete material properties and damage status. Furthermore, the effects of various factors on ML model performance must be thoroughly investigated. The study summarized herein evaluated the effectiveness of two ML models (i.e., support vector regression (SVR) and deep neural network (DNN)) in predicting concrete material damage induced by ASR based on the long-term ultrasonic monitoring data. Four distinct concrete specimens were cast with artificially induced ASR, and over a period exceeding 500 days, ultrasonic signals and expansion data were continuously collected. For the SVR model, wave velocity and 12 other wave features were extracted from the ultrasonic signals, with 6 out of 13 features selected as input for the model. Different combinations of training and testing datasets were designed to explore factors influencing prediction performance, including the range of data within training and testing sets, in addition to various signal preprocessing methodologies. These findings suggest the importance of using a training dataset with a broader data range compared with testing datasets for improved model performance alongside consistent signal preprocessing across datasets.

36 MATERIALS SCIENCE↗

WoRDMAp Outbrief: Workshop on Radiation Detection Materials [Slides]

Project Goal: Identify pathway to reliably grow and fabricate high-performance radiation detectors for use in a variety of nonproliferation applications. 1. Create 3 working groups (semiconductors, inorganic and organic scintillators) that bring together international R&D subject-matter experts (national laboratories, industry, and academia), end users, and mission stakeholders 2. Reach expert consensus views regarding current materials related technology gaps and define prioritized R&D directions required to resolve these gaps 3. Envisage the future state of next-generation radiation detection materials and quantify the benefits to nuclear security applications 4. Provide a comprehensive expert report to DNN R&D program office to serve as roadmap with recommendations for future high-impact office investment in radiation-detection materials development

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Machine Learning for Joint Quality Control

The use of lightweight material combinations has been highly demanded in manufacturing automotive structures. However, making robust dissimilar material joints of such lightweight materials is still challenging. A significant barrier to achieving high-quality and repeatable joint performance is a deficient understanding of the relationship between the welding process, joint attributes, and joint performance. In this context, welding factors refer to material, equipment, environment, and process parameters, while joint features comprise specific microstructural attributes of the weld such as nugget size, heat affected zone (HAZ) topology, intermetallic layer thickness, and sheet thickness reduction. Joint performance is quantified in terms of strength (e.g., tensile shear, coach peel, cross-tension), weld size, and hardness, among other factors. While there have been many attempts to establish this process-structure-property relationship by developing a model derived from the associated physics and first principles, the complexity of the joining processes compounded by the complex interactions with different materials in an automotive assembly line environment, has hindered the usefulness of such attempts. The complexity is further exacerbated using different stacking materials, especially comprising dissimilar material combinations. In practice, the common approach has been the laborious process of creating welds, characterizing them, and then physically testing them through experimentation. With the emergence of artificial intelligence (AI) methods, an alternative pathway to eliciting the desired process-structure-property relationship at an accelerated pace is to use a data-driven approach by employing machine-learning (ML) techniques. This approach is benefitted by the availability of large streams of data, generated through years of research and testing by original equipment manufacturers, in the form of material, process, environmental, equipment, microstructural, and bulk-scale performance information from multimodal, multiscale sensors making measurements from laboratory-scale to production-scale processes. During Phase I efforts, which ended in fiscal year (FY) 2021, the Oak Ridge National Laboratory and Pacific Northwest National Laboratory (ORNL/PNNL) team demonstrated the effectiveness of different ML/AI frameworks in modeling complex relationships between resistance spot welding (RSW) process parameters, weld attributes, and joint properties using a subset of data from General Motors (GM). In FY 2022, the project team further refined and expanded their respective ML models to analyze additional welds with new weld stack-ups and materials to enhance the ML model predictive capability. ORNL extended its unified deep neural networks (DNN) ML training and prediction framework with new data streams of process parameters, and PNNL extended its model describing RSW process parameters’ associations with weld attributes. In FY 2023, the project team completed the development of the AI/ML architecture for analyzing aluminum/steel joints manufactured by GM via RSW and transitioned into the inline welding quality monitoring task for steel/steel RSW joints provided by GM.

36 MATERIALS SCIENCE↗

Advanced Distributed Optical Fiber Sensor Systems for Pipeline Integrity Monitoring

Distributed fiber optic sensors allow the measurement of structural parameters such as static/dynamic strain, temperature, pressure, and vibrations at thousands of locations along a single fiber cable. Deep neural network (DNN) algorithms were developed for rapid data processing speed and vibration event classification.

Lalam, Nageswara↗

Machine Learning for Real-time Fusion Plasma Behavior Prediction and Manipulation (Final Report)

The goal of this project is to implement real-time analysis of 2D Beam Emission Spectroscopy (BES) data to predict and control transient and high-bandwidth events at DIII-D. In essence, we wish to bring high-bandwidth fluctuation diagnostics into the realm of real-time measurements and control. The BES ML models will necessarily be deep neural networks (DNN) with a “data flow” architecture for compatibility with high-throughput, low-latency evaluation on a field-programmable gate array (FPGA) or other emerging processor technologies. The real-time output will be fed to the plasma control system (PCS) for real-time control tasks, specifically for ELM control and avoidance and for QH-mode access and sustainment. We anticipate that the real-time analysis of fluctuation diagnostics will create new enabling technologies to predict and control transient events such as confinement mode transitions, edge-localized modes, Alfven eigenmode events, and disruptions. The proposed research is aligned with ITER research needs and DIII-D programmatic goals. For instance, the prediction and avoidance of ELM events is critical for ITER machine safety. Also, H-mode access with RMP ELM suppression in ITER is an active research area due to high separatrix density, narrow SOL width, and elevated LH transition power threshold.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Development and Evaluation of a General Drag Model for Gas-Solid Flows via Deep Learning

This project presents the development and evaluation of a general drag model for gas–solid multiphase flows using deep learning techniques. A comprehensive database of more than 4,000 experimental and numerical data points for spherical and non spherical particles was compiled, incorporating geometric features such as sphericity, aspect ratio, and orientation. Several predictive approaches—including traditional em pirical correlations, machine learning, and deep neural networks—were benchmarked, with the proposed Drag Coefficient Correlation-aided Deep Neural Network (DCC DNN) demonstrating superior accuracy. To account for particle–particle interactions, additional drag data were generated using CFD-based simulations of packed and flu idized beds, leading to the development of a retrained model capable of incorporat ing volume fraction effects. Integration of the trained model with the MFiX CFD solver was achieved using FTorch, enabling drag predictions during discrete element method (DEM) simulations. Validation against experimental data for single particles and fluidized beds confirmed the model’s improved predictive ability, particularly for non-spherical geometries. While the model performed strongly under fluidized con ditions, limitations remained in unfluidized regimes, suggesting a need for expanded datasets. Overall, this study demonstrates the feasibility of combining deep learning with physics-informed CFD to improve drag modeling for gas–solid flows, with promis ing implications for scaling multiphase simulations in industrial applications.

42 ENGINEERING↗

Crossroads of Nonproliferation and Safeguarding Technologies for Implementation in Molten Salt Reactors

Idaho National Laboratory (INL) recently conducted a workshop endorsed by the National Nuclear Security Administration (NNSA) under the auspices of the Defense Nuclear Nonproliferation R&D (DNN R&D) Office's Safeguards Portfolio. The workshop's primary objective was to foster an engaging dialogue among researchers, with a specialized emphasis on the safeguards pertaining to molten salt reactors. At INL, the installation of the state-of-the-art Molten Salt Thermophysical Examination Capability (MSTEC) is underway. This shielded argon glovebox facility, designed for both irradiated and non-irradiated actinide materials, represents the cutting edge of research infrastructure. MSTEC is poised to serve as a pivotal research platform in the realm of molten salt technology, with significant implications for safeguards applications. Participants of the workshop had the opportunity to tour the facilities, including the site where MSTEC is being installed, as well as to observe the INL's molten salt and pyroprocessing research hot cells. The event featured insightful presentations delving into molten salt chemistry and the MSTEC project. Each participating laboratory contributed to the discourse with presentations on their respective research efforts addressing safeguards in relation to molten salt reactors. The workshop culminated with a generative brainstorming session, where participants shared their thoughts on strategic integration with partner agencies, aiming to synergize efforts in advancing the field of nuclear safeguards.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Geologic Framework Modeling (GFM) Integration

To be presented at the 2021 NEM. The March 15-19, 2021 virtual Nuclear Explosion Monitoring (NEM) Program Review combines reviews of several related programs within the Office of Defense Nuclear Nonproliferation Research and Development (DNN R&D) of the National Nuclear Security Administration.

58 GEOSCIENCES↗