Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “DNN”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Deep Learning Accelerated History Matching and Forecasting in Geologic CO 2 Sequestration [Slides]

We have successfully developed a predictive workflow for the Geologic CO 2 Sequestration using a deep learning model based on the Fourier Neural Operator. The workflow has high accuracy for predicting pressure & saturation during the injection and post-injection periods and has decent accuracy for predicting water and CO 2 production rates during injection period. It is necessary to train exclusive DNN models for pressure prediction in long term GCS, but for saturation prediction, we can use a single model to predict it.

58 GEOSCIENCES↗
DOE OSTI2023

Digital Signal Processing Using Deep Neural Networks

Currently there is great interest in the utility of deep neural networks (DNNs) for the physical layer of radio frequency (RF) communications. In this manuscript we describe a custom DNN specially designed to solve problems in the RF domain. Our model leverages the mechanisms of feature extraction and attention through the combination of an autoencoder convolutional network with a transformer network, to accomplish several important communications network and digital signals processing (DSP) tasks. We also present a new open dataset and physical data augmentation model that enables training of DNNs that can perform automatic modulation classification, infer, and correct transmission channel effects, and directly demodulate baseband RF signals.

42 ENGINEERING↗
DOE OSTI2023

NCERC Provides Unique Opportunities for University Student Researchers

Five students and one faculty member - sponsored by the Defense Nuclear Nonproliferation (DNN, NA 22) university consortia - visited the National Criticality Experiments Research Center (NCERC) in July of 2023 to measure radiation signatures from Category I Special Nuclear Material (SNM) in a week-long measurement campaign organized by staff at Los Alamos National Laboratory. Participants included University of Florida, University of Michigan, and University of Illinois-Champaign Urbana. The measurement campaign was organized on behalf of the Consortium for Monitoring, Testing, and Verification (MTV), the Nuclear Science and Security Consortium (NSSC), and the Consortium for Enabling Technologies and Innovation (ETI).

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

Report on Next-Gen AI for Proliferation Detection Workshop: Domain-Aware Methods

The emergence of artificial intelligence (AI) and machine learning (ML) in the modern world has impacted nearly every application imaginable. This includes nuclear proliferation detection, which offers the potential to improve existing capabilities as well as create new ones. Proliferation detection seeks to detect and characterize attempts by state and non-state actors to acquire nuclear weapons or associated technology, materials, or knowledge. Such a mission is vitally important for global stability and security but is notoriously difficult. By leveraging advances in AI, exciting opportunities exist to enhance the proliferation detection regime. The Data Science and AI portfolio within the National Nuclear Security Administration’s Office of Defense Nuclear Nonproliferation Research and Development (DNN R&D) seeks to leverage the capabilities of the Department of Energy’s (DOE’s) national laboratories and other partners to develop AI systems that can accomplish otherwise impossible tasks in support of proliferation detection. As part of its efforts, the portfolio has created a series of workshops on Next-Gen AI for Proliferation Detection to help define the requirements for suitable AI systems, share successful research and best practices, and foster connection and understanding between the relevant parties including researchers and end-users. Each workshop in the series focuses on a specific and critical aspect of AI to enable it to accomplish proliferation detection objectives. The first workshop focused on explainability techniques; the second workshop and the topic of this report, covers methods for incorporating domain awareness into AI. The Next-Gen AI for Proliferation Detection Workshop: Domain-Aware Methods took place virtually over two days in February 2021 and included four keynote presentations, 22 technical presentations, and a concluding panel. The presentations, discussions, and workshop findings are summarized in this report.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Multi-phenomenology Yield Characterization

This report serves as the first delivery of a four-year applied science effort to transform and advance the error bounds for the yield estimate of an explosion. Each year’s delivery will be in this form, culminating in the submission of this work for peer review to a scientific journal. Importantly, the yearly progress reports can then also be viewed as expanding drafts working towards a formal journal article submission. For the first tranche of funding, we collaborated with Air Force Technical Applications Center (AFTAC) scientists to identify unclassified real-world data that demonstrate and validate our advanced error propagation methods. Collaboration includes visits to AFTAC and telecons. For this development, we illustrate the fusion of seismic, acoustic, optical, and surface effect signatures from an explosion. The mathematics and code being adapted to this specific application (Williams et al., 2021) involves physics models of multiple sensor signatures. We have also identified related physics models and have integrated them into code. Current methods of underground explosion yield estimation for the Threshold Test Ban Treaty (TTBT) have served the US treaty monitoring mission well for decades. A research objective of the Defense Nuclear Nonproliferation Research and Development (DNN R&D) office of the National Nuclear Security Administration (NNSA) has always been to provide new technical capabilities for monitoring lower thresholds. The general model and error propagation code to be developed in this project is based on significant advances in error modeling and propagation needed to analyze data at lower detection thresholds. The second tranche of funding for this project began on May 1, 2022, and planned work for the second tranche includes: i) completing the integration of physical model code into the general error model framework; this code accommodates a wide range of linear/nonlinear source models, fixed/ random effects, and frequentist/Bayesian analyses (the purpose of which is not to dictate to users how to analyze data, but instead to allow users the maximum flexibility in their work); ii) illustrative application of code to identified data, and; iii) initial planning with AFTAC researchers on delivery of code to the Common Development Environment at AFTAC, and continued writing of the planned final journal article submission (year two of this progress report), with particular emphasis on descriptions of data identified for this effort.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2023

Towards Three-Dimensional Neutron Imaging with Light-field Technology

A broad range of applications in nuclear safeguards and security can benefit from compact, fast neutron imagers with large angular acceptance. However, accurate 3D multi-vertex reconstruction in a monolithic detector remains a significant barrier to realization. Current approaches, such as the centroiding approach and the use of shadow masks, have not yet resulted in a successful demonstration in a light-starved environment. This project explored the use of cutting-edge technology—a light field camera—which inherently preserves both the spatial and directional information of incident light. Such technology can, in principle, resolve multi-vertex events and offer accurate position reconstruction in 3D with relatively simple readout electronics. Since the project's inception in May 2023, we have built an experimental setup to calibrate and characterize a commercial light-field camera (Lytro Illum). We assessed its 3D event reconstruction capability in a relatively low-light intensity environment by analyzing the cross-correlation of a series of 2D images of a characterized tunable light source taken at various distances. A sub-cm resolution, lower than typical neutron interaction separations in a compact scintillator volume, was observed with the LED light source, suggesting the promising capability of its nominal optics design to provide the adequate resolution required for a compact monolithic neutron directional detector. However, using a light-field-based readout for a neutron camera requires incorporating an ultra-low-noise light sensor, which is beyond the scope of this project. We also initiated the development of a 3D light-field-based reconstruction algorithm tailored to sparse scenes, as expected from particle interactions in a scintillator medium. Additionally, we demonstrated the capability of the algorithm to replicate the ground truth. Finally, we began the development of a neutron directional detector simulation to determine the performance criteria for light-field-based reconstruction that allows for good neutron directional reconstruction. This Feasibility Study has led to a successful follow-up project under the DNN R&D innovation portfolio starting May 2024.

42 ENGINEERING↗
DOE OSTI2024

Women as a force multiplier for bringing nuclear forensic capabilities to the international stage

In 2009, the U.S. Department of Energy / National Nuclear Security Administration’s (DOE/NNSA) Defense Nuclear Nonproliferation (DNN) Program initiated a new nuclear forensics outreach effort under its Confidence Building Measures Program. Little did they know that the timing could not have been better. This article focuses on the early years (2009-2015) of the NNSA’s international nuclear forensics outreach, specifically the efforts and experiences of the women who helped establish this program, building it from a fledgling bilateral effort into an enduring technical capacity provider engaging with dozens of countries and multilateral organizations. At the onset of the program, nuclear forensics was an emerging priority within the U.S. Government and receiving increased focus from international organizations through high-level diplomatic efforts such as the Nuclear Security Summit and Global Initiative to Combat Nuclear Terrorism. Additionally, working-level initiatives were gaining traction through the International Atomic Energy Agency and the Nuclear Forensics International Technical Working Group. Over the next six years, a small team comprised of a uniquely large number of women NNSA federal, contract, and national laboratory staff served as key leaders engaging with the international community to strengthen global technical nuclear forensics capacity and best practices. The program continues today under the Nuclear Smuggling Detection and Deterrence Program as Investigation Support. The experiences shared here detail a unique time period when the new technical discipline of nuclear forensics was beginning to mature and gain international traction. The authors have made every effort to remember history correctly and be as inclusive as possible. A wealth of training, guidance, and exercises documentation was developed in the 2009-2015 timeframe, much of which still serves as the foundation for today’s even more extensive program and community of dedicated technical and diplomatic practitioners.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2024

Assessment of Machine Learning for Ultrasonic Nondestructive Evaluation of Alkali–Silica Reaction in Concrete

Alkali–silica reaction (ASR) is a type of material degradation in concrete structures that leads to concrete cracking and rebar corrosion, thereby reducing the material’s structural integrity and the overall structure’s lifetime and raising safety concerns. Ultrasonic nondestructive evaluation (NDE) has been proven to be a valuable technique for assessing concrete properties and monitoring ASR progression in concrete. However, the deployment and analysis of ultrasonic NDE and its data requires specialized expertise, often relying on the engineer’s subjective interpretation. With the surge in computational power, artificial intelligence (AI) and machine learning (ML) algorithms have become popular in automating NDE data analysis. Various industrial sectors are increasingly adopting ML algorithms for NDE data analysis with a growing emphasis on AI–assisted automation. Regulatory agencies are also preparing for this technological shift, anticipating corresponding revisions in standards. Thus, there is an urgent need to identify the capabilities and limitations of current ML technologies for the evaluation of concrete material properties and damage status. Furthermore, the effects of various factors on ML model performance must be thoroughly investigated. The study summarized herein evaluated the effectiveness of two ML models (i.e., support vector regression (SVR) and deep neural network (DNN)) in predicting concrete material damage induced by ASR based on the long-term ultrasonic monitoring data. Four distinct concrete specimens were cast with artificially induced ASR, and over a period exceeding 500 days, ultrasonic signals and expansion data were continuously collected. For the SVR model, wave velocity and 12 other wave features were extracted from the ultrasonic signals, with 6 out of 13 features selected as input for the model. Different combinations of training and testing datasets were designed to explore factors influencing prediction performance, including the range of data within training and testing sets, in addition to various signal preprocessing methodologies. These findings suggest the importance of using a training dataset with a broader data range compared with testing datasets for improved model performance alongside consistent signal preprocessing across datasets.

36 MATERIALS SCIENCE↗
DOE OSTI2024

WoRDMAp Outbrief: Workshop on Radiation Detection Materials [Slides]

Project Goal: Identify pathway to reliably grow and fabricate high-performance radiation detectors for use in a variety of nonproliferation applications. 1. Create 3 working groups (semiconductors, inorganic and organic scintillators) that bring together international R&D subject-matter experts (national laboratories, industry, and academia), end users, and mission stakeholders 2. Reach expert consensus views regarding current materials related technology gaps and define prioritized R&D directions required to resolve these gaps 3. Envisage the future state of next-generation radiation detection materials and quantify the benefits to nuclear security applications 4. Provide a comprehensive expert report to DNN R&D program office to serve as roadmap with recommendations for future high-impact office investment in radiation-detection materials development

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

Machine Learning for Joint Quality Control

The use of lightweight material combinations has been highly demanded in manufacturing automotive structures. However, making robust dissimilar material joints of such lightweight materials is still challenging. A significant barrier to achieving high-quality and repeatable joint performance is a deficient understanding of the relationship between the welding process, joint attributes, and joint performance. In this context, welding factors refer to material, equipment, environment, and process parameters, while joint features comprise specific microstructural attributes of the weld such as nugget size, heat affected zone (HAZ) topology, intermetallic layer thickness, and sheet thickness reduction. Joint performance is quantified in terms of strength (e.g., tensile shear, coach peel, cross-tension), weld size, and hardness, among other factors. While there have been many attempts to establish this process-structure-property relationship by developing a model derived from the associated physics and first principles, the complexity of the joining processes compounded by the complex interactions with different materials in an automotive assembly line environment, has hindered the usefulness of such attempts. The complexity is further exacerbated using different stacking materials, especially comprising dissimilar material combinations. In practice, the common approach has been the laborious process of creating welds, characterizing them, and then physically testing them through experimentation. With the emergence of artificial intelligence (AI) methods, an alternative pathway to eliciting the desired process-structure-property relationship at an accelerated pace is to use a data-driven approach by employing machine-learning (ML) techniques. This approach is benefitted by the availability of large streams of data, generated through years of research and testing by original equipment manufacturers, in the form of material, process, environmental, equipment, microstructural, and bulk-scale performance information from multimodal, multiscale sensors making measurements from laboratory-scale to production-scale processes. During Phase I efforts, which ended in fiscal year (FY) 2021, the Oak Ridge National Laboratory and Pacific Northwest National Laboratory (ORNL/PNNL) team demonstrated the effectiveness of different ML/AI frameworks in modeling complex relationships between resistance spot welding (RSW) process parameters, weld attributes, and joint properties using a subset of data from General Motors (GM). In FY 2022, the project team further refined and expanded their respective ML models to analyze additional welds with new weld stack-ups and materials to enhance the ML model predictive capability. ORNL extended its unified deep neural networks (DNN) ML training and prediction framework with new data streams of process parameters, and PNNL extended its model describing RSW process parameters’ associations with weld attributes. In FY 2023, the project team completed the development of the AI/ML architecture for analyzing aluminum/steel joints manufactured by GM via RSW and transitioned into the inline welding quality monitoring task for steel/steel RSW joints provided by GM.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Advanced Distributed Optical Fiber Sensor Systems for Pipeline Integrity Monitoring

Distributed fiber optic sensors allow the measurement of structural parameters such as static/dynamic strain, temperature, pressure, and vibrations at thousands of locations along a single fiber cable. Deep neural network (DNN) algorithms were developed for rapid data processing speed and vibration event classification.

Lalam, Nageswara↗
DOE OSTI2025

Machine Learning for Real-time Fusion Plasma Behavior Prediction and Manipulation (Final Report)

The goal of this project is to implement real-time analysis of 2D Beam Emission Spectroscopy (BES) data to predict and control transient and high-bandwidth events at DIII-D. In essence, we wish to bring high-bandwidth fluctuation diagnostics into the realm of real-time measurements and control. The BES ML models will necessarily be deep neural networks (DNN) with a “data flow” architecture for compatibility with high-throughput, low-latency evaluation on a field-programmable gate array (FPGA) or other emerging processor technologies. The real-time output will be fed to the plasma control system (PCS) for real-time control tasks, specifically for ELM control and avoidance and for QH-mode access and sustainment. We anticipate that the real-time analysis of fluctuation diagnostics will create new enabling technologies to predict and control transient events such as confinement mode transitions, edge-localized modes, Alfven eigenmode events, and disruptions. The proposed research is aligned with ITER research needs and DIII-D programmatic goals. For instance, the prediction and avoidance of ELM events is critical for ITER machine safety. Also, H-mode access with RMP ELM suppression in ITER is an active research area due to high separatrix density, narrow SOL width, and elevated LH transition power threshold.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Development and Evaluation of a General Drag Model for Gas-Solid Flows via Deep Learning

This project presents the development and evaluation of a general drag model for gas–solid multiphase flows using deep learning techniques. A comprehensive database of more than 4,000 experimental and numerical data points for spherical and non spherical particles was compiled, incorporating geometric features such as sphericity, aspect ratio, and orientation. Several predictive approaches—including traditional em pirical correlations, machine learning, and deep neural networks—were benchmarked, with the proposed Drag Coefficient Correlation-aided Deep Neural Network (DCC DNN) demonstrating superior accuracy. To account for particle–particle interactions, additional drag data were generated using CFD-based simulations of packed and flu idized beds, leading to the development of a retrained model capable of incorporat ing volume fraction effects. Integration of the trained model with the MFiX CFD solver was achieved using FTorch, enabling drag predictions during discrete element method (DEM) simulations. Validation against experimental data for single particles and fluidized beds confirmed the model’s improved predictive ability, particularly for non-spherical geometries. While the model performed strongly under fluidized con ditions, limitations remained in unfluidized regimes, suggesting a need for expanded datasets. Overall, this study demonstrates the feasibility of combining deep learning with physics-informed CFD to improve drag modeling for gas–solid flows, with promis ing implications for scaling multiphase simulations in industrial applications.

42 ENGINEERING↗
DOE OSTI2024

Crossroads of Nonproliferation and Safeguarding Technologies for Implementation in Molten Salt Reactors

Idaho National Laboratory (INL) recently conducted a workshop endorsed by the National Nuclear Security Administration (NNSA) under the auspices of the Defense Nuclear Nonproliferation R&D (DNN R&D) Office's Safeguards Portfolio. The workshop's primary objective was to foster an engaging dialogue among researchers, with a specialized emphasis on the safeguards pertaining to molten salt reactors. At INL, the installation of the state-of-the-art Molten Salt Thermophysical Examination Capability (MSTEC) is underway. This shielded argon glovebox facility, designed for both irradiated and non-irradiated actinide materials, represents the cutting edge of research infrastructure. MSTEC is poised to serve as a pivotal research platform in the realm of molten salt technology, with significant implications for safeguards applications. Participants of the workshop had the opportunity to tour the facilities, including the site where MSTEC is being installed, as well as to observe the INL's molten salt and pyroprocessing research hot cells. The event featured insightful presentations delving into molten salt chemistry and the MSTEC project. Each participating laboratory contributed to the discourse with presentations on their respective research efforts addressing safeguards in relation to molten salt reactors. The workshop culminated with a generative brainstorming session, where participants shared their thoughts on strategic integration with partner agencies, aiming to synergize efforts in advancing the field of nuclear safeguards.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
NASA NTRS2018

Augmented Reality Data Generation for Training Deep Learning Neural Network

One of the major challenges in deep learning is retrieving sufficiently large labeled training datasets, which can become expensive and time consuming to collect. A unique approach to training segmentation is to use Deep Neural Network (DNN) models with a minimal amount of initial labeled training samples. The procedure involves creating synthetic data and using image registration to calculate affine transformations to apply to the synthetic data. The method takes a small dataset and generates a highquality augmented reality synthetic dataset with strong variance while maintaining consistency with real cases. Results illustrate segmentation improvements in various target features and increased average target confidence.

Torres, Gil↗
NASA NTRSDate not supplied

Toward Design Assurance of Machine-Learning Airborne Systems

In recent years, Artificial Intelligence (AI) systems, enabled by Machine Learning (ML)technology, have demonstrated impressive progress and provides historic opportunities for the aviation industry. However, several key aspects of ML technology are not compatible with existing design assurance standards and make certification problematic. In this paper, we present a case study of a visual system with a Deep Neural Network (DNN) intended to detect and identify airport runway signs. Different use cases and variants of this system exhibit different levels of criticality ranging from design assurance level (DAL) D to B. We use the case study to illustrate the challenges of certification according to the current standards, such asDO-178C. We present the system design, data generation, training, and verification in detail and describe how the design assurance objectives can be met for a DAL D variant of the system. We also discuss gaps and potential approaches for the higher design assurance levels.

Avionics↗
NASA NTRSDate not supplied

Machine-Learning for Safety Critical Airborne Applications Part II: Case Study

The exceptional progress in the field of Artificial Intelligence (AI) systems, enabled by Machine Learning (ML) technology in recent years provides historic opportunities for the aviation industry. Current certification standards for avionics were developed prior to the ML renaissance and have several fundamental incompatibilities with the ML technology. WG-114 is working hard to release a new standard as soon as possible but for now there is no recognized means of compliance for ML based systems even of low criticality. In this talk, we present the custom ML workflow that can be used comply with all objectives of the current certification standards for a low-criticality (DAL D and C) ML-based system. To illustrate the practical application of the custom ML workflow we present a case study of a system based on a Deep Neural Network (DNN) intended to detect and identify airport runway signs. We present the system design, data generation, training, and verification in detail and describe how the design assurance objectives can be met for a DAL D and DAL C systems.

Johann Schumann↗
NASA NTRS2021

Dynamic fire and smoke detection and classification for flashover prediction

Flashover is a dangerous phenomenon caused by near-simultaneous ignition of exposed materials. It is one of the major causes of firefighter fatalities. Research has been done using CMOS vision cameras combined with thermal sensors to perform remote detection and dynamic classification of fire and smoke patterns. Tests and experiments have been done to detect fire and smoke remotely. The inexpensive visible and infrared sensors used in the tests corroborate and closely follow the detailed trends recorded by the more expensive (and less mobile) radiometers and thermocouples. Deep neural networks (DNN) have been used to detect, classify and track fire and smoke areas. Real-time segmentation is utilized to measure the fire and smoke boundaries. The segmentations are used to dynamically monitor fluctuations in temperature, fire size and smoke progression in the monitored areas. A fire and smoke progression curve has been drawn to predict the flashover point. In the paper, data analysis and preliminary results will be shown. Keywords: Flashover, fire, smoke, deep learning, visible and infrared vision

Chow, Edward↗