Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “supervised”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38

Development of Hopfield Artificial Neural Network for Anomaly Detection in Environmental Gamma Radiation Background: Consortium on Nuclear Security Technologies (CONNECT) (Q2 Report)

Environmental screening of gamma radiation consists of detecting weak nuisance and anomaly signal in the presence of strong and highly varying background. In a typical scenario, a mobile detector-spectrometer continuously measures gamma radiation spectra in short, e.g., one-second, signal acquisition intervals. The measurement data is a 2D matrix, where one dimension is gamma ray energy, and the other dimension is the number of measurements or total time. In principle, gamma radiation sources can be detected and identified from the measured data by their unique spectral lines. Detecting sources from data measured in a search scenario is difficult due to the highly varying background because of naturally occurring radioactive material (NORM), and low signal-to-noise ratio (S/N) of spectral signal measured during one-second acquisition intervals. The objective of this work is to explore supervised machine learning (ML) algorithms for development of a Hopfield Neural Network (HNN) in conjunction with an image processing algorithm for detection and identification of weak nuisances and anomalies events in the presence of a highly fluctuating background.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Sorption of Iodine Species on SRS Wetland Soils

This research work has been supported by the DOE-FIU Science & Technology Workforce Development Initiative, an innovative program developed by the U.S. Department of Energy’s Office of Environmental Management (DOE-EM) and Florida International University’s Applied Research Center (FIU-ARC). During the summer of 2021, a DOE Fellow intern, Phuong Pham, spent 10 weeks doing a summer internship at Savannah River National Laboratory under the supervision and guidance of Hansell Gonzalez-Raymat. The intern’s project was initiated on May 24, 2021, and continued through July 30, 2021, with the objective of gaining a better understanding of the dominant attenuation mechanisms for 129 I in the wetlands, the strength of the attenuation, and what conditions would influence it.

54 ENVIRONMENTAL SCIENCES↗

2021 LLNL Nuclear Science and Security Summer Internship Program

The Lawrence Livermore National Laboratory (LLNL) Nuclear Science and Security Summer Internship Program (NS 3 IP) is designed to give graduate students an opportunity to come to LLNL for 8–10 weeks of hands-on research. Students conduct research under the supervision of a staff scientist, attend a weekly lecture series, interact with other students, and present their work in poster format at the end of the program. Students also have the opportunity to meet staff scientists one-on-one, participate in LLNL facility tours (e.g., the National Ignition Facility and Center for Accelerator Mass Spectrometry), and gain a better understanding of the various science programs at LLNL. Due to the travel and access restrictions imposed by the COVID-19 pandemic, the 2021 NS 3 IP was organized as an “all-virtual” internship program. With LLNL’s extensive institutional support, students accessed the laboratory’s cyberinfrastructure through a secure virtual desktop environment and all seminars, mentor interactions, summer presentations, and laboratory tours were performed remotely. While this virtual internship format did not allow for hands-on laboratory research projects, both the interns and their mentors constructed creative research projects that maximized student exposure to nuclear science research that is relevant to DTRA and LLNL interests in nuclear security. We anticipate a return to an in-person internship format for the summer of 2022.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Characterization of Surface Water Dynamics within Fourmile Branch and its Linkages with Groundwater and I-129 Geochemistry

This research work has been supported by the DOE-FIU Science & Technology Workforce Development Initiative, an innovative program developed by the U.S. Department of Energy’s Environmental Management (DOE-EM) and Florida International University’s Applied Research Center (FIU-ARC). During the summer of 2021, DOE Fellow intern, Stevens Charles, spent 10 weeks doing a summer internship at Lawrence Berkley National Laboratory (LBNL) under the supervision and guidance of Dr. Haruko Wainwright from LBNL and Dr. Hansell GonzalezRaymat from Savannah River National Laboratory (SRNL). The intern’s project was initiated on June 1, 2020, and continued through August 6, 2020, with the objective of characterizing the surface water dynamics in the F-Area of Savannah River Site (SRS) and analyzing the surface water dynamics to find any linkages with groundwater and Iodine-129(I-129) geochemistry.

54 ENVIRONMENTAL SCIENCES↗

FY21 Progress Report: SRNL Analysis of ICCWR LCM and WAMS data for Corrosion and Cracking

The development of algorithms for machine learning and data analysis for the 3013 Surveillance Program is a collaborative effort by the Savannah River National Laboratory (SRNL) and the University of South Carolina (USC). For corrosion detection, Laser Confocal Microscope (LCM) or Wide Area 3D Measurement System (WAMS) data is extracted from large binary files, with software written to convert the data to physical attributes (e.g., height, color and grayscale values; all as functions of a location in a plane projection). A user-friendly Matlab Graphical User Interface (GUI) that reads data from either LCM or WAMS files was developed to integrate input data with software developed for processing and evaluation. The GUI can selectively download binary data, interrogate data attributes, label data, flag significant features, execute Machine Learning (ML) algorithms, output parameters for trained ML algorithms, report ML model accuracy with respect to labeled data, and generate graphical representations for various analyses. Features can be called out by user-specified thresholds, manual labeling or machine learning algorithms when they have been completed. The ability to rapidly label data is important because of the volume of data required for training machine learning algorithms. The GUI has the flexibility to allow addition of improved ML algorithms, methods for data visualization, and statistical computations. Statistical analyses via the GUI include areas of pits within a defined range of pit depths, correlations between Red-Green-Blue (RGB) or grayscale intensity and relative surface height, covariances between values associated with features, and feature histograms. The development of supervised machine learning algorithms, however, has been hindered by a lack of training data. The machine learning algorithms for crack identification are being refined but require improvements to the true positive rate for crack detection. This shortcoming is an artifact of the limited training data currently available, perhaps more so than the structure of the neural networks. At present, the best results are had from a consensus over an ensemble of randomly generated Deep Neural Network (DNN) or Convolutional Neural Network (CNN) algorithms. Although the consensus accuracy method has yielded optimum true positive and true negative rates in excess of 80%, additional validation testing is necessary. In addition to the suite of LCM data that was initially used, and which represents the majority of the work presented in this report, WAMS image data was also reviewed at a preliminary level. The review included a comparison between image resolution and dynamic range for each method. WAMS (ZON file) image data was found to have a pixel pitch of 3.69μm compared to 1 μm for the LCM (vk4 file) data, which implies a lower resolution for the WAMS images. Conversely, the ratio of dynamic range of the WAMS data to the LCM data was approximately 41:20 for height data, suggesting that information from WAMS should more accurately determine the depth of pits. At present, the significance of the greater dynamic range of the WAMS data relative to the LCM data has not yet been evaluated.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Exploring Advanced Computational Tools and Techniques with Artificial Intelligence and Machine Learning in Operating Nuclear Plants

This report presents the project Idaho National Laboratory conducted for Nuclear Regulatory Commission to explore the advanced computational tools and techniques, such as artificial intelligence (AI) and machine learning (ML), for operating nuclear plants. The report reviews the nuclear data sources, with the focus on the operating experience data, that could be applied by advanced computational tools and techniques. Plant-specific and generic (national and international) data from different sources are described. The report describes the relationships between statistics and AI/ML and then introduces the most widely used AI/ML algorithms in both supervised and unsupervised learning. The report reviews the recent applications of advanced computational tools and techniques in various fields of nuclear industry, such as reactor system design and analysis, plant operation and maintenance, and nuclear safety and risk analysis. Finally, the report presents the insights from the project on the potential applicability of AI/ML techniques in improving advanced computational capabilities, how the advanced tools and techniques could contribute to the understanding of safety and risk, and what information would be needed to provide meaningful insights to decision makers. The report also documents an NRC survey on the current state of commercial nuclear power operations relative to the use of AI and ML tools as well as the role of AI/ML tools in nuclear power operations was published by the NRC as in FRN NRC-2021-0048 in April 2021. A summary of the survey including the survey questions, survey participants, survey responses, and the conclusions and insights derived from the survey is provided in the report. Finally, the report investigates potential applications of using AI/ML in operating NPPs and advanced reactors (both advanced LWRs and advanced NLWRs) to improve nuclear plant safety and efficiency. Three main application fields are defined and discussed: (1) plant safety and security assessments; (2) plant degradation modeling, fault and accident diagnosis and prognosis; and (3) plant operation and maintenance efficiency improvement.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Seascape Interface Control Document

This paper serves as the Interface Control Document (ICD) for the Seascape automated test harness developed at Sandia National Laboratories. The primary purposes of the Seascape system are: (1) provide a place for accruing large, curated, labeled data sets useful for developing and evaluating detection and classification algorithms (including, but not limited to, supervised machine learning applications) (2) provide an automated structure for specifying, running and generating reports on algorithm performance. Seascape uses GitLab, Nexus, Solr, and Banana, open source software, together with code written in the Python language, to automatically provision and configure computational nodes, queue up jobs to accomplish algorithms test runs against the stored data sets, gather the results and generate reports which are then stored in the Nexus artifact server.

97 MATHEMATICS AND COMPUTING↗

Evaluating the Impact of Proprietary Oil & Gas Data on Machine Learning Model Performance Using a Quasi-Experimental Analytical Approach

This study implements a data-intensive supervised ML approach through a quasi-experimental framework with the objective of quantifying the impact of oil and gas operator-specific proprietary data on ML-based predictive model performance relative to using oil and gas datasets that may be more commonly publicly available. The models are designed to jointly predict daily oil, gas, and water production for horizontal wells as a function of bottom-hole pressure drawdown, spatial placement across the study domain, and well completion attributes. Model performance is quantified on holdout test data to evaluate how each dataset affects resulting model variant performance.

02 PETROLEUM↗

A Strategy for NACS investment in Machine Learning

The Nuclear and Chemical Sciences (NACS) Division furnishes the expertise in the scientific areas of chemical, nuclear and isotopic sciences that are foundational in the Laboratory’s national security missions. This expertise is maintained and advanced through identification, development and application of state-of-the-art theoretical, computational and experimental methods and tools. Recent developments in artificial intelligence and machine learning (AI/ML) techniques enabled by advances in computing capabilities and widespread availability of powerful software implementations have made use of these techniques ubiquitous across both science and industry. While the scope of AI/ML applications is incredibly large and evolves very rapidly, the topics most relevant to NACS missions fall into the general category of detecting, categorizing or identifying features in large, complex datasets using either supervised or unsupervised learning. This covers both basic scientific data analysis and the development of efficient surrogate models of real-life technological systems, experimental detectors, or theoretical models. To remain at the forefront of its core scientific disciplines, NACS must both cultivate ML expertise as well as continuously explore applying this expertise to new problems or utilizing new methods. This document identifies the key areas where this support is critical and provides a strategy for investing in them.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

Report on PTT Imaging of Defects in AM Metallic Materials-Part 2

Metal Additive Manufacturing (AM) is a promising method for cost-efficient fabrication of complex shape structures for applications in harsh environment, such as in a nuclear reactor. However, internal defects (pores) occur in high-strength AM alloys, which are manufactured with Laser Powder Bed Fusion (LPBF) AM method. Pulsed Infrared Thermography (PIT) is an efficient nondestructive evaluation (NDE) method to examine actual structures, because this method offers one-sided non-contact measurements, and fast processing of large sample areas. However, imaging of material defects, particularly defects with sizes at microscopic level, is challenging. In this report, we benchmark the performance of several Unsupervised Learning (UL) algorithms designed to enhance imaging of microscopic defects in metals with PIT. UL aims to learn the latent principal patterns (dictionaries) in PIT data to detect defects with minimal human supervision. Performance of Independent Component Analysis (ICA), Sparse Coding (SC), Principal Component Analysis (PCA) and Exploratory Factor Analysis (EFA) was compared using F-score, UL model training time and defects reconstruction time. We obtained the average F-score of 0.75, and a highest F-score of 0.89 for the EFA algorithm. Overall, EFA outperforms other UL algorithms considered in this study.

36 MATERIALS SCIENCE↗

Amendment to Programmatic Agreement among the U.S. Department of Energy, National Nuclear Security Administration, Los Alamos Field Office, the New Mexico State Historic Preservation Office and the Advisory Council on History Preservation Concerning Management of the Historic Properties of Los Alamos National Laboratory, Los Alamos, New Mexico (AGREEMENT)

The Field Office has a cultural resources program manager. The LANL Management and Operating Contractor has a staff of cultural resource specialists who meet the qualifications set forth in the Secretary of the Interior's Standards and Guidelines for Professional Qualifications (36 CFR Part 61), or work under the supervision of individuals who meet these qualifications. Any future Management and Operating Contractor will have a staff of Secretary of the Interior-qualified cultural resource specialists.

99 GENERAL AND MISCELLANEOUS↗

Automation of the Receipt Inspection of Criticality Control Overpacks (CCO)

This research work has been supported by the DOE-FIU Science & Technology Workforce Development Initiative, an innovative program developed by the U.S. Department of Energy’s Office of Environmental Management (DOE-EM) and Florida International University’s Applied Research Center (FIU-ARC). During the spring of 2022, a DOE Fellow intern, Philip Moore, spent 16 weeks doing a spring internship at Savannah River National Lab under the supervision and guidance of Corey Hopper. The intern’s project was initiated on January 24, 2022, and continued through April 2, 2022, with the objective of contributing to a robotic system for automation of CCO inspection.

47 OTHER INSTRUMENTATION↗

Big Data Synchrophasor Monitoring and Analytics for Resiliency Tracking (BDSMART)

This report contains key findings from a project titled Big Data Synchrophasor Monitoring and Analytics for Resiliency Tracking (BDSMART), which was carried out through a collaborative effort of a team of researchers from Texas A&M Engineering Experiment Station, Temple University, and Quanta Technology, LLC. The in-kind support came from OSIsoft (acquired by AVEVA), which provided their PI Historian software to demonstrate the use case of streaming PMU data. The first section of the report describes the project goals and objectives related to the development of Machine Learning (ML) models capable of detecting and classifying events by processing phasor measurements captured in the field by Phasor Measurement Units (PMUs). The data for this study was contributed by the utilities/ISOs from the Western and Eastern interconnects and ERCOT, further referred to as Interconnect B (IC B), Interconnect A (IC A), and Interconnect C (IC C), respectively. The approach that the BDSMART Research Team proposed and the key research tasks defined by the team are outlined in this section. The next section describes the technical approach. We first discuss the data constraints related to the PMU measurements and data interpretation constraints imposed by the data contributors. They provided neither the topological information of the grid nor PMU placement locations and captured recorded data at very few locations in the system with the reporting rate of either 30 or 60 fps. The recordings are mostly positive sequence voltage, frequency, and ROCOF, and in some limited cases, three-phase voltages and currents. We then reflect on the bad data issues that stem from poor recording practices and vague definitions of the PMU status bits to supposedly be used for bad data identification. Finally, the data discovery points to imprecise time stamps with incomplete event start/end time, as well as inconsistent and incomplete event labeling, which combined make the implementation of the data models using supervising learning quite challenging. Following the data discovery study, we hypothesize that because the IC B data has the most complete labels, we should focus our model development on that data and then test it on data from other interconnects. We also define the common metrics used to evaluate the results from the ML algorithm tests. We concluded this section by summarizing the common ML models we used and explaining how we implemented and tested them. The issues from this section are expanded in the Training Dataset Report from this project. The final section of this report deals with the accomplishments and conclusions. As the accomplishments, we formulate the problem we are solving and what is achieved by solving the problem. We then reflect on each of the analytics tools we developed and point out the performance of each tool when applied to solving the mentioned problems. We reference this work for further details to the papers we published on each tool. In the conclusions, we give recommendations on how to improve future PMU recording practices to facilitate the ML algorithm implementation and guidance for the future standardization work aimed at clarifying the ambiguities associated with the PMU status bits. We finally list future tasks that can bring about further improvements in the proposed algorithms. The issues from this section are expanded in the Training, and Test Dataset Report filed at the project completion date.

97 MATHEMATICS AND COMPUTING↗

Active Learning for Language Modeling

Foreign disinformation campaigns undermine national security. Various supervised language modeling techniques in NLP can help to understand and dismantle these campaigns, but they rely heavily on large, labeled (often by humans) datasets. This work provides a solution to this problem in the form of an active learning (AL) framework, which is used to generate labeled datasets and leverage human input for detecting disinformation. The developed AL framework utilizes task adaptive pretraining to fully leverage the unlabeled data and boost the performance of the classifier used for labeling. A disinformation rhetoric metric was developed to measure the presence of common rhetorical techniques used in text that are meant to deceive, for both the classifier and human to use in the task of identifying disinformation. This metric was combined with an uncertainty criterion to create a hybrid acquisition method for AL, and this hybrid method was tested alongside other acquisition functions. A sophisticated and robust stopping strategy was developed to signal the AL process should terminate, saving human time from being wasted on iterations that would not significantly benefit classifier performance.

99 GENERAL AND MISCELLANEOUS↗

Computational Analysis of Coupled Geoscience Processes in Fractured and Deformable Media

Prediction of flow, transport, and deformation in fractured and porous media is critical to improving our scientific understanding of coupled thermal-hydrological-mechanical processes related to subsurface energy storage and recovery, nonproliferation, and nuclear waste storage. Especially, earth rock response to changes in pressure and stress has remained a critically challenging task. In this work, we advance computational capabilities for coupled processes in fractured and porous media using Sandia Sierra Multiphysics software through verification and validation problems such as poro-elasticity, elasto-plasticity and thermo-poroelasticity. We apply Sierra software for geologic carbon storage, fluid injection/extraction, and enhanced geothermal systems. We also significantly improve machine learning approaches through latent space and self-supervised learning. Additionally, we develop new experimental technique for evaluating dynamics of compacted soils at an intermediate scale. Overall, this project will enable us to systematically measure and control the earth system response to changes in stress and pressure due to subsurface energy activities.

58 GEOSCIENCES↗

High-Energy X-ray Diffraction Microscopy for Nuclear Forensics FY2022 Project Report

Morphological information on nuclear material has been identified using visible light and scanning electron microscopy. These identify qualitative differences in particle morphology. Three-dimensional imaging of materials through alternating scanning electron microscopy imaging and focused ion beam milling has also been used. Unfortunately, these techniques are time- and labor-intensive, with significant sample preparation required and lengthy analysis times. Further, the resulting 3D images are qualitative, require manual identification, and do not capture statistically-representative populations. High energy X-ray 3D imaging using a direct-beam or diffracted-beam (High-Energy Diffraction Microscopy) have been developed at the Advanced Photon Source and can produce quantitative information on grains (phase, location, etc.) and pores (size distribution, sphericity) in a material. These techniques require only minutes to characterize a sample volume and are non-destructive, thus suitable for a wide range of existing samples and for confirmatory analyses to be carried out using conventional microscopy techniques. In this first year of the project, all uranium oxide samples were synthesized and characterized using conventional analyses by the analytical chemistry laboratory. Conventional analysis methods included powder x-ray diffraction, scanning electron microscopy, impurity analysis via inductively coupled plasma mass spectrometry, and infrared spectroscopy. Impurity analysis shows a drop in boron content from UO 3 to the lowest U 3 O 8 calcination temperature, but otherwise no appreciable difference in any sample. Analysis of diffraction data shows a flip of peaks from UO 3 dominated for the 600 °C calcined sample to U 3 O 8 dominated at 700 °C and 800 °C. Analysis of scanning electron microscopy images shows that with increased calcination temperature the size distribution of particles seems to increase and broaden. Both of these last findings are in line with previously published data, though this work used significantly fewer particles to simply show similar trends instead of getting truly quantitative particle analysis. Infrared analysis similarly shows ingrowth of U 3 O 8 as calcination temperature is increased, along with depression of peaks associated with UO 3 and water. Samples were prepared for analysis at the Advanced Photon Source at beamline 1-ID. It is anticipated that analysis will occur in November of 2022. AI/ML techniques to de-noise data coming out of 1-ID during the analyses was also developed during this time using previously gathered data. Preliminary results using a self-supervision technique called Noise2Selfshow good de-noising of data. Once the uranium oxide samples are analyzed, real data will be used to test the de-noising and other AI/ML techniques that may be developed in the second year of the project.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Neptunyl and Uranyl Peroxide Chemistry in Molten Salts, Uranyl Structures from Nature, and Thermodynamic Studies Extending into the Transuranium Elements (Final Report)

This project was initially funded in 2007 and the current technical report is for 2019-2022. The specific objectives of this project (2019-2022) were: (1) Synthesis of actinide peroxide compounds in molten salt eutectics, (2) Studies of new uranyl minerals with fascinating structures and compositions, (3) Drop-solution calorimetric studies of actinide compounds extending into the transuranium elements, with an emphasis on the uranyl-sulfate system, (4) Continuation of studies of uranyl vanadate clusters synthesized using ionic liquids, (5) The training of Ph.D. graduate students in actinide chemistry, and to introduce undergraduate students to actinide research through providing research assistantships and supervision. The report lists 67 archival journal papers describing the work, of which 23 were since 2019. Highlights of the work are summarized for the period 2019-2022.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

2022 LLNL Nuclear Science and Security Summer Internship Program

The Lawrence Livermore National Laboratory (LLNL) Nuclear Science and Security Summer Internship Program (NS 3 IP) is designed to give graduate and undergraduate students an opportunity to come to LLNL for 8–10 weeks of hands-on research. Students conduct research under the supervision of a staff scientist, attend a weekly lecture series, interact with other students, and present their work to the LLNL scientific community at the end of the program. Students also have the opportunity to meet staff scientists one-on-one, participate in LLNL facility tours (e.g., the National Ignition Facility and Center for Accelerator Mass Spectrometry), and gain a better understanding of the various science programs at LLNL. Due to the travel and access restrictions imposed by the COVID-19 pandemic, the 2022 NS 3 IP was organized as a hybrid internship program. Five of the 20 NS 3 IP students participated remotely. One of the 8 students funded directly by DTRA participated remotely. With LLNL’s extensive institutional support, remote students accessed the laboratory’s cyberinfrastructure through a secure virtual desktop environment and all seminars, mentor interactions, summer presentations, and laboratory tours had a remote option. The hybrid approach to the internship program provided flexibility to both the interns and their mentors to construct creative research projects that maximized student exposure to nuclear science research that is relevant to DTRA and LLNL. We anticipate continuing a hybrid internship format in the summer of 2023.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗