Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data processing automation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Fostering Geothermal Machine Learning Success: Elevating Big Data Accessibility and Automated Data Standardization in the Geothermal Data Repository: Preprint

The Department of Energy's (DOE) Geothermal Data Repository (GDR) has implemented improvements to both its data lakes and its data standards and automated data pipelines. The GDR data lakes have reduced storage and compute-related barriers to using large geothermal datasets, enabling these large datasets to be accessed by anyone with a modern computer and internet access. More recently, the GDR has been working to further reduce barriers through streamlining the data intake process, educating users on the process and requirements, and aiding users in accessing data from the data lakes. These improvements have augmented the quantity of datasets the GDR is able to accept into its data lakes and have enabled users who are new to cloud tools to access these datasets more easily, overall increasing the accessibility of big geothermal data for use in machine learning and other projects. In addition, the GDR now has built-in data standards and pipelines for drilling data, geospatial data, and distributed acoustic sensing (DAS) data. These standardization efforts aim to enhance the real-world applicability of geothermal machine learning outcomes by improving the quality of training data. Specifically, through standardizing high-value datasets, the GDR is reducing project-specific data curation requirements, thus allowing more time for actual research. By automating this process, the burden of standardization is lifted from the user, ultimately increasing the availability of standardized data.

accessibility↗
DOE OSTI2023

Artificial Intelligence in Nuclear Physics

Artificial Intelligence (AI) and Machine Learning (ML) are rapidly developing fields providing data-driven algorithms to predict, classify, and make decisions based on data. Nuclear Physics Research is data-driven and AI/ML techniques have been implemented for experiment and accelerator control, in theoretical applications, and in data processing and analysis. These algorithms open possibilities for automation, thereby augmenting human capabilities. Additionally, Open Science is enabled by simultaneous analyses of multiple data sources, leading to scientific knowledge. This talk will summarize current applications of AI/ML in nuclear physics, as well as accelerator applications, and will cover upcoming initiatives and research in AI/ML.

Jeske, Torri↗
DOE OSTI2020

Systems and methods for control of polymer reactions and processing using automatic continuous online monitoring

Manual and automatic methods and devices using a ACOMP system for active control of polymerization reaction processes. An ideal desired trajectory of one or more reaction and polymer characteristics can be established to produce a desired final polymer product with specified characteristics from a polymerization reaction process. A current reaction trajectory of a polymerization reaction process can be driven to an ideal or desired reaction trajectory. In a manual embodiment an operator can use ACOMP data to adjust process variables in order to drive the current reaction trajectory toward the ideal or desired reaction trajectory. In an automated mode a control program can use ACOMP data to make adjustments to process variables to drive the polymerization reaction process toward the desired trajectory as closely as possible either empirically or by solving the governing equations for the polymerization reaction process.

Reed, Wayne Frederick↗
DOE OSTI2025

nmRanalysis: An Open-Source Web Application for Semi-automated NMR Metabolite Profiling

Though data acquisition and initial signal pre-processing of nuclear magnetic resonance (NMR) spectra have achieved high degrees of automation, downstream processing - specifically the profiling of spectra - has bottlenecked the overall NMR analysis workflow. Several efforts have been made to mitigate this bottleneck, but these solutions often trade an increase in automation for limitations elsewhere. Here, in this technical note, we introduce nmRanalysis, a user-friendly web-application that integrates the strengths of existing profiling tools for a more automated profiling workflow. nmRa-nalysis additionally incorporates novel features, including a machine-learning-driven recommender system for me-tabolite identification, further increasing the utility of nmRanalysis over the individual tools that it incorporates.

Flores, Javier E. [Pacific Northwest National Labo↗
DOE OSTI2022

Nanoscale defect evaluation framework combining real-time transmission electron microscopy and integrated machine learning-particle filter estimation

Observation of dynamic processes by transmission electron microscopy (TEM) is an attractive technique to experimentally analyze materials’ nanoscale phenomena and understand the microstructure-properties relationships in nanoscale. Even if spatial and temporal resolutions of real-time TEM increase significantly, it is still difficult to say that the researchers quantitatively evaluate the dynamic behavior of defects. Images in TEM video are a two-dimensional projection of three-dimensional space phenomena, thus missing information must be existed that makes image’s uniquely accurate interpretation challenging. Therefore, even though they are still a clustering high-dimensional data and can be compressed to two-dimensional, conventional statistical methods for analyzing images may not be powerful enough to track nanoscale behavior by removing various artifacts associated with experiment; and automated and unbiased processing tools for such big-data are becoming mission-critical to discover knowledge about unforeseen behavior. We have developed a method to quantitative image analysis framework to resolve these problems, in which machine learning and particle filter estimation are uniquely combined. The quantitative and automated measurement of the dislocation velocity in an Fe-31Mn-3Al-3Si autunitic steel subjected to the tensile deformation was performed to validate the framework, and an intermittent motion of the dislocations was quantitatively analyzed. The framework is successfully classifying, identifying and tracking nanoscale objects; these are not able to be accurately implemented by the conventional mean-path based analysis.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Cinema:Snap: Real-time tools for analysis of dynamic diamond anvil cell experiment data

We report we developed tools and a workflow for real-time analysis of data from dynamic diamond anvil cell experiments performed at user light sources. These tools allow users to determine the phases of matter observed during the compression of materials in order to make decisions during an experiment to improve the quality of experimental results and maximize the use of scarce experimental facility time. The tools fill a gap in dynamic compression data analysis tools that are real-time, are flexible to the needs of high-pressure scientists, connect to automated processing of results, can be easily incorporated into workflows with existing tools and data formats, and support remote experimental data analysis workflows. Specific analytics developed include novel automated two-peak analysis for overlapping peaks and multiple phases, coordinated views of pressure and temperature values, full-compression contour plots, and configurable views of integrated x-ray diffraction. We present an experimental use case to show how the tools produce real-time analytics that help the scientists revise parameters for the next compression

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Using Information Automation and Human Technology Integration to Implement Integrated Operations for Nuclear

The purpose of the research effort described in this report is to develop and demonstrate an approach to the design and implementation of advanced, automated systems intended to increase operational efficiencies at nuclear power plants. In particular, we describe methods for considering human-technology integration (HTI) issues throughout the various phases of system design, test, and implementation and how these considerations help promote effective design. This research project will develop planning tools and comprehensive guidance on how HTI principles and methods, in combination with information automation technologies, can enable effective data integration and coordination for full nuclear plant modernization. Specifically, this research project will develop an approach to automate the mapping of data from plant systems and processes to application needs, thereby significantly reducing the amount of human workload currently required for the execution of these tasks. In addition to developing an automated solution as a replacement for these tasks, this research will also analyze digitalization’s effectiveness in reducing operational costs of compliance related activities. Compliance activities are estimated to account for as much as 50% of operations and maintenance (i.e., non-fuel and non-capital) costs of plant operation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Machine learning for domain transfer between simulated and experimental 2D X-ray diffraction patterns using generative adversarial networks

X-ray diffraction (XRD) is a well-established technique for analyzing materials at an atomic level. Dynamic compression experiments (DCE), in which materials are subject to extreme pressures, can provide fundamental understanding to pressure-induced phase transitions and compression of the crystal lattice. The analysis of XRD patterns from highly compressed samples is non-trivial given the sparsity of data, high experimental costs, and the fact that the data is often marred with X-ray background and other artifacts. While accurate computational frameworks exist, they solve the forward problem—from structures and orientations to XRD patterns. Solving the inverse problem for 2D experimental diffraction patterns is currently a complex manual process of matching and comparing experimentally observed patterns to computationally generated ones. Machine learning is a promising tool for automating the matching process but often requires data-intensive architectures. Here, in this study, we use a CycleGAN to translate the domain of limited experimental data to a domain in which there is readily available simulated data. This domain shift allows data-intensive machine learning models that have only been trained on simulated XRD patterns to be used in the analysis of experiments.

Brozak, Samantha Jean [Sandia National Laboratorie↗
DOE OSTI2022

Power quality disturbances diagnosis: A 2D densely connected convolutional network framework

The fast and accurate diagnosis of power quality disturbances (PQD) aids in avoiding shutdowns and unnecessary procedures, concerning electric energy distribution systems. As such, a number of techniques have been tested and applied in order to reach this objective. Majority of the techniques applied are two-step based. On the first step, power quality disturbances features are extracted. Second step, considering features extracted, disturbance classification is implemented. Recently, relevant literature has presented data-driven signal processing-based approaches, as deep convolutional neural networks (DCNN), which can implement both processing steps while providing automated recognition of patterns and outliers in data. However, not considered by state-of-art, power quality disturbances are evolving in nature, while all possible regularities might not be represented in the dataset. In this work a 2 Dimension Densely Connected Convolutional Network (2D-DenseNet) framework is presented. Further, a case study with synthetic disturbance events are analyzed. Easy-to-implement formulation, built on the 2D-DenseNet, without hard-to-design parameters, highlight potential aspects for real-life implementation.

42 ENGINEERING↗
DOE OSTI2021

Optimization of Mitigating System Performance Index to Improve Nuclear Power Plant Safety and Efficiency

MSPI (Mitigation System Performance Index) is one of the risk-informed, plant-specific performance indicators of NRC’s Reactor Oversight Process. MSPI is used by the regulator and nuclear industry to monitor and assess the performance of plant mitigating systems. In this project, a calculation tool has been developed by incorporating the plant operation data, Probabilistic Risk Assessment (PRA) data, and industry baseline values to automate the calculation process of MSPI and the generation of the report. This is the first stage in an effort to optimize the MSPI through advanced artificial intelligence (AI) and machine learning (ML) techniques to improve nuclear power plant safety and efficiency.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2025

Interlaboratory comparison of secondary ion mass spectrometry analysis results from the 7th international technical nuclear forensics working group collaborative material exercise

A review and interlaboratory comparison of secondary ion mass spectrometry (SIMS) data obtained by laboratories participating in the International Technical Nuclear Forensics Working Group (ITWG) 7th Collaborative Material Exercise (CMX-7) has been conducted. The analyzed materials were two uranium compounds in powder form and two pieces of uranium metal. The instruments used in this comparison were a small-geometry (SG) SIMS, CAMECA IMS 7f from the Research Centre Rez, and a large-geometry (LG) SIMS, CAMECA IMS 1280 from Los Alamos National Laboratory. Despite the differences in instruments and analytical procedures, e.g., sample preparation, SIMS setups, and data post-processing, there was good agreement for the 234 U/ 238 U, 235 U/ 238 U, and 236 U/ 238 U ratios in the analyzed materials. The main difference was in the precision, which was, as expected, higher for the LG-SIMS. In addition, a comparison between the laboratories was also made for the image processing algorithms applied to raw data acquired in automated particle measurement (APM) mode. In conclusion, the result of this comparison has led to identification of best practices for setting up parameters of the APM software.

and nuclear chemistry↗
DOE OSTI2021

The value of human data annotation for machine learning based anomaly detection in environmental systems

Anomaly detection is the process of identifying unexpected data samples in datasets. Automated anomaly detection is either performed using supervised machine learning models, which require a labelled dataset for their calibration, or unsupervised models, which do not require labels. While academic research has produced a vast array of tools and machine learning models for automated anomaly detection, the research community focused on environmental systems still lacks a comparative analysis that is simultaneously comprehensive, objective, and systematic. This knowledge gap is addressed for the first time in this study, where 15 different supervised and unsupervised anomaly detection models are evaluated on 5 different environmental datasets from engineered and natural aquatic systems. To this end, anomaly detection performance, labelling efforts, as well as the impact of model and algorithm tuning are taken into account. As a result, our analysis reveals the relative strengths and weaknesses of the different approaches in an objective manner without bias for any particular paradigm in machine learning. Most importantly, our results show that expert-based data annotation is extremely valuable for anomaly detection based on machine learning.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

ASME Code change proposal to implement new universal high temperature constitutive models for Section III, Division 5

This report completes work on a universal high temperature constitutive model suitable for use with the ASME Boiler & Pressure Vessel Code Section III, Division 5 rules for the design by inelastic analysis of Class A nuclear reactor components. The goals of this work are to provide a simple model form that adequately captures the high temperature response of materials and can be applied to any future Code material. Additionally, the report describes an automated process for calibrating a model against test data. The idea is to simplify the effort required to generate a constitutive model for an arbitrary material, provided test data is available. This will accelerate the process of qualifying new Code materials in the future. In addition, the report provides calibrated models and detailed validation comparisons to test data for five currently-qualified or soon-to-be qualified materials: 316H, Grade 91, Alloy 800H, Alloy 617, and Alloy 709. The report surveys the available data for the remaining two ASME Class Materials --- 2.25Cr-1Mo and 304H --- concluding that there is enough data data to generate a model for 2.25Cr-1Mo steel provided some additional sources of non-public data can be included in the test database, but that a dedicated cyclic test campaign would be needed for 304H. Supplemental material includes the full text of an ASME Code change proposal to incorporate the models for the four currently-qualified Class A material, detailed validation comparisons to test data for the five material models, and input files for reference implementations of the constitutive models in the NEML and NEML2 modeling frameworks.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2020

Using Meteorological Data to Evaluate Worldwide PV Degradation Rates

Here we automate the process to enable the creation of world maps for specific PV durability metrics. The end goal is to create a tool for the creation of world maps predicting the sensitivity of modules to degradation to inform the development and utilization of module testing standards and to provide information to module designers. TMY (Typical Meteorological Year) Data was aggregated from sites around the world to render insight into factors contributing to the degradation of solar modules. The focus of aggregating data was to create a single dataset to work with utilizing Solar Irradiance values combined with Ambient Temperature, Relative Humidity, Wind Speed and Dew-Point Temperature.

14 SOLAR ENERGY↗
DOE OSTI2020

Distributed Computing for the Project 8 Experiment

The Project 8 collaboration aims to measure the absolute neutrino mass or improve on the current limit by measuring the tritium beta decay electron spectrum. We present the current distributed computing model for the Project 8 experiment. Project 8 is in its second phase of data taking with a near continuous data rate of 1Gbps. The current computing model uses DIRAC (Distributed Infrastructure with Remote Agent Control) for its workflow and data management. A detailed meta-data assignment using the DIRAC File Catalog is used to automate raw data transfers and subsequent stages of data processing. The DIRAC system is deployed on containers managed using a Kubernetes cluster to provide a scalable infrastructure. A modified DIRAC Site Director provides the ability to submit jobs using Singularity on opportunistic High-Performance Computing (HPC) sites.

Distributed Computing, Kubernetes, DIRAC, Project ↗
DOE OSTI2023

Crack detection in fuel cell electrodes using a spatial filtering technique for overcoming noisy backgrounds

Image processing is a powerful tool that allows for rapid and automated data parsing in settings that occupy large variable spaces and require large data sets. Feature detection on difficultly discerned backgrounds is a subset of image processing that facilitates the extraction of quantitative metrics from otherwise subjective data. Crack detection and quantification is an important capability in polymer electrolyte membrane fuel cell quality control, failure analysis, and optimization. This work presents a technique to perform crack detection and quantification which overcomes challenges faced by commonly used image segmentation techniques. We demonstrate the use of a geometrically filtered noise‐level detection technique to select a binary threshold value from which we then quantify how cracked a sample is. Furthermore, we demonstrate the accuracy of our technique using programmatically generated test images of known crack amounts and their performance on real‐world fuel cell catalyst layer samples.

30 DIRECT ENERGY CONVERSION↗
DOE OSTI2023

Fuel Performance Analysis of Fast Flux Test Facility MFF-3 and -5 Fuel Pins Using BISON with Post Irradiation Examination Data

Using the BISON fuel-performance code, simulations were conducted of an automated process to read initial and operating conditions from the Pacific Northwest National Laboratory (PNNL) database and reports, which contain metallic-fuel data from the Fast Flux Test Facility (FFTF) MFF Experiments. This work builds on previous modeling efforts involving 1977 EBR-II metallic fuel pins from experiments. Coupling the FFTF PNNL reports to BISON allowed for all 338 pins from MFF-3 and MFF-5 campaigns to be simulated. Each BISON simulation contains unique power and flux histories, axial power and flux profiles, and coolant-channel flow rates. Fission-gas release (FGR), fuel axial swelling, cladding profilometry, and burnup were all simulated in BISON and compared to available post-irradiation examination (PIE) data. Cladding profilometry, FGR, and fuel axial swelling simulation results for full-length MFF metallic pins were found to be in agreement with PIE measurements using FFTF physics and models used previously for EBR-II simulations. The main two peaks observed within the cladding profilometry were able to be simulated, with fuel-cladding mechanical interaction (FCMI), fuel-cladding chemical interaction (FCCI), and thermal and irradiation-induced creep being the cause. A U-Pu-Zr hot-pressing model was included in this work to allow pore collapse within the fuel matrix. This allowed better agreement between BISON-simulated cladding profilometry and PIE measurements for the peak caused by FCMI. This work shows that metallic fuel models used to accurately represent fuel performance for smaller EBR-II pins may be used for full-length metallic fuel, such as FFTF MFF assemblies and the Versatile Test Reactor (VTR). As new material models and PIE measurements become available, FFTF MFF assessment cases will be reassessed to further BISON model development.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Urban morphology and urban water demand evolution in the Los Angeles region

Detailed description of the dataset sources used in this study, the experimental workflow, and plotting for the paper figures provided at the associated GitHub Meta Repo: https://github.com/IMMM-SFA/Ferencz_et_al_2024_ERL The future water demand projections from this study are hypothetical future water demands that reflect the population and urban land cover changes represented by the scenarios considered. The intent and emphasis of this work is investigating the interactions between population change, evolution of urban morphology, and water demand. These projections are not meant to be likely future demands for specific water providers or the LA region and should not be interpreted as such. The folders contain input and output data for each step of the "Recreate my Experiment" workflow described in the associated GitHub meta-repository as well as data used for plotting Figures for the paper that this dataset supports. Description of each folder's contents and use: Step_1a: All necessary inputs to the associated python script provided on the GitHub repo. Step_1b: All necessary inputs (downscaled population rasters) used by the associated python script provided on the GitHub repo. Original 1-km squared rasters that were downscaled also provided. Step_1c: Urban growth projection rasters corresponding to SSP3 and SSP5 population scenarios are provided in separate subfolders as well as the water provider boundaries used for analysis. Outputs of data processing also provided. Associated python script provided on GitHub. Step_1d: Description of Inputs used by the QGIS Model Builder GUI that automates geospatial processing and clipping the of the high resolution land cover data for each urban land class footprint within a defined polygon boundary. The Model Builder is provided on the GitHub repo and can be used by QGIS. The outputs of this step are in "Clipped Provider Hi Res Landcover". If the user wants to use The Model Builder for different regions of LA or two test our outputs, they will need to download the hi resolution landcover raster listed in the Readme and in Ref [2] of the GitHub Page. Step_1e: All necessary inputs to generate average monthly demand for each water provider. Associated python script on GitHub. Step 2: Output data about land cover metrics (areas and fractions) for each urban land class for each water provider. Associated python script on GitHub. Uses outputs from Step 1d "Clipped Provider Hi Res Landcover" Step 3: Inputs for and Outputs from the urban projection raster analysis Python script on GitHub. The outputs are rasters of urban pixels that were converted to a higher land class and the number of land class units that changed (Values of 1, 2, or 3). For example, a value of 2 could be LC 21 -> 23 or LC 22 -> 24. These maps are label "intensification." The other outputs are "urban growth" rasters showing the conversion of non urban to urban land, which are indicated by pixel values of 1. Step 4: Output projections of indoor and outdoor annual and monthly demands for each water provider. These are used for Figures 4 - 7 of the paper. Figures: This folder has data used for plotting Figures 1 through 5. Data for Figures 6 and 7 are sourced directly from folders associated with the Processing and Analysis Steps 1 - 4 and the plotting scripts for Figures 6 and 7 are commented with what folder paths are needed to generate the figures. The GitHub page provides descriptions of how each figure was made and the associated plotting scripts used.

Los Angeles↗