SEARCH · Engineering Papers

Results for “Automatic Data Processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

All sources NASA NTRS DOE OSTI

DOE OSTI2016

Systems and methods for data quality control and cleansing

A method for detecting and cleansing suspect building automation system data is shown and described. The method includes using processing electronics to automatically determine which of a plurality of error detectors and which of a plurality of data cleansers to use with building automation system data. The method further includes using processing electronics to automatically detect errors in the data and cleanse the data using a subset of the error detectors and a subset of the cleansers.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

SNAPRed: Reduction of multidimensional neutron time-of-flight diffraction data

SNAP is a neutron time-of-flight diffractometer at the Spallation Neutron Source operated by Oak Ridge National Laboratory. It generates large arrays of neutron detection events that encode the crystalline atomic structure of materials under study. SNAPRed is an application that makes these datasets accessible to end users by orchestrating the process of data reduction while automatically managing the variable neutron instrumentation configuration. It supports arbitrary grouping and masking of individual detector pixels and includes custom-developed data compression approaches to accommodate the large volumes of data generated by the SNAP instrument.

Diffraction↗

DOE OSTI2020

Quantifying patterns in optical micrographs of one- and two-dimensional ellipsoidal particle assemblies

Current developments in colloidal science include the assembly of anisotropic colloids with broad geometric diversity. As the complexity of particle assemblies increases, the need for ubiquitous algorithms that quantitatively analyze images of the assemblies to deliver key information such as quantification of crystal structures becomes more urgent. This contribution describes algorithms capable of image analysis for classifying colloidal structures based on abstracted interparticle relationship information and quantitatively analyzing the abundance of each structure in mixed pattern assemblies. The algorithm parameters can be adjusted, allowing for the algorithms to be adapted for different image analyses. Three different ellipsoidal particle assembly images are presented to demonstrate the effectiveness of the algorithms: a one-dimensional (1D) particle chain assembly and two two-dimensional (2D) polymorphic crystals each consisting of assemblies of two distinct plane symmetry groups. Angle relationships between neighbouring particles are calculated and neighbour counts of each particle are determined. Combining these two parameters as rules for classification criteria allows for the labeling and quantification of each particle into a defined symmetry class within an assembly. The algorithms provide a labelled image comprising classification results and particle counts of each defined class. For multiple images or individual frames from a video, the script can be looped to achieve automatic processing. The yielded classification data allow for more in-depth image analysis of mixed pattern particle assemblies. Finally, we envision that these algorithms will have utility in quantitative analysis of images comprising ellipsoidal colloidal materials, nanoparticles, or biological matter.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2025

Livewire: Automatic Annotations

Diogenes processes datasets to provide data quality metrics for the Livewire platform and creates standardized data dictionaries from data annotations. Diogenes needs data annotations that clearly outline thenformat and organization of the data. It also relies on the type, class, and unit of each data piece for comprehensive analysis, which it cannot determine independently. The Annotation Tool significantly reduces the time needed to create annotations for Diogenes by generating data annotations with the correct formatting and content. It also employs machine learning and hard-coded models to automatically annotate data class, quality type, and data units.

33 - ADVANCED PROPULSION SYSTEMS↗

DOE OSTI2021

Quantifying experimental edge plasma evolution via multidimensional adaptive Gaussian process regression

The edge density and temperature of tokamak plasmas are strongly correlated with energy and particle confinement and their quantification is fundamental to understanding edge dynamics. These quantities exhibit behaviours ranging from sharp plasma gradients and fast transient phenomena (e.g. transitions between low and high confinement regimes) to nominal stationary phases. Analysis of experimental edge measurements therefore require robust fitting techniques to capture potentially stiff spatiotemporal evolution. Additionally, fusion plasma diagnostics inevitably involve measurement errors and data analysis requires a statistical framework to accurately quantify uncertainties. This paper outlines a generalized multidimensional adaptive Gaussian process routine capable of automatically handling noisy data and spatiotemporal correlations. We focus on the edge-pedestal region in order to underline advancements in quantifying time-dependent plasma profiles including transport barrier formation on the Alcator C-Mod tokamak.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2022

An autonomous robot for shell and tube heat exchanger inspection

Shell and tube heat exchangers (STHEs) are critical to energy conversion efficiency of power plants. Eddy current examination is a way to evaluate working conditions of these tubes. However, the current testing apparatus requires human to manually insert an eddy current testing (ECT) probe into and extract it out of individual tubes, and meanwhile monitor measurement results for diagnosis. It is a time-consuming and labor-intensive procedure even for an experienced technician. To tackle this challenge, in this study, we developed a robot enabled ECT system for autonomous inspection of STHEs. The robotic platform employs Mecanum wheeled chassis for high mobility, machine vision to locate tube bundle and tube inlets, a rotational Cartesian mechanism to operate at planes with all possible inclinations, and a task-specific mechanism for ECT probe delivery. Machine vision locates tube bundle and tube inlets by an April tag detection algorithm and a Circle Hough Transform algorithm, respectively. Assisted by a guiding cone, the ECT probe is continuously fed into the tubes with a fill factor of 0.819. In conclusion, during this process, the eddy current data are automatically collected and real-time analyzed by convolutional neural networks, showing accuracy of nearly 100% for identifying defective and nondefective tubes and 85% for four types of defective tubes and nondefective tubes.

42 ENGINEERING↗

DOE OSTI2024

Atomic-Scale Characterization of Dilute Dopants in Topological Insulators via STEM–EDS Using Registration and Cell Averaging Techniques

Magnetic dopants in three-dimensional topological insulators (TIs) offer a promising avenue for realizing the quantum anomalous Hall effect (QAHE) without the necessity for an external magnetic field. Understanding the relationship between site occupancy of magnetic dopant elements and their effect on macroscopic property is crucial for controlling the QAHE. By combining atomic-scale energy-dispersive X-ray spectroscopy (EDS) maps obtained by aberration-corrected scanning transmission electron microscopy (AC-STEM) and novel data processing methodologies, including semi-automatic lattice averaging and frame registration, we have determined the substitutional sites of Mn atoms within the 1.2% Mn-doped Sb 2 Te 3 crystal. More importantly, the methodology developed in this study extends beyond Mn-doped Sb 2 Te 3 to other quantum materials, traditional semiconductors, and even electron irradiation sensitive materials.

36 MATERIALS SCIENCE↗

DOE OSTI2021

Specification of EBR-II Laser Profilometry Data

All laser profilometry data stored in FIPD were originally measured using the element laser profilometer system in HFEF/N. The irradiated fuel elements or pins were scanned by a laser beam to measure the outer diameter with position mapping of the spacer wire. The normal operation and data collection were performed automatically with HFEF/N Data Acquisition and Process Control System (DAPCS). With the digital control system, measured laser profilometry data were recorded in digital form on magnetic tapes, different from the analog contact profilometry data recorded by strip-chart record sheets. Two documents contained most of the important details about laser profilometry measurements. The first one is the operational manual of the laser profilometer (title: Element laser profilometer (ELP) operation and maintenance manual, HFEF/N OMM 4329, DOC. NO. W0171-0149-ES-01). This manual provides: (1) description of laser profilometer including the functions of each component (transceiver, retroreflector, clamping guide, shielding enclosure, electronic controller, etc.); (2) step-by-step guidance for calibrations, operations and measurements; and (3) maintenance procedures and other details of the element laser profilometer. Since first issued on 12/1/1986, several revisions/changes of the manual were developed to update the measurement accuracies and other factors for the laser profilometer system. The second document is a publicly accessible conference article titled “the element laser profilometer system in HFEF/N.” This article summarizes important functions and parameters of the laser profilometer. The range of measurements and the uncertainties reported in the article were consistent with the values reported in the operational manual.

42 ENGINEERING↗

DOE OSTI2018

Deep learning tackles cloud detection

To better understand Earth systems, atmospheric scientists use cloud data collected by a remote sensing tool called lidar. These data are an important part of global forecasting, but analyzing lidar images by hand is time-consuming. Researchers at Pacific Northwest National Laboratory teamed up to see if a deep learning model could process lidar data better than current automatic detection techniques.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

An Autonomous Robot for Shell and Tube Heat Exchanger Inspection

Shell and tube heat exchangers (STHEs) are critical to energy conversion efficiency of power plants. Eddy current examination is a way to evaluate working conditions of these tubes. However, the current testing apparatus requires human to manually insert an eddy current testing (ECT) probe into and extract it out of individual tubes, and meanwhile monitor measurement results for diagnosis. It is a time-consuming and labor-intensive procedure even for an experienced technician. To tackle this challenge, in this work, we developed a robot enabled ECT system for autonomous inspection of STHEs. The robotic platform employs Mecanum wheeled chassis for high mobility, machine vision to locate tube bundle and tube inlets, a rotational Cartesian mechanism to operate at planes with all possible inclinations, and a task-specific mechanism for ECT probe delivery. Machine vision locates tube bundle and tube inlets by an April tag detection algorithm and a Circle Hough Transform (CHT) algorithm, respectively. Assisted by a guidance cone, the ECT probe is continuously fed into the tubes with a fill factor of 0.819. During this process, the eddy current data are automatically collected and real-time analyzed by convolutional neural networks (CNN), showing accuracy of nearly 100% for identifying defective and non-defective tubes and 85% for four types of defective tubes and non-defective tubes.

autonomy, deep learning, eddy current testing, hea↗

DOE OSTI2023

A hybrid machine-learning approach for analysis of methane hydrate formation dynamics in porous media with synchrotron CT imaging

Fast multi-phase processes in methane hydrate bearing samples pose a challenge for quantitative micro-computed tomography study and experiment steering due to complex tomographic data analysis involving time-consuming segmentation procedures. This is because of the sample's multi-scale structure, which changes over time, low contrast between solid and fluid materials, and the large amount of data acquired during dynamic processes. Here, a hybrid approach is proposed for the automatic segmentation of tomographic data from time-resolved imaging of methane gas-hydrate formation in sandy granular media, which includes a deep-learning 3D U-Net model. To prepare a training dataset for the 3D U-Net, a technique to automate data labeling based on sample-specific information about the mineral matrix immobility and occasional fluid movement in pores is proposed. Automatic segmentation allowed for studying properties of the hydrate growth in pores, as well as dynamic processes such as incremental flow and redistribution of pore brine. Results of the quantitative analysis showed that for typical gas-hydrate stability parameters (100 bar methane pressure, 7°C temperature) the rate of formation is slow (less than 1% per hour), after which the surface area of contact between brine and gas increases, resulting in faster formation (2.5% per hour). Hydrate growth reaches the saturation point after 11 h of the experiment. Finally, the efficacy of the proposed segmentation scheme in on-the-fly automatic data analysis and experiment steering with zooming to regions of interest is demonstrated.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2017

Benchmarking sensor fusion capabilities of an integrated instrumentation package

Quantifying and mitigating environmental risks introduced by marine energy conversion systems requires a variety of sensors (active acoustic, passive acoustic, and optical). The operation of these sensors must satisfy three directives to be effective: (1) do not alter the environment through operation of sensors; (2) capture rare events; and (3) do not accrue unmanageable volumes of low-value data. This requires integrating sensors into a single package, rather than operating them independently. The Adaptable Monitoring Package is an integrated instrumentation package that combines a multibeam sonar, acoustic camera, current profiler, optical cameras, and an array of hydrophones. The capabilities and limitations of the AMP sensors were benchmarked using cooperative targets, and real-time target tracking and detection was used to detect opportunistic targets (e.g., diving birds, seals). During an initial deployment, automatic detection of opportunistic targets achieved a 58% true positive rate and a 99% true negative rate (100% corresponding to an ideal system in both cases). In post-processing, target tracking data were used to evaluate automatic target classification capabilities using a k-nearest neighbor algorithm. Findings suggest that real-time target classification should be possible and enable integrated instrumentation systems to meet the monitoring needs of marine energy deployments.

16 TIDAL AND WAVE POWER↗

DOE OSTI2019

Localized Actual Meteorological Year File Creator (LAF): A tool for using locally observed weather data in building energy simulations

The Localized Actual Meteorological Year File Creator (LAF) application provides web-based access to real meteorological data and processes it into a weather file suitable for building energy modeling. Building energy consumption is affected by what is inside the building (such as occupants, appliances, HVAC systems, etc.) and by what is outside: the weather conditions the building is exposed to. However, freely available weather data files are limited to a number of specific locations, usually airports, which are often located away from city centers where buildings are concentrated. The authors have developed a new tool that supports the investigation and quantification of micro-climate conditions on building energy consumption. LAF is built on the Python open-source programming language and has a Graphical User Interface (GUI) that allows users to create custom weather data files for building energy simulations. Many sets of actual meteorological year weather data for long time periods are publicly available online (such as the MesoWest database) for thousands of locations in the US. LAF selects weather data according to user specifications and automatically processes it through an API across multiple weather stations and multiple time periods. The user may easily select a specific location, time frame, and time step that best meets their needs. This article presents a useful tool for energy modelers, building designers and operators to assist with building performance analysis and optimization.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2023

Robust Parameter Design on Dual Stochastic Response Models With Constrained Bayesian Optimization

In engineering system design, minimizing the variations of the quality measurements while guaranteeing their overall quality up to certain levels, namely the robust parameter design (RPD), is crucial. Recent works have dealt with the design of a system whose response-control variables relationship is a deterministic function with a complex shape and function evaluation is expensive. In this work, we propose a Bayesian optimization method for the RPD of stochastic functions. Dual stochastic response models are carefully designed for stochastic functions. The heterogeneous variance of the sample mean is addressed by the predictive mean of the log variance surrogate model in a two-step approach. We establish an acquisition function that favors exploration across the feasible and optimality-improvable regions to effectively and efficiently solve the stochastic constrained optimization problem. Further, the performance of our proposed method is demonstrated by the extensive numerical and case studies. Note to Practitioners-Many manufacturing processes involve undesirable variations, which create variations in the final products. For example, many emerging manufacturing processes, such as nanomanufacturing, involve complex physical and chemical dynamics and transformation, creating variations in the manufacturing output. In such processes, it is crucial to design the manufacturing processes or products so that they have minimum variations in their quality. Meanwhile, it is also important to maintain the overall quality of the designed processes or products. Furthermore, acquiring data from many advanced manufacturing processes is often very costly, especially in the designing stage. In this work, we propose a data-driven method that automatically finds the best setting of manufacturing processes or products with the minimum variations of quality and a given constraint on the average quality satisfied. Our proposed method is used before conducting every experiment; It analyzes the historical data from previous experiments and provides a setting to be used in the next experiment. Our proposed method efficiently utilizes the historical data, and thus finds the best robust setting by conducting only a small number of experiments.

42 ENGINEERING↗

DOE OSTI2021

Machine Learning and Economic Models to Enable Risk-Informed Condition Based Maintenance of a Nuclear Plant Asset

The primary objective of this research is to address challenges in the implementation of risk-informed, condition-based predictive maintenance (PdM), which reduces operating costs while still maintaining the safety and reliability of commercial nuclear power plants (NPPs). To achieve the objective, risk models are being developed by taking advantage of advancements in data analytics, deep learning, machine learning (ML), and artificial intelligence (AI). The notable outcomes presented in the report include ? Development of a ML models using heterogeneous plant process and vibration data collected at different spatial and temporal resolutions from the Salem?s CWS to diagnose a circulating water pump (CWP) failure based on salient fault signatures. The developed diagnostic models are extendable to other faults associated with CWPs and CWP motors given associated fault signatures. ? Development of a natural language processing (NLP) technique to automatically classify the WO data into different categories. The developed NLP technique was validated on independent WO data. This automates the tedious and time-consuming activity of mining and classifying WOs by subject matter experts. ? Estimation of mean time between downtime (i.e., time duration between time instances when 1 or more CWPs are not available) and developed an approach to establish reliability of CWS components using unstructured WO data along with CWS plant process data. ? Formulation of economic model based on Markov chain models. The parameters of associated with the transition rate between different states of Markov chain models were estimated using WO data. The economic model formulation and discussion captures both time-independent and time-dependent parameter variation, leading to risk-informed decision-making.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2020

Automatic Seismic Phase Picking Using Deep Learning for the EGS Collab project

Microseismic monitoring plays an important role in many energy-related and environmental industries.The microseismic event catalog and seismic structure of the subsurface are two of the primary outputsof the microseismic monitoring system. Though rough locations of microseismic events can be estimated automatically, obtaining high-resolution microseismic event locations requires a significant amount of human laborespecially on seismic phase picking. Unlike traditional automatic pickers that are usually less precise than human analysts, a fewrecently proposed algorithms based on deepneural networks(DNN)were able to match or surpass human performance for earthquake signals. Due to differences in the spatial scale of the study area, sensor sampling rate, and geometry of the monitoring system, it is not clear whether these deepneural networkmodels can be used to speed up microseismic data processing. In this paper, we adapted the DNN based technique for automatic phase picking of microseismic signals. We usedmicroseismic data recorded at the experiment 1 site of the enhancedgeothermal system (EGS) Collab project anddesigneda workflowthat we call transfer-learning aided double-difference tomography (TADT),thatcombines transfer learning and seismic tomography. We re-train an existing DNN with our data to obtain a newmodel using around 3500 seismogramsand associated manual phase picks. Thistransfer learnedmodel is able to reach human performance but muchfaster than human analysts. The transfer-learning-derived phase pickswereused to improve microseismic event locations and imagethesubsurface. The results are similar to or slightly better than those obtained with manual phase picks.

Chai, Chengping↗

DOE OSTI2023

One-way transfer device with secure reverse channel

A data diode provides a flexible device for collecting data from a data source and transmitting the data to a data destination using one-way data transmission across a main channel. On-board processing elements allow the data diode to identify automatically the type of connectivity provided to the data diode and configure the data diode to handle the identified type of connectivity. Either or both of the inbound and outbound side of the data diode may comprise one or both of wired and wireless communication interfaces. A secure reverse channel, separate from the main channel, allows carefully predetermined communications from the data destination to the data source.

Lee, Sang Cheon↗

DOE OSTI2023

One-way transfer device with secure reverse channel

Lee, Sang Cheon↗