Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data processing automation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Autonomous Radiation Mapping and Quantification using an Unmanned Ground Vehicle. Part II - Autonomous Navigation

Nuclear sites across the Unites States and other nations in the world, are prone to extreme radiation effects. To understand the radiation hazards, plan the cleanup efforts; and to meet the quality standards and guidelines, it is important to accurately characterize any nuclear facility. One of the current methods in characterizing facilities is the use of advanced autonomous systems. These are safe, efficient, and cost-effective tools, which can safely deploy state-of-the-art instrumentation without exposing workers to radiation risks. Conventional methods of taking radiation measurements by hand within or around the containment areas, and analyzing the collected data to obtain the result are: Ineffective, Puts scientists at risk of Radiation, Not cost-effective. The platform uses the Robotic Operating Systems (ROS) to integrate multiple sensors seamlessly. It can operate near real time by using a distributed processing system to handle large amounts of data: Surrounding cameras, A multi-channel 3D Lidar, Manipulator arm, High-performance gamma-ray spectrometer.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2023

Automating the Solar Interconnection Technical Evaluation Process: PREconfiguring and Controlling Inverter SEt-Points (PRECISE)

Utilities are receiving an increasing number of interconnection requests for distributed solar photovoltaic (PV) systems from their customers, requiring a solution to quickly and intelligently perform technical assessments of these requests and to manage these new renewable energy assets. In this paper, we present a stand-alone interconnection tool, PREconfiguring and Controlling Inverter SEt-points (PRECISETM), and how it overcomes the challenges of accelerating technical evaluations and leverages smart inverter functionality to provide local voltage support on an as-needed basis. The paper details the purpose and architecture of PRECISE, including tools, data source requirements, the model-based interconnection evaluation process, and technical results. PRECISE is an integrated software tool that customizes PV inverter settings for utilities by modeling and assessing impacts on local voltages and the need for advanced inverter functions (AIFs) (e.g., volt-VAR and volt-watt). PRECISE maximizes the use of readily available utility data sets to make fast online assessments of incoming PV interconnection requests and makes accept/reject recommendations along with custom settings for AIFs.

ENERGY PLANNING, POLICY, AND ECONOMY,SOLAR ENERGY↗
DOE OSTI2021

Pycheron: A Python-Based Seismic Waveform Data Quality Control Software Package

Supplementing an existing high-quality seismic monitoring network with openly available station data could improve coverage and decrease magnitudes of completeness; however, this can present challenges when varying levels of data quality exist. Without discerning the quality of openly available data, using it poses significant data management, analysis, and interpretation issues. Incorporating additional stations without properly identifying and mitigating data quality problems can degrade overall monitoring capability. If openly available stations are to be used routinely, a robust, automated data quality assessment for a wide range of quality control (QC) issues is essential. To meet this need, we developed Pycheron, a Python-based library for QC of seismic waveform data. Pycheron was initially based on the Incorporated Research Institutions for Seismology’s Modular Utility for STAtistical kNowledge Gathering but has been expanded to include more functionality. Pycheron can be implemented at the beginning of a data processing pipeline or can process stand-alone data sets. Its objectives are to (1) identify specific QC issues; (2) automatically assess data quality and instrumentation health; (3) serve as a basic service that all data processing builds on by alerting downstream processing algorithms to any quality degradation; and (4) improve our ability to process orders of magnitudes more data through performance optimizations. This article provides an overview of Pycheron, its features, basic workflow, and an example application using a synthetic QC data set.

58 GEOSCIENCES↗
DOE OSTI2023

Deploying Automation Technology Supporting Packaging and Transportation Operations

Various United States Department of Energy (DOE) sites are investigating the deployment of robotics to provide safer, effective, and more efficient operations. By implementing robotics in packaging and transportation operations, improvements toward production efficiency, worker ergonomics, radiological dose reduction, and security assurance can be realized. Robotic Systems must be designed and implemented in concert with a facility’s safety basis, classification, and security constraints, while improving overall operational effectiveness. The desired robotic implementation should provide a path to potential long-term cost savings, reduce/eliminate hazardous conditions and radiological exposure, while improving quality and reliability of an operation process. The Savannah River Site (SRS), a DOE Site located in Aiken South Carolina, has initiated several large scale projects supporting future nuclear material disposition activities. Incorporation of automation and robotic equipment in system designs will support effective and efficient material handling operations, including container movements and packaging activities. Robotic systems will execute tasks that are precise, procedural and integrated with control systems to verify and record data for material inventory and historical archiving. An overview of the current robotic system development to perform receipt inspection, packaging, storage and shipment preparation activities of designated Type A and B shipping packages will be presented.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2026

ACDC (Automated Campbell Diagram Code) [SWR-26-042]

This application provides a web-based graphical user interface to generating Campbell Diagrams and visualizing mode shapes for OpenFAST turbine models. Determining the aeroelastic stability and dynamic characteristics of wind turbines is a critical step in turbine design and analysis. Historically, extracting natural frequencies and mode shapes from OpenFAST—the industry-standard whole-turbine simulation code—has been a fragmented and tedious process. It required manual model configuration, command-line linearization execution, and complex post-processing via proprietary scripts to handle rotating-frame dynamics. To address these workflow bottlenecks, we present the Automated Campbell Diagram Code (ACDC), an open-source graphical software tool developed by the National Laboratory of the Rockies (NLR) under the DOE-funded Distributed Wind Aeroelastic Modeling (dWAM) project. ACDC streamlines the end-to-end linearization and stability analysis workflow into a single, intuitive cross-platform application. The software guides users through OpenFAST model configuration, definition of operating points, and the automated execution of steady-state trim and linearization simulations. Under the hood, ACDC automates the complex mathematical post-processing steps required for rotating systems, including Multi-Blade Coordinate (MBC) transformations, eigenanalysis, and advanced modal tracking utilizing the Modal Assurance Criterion (MAC) and spectral clustering. Finally, ACDC processes these results to automatically generate Campbell diagrams and features a robust 3D visualization engine to animate full-system mode shapes. By eliminating the reliance on external post-processing environments and manual data manipulation, ACDC significantly accelerates dynamic analysis and lowers the barrier to entry for wind energy researchers and engineers.

Summerville, Brent [National Laboratory of the Roc↗
DOE OSTI2026

Livewire: A Model Platform for Data Quality Assessment and AI Readiness Across DOE Missions

High-quality, well-governed data is essential for accelerating discovery and achieving operational excellence across DOE and national laboratory missions. The Livewire Data Platform is a DOE-supported platform that offers automated assessments of data quality, standardization, provenance, and Artificial Intelligence (AI) readiness. It allows researchers and data practitioners to systematically and easily evaluate datasets against established governance criteria and prepare them for advanced analytics. Livewire addresses critical challenges in DOE's data ecosystem with integrated capabilities for metadata validation, provenance tracking, and schema alignment. This platform's automated workflows assist users in identifying data quality gaps, enhancing interoperability between datasets collected from various stakeholders, and ensuring compliance with DOE data standards, all while reducing manual curation efforts. Additionally, we will discuss its AI readiness framework, which is being developed to prepare datasets for training models, developing advanced analytic tools, and machine learning applications. Using some of the more than one hundred tabular datasets on Livewire, processed with this open-source methodology, we will demonstrate how Livewire can serve as a model for scalable, standards-driven data management. This approach provides a pathway to leverage existing and future datasets within the DOE, boosting innovation and efficiency across national laboratories.

33 - ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2023

In situ synchrotron X-ray total scattering measurements and analysis of colloidal CsPbX 3 nanocrystals during flow synthesis

In situ X-ray scattering measurements of CsPbX 3 (X = Cl, Br, I) nanocrystal formation and halide exchange at NSLS-II beamlines were performed in an automated flow reactor. Total scattering measurements were performed at the 28-ID-2 (XPD) beamline and small-angle X-ray scattering at the 16-ID (LiX) beamline. Nanocrystal structural parameters of interest, including size, size distribution and atomic structure, were extracted from modeling the total scattering data. The results highlight the potential of these beamlines and the measurement protocols described in this study for studying dynamic processes of colloidal nanocrystal synthesis in solution with timescales on the order of seconds.

nucleation↗
DOE OSTI2022

Automated bubble analysis of high-speed subcooled flow boiling images using U-net transfer learning and global optical flow

Capturing and analyzing the bubble dynamics is crucial to improving the understanding of boiling heat transfer mechanisms and predicting boiling heat transfer coefficient and boiling crisis. High speed video (HSV) imaging has been used for decades towards this end. Still, there is no universal approach to quantitatively analyze bubble dynamics from HSV images. In this study, we propose a data-driven post-processing approach to segment, track, and identify wall-attached vapor bubbles from HSV images of the boiling process in subcooled flow conditions. Firstly, we employ a transfer learning framework with a U-Net-based convolution neural network (CNN) architecture to detect and segment bubbles in HSV images of diverse contrast and surface texture using very little data (e.g., 10 images) for training. Then, we evaluate the trained CNN model with 100 ground-truth images, and the validation results show that the model accuracy and precision in detecting the optical footprint of bubbles are higher than 90%. Finally, we suggest a criterion to identify a condensing bubble based on the divergence of the bubble displacement, which is calculated from sequential segmented bubble images using a global optical flow code. Using this combination of machine learning and optical flow, we can identify nucleation sites and track the growth of bubbles nucleating at each site to quantify nucleation site density, nucleation frequency, and other fundamental boiling parameters. The proposed system is validated using results obtained on a special heater, which enables both infrared (IR) thermometry and HSV imaging on a metallic surface. We compare the fundamental boiling parameters obtained by the two different diagnostics. The results show good agreement. In conclusion, the difference between the measurements of nucleation site density, averaged nucleation frequency, and averaged growth time performed with the two techniques is always within ± 20% and mostly ± 10% of the values measured with IR thermometry.

42 ENGINEERING↗
DOE OSTI2022

A Qualitative Strategy for Fusion of Physics into Empirical Models for Process Anomaly Detection

To facilitate the automated online monitoring of power plants, a systematic and qualitative strategy for anomaly detection is presented. This strategy is essential to provide credible reasoning on why and when an empirical versus hybrid (i.e., physics-supported) approach should be used and to determine the ideal mix of these two approaches for a defined anomaly detection scope. Empirical methods are usually based on pattern, statistical, and causal inference. Hybrid methods include the use of physics models to train and test data methods, reduce data dimensionality, reduce data-model complexity, augment data, and reduce empirical uncertainty; hybrid methods also include the use of data to tune physics models. The presented strategy is driven by key decision points related to data relevance, simple modeling feasibility, data inference, physics-modeling value, data dimensionality, physics knowledge, method of validation, performance, data availability, and suitability for training and testing, cause-effect, entropy inference, and model fitting. The strategy is demonstrated through a pilot use case for the application of anomaly detection to capture a valve packing leak at the high-pressure coolant injection system of a nuclear power plant.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

AI-assisted detector design for the EIC (AID(2)E)

Artificial Intelligence is poised to transform the design of complex, large-scale detectors like ePIC at the future Electron Ion Collider. Featuring a central detector with additional detecting systems in the far forward and far backward regions, the ePIC experiment incorporates numerous design parameters and objectives, including performance, physics reach, and cost, constrained by mechanical and geometric limits. This project aims to develop a scalable, distributed AI-assisted detector design for the EIC (AID(2)E), employing state-of-the-art multiobjective optimization to tackle complex designs. Supported by the ePIC software stack and using G EANT 4 simulations, our approach benefits from transparent parameterization and advanced AI features. The workflow leverages the PanDA and iDDS systems, used in major experiments such as ATLAS at CERN LHC, the Rubin Observatory, and sPHENIX at RHIC, to manage the compute intensive demands of ePIC detector simulations. Tailored enhancements to the PanDA system focus on usability, scalability, automation, and monitoring. Ultimately, this project aims to establish a robust design capability, apply a distributed AI-assisted workflow to the ePIC detector, and extend its applications to the design of the second detector (Detector-2) in the EIC, as well as to calibration and alignment tasks. Additionally, we are developing advanced data science tools to efficiently navigate the complex, multidimensional trade-offs identified through this optimization process.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Detect the Unobservable: Abnormality Detection in mixed Autonomy for Lane Change Maneuver with Following Vehicles’ Trajectories Only

Highly Automated Vehicles (HAVs) and Advanced Driver-Assistance Systems (ADAS) are transforming modern transportation with enhanced mobility, safety, and efficiency. Despite their advantages, cybersecurity vulnerabilities in these systems can lead to abnormal behavior, posing significant risks to surrounding human-driven vehicles (HDVs) in mixed traffic environments. Here, this article addresses the challenge of detecting abnormal lateral movements of HAVs/ADAS vehicles using only trajectory profiles of following HDVs. Specifically, we propose a novel modeling approach that captures both normal and abnormal lateral behaviors through vehicle kinematics, integrated decision-making processes, vehicle control using symbolic regression for lane change vehicles. Additionally, we introduce an abnormality detection framework that relies on observable HDV data, even in occlusion scenarios. The framework evaluates the sensitivity of various car-following models to detect abnormal behaviors, providing insights into the interaction between HAVs/ADAS and HDVs in mixed autonomy systems.

Connected and Automated vehicles↗
DOE OSTI2021

Pipe Parity Analysis of Seawater Desalination in the United States: Exploring Costs, Energy, and Reliability via Case Studies and Scenarios of Emerging Technology

As climate change-induced variables exacerbate water scarcities, the use of seawater reverse osmosis (SWRO) membrane desalination technology for treating seawater could potentially provide a long-term drought-proof source of drinking water. This study carried out a technoeconomic assessment (TEA) for three SWRO desalination plants in the U.S. and one in Israel to set baselines for the cost and energy consumption for seawater desalination. In addition, a breakeven curve for implementing SWRO desalination was estimated in relation to the cost of water conservation measures to meet drought-induced reduction of the traditional water supply. The results show that the cost of SWRO water production scales with the plant capacity while energy intensity is not dramatically different across the plants. The higher cost in some U.S. plants is due to high capital investment, including land acquisition and permitting. Variations in plant capacity utilization have the greatest impact on the levelized cost of water (LCOW) over the plant service life, suggesting the importance of reducing fouling and maintenance-related downtime. Scenario analysis of fixed labor cost reduction through process automation indicates investments in automation and sensing technology could result in long-term savings. Breakeven analysis shows the decision to adopt SWRO is highly dependent on the local cost associated with water conservation to meet water supply reduction. Moreover, a small reduction in SWRO cost can influence a shift toward the adoption of SWRO over water conservation measures. Incorporation of future water demand, water conservation potential, and water stress data around the nation indicates SWRO desalination could be an important contributor to the future municipal drinking water portfolio in the U.S.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

Cropland abandonment between 1986 and 2018 across the United States: spatiotemporal patterns and current land uses

Knowing where and when croplands have been abandoned or otherwise removed from cultivation is fundamental to evaluating future uses of these areas, e.g. as sites for ecological restoration, recultivation, bioenergy production, or other uses. However, large uncertainties remain about the location and time of cropland abandonment and how this process and the availability of associated lands vary spatially and temporally across the United States. Here, we present a nationwide, 30 m resolution map of croplands abandoned throughout the period of 1986–2018 for the conterminous United States (CONUS). We mapped the location and time of abandonment from annual cropland layers we created in Google Earth Engine from 30 m resolution Landsat imagery using an automated classification method and training data from the U.S. Department of Agriculture Cropland Data Layer. Our abandonment map has overall accuracies of 0.91 and 0.65 for the location and time of abandonment, respectively. From 1986 to 2018, 12.3 (±2.87) million hectares (Mha) of croplands were abandoned across CONUS, with areas of greatest change over the Ogallala Aquifer, the southern Mississippi Alluvial Plain, the Atlantic Coast, North Dakota, northern Montana, and eastern Washington state. The average annual nationwide abandoned area across our study period was 0.51 Mha per year. Annual abandonment peaked between 1997 and 1999 at a rate of 0.63 Mha year –1 , followed by a continuous decrease to 0.41 Mha year –1 in 2009–2011. Among the abandoned croplands, 53% (6.5 Mha) changed to grassland and pasture, 18.6% (2.28 Mha) to shrubland and forest, 8.4% (1.03 Mha) to wetlands, and 4.6% (0.56 Mha) to non-vegetated lands. Of the areas that we mapped as abandoned, 19.6% (2.41 Mha) were enrolled in the Conservation Reserve Program as of 2020. Our new map highlights the long-term dynamic nature of agricultural land use and its relation to various competitive pressures and land use policies in the United States.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Machine Learning Atom Probe Tomography Tool For Automatic And Fast Clustering

The software uses a YOLO11 segmentation model trained on synthetic data to analyze APT datasets. The workflow operates as follows: 1. Data Slicing: The APT dataset is divided into multiple 2D cross-sections of a specified thickness. 2. Segmentation: The model identifies point-dense regions within each 2D slice. 3. 3D Reconstruction: Detected regions (masks) from all slices are combined and reconstructed back into the original 3D space, forming clusters. The integration with HPC resources enables the software to process large-scale APT datasets efficiently. This combination of automation and scalability reduces manual intervention, improves reproducibility, and accelerates the clustering workflow.

Tang, Yalei [Idaho National Laboratory (INL), Idah↗
DOE OSTI2022

Novel Proposals for FAIR, Automated, Recommendable, and Robust Workflows

Lightning talks of the Workflows in Support of Large-Scale Science (WORKS) workshop are a venue where the workflow community (researchers, developers, and users) can discuss work in progress, emerging technologies and frameworks, and training and education materials. This paper summarizes the WORKS 2022 lightning talks, which cover five broad topics: data integrity of scientific workflows; a machine learning-based recommendation system; a Python toolkit for running dynamic ensembles of simulations; a cross-platform, high-performance computing utility for processing shell commands; and a meta(data) framework for reproducing hybrid workflows.

Abhinit, Ishan↗
DOE OSTI2026

Automating Detection and Diagnosis of Faults, Failures, and Underperformance in PV Plants

The project developed hybrid physics-based and machine-learning methods for near-real-time detection of balance-of-system faults (e.g., string, combiner, and tracker outages) in utility-scale Photovoltaic plants, achieving over 50% true positive rates with under 10% false positives and significantly reducing engineering setup time. In the extended phase, the scope expanded to plant-level underperformance analysis and industry benchmarking through the SUPER.epri.com platform. SUPER standardizes data processing and performance metrics across more than 9 GWac and 120+ plants, enabling robust comparisons and insights into loss rates, inverter downtime, and capacity degradation.

14 SOLAR ENERGY↗
DOE OSTI2023

AI ATAC 1: An Evaluation of Prominent Commercial Malware Detectors

This work presents an evaluation of six prominent commercial endpoint malware detectors, a network malware detector, and a file-conviction algorithm from a cyber technology vendor. The evaluation was administered as the first of the Artificial I ntelligence Applications t o Autonomous Cybersecurity (AI ATAC) prize challenges, funded by / completed in service of the US Navy. The experiment employed 100K files (50/50% benign/malicious) with a stratified distribution of file types, including ~1K zero-day program executables (increasing experiment size two orders of magnitude over previous work). We present an evaluation process of delivering a file to a fresh virtual machine donning the detection technology, waiting 90s to allow static detection, then executing the file and waiting another period for dynamic detection; this allows greater fidelity in the observational data than previous experiments, in particular, resource and time-to-detection statistics. To execute all 800K trials (100K files × 8 tools), a software framework is designed to choreograph the experiment into an automated, time-synced, and reproducible workflow with substantial parallelization. Software with base classes for this framework are provided. A cost-benefit model was configured to integrate the tools’ detection statistics into a comparable quantity by simulating costs of use. This provides a ranking methodology for cyber competitions and a lens for reasoning about the varied statistical results. The results provide insights on state of commercial malware detection.

Bridges, Robert↗
DOE OSTI2021

INTEGRATE - Inverse Network Transformations for Efficient Generation of Robust Airfoil and Turbine Enhancements

The INTEGRATE (Inverse Network Transformations for Efficient Generation of Robust Airfoil and Turbine Enhancements) project is developing a new inverse-design capability for the aerodynamic design of wind turbine rotors using invertible neural networks. This AI-based design technology can capture complex non-linear aerodynamic effects while being 100 times faster than design approaches based on computational fluid dynamics. This project enables innovation in wind turbine design by accelerating time to market through higher-accuracy early design iterations to reduce the levelized cost of energy. INVERTIBLE NEURAL NETWORKS Researchers are leveraging a specialized invertible neural network (INN) architecture along with the novel dimension-reduction methods and airfoil/blade shape representations developed by collaborators at the National Institute of Standards and Technology (NIST) learns complex relationships between airfoil or blade shapes and their associated aerodynamic and structural properties. This INN architecture will accelerate designs by providing a cost-effective alternative to current industrial aerodynamic design processes, including: - Blade element momentum (BEM) theory models: limited effectiveness for design of offshore rotors with large, flexible blades where nonlinear aerodynamic effects dominate - Direct design using computational fluid dynamics (CFD): cost-prohibitive - Inverse-design models based on deep neural networks (DNNs): attractive alternative to CFD for 2D design problems, but quickly overwhelmed by the increased number of design variables in 3D problems AUTOMATED COMPUTATIONAL FLUID DYNAMICS FOR TRAINING DATA GENERATION - MERCURY FRAMEWORK The INN is trained on data obtained using the University of Marylands (UMD) Mercury Framework, which has with robust automated mesh generation capabilities and advanced turbulence and transition models validated for wind energy applications. Mercury is a multi-mesh paradigm, heterogeneous CPU-GPU framework. The framework incorporates three flow solvers at UMD, 1) OverTURNS, a structured solver on CPUs, 2) HAMSTR, a line based unstructured solver on CPUs, and 3) GARFIELD, a structured solver on GPUs. The framework is based on Python, that is often used to wrap C or Fortran codes for interoperability with other solvers. Communication between multiple solvers is accomplished with a Topology Independent Overset Grid Assembler (TIOGA). NOVEL AIRFOIL SHAPE REPRESENTATIONS USING GRASSMAN SPACES We developed a novel representation of shapes which decouples affine-style deformations from a rich set of data-driven deformations over a submanifold of the Grassmannian. The Grassmannian representation as an analytic generative model, informed by a database of physically relevant airfoils, offers (i) a rich set of novel 2D airfoil deformations not previously captured in the data , (ii) improved low-dimensional parameter domain for inferential statistics informing design/manufacturing, and (iii) consistent 3D blade representation and perturbation over a sequence of nominal shapes. TECHNOLOGY TRANSFER DEMONSTRATION - COUPLING WITH NREL WISDEM Researchers have integrated the inverse-design tool for 2D airfoils (INN-Airfoil) into WISDEM (Wind Plant Integrated Systems Design and Engineering Model), a multidisciplinary design and optimization framework for assessing the cost of energy, as part of tech-transfer demonstration. The integration of INN-Airfoil into WISDEM allows for the design of airfoils along with the blades that meet the dynamic design constraints on cost of energy, annual energy production, and the capital costs. Through preliminary studies, researchers have shown that the coupled INN-Airfoil + WISDEM approach reduces the cost of energy by around 1% compared to the conventional design approach. This page will serve as a place to easily access all the publications from this work and the repositories for the software developed and released through this pr...

aerodynamics↗