SEARCH · Engineering Papers

Results for “data conditioning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

All sources NASA NTRS DOE OSTI

DOE OSTI2024

LiDAR Point Cloud Data from the 2018 NGEE Arctic UAS Campaign at the Kougarok 64 Field Site, Seward Peninsula, Alaska

Airborne remote sensing data collected from Los Alamos National Laboratory's (LANL) heavy-lift unoccupied aerial system (UAS) hexacopter platform operated by NGEE Arctic scientists from the EES-14 group at Los Alamos National Laboratory. These data were collected in July 2018 at a field site near mile marker 64 along the Kougarok road (Nome-Taylor Highway) between Nome, Alaska and Taylor, Alaska. A DJI Matrice 600 Pro Airframe and Routescene UAV LiDARSystem was used to collect LiDAR data. The LiDAR data has undergone basic post-processing using Routescene LidarViewer Pro software to create point cloud data (.laz files). This data package contains point clouds (.laz), processing metadata files (json.lvp), and post-processed kinematic files (.csv). Ancillary aircraft data, flight mission parameters, weather conditions, raw LiDAR data, and RGB imagery can be found in NGA298.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

HERO WEC V1.0 2024 - WEC-Sim Detailed Simulation Runs and Summary Data

This dataset includes results from simulations of NREL's hydraulic and electric reverse osmosis wave energy converter (HEREO WEC). Simulation runs include 135 wave cases that were based on the updated WEC-Sim model, which is linked below. The data represented in this repository is based on an updated WEC-Sim model using laboratory data to tune and refine the original WEC-Sim model for the V1.0 HERO WEC. The 135 wave cases represent waves with the following wave height and wave period ranges: - Significant Wave Height: 0.25 - 3.75m in 0.25m increments - Wave Period: 5 - 13 sec in 1 sec increments Each run was simulated using a Pierson-Moskowitz irregular wave spectrum with a 100 second ramp time, a total simulation time of 3,100 seconds, and a simulation time-step of 0.005s. A reference table has been included to map each multi condition run (MCR) case with each wave condition. Summary data set includes a spreadsheet and image files with matrices that are associated with data from simulation runs. All matrices cover the same significant wave height and wave periods from the simulation runs, in the same increments. The following matrices are included: - Power Abs: The average absorbed power from the WEC (calculated from anchor reaction force and heave velocity) - Power Hyd: The average hydraulic power output at pump (calculated from pump output flow and pressure) - Power - Hyd ROi: The average hydraulic power measured at the RO system inlet (calculated from RO system pressure and flow (pre-accumulator)) - Flow - Pump out: The average flowrate measured at the pump outlet - Flow - Perm: The average permeate (clean water) production - Flow - RO (pre): The average flowrate measured at the inlet of the RO system before the accumulators - Flow - RO (post): The average flowrate measured after the accumulator bank in the RO system - Pressure - RO: The average pressure measured at the inlet of the RO system This data set has been developed by the National Renewable Energy Laboratory, operated by the Alliance for Sustainable Energy, LLC, for the U.S. Department of Energy (DOE) under Contract No. DE-AC36-08GO28308. Funding provided by the U.S. Department of Energy Office of Energy Efficiency and Renewable Energy Water Power Technologies Office.

16 TIDAL AND WAVE POWER↗

DOE OSTI2025

JHTDB-wind: a web-accessible large-eddy simulation database of a wind farm with virtual sensor querying

This paper introduces JHTDB-wind (https://turbulence.idies.jhu.edu/datasets/windfarms, last access: 11 November 2025), a publicly accessible database containing large-eddy simulation (LES) data from wind farms. Building on the framework of the Johns Hopkins Turbulence Database (JHTDB), which hosts direct numerical simulation (DNS) and some LES datasets of canonical turbulent flows, JHTDB-wind stores the 4D space–time history of the flow and provides users the ability to access and query the data via a web-based virtual sensor interface. The initial dataset comprises LES results from a large wind farm with 10×6 turbines, modeled using a filtered actuator line method, under conventionally neutral atmospheric conditions. These data comprise 1 h (hour) of flow field data (velocity, pressure, potential temperature deviation, subgrid-scale (SGS) eddy viscosity, and turbine forces, approximately 15 TB (terabytes) and wind turbine data – including both turbine-level operational quantities and blade-level aerodynamic quantities (approximately 1.3 TB) – stored in Zarr and Parquet formats, respectively. Data retrieval is facilitated by the giverny Python package, allowing remote users to query the database in Python or MATLAB (C and Fortran support are available for flow field data). This paper details the simulation setup and demonstrates data access through examples that analyze wind farm flow structures and turbine performance. The framework is extensible to future datasets, including the JHTDB-wind diurnal cycle simulation analyzed in Xiao et al. (2025).

17 WIND ENERGY↗

DOE OSTI2026

CMS Storage Performance with RNTuple

CMS is transitioning to use ROOT’s new RNTuple data storage format for the files CMS will write in the HL-LHC era. Based on initial tests, CMS expects faster I/O and smaller files compared to the present TTree storage format. This contribution will show a comprehensive performance comparison between RNTuple and TTree I/O using CMS AOD and MiniAOD data formats as test cases for both simulation and collision data corresponding to similar data taking conditions of LHC Run 3. Quantities such as the resulting file size, the memory usage of the I/O components, and the rate of events being read from a file or written to a file will be measured. CMS’ data processing relies heavily on reading files over the local or wide area networks. The file read patterns are important because the latencies have been seen to influence the total production job times. Therefore a study on the file read patterns will be conducted by recording traces of the offset, size, and timestamp of each read request for both RNTuple and TTree. The behavior of network reads will be mimicked by reading local files where artificial latency will be added to the read requests. The effect of different latency values on the job times will be studied.

Jones, Christopher D. [Fermilab]↗

DOE OSTI2020

Wireless Sensing and Communication Capability from In-Core to a Monitoring Center

Significant cost savings can be made if electrical cables can be replaced by wireless technology in current Nuclear Power Plants (NPP) and in advance reactor designs. Wireless technology can also provide in-core opportunities by significantly reducing the number of penetrations in the pressure vessel, cost and complexity of sensor installation and by increasing the efficiency of current and advanced reactors. Unlike other deployment scenarios for an industrial environment, operators need to have centralized control over all the networks. Centralized control will reduce implementation costs, provide single point control and enable monitoring of network devices, improve security, and enhance connectivity. Micro-sensors that can simultaneously monitor temperature and pressure within a fuel rod inside nuclear reactors will enable preventative actions during abnormal operating conditions. This ability could avert accidents and enable the expedient development of accident tolerant fuels. A novel micro-sensor suite (~ mm) to simultaneously measure multiple parameters such as temperature, strain, pressure, and neutron/gamma flux inside a fuel rod is being developed for use in reactors. The necessary communication architecture is also being developed to transmit measurement signals from the core to the plant's data cloud or control room. A three three-tier strategy has been developed to support wireless transmission of in-core measurements to the control room or to a secure cloud platform for control, analytics, and decision-making purposes. 1. In-core: data signal from in-core to outside of the pressure vessel within the containment building 2. Containment building: data signal from inside to the outside of the containment building and into the balance of the plant network 3. Balance of the plant network: information transmitted to the data cloud and control room This plan presents a wireless sensing and communication system for use within a reactor core and elsewhere. The communication technology is advantageous to compensate for network equipment failures and adverse data transmission conditions. Wireless technology will significantly increase the resiliency of the plants network system. The wireless system naturally provides multiple transmission path capability and data redundancy.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2026

Knowledge-guided graph machine learning for spatially distributed prediction of daily discharge and nitrogen export dynamics

Spatially distributed prediction of streamflow and nitrogen export dynamics is essential for precision management of agricultural watersheds. While temporal deep learning models such as Long Short-Term Memory (LSTM) have shown strong performance at basin scales, their ability to generalize spatially is limited by insufficient representation of spatial dependencies and flow paths, particularly under data-scarce conditions. To address this gap, we propose HydroGraphNet, a knowledge-guided graph machine learning framework that integrates process-based knowledge and explicit spatial learning into temporal modeling. This framework incorporates directed graph topology to encode watershed connectivity and upstream inflows, with mass balance constraints to improve physical consistency. To enhance generalization in sparsely monitored regions, HydroGraphNet is pretrained on synthetic data generated by the SWAT+ (Soil and Water Assessment Tool Plus) model. We evaluated HydroGraphNet in the Upper Sangamon River Basin (44 HUC-12 subwatersheds, 2001–2020) against two LSTM baselines: a lumped basin-level model and a distributed variant. When benchmarked on SWAT+ simulations in pretraining, HydroGraphNet improved test NSEs by 8.9% (discharge) and 13.7% (NO₃–N load) in temporal extrapolation, and by 27.1% and 34.7% in spatial extrapolation, relative to the Lumped LSTM baseline. After fine-tuning with USGS monitoring data, the model achieved mean test NSE (KGE) scores of 0.768 (0.861) for discharge and 0.626 (0.664) for NO₃–N load, substantially outperforming baselines. Attribution analysis further highlighted the importance of upstream inflow representation and graph-based spatial learning in capturing cross-subwatershed dependencies. The model also reproduced seasonal hydrological and biogeochemical patterns consistent with known processes, demonstrating its robustness and process fidelity for spatially distributed prediction. Altogether, HydroGraphNet advances the integration of physical knowledge and spatially explicit learning in hydrological modeling, offering a generalizable framework for distributed modeling to support spatially targeted water quality management in data-scarce watersheds.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

Global Evaluation of Process Conditions and Wave Modes in a Rotating Detonation Engine

Rotating Detonation Engines (RDEs) show significant promise for enhancing the efficiency of gas turbine engines while maintaining low 𝑁𝑂𝑥 emissions. This work investigates the predictability of wave modes in a water-cooled RDE under varying operational conditions. Experimental data comprising over 6,700 samples was collected, including parameters such as flow rates, temperatures, pressures, and equivalence ratios. A machine learning approach using the XGBoost library was used to build a multi-class classifier, predicting wave modes based on these inputs. The model achieved a high accuracy of 97%, demonstrating that wave modes are not random but deterministic based on the process conditions. SHAP analysis was used to identify the most influential parameters affecting wave mode prediction. The results show that for the water-cooled NETL RDE, wave mode is determinant and predictable based on the process parameters.

Weber, Justin [NETL] (ORCID:0000000218487035)↗

DOE OSTI2022

InClass nets: independent classifier networks for nonparametric estimation of conditional independence mixture models and unsupervised classification

Abstract Conditional independence mixture models (CIMMs) are an important class of statistical models used in many fields of science. We introduce a novel unsupervised machine learning technique called the independent classifier networks (InClass nets) technique for the nonparameteric estimation of CIMMs. InClass nets consist of multiple independent classifier neural networks (NNs), which are trained simultaneously using suitable cost functions. Leveraging the ability of NNs to handle high-dimensional data, the conditionally independent variates of the model are allowed to be individually high-dimensional, which is the main advantage of the proposed technique over existing non-machine-learning-based approaches. Two new theorems on the nonparametric identifiability of bivariate CIMMs are derived in the form of a necessary and a (different) sufficient condition for a bivariate CIMM to be identifiable. We use the InClass nets technique to perform CIMM estimation successfully for several examples. We provide a public implementation as a Python package called RainDancesVI.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2025

Evaluating the limitations of Bayesian metabolic control analysis

AbstractBayesian Metabolic Control Analysis (BMCA) has emerged as a promising framework for inferring metabolic control coefficients in data-limited scenarios by integrating Bayesian inference with linlog rate laws. However, its predictive accuracy and limitations remain underexplored. This study systematically evaluates BMCA’s ability to infer elasticity values, flux control coefficients (FCCs), and concentration control coefficients (CCCs) under varying data availability conditions using three synthetic metabolic network models. Our findings highlight the strengths and weaknesses of BMCA, guiding its application in metabolic engineering and emphasizing the need for methodological refinements.Author summaryUnderstanding how enzymes control metabolic pathways is crucial for optimizing biomanufacturing and synthetic biology applications. Bayesian Metabolic Control Analysis (BMCA) is a promising computational method that integrates Bayesian inference with metabolic control analysis to estimate key control parameters, even in cases with limited experimental data. However, the accuracy and limitations of BMCA remain unclear. In this study, we systematically evaluate BMCA using three synthetic metabolic networks to determine how different types of physiological data impact its predictive performance. We find that BMCA requires flux and enzyme concentration data for accurate predictions, while external metabolite concentrations contribute little. Additionally, BMCA fails to predict elasticity values beyond a magnitude of 1.5 and reliably infer allosteric regulation, even when strong regulatory interactions exist. In addition, BMCA does not accurately rank metabolic control points, which may limit its utility in identifying key enzymes in engineered pathways. Our work provides practical insights into when and how BMCA can be applied, guiding future research in metabolic modeling and control analysis.

Shin, Janis (ORCID:0000000216572455)↗

DOE OSTI2022

Statistical framework to assess long-term spatio-temporal climate changes: East River mountainous watershed case study

Abstract Evaluation of long-term temporal and spatial climatic change in mountainous regions is a critical challenge because of the interactive effects of multiple land and climatic factors and processes. Here we present the application of the statistical framework to the assessment of changes of climatic conditions, using data from 17 meteorological stations across the East River watershed near Crested Butte, Colorado, USA, and spanning the period from 1966 to 2021. The framework is developed based on (1) a time-series analysis of daily, monthly, and yearly averaged meteorological parameters (temperature, relative humidity, precipitation, wind speed, etc.), (2) evaluation and time series analysis of potential evapotranspiration (ET o ), actual evapotranspiration (ET), aridity index (AI), standard precipitation index (SPI) and standard precipitation-evapotranspiration index (SPEI), and (3) a temporal-spatial climatic zonation of the studied area based on the hierarchical clustering and PCA analysis of the SPEI, because the SPEI can be considered an integrative characteristic of the changes of climatic conditions. The Budyko model, with the application of the Penman–Monteith equation for the estimation of ET o , was used to determine the ET. The time series analysis of the AI is used to identify the periods with energy limited and water limited conditions. Hierarchical clustering of site locations for the three temporal segments of the SPEI showed a significant temporal-spatial shifts, indicating that dynamic climatic processes drive zonation patterns. Therefore, the watershed climatic zonation requires periodic re-evaluation based on the structural time series analysis of meteorological and water balance data.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

New Particle Formation Event Dataset at the Southern Great Plains (SGP) Observatory from 2018 to 2023

This data set contains observations of new particle formation (NPF) events collected at the U.S. Department of Energy’s Atmospheric Radiation Measurement (ARM) Southern Great Plains (SGP) observatory from 2018 to 2023. Measurements include particle number size distributions, radiance measurements, and associated meteorological variables from onsite instrumentation relevant for identifying and characterizing NPF events. Events were identified using standardized criteria and documented to support investigations of aerosol nucleation, growth dynamics, and their interactions with local atmospheric conditions. The data set provides a multi-year record that enables evaluation of seasonal and interannual variability in NPF occurrence and intensity at a mid-continental site. These data are intended to support studies of aerosol-cloud-climate interactions and model evaluation within both ARM and the broader atmospheric science community. More information can be found within the README_NPF_SGP_2018_2023.docx file.

event↗

DOE OSTI2020

Data Analytics Applied to Coal Fired Boilers for Detecting Leaks

Data analytics were used to detect boiler leaks from five different coal-fired boilers including both subcritical and supercritical systems. Discriminant functions were developed that detected leaks up to two weeks prior to forced plant shutdowns for repairs. The leaks were identified to occur at different sections of the boiler for each plant, including waterwalls, economizer and superheater using conventional process measurement data. Leaking conditions were detected with a high degree of confidence (&NestedLessLess; 1% misclassified observations) and were able to distinguish normal operations from those time periods with steam leaks even while operating the power plants in power cycling mode.Multivariable statistical analyses, including Principal Component (PCA), cluster, and Fischer Discriminant Analysis (FDA) were used to characterize the leak occurrence. Normal and operational states with steam leaks were provided in the original process datasets. These datasets were split into two different groups for training and validation purposes. The data were sorted chronologically, and every third observation was assigned to training the Discriminant Function Model (DFM) while the rest were reserved for validation. PCA was used to reduce dimensionality of the original datasets. Canonical and FDA analyses were used to investigate the relationship between process variables. The outcome of the analyses revealed that nearly 35,000 observations were classified correctly; less than 0.05% of total observations were misclassified to be leaking, i.e. both false positives and false negatives.

Indrawan, Natarianto↗

DOE OSTI2024

GRIDCERF - Geospatial Raster Input Data for Capacity Expansion Regional Feasibility

The Geospatial Raster Input Data for Capacity Expansion Regional Feasibility (GRIDCERF) data package is a high-resolution product to evaluate siting suitability for renewable and non-renewable power plants in the conterminous United States. GRIDCERF offers hundreds of individual suitability layers for use with both renewable and non-renewable power plant technology configurations in a harmonized format that can be easily ingested by geospatially-enabled modeling software. It also provides pre-compiled technology-specific suitability layers and allows for user customization to robustly address science objectives when evaluating varying future conditions. GRIDCERF data can be directly used with the CERF (Capacity Expansion Regional Feasibility) model to site power plants at a 1km resolution. GRIDCERF includes composite technology siting suitability raster layers for the following utility scale technology configurations. Note that, in addition to technology sub-types shown below, various cooling types are also included (recirculating, pond, once-through, recirculating-seawater, dry-hybrid, or dry) for various technologies. Biomass Conventional (with or without CCS) IGCC (with or without CCS) Coal Conventional (with or without CCS) IGCC (with or without CCS) Natural Gas Combined-cycle (CC) (with or without CCS) Turbine Geothermal Enhanced Geothermal Systems (EGS) - Class 1 through Class 5 resource potential Nuclear Gen 2 Light Water Reactor (LWR) Gen 3 Small Modular Reactor (SMR) Gen 3 AP1000 Refined Liquids Combined-cycle (CC) (with or without CCS) Turbine Solar Photovoltaic (PV) - for capacity factors in the range of 6-18% Utility-scale Concentrating Solar Power (CSP) - for capacity factors in the range of 24-46% Tower Wind (Onshore) - for capacity factors in the range of 5-50% 80m hub height 100m hub height 120m hub height 140m hub height Wind (Offshore) - for capacity factors in the range of 25-60% 100m hub height 140m hub height 160m hub height

capacity expansion↗

DOE OSTI2026

GRIDCERF - Geospatial Raster Input Data for Capacity Expansion Regional Feasibility

capacity expansion↗

DOE OSTI2022

Methodology to determine the coupling of continental clouds with surface and boundary layer height under cloudy conditions from lidar and meteorological data

Abstract. The states of coupling between clouds and surface or boundary layer have been investigated much more extensively for marine stratocumulus clouds than for continental low clouds, partly due to more complex thermodynamic structures over land. A manifestation is a lack of robust remote sensing methods to identify coupled and decoupled clouds over land. Following the idea for determining cloud coupling over the ocean, we have generalized the concept of coupling and decoupling to low clouds over land, based on potential temperature profiles. Furthermore, by using ample measurements from lidar and a suite of surface meteorological instruments at the U.S. Department of Energy's Atmospheric Radiation Measurement Program's Southern Great Plains site from 1998 to 2019, we have developed a method to simultaneously retrieve the planetary boundary layer (PBL) height (PBLH) and coupled states under cloudy conditions during the daytime. The new lidar-based method relies on the PBLH, the lifted condensation level, and the cloud base to diagnose the cloud coupling. The coupled states derived from this method are highly consistent with those derived from radiosondes. Retrieving the PBLH under cloudy conditions, which has been a persistent problem in lidar remote sensing, is resolved in this study. Our method can lead to high-quality retrievals of the PBLH under cloudy conditions and the determination of cloud coupling states. With the new method, we find that coupled clouds are sensitive to changes in the PBL with a strong diurnal cycle, whereas decoupled clouds and the PBL are weakly related. Since coupled and decoupled clouds have distinct features, our new method offers an advanced tool to separately investigate them in climate systems.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

Aerial and Processed Model Data Representing As-built Conditions in Coastal Port Arthur, Texas in May 2025

This dataset was collected by the Co-Design Team of the Southeast Texas Urban Integrated Field Lab, a research initiative led by the University of Texas at Austin and funded by the U.S. Department of Energy. The broader project focuses on developing climate-resilient design solutions for the Beaumont–Port Arthur region, with more information available at www.setx-uifl.org. Our team conducted aerial surveys of the Port Arthur coastal neighborhood in May 2025, before the start of construction scheduled for Summer 2026. These pre-construction datasets are designed to facilitate comparative analyses, including pre- and post-construction assessments and simulated inundation scenario evaluations. Aerial images were captured using DroneDeploy autonomous flight systems, with imagery processed through the DroneDeploy engine. All original aerial photographs are provided in JPG format and organized in zipped folders by area. The processed data package includes: 3D surface models Orthomosaics Geospatial and topographic mappings Point clouds For guidance on file contents, structure, and recommended usage, please refer to the included README file.

2D mapping↗

DOE OSTI2021

Clear Sky Irradiance Year-to-Year Variations and Trends

Solar radiation data for seven SURFRAD stations for the period 1996-2018 show an increase in irradiance under clear skies over the period, but the increase was not constant and shorter periods may have even experienced decreases in irradiance. A popular implementation of a clear sky model provided modeled irradiances for comparison with the SURFRAD data under conditions screened for clear skies. The use of the clear sky model, which did not consider year-to-year variances in atmospheric turbidity, was found problematic for resolving small changes in irradiance important for determining PV system degradation over three or five years, but less problematic for a period of ten years.

41 EE - Solar Energy Technologies Office (EE-4S)↗

DOE OSTI2024

Muon Flux Variance from Severe Atmospheric Conditions

We analyze data from the European Centre for Medium-Range Weather Forecasts (ECMWF) and the QuarkNet Research Group at Fermilab to study the variance in muon flux due to extreme weather conditions. We considered three high-intensity storms for each season: winter, spring, and summer. The most significant observation was during winter, with a ~125% increase in muon flux corresponding to a temperature drop of ~20K. Additionally, we are developing CosmicWatch muon detectors to be used in tests for the MMBC/MAMBA Bubble Chamber. A pair of these detectors will be employed to trigger on muons, providing extremely precise and inexpensive tracking granularity in the form of a muon telescope.

Aamir, Yusuf↗