Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “validation dataset”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

Toroidal injection angle dependence of EC assisted plasma initiation at DIII-D

An experimental scan of the electron cyclotron waves (EC) toroidal injection angle in plasma breakdown is performed at the DIII-D tokamak. The second harmonic, extraordinary mode EC is used for the study. The dependence of n e and T e on the EC injection angle cannot be conclusively drawn from this study due to the large error bars in the n e and T e measurements. On the other hand, high T e data points are observed in some discharges which can be explained by nonlinear heating. The D α emission measurement shows a clear relation between the breakdown time and the injection angle. An experimental investigation of the cause of the dependence of breakdown delay on the EC injection angle suggests that when the injection angle is oblique, the EC heating after the reflection at the inboard wall may become ineffective and cause the breakdown delay even when the EC heating before and directly upon injection remains effective. A preliminary run of the heat and transport balance code DYON indicates that the obtained dataset is suitable for a quantitative validation of EC absorption models.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Linking Threat Agents to Targeted Organizations: A Pipeline for Enhanced Cybersecurity Risk Metrics

In this study, we present a methodology leveraging Large Language Models (LLMs) to transform Cybersecurity Threat Intelligence (CTI) narratives into actionable insights for individual organizations. Our approach automates the extraction of machine-readable adversary SKRAM (Skills, Knowledge, Resources, Authorities, and Motivation) attributes from open-source reports, extending LLM utility beyond typical interactions. This innovation enables precise, automated assessments of cybersecurity risks posed by various adversaries. Using a chain-of-thought and multi-shot prompting strategy, our methodology advances the automation of cybersecurity feature extraction for new machine-learning models that predict the risk of adversary targeting. This approach is refined using a substantial dataset of over 150 analyst-validated threat reports and synthetic organizational data from 900 companies. Here, by bootstrapping the training data with a rule-based heuristic over synthetic data, we have developed a high-accuracy machine-learning model that allows entities to dynamically prioritize threats and defensive actions.

Cyber Threat Intelligence↗

Model Residuals as Shields: A Two-Level Formulation to Defend Smart Grids From Poisoning Attacks

The advancement of smart grids presents both vast opportunities and heightened cybersecurity risks. Data-driven defense mechanisms, though designed as a shield against these threats, can fall prey to poisoning attacks. We delve into regression settings, underscoring the imperative to fortify defenses against a spectrum of poison ratios, notably those above 0.5—an issue scarcely addressed in prior studies. Recognizing the susceptibilities of smart grids and their manipulable sensors, we exploit the very intent of poisoning attacks, compromising model accuracy, as our defense mechanism. Our proposed two-level optimization framework discerns between poisoned and authentic data based on model residuals, outperforming or matching existing methods in 72% to 77% of precision and 75% to 80% of recalls across various poisoning attacks, poison ratios, and datasets. Once the authentic data are identified, the trained model is adaptable for a variety of applications. Comprehensive evaluations on different smart grid datasets, pitted against myriad poisoning schemes, validate our methodology’s edge over existing methods. Here, we also shed light on the implications of model misspecification originating from temporal auto-correlation, a common feature in Internet of Things and smart grid data.

Adversarial machine learning (ML)↗

Optimal Energy Storage System and Smart Switch Placement in Dynamic Microgrids With Applications to Marine Energy Integration

Here this paper studies a dynamic microgrid (DMG) planning problem that places energy storage systems (ESSs) and smart switches (SSWs) optimally in the system. We apply the proposed methodology to applications concerning marine renewable energy (MRE). MRE is an emerging clean energy resource with enormous capacity but volatile and intermittent energy output profiles. Innovative grid-integration technologies designed to enhance the reliability of an MRE-integrated system are needed. However, there are still limited studies in this regard. Existing works have shown the promising prospect of using a dynamic microgrid (DMG) operational concept to accommodate renewable resources in distribution systems, but they usually assume fixed ESS and SSW installations. To further improve the operational flexibility of DMGs, we propose a DMG planning methodology that optimally places ESSs and SSWs so that a DMG with MRE is warranted with proper resource adequacy and topological flexibility in both the contingency and normal operations. We use realistic case studies based on a real-world distribution network and the U.S. Department of Energy's MRE dataset to verify the value and validity of the proposed work.

25 ENERGY STORAGE↗

Metabolic Costs of Walking with Weighted Vests

ABSTRACT Introduction The US Army Load Carriage Decision Aid (LCDA) metabolic model is used by militaries across the globe and is intended to predict physiological responses, specifically metabolic costs, in a wide range of dismounted warfighter operations. However, the LCDA has yet to be adapted for vest-borne load carriage, which is commonplace in tactical populations, and differs in energetic costs to backpacking and other forms of load carriage. Purpose The purpose of this study is to develop and validate a metabolic model term that accurately estimates the effect of weighted vest loads on standing and walking metabolic rate for military mission-planning and general applications. Methods Twenty healthy, physically active military-age adults (4 women, 16 men; age, 26 ± 8 yr old; height, 1.74 ± 0.09 m; body mass, 81 ± 16 kg) walked for 6 to 21 min with four levels of weighted vest loading (0 to 66% body mass) at up to 11 treadmill speeds (0.45 to 1.97 m·s −1 ). Using indirect calorimetry measurements, we derived a new model term for estimating metabolic rate when carrying vest-borne loads. Model estimates were evaluated internally byk-fold cross-validation and externally against 12 reference datasets (264 total participants). We tested if the 90% confidence interval of the mean paired difference was within equivalence limits equal to 10% of the measured walking metabolic rate. Estimation accuracy, precision, and level of agreement were also evaluated by the bias, standard deviation of paired differences, and concordance correlation coefficient (CCC), respectively. Results Metabolic rate estimates using the new weighted vest term were statistically equivalent (P< 0.01) to measured values in the current study (bias, −0.01 ± 0.54 W·kg −1 ; CCC, 0.973) as well as from the 12 reference datasets (bias, −0.16 ± 0.59 W·kg −1 ; CCC, 0.963). Conclusions The updated LCDA metabolic model calculates accurate predictions of metabolic rate when carrying heavy backpack and vest-borne loads. Tactical populations and recreational athletes that train with weighted vests can confidently use the simplified LCDA metabolic calculator provided as Supplemental Digital Content to estimate metabolic rates for work/rest guidance, training periodization, and nutritional interventions.

Sport Sciences↗

PELICAN Design, Test Planning, and Commissioning Results

To support design efforts for the Versatile Test Reactor (VTR) core assemblies, an experimental facility has been designed and constructed at Argonne National Laboratory to match the hydraulic flow conditions within the VTR’s primary heat transport system (PHTS). This facility, the Pressure drop Experimental Loop for Investigations of Core Assemblies in advanced Nuclear reactors, PELICAN, provides the ability to measure pressure drop across a full-scale fuel assembly containing prototypic axial reflectors, fuel, and plena components. The PELICAN facility was designed and built to offer maximum flexibility, allowing testing from short sub-sections all the way to the full-length core fuel assemblies. The report presents the high-level program objectives, a summary of the facility design, instrumentation, and control systems, and the testing procedure. The outcomes from facility characterization efforts and first test matrix results are then presented and then, finally, the conclusion contains a summary of the future work to be performed. This test facility was designed to match the hydraulic conditions of the flowing sodium in the VTR using water as a surrogate fluid. To do so, the water is elevated to a temperature of 110°C where its viscosity matches that of sodium, and with a 50-HP centrifugal pump, is capable of generating full scale flow rates to achieve prototypic Reynolds and Euler number flow conditions. To prevent boiling, the system is maintained at elevated pressure of at least 2.7-3.0 bar (40-44 psig). A set of 15 tests have been used to perform checkout activities in order to commission the device, survey the capabilities of PELICAN, and generate experimental data at isothermal conditions and over a range of flow rates up to 44 kg/s (700 GPM) to produce datasets used in the verification and validation of VTR design and modeling efforts. Initial testing focused on facility characterization, which assessed the operational capabilities of various control systems. The thermal control system was qualified, including the thermal response of the loop to the heat added by self- and auxiliary heaters, the chiller and heat exchanger systems for removing excess heat, and their coupled ability to maintain steady-state isothermal conditions as desired. Additionally, the pressure control system was verified to ensure necessary operating environments that promote pump health and prevent boiling of loop inventory at high temperatures could be met. With these systems in place, the first set of matrix tests have been carried out using orifice plates with inner diameters of 2.25-inches and 2.5-inches. Orifice plate flow behavior is well covered in scientific literature, and the results find good agreement with the measured pressure drop vs flow rate and those of theoretical predictions. This initial testing not only helps to validate the experiment, but it also produces a high quality data set for a geometry that is easily reproducible for simulations. Finally, the report is concluded with a discussion of the work to come and provides a snapshot of the test articles in the experimental pipeline whose designs are being inspired by the current designs from the VTR.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Cybersecurity Center for Offshore Wind Energy (Final Project Report)

This project establishes a Cybersecurity Center for Offshore Wind Energy with the objective of designing and operating a cyber-physical testbed for wind energy farms (WEFs) that enables comprehensive cybersecurity research. The testbed incorporates a Supervisory Control and Data Acquisition (SCADA) system connected to turbine models via industrial-grade programmable logic controllers (PLCs) and remote terminal units (RTUs). It supports side-channel data acquisition, implementation and analysis of various cyberattack scenarios, and development of attack detection, mitigation, and best-practice guidance tailored to wind energy systems. During the project, the team expanded the number and fidelity of mathematical turbine models (MTMs), integrated these models with SCADA infrastructure, and deployed a scaled physical turbine and associated sensors. High-resolution operational and side-channel data streams were collected and used to refine machine-learning (ML)-based attack detection systems and to extend the WindCRAFT framework to multi-turbine threat scenarios. The project demonstrated a realistic, scalable environment for evaluating cyber threats, validated attack detection approaches using enriched datasets, and identified new multi-turbine and inter-turbine communication attack vectors. The resulting testbed, models, and security mechanisms provide a foundation for ongoing R&D and deployment of cyber-resilient offshore wind energy systems.

17 WIND ENERGY↗

Enhancing Docking Accuracy with PECAN2, a 3D Atomic Neural Network Trained without Co-Complex Crystal Structures

Decades of drug development research have explored a vast chemical space for highly active compounds. The exponential growth of virtual libraries enables easy access to billions of synthesizable molecules. Computational modeling, particularly molecular docking, utilizes physics-based calculations to prioritize molecules for synthesis and testing. Nevertheless, the molecular docking process often yields docking poses with favorable scores that prove to be inaccurate with experimental testing. To address these issues, several approaches using machine learning (ML) have been proposed to filter incorrect poses based on the crystal structures. However, most of the methods are limited by the availability of structure data. Here, we propose a new pose classification approach, PECAN2 (Pose Classification with 3D Atomic Network 2), without the need for crystal structures, based on a 3D atomic neural network with Point Cloud Network (PCN). The new approach uses the correlation between docking scores and experimental data to assign labels, instead of relying on the crystal structures. We validate the proposed classifier on multiple datasets including human mu, delta, and kappa opioid receptors and SARS-CoV-2 Mpro. Our results demonstrate that leveraging the correlation between docking scores and experimental data alone enhances molecular docking performance by filtering out false positives and false negatives.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Graph-based featurization methods for classifying small molecule compounds

For over a decade, drug-induced liver injury (DILI) has posed significant drawbacks in the synthesis and development of drugs and remains a consequential concern. With finite success within the existing preclinical models, DILI is one of the main causes of drug withdrawal or termination from the market. Particularly, this withdrawal occurs during the late stages of drug development (Kullak-Ublick, 2017). Since DILI is difficult to diagnose and treat, it has become an obstacle in the drug production market that in turn affects clinicians, pharmaceutical companies, and consumers. We propose a method for learning features of DILI-positive drugs based on the graphical relationships and patterns they possess within a network of biological databases. We also train various statistical and machine learning models on these learned features in order to classify the drugs as DILI-positive or negative. Our methods include Random Forest, Neural networks, and logistic regression classification. We utilize labeled DILI-positive and DILI-negative datasets, which were developed by the FDA and the National center for toxicological research, as well as additional literature datasets (Thakkar, 2020) in order to validate our results and assess our featurization and model accuracy.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Panta Rhei benchmark dataset: socio-hydrological data of paired events of floods and droughts

As the adverse impacts of hydrological extremes increase in many regions of the world, a better understanding of the drivers of changes in risk and impacts is essential for effective flood and drought risk management and climate adaptation. However, there is currently a lack of comprehensive, empirical data about the processes, interactions, and feedbacks in complex human–water systems leading to flood and drought impacts. Here we present a benchmark dataset containing socio-hydrological data of paired events, i.e. two floods or two droughts that occurred in the same area. The 45 paired events occurred in 42 different study areas and cover a wide range of socio-economic and hydro-climatic conditions. The dataset is unique in covering both floods and droughts, in the number of cases assessed and in the quantity of socio-hydrological data. The benchmark dataset comprises (1) detailed review-style reports about the events and key processes between the two events of a pair; (2) the key data table containing variables that assess the indicators which characterize management shortcomings, hazard, exposure, vulnerability, and impacts of all events; and (3) a table of the indicators of change that indicate the differences between the first and second event of a pair. The advantages of the dataset are that it enables comparative analyses across all the paired events based on the indicators of change and allows for detailed context- and location-specific assessments based on the extensive data and reports of the individual study areas. The dataset can be used by the scientific community for exploratory data analyses, e.g. focused on causal links between risk management; changes in hazard, exposure and vulnerability; and flood or drought impacts. The data can also be used for the development, calibration, and validation of socio-hydrological models. The dataset is available to the public through the GFZ Data Services (Kreibich et al., 2023, https://doi.org/10.5880/GFZ.4.4.2023.001).

54 ENVIRONMENTAL SCIENCES↗

Probing the matter-dominated expansion with multi-redshift Lyman-$α$ BAO from DESI DR2

We present a multi-redshift Baryon Acoustic Oscillations (BAO) analysis of the DESI Data Release 2 (DR2) Lyman-$α$ (Ly$α$) forest, splitting the forest auto-correlation and its cross-correlation with quasars into three redshift bins. We obtain BAO measurements at effective redshifts $z_{\rm eff} = 2.13$, $2.40$, and $2.81$ with $\sim2.0$--$2.5\%$ precision per bin in the radial and transverse directions, corresponding to $\sim1.1$--$1.2\%$ precision for the isotropic BAO measurement. Using the same data products and modeling framework as the DESI DR2 Ly$α$ BAO analysis, we validate the pipeline on $400$ synthetic datasets and find unbiased BAO recovery with well-calibrated uncertainties. The measurements show an increase in the isotropic dilation parameter $D_V/r_d$ from $30.26\pm0.39$ to $32.22\pm0.47$ and in the Alcock-Paczyński parameter $D_M/D_H$ from $3.96\pm0.15$ to $5.63^{+0.22}_{-0.24}$. The Hubble distance $D_H/r_d$ decreases from $9.40\pm0.20$ to $7.22\pm0.17$, providing a direct measurement of the expansion history consistent with $Λ$CDM and the expected matter-dominated scaling, with $H(z)\propto(1+z)^n$ giving $n=1.34\pm0.16$. The redshift split also provides a self-consistent measurement of clustering evolution: the Ly$α$ forest bias evolves as $(1+z)^γ$ with $γ_α=3.05\pm0.16$, the RSD parameter has a redshift evolution described by $γ_β=-0.97\pm0.26$, and the quasar bias evolves with $γ_Q=1.56\pm0.23$, consistent with independent quasar clustering measurements. Combining these three-bin BAO measurements with DESI DR2 galaxy and quasar BAO measurements yields cosmological constraints consistent with the single-bin Ly$α$ BAO analysis in flat $Λ$CDM and $w_0w_a$CDM and improves curvature constraints by $\sim12\%$ in $Λ$CDM$+Ω_\mathrm{K}$.

Herrera-Alcantar, Hiram K. [Paris, Inst. Astrophys↗

Manufacturing Facility Inventory National Dataset (M-FIND)

This asset provides a high-fidelity, validated inventory of manufacturing facilities across the United States, filling a critical gap in publicly available industrial data. By integrating and cross-referencing thirteen distinct data sources, this dataset moves beyond the limitations of single-source registries to provide a harmonized list that includes precise geographic coordinates, industrial subsector designations, and—crucially—parcel-level spatial boundaries.

Billings, Blake [ORNL] (ORCID:0000000186021600)↗

Diesel Fuel Consumption in Prominent U.S. Open-Pit Mines: Site-Level Estimates

This report presents a comprehensive framework for estimating diesel fuel consumption and prices at open-pit mines in the United States. The framework includes transparent methods for calculating site-level diesel energy use when direct reporting is unavailable, and a structured confidence evaluation for each method. The framework is demonstrated to estimate current diesel consumption at 21 open-pit mines in the United States. Initial findings support ongoing efforts to strengthen the competitiveness and security of the U.S. industrial base by supporting data-driven supply chain analysis and decision-making, improved transparency in mining sector energy use, and targeted deployment of energy innovation and cost-reduction strategies. Future updates to the dataset—coupled with expanded data transparency and method validation—will help ensure that the findings remain relevant as the sector continues to evolve.

02 PETROLEUM↗

LyaCoLoRe : synthetic datasets for current and future Lyman-α forest BAO surveys

The statistical power of Lyman-α forest Baryon Acoustic Oscillation (BAO) measurements is set to increase significantly in the coming years as new instruments such as the Dark Energy Spectroscopic Instrument deliver progressively more constraining data. Generating mock datasets for such measurements will be important for validating analysis pipelines and evaluating the effects of systematics. With such studies in mind, here we present LyaCoLoRe: a package for producing synthetic Lyman-α forest survey datasets for BAO analyses. LyaCoLoRe transforms initial Gaussian random field skewers into skewers of transmitted flux fraction via a number of fast approximations. In this work we explain the methods of producing mock datasets used in LyaCoLoRe, and then measure correlation functions on a suite of realisations of such data. We demonstrate that we are able to recover the correct BAO signal, as well as large-scale bias parameters similar to literature values. Finally, we briefly describe methods to add further astrophysical effects to our skewers — high column density systems and metal absorbers — which act as potential complications for BAO analyses.

79 ASTRONOMY AND ASTROPHYSICS↗

SFCOMPO Database of Spent Nuclear Fuel Assay Data – the Next Frontier

SFCOMPO is the world’s largest database for measured spent nuclear fuel assay data. An international effort coordinated by the Nuclear Energy Agency (NEA) resulted in a significant expansion of the database and its release online in 2017 as a downloadable application. The SFCOMPO Technical Review Group (TRG) was recently formed under the direction of NEA’s Nuclear Science Committee/Working Party on Nuclear Criticality Safety and was mandated to maintain and further coordinate the development of SFCOMPO. This TRG is currently focused on (1) critical evaluation of the experimental assay data by independent experts and (2) development of benchmarks and benchmark models that can be applied to validate burnup codes. This will improve the quality and documentation of the experimental datasets and enable their use by the international community to support code validation for design and safety analysis of spent nuclear fuel transportation, storage, and repository applications. It follows the precedent and draws on the experience gained from similar NEA efforts in the International Reactor Physics Experiment Evaluation Project and the International Criticality Safety Benchmark Experiment Project. Ongoing SFCOMPO evaluations have served as a test bed to develop templates for documenting evaluations, develop review guidance, improve approaches for a global uncertainty analysis, and devise a strategy focused on providing practical information of highest value to the user community. The current effort, status, and associated challenges are discussed.

Ilas, Germina↗

Decentralized Distributed Proximal Policy Optimization (DD-PPO) for High Performance Computing Scheduling on Multi-User Systems

Resource allocation in High Performance Computing (HPC) environments presents a complex and multifaceted challenge for job scheduling algorithms. Beyond the efficient allocation of system resources, schedulers must account for and optimize multiple performance metrics, including job wait time and system throughput. Traditional heuristic-based scheduling algorithms increasingly struggle and lack the efficiency needed to meet the demands and address the complexity and scale of modern HPC systems. Consequently, recent research efforts have focused on leveraging advancements in Artificial Intelligence (AI) and Deep Learning (DL), particularly Reinforcement Learning (RL), to develop more adaptable and intelligent scheduling strategies. Previous RL-based scheduling approaches have explored a range of algorithms, from Deep Q-Networks (DQN) to Proximal Policy Optimization (PPO), and more recently, hybrid methods that integrate Graph Neural Networks (GNNs) with RL techniques. However, a common limitation across these methods is their reliance on relatively small datasets, with few methods being evaluated using large-scale, multi-million-job trace datasets representative of real-world HPC workloads. Moreover, existing RL schedulers face scalability issues due to centralized policy updates, which hinder training efficiency and performance when applied to large datasets. This study introduces a novel RL-based scheduler utilizing Decentralized Distributed Proximal Policy Optimization (DD-PPO) algorithm, which supports large-scale distributed training across multiple workers without requiring parameter synchronization at every step. By eliminating reliance on centralized updates to a shared policy, the DD-PPO scheduler enhances scalability, training efficiency, and sample utilization. Experimental validation using a large real-world dataset containing over 11.5 million job traces collected from petascale HPC systems over six years assesses the influence of dataset scale on training effectiveness and compares DD-PPO performance to traditional and advanced scheduling approaches. The experimental results demonstrate improved scheduling performance in comparison to both heuristic-based schedulers and existing RL-based scheduling algorithms.

AI↗

Performance and wake flow characterization of a 1:8.7-scale reference USDOE MHKF1 hydrokinetic turbine to establish a verification and validation test database

As hydrokinetic turbine technologies continue to advance towards commercialization, public datasets on the performance characteristics for these devices and their flow field effects are invaluable to advance our understanding of these technologies and to validate analytical and numerical models. The Applied Research Laboratory at The Pennsylvania State University (ARL Penn State) collaborated with Sandia National Laboratories and the University of California at Davis to design, fabricate (at a 1:8.7 scale), and experimentally test a novel hydrokinetic turbine rotor design to provide an open platform and dataset for further study and development. The water tunnel test of this three-bladed, horizontal-axis rotor recorded power production, blade loading, the near-wake flow, cavitation effects, and noise generation. These state-of-the-art measurements demonstrate much of the complex physics associated with the flow through an unducted, horizontal-axis turbine, and they elucidate the performance characteristics and flow field effects at an unprecedented fidelity, accuracy and resolution. Measurements of powering coefficients (power, torque and thrust) as a function of tip-speed-ratio were performed. The dataset also includes unsteady measurements of driveshaft loading, blade strain, tower pressures, and radiated noise. Detailed flow mapping using laser Doppler velocimetry, and planar and stereo particle image velocimetry includes measurements of mean velocity and Reynolds stresses. Although the wake measurements are limited to less than half a diameter, they reveal the complex flow patterns in the near-wake structure of the rotor. The full database, available at the United States Department of Energy’s marine and hydrokinetic data repository, includes tunnel and model Computer Aided Design geometry files and inflow data sufficient for a “Model-the-Test” computational Verification and Validation study.

13 HYDRO ENERGY↗

Designing resilient IoT and Edge Computing with federated tinyML

The rapid growth of the Internet of Things (IoT) and Edge Computing (EC) has brought significant conveniences to modern society but has also greatly expanded the cyber attack surfaces, particularly as these technologies are being increasingly integrated into critical systems such as power grids, healthcare, and smart homes. Here, to improve IoT/EC’s cybersecurity posture, we leveraged Artificial Intelligence (AI) and Machine Learning (ML) by employing tinyML to monitor voluminous IoT data for cyber threats while addressing devices’ resource constraints, and utilizing Federated Learning (FL) to share local detection knowledge across the system while preserving privacy. Building on our three-layer architecture combining tinyML and FL to enhance autonomous cyber attack detection, this paper demonstrated that the architecture improves detection accuracy, reduces resource consumption, and enables lightweight, secure IoT device monitoring. These results were validated using the public N-BaIoT dataset as well as real IoT network traffic data collected under multiple attack scenarios from our testbeds. Additionally, we introduced an enhanced FL methodology with a novel preprocessing stage, including federated feature selection and global preprocessor construction, to address IoT/EC data heterogeneity. We developed a physical IoT testbed for attack simulations and data collection, implemented a tinyML-powered detector for realistic model validation, and also built a virtual testbed for scalable evaluations of FL models across diverse network environments.

Cognitive cyber↗