Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,387 records · Page 77
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Hydrogen Recombiner Catalyst Evaluations for Waste Storage

Radiolysis of water in nuclear waste storage generates hydrogen gas that can accumulate within sludge style waste and be rapidly released during agitation events, creating a significant flammability hazard. Engineering controls are therefore required to limit hydrogen concentrations during both quiescent storage and transient disturbances. Catalytic recombination of hydrogen in waste storage offgas is a proven mitigation strategy, maintaining hydrogen levels below flammability limits and managing sudden concentration spikes. Conventional recombiners rely on platinum and/or palladium catalysts, with development efforts focused on extending service life, increasing active surface area, and ensuring safe deployment in radioactive environments. Savannah River National Laboratory (SRNL) is evaluating a newly developed hydrogen recombiner catalyst from Canadian Nuclear Laboratories as a cost-effective and durable alternative for nuclear waste applications. Testing was conducted in SRNL’s Shielded Cells facility, which enables reduced-scale experimental modeling under radiation fields and near-use-case conditions relevant to radioactive waste storage. Catalyst performance was evaluated using a custom offgas characterization system designed for near-zero flow conditions. The experimental apparatus consisted of a gas-tight 2.7 L PTFE vessel equipped with temperature monitoring, gas flow controls, and a variable-speed mixer to simulate sludge agitation. Offgas composition was monitored using a dedicated gas chromatograph with argon carrier gas and a krypton internal standard. Measurements were obtained for an empty vessel, the vessel containing a well characterized radioactive tank waste sample, and the same configuration with the candidate catalyst installed. Results demonstrate that the new catalyst effectively reduced hydrogen concentrations in the offgas within the constraints of the experimental design. In addition to confirming catalytic activity, the testing provided valuable insights into experimental optimization and considerations for future performance evaluations. These findings support the potential scalability of the technology and highlight its applicability to broader nuclear waste management operations, offering improved safety and reduced operational costs through enhanced catalyst durability and lower replacement frequency.

Tener, Zachary P. [Savannah River National Laborat↗
DOE OSTI2025

EVALUATION OF OPERATION TEMPERATURES UNDER NATURAL CONVECTION HELIUM FLOW IN A CONFINED CAVITY

The Spallation Neutron Source (SNS) is a high-power accelerator-based pulsed neutron source led by Oak Ridge National Laboratory (ORNL) to achieve high fluxes of neutrons for scientific experiments. Active and passive cooling of the systems and parts forming the SNS have been considered to warrant the safe operation of the facility. The diverse cooling systems make use of conjugated heat transfer mechanisms to provide a stable operation temperature for all components in the machine. Thermal power deposited into stainless-steel piping lines due to particle radiation may reach values of up to 1.2 W/cc in the regions located closer to the center of the lower IRP. These energy deposition levels, in not actively cooled components, such as the transfer-line-outer-vacuum-layer may increase the temperature of the component beyond design requirement limitations. The evaluation of the operation temperatures for the former components relies in the assumption that a low-pressure helium atmosphere provides enough heat removal capacity based on natural convection phenomena. In this work, the evaluation of steady state temperatures in components such as the CMS transfer lines has been evaluated using computational fluid dynamics (CFD), analytical correlations and experimental measurements. The companion experiments were conducted in a closed helium system at pressures varying from 1.1 to 1.5 bar. A copper rod was affixed horizontally between viewing windows and heated at constant power, and measurements were made of both the rod temperature and ambient temperature via a system fiberoptic distributed temperature sensors and RTDs. It was found that the measured heat transfer coefficients agree well with the predictions of Churchill and Chu correlations across the range of cases considered. Additionally, the ambient helium volume above the rod was imaged via background oriented schlieren (BOS), and these data was used to determine the line-averaged density gradients in this region. These gradients were compared to simulation data to validate the predictions of natural convection simulations.

Dominguez-Ontiveros, Elvis [ORNL] (ORCID:000000018↗
DOE OSTI2021

Evaluating Deception Detection Model Robustness To Linguistic Variation

With the increasing use of automated, machine learning-driven tools and the downstream impact that algorithmic judgements can have, it is critical to develop models that are robust to evolving or manipulated inputs. Evaluating the reliability of multimodal models across linguistic variations to understand model susceptibility to intentional linguistic adversarial attacks as well as natural linguistic variations is essential in this pursuit. We present extensive analysis of model robustness and susceptibility to linguistic variations in the setting of deceptive news detection, a difficult classification task that is an increasingly important problem to solve with the impact of misinformation spread online. We evaluate the effectiveness of incorporating adversarial defense strategies and measure model susceptibility to state-of-the-art adversarial attacks using two types of linguistic attacks — character and word perturbations. We consider two multiclass prediction tasks — a 3-way classification of tweets as trustworthy, propaganda, or disinformation; and a 4-way classification as clickbait, hoax, satire, or conspiracy — and compare the performance of three embeddings that have been state-of-the-art for several NLP tasks — GloVe, ELMo, and BERT — to highlight consistent trends in susceptibility, high confidence misclassifications, and high impact failures. We find that character or mixed ensemble models are the most effective defense mechanisms and that character perturbations are a more effective attack than word perturbations for deception classification.

adversarial evaluation↗
DOE OSTI2023

Status of ORNL TSL evaluations [Slides]

This lecture provides details on the status of ORNL TSL evaluations. Main sections include modeling of concrete, updates of polyethylene evaluation, and initial transmission measurements at Oak Ridge National Labatory (ORNL). The presentation Conclusions show that literature review and initial modeling of concrete components have been performed. INS and transmission measurements of concrete and hydrated cement have been also planned. Additionally, A new TSL library for Polyethylene was created and submitted to NNDC and development for a new transmission capability at ORNL is underway.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Applying Methodology for Evaluating and Validating TSLs to Materials of Interest to NCSP [Slides]

This presentation covers the topic of applying methodology for evaluation validation of TSLs to material of interest to the Nuclear Criticality Safety Program (NCSP). The talk covers recent efforts in validating thermal neutron scattering cross sections. The presentation also proposes a methodology for not only validating thermal scattering files that utilizes all available experimental data, but also for evaluating new libraries as demonstrated on Polystyrene and Lucite

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Training Evaluation: A Case Study of Measuring Impact and ROI

The purpose of this case study was to evaluate the Compliance Officer/Coordinator (CO/CC) training program using Phillips’ approach to training evaluation. INL Learning Performance Consultants (LPCs) applied the ROI Methodology to measure the effectiveness of the CO/CC training program. INL CO/CCs participated in focus groups to provide feedback on their learning, enablers and barriers to applying what they learned, and opportunities to improve the CO/CC learning experience. With collaboration from the CO/CC training program owner, the LPCs demonstrated the business impact and return on investment (ROI) of the CO/CC training program. Included are training program recommendations and lessons learned using the ROI Methodology.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2025

Evaluation of normalization strategies for mass spectrometry-based multi-omics datasets

Introduction Data normalization is crucial for multi-omics integration, reducing systematic errors and maximizing the likelihood of discovering true biological variation. Most studies assess normalization for a single omics type or use datasets from separate experiments. Few address time-course data, where normalization might bias temporal differentiation. In this study, we compared common normalization methods and a machine learning approach, Systematical Error Removal using Random Forest (SERRF), using multi-omics datasets generated from the same experiment—even from the same cell lysate. Objectives To develop a straightforward process to assess normalization effects and identify the most robust methods across multi-omics datasets. Methods We analyzed metabolomics, lipidomics, and proteomics datasets from primary human cardiomyocytes and motor neurons exposed to acetylcholine-active compounds over time. Normalization effectiveness was evaluated based on improvement in QC features consistency and observing the change in treatment and time-related variance. Results Probabilistic Quotient Normalization (PQN) and Locally Estimated Scatterplot Smoothing (LOESS) QC were identified as optimal for metabolomics and lipidomics, while PQN, Median, and LOESS normalization excelled for proteomics. These methods consistently enhanced QC feature consistency in metabolomics and lipidomics, and preserved time-related variance or treatment-related variance in proteomics, demonstrating their effectiveness and robustness. SERRF normalization, applied only to metabolomics in this study, outperformed other methods in some datasets but inadvertently masked treatment-related variance in others. Conclusion Our evaluation identified PQN and LoessQC as the top methods for metabolomics and lipidomics, and PQN, Median, and Loess normalization for proteomics, in multi-omics integration in a temporal study.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Quantitative evaluations of subtropical westerly jet simulations over East Asia based on multiple CMIP5 and CMIP6 GCMs

As a salient feature of the Asian monsoon system, the East Asian subtropical westerly jet (EASWJ) exerts significant impacts on weather and climate changes in China and even throughout East Asia. In this paper, we applied a new self-adaptive algorithm to detect the EASWJ, identify its boundaries, and then represent its characteristics by defining three indices: the intensity index, meridional displacement index, and width index. Compared to the reanalysis data, we carried out a comprehensive, objective, and quantitative EASWJ evaluation using historical experiments from multiple global climate models (GCMs) in the Coupled Model Intercomparison Project Phases 5 and 6 (CMIP5 and CMIP6). The results show that the multimodel ensemble mean (MME) of both CMIP5 and CMIP6 can simulate the characteristics of winter EASWJ well. While for the other three seasons, the MME of both phase models underestimate the 200-hPa zonal wind (U200) strength in the jet coverage area and overestimate the U200 outside the jet area, such simulation results weaken the meridional shear of the wind field. The EASWJ simulations from the CMIP5 GCMs had no consistent intensity or location characteristic tendencies, and most CMIP5 GCMs tended to simulate relatively wide-coverage jets. In contrast, most CMIP6 GCMs are inclined to simulate significantly weaker, wider, and more-northward jets. Compared to the predecessors in CMIP5, about half of CMIP6 GCMs significantly minimized the jet intensity bias, but remarkable errors were still observed in their jet location and coverage representations. Furthermore, the comparative analysis performed by classifying models based on their evaluated simulation results suggested that the simulated performance of the meridional temperature gradient was important for capturing the EASWJ characteristics. Further in-depth study of the causes of model differences is warranted to improve simulation results.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

pystorms: A simulation sandbox for the development and evaluation of stormwater control algorithms

Advances in cyber–physical technologies have enabled real-time sensing and adaptive control of stormwater infrastructure. These smart stormwater systems allow for inexpensive, minimally-invasive stormwater control interventions in lieu of new construction. Importantly, however promising the area of smart stormwater control, there still remain barriers – for experts and novices alike – to access shared tools and methods for investigating, developing, and contributing to it. In an effort to make smart stormwater control research more methodical and accessible, we present pystorms, an open-source Python-based simulation sandbox that facilitates the quantitative evaluation and comparison of control strategies. pystorms consists of a collection of real world-inspired smart stormwater control scenarios on which any number of control strategies can be applied and tested via an accompanying Python programming interface and coupled stormwater simulator. pystorms provides a framework for the rigorous and efficient evaluation of smart stormwater control methodologies across diverse watersheds with only a few lines of code.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

How to estimate soil organic carbon stocks of agricultural fields? perspectives using ex-ante evaluation

Estimating soil organic carbon (SOC) stocks of agricultural fields has a range of important applications from development of sustainable management practices to monitoring carbon stocks. There are many estimation strategies with the potential for more reliable estimates of SOC stock and more efficient use of soil sampling and analysis resources, especially by leveraging readily available auxiliary information such as remote sensing. However, concrete guidance for strategy selection is lacking. This study narrows this gap with a comparison of strategies for estimating deep SOC stock (0–60 cm) in a prototypical field. Using high density SOC stock measurements and simulation, we built on past studies by 1) ex-ante evaluating a large number of strategy options, 2) using a Bayesian approach to quantify the uncertainty of the comparison, and 3) considering multiple Bayesian models to assess sensitivity to this modeling choice. We found that, using readily available auxiliary information, both balanced and stratified sampling offer substantial improvements over simple random sampling. The auxiliary information most important for this improvement is a Sentinel-2 SOC index = blue / (green × red), followed by the topographic wetness index. We found that these results are robust to the choice of mapping method, but that there is uncertainty in the magnitude of improvement. Here, we recommend future studies implement this Bayesian approach for simulated ex-ante evaluation of SOC stock estimation strategies across more fields to investigate the generalizability of these findings.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Systematic Evaluation of Atmospheric Forcing, Surface Datasets, and Mesh Effects on Kilometer-Scale Land Surface and River Modeling

Earth system models are advancing toward kilometer-scale resolution to capture local climate impacts and extremes. High-resolution land and river modeling depends on multiple factors, including mesh, surface datasets, and atmospheric forcing, but their relative effects at kilometer scales remain unquantified. We evaluated five Energy Exascale Earth System Model land and river configurations over the Mid-Atlantic region using two mesh (1/8° structured versus variable-resolution unstructured mesh), two surface datasets (default versus newly developed), and three atmospheric forcings (NLDAS2, MSWX, GSWP). Evaluation against satellite, reanalysis, and in situ benchmarks across water, energy, and carbon cycles quantifies how these factors affect model performance. Forcing selection produces the largest bias reductions (12-99% across variables), followed by surface datasets (7-75%) and mesh (up to 21%). Forcing effects vary by variable, with MSWX reducing biases for snow water equivalent, evapotranspiration, albedo, temperature, and gross primary productivity, GSWP for snow cover and runoff, and NLDAS for soil moisture and streamflow. The use of newly developed surface datasets improves gross primary productivity (58% bias reduction) and evapotranspiration but increase soil moisture and albedo biases due to current modeling limitations. Variable-resolution unstructured mesh improves the simulation of small-basin streamflow through better capturing drainage networks, though mesh minimally affects other land variables. These findings provide important guidance for high-resolution modeling development and actionable science.

Land and River modeling↗
DOE OSTI2025

Comprehensive defect evaluation of advanced nuclear fuels using high-resolution acoustic signals and optimized sensor separation

Graphite pebble composite structures based on TRistructural-ISOtropic (TRISO) particles are being developed as core nuclear fuels in advanced power reactors, promising safe operation at increased temperatures. Ensuring the structural integrity of these nuclear fuels requires comprehensive and accurate non-destructive evaluation (NDE) techniques to characterize defects and damage in the pebbles. However, traditional acoustic evaluation methods face limitations in defect characterization due to the highly attenuative, and geometrically and compositionally complex nature of these structures. This study proposes an improved acoustic NDE technique for accurate detection and classification of anticipated relevant defects and damage in graphite pebbles using high-resolution acoustic signals and optimized transmit-receive sensor networks. The proposed approach utilizes a triangular three-sensor network as the base unit, comprising three transmit-receive sensors. The sensor separation distance, as well as acoustic excitation center frequency, pulse-width, and bandwidth are optimized to enhance spatial resolution and improve signal-to-noise ratio, enabling effective characterization of the smallest size and widest range of defects in pebbles. Furthermore, the use of the triangular sensor configuration instead of a more conventional transmit-receive sensor pair expands the inspection region from a one-dimensional linear path to a two-dimensional area, increasing spatial coverage. To mitigate challenges associated with processing of complex acoustic signals arising from high-frequency, high-bandwidth excitation in these structures, a machine-learning-based signal processing algorithm is integrated with the sensor network. In the machine-learning-based algorithm, multi-domain features are extracted from the acoustic signals to capture intricate signal characteristics, significantly improving defect identification and classification compared to traditional approaches. The proposed acoustic NDE technique offers considerable promise for practical and reliable defect/damage diagnostics of advanced nuclear pebble fuels.

42 ENGINEERING↗
DOE OSTI2022

Quantitative evaluation of common cause failures in high safety-significant safety-related digital instrumentation and control systems in nuclear power plants

Digital instrumentation and control (DI&C) systems at nuclear power plants (NPPs) have many advantages over analog systems. They are proven to be more reliable, cheaper, and easier to maintain given obsolescence of analog components. However, they also pose new engineering and technical challenges, such as possibility of common cause failures (CCFs) unique to digital systems. Here this paper proposes a Platform for Risk Assessment of DI&C (PRADIC) that is developed by Idaho National Laboratory (INL). A methodology for evaluation of software CCFs in high safety-significant safety-related DI&C systems of NPPs was developed as part of the framework. The framework integrates three stages of a typical risk assessment—qualitative hazard analysis and quantitative reliability and consequence analyses. The quantified risks compared with respective acceptance criteria provide valuable insights for system architecture alternatives allowing design optimization in terms of risk reduction and cost savings. A comprehensive case study performed to demonstrate the framework's capabilities is documented here in this paper. Results show that the PRADIC is a powerful tool capable to identify potential digital-based CCFs, estimate their probabilities, and evaluate their impacts on system and plant safety.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2026

Integrating three plan evaluation approaches for coordinated heat resilience in cities across the Arizona urban corridor

Increasing heat poses a growing threat to cities worldwide due to both climate change and the urban heat island effect. While heat planning and governance are still emergent, research suggests that silos and conflicts within cities' networks of plans often impede heat resilience. Integrated heat resilience planning, therefore, requires a systematic and comprehensive analysis of the silos and conflicts relevant to heat resilience within networks of plans. This study is the first to combine three complementary plan evaluation methods to assess how cities' networks of plans address heat resilience. We applied 1) plan cross-referencing, 2) Plan Quality Evaluation for Heat Resilience, and 3) Plan Integration for Resilience Scorecard™ (PIRS™) for Heat to 19 plans from seven Arizona cities. We find similarities and differences in how these cities' networks of plans address heat hazards. The plans have consistently high-quality participation and coordination principles but lack details on vulnerability and climate change uncertainty, suggesting a need to move beyond immediate heat risks. We also identify opportunities to diversify policy mechanisms, spatially target high heat risk areas, and enhance the connection between planning efforts. These results validate that plan elements are interlinked and the importance of integrative plan development processes to improve heat resilience.

Extreme heat↗
DOE OSTI2021

Data–Driven Velocity Model Evaluation Using K–Means Clustering

In this work, we develop a data-driven clustering method to evaluate a velocity model using surface wave velocity dispersion. This is done by first computing theoretical dispersion curves for 1-D velocity profiles of all the grid locations and then splitting the resulting dispersion curves into a certain number of groups via the K-means clustering. The observed dispersion curves are also clustered following the same procedure and the velocity model is assessed by comparing the spatial patterns obtained for the observed and synthetic data sets. The method is applied to evaluate two community velocity models in southern California, CVM-S4.26 and CVM-H15.1, using phase velocity maps derived for 3–16 s Rayleigh waves. We found a good correlation in the spatial distribution of clusters between the result of CVM-S4.26 and that of the observed data, suggesting that the CVM-S4.26 fits the observed dispersion maps better than the CVM-H15.1 in terms of features extracted from the clustering analysis.

58 GEOSCIENCES↗
DOE OSTI2020

Evaluation of Low Dose Silicon Carbide Temperature Monitors

Thermocouples are generally used to provide real-time temperature indications in instrumented tests performed at materials and test reactors. Melt wires or paint spots are often included in such tests as an independent technique of detecting peak temperatures incurred during irradiation. In addition, less expensive static capsule tests, which have no leads attached for real-time data transmission, often rely on melt wires and paint spots as a post-irradiation technique for peak temperature indication. Unfortunately, these techniques are limited in that they can only detect whether a single temperature is or is not exceeded. Silicon carbide (SiC) monitors are advantageous because a single monitor can be used to determine the peak temperature reached within a relatively broad range (200 – 800°C). Although the use of SiC monitors was proposed more than five decades ago, the ultimate performance limits of this technique are not fully understood. The Nuclear Science User Facilities (NSUF) is the United States Department of Energy Office of Nuclear Energy's only designated nuclear energy user facility. Its mission is to provide nuclear energy researchers access to world-class capabilities and to facilitate the advancement of nuclear science and technology. This mission is supported by providing access to state-of-the-art experimental irradiation testing, post irradiation examination facilities, and high performance computing capabilities as well as technical and scientific assistance for the design and execution of projects. As part of an NSUF project, low dose silicon carbide monitors were irradiated in the Belgian Reactor 2 and were then evaluated both at the SCK•CEN and at Idaho National Laboratory's High Temperature Test Laboratory to determine their peak temperature achieved during irradiation. The technical significance of this work was that the monitors were irradiated to a dose that was significantly less than recommended in published literature. This paper will discuss the evaluation process, the irradiation test, and the performance of the low dose silicon carbide temperature monitors.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Socially-aware evaluation framework for transportation

Technological advancements are rapidly changing traffic management in cities. Navigation applications, in particular, have impacted cities in many ways by rerouting traffic. As different routing strategies distribute traffic differently, understanding these disparities across multiple city-relevant dimensions is extremely important for decision-makers. We develop a multi-themed framework called Socially- Aware Evaluation Framework for Transportation (SAEF), which assists in understanding how traffic routing and the resultant dynamics affect cities. The framework is presented for four Bay Area cities, for which we compare three routing strategies - user equilibrium travel time, system optimal travel time, and system optimal fuel. The results demonstrate that many neighborhood impacts, such as traffic load on residential streets and around minority schools, degraded with the system-optimal travel time and fuel routing in comparison to the user-equilibrium travel time routing. The findings also show that all routing strategies subject the city's disadvantaged neighborhoods to disproportionate traffic exposure. Our intent with this work is to provide an evaluation framework that enables reflection on the consequences of traffic routing and management strategies, allowing city planners to recognize the trade-offs and potential unintended consequences.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2026

Evaluation of daily gridded climate products using in situ FLUXNET data and tree growth modeling

Gridded climate data products have facilitated research in climate and ecology by providing meteorological data continuously across large spatial scales. However, the sensitivity of scientific outcomes to dataset choice remains poorly understood, and evaluation using station-based records can favor datasets built heavily on weather stations. Here, we evaluate seven high-resolution daily gridded datasets covering the contiguous United States using independent meteorology from the FLUXNET2015 dataset, with a focus on the implications of dataset choice for process-based tree growth modeling. We find that gridded products tend to capture temperature accurately while consistently overestimating the magnitude and frequency of precipitation and its extremes. Moreover, datasets vary in how they define a ‘day,’ which significantly affects temporal alignment with FLUXNET2015 observations. Despite differences among the datasets, the interannual variability in tree ring simulations is insensitive to dataset choice, likely because daily-scale biases are averaged out through accumulated growth across several months. However, inaccuracies in temperature and precipitation can significantly bias modeled xylem cell production, with systematically higher annual precipitation in the gridded datasets leading to greater xylem production compared to simulations using in situ data. Our results suggest that model applications, especially those that integrate to time scales longer than one day, are likely insensitive to climate dataset choice, but applications that are sensitive to daily climate variations or to absolute climate values need to carefully consider biases in gridded climate products.

54 ENVIRONMENTAL SCIENCES↗