Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Evaluating Hydropower Plants for Wildfire Resilient Microgrids

The increasing occurrence and severity of wildfires in recent years is severely impacting critical infrastructures, including the power grid, compromising the quality of life and provision of essential services, including electricity. The western parts of the United States, more specifically Washington, Oregon, and California, which are prone to large wildfires, are also rich in hydropower resources. Hydropower resources located close to communities vulnerable to wildfire can be utilized to develop wildfire-resilient microgrids to support critical needs of those communities. Therefore, this paper develops a framework to characterize hydropower plants and evaluate their feasibility to operate in microgrids during wildfire-related outages. In the proposed framework, hydropower plants are characterized using various plant and site attributes and evaluated in terms of capability and performance indicative metrics. A case study is carried out evaluating the Hills Creek hydropower plant located in a wildfire-prone region of Oregon for wildfire-resilient microgrid. The results of steady-state and dynamic simulations show that the hydropower plant is capable of providing the essential microgrid services and powering nearby communities during extended wildfire-related outages.

29 - ENERGY PLANNING, POLICY AND ECONOMY↗
DOE OSTI2024

Laboratory Evaluation of Commercial Utility Microgrid Controller Test Results

The functional requirements of many microgrid controllers (MGCs) are expanding and evolving to meet growing utility and community needs. At a high level, the utility microgrid controller serves resilience and reliability use cases by coordinating transitions between grid-connected and islanded states and by managing the system during island operations. This includes control scenarios that require the microgrid controller to use flexible microgrid boundaries, maintain energy balance, coordinate with peer systems, and manage grid-forming (GFM) and grid-following (GFL) distributed energy resources (DER). In order to evaluate these functional enhancements, microgrid controller test plans must also be developed to ensure that the implemented controllers provide adequate performance. This report provides MGC test plans for both island operation and transition functions. The functions covered in this report include feeder level energy management, island constraint management, secondary voltage and frequency control, black start, and synchronized reconnection. This second edition update also includes results from applying the tests to a commercial utility microgrid controller. These results evaluate the performance and reliability of the controller under various operational scenarios. It identifies specific areas where the controller excels and highlights gaps that need to be addressed for future enhancements. The application of these test plans on real-world system behavior provides insights on commercial equipment readiness for field deployment. These test cases can be applied to utility-managed microgrid controllers that exclusively manage utility-owned equipment; the tests also apply to third-party managed microgrid controllers that coordinate with utility- and customer-owned equipment. The report can also be used by technology developers and project developers in industry to evaluate control strategies and performance characteristics for community microgrid controllers.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Evaluation of Bio-Intermediates and Other Biofuels for use in Marine Engines

This paper presents an overview of the DOE Marine Biofuel Feasibility Study to evaluate the potential of biofuels for ocean-going vessels. These vessels operate on low-cost residual fuel oils (also known as heavy fuel oils or HFO), which require significant heating and purification onboard vessels. The industry is looking at economical alternative fuels that can enhance performance from combustion/emissions, rheology, and other perspectives. Four U.S. national laboratories are collaborating to evaluate a variety of biofuels, including bio-intermediates (pyrolysis and hydrothermal liquefaction oils), biodiesel (fatty acid methyl esters or FAME), bio-residuals (FAME byproducts) for their suitability as fuels for marine diesel engines. Bio-intermediates in particular are of interest because large marine engines that operate on HFO can tolerate lowerquality, more viscous fuels and may be able to utilize these fuels with less upgrading than other applications, presenting economic advantages. The test fuels of interest are examined to determine the minimum level of upgrading required for blend compatibility with market HFOs containing high levels of asphaltenes as well as their impact on the viscosity, polymerization tendency, and combustion properties (particularly cetane number) of the fuel blends in preparation for future evaluation in engine studies.

Kaul, Brian [ORNL] (ORCID:0000000184813620)↗
DOE OSTI2026

Hydrogen Recombiner Catalyst Evaluations for Waste Storage

Radiolysis of water in nuclear waste storage generates hydrogen gas that can accumulate within sludge style waste and be rapidly released during agitation events, creating a significant flammability hazard. Engineering controls are therefore required to limit hydrogen concentrations during both quiescent storage and transient disturbances. Catalytic recombination of hydrogen in waste storage offgas is a proven mitigation strategy, maintaining hydrogen levels below flammability limits and managing sudden concentration spikes. Conventional recombiners rely on platinum and/or palladium catalysts, with development efforts focused on extending service life, increasing active surface area, and ensuring safe deployment in radioactive environments. Savannah River National Laboratory (SRNL) is evaluating a newly developed hydrogen recombiner catalyst from Canadian Nuclear Laboratories as a cost-effective and durable alternative for nuclear waste applications. Testing was conducted in SRNL’s Shielded Cells facility, which enables reduced-scale experimental modeling under radiation fields and near-use-case conditions relevant to radioactive waste storage. Catalyst performance was evaluated using a custom offgas characterization system designed for near-zero flow conditions. The experimental apparatus consisted of a gas-tight 2.7 L PTFE vessel equipped with temperature monitoring, gas flow controls, and a variable-speed mixer to simulate sludge agitation. Offgas composition was monitored using a dedicated gas chromatograph with argon carrier gas and a krypton internal standard. Measurements were obtained for an empty vessel, the vessel containing a well characterized radioactive tank waste sample, and the same configuration with the candidate catalyst installed. Results demonstrate that the new catalyst effectively reduced hydrogen concentrations in the offgas within the constraints of the experimental design. In addition to confirming catalytic activity, the testing provided valuable insights into experimental optimization and considerations for future performance evaluations. These findings support the potential scalability of the technology and highlight its applicability to broader nuclear waste management operations, offering improved safety and reduced operational costs through enhanced catalyst durability and lower replacement frequency.

Tener, Zachary P. [Savannah River National Laborat↗
DOE OSTI2025

EVALUATION OF OPERATION TEMPERATURES UNDER NATURAL CONVECTION HELIUM FLOW IN A CONFINED CAVITY

The Spallation Neutron Source (SNS) is a high-power accelerator-based pulsed neutron source led by Oak Ridge National Laboratory (ORNL) to achieve high fluxes of neutrons for scientific experiments. Active and passive cooling of the systems and parts forming the SNS have been considered to warrant the safe operation of the facility. The diverse cooling systems make use of conjugated heat transfer mechanisms to provide a stable operation temperature for all components in the machine. Thermal power deposited into stainless-steel piping lines due to particle radiation may reach values of up to 1.2 W/cc in the regions located closer to the center of the lower IRP. These energy deposition levels, in not actively cooled components, such as the transfer-line-outer-vacuum-layer may increase the temperature of the component beyond design requirement limitations. The evaluation of the operation temperatures for the former components relies in the assumption that a low-pressure helium atmosphere provides enough heat removal capacity based on natural convection phenomena. In this work, the evaluation of steady state temperatures in components such as the CMS transfer lines has been evaluated using computational fluid dynamics (CFD), analytical correlations and experimental measurements. The companion experiments were conducted in a closed helium system at pressures varying from 1.1 to 1.5 bar. A copper rod was affixed horizontally between viewing windows and heated at constant power, and measurements were made of both the rod temperature and ambient temperature via a system fiberoptic distributed temperature sensors and RTDs. It was found that the measured heat transfer coefficients agree well with the predictions of Churchill and Chu correlations across the range of cases considered. Additionally, the ambient helium volume above the rod was imaged via background oriented schlieren (BOS), and these data was used to determine the line-averaged density gradients in this region. These gradients were compared to simulation data to validate the predictions of natural convection simulations.

Dominguez-Ontiveros, Elvis [ORNL] (ORCID:000000018↗
DOE OSTI2021

Evaluating Deception Detection Model Robustness To Linguistic Variation

With the increasing use of automated, machine learning-driven tools and the downstream impact that algorithmic judgements can have, it is critical to develop models that are robust to evolving or manipulated inputs. Evaluating the reliability of multimodal models across linguistic variations to understand model susceptibility to intentional linguistic adversarial attacks as well as natural linguistic variations is essential in this pursuit. We present extensive analysis of model robustness and susceptibility to linguistic variations in the setting of deceptive news detection, a difficult classification task that is an increasingly important problem to solve with the impact of misinformation spread online. We evaluate the effectiveness of incorporating adversarial defense strategies and measure model susceptibility to state-of-the-art adversarial attacks using two types of linguistic attacks — character and word perturbations. We consider two multiclass prediction tasks — a 3-way classification of tweets as trustworthy, propaganda, or disinformation; and a 4-way classification as clickbait, hoax, satire, or conspiracy — and compare the performance of three embeddings that have been state-of-the-art for several NLP tasks — GloVe, ELMo, and BERT — to highlight consistent trends in susceptibility, high confidence misclassifications, and high impact failures. We find that character or mixed ensemble models are the most effective defense mechanisms and that character perturbations are a more effective attack than word perturbations for deception classification.

adversarial evaluation↗
DOE OSTI2023

Status of ORNL TSL evaluations [Slides]

This lecture provides details on the status of ORNL TSL evaluations. Main sections include modeling of concrete, updates of polyethylene evaluation, and initial transmission measurements at Oak Ridge National Labatory (ORNL). The presentation Conclusions show that literature review and initial modeling of concrete components have been performed. INS and transmission measurements of concrete and hydrated cement have been also planned. Additionally, A new TSL library for Polyethylene was created and submitted to NNDC and development for a new transmission capability at ORNL is underway.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Applying Methodology for Evaluating and Validating TSLs to Materials of Interest to NCSP [Slides]

This presentation covers the topic of applying methodology for evaluation validation of TSLs to material of interest to the Nuclear Criticality Safety Program (NCSP). The talk covers recent efforts in validating thermal neutron scattering cross sections. The presentation also proposes a methodology for not only validating thermal scattering files that utilizes all available experimental data, but also for evaluating new libraries as demonstrated on Polystyrene and Lucite

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Training Evaluation: A Case Study of Measuring Impact and ROI

The purpose of this case study was to evaluate the Compliance Officer/Coordinator (CO/CC) training program using Phillips’ approach to training evaluation. INL Learning Performance Consultants (LPCs) applied the ROI Methodology to measure the effectiveness of the CO/CC training program. INL CO/CCs participated in focus groups to provide feedback on their learning, enablers and barriers to applying what they learned, and opportunities to improve the CO/CC learning experience. With collaboration from the CO/CC training program owner, the LPCs demonstrated the business impact and return on investment (ROI) of the CO/CC training program. Included are training program recommendations and lessons learned using the ROI Methodology.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2025

Evaluation of normalization strategies for mass spectrometry-based multi-omics datasets

Introduction Data normalization is crucial for multi-omics integration, reducing systematic errors and maximizing the likelihood of discovering true biological variation. Most studies assess normalization for a single omics type or use datasets from separate experiments. Few address time-course data, where normalization might bias temporal differentiation. In this study, we compared common normalization methods and a machine learning approach, Systematical Error Removal using Random Forest (SERRF), using multi-omics datasets generated from the same experiment—even from the same cell lysate. Objectives To develop a straightforward process to assess normalization effects and identify the most robust methods across multi-omics datasets. Methods We analyzed metabolomics, lipidomics, and proteomics datasets from primary human cardiomyocytes and motor neurons exposed to acetylcholine-active compounds over time. Normalization effectiveness was evaluated based on improvement in QC features consistency and observing the change in treatment and time-related variance. Results Probabilistic Quotient Normalization (PQN) and Locally Estimated Scatterplot Smoothing (LOESS) QC were identified as optimal for metabolomics and lipidomics, while PQN, Median, and LOESS normalization excelled for proteomics. These methods consistently enhanced QC feature consistency in metabolomics and lipidomics, and preserved time-related variance or treatment-related variance in proteomics, demonstrating their effectiveness and robustness. SERRF normalization, applied only to metabolomics in this study, outperformed other methods in some datasets but inadvertently masked treatment-related variance in others. Conclusion Our evaluation identified PQN and LoessQC as the top methods for metabolomics and lipidomics, and PQN, Median, and Loess normalization for proteomics, in multi-omics integration in a temporal study.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Quantitative evaluations of subtropical westerly jet simulations over East Asia based on multiple CMIP5 and CMIP6 GCMs

As a salient feature of the Asian monsoon system, the East Asian subtropical westerly jet (EASWJ) exerts significant impacts on weather and climate changes in China and even throughout East Asia. In this paper, we applied a new self-adaptive algorithm to detect the EASWJ, identify its boundaries, and then represent its characteristics by defining three indices: the intensity index, meridional displacement index, and width index. Compared to the reanalysis data, we carried out a comprehensive, objective, and quantitative EASWJ evaluation using historical experiments from multiple global climate models (GCMs) in the Coupled Model Intercomparison Project Phases 5 and 6 (CMIP5 and CMIP6). The results show that the multimodel ensemble mean (MME) of both CMIP5 and CMIP6 can simulate the characteristics of winter EASWJ well. While for the other three seasons, the MME of both phase models underestimate the 200-hPa zonal wind (U200) strength in the jet coverage area and overestimate the U200 outside the jet area, such simulation results weaken the meridional shear of the wind field. The EASWJ simulations from the CMIP5 GCMs had no consistent intensity or location characteristic tendencies, and most CMIP5 GCMs tended to simulate relatively wide-coverage jets. In contrast, most CMIP6 GCMs are inclined to simulate significantly weaker, wider, and more-northward jets. Compared to the predecessors in CMIP5, about half of CMIP6 GCMs significantly minimized the jet intensity bias, but remarkable errors were still observed in their jet location and coverage representations. Furthermore, the comparative analysis performed by classifying models based on their evaluated simulation results suggested that the simulated performance of the meridional temperature gradient was important for capturing the EASWJ characteristics. Further in-depth study of the causes of model differences is warranted to improve simulation results.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

pystorms: A simulation sandbox for the development and evaluation of stormwater control algorithms

Advances in cyber–physical technologies have enabled real-time sensing and adaptive control of stormwater infrastructure. These smart stormwater systems allow for inexpensive, minimally-invasive stormwater control interventions in lieu of new construction. Importantly, however promising the area of smart stormwater control, there still remain barriers – for experts and novices alike – to access shared tools and methods for investigating, developing, and contributing to it. In an effort to make smart stormwater control research more methodical and accessible, we present pystorms, an open-source Python-based simulation sandbox that facilitates the quantitative evaluation and comparison of control strategies. pystorms consists of a collection of real world-inspired smart stormwater control scenarios on which any number of control strategies can be applied and tested via an accompanying Python programming interface and coupled stormwater simulator. pystorms provides a framework for the rigorous and efficient evaluation of smart stormwater control methodologies across diverse watersheds with only a few lines of code.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

How to estimate soil organic carbon stocks of agricultural fields? perspectives using ex-ante evaluation

Estimating soil organic carbon (SOC) stocks of agricultural fields has a range of important applications from development of sustainable management practices to monitoring carbon stocks. There are many estimation strategies with the potential for more reliable estimates of SOC stock and more efficient use of soil sampling and analysis resources, especially by leveraging readily available auxiliary information such as remote sensing. However, concrete guidance for strategy selection is lacking. This study narrows this gap with a comparison of strategies for estimating deep SOC stock (0–60 cm) in a prototypical field. Using high density SOC stock measurements and simulation, we built on past studies by 1) ex-ante evaluating a large number of strategy options, 2) using a Bayesian approach to quantify the uncertainty of the comparison, and 3) considering multiple Bayesian models to assess sensitivity to this modeling choice. We found that, using readily available auxiliary information, both balanced and stratified sampling offer substantial improvements over simple random sampling. The auxiliary information most important for this improvement is a Sentinel-2 SOC index = blue / (green × red), followed by the topographic wetness index. We found that these results are robust to the choice of mapping method, but that there is uncertainty in the magnitude of improvement. Here, we recommend future studies implement this Bayesian approach for simulated ex-ante evaluation of SOC stock estimation strategies across more fields to investigate the generalizability of these findings.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Systematic Evaluation of Atmospheric Forcing, Surface Datasets, and Mesh Effects on Kilometer-Scale Land Surface and River Modeling

Earth system models are advancing toward kilometer-scale resolution to capture local climate impacts and extremes. High-resolution land and river modeling depends on multiple factors, including mesh, surface datasets, and atmospheric forcing, but their relative effects at kilometer scales remain unquantified. We evaluated five Energy Exascale Earth System Model land and river configurations over the Mid-Atlantic region using two mesh (1/8° structured versus variable-resolution unstructured mesh), two surface datasets (default versus newly developed), and three atmospheric forcings (NLDAS2, MSWX, GSWP). Evaluation against satellite, reanalysis, and in situ benchmarks across water, energy, and carbon cycles quantifies how these factors affect model performance. Forcing selection produces the largest bias reductions (12-99% across variables), followed by surface datasets (7-75%) and mesh (up to 21%). Forcing effects vary by variable, with MSWX reducing biases for snow water equivalent, evapotranspiration, albedo, temperature, and gross primary productivity, GSWP for snow cover and runoff, and NLDAS for soil moisture and streamflow. The use of newly developed surface datasets improves gross primary productivity (58% bias reduction) and evapotranspiration but increase soil moisture and albedo biases due to current modeling limitations. Variable-resolution unstructured mesh improves the simulation of small-basin streamflow through better capturing drainage networks, though mesh minimally affects other land variables. These findings provide important guidance for high-resolution modeling development and actionable science.

Land and River modeling↗
DOE OSTI2025

Comprehensive defect evaluation of advanced nuclear fuels using high-resolution acoustic signals and optimized sensor separation

Graphite pebble composite structures based on TRistructural-ISOtropic (TRISO) particles are being developed as core nuclear fuels in advanced power reactors, promising safe operation at increased temperatures. Ensuring the structural integrity of these nuclear fuels requires comprehensive and accurate non-destructive evaluation (NDE) techniques to characterize defects and damage in the pebbles. However, traditional acoustic evaluation methods face limitations in defect characterization due to the highly attenuative, and geometrically and compositionally complex nature of these structures. This study proposes an improved acoustic NDE technique for accurate detection and classification of anticipated relevant defects and damage in graphite pebbles using high-resolution acoustic signals and optimized transmit-receive sensor networks. The proposed approach utilizes a triangular three-sensor network as the base unit, comprising three transmit-receive sensors. The sensor separation distance, as well as acoustic excitation center frequency, pulse-width, and bandwidth are optimized to enhance spatial resolution and improve signal-to-noise ratio, enabling effective characterization of the smallest size and widest range of defects in pebbles. Furthermore, the use of the triangular sensor configuration instead of a more conventional transmit-receive sensor pair expands the inspection region from a one-dimensional linear path to a two-dimensional area, increasing spatial coverage. To mitigate challenges associated with processing of complex acoustic signals arising from high-frequency, high-bandwidth excitation in these structures, a machine-learning-based signal processing algorithm is integrated with the sensor network. In the machine-learning-based algorithm, multi-domain features are extracted from the acoustic signals to capture intricate signal characteristics, significantly improving defect identification and classification compared to traditional approaches. The proposed acoustic NDE technique offers considerable promise for practical and reliable defect/damage diagnostics of advanced nuclear pebble fuels.

42 ENGINEERING↗
DOE OSTI2022

Quantitative evaluation of common cause failures in high safety-significant safety-related digital instrumentation and control systems in nuclear power plants

Digital instrumentation and control (DI&C) systems at nuclear power plants (NPPs) have many advantages over analog systems. They are proven to be more reliable, cheaper, and easier to maintain given obsolescence of analog components. However, they also pose new engineering and technical challenges, such as possibility of common cause failures (CCFs) unique to digital systems. Here this paper proposes a Platform for Risk Assessment of DI&C (PRADIC) that is developed by Idaho National Laboratory (INL). A methodology for evaluation of software CCFs in high safety-significant safety-related DI&C systems of NPPs was developed as part of the framework. The framework integrates three stages of a typical risk assessment—qualitative hazard analysis and quantitative reliability and consequence analyses. The quantified risks compared with respective acceptance criteria provide valuable insights for system architecture alternatives allowing design optimization in terms of risk reduction and cost savings. A comprehensive case study performed to demonstrate the framework's capabilities is documented here in this paper. Results show that the PRADIC is a powerful tool capable to identify potential digital-based CCFs, estimate their probabilities, and evaluate their impacts on system and plant safety.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2026

Integrating three plan evaluation approaches for coordinated heat resilience in cities across the Arizona urban corridor

Increasing heat poses a growing threat to cities worldwide due to both climate change and the urban heat island effect. While heat planning and governance are still emergent, research suggests that silos and conflicts within cities' networks of plans often impede heat resilience. Integrated heat resilience planning, therefore, requires a systematic and comprehensive analysis of the silos and conflicts relevant to heat resilience within networks of plans. This study is the first to combine three complementary plan evaluation methods to assess how cities' networks of plans address heat resilience. We applied 1) plan cross-referencing, 2) Plan Quality Evaluation for Heat Resilience, and 3) Plan Integration for Resilience Scorecard™ (PIRS™) for Heat to 19 plans from seven Arizona cities. We find similarities and differences in how these cities' networks of plans address heat hazards. The plans have consistently high-quality participation and coordination principles but lack details on vulnerability and climate change uncertainty, suggesting a need to move beyond immediate heat risks. We also identify opportunities to diversify policy mechanisms, spatially target high heat risk areas, and enhance the connection between planning efforts. These results validate that plan elements are interlinked and the importance of integrative plan development processes to improve heat resilience.

Extreme heat↗
DOE OSTI2021

Data–Driven Velocity Model Evaluation Using K–Means Clustering

In this work, we develop a data-driven clustering method to evaluate a velocity model using surface wave velocity dispersion. This is done by first computing theoretical dispersion curves for 1-D velocity profiles of all the grid locations and then splitting the resulting dispersion curves into a certain number of groups via the K-means clustering. The observed dispersion curves are also clustered following the same procedure and the velocity model is assessed by comparing the spatial patterns obtained for the observed and synthetic data sets. The method is applied to evaluate two community velocity models in southern California, CVM-S4.26 and CVM-H15.1, using phase velocity maps derived for 3–16 s Rayleigh waves. We found a good correlation in the spatial distribution of clusters between the result of CVM-S4.26 and that of the observed data, suggesting that the CVM-S4.26 fits the observed dispersion maps better than the CVM-H15.1 in terms of features extracted from the clustering analysis.

58 GEOSCIENCES↗