Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 901 records · Page 50

Performance Evaluation of Intelligent Solar Control Software Through Hardware-in-the-Loop (CRADA Final Report)

Recent research has highlighted the potential for solar to act as a zero-marginal-cost and zero-emission flexibility resource on the bulk power system when operated with advanced control systems. To increase the performance of these systems, leading technologies, including machine learning (ML) and hierarchical inverter set point allocation, have been developed by Latimer Controls, Inc. to estimate the headroom of large PV plants for grid operation and control; however, these technologies lack comprehensive validation under real-world application scenarios. Latimer Controls, Inc. received two voucher awards for research at a national laboratory from the Department of Energy American Made Solar Prize Round 6. The National Renewable Energy Laboratory (NREL) was selected to collaborate with Latimer staff to conduct a performance evaluation of Latimer PV control software. The NREL team will develop a hardware-in-the-loop (HIL) testbed to perform testing and validation of the Latimer PV control technology in a de-risked yet realistic testbed environment. Latimer and NREL worked together to analyze the test data, draw conclusions from the results, and disseminate the resulting scientific findings. In this CRADA work, we propose to test and validate the real-world application of the Latimer Control solution in an HIL environment. We evaluate the performance of different flexible solar technologies in responding to automatic generation control signals in a closed-loop fashion. In particular, a data-driven potential high limit (PHL) estimation is developed for large solar plants to accurately estimate their headroom so that they have fast and short-time regulation and control capability to participate in grid services and respond to grid signals in real time (e.g., AGC). This PHL estimation algorithm is embedded in a hardware power plant controller (PPC) and tested with an IEEE-39 bus system model developed in RTDS. To account for the varying cloud conditions and diverse inverter dispatches, we developed a 135-MW PV plant with detailed modeling of 27 individual PV modules and inverters using RTDS. The real-world communications used in such big plants, such as ModBus TCP/IP for inverter level and DNP3 for plant level, were developed to emulate the real-world applications in big PV plants. The ML-based PHL estimation method is tested under nine separate weather scenarios against the ‘reference-control’ solution, hereafter referred to as the baseline solution. The baseline method reserves a subset of inverters (reference group) to operate at their PHL at all times and dispatches only the remaining inverters (control group) at curtailed levels to fulfill the flexibility need. Despite being successfully piloted by NREL in California in 2017 and Chile in 2020, there exist two gaps in the state of the art to fully unlock the flexibility of PV plants: a. There is a trade-off between the PHL estimation accuracy and the flexibility range. b. There lacks granularity in the PHL estimation to capture the variation across inverters. The Latimer solution seeks to address these gaps by applying machine learning methods to improve PHL estimation accuracy while accounting for variability at every inverter. Performance metrics were taken from the 2023 Georgia Power CARES utility-scale RFP. The results demonstrate that the ML-based approach outperforms the traditional baseline method in PHL estimation accuracy for 7 of 9 scenarios. The average PHL error across the nine scenarios was 7.40% for the ML-based method, 2.06% less than the 9.46% PHL error average across scenarios that was exhibited by the baseline method. Additionally, the PHL error was below 5% for at least 95% of the testing interval for 3 of 9 tested intervals with the ML approach, whereas it did not achieve this metric for any of the baseline tests. Overall, simulation results indicate the superior performance of an ML-based approach compared to the conventional baseline reference-control approach, showcasing its potential to support grid stability and operational efficiency. This laboratory HIL testing using real PPC, representative power system simulation models in real-time with detailed PV plant and inverter models, and real-world communication protocols gives us confidence that this machine learning based PHL estimation algorithm works well in the hardware PPC and therefore de-risks future field commissioning. The end goal of this project is to advance grid technology to address the grid operation challenges brought by solar plant’s variability and uncertainties in power generation.

14 SOLAR ENERGY↗

A Framework for Evaluating the Implementation Cost of Attacks on Large Language Models

Large Language Models (LLMs) have been increasingly proposed as a method to enhance productivity in tasks that involve language and code. However, these models are large, complex, and their capabilities are not easily understood and controlled, meaning that their adoption opens many possibilities for new cyberattacks and misuse. Numerous attacks on LLMs have been reported and summarized in literature reviews, but we found existing reviews lacking in understanding the implementation cost of the attacks - i.e., how much effort would an attacker need in terms of coding, expertise, and resources to adopt attacks presented in the literature. Therefore, we divide existing attacks on LLMs into a taxonomy, and define a cost evaluation framework to determine the cost of the attack. An attack’s cost can be 1) estimated from reading the publication about the attack or 2) determined by implementing the attack from that publication. We provide an example evaluation of a couple jailbreaking frameworks based on experiments, and then apply the more lightweight cost estimate to a representative selection of attacks across the taxonomy we define. We discuss the relative difficulty of the attacks and also highlight defenses that have attempted to mitigate these attacks and assess their effectiveness.

97 MATHEMATICS AND COMPUTING↗

Feature Based Qualification of 17-4PH Stainless Steel to Evaluate Location-Specific Variability in Wire Arc Additive Manufacturing

Qualifying large-scale metal additive manufacturing (M-AM) technologies such as wire arc additive manufacturing (WAAM) can be challenging. This is especially significant in precipitation hardened martensitic stainless steels like SS 17-4PH, where thermal histories induce location-specific microstructural variability and property anisotropy. The Department of Defense (DOD) and the United States Army Combat Capabilities Development Command Ground Vehicle Systems Center (GVSC) Ground Vehicle Materials Engineering (GVME) aim to build robust and qualified large-scale M-AM workflows that could reduce the time and cost through quick and informed evaluation, testing, and development of feedstock, processes, and parts. The report presents the findings from the collaborative efforts between Oak Ridge National Laboratory (ORNL) and the U.S. Army GVSC GVME. The aim of this project was to develop a geometric feature-based qualification framework for WAAM of SS 17-4PH components. This report outlines selection methodology of representative build geometries, optimization of WAAM process parameters, in-situ monitoring, microstructure-property evaluation, thermal simulations, as well as data visualization techniques incorporated in this project. The results from this project demonstrate a clear understanding of thermal history dependent phase evolution and consequent location-specific property variations in WAAM of SS 17-4PH. These results in conjunction with the data-driven methodologies used in this project are expected to reduce qualification timelines, improve predictability, and accelerate the development of reliable feature-based qualification strategies for part production via large-scale M-AM technologies.

36 MATERIALS SCIENCE↗

Intermediate Scale Test Platform Conceptual Design and Hybrid Resin Performance Evaluation Recommendations

Recent laboratory evaluations demonstrated that further testing of alternative hybrid resins is warranted for their potential use as part of the 200 West Area (200W) pump-and-treat (P&T) remedy. 200W P&T has been treating technetium (Tc) since 2012 and uranium (U) since 2015 via two separate ion exchange (IX) treatment units: a single treatment train (i.e., a three-vessel system) for the removal of uranium utilizing a gel strong base anion (SBA) exchange resin, Dowex 21K; and two parallel treatment trains for the removal technetium using a gel SBA resin, Purolite® A532E. While these resins have been removing these contaminants effectively, new hybrid resins can provide additional benefits of further optimizing the IX treatment unit capacities and addressing additional treatment needs (e.g., Cr(VI)) by removing multiple contaminants simultaneously and/or through specific design configurations. Some of these resins also demonstrated some level of removal for I-129 which would be significant for expansion of the P&T into the 200 East Area. This document provides design recommendations for an intermediate scale test platform (ISTP) to evaluate alternative hybrid IX resin performance under conditions approaching field scale and using 200W P&T process groundwater. Results from the ISTP will provide the technical basis required to inform alternative IX resin selection in future 200W P&T facility operations where the treatment of multiple contaminants of concern may be required.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Evaluating pulse-shaping capabilities of next-generation pulsed power architectures

This project evaluated the pulse shaping capabilities of next-generation pulsed power (NGPP) architectures. NGPP architectures share several common attributes including multiple independent pulse-generation lines, a radial water-insulated impedance transformer, and a central vacuum insulated load region. A multi-module circuit model was developed, incorporating independent pulse-generation lines and a 2-D transmission line mesh of the radial impedance transformer to assess the effects of azimuthal asymmetry in pulse-shaped experiments. Circuit model simulations demonstrated that NGPP architectures are able to produce the the desired current pulse shapes for exemplar NGPP experiments. Additionally, the project explored automated methods for experiment design, including derivative -ree optimization and machine learning. Pulse-shaped experiments require designers to determine machine parameters that reliably produce the desired current pulse at the load, a process that typically relies on expert knowledge and iterative adjustments using the Z circuit model. Given the increased complexity of NGPP systems, this manual approach may be impractical. While the evaluated methods do not eliminate the need for manual iteration, they can reduce the time required for experiment design. Derivative-free optimization automates much of the trial-and-error process, providing a close starting point for manual adjustments or making small modifications to near-final designs. Meanwhile, deep neural network methods can generate a good qualitative match to the desired current pulse in under one second without requiring circuit model simulations.

42 ENGINEERING↗

Hydropower Biological Evaluation Toolset (HBET) Version 3.0: User Guide

The Hydropower Biological Evaluation Tools (HBET) software package, developed by Pacific Northwest National Laboratory (PNNL), is designed to assemble, organize, and process data collected by Sensor Fish and live fish. HBET enable users to characterize the hydraulic conditions of hydropower structures and estimate fish injury and mortality rates from various stressors. Future updates of the software may support other technologies, such as bead tracking in physical models and computational fluid dynamics. The HBET program can be customized to analyze different hydraulic applications, including turbines, spillways, weirs, pumped storage, and other user-defined functions, and therefore, help researchers, turbine designers, hydropower operators, and regulators better evaluate hydropower structures regarding their environmental sustainability and cost-effectiveness. Added content to the user guide about the new feature for predicting absolute injury rates.

13 HYDRO ENERGY↗

Summary of FY25 activities on the project Realistic Reaction Evaluations for Fission Products Off Stability (RREFPOS)

Applications such nonproliferation, post-detonation forensics, spent-fuel assay, reactor burnup and design, as well as astrophysics, rely on the accurate description of the neutron interaction with unstable fission products. Current neutron-induced cross-section descriptions for these nuclei are either non-existent or based on simplified assumptions, leading to unquantified impacts on predicted cross-sections. The goal of the Realistic Reaction Evaluations for Fission Products Off Stability (RREFPOS) project is to develop a reproducible methodology leading to a more predictive and realistic new set of evaluated nuclear data, improving the reliability of applications involving fission products off stability. The current report documents the activities related to the RREFPOS project in its first year, corresponding to the Fiscal Year of 2025 (FY25).

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Evaluation of IEC 62443 Standard Gaps for Electric Grid Substation Model Use Case

This report presents an evaluation of the IEC 62443 standards in the context of electric grid substations, as part of a collaborative effort among Sandia National Laboratories (SNL), Idaho National Laboratory (INL), and the National Renewable Energy Laboratory (NREL). The primary objective is to assess the applicability of these standards to enhance cybersecurity measures for industrial automation and control systems (IACS) within the energy sector. The evaluation identifies strengths, such as the scalability of security levels and the structured lifecycle guidance provided by IEC 62443. However, it also highlights significant gaps, including limited integration of physical security, insufficient guidance for legacy systems, and challenges in addressing emerging threats like supply chain vulnerabilities. Recommendations for refining the standards are proposed, including the need for tailored guidance for securing legacy systems, integrating physical security with cybersecurity frameworks, and enhancing interoperability across multi-vendor environments. By addressing these gaps, the IEC 62443 standards can be strengthened to ensure comprehensive cybersecurity for electric grid substations, thereby supporting the resilience and reliability of critical energy infrastructure.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Estimation Methodology to Evaluate Hypothetical Downwind Impacts from Fusion Plants

The continuing move toward establishing fusion systems for power generation and the associated research to that end is prompting examination of the potential health and safety impacts of such plants to the environment and human health. As many fusion facilities will have tritium inventories on site as part of the fusion fuel, evaluating the potential for downwind impacts from fusion facilities or power plants resulting from accident or routine emissions is a general requirement for assessing location and impacts to workers and the public. As part of siting considerations and permitting, the fusion facilities would be evaluated for potential for downwind concentration and dose impacts. For accident assessment scenarios, the downwind impacts are usually modeled as an instantaneous (or near-instantaneous) release of material transported following the wind. A range of meteorological conditions are usually assessed to determine a bounding case which results in a dose exceeding a specified threshold (e.g., 95 th or 99 th percentile; DOE 2015). This report provides initial estimates of the downwind dose impacts from a potential tritium release at a fusion power plant-relevant facility and identifies potential distances required to limit impacts to nearby population. This effort is meant to provide a bounding analysis and theoretical understanding of impacts of tritium releases for facilities subject to various environmental and atmospheric conditions. Using a Gaussian dispersion model to simulate a brief plume, downwind concentration and dose is projected for tritium oxide. Releases are assumed to consist entirely of tritium oxide due to the increased dose impacts from the oxide form relative to the elemental form of tritium. We also briefly identify how climatological conditions could potentially be used to support risk profile determination.

54 ENVIRONMENTAL SCIENCES↗

Survey of Neutron Induced Fission Experimental and Evaluated Data for 233 U, 238 Pu, 240 Pu, and 242 Pu between 100 keV and 20 MeV

We review data and evaluations for neutron-induced fission for the actinides 233 U, 238 Pu, 240 Pu and 242 Pu. These isotopes are part of common nuclear fuel cycles, especially for modern fast reactors. We focus on incident neutrons in the energy range of 100 keV to 20 MeV and compare the experimental data from the literature to the major evaluated libraries ENDF/B-VIII.1, JENDL-5, and JEFF-3.3, as well as to LLNL’s ENDL-2009.5 library. Based on the assessment of the fission cross sections, we provide recommendations on which library to use. Additional assessments covering other reaction channels will be provided separately.

07 ISOTOPE AND RADIATION SOURCES↗

Thermo-Mechanical Modeling and Evaluation of the Cracking Response of Additively Manufactured Monolithic SiC Lattice Structures Subjected to Laser Heating

Increasing operating temperatures of solar receivers is paramount to the efficiency of concentrated solar thermal (CST) and solar power (CSP) systems. Owing to its high temperature stability combined with excellent thermal and optical properties, SiC has been the material of choice for application in high-temperature solar receivers. The state-of-the-art SiC volumetric concentrating solar air receivers such as honeycomb design have been demonstrated in field tests to achieve exit air temperatures approaching 800oC. However, successful application of CST systems for decarbonization requires significant increase in temperature capability of SiC receiver technology. Supported by an award from the Solar Technology Office (SETO), US Department of Energy (DOE), GE Research in collaboration with Heliogen Holdings Inc, is engaged in the development of ultra-High Operating Temperature SiC-matrix Solar Thermal Air Receiver (HOTSSTAR) enabled by additive manufacturing. The program objective is to design and to demonstrate a techno-economically viable SiC air receiver technology to achieve exit air temperature of 1100oC for CST applications. This report summarizes the learnings of a computational study on additively manufactured SiC lattice structures subjected to laser heating. The results from this study aim to help guide the design of a SiC receiver through a better understanding of lattice structure geometric parameters and their implications on the cracking response of the structure. In the study, a heat flux was applied to the surface of a 2”-diameter cylindrical lattice structure to simulate a 4kW CO2 laser. The resulting temperature distribution was applied to a structural model to approximate the stress distribution within the lattice structure and a Weibull analysis was performed to gain insight into the probability of failure and to evaluate the cracking response of the structure. With this approach, the influence of lattice density on temperature, stress, and probability of failure was explored for two different lattice beam spacings. A discussion on modeling assumptions, a comparison with experimental results, and an evaluation of the lattice cracking response is provided.

14 SOLAR ENERGY↗

Performance Evaluation of a Microgrid System with Grid-Forming and Grid-Following Inverters with Diesel Generators: Insights From Hardware Experiments

This paper presents a comprehensive performance evaluation of a microgrid system integrating grid-forming (GFM) inverters, grid-following (GFL) inverters, and a diesel generator, focusing on their interactions and behavior under various dynamic events. The study is conducted using a pure hardware setup comprising two GFM inverters, one GFL inverter, a diesel generator, load banks, a point of common coupling (PCC), and an emulated main grid. The evaluation specifically examines dynamic scenarios, including voltage jumps, phase jumps, rate of change of frequency (ROCOF), synchronization, and islanding operations, which pose critical challenges to system stability. Among all the tests conducted, the overloading and phase jump tests proved to be the most challenging. The capacity of the DC side is crucial for withstanding overloading and grid disturbance tests; otherwise, GFM inverters frequently trip due to DC undervoltage. Throughout all grid disturbance tests, the diesel generator consistently stands out as the most robust and reliable GFM unit in the system. Overall, insights from these hardware experiments shed light on the response characteristics of different generation types during grid disturbances and identify potential stability concerns in such hybrid microgrid systems.

14 SOLAR ENERGY↗

Evaluation of AI-enabled Digital Documented Safety Analysis

The National Reactor Innovation Center (NRIC) is leading a transformative initiative to accelerate advanced reactor deployment by fundamentally reimagining how nuclear safety basis documentation is developed, reviewed, and maintained. Traditional Documented Safety Analysis (DSA) processes for DOE-authorized facilities rely on static, document-centric workflows that consume significant time and resources, exemplified by recent major licensing efforts requiring hundreds of thousands of staff hours and millions of pages of documentation review. These conventional approaches create barriers to the rapid, cost-effective deployment of advanced reactors that America's future energy needs demand. NRIC's DOE Authorization Digital Transformation Project addresses these challenges through an innovative framework that integrates artificial intelligence (AI), digital engineering, and systems-based data management into a cohesive digital ecosystem. This white paper presents NRIC's methodology for evaluating AI-enabled document generation capabilities within this broader digital infrastructure, using the Demonstration of Microreactor Experiments (DOME) facility as a pilot case study. The evaluation will assess an AI tool's ability to generate a Preliminary Documented Safety Analysis (PDSA) through progressive integration stages—from standalone document processing to full digital thread connectivity—while maintaining rigorous verification, validation, and regulatory acceptance standards. By establishing dynamic, traceable connections between design data and safety documentation, NRIC's approach has the potential to reduce both document development time and regulatory review cycles by as much as 50%, while simultaneously improving accuracy, consistency, and traceability. This initiative represents a critical step toward establishing reusable digital infrastructure that reactor developers can leverage to accelerate their path from concept to commercial operation, directly supporting NRIC's mission to demonstrate and deploy advanced nuclear energy technologies.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

Evaluation of the Radiological Characterization for Off-Site Source Recovery Program Waste Streams LA-OS-00-01.001, LA-OS-00-03, and LA-OS-00-04

The purpose of this memorandum is to satisfy the requirements of Section 4.4 of the CCP Acceptable Knowledge Documentation procedure CCP-TP-005 (Ref. 1). This evaluation is updating the previously issued memo NEN3:24-045 issued in August 2024. CCP-TP-005 requires an AK Expert and the OSRP group to evaluate the radionuclide characterization of a waste stream and prepare the NDA Memorandum (letter to CCP Records). This NDA memorandum was written with input from the OSRP group, as required by CCP-TP-005. This memo includes a discussion of the limitations for the radiological characterization and a description of the characterization method.

07 ISOTOPE AND RADIATION SOURCES↗

Neutronics Evaluation of the Preliminary Design of the Service Cell Door for the Second Target Station

The service cell door needs to provide sufficient shielding to achieve 0.25 mrem/h dose rates in the adjacent room while remote handling operations of waste materials are going on within the service cell for the Second Target Station (STS). This analysis provides a neutronics evaluation of the preliminary design of the service cell door to evaluate the required thickness and the effect of streaming gaps around the door. As radiation source, we use the decay gamma source of the moderator reflector assembly (MRA) of the STS with a decay time of either two days or six months. As the MRA contains a significant amount of beryllium, photonuclear reactions induce a neutron source, which dictates the required door thickness in certain situations. Four scenarios with different MRA positions and decay times have been analyzed. The required thickness differs drastically depending on the chosen scenario and on the material of the door. The streaming through the gaps around the door is relatively small with high dose rates limited to small sections of the geometry.

43 PARTICLE ACCELERATORS↗

Ruggedized Acoustic Tool for High-Temperature Wellbore Integrity Evaluation in Harsh Geothermal Environments [Slides]

This presentation covers the development of a high-temperature well integrity evaluation tool that (1) can operate in high-temperature EGS boreholes to provide consistent, high-resolution evaluation information, (2) can operate without active cooling or substantial mitigation of borehole conditions, and (3) can provide high-fidelity data to adequately characterize conditions that may present safety hazards, risk to the environment, and efficacy of wellbore construction for long-term operation.

15 GEOTHERMAL ENERGY↗

Bonneville Dam Powerhouse 2 Gatewell Improvement Post Construction Evaluation (Final Report)

Modifications to vertical barrier screens (VBS) and the addition of concrete corbels to improve passage conditions for juvenile salmonids in the gatewells of Bonneville Dam’s second powerhouse (B2) were completed prior to the 2024 passage season. To evaluate the effectiveness of those modifications, PNNL carried out a post construction evaluation to contrast fish condition and mortality between two turbine unit operational ranges within the peak efficiency range. A block-treatment study design was implemented in 2024 to contrast descaling and mortality of juvenile salmonids sampled in the juvenile fish facility following exposure to turbine operations (middle versus upper 1% peak efficiency range) during spring and summer passage periods. In spring, 1.96% of juvenile salmonids sampled during mid-1% operations were descaled and 0.46% were mortalities. Of those sampled during upper 1% unit operations in spring, 2.90% were descaled and 0.95% were mortalities. Although these differences appeared to be meaningful, substantial exceedances of the upper 1% limit occurred during two treatment blocks of the spring study period. Fish collected during the upper 1% treatment of these two blocks experienced substantially higher rates of descaling and mortality compared to those collected during mid-1% treatments. Censoring these two upper 1% samples from the spring study period resulted in upper 1% descaling and mortality rates that were statistically similar to those from the mid-1% treatment. During the summer study period, 0.99% of juveniles sampled during mid-1% operations were descaled and 0.33% suffered mortality; these rates were significantly lower than the descaling (2.80%) and mortality (1.73%) rates observed during upper 1% treatments. Comparing the results from the 2024 study to those from the historical (2008–2013) baseline of unmodified units revealed that the descaling and mortality rates observed during upper 1% operations in spring 2024 were near the upper end of the historic range observed for mid-1% operations. Spring 2024 upper 1% descaling and mortality rates were below, or well below the median of historical mid and upper 1% (combined) rates, which suggests that the modifications have had a positive effect. Summer 2024 upper 1% descaling and mortality rates were at or above the top of the range of historical mid 1% and above or well above the median of historical mid and upper 1% (combined) rates. It is important to keep in mind that 2024 is a single year when considering these comparisons. Additional study could help confirm these results or seek a level of operation that achieves the desired outcomes for fish.

13 HYDRO ENERGY↗

Large Scale Field Demonstration Evaluation Plan

This Evaluation Plan defines practical, commissioning-oriented test protocols for in-field assessment of grid-forming (GFM) inverter-based resources (IBRs) deployed under the UNIFI Consortium Field Demonstration. The demonstration’s overarching objective is to validate multi vendor GFM technologies at impactful unit/plant scale, assess interoperability and grid-service performance, and evaluate the applicability of the UNIFI Specifications for Grid-forming Inverter-based Resources in real utility environments, including integration with operational systems and protection schemes.

24 POWER TRANSMISSION AND DISTRIBUTION↗