Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Evaluating the Effectiveness of a Detection and Deterrent System in Reducing Golden Eagle Fatalities at Operational Wind Facilities

The Renewable Energy Wildlife Institute (REWI) was appointed as the prime awardee of DOE award number DE-EE0007883 to lead a team of scientists, wind developers, and technology manufacturers toward the overarching goal of evaluating the effectiveness of the current DTBird system in minimizing the risk of golden eagles (Aquila chrysaetos) and other large soaring raptors from approaching the rotor-swept zone (RSZ) of operating wind turbines. As part of this goal, the team set out to 1) quantify the expected reduction in collision risk for golden eagles from operation of the detection and deterrence modules in a manner that supports the approach used by the U.S. Fish and Wildlife Service (USFWS) to assess and credit facility operators for their efforts to minimize predicted collision fatalities and 2) provide information to help improve the technology to maximize its effectiveness. DTBird is an automated detection and audio deterrent system created by the Spanish company Liquen, designed to discourage birds from entering the RSZ of spinning wind turbines. The system uses cameras to automatically detect airborne targets of interest, records each such event in an online database, and triggers a warning signal (loud sound) if the tracked object has moved close to the turbine. If the object moves even closer to the RSZ, a more aggressive dissuasion signal is broadcast. To meet our objectives, the team conducted a two-year experiment at the Goodnoe Hills wind facility in Washington state, in which 14 turbines were outfitted with DTBird units. Daily, each DTBird-equipped turbine was randomly assigned to a control or treatment group. Treatment turbines operated with DTBird running as intended—broadcasting warning or deterrent signals when DTBird detected a target within range. On control turbines, no sound signals were broadcast if a moving target triggered the DTBird system. The team also flew unmanned aerial vehicles (UAVs) designed to coarsely mimic the general size, weight, and coloration of golden eagles in programmed flight transects across DTBird detection ranges to quantify DTBird’s ability to detect intended targets and to evaluate factors that influence the probability of detection and DTBird’s response distances. Additionally, the team evaluated the behavioral responses of in situ eagles exposed to spinning turbines alone (visual and sound influences) versus spinning turbines plus broadcasted DTBird audio deterrents, to estimate the effectiveness of deterrence by the DTBird system. The data and results from these investigations were combined with those from a pilot study conducted at the Manzana Wind Power Project in California to better evaluate DTBird’s effectiveness across different landscapes.

17 WIND ENERGY↗
DOE OSTI2025

2023 T120 Horizon and Slim Posthole Seismometer Exploratory Evaluation

Sandia National Laboratories has tested and evaluated a suite of four T120 broadband seismometers designed and manufactured by Nanometrics. Specifically, two T120 Horizon V2 sensors, one T120 Horizon V1 sensor and one T120 Slim Posthole (PH) sensor were evaluated. The purpose of this seismometer evaluation is to measure performance characteristics in areas such as power consumption, sensitivity, frequency response, full scale, self-noise, dynamic range, calibration system response, and passband. The T120 model of sensors are being evaluated to explore the potential for a future seismometer Type Approval process in the International Monitoring System (IMS) of the Comprehensive Nuclear-Test-Ban Treaty (CTBT).

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Evaluating 240 Pu Prompt Fission Neutron Spectra Including Chi-Nu Experimental Data

This report documents an evaluation of 240 Pu prompt fission neutron spectra (PFNS) including Chi-Nu experimental data. This work is a FY2025 Q4 NCSP (Nuclear Criticality Safety Program) milestone and named a “strategic priority”. This evaluation is new; it differs substantially from the most recent evaluation included in the ENDF/B library, which was for ENDF/B-VII.1 and then carried over unchanged to ENDF/B-VIII.1. The key difference between ENDF/B-VIII.1 and the new evaluation is that we have, for the first time, realistic experimental 240 Pu PFNS covering a broad incident and outgoing neutron energy range.

240Pu↗
DOE OSTI2026

Model Evaluation Protocol for Fire Models Involving Fuels at Liquefied Natural Gas Facilities (Version 2)

This document provides a description of the model evaluation protocol (MEP) for pool fires, jet fires, and fireballs involving liquefied natural gas (LNG) and processing fuels at LNG facilities. The purpose of the MEP is to provide procedures regarding the assessment of a model’s suitability to predict heat flux from fires. Three components, namely, a scientific assessment, model verification, and model validation comprise the MEP. The evaluation of a model satisfying these three components is to be documented in the form of a model evaluation report (MER). Discussion of models for the prediction of fire, detailed information on each of the three MEP components, the MEP procedure regarding new versions of previously approved models, and the format of the model evaluation report (MER) are provided.

03 NATURAL GAS↗
DOE OSTI2025

CyberMESA: Evaluation Procedures and Metrics for Charging Infrastructure Cybersecurity

A report detailing the cybersecurity evaluation and assessment procedures for EV charging infrastructure. This report is authored by three national lab contributors. INL, PNNL, NRL. The grid integration of Electric Vehicle Charging Infrastructure (EVCI) is a large and complex system of systems (SoS) made up of components from many manufacturers and integrated by various companies responsible for their operation and maintenance. This complexity makes it challenging to implement security standards like IEC 62443 across the entire infrastructure. This document aims to aid in the vulnerability assessments of individual devices, such as Electric Vehicle Supply Equipment (EVSE), to support vendors in adopting and implementing security standards such as UL 2900, NIST SP 800-53 and Common Criteria (CC) (ISO/IEC 15408). This document serves as a guide to help evaluate the cybersecurity posture of EVCI assets. It aims to provide a consistent method for evaluating EVCI, enabling cybersecurity research teams to systematically test a wide range of electric vehicle (EV) assets. The target audiences include cybersecurity research teams, vendor development teams, automotive OEMs, and third-party evaluators.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

MoE-Inference-Bench: Performance Evaluation of Mixture of Expert Large Language and Vision Models

Mixture of Experts (MoE) models have enabled the scaling of Large Language Models (LLMs) and Vision Language Models (VLMs) by achieving massive parameter counts while maintaining computational efficiency. However, MoEs introduce several inference-time challenges, including load imbalance across experts and the additional routing computational overhead. To address these challenges and fully harness the benefits of MoE, a systematic evaluation of hardware acceleration techniques is essential. We present MoE-Inference-Bench, a comprehensive study to evaluate MoE performance across diverse scenarios. We analyze the impact of batch size, sequence length, and critical MoE hyperparameters such as FFN dimensions and number of experts on throughput. We evaluate several optimization techniques on Nvidia H100 GPUs, including pruning, Fused MoE operations, speculative decoding, quantization, and various parallelization strategies. Our evaluation includes MoEs from the Mixtral, DeepSeek, OLMoE and Qwen families. The results reveal performance differences across configurations and provide insights for the efficient deployment of MoEs.

Chitty-Venkata, Krishna Teja↗
DOE OSTI2025

Ship Motion Testing Needs Evaluation

The American Bureau of Shipping performed an evaluation of national maritime nuclear testing capabilities and determined there currently is an inability to test maritime nuclear power plants in a ship motion environment. A Ship Motion Test Facility (SMTF) is proposed to fill this gap. To inform design of this facility, this report documents an evaluation performed by a panel of technical experts that identifies key physical phenomena associated with maritime nuclear power plant operation that are important to safety and reliability and have a low state of knowledge. This evaluation concluded that all of the major test needs to understand a nuclear plant's behavior in a ship motion environment are for thermal-hydraulics related phenomena. Based on this finding, the evaluation panel concluded that the SMTF would not be required to use nuclear fuel to provide a heat source for the fluids. This would significantly decrease the cost, timeline, and complexity for this test facility to enable the advancement of maritime nuclear technology.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

Evaluations for Nuclear Criticality Safety Program 12 C, 139 La, minor actinides, 235 U [Slides]

For light nuclei, preliminary work extends the evaluation from 6.5 MeV to ~ 10 MeV. For 139 La, the team delivered full evaluation in fast region to ORNL, including covariances. For sup>235 U, RPI data simulations, the team performed simulations and showed some improvement for neutrons below 5 MeV. Some of the changes needed for more improvement might not be supported by the current format. Some of the changes above 12 MeV to account for the angular distribution of preequilibrium neutrons require a change in the PFNS evaluation procedure.

235U re-evaluation↗
DOE OSTI2024

A new 181 Ta neutron resolved resonance region evaluation

A new 181 Ta neutron resolved resonance region evaluation has been performed from the thermal energy range up to approximately 2.5 keV. The R-matrix SAMMY code was used with the Reich–Moore approximation to evaluate resonance parameters from several experimental data sets. A Monte Carlo approach was used for resonance spin assignments and generating 59 small fictitious resonance levels which were shown to improve the cumulative level, Porter-Thomas, and Wigner distributions as compared to theoretical predictions. Covariance information was also generated for the entire resolved resonance region. Finally, the positive impact of the new evaluation was validated through benchmark calculations which were sensitive to the 181 Ta cross section and showed improvement in the reactivity bias for several benchmark cases.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

Design and evaluation of alphabetic and numeric input methods for virtual reality

In today’s virtual reality (VR), users have various ways to influence their VR experience, including alphanumeric input. While typing characters and numbers is straightforward on desktop computers, it presents challenges and opportunities in head-mounted display VR due to specific interaction methods and a lack of real-world visual stimuli. Addressing these open questions, our work implements and evaluates ten approaches to alphabetic and numeric inputs in VR. Here, we describe the design motivation behind these input methods and evaluate them in a user study with 40 participants divided into groups for alphabetic and numeric keyboards. This comparison investigates each method’s performance and user interactions. Our findings suggest that different input methods significantly impact words per minute and error rates, and that certain keyboard designs may receive better subjective evaluations despite poorer objective performance.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Model Data Archive for Manuscript Titled "Evaluation of a Coupled Surface–Subsurface Hydrologic Model Using Dense Water‑Level Sensors in a Mixed Urban–Rural Watershed"

This archive provides scripts, input files, and datasets used for the implementation and evaluation of a fully coupled surface–subsurface hydrologic model in the Neches River Basin, southeast Texas. The study uses the Advanced Terrestrial Simulator (ATS) to simulate coupled surface–subsurface hydrologic processes over a mixed urban–rural watershed and evaluates model performance using a dense network of 136 in situ water-level sensors, nine U.S. Geological Survey (USGS) stream gauges, and SSEBop-derived evapotranspiration estimates during the period October 2014–June 2024. The workflow is implemented primarily in Python 3 using the Watershed Workflow package. The Jupyter notebooks can be executed using open-source software such as Anaconda JupyterLab or Visual Studio Code. Other data files include TXT, CSV, XML, SHP, TIF, NetCDF, HDF5, and ExodusII files, which can be processed using the provided Python scripts. ATS input files are provided in XML format and can be edited using any commonly used text editor. This archive contains: *Scripts and input files used to generate the ATS model setup, including watershed discretization, mesh generation, parameter mapping, and model configuration. *Jupyter notebooks used for preprocessing observational data, evaluating streamflow, water levels, and evapotranspiration, computing performance metrics, and generating the figures presented in the manuscript. *ATS simulation outputs and processed observational datasets, including OneRain and DD6 water-level sensors, USGS streamflow observations, GIS data, and supporting spatial datasets used throughout the study.

Dense water-level sensor network↗
DOE OSTI2024

A Resolved Resonance Evaluation for 51 V with Resonance Parameter Covariance

In this presentation the 51 V evaluation in response to NCSP need is completed. Issues in connection to RR representation are addressed. Uncertainty and covariance information derived with the evaluation. Evaluation proposed and accepted for inclusion in ENDF/B-VIII.1 library.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Analytical and Performance-Based Evaluation Alternatives to Full-Scope, High-Fidelity Testbeds

One consequence the design and operational differences of advanced reactors is that integrated system validation (ISV) using full-scope, high-fidelity testbed might not be cost-justified or practical. The absence of traditional ISV may pose an issue for the conduct of safety evaluations since it may leave regulators without the information derived from this performance-based testing. The purpose of this research is to identify analytical and performance-based test and evaluation methods that are alternatives to full-scope, high-fidelity testbeds that have traditionally been used for ISV. We developed a method to test validation based on a multi-stage validation (MSV) framework. MSV is an approach to meeting validation objectives through incremental, successive validation activities beginning in the early stages of the design process and continuing through the later stages. MSV doesn't rely solely on late stage validation, rather it accommodates the use of a broad spectrum of analytical and performance-based information and a diversity of testbeds. In addition, MSV embraces the use of information from other types of evaluations and analyses.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2026

EXERGETIC: De-Risking Next-Generation Resilient Geothermal Hybrids via At-Scale Evaluation Using Virtual Emulation Digital Twin Environment for Efficient Operation

The DOE-GTO-funded project, award number 5.1.2.12, entitled "EXERGETIC - De-risking Next Generation Resilient Geothermal Hybrids via at-Scale Evaluation Using a Virtual Emulation Digital Twin Environment for Efficient Operation," advances the solution to these challenges by developing and validating a geothermal co-emulation environment implemented at the National Laboratory of the Rockies (NLR)'s Advanced Research on Integrated Energy Systems (ARIES) platform. This framework enables the de-risking of next-generation geothermal and geothermal hybrid systems through high-fidelity modeling, real-time digital emulation, advanced control strategies, and techno-economic assessment. The project focused on geothermal hybrid configurations that integrate geothermal power plants with concentrated solar power and underground thermal energy storage, enabling enhanced efficiency, flexibility, and grid support capabilities. The main goal of this project was the development of a geothermal digital co-emulation environment to demonstrate the technical and economic value of geothermal hybrid systems and their contribution to grid stability and flexibility. The EXERGETIC framework combined physics-based models, controls, and real assets at ARIES, including digital real-time simulators (DRTS), a 20-MW-scale controllable grid interface (CGI), and a 2-MW conventional generator. Detailed transient models were developed for the key subsystems of a hybrid geothermal plant, including parabolic trough solar collectors, reservoir thermal energy storage (RTES), and a binary Organic Rankine Cycle (ORC) power plant. The ORC model explicitly captured thermal inertia and off-design operation and integrated control strategies to dynamically respond to electric load profiles. The models were validated against published experimental and numerical studies, demonstrating strong agreement and confirming the accuracy and robustness of the modeling approach. The resulting digital twin represents geothermal-solar-storage systems at multiple scales (1 MW to 100 MW) and enables realistic emulation of grid-connected operation. The control architecture allows the geothermal resource to provide stable baseload generation, while solar and stored thermal energy supply flexible, dispatchable support during periods of high demand or variable grid conditions. A key contribution of the EXERGETIC project is the demonstration that geothermal hybrid systems can be designed to be active grid assets rather than passive baseload generators. Using the ARIES platform, the digital twin was evaluated under multiple grid scenarios, including load following, voltage support at the distribution level, and frequency response at the transmission level. Results show that hybrid geothermal systems can respond effectively to dynamic grid conditions, providing inertia-like behavior, primary frequency support, and voltage regulation through coordinated control. In addition to the performance and grid services capability analysis of geothermal and hybrid geothermal systems, the EXERGETIC project also focused on scalability and techno-economic analysis of geothermal hybrid plants. In particular, for the scalability analysis, machine-learning (ML)-based surrogate models were trained using data generated from the geothermal digital twin under different grid-connected scenarios and plant capacities. These ML models demonstrated strong interpolation and extrapolation capabilities across plant sizes, accurately reproducing both steady-state and transient responses with very low errors. Regarding the techno-economic analysis, plant performance results were integrated with cost models for hybrid geothermal systems, and the levelized cost of electricity (LCOE) was used as the main economic metric to evaluate system performance across a range of system capacities, solar shares, solar multiples, and storage durations. Results indicate that economies of scale significantly reduce geothermal LCOE as plant capacity increases, with large-scale systems (25-100 MW) achieving substantially lower costs than small plants. Hybridization with solar thermal energy and storage further improves economic performance by increasing capacity utilization and enabling flexible dispatch. In addition, thermal storage plays a critical role in reducing LCOE by maximizing geothermal, solar, and stored energy resources. In summary, the results from this project demonstrate that geothermal hybrid systems represent a promising alternative for increasing the energy conversion efficiency of geothermal technologies, contributing to the preservation of geothermal resources, and supporting the transition of geothermal plants from traditional baseload resources into flexible, resilient, and cost-competitive energy conversion technologies.

15 GEOTHERMAL ENERGY↗
DOE OSTI2026

Evaluation Toolkit for Technical Assistance Programs

Across the United States, every home, business, industry, and government depends on abundant, reliable, and affordable electricity. Energy stakeholders have many options to improve how energy is generated, distributed, and used, but choosing the right path can be complex and challenging. To support more informed decision-making about local electricity systems, the U.S. Department of Energy (DOE) and its national laboratories provide customized technical assistance (TA) through several different programs. These TA programs are designed to support a wide range of stakeholders with a variety of needs. Technical assistance may include brief consultations with subject-matter experts, in-depth technical modeling and analysis, stakeholder engagement, and peer-to-peer exchange. Delivering effective TA is an iterative process that requires evaluation and adaptation. A comprehensive and robust evaluation framework provides the structure needed to ensure that TA programs and practitioners remain effective, responsive to industry trends, and aligned with local needs. This toolkit provides a framework—including a clear, structured process—that TA program staff can adapt to their program's goals to evaluate success.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

ECAR-6440 Rev 2 MARVEL Hazard Evaluation

This hazard evaluation supports the Microreactor Applications Research, Validation, and Evaluation (MARVEL) Project’s design effort and the development of the preliminary documented safety analysis (PDSA) (addendum to safety analysis report [SAR]-420, “Transient Reactor Test [TREAT] Facility FSAR”) (SAR-420-ADD-1). The hazard evaluation process for the MARVEL project for compliance with the requirements in 10 CFR 830, “Nuclear Safety Management,” follows a process similar to the Licensing Modernization Project (LMP) as outlined in Nuclear Energy Institute (NEI)-18-04, “Risk-Informed Performance-Based Guidance for Non-Light Water Reactor Licensing Basis Development,” and supporting documents. The LMP process is adapted to fit Department of Energy (DOE) reactor regulatory requirements as applicable and appropriate using a graded approach based on the MARVEL microreactor design. This approach provides reasonable assurance of meeting the requirements of 10 CFR 830 for protection of the public, workers, and environment.

21 - SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLAN↗
DOE OSTI2025

Identification and Clinical Evaluation of Potential Biomarkers for Breast Cancer Resistance Protein ( BCRP / ABCG2 )

Clinical inhibition and genetic variation of the Breast Cancer Resistance Protein (BCRP/ABCG2) efflux transporter can significantly influence drug exposure, highlighting the need for reliable BCRP functional biomarkers. This study aimed to identify and evaluate biomarkers predictive of BCRP function in humans. A comprehensive analysis of metabolomic genome‐wide association studies (mGWAS) was conducted to discover potential BCRP biomarkers, followed by evaluation inin vitrotransporter assays and a clinical drug–drug interaction (DDI) study. Across multiple mGWAS datasets, plasma concentrations of three herbicide derivatives—4‐hydroxychlorothalonil (4HC), 3‐bromo‐5‐chloro‐2,6‐dihydroxybenzoic acid (BCDBA), and 3,5‐dichloro‐2,6‐dihydroxybenzoic acid (DCDBA)—were significantly elevated (P < 5E‐8) in individuals carrying reduced functionABCG2polymorphisms. These compounds were confirmed as novel BCRP substrates via transporter uptake assays and selected for clinical evaluation alongside riboflavin, a known BCRP substrate and potential BCRP biomarker. In a DDI study with 11 healthy subjects, eltrombopag, a BCRP inhibitor, increased rosuvastatin concentrations by approximately twofold (P = 0.002). No significant changes in the plasma concentrations of organic anion transporting polypeptide 1B (OATP1B) biomarkers (CP‐I and CP‐III) or potential BCRP biomarkers (4HC, BCDBA, DCDBA, or riboflavin) were observed. Notably, two subjects were heterozygous carriers for theABCG2p.Q141K variant and exhibited significantly higher baseline concentrations of 4HC (P = 0.004) and BCDBA (P = 0.0003), consistent with reduced BCRP function. These findings suggest that 4HC and BCDBA are promising biomarkers for baseline BCRP function in specific populations, such as those harboring reduced function genetic polymorphisms, but do not appear suitable for detecting acute BCRP inhibition.

Pharmacology & Pharmacy↗