Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

ARM data-oriented metrics and diagnostics package for climate model evaluation (ARM-DIAGS-V3) version 3

A Python-based metrics and diagnostics package is currently being developed by the ARM Infrastructure Team at Lawrence Livermore National Laboratory to facilitate the use of long-term high frequency measurements from the ARM program in evaluating the regional climate simulation of clouds, radiation, precipitation, and aerosols. This metrics and diagnostics package computes climatological means of targeted climate model simulation and generates tables and plots for comparing the model simulation with ARM observational data. The CMIP model data sets are also included in the package to enable model inter-comparison as demonstrated in Zhang et al. (2018) and Zhang et al. (2020). The mean of the CMIP model can be served as a reference for individual models. Basic performance metrics are computed to measure the accuracy of mean state and variability of climate models. The evaluated physical quantities include cloud fraction, temperature, relative humidity, cloud liquid water path, total column water vapor, precipitation, sensible and latent heat fluxes, aerosol optical depth, and radiative fluxes, with plan to extend to more fields, such as the evaluation of model simulated aerosol physicochemical properties and cloud microphysics properties. Process-oriented diagnostics focusing on aerosol, cloud, and precipitation-related phenomena are also being developed for the evaluation and development of specific model physical parameterizations. In addition to the Southern Great Plains (SGP), North Slope of Alaska (NSA) and Tropical Western Pacific (TWP) atmospheric observatories in the ARMDIAGS version 2.0, the version 3.0 package have extended to the data collected at the ARM Eastern North Atlantic (ENA) atmospheric observatory and the Observation and Modeling of the Green Ocean Amazon (GOAMAZON) field campaign. The metrics and diagnostics package are currently built upon standard Python libraries and additional Python packages developed by DOE (CDAT). The ARM metrics and diagnostic package is available publicly with the hope that it can serve as an easy entry point for climate modelers to compare their models with ARM data. In this report, we first provide an overview of major metrics in section 2. The input data, which constitutes the core content of the metrics and diagnostics package, is summarized in section 3. A user's guide documenting the workflow/structure of the version 3.0 codes and including step-by-step instruction for running the package is described in section 4.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

ORNL Nuclear Data Evaluation Contribution to NCSP (ND-2) [Slides]

This presentation is titled ORNL Nuclear Data Evaluation Contribution to NCSP (ND-2). This lecture includes resonance evaluations, SAMMY fitting results, and resonance evaluation features. The presentation finishes with evaluations in alkaline earth-metals and halogens.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2024

Evaluating the Effectiveness of a Detection and Deterrent System in Reducing Golden Eagle Fatalities at Operational Wind Facilities

The Renewable Energy Wildlife Institute (REWI) was appointed as the prime awardee of DOE award number DE-EE0007883 to lead a team of scientists, wind developers, and technology manufacturers toward the overarching goal of evaluating the effectiveness of the current DTBird system in minimizing the risk of golden eagles (Aquila chrysaetos) and other large soaring raptors from approaching the rotor-swept zone (RSZ) of operating wind turbines. As part of this goal, the team set out to 1) quantify the expected reduction in collision risk for golden eagles from operation of the detection and deterrence modules in a manner that supports the approach used by the U.S. Fish and Wildlife Service (USFWS) to assess and credit facility operators for their efforts to minimize predicted collision fatalities and 2) provide information to help improve the technology to maximize its effectiveness. DTBird is an automated detection and audio deterrent system created by the Spanish company Liquen, designed to discourage birds from entering the RSZ of spinning wind turbines. The system uses cameras to automatically detect airborne targets of interest, records each such event in an online database, and triggers a warning signal (loud sound) if the tracked object has moved close to the turbine. If the object moves even closer to the RSZ, a more aggressive dissuasion signal is broadcast. To meet our objectives, the team conducted a two-year experiment at the Goodnoe Hills wind facility in Washington state, in which 14 turbines were outfitted with DTBird units. Daily, each DTBird-equipped turbine was randomly assigned to a control or treatment group. Treatment turbines operated with DTBird running as intended—broadcasting warning or deterrent signals when DTBird detected a target within range. On control turbines, no sound signals were broadcast if a moving target triggered the DTBird system. The team also flew unmanned aerial vehicles (UAVs) designed to coarsely mimic the general size, weight, and coloration of golden eagles in programmed flight transects across DTBird detection ranges to quantify DTBird’s ability to detect intended targets and to evaluate factors that influence the probability of detection and DTBird’s response distances. Additionally, the team evaluated the behavioral responses of in situ eagles exposed to spinning turbines alone (visual and sound influences) versus spinning turbines plus broadcasted DTBird audio deterrents, to estimate the effectiveness of deterrence by the DTBird system. The data and results from these investigations were combined with those from a pilot study conducted at the Manzana Wind Power Project in California to better evaluate DTBird’s effectiveness across different landscapes.

17 WIND ENERGY↗
DOE OSTI2025

2023 T120 Horizon and Slim Posthole Seismometer Exploratory Evaluation

Sandia National Laboratories has tested and evaluated a suite of four T120 broadband seismometers designed and manufactured by Nanometrics. Specifically, two T120 Horizon V2 sensors, one T120 Horizon V1 sensor and one T120 Slim Posthole (PH) sensor were evaluated. The purpose of this seismometer evaluation is to measure performance characteristics in areas such as power consumption, sensitivity, frequency response, full scale, self-noise, dynamic range, calibration system response, and passband. The T120 model of sensors are being evaluated to explore the potential for a future seismometer Type Approval process in the International Monitoring System (IMS) of the Comprehensive Nuclear-Test-Ban Treaty (CTBT).

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Evaluating 240 Pu Prompt Fission Neutron Spectra Including Chi-Nu Experimental Data

This report documents an evaluation of 240 Pu prompt fission neutron spectra (PFNS) including Chi-Nu experimental data. This work is a FY2025 Q4 NCSP (Nuclear Criticality Safety Program) milestone and named a “strategic priority”. This evaluation is new; it differs substantially from the most recent evaluation included in the ENDF/B library, which was for ENDF/B-VII.1 and then carried over unchanged to ENDF/B-VIII.1. The key difference between ENDF/B-VIII.1 and the new evaluation is that we have, for the first time, realistic experimental 240 Pu PFNS covering a broad incident and outgoing neutron energy range.

240Pu↗
DOE OSTI2020

Delivering Energy Efficiency and Grid Services for Commercial Buildings on an IoT-Platform: Field Evaluation Plan

In FY20, the Commercial Buildings Integration Program (CBI) within Building Technologies Office (BTO) has funded PNNL to conduct field evaluation of the AIRCx and intelligent load control (ILC) using an Internet-of-Things (IoT) platform, VOLTTRON. The primary goal of the project is to show that software solutions deployed and delivered through an IoT-platform can identify energy efficiency opportunities and manage peak load in commercial buildings. There are also two secondary goals: 1) show that the energy efficiency solutions will result in identification of significant savings (10% to 30%) opportunities as well as energy cost reductions (10% to 15%) by managing the peak load in commercial buildings, and 2) show that an IoT-based software solution is more cost-effective in meeting the Re-tuning mandates than traditional retro commissioning (RCx) and there is a pathway for broader adoption of this approach. This report details how the field evaluation will be conducted, including what enhancements will be made to the software technologies, how PNNL will recruit energy service providers, types of buildings where the technology will be evaluated, metric of success for the field evaluation, and how the metric of success will be measured.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2026

Model Evaluation Protocol for Fire Models Involving Fuels at Liquefied Natural Gas Facilities (Version 2)

This document provides a description of the model evaluation protocol (MEP) for pool fires, jet fires, and fireballs involving liquefied natural gas (LNG) and processing fuels at LNG facilities. The purpose of the MEP is to provide procedures regarding the assessment of a model’s suitability to predict heat flux from fires. Three components, namely, a scientific assessment, model verification, and model validation comprise the MEP. The evaluation of a model satisfying these three components is to be documented in the form of a model evaluation report (MER). Discussion of models for the prediction of fire, detailed information on each of the three MEP components, the MEP procedure regarding new versions of previously approved models, and the format of the model evaluation report (MER) are provided.

03 NATURAL GAS↗
DOE OSTI2025

CyberMESA: Evaluation Procedures and Metrics for Charging Infrastructure Cybersecurity

A report detailing the cybersecurity evaluation and assessment procedures for EV charging infrastructure. This report is authored by three national lab contributors. INL, PNNL, NRL. The grid integration of Electric Vehicle Charging Infrastructure (EVCI) is a large and complex system of systems (SoS) made up of components from many manufacturers and integrated by various companies responsible for their operation and maintenance. This complexity makes it challenging to implement security standards like IEC 62443 across the entire infrastructure. This document aims to aid in the vulnerability assessments of individual devices, such as Electric Vehicle Supply Equipment (EVSE), to support vendors in adopting and implementing security standards such as UL 2900, NIST SP 800-53 and Common Criteria (CC) (ISO/IEC 15408). This document serves as a guide to help evaluate the cybersecurity posture of EVCI assets. It aims to provide a consistent method for evaluating EVCI, enabling cybersecurity research teams to systematically test a wide range of electric vehicle (EV) assets. The target audiences include cybersecurity research teams, vendor development teams, automotive OEMs, and third-party evaluators.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Evaluating energy justice metrics in early-stage science and technology research using the JUST-R metrics framework

Embedding principles of energy justice throughout all aspects of clean energy technology research and development (R&D) can facilitate a more just energy transition; yet gaps remain in our understanding of how to best integrate energy justice from the earliest R&D stages. The Justice Underpinning Science and Technology Research (JUST-R) metrics framework has been developed to enable early-stage energy researchers to assess and address justice considerations associated with their research, but the impacts of the framework, and others like it, have yet to be evaluated. This study seeks to evaluate the JUST-R metrics framework in terms of its effectiveness and appeal to researchers engaged in early-stage technical R&D using qualitative analyses of documents and workshop transcripts. We find that the metrics framework helps researchers identify problems and potential solutions surrounding the energy justice implications of their work and spurs a change in perspective for researchers, but, simultaneously, there is no evidence of solution follow-through within the evaluation timeframe. Greater institutional support, specialization to research areas, knowledge of energy justice fundamentals, and earlier incorporation of energy justice considerations in research projects arise as factors needed to aid continued use of the framework and pursuit of identified solutions. This evaluation protocol and these findings can serve as a guide for improving other frameworks with similar goals of encouraging sociotechnical engagement in early-stage energy R&D.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2021

Total System Performance Ratio—A Systems Based Approach for Evaluating HVAC System Efficiency

The prescriptive path is the most widely used approach for commercial code compliance in the United States. Though easy to implement, prescriptive approaches do not typically discriminate between minimally compliant, high-performing and poorly performing HVAC system configurations. Hence, to meet aggressive energy and carbon reduction goals, it is clear that energy codes will need to transition from prescriptive to performance-based approaches, a transition that is riddled with several challenges. This paper discusses a new HVAC system-based performance approach (HVAC System Performance) which provides a simpler solution to HVAV system evaluation compared to whole building performance, while keeping tradeoffs limited to specific building systems. The Total System Performance Ratio (TSPR) is a metric for evaluation of overall system efficiency instead of individual component efficiency, a solution which could also eventually facilitate the transition to a 100% performance-based code structure. TSPR is a ratio that compares the annual heating and cooling load of a building to the annual energy consumed by the building’s HVAC system. A calculation software tool has been developed for determining a building’s TSPR. Already incorporated into the 2018 Washington State Energy Code, this approach is also being evaluated by ASHRAE Standard 90.l Project Committee and has the potential to provide a comprehensive performance-based approach for HVAC system evaluation and analysis.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2020

Leveraging Real-World Driving Data for Design and Impact Evaluation of Energy Efficient Control Strategies

Modeling and simulation are crucial in the development of advanced energy efficient control strategies. Utilizing real-world driving data as the underlying basis for control design and simulation lends veracity to projected real-world energy savings. Standardized drive cycles are limited in their utility for evaluating advanced driving strategies that utilize connectivity and on-vehicle sensing, primarily because they are typically intended for evaluating emissions and fuel economy under controlled conditions. Real-world driving data, because of its scale, is a useful representation of various road types, driving styles, and driving environments. The scale of real-world data also presents challenges in effectively using it in simulations. A fast and efficient simulation methodology is necessary to handle the large number of simulations performed for design analysis and impact evaluation of control strategies. In this study, two methods are presented of leveraging real-world data in both design optimization of energy efficient control strategies and in evaluating the real-world impact of those control strategies upon large-scale deployment. Through these methodologies, strategies with highest impact on energy savings were selected to be implemented as control algorithms. The developed algorithms were incorporated into a vehicle dynamics and powertrain control architecture implemented on a Cadillac CT6 demonstration vehicle. The control algorithms were then exercised on real-world driving scenarios to determine their impact on collective energy savings. The methodology utilizes the large-scale driving data sets maintained by the National Renewable Energy Laboratory to extract real-world driving scenarios and efficient simulation software tools. The insights obtained through this research help in guiding technology selection for energy efficient driving controls.

ARPA-E↗
DOE OSTI2022

Evaluation of High-Temperature Martensitic Steels for Heavy-Duty Diesel Piston Applications

Five different commercially available high-temperature martensitic steels were evaluated for use in a heavy-duty diesel engine piston application and compared to existing piston alloys 4140 and microalloyed steel 38MnSiVS5 (MAS). Finite element analyses (FEA) were performed to predict the temperature and stress distributions for severe engine operating conditions of interest, and thus aid in the selection of the candidate steels. Complementary material testing was conducted to evaluate the properties relevant to the material performance in a piston. The elevated temperature strength, strength evolution during thermal aging, and thermal property data were used as inputs into the FEA piston models. Additionally, the long-term oxidation performance was assessed relative to the predicted maximum operating temperature for each material using coupon samples in a controlled-atmosphere cyclic-oxidation test rig. A current commercial steel piston alloy, quenched and tempered martensitic steel 4140, was tested in a single-cylinder research engine for a baseline oxidation and mechanical performance assessment using an abbreviated (50h) durability test plan. The predicted suitability of a candidate piston material in an engine is primarily based on its elevated temperature strength, oxidation resistance, and the complex influence of thermal conductivity, the latter of which is substantially lower for the candidate materials considered in this research relative to the traditional alloys. Although the lower thermal conductivity causes the candidate alloys to operate in higher temperature ranges under identical engine operating conditions and piston geometries, increasing the likelihood of partially or completely negating their strength and oxidation resistance advantages relative to 4140 and MAS steels, this evaluation indicates that several of the candidate piston alloys are predicted to enable improved oxidation resistance under more severe engine operating conditions relative to the current piston materials. However, further evaluation is required to determine if the elevated temperature fatigue strength and durability of these alloys are suitable for more severe engine conditions.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Diesel Particulate Filter Durability Performance Comparison Using Metals Doped B20 vs. Conventional Diesel Part I: Accelerated Ash Loading and DPF Performance Evaluation

The project objective was to generate experimental data to evaluate the impact of metals doped B20 on DPF ash loading and performance compared to that of conventional petrodiesel. Accelerated ash loading was conducted on two DPFs - one exposed to regular diesel fuel and the other to B20 containing metal dopants equivalent to 4 ppm B100 total metals (currently total metals are limited to 10 ppm in ASTM D6751, the standard for B100). Periodic performance evaluations were conducted on the DPFs at 10 g/L ash loading intervals. After the evaluations at 30 g/L, the DPF was cleaned with a commercial DPF cleaning machine and another round of DPF evaluations were conducted. A comparison of the effect of ash loading with the two fuels and DPF cleaning is presented. The metals doped B20 fuel resulted in ash that was similar to that deposited when exposed to ULSD (lube oil ash) and exhibited similar ash cleaning removal efficiency. Metals doped B20 resulted in faster ash accumulation within the DPF, as expected, but did not appear to have a negative effect on DPF pressure drop or regeneration rates (up to 30 g/L of ash) or exhibit deleterious physical effects on the DPF substrate.

ADVANCED PROPULSION SYSTEMS,BIOMASS FUELS↗
DOE OSTI2024

Refinement of Pitting Factor Basis to Evaluate Minimum Nitrite Requirement in Dilute Waste Chemistries

Considering that chloride concentrations are an order of magnitude lower at SRS than the maximum chloride previously tested to evaluate pitting susceptibility of carbon steel, it has been proposed that the Pitting Factor methodology be refined to determine if a reduction in the minimum nitrite requirement is warranted in more dilute solutions and those with chloride concentrations more indicative of waste tank chemistries at SRS. Through the use of cyclic potentiodynamic polarization, the susceptibility of A537 carbon steel to pitting corrosion was evaluated. The Pitting Factor was shown to accurately predict pitting susceptibility throughout the chemistry envelope evaluated. In addition, it was shown that nitrite is not required for inhibition of pitting corrosion in tank conditions with chloride concentrations observed at SRS and up to 4 M nitrate. Based upon these findings, new control limits were proposed that removed the minimum nitrite requirement within the chemistry envelope evaluated up to 50 °C.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Evaluation of native Earth system model output with ESMValTool v2.6.0

Earth system models (ESMs) are state-of-the-art climate models that allow numerical simulations of the past, present-day, and future climate. To extend our understanding of the Earth system and improve climate change projections, the complexity of ESMs heavily increased over the last decades. As a consequence, the amount and volume of data provided by ESMs has increased considerably. Innovative tools for a comprehensive model evaluation and analysis are required to assess the performance of these increasingly complex ESMs against observations or reanalyses. One of these tools is the Earth System Model Evaluation Tool (ESMValTool), a community diagnostic and performance metrics tool for the evaluation of ESMs. Input data for ESMValTool needs to be formatted according to the CMOR (Climate Model Output Rewriter) standard, a process that is usually referred to as “CMORization”. While this is a quasi-standard for large model intercomparison projects like the Coupled Model Intercomparison Project (CMIP), this complicates the application of ESMValTool to non-CMOR-compliant climate model output. In this paper, we describe an extension of ESMValTool introduced in v2.6.0 that allows seamless reading and processing of “native” climate model output, i.e., operational output produced by running the climate model through the standard workflow of the corresponding modeling institute. This is achieved by an extension of ESMValTool's preprocessing pipeline that performs a CMOR-like reformatting of the native model output during runtime. Thus, the rich collection of diagnostics provided by ESMValTool is now fully available for these models. For models that use unstructured grids, a further preprocessing step required to apply many common diagnostics is regridding to a regular latitude–longitude grid. Extensions to ESMValTool's regridding functions described here allow for more flexible interpolation schemes that can be used on unstructured grids. Currently, ESMValTool supports nearest-neighbor, bilinear, and first-order conservative regridding from unstructured grids to regular grids. Example applications of this new native model support are the evaluation of new model setups against predecessor versions, assessing of the performance of different simulations against observations, CMORization of native model data for contributions to model intercomparison projects, and monitoring of running climate model simulations. For the latter, new general-purpose diagnostics have been added to ESMValTool that are able to plot a wide range of variable types. Currently, five climate models are supported: CESM2 (experimental; at the moment, only surface variables are available), EC-Earth3, EMAC, ICON, and IPSL-CM6. As the framework for the CMOR-like reformatting of native model output described here is implemented in a general way, support for other climate models can be easily added.

58 GEOSCIENCES↗
NASA NTRS1972

Flight program language requirements. Volume 2: Requirements and evaluations

The efforts and results are summarized for a study to establish requirements for a flight programming language for future onboard computer applications. Several different languages were available as potential candidates for future NASA flight programming efforts. The study centered around an evaluation of the four most pertinent existing aerospace languages. Evaluation criteria were established, and selected kernels from the current Saturn 5 and Skylab flight programs were used as benchmark problems for sample coding. An independent review of the language specifications incorporated anticipated future programming requirements into the evaluation. A set of detailed language requirements was synthesized from these activities. The details of program language requirements and of the language evaluations are described.

Source record↗
NASA NTRS1972

Evaluation of thermal network correction program using test temperature data

An evaluation process to determine the accuracy of a computer program for thermal network correction is discussed. The evaluation is required since factors such as inaccuracies of temperatures, insufficient number of temperature points over a specified time period, lack of one-to-one correlation between temperature sensor and nodal locations, and incomplete temperature measurements are not present in the computer-generated information. The mathematical models used in the evaluation are those that describe a physical system composed of both a conventional and a heat pipe platform. A description of the models used, the results of the evaluation of the thermal network correction, and input instructions for the thermal network correction program are presented.

Ishimoto, T.↗
NASA NTRS1972

Evaluation of spacecraft boom deployment dynamics by combined analysis and testing.

Discussion of the deployment of multiple hinged booms from the IMP-I satellite, which is a good example of the use of the combined analysis and testing approach for preflight system reliability evaluation. The procedures used for test and evaluation of the booms are described, and problems encountered and results achieved are considered. Analytical methods, using a digital computer program, and functional test operation with the best possible environmental simulation, were both applied to the problem and comparisons between analytical and test results were made to evaluate their validity and to reveal the effects of errors and imperfections. There is a synergistic advantage in the combined approach in that mutual comparison gives better evaluation of both analysis and test results than independent study of either. An appendix presents some results of a later and as yet incomplete test program involving the IMP-H satellite.

Lang, W. E.↗