Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluation protocols”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Model Evaluation Protocol for Fire Models Involving Fuels at Liquefied Natural Gas Facilities.

This document provides a description of the model evaluation protocol (MEP) for pool fires, jet fires, and fireballs involving liquefied natural gas (LNG), refrigerant fluids, and byproducts at LNG facilities. The purpose of the MEP is to provide procedures regarding the assessment of a model's suitability to predict heat flux from fires. Three components, namely, a scientific assessment, model verification, and model validation comprise the MEP. The evaluation of a model satisfying these three components is to be documented in the form of a model evaluation report (MER). Discussion of models for the prediction of fire, detailed information on each of the three MEP components, the MEP procedure regarding new versions of previously approved models, and the format of the model evaluation report (MER) are provided.

03 NATURAL GAS↗
DOE OSTI2026

Model Evaluation Protocol for Fire Models Involving Fuels at Liquefied Natural Gas Facilities (Version 2)

This document provides a description of the model evaluation protocol (MEP) for pool fires, jet fires, and fireballs involving liquefied natural gas (LNG) and processing fuels at LNG facilities. The purpose of the MEP is to provide procedures regarding the assessment of a model’s suitability to predict heat flux from fires. Three components, namely, a scientific assessment, model verification, and model validation comprise the MEP. The evaluation of a model satisfying these three components is to be documented in the form of a model evaluation report (MER). Discussion of models for the prediction of fire, detailed information on each of the three MEP components, the MEP procedure regarding new versions of previously approved models, and the format of the model evaluation report (MER) are provided.

03 NATURAL GAS↗
DOE OSTI2020

Chapter 17: Residential Behavior Evaluation Protocol. The Uniform Methods Project: Methods for Determining Energy Efficiency Savings for Specific Measures, September 2011 - August 2020

This document has been updated in August 2020. This document was developed for the U.S. Department of Energy Uniform Methods Project (UMP). The UMP provides model protocols for determining energy and demand savings that result from specific energy-efficiency measures implemented through state and utility programs. In most cases, the measure protocols are based on a particular option identified by the International Performance Verification and Measurement Protocol; however, this work provides a more detailed approach to implementing that option. Each chapter is written by technical experts in collaboration with their peers, reviewed by industry experts, and subject to public review and comment. The protocols are updated on an as-needed basis. The UMP protocols can be used by utilities, program administrators, public utility commissions,evaluators, and other stakeholders for both program planning and evaluation. To learn more about the UMP, visit the website, https://energy.gov/eere/about-us/ump-home, or download the UMP introduction document at http://www.nrel.gov/docs/fy17osti/68557.pdf.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
NASA NTRS2005

SCPS-TP, TCP, and Rate-Based Protocol Evaluation

Tests were performed at Glenn Research Center to compare the performance of the Space Communications Protocol Standard Transport Protocol (SCPS TP, otherwise known as "TCP Tranquility") relative to other variants of TCP and to determine the implementation maturity level of these protocols, particularly for higher speeds. The testing was performed over reasonably high data rates of up to 100 Mbps with delays that are characteristic of near-planetary environments. The tests were run for a fixed packet size, but for variously errored environments. This report documents the testing performed to date.

Tran, Diepchi T.↗
DOE OSTI2023

The Uniform Methods Project: Smart Thermostat Evaluation Protocol

A smart thermostat is an internet-connected device that controls home heating, ventilation, and air-conditioning (HVAC) equipment and can automatically adjust temperature set points to optimize performance and achieve energy savings. Smart thermostat features often include two way communication, occupancy detection (such as geofencing and occupancy sensors), schedule learning, and seasonal optimization algorithms. Smart thermostats can control most conventional HVAC systems, including central air conditioners, heat pumps, and forced air furnaces. Several types of residential utility programs offer smart thermostats as replacements measures. Working with smart thermostat vendors, utilities can offer separate optimization programs to produce energy savings beyond those achieved by installing a smart thermostat. From an evaluation perspective, smart thermostat programs have several noteworthy features. First, the energy savings from a smart thermostat may change over the life of the device. As a smart thermostat is connected to the internet, original equipment manufacturers can update the thermostat software to improve the thermostat's energy efficiency. Likewise, users can adjust the thermostat settings and schedules over time in response to changes in weather, thermal comfort, energy prices, or preferences for energy efficiency. Additionally, many thermostat manufacturers offer seasonal optimization programs that recommend changes or make minor, automated adjustments to the thermostat settings to improve energy efficiency. These opt-in programs are now standard offerings for many smart thermostat manufacturers and provided at no additional cost to users. The potential for software updates and continuous optimization and the evolving nature of user interactions mean future energy savings may differ from first-year savings and the energy savings of smart thermostats may need to be evaluated more than once. Second, smart thermostats often have small unit energy savings relative to a home's total energy consumption, especially in comparison to whole- home retrofit programs. This can make it difficult to detect the smart thermostat savings in billing or advanced metering infrastructure (AMI) meter consumption data. For example, as cooling loads in many regions average about 20% of annual electricity consumption, smart thermostat savings of 10% of cooling energy use would equate to a 2% reduction in home electricity consumption. Evaluators should use regression analysis of whole-home billing consumption or advanced metering infrastructure (AMI) meter consumption data to evaluate smart thermostat savings because, as explained at greater length below , these data are usually available to evaluators and regression can control for the impacts of weather and other potentially confounding factors on a home's energy consumption. Finally, as with other energy efficiency programs, participation in smart thermostat programs is self-selective. As discussed at greater length below , smart thermostat participants tend to be, among other things, younger, higher-income, and more likely to adopt electric vehicles (EVs) and internet connected devices than nonparticipants. These differences are often unobservable to the evaluator and correlated with a home's energy consumption, creating the potential for bias in estimating savings. Due to the small unit savings of thermostats, errors and biases from self-selection that may not be very consequential when evaluating a whole- home retrofits (e.g., ±2% of home electricity consumption) can have a major impact when evaluating the savings and cost-effectiveness of smart thermostat programs. A percentage point change in the estimated savings could affect the cost-effectiveness of a program. This means it is important for evaluators to assess and to minimize the potential for error from selection bias in estimating smart thermostat program savings. The Uniform Methods Project provides model protocols for determining energy savings and demand reductions that result from specific energy efficiency measures implemented through state and utility programs. In most cases, the measure protocols are based on a particular option identified by the International Performance Verification and Measurement Protocol ; however, this work provides a more detailed approach to implementing that option. Each chapter is written by technical experts in collaboration with their peers, reviewed by industry experts, and subject to public review and comment. The UMP protocols can be used by utilities, program administrators, public utility commissions, evaluators, and other stakeholders for both program planning and evaluation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Chapter 22: Compressed Air Evaluation Protocol. The Uniform Methods Project: Methods for Determining Energy Efficiency Savings for Specific Measures (September 2011 - August 2020)

Compressed-air systems are used widely throughout industry for many operations, including pneumatic tools, packaging and automation equipment, conveyors, and other industrial process operations. Compressed-air systems are defined as a group of subsystems composed of air compressors, air treatment equipment, controls, piping, pneumatic tools, pneumatically powered machinery, and process applications using compressed air. A compressed-air system has three primary functional subsystems: supply, distribution, and demand. Air compressors are the primary energy consumers in a compressed-air system and are the primary focus of this protocol. The two compressed-air energy efficiency measures specifically addressed in this protocol are: high-efficiency/variable speed drive (VSD) compressor replacing modulating, load/unload, or constant-speed compressor; compressed-air leak survey and repairs. This protocol provides direction on how to reliably verify savings from these two measures using a consistent approach for each.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Evaluation protocol for revealing magnonic contrast in TR-STXM measurements

We present a statistically motivated method to extract magnonic contrast from time-resolved scanning transmission x-ray microscopy (TR-STXM) measurements. TR-STXM is an element-specific method for resolving spin-dynamics in space and time. It offers nanometer spatial resolution and picosecond temporal resolution. The presented method makes it possible to obtain phase and amplitude profiles of spin-waves from STXM measurements. Furthermore, it allows for a rigorous transformation to reciprocal magnon k⃗-space, revealing k⃗-dependent magnon properties such as the magnon dispersion in three dimensions and for all directions of the magnetic anisotropy. We demonstrate our method using X-band ferromagnetic resonance on a micrometer-sized permalloy assembly.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2025

Fire and Thermal Experiments in Support of the Model Evaluation Protocol for LNG Facility Fires

The motivation for the experiments reported here pertains to the siting of Liquefied Natural Gas (LNG) facilities which requires assessing the potential adverse radiant thermal impacts of accidental fires on the public. The objective is to obtain data on jet fires, pool fires, fireballs, and concrete walls that could serve as thermal barriers for model validation. The fuels tested include ethane, ethylene, propane, and isopentane.

42 ENGINEERING↗
DOE OSTI2024

​​Integrity Enhancing Protocols (IEP) Evaluation Framework​

​Protocols play an essential role in Advance Reactor systems. A diverse set of protocols are available to these reactors. Advanced Reactors benefit from technologies that can minimize their resource utilization and costs. Evaluation frameworks are often used when assessing protocols and processes related to cryptographic security systems. The following report discusses the various characteristics associated with these protocol evaluation frameworks, and derives a novel evaluative framework.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
NASA NTRS1994

Extra-Vehicular Activity (EVA) glove evaluation test protocol

One of the most critical components of a space suit is the gloves, yet gloves have traditionally presented significant design challenges. With continued efforts at glove development, a method for evaluating glove performance is needed. This paper presents a pressure-glove evaluation protocol. A description of this evaluation protocol, and its development is provided. The protocol allows comparison of one glove design to another, or any one design to bare-handed performance. Gloves for higher pressure suits may be evaluated at current and future design pressures to drive out differences in performance due to pressure effects. Using this protocol, gloves may be evaluated during design to drive out design problems and determine areas for improvement, or fully mature designs may be evaluated with respect to mission requirements. Several different test configurations are presented to handle these cases. This protocol was run on a prototype glove. The prototype was evaluated at two operating pressures and in the unpressurized state, with results compared to bare-handed performance. Results and analysis from this test series are provided, as is a description of the configuration used for this test.

Hinman-Sweeney, E. M.↗
DOE OSTI2022

Standardized protocols for evaluating platinum group metal-free oxygen reduction reaction electrocatalysts in polymer electrolyte fuel cells

Platinum group metal (PGM)-free electrocatalysts for the oxygen reduction reaction at the polymer electrolyte fuel cell cathode have shown substantial improvements in activity—especially those derived from transition metals, nitrogen and carbon. However, their stability and durability remain insufficient. A key to enabling future improvements and performance comparisons lies in the development of test protocols that are relevant to the operating conditions of the fuel cell cathode, can be completed within a reasonable time and are ubiquitously adopted. Here we propose and validate such protocols, designed with special attention to typical catalyst degradation mechanisms of PGM-free catalysts. The results of the cross-laboratory validation study using two different catalysts attest to the strength and feasibility of the proposed approach. We hope that the information provided here can serve as a broad and effective platform for assessing the performance and durability of PGM-free catalysts for polymer electrolyte fuel cells.

25 ENERGY STORAGE↗
NASA NTRS2012

An Evaluation of Protocol Enhancing Proxies and File Transport Protocols for Satellite Communication

NASA is utilizing Global Hawk aircraft in high-altitude, long-duration Earth science missions. Communications with the onboard research equipment and sensors (the science payload) is via Ku-Band radio utilizing satellites in geostationary orbits. All payload communications use standard Internet Protocols and routing, and much of the data to be transferred is comprised of very large files. The science community is interested in fully utilizing these communication links to retrieve data as quickly and reliably as possible. A test bed was developed at NASA Ames to evaluate modern transport protocols as well as Protocol Enhancing Proxies (PEPs) to determine what tools best fit the needs of the science community. This paper describes the test bed used, the protocols, the PEPs that were evaluated, the particular tests performed and the results and conclusions.

Finch, Patrick Eugene↗
DOE OSTI2021

The soil health assessment protocol and evaluation applied to soil organic carbon

The concept of soil health has evolved over the past several decades, recognizing that dynamic soil property response to management and land use is highly dependent on site-specific factors that must be considered when interpreting soil health measurements. Initially, the Soil Management Assessment Framework (SMAF) and Comprehensive Assessment of Soil Health (CASH) were developed and used globally for scoring soil health indicators. However, both SMAF and CASH frameworks were developed using a relatively small dataset and their interpretation curves were not validated at the nationwide scale. Expanding upon these concepts, we propose the Soil Health Assessment Protocol and Evaluation (SHAPE) tool. The SHAPE was developed using 14,680 soil organic C (SOC) observations from across the United States, and accounts for edaphic and climate factors at the continental scale. Data were compiled from the literature, the Cornell Soil Health Laboratory, and the Kellogg Soil Survey Laboratory. In this approach, scoring curves are Bayesian model-based estimates of the conditional cumulative distribution function (CDF) for defined soil peer groups reflecting five soil texture and five soil suborder classes adjusted for mean annual temperature and precipitation. Specifically, SHAPE produces scores between 0 and 1 (0–100%) for measured SOC values that reflect the quantile or position within the conditional CDF along with measures of uncertainty. Herein, we focus on development of the SHAPE scoring curve for SOC with our case studies. SHAPE is a flexible, quantitative tool that provides a regionally relevant interpretation of this key soil health indicator.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2012

An Evaluation of Protocols for UAV Science Applications

This paper identifies data transport needs for current and future science payloads deployed on the NASA Global Hawk Unmanned Aeronautical Vehicle (UAV). The NASA Global Hawk communication system and operational constrains are presented. The Genesis and Rapid Intensification Processes (GRIP) mission is used to provide the baseline communication requirements as a variety of payloads were utilized in this mission. User needs and desires are addressed. Protocols are matched to the payload needs and an evaluation of various techniques and tradeoffs are presented. Such techniques include utilization rate-base selective negative acknowledgement protocols and possible use of protocol enhancing proxies. Tradeoffs of communication architectures that address ease-of-use and security considerations are also presented.

Ivancic, William D.↗
DOE OSTI2022

Computational Protocol to Evaluate Electron–Phonon Interactions Within Density Matrix Perturbation Theory

We present a computational protocol, based on density matrix perturbation theory, to obtain non-adiabatic, frequency-dependent electron–phonon self-energies for molecules and solids. Our approach enables the evaluation of electron–phonon interaction using hybrid functionals, for spin-polarized systems, and the computational overhead to include dynamical and non-adiabatic terms in the evaluation of electron–phonon self-energies is negligible. We discuss results for molecules, as well as pristine and defective solids.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Implementation and Evaluation of Emission‐Driven Land‐Atmosphere Coupled Simulation in E3SMv2.1

Emissions-driven (prognostic CO 2 ) simulations are essential for representing two-way carbon-climate feedback in Earth System Models. We present an emissions-driven land–atmosphere coupled biogeochemistry (BGC) configuration (BGCLNDATM_progCO2) in version 2.1 of the Energy Exascale Earth System Model (E3SMv2.1). This is the first E3SM configuration that performs land-atmosphere emission-hindcasts. Here, we document its implementation, evaluate the model's performance against observations and other models, and propose a structured evaluation protocol for such emissions-driven simulations. We conducted transient historical simulations (1850–2014) with BGCLNDATM_progCO2 and compare them to reference simulations—a land-atmosphere coupled simulation without BGC and a standalone land simulation with BGC, both using prescribed CO 2 concentrations—and to observations. BGCLNDATM_progCO2 overestimates atmospheric CO 2 concentrations by 11–23 ppm yet stays within the 40-ppm spread CMIP6 emission-driven models and retains physical climate properties comparable to the reference runs. The CO 2 biases are partly attributed to underrepresented oceanic CO 2 uptake and inadequate representations of some terrestrial processes. In general, introducing prognostic CO 2 did not change physical climate metrics at the global scale but had larger regional effects, particularly over land where spatially heterogeneous CO 2 and prognostic leaf area index influenced surface energy balance. Finally, we propose a general evaluation protocol including spin-up assessment, atmospheric CO 2 benchmarking, physical climate evaluation, and land biogeochemical analysis to support scientific rigor and facilitate inter-model comparisons. The new configuration lays the groundwork for future enhancements, including improved terrestrial biogeochemical processes, integrated marine biogeochemistry, and additional human–Earth system interactions. These developments advance E3SM toward fully coupled emissions-driven simulations, enabling more accurate carbon–climate feedback projections and informing mitigation policy by providing physically consistent carbon-budget metrics for mitigation scenarios.

54 ENVIRONMENTAL SCIENCES↗