SEARCH · Engineering Papers

Results for “evaluation protocols”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

All sources NASA NTRS DOE OSTI

DOE OSTI2024

A protocol and analysis of year-long simulations of global storm-resolving models and beyond

We propose a protocol to evaluate and analyze year-long simulations of global storm-resolving models (GSRMs). The proposed protocol complements an earlier 40-day simulation protocol under the DYAMOND (DYnamics of the Atmospheric general circulation Modeled On Non-hydrostatic Domains) project to allow the analysis of the seasonal cycle and associated climatic relevant phenomena. This intercomparison aims to reveal how GSRMs, which can simulate mesoscale convective systems (MCSs) in the global domain, reproduce atmospheric large-scale structures related to convection beyond month-long simulations. The intercomparison for one-year simulations is conducted by either atmosphere-only models or atmosphere–ocean coupled models with atmospheric horizontal mesh sizes less than 5 km. We recommend the continuous four seasons from March 2020 to February 2021 as a target period for the intercomparison but with options for many groups to join more flexibly. The output variables are collected at 0.25° resolution, and archives of a small set of native grid variables are encouraged to analyze tropical cyclones and MCSs. Through the proposed global storm-resolving simulation, we will evaluate the climatological distributions of the atmospheric large-scale circulations, such as the Intertropical Convergence Zone (ITCZ), monsoon, midlatitude jets, their time evolution, and the upscale impacts on them. We present sample analyses from a one-year simulation using the 3.5 km mesh Nonhydrostatic Icosahedral Atmospheric Model (NICAM), revealing the realistic zonal contrast of tropical precipitation, no double ITCZ structure, the reasonable midlatitude jet position and intensity but a weak bias of storm track activities, and a warm bias over the Eurasia during boreal winter. We also clarify the cross-scale interaction, such as the effects of cold pools on mean precipitation over the Maritime Continent through the precipitation diurnal cycle and the effects of resolved gravity waves on midlatitude mean flows. The proposed one-year simulation protocol is referred to as the “Sendai Protocol.” This protocol is not unique or definite for evaluating GSRMs; we prospect a hierarchical set of experiments from short-term to multi-year simulations as GSRM intercomparisons.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Evaluating kratom alkaloids using PHASE

Kratom is a botanical substance that is marketed and promoted in the US for pharmaceutical opioid indications despite having no US Food and Drug Administration approved uses. Kratom contains over forty alkaloids including two partial agonists at the mu opioid receptor, mitragynine and 7-hydroxymitragynine, that have been subjected to the FDA’s scientific and medical evaluation. However, pharmacological and toxicological data for the remaining alkaloids are limited. Therefore, we applied the Public Health Assessment via Structural Evaluation (PHASE) protocol to generate in silico binding profiles for 25 kratom alkaloids to facilitate the risk evaluation of kratom. PHASE demonstrates that kratom alkaloids share structural features with controlled opioids, indicates that several alkaloids bind to the opioid, adrenergic, and serotonin receptors, and suggests that mitragynine and 7-hydroxymitragynine are the strongest binders at the mu opioid receptor. Subsequently, the in silico binding profiles of a subset of the alkaloids were experimentally verified at the opioid, adrenergic, and serotonin receptors using radioligand binding assays. The verified binding profiles demonstrate the ability of PHASE to identify potential safety signals and provide a tool for prioritizing experimental evaluation of high-risk compounds.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2020

Remote Hardware-in-the-Loop Approach for Microgrid Controller Evaluation

Utilities have been installing microgrids because of the increased resilience and reliability advantages they may provide to the distribution system. A microgrid controller is a critical component in microgrids. It is of great benefit to derisk the installation of microgrid controllers before field deployment. Hardware-in-the-loop (HIL) testing is used by controller developers and utilities to evaluate the controllers under stressful conditions. In this work, a microgrid control function developed by the Synchrophasor Grid Monitoring and Automation (SyGMA) laboratory at the University of California, San Diego is tested in a remote HIL (RHIL) setup. The digital real-time simulation of the detailed microgrid system was operated at the National Renewable Energy Laboratory's Energy Systems Integration Facility. Under such RHIL setup, successful controller operation is contingent on understanding and characterizing the communications channel and in particular network latencies. The novelty of this paper is the proposed use of a RHIL setup that leverages existing power system communications protocols to evaluate the controller in conjunction with the simulation capabilities of a remote facility. The work presented here will provide the complete setup of the HIL evaluation platform, the details of the communications protocols used by the setup for data transfer between the two organizations, test cases developed to evaluate the controller, and the results from the experiments.

controller hardware-in-the-loop↗

DOE OSTI2020

Remote Hardware-in-the-Loop Approach for Microgrid Controller Evaluation

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2020

Transmission of Images With Ultrasonic Elastic Shear Waves on a Metallic Pipe Using Amplitude Shift Keying Protocol

Transmission of information using ultrasonic elastic waves on existing metallic pipes provides an alternative communication option across physical barriers in a highly partitioned industrial complex, such as a nuclear facility. This work investigates the feasibility of the transmission of digital images over metallic pipes. Ultrasonic communication systems for transmission of images on a nuclear-grade stainless steel pipe were assembled for bench-scale demonstration. Information carriers in this system are refracted shear waves transmitted and received with piezoelectric transducers (PZTs) operating at 2-MHz nominal frequency. The refraction and propagation of ultrasonic shear waves were modeled with COMSOL software. An amplitude shift keying (ASK) communication protocol for image transmission was developed and implemented in the GNURadio software-defined radio (SDR) environment. Digital information was converted to analog ultrasonic signals using Red Pitaya electronic boards. The performance of the ASK protocol is evaluated at the output of every block in the GNURadio program by monitoring the transmission of select characters. Using the ASK communication protocol, the transmission of the 32-KB image was demonstrated at 2-Kbps bitrate across 6-ft-long stainless steel pipe. Finally, preliminary evaluation of ultrasonic communication on the piping of a nuclear facility, such as signal transmission on bent pipes, was performed with COMSOL computer simulations.

42 ENGINEERING↗

DOE OSTI2026

PRIME: An evaluation framework for protein representation inference and generalization in viral mutation space

Background Protein language models (PLMs) have revolutionized protein fitness prediction, yet their application to rapidly evolving viral pathogens is often confounded by extreme sequence homology. This homology leads to “data leakage” in standard random validation splits, yielding inflated performance metrics that fail to translate into real-world biosurveillance utility. Results We present Protein Representation Inference for Mutation Evaluation (PRIME), a framework that integrates domain-specific fine-tuning with a rigorous position-stratified validation protocol to evaluate viral threats. Using a dataset of 347,432 SARS-CoV-2 receptor binding domain (RBD) sequences, we demonstrate that while random training data split yields deceptive R 2 values (> 0.90), they fail to generalize to novel mutational sites. By benchmarking models up to 650 M parameters, we show that domain-specific fine-tuning of the ESM-C 600 M model with correctly stratified data provides an initial demonstration of predictive signal for binding affinity and expression at unseen mutational sites of binding affinity and expression on unseen sites (R 2 ~0.23), a significant advancement over base foundation models which exhibit no predictive power (R 2 <0). PRIME’s embedding-based clustering identified 3.03% of bat coronavirus sequences as candidates for further experimental prioritization based on their functional similarity to human-infective strains in embedding space, offering a perspective complementary to traditional phylogenetic methods. Conclusion PRIME establishes a new benchmark for the application of PLMs in pathogen surveillance. Our findings demonstrate that state-of-the-art models and fine-tuning, when paired with stratified validation, provide biologically meaningful insights into pathogen evolution and zoonotic risk.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2020

A systematic strategy for estimating hERG block potency and its implications in a new cardiac safety paradigm

Introduction: hERG block potency is widely used to calculate a drug's safety margin against its torsadogenic potential. Previous studies are confounded by use of different patch clamp electrophysiology protocols and a lack of statistical quantification of experimental variability. Since the new cardiac safety paradigm being discussed by the International Council for Harmonisation promotes a tighter integration of nonclinical and clinical data for torsadogenic risk assessment, a more systematic approach to estimate the hERG block potency and safety margin is needed. Methods: A cross-industry study was performed to collect hERG data on 28 drugs with known torsadogenic risk using a standardized experimental protocol. A Bayesian hierarchical modeling (BHM) approach was used to assess the hERG block potency of these drugs by quantifying both the inter-site and intra-site variability. A modeling and simulation study was also done to evaluate protocol-dependent changes in hERG potency estimates. Results: A systematic approach to estimate hERG block potency is established. The impact of choosing a safety margin threshold on torsadogenic risk evaluation is explored based on the posterior distributions of hERG potency estimated by this method. The modeling and simulation results suggest any potency estimate is specific to the protocol used. Discussion: This methodology can estimate hERG block potency specific to a given voltage protocol. The relationship between safety margin thresholds and torsadogenic risk predictivity suggests the threshold should be tailored to each specific context of use, and safety margin evaluation may need to be integrated with other information to form a more comprehensive risk assessment.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2023

Developing rapid electrochemical relithiation protocols for scalable relithiation of lithium-ion battery cathode materials

The recent and ongoing boom in electric vehicle sales has caused the circularity of the supply chain for electric vehicle battery materials to come under a great deal of scrutiny. Innovative recycling processes, or direct recycling, that offer the possibility of reducing the cost of recycling are one possible solution to regaining resources from end-of-life (EoL) electric vehicle batteries. Electrochemically shuttling lithium back into the cathode, or electrochemical relithiation, is a possible technique for restoring lithium content to NMC materials (EoL) in a direct recycling process. This study provides essential understanding towards developing an electrochemical relithiation protocol that will restore lithium loss in intercalation cathode materials that reach EoL by loss of lithium inventory (LLI) as opposed to other degradation mechanisms like loss of active material (LAM), cation mixing or phase transition. Electrochemically aged NMC cathode materials have been prepared and characterized to establish the extent of EoL material structural degradation and lithium loss. A model-informed experimental process is used to identify the optimal electrochemical relithiation protocol to minimize the time taken to relithiate EoL materials and maximize the amount of lithium restored. Protocols were evaluated based on their ability to enable rapid lithium intercalation, maintain structural uniformity in the EoL material and fully restore lithium content. An optimal protocol was identified at elevated temperatures utilizing a novel scanning voltage step.

25 ENERGY STORAGE↗

DOE OSTI2025

Harnessing land-atmosphere interactions to enhance subseasonal-to-seasonal predictability

2025 Advancing Understanding of Land-Atmosphere Interactions and Processes on S2S Predictability Workshop What: 227 registered workshop participants gathered in person (43%) and online (57%) to discuss state-of-the-art scientific understanding and modeling of land-atmosphere interactions and related processes in the context of subseasonal-to-seasonal (S2S) predictability. Topics covered sources of S2S predictability, land model initialization methods, model diagnosis and evaluation metrics, AI/ML analysis and applications, and coordination of future community multi-model S2S forecast focused experiments. To advance the science, this community workshop, organized by NSF NCAR, NOAA, NASA, and DOE, aimed to 1) identify process- and application-oriented metrics for assessing S2S prediction skill and 2) develop experimental protocols for coordinated experiments to isolate, quantify, and understand the role of land-atmosphere interactions in S2S predictability. When: June 16-18, 2025 Where: Boulder, CO, USA, and online.

Land-Atmosphere Interaction↗

DOE OSTI2023

Evaluating the Water Cycle Over CONUS at the Watershed Scale for the Energy Exascale Earth System Model Version 1 (E3SMv1) Across Resolutions

Abstract The water cycle is an important component of the earth system and it plays a key role in many facets of society, including energy production, agriculture, and human health and safety. In this study, the Energy Exascale Earth System Model version 1 (E3SMv1) is run with low‐resolution (roughly 110 km) and high‐resolution (roughly 25 km) configurations—as established by the High Resolution Model Intercomparison Project protocol—to evaluate the atmospheric and terrestrial water budgets over the conterminous United States (CONUS) at the large watershed scale. The warm season water cycle slows down in the HR experiment relative to the LR, with decreasing fluxes of precipitation, evapotranspiration, atmospheric moisture convergence, and runoff. The reductions in these terms exacerbate biases for some watersheds, while reducing them in others. For example, precipitation biases are exacerbated at HR over the Eastern and Central CONUS watersheds, while precipitation biases are reduced at HR over the Western CONUS watersheds. The most pronounced changes with resolution to the water cycle come from reductions in precipitation and evapotranspiration. The reduction in evapotranspiration reduces the biases across nearly all of the CONUS. Additional exploratory metrics show improvements to water cycle extremes (both in precipitation and streamflow), fractional contributions of different storm types to total precipitation, and mountain snowpack.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Evaluation of Cathode Materials with Lithium-Metal Anodes: Baseline Performance and Protocol Standardization of Coin Cells

The collaborative evaluation of electrode materials across multiple research entities requires standardized electrochemical testing protocols to produce reliable, one-to-one comparisons between different systems of interest. Similar to the work done by Long et al. on protocol standardization for coin-cell testing with graphite anodes [J. Electrochem. Soc., 163, A2999, (2016)], here we introduce two standardized testing protocols designed to quickly evaluate important electrochemical properties of cathode materials using lithium-metal anodes. The two protocols measure kinetic and thermodynamic capacity losses, rate- and voltage-dependent cycling capacities, instabilities at high voltage and high cycling rate, and overpotentials at various states of charge. We then apply these protocols to four commercially available cathode materials to establish benchmark performance metrics that can be used to screen and evaluate new cathode materials.

25 ENERGY STORAGE↗

DOE OSTI2022

Current limitations of solid-state NMR in carbohydrate and cell wall research

High-resolution investigation of cell wall materials has emerged as an important application of biomolecular solid-state NMR (ssNMR). Multidimensional correlation experiments have become a standard method for obtaining sufficient spectral resolution to determine the polymorphic structure of carbohydrates and address biochemical questions regarding the supramolecular organization of cell walls. Here, using plant cellulose and matrix polysaccharides as examples, we will review how the multifaceted complexity of polysaccharide structure is impeding the resonance assignment process and assess the available biochemical and spectroscopic approaches that could circumvent this barrier. We will emphasize the ineffectiveness of the current methods in reconciling the ever-growing dataset and deriving structural information. We will evaluate the protocols for achieving efficient and homogeneous hyperpolarization across the cell wall material using magic-angle spinning dynamic nuclear polarization (MAS-DNP). Critical questions regarding the line-broadening effects of cell wall molecules at cryogenic temperature and by paramagnetic biradicals will be considered. Finally, the MAS-DNP method will be placed into a broader context with other structural characterization techniques, such as cryo-electron microscopy, to advance ssNMR research in carbohydrate and cell wall biomaterials.

09 BIOMASS FUELS↗

DOE OSTI2021

Cookstove Emissions and Performance Evaluation Using a New ISO Protocol and Comparison of Results with Previous Test Protocols

Not provided.

Engineering↗

DOE OSTI2024

Increasing the Measured Effective Quantum Volume with Zero Noise Extrapolation

Quantum volume is a full-stack benchmark for near-term quantum computers. It quantifies the largest size of a square circuit which can be executed on the target device with reasonable fidelity. Error mitigation is a set of techniques intended to remove the effects of noise present in the computation of noisy quantum computers when computing an expectation value of interest. Effective quantum volume is a proposed metric that applies error mitigation to the quantum volume protocol to evaluate the effectiveness not only of the target device but also of the error mitigation algorithm. Digital zero-noise extrapolation is an error mitigation technique that estimates the noiseless expectation value using circuit folding to amplify errors by known scale factors and then extrapolating computed expectation values to the zero-noise limit. Here we demonstrate that zero-noise extrapolation, with global and local unitary folding with fractional scale factors, in conjunction with dynamical decoupling, can increase the effective quantum volume over the vendor-measured quantum volume. Specifically, we measure the effective quantum volume of four IBM Quantum superconducting processor units, obtaining values that are larger than the vendor-measured quantum volume on each device. This is the first such increase reported.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2022

Investigating the Particle Growth in Bimodal Pt/C Catalysts by In-Situ Small-Angle X-ray Scattering: Challenges in the Evaluation of Stress Test Protocol-Dependent Degradation Mechanisms

The influence of different combinations of accelerated stress test (AST) protocols simulating load-cycle and start/stop conditions of a proton exchange membrane fuel cell (PEMFC) vehicle is investigated on a bimodal Pt/C catalyst. The bimodal Pt/C catalyst, prepared by mixing two commercial catalysts, serves as a model system and consists of two distinguishable size populations. The change in mean particle size was investigated by in situ small-angle X-ray scattering (SAXS). The comparison to the reference catalysts, i.e., the two single-size population catalysts, uncovers the presence of electrochemical Ostwald ripening as a degradation mechanism in the bimodal catalyst. Increasing the harshness of the applied AST protocol combinations by faster changing between load-cycle or start/stop conditions, the particle size of the larger population of the bimodal catalyst increases faster than expected. Surprisingly, the change in mean particle size of the smaller size population indicates a smaller increase for harsher AST protocols, which might be explained by a substantial electrochemical Ostwald ripening.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2021

Laser-based Adhesion Strength Measurements for Advanced Manufactured Sensor Adhesion Characterization

As part of the advanced manufacturing (AM) focus of the Nuclear Energy Enabling Technologies (NEET) Advanced Sensors and Instrumentation (ASI) Program, new in-house capabilities to fabricate and test novel active and passive in-pile sensors are being developed at the Idaho National Laboratory (INL). These advanced-manufactured sensors, such as peak temperature monitors and strain gauges, must be miniaturized and be able to provide real-time feedback, all while withstanding the coupled extremes of temperature and radiation typically observed in the environment of a nuclear test reactor. Fabricating durable and robust in-pile sensors with high fidelity requires a fundamental understanding of the optimal process parameters required in the AM technique, as well as the effect of deviations from optimal process parameters on the sensor-substrate adhesion and the ultimate robustness of the sensor. This report presents the use of a laser-based, non-contact approach for characterizing the adhesion of sensors manufactured using aerosol jet printing (AJP) that comprise of silver nanoparticle inks deposited and sintered on austenitic stainless steel (SS) 316L substrates. The effect of substrate surface roughness, surface energy, ink sintering time and sintering temperature on the printed sensor topography and the sensor-substrate adhesion has been systematically investigated. The sensor-substrate interfacial adhesion strength was determined from the critical laser pulse energy required to ablate/ detach the printed sensor from the substrate. Measurements of the sensor topography using optical profilometry revealed that post-deposition sintering at 400°C for 60 minutes resulted in a reduced sensor thickness, while plasma treating the substrate prior to printing yielded sensors with uniform thickness profiles transverse to the print direction. Sintering temperature and time were found to be the dominant parameters that affected sensor-substrate adhesion, followed by substrate surface roughness. The laser-based and locally-destructive approach for adhesion strength measurements shows promise in overcoming the challenges and limitations of current standardized peel tests and can be developed into a post-fabrication process control protocol for evaluating the durability of AM printed sensors in a high throughput fashion. Future studies will investigate the use of laser-induced spallation techniques as well as non-destructive laser ultrasonic methods for sensor-substrate adhesion characterization on sensors manufactured using AJP and other AM techniques such as plasma jet printing (PJP).

42 ENGINEERING↗

DOE OSTI2023

Development of ASTM International D8405—Standard Test Method for Evaluating PM 2.5 Sensors or Sensor Systems Used in Indoor Applications

Sensors and sensor systems for monitoring fine particles with aerodynamic diameters smaller than 2.5 µm can provide real-time feedback on indoor air quality and thus can help guide actions to manage indoor air pollutant concentrations. Standardized verification of the performance and accuracy of sensors and sensor systems is crucial for predicting the efficacy of such monitoring. A new ASTM International standard test method (ASTM D8405) was created for this need and is the most exacting laboratory protocol published to date for evaluating indoor air quality sensors and sensor systems measuring particles smaller than 2.5 µm in diameter. ASTM D8405 subjects sensors and sensor systems to five test phases: (1) an initial particle concentration ramp; (2) exposure to various temperature and humidity conditions; (3) exposure to interfering particles; (4) temperature cycling; and (5) a final particle concentration ramp to assess drift. This paper discusses the development of the standard test method, key aspects of the testing process, example evaluation results, and a comparison of this standard test method against peer evaluation protocols.

47 OTHER INSTRUMENTATION↗

DOE OSTI2021

Predicting nepheline precipitation in waste glasses using ternary submixture model and machine learning

Nepheline precipitation in nuclear waste glasses during vitrification can be detrimental due to its negative effect on chemical durability. Developing models to accurately predict nepheline precipitation from compositions is important to increase waste loading since existing models can be overly conservative. In this study, an expanded dataset containing 955 glasses was compiled from literature data, where 355 glasses are for high-level waste (HLW). Previously developed submixture models were refitted using the new dataset, where a misclassification rate of 7.8% was achieved. Nine machine learning (ML) algorithms (e.g., k-nearest neighbor, Gaussian process regression, artificial neural network, support vector machine, decision tree, etc.) were applied to evaluate their ability of predicting nepheline precipitation from compositions. Model accuracy, precision, recall/sensitivity, and F1 score were systemically compared between different ML algorithms and modeling protocols. Good model prediction with an accuracy ~0.9 (misclassification rate of ~10%) was observed with different algorithms under certain protocol. This study evaluated various ML models to predict nepheline precipitations in waste glasses, highlighting the importance of data preparation, modeling protocol, and their effect on model stability and reproducibility. The results provide insights into applying ML to predict glass properties and suggest areas for future research on modeling nepheline precipitations.

Lu, Xiaonan↗