SEARCH · Engineering Papers

Results for “evaluation protocols”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

All sources NASA NTRS DOE OSTI

DOE OSTI2024

A protocol and analysis of year-long simulations of global storm-resolving models and beyond

We propose a protocol to evaluate and analyze year-long simulations of global storm-resolving models (GSRMs). The proposed protocol complements an earlier 40-day simulation protocol under the DYAMOND (DYnamics of the Atmospheric general circulation Modeled On Non-hydrostatic Domains) project to allow the analysis of the seasonal cycle and associated climatic relevant phenomena. This intercomparison aims to reveal how GSRMs, which can simulate mesoscale convective systems (MCSs) in the global domain, reproduce atmospheric large-scale structures related to convection beyond month-long simulations. The intercomparison for one-year simulations is conducted by either atmosphere-only models or atmosphere–ocean coupled models with atmospheric horizontal mesh sizes less than 5 km. We recommend the continuous four seasons from March 2020 to February 2021 as a target period for the intercomparison but with options for many groups to join more flexibly. The output variables are collected at 0.25° resolution, and archives of a small set of native grid variables are encouraged to analyze tropical cyclones and MCSs. Through the proposed global storm-resolving simulation, we will evaluate the climatological distributions of the atmospheric large-scale circulations, such as the Intertropical Convergence Zone (ITCZ), monsoon, midlatitude jets, their time evolution, and the upscale impacts on them. We present sample analyses from a one-year simulation using the 3.5 km mesh Nonhydrostatic Icosahedral Atmospheric Model (NICAM), revealing the realistic zonal contrast of tropical precipitation, no double ITCZ structure, the reasonable midlatitude jet position and intensity but a weak bias of storm track activities, and a warm bias over the Eurasia during boreal winter. We also clarify the cross-scale interaction, such as the effects of cold pools on mean precipitation over the Maritime Continent through the precipitation diurnal cycle and the effects of resolved gravity waves on midlatitude mean flows. The proposed one-year simulation protocol is referred to as the “Sendai Protocol.” This protocol is not unique or definite for evaluating GSRMs; we prospect a hierarchical set of experiments from short-term to multi-year simulations as GSRM intercomparisons.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS2010

Criteria for Evaluating Alternative Network and Link Layer Protocols for the NASA Constellation Program Communication Architecture

Selecting a communications and network architecture for future manned space flight requires an evaluation of the varying goals and objectives of the program, development of communications and network architecture evaluation criteria, and assessment of critical architecture trades. This paper uses Cx Program proposed exploration activities as a guideline; lunar sortie, outpost, Mars, and flexible path options are described. A set of proposed communications network architecture criteria are proposed and described. They include: interoperability, security, reliability, and ease of automating topology changes. Finally a key set of architecture options are traded including (1) multiplexing data at a common network layer vs. at the data link layer, (2) implementing multiple network layers vs. a single network layer, and (3) the use of a particular network layer protocol, primarily IPv6 vs. Delay Tolerant Networking (DTN). In summary, the protocol options are evaluated against the proposed exploration activities and their relative performance with respect to the criteria are assessed. An architectural approach which includes (a) the capability of multiplexing at both the network layer and the data link layer and (b) a single network layer for operations at each program phase, as these solutions are best suited to respond to the widest array of program needs and meet each of the evaluation criteria.

Benbenek, Daniel↗

DOE OSTI2020

Evaluating kratom alkaloids using PHASE

Kratom is a botanical substance that is marketed and promoted in the US for pharmaceutical opioid indications despite having no US Food and Drug Administration approved uses. Kratom contains over forty alkaloids including two partial agonists at the mu opioid receptor, mitragynine and 7-hydroxymitragynine, that have been subjected to the FDA’s scientific and medical evaluation. However, pharmacological and toxicological data for the remaining alkaloids are limited. Therefore, we applied the Public Health Assessment via Structural Evaluation (PHASE) protocol to generate in silico binding profiles for 25 kratom alkaloids to facilitate the risk evaluation of kratom. PHASE demonstrates that kratom alkaloids share structural features with controlled opioids, indicates that several alkaloids bind to the opioid, adrenergic, and serotonin receptors, and suggests that mitragynine and 7-hydroxymitragynine are the strongest binders at the mu opioid receptor. Subsequently, the in silico binding profiles of a subset of the alkaloids were experimentally verified at the opioid, adrenergic, and serotonin receptors using radioligand binding assays. The verified binding profiles demonstrate the ability of PHASE to identify potential safety signals and provide a tool for prioritizing experimental evaluation of high-risk compounds.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2020

Remote Hardware-in-the-Loop Approach for Microgrid Controller Evaluation

Utilities have been installing microgrids because of the increased resilience and reliability advantages they may provide to the distribution system. A microgrid controller is a critical component in microgrids. It is of great benefit to derisk the installation of microgrid controllers before field deployment. Hardware-in-the-loop (HIL) testing is used by controller developers and utilities to evaluate the controllers under stressful conditions. In this work, a microgrid control function developed by the Synchrophasor Grid Monitoring and Automation (SyGMA) laboratory at the University of California, San Diego is tested in a remote HIL (RHIL) setup. The digital real-time simulation of the detailed microgrid system was operated at the National Renewable Energy Laboratory's Energy Systems Integration Facility. Under such RHIL setup, successful controller operation is contingent on understanding and characterizing the communications channel and in particular network latencies. The novelty of this paper is the proposed use of a RHIL setup that leverages existing power system communications protocols to evaluate the controller in conjunction with the simulation capabilities of a remote facility. The work presented here will provide the complete setup of the HIL evaluation platform, the details of the communications protocols used by the setup for data transfer between the two organizations, test cases developed to evaluate the controller, and the results from the experiments.

controller hardware-in-the-loop↗

DOE OSTI2020

Remote Hardware-in-the-Loop Approach for Microgrid Controller Evaluation

24 POWER TRANSMISSION AND DISTRIBUTION↗

NASA NTRS2011

Evaluation of Robotic Systems to Carry Out Traverse Execution, Opportunistic Science, and Landing Site Evaluation Tasks

This report covers the execution of and results from the activities proposed and approved in Exploration Analogs and Mission Development (EAMD) Field Test Protocol HMP2010: Evaluation of Robotic Systems to carry out Traverse Execution, Opportunistic Science, and Landing Site Evaluation Tasks. The field tests documented in this report examine one facet of a larger program of planetary surface exploration. This program has been evolving and maturing for several years, growing from a broad policy statement with a few specified milestones for NASA to an international effort with much higher fidelity descriptions of systems and operations necessary to accomplish this type of exploration.

Hoffman, Stephen J.↗

DOE OSTI2020

Transmission of Images With Ultrasonic Elastic Shear Waves on a Metallic Pipe Using Amplitude Shift Keying Protocol

Transmission of information using ultrasonic elastic waves on existing metallic pipes provides an alternative communication option across physical barriers in a highly partitioned industrial complex, such as a nuclear facility. This work investigates the feasibility of the transmission of digital images over metallic pipes. Ultrasonic communication systems for transmission of images on a nuclear-grade stainless steel pipe were assembled for bench-scale demonstration. Information carriers in this system are refracted shear waves transmitted and received with piezoelectric transducers (PZTs) operating at 2-MHz nominal frequency. The refraction and propagation of ultrasonic shear waves were modeled with COMSOL software. An amplitude shift keying (ASK) communication protocol for image transmission was developed and implemented in the GNURadio software-defined radio (SDR) environment. Digital information was converted to analog ultrasonic signals using Red Pitaya electronic boards. The performance of the ASK protocol is evaluated at the output of every block in the GNURadio program by monitoring the transmission of select characters. Using the ASK communication protocol, the transmission of the 32-KB image was demonstrated at 2-Kbps bitrate across 6-ft-long stainless steel pipe. Finally, preliminary evaluation of ultrasonic communication on the piping of a nuclear facility, such as signal transmission on bent pipes, was performed with COMSOL computer simulations.

42 ENGINEERING↗

DOE OSTI2026

PRIME: An evaluation framework for protein representation inference and generalization in viral mutation space

Background Protein language models (PLMs) have revolutionized protein fitness prediction, yet their application to rapidly evolving viral pathogens is often confounded by extreme sequence homology. This homology leads to “data leakage” in standard random validation splits, yielding inflated performance metrics that fail to translate into real-world biosurveillance utility. Results We present Protein Representation Inference for Mutation Evaluation (PRIME), a framework that integrates domain-specific fine-tuning with a rigorous position-stratified validation protocol to evaluate viral threats. Using a dataset of 347,432 SARS-CoV-2 receptor binding domain (RBD) sequences, we demonstrate that while random training data split yields deceptive R 2 values (> 0.90), they fail to generalize to novel mutational sites. By benchmarking models up to 650 M parameters, we show that domain-specific fine-tuning of the ESM-C 600 M model with correctly stratified data provides an initial demonstration of predictive signal for binding affinity and expression at unseen mutational sites of binding affinity and expression on unseen sites (R 2 ~0.23), a significant advancement over base foundation models which exhibit no predictive power (R 2 <0). PRIME’s embedding-based clustering identified 3.03% of bat coronavirus sequences as candidates for further experimental prioritization based on their functional similarity to human-infective strains in embedding space, offering a perspective complementary to traditional phylogenetic methods. Conclusion PRIME establishes a new benchmark for the application of PLMs in pathogen surveillance. Our findings demonstrate that state-of-the-art models and fine-tuning, when paired with stratified validation, provide biologically meaningful insights into pathogen evolution and zoonotic risk.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2020

A systematic strategy for estimating hERG block potency and its implications in a new cardiac safety paradigm

Introduction: hERG block potency is widely used to calculate a drug's safety margin against its torsadogenic potential. Previous studies are confounded by use of different patch clamp electrophysiology protocols and a lack of statistical quantification of experimental variability. Since the new cardiac safety paradigm being discussed by the International Council for Harmonisation promotes a tighter integration of nonclinical and clinical data for torsadogenic risk assessment, a more systematic approach to estimate the hERG block potency and safety margin is needed. Methods: A cross-industry study was performed to collect hERG data on 28 drugs with known torsadogenic risk using a standardized experimental protocol. A Bayesian hierarchical modeling (BHM) approach was used to assess the hERG block potency of these drugs by quantifying both the inter-site and intra-site variability. A modeling and simulation study was also done to evaluate protocol-dependent changes in hERG potency estimates. Results: A systematic approach to estimate hERG block potency is established. The impact of choosing a safety margin threshold on torsadogenic risk evaluation is explored based on the posterior distributions of hERG potency estimated by this method. The modeling and simulation results suggest any potency estimate is specific to the protocol used. Discussion: This methodology can estimate hERG block potency specific to a given voltage protocol. The relationship between safety margin thresholds and torsadogenic risk predictivity suggests the threshold should be tailored to each specific context of use, and safety margin evaluation may need to be integrated with other information to form a more comprehensive risk assessment.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2023

Developing rapid electrochemical relithiation protocols for scalable relithiation of lithium-ion battery cathode materials

The recent and ongoing boom in electric vehicle sales has caused the circularity of the supply chain for electric vehicle battery materials to come under a great deal of scrutiny. Innovative recycling processes, or direct recycling, that offer the possibility of reducing the cost of recycling are one possible solution to regaining resources from end-of-life (EoL) electric vehicle batteries. Electrochemically shuttling lithium back into the cathode, or electrochemical relithiation, is a possible technique for restoring lithium content to NMC materials (EoL) in a direct recycling process. This study provides essential understanding towards developing an electrochemical relithiation protocol that will restore lithium loss in intercalation cathode materials that reach EoL by loss of lithium inventory (LLI) as opposed to other degradation mechanisms like loss of active material (LAM), cation mixing or phase transition. Electrochemically aged NMC cathode materials have been prepared and characterized to establish the extent of EoL material structural degradation and lithium loss. A model-informed experimental process is used to identify the optimal electrochemical relithiation protocol to minimize the time taken to relithiate EoL materials and maximize the amount of lithium restored. Protocols were evaluated based on their ability to enable rapid lithium intercalation, maintain structural uniformity in the EoL material and fully restore lithium content. An optimal protocol was identified at elevated temperatures utilizing a novel scanning voltage step.

25 ENERGY STORAGE↗

NASA NTRS2015

An Approach for Performance Based Glove Mobility Requirements

The Space Suit Assembly (SSA) Development Team at NASA Johnson Space Center has invested heavily in the advancement of rear‐entry planetary exploration suit design but largely deferred development of extravehicular activity (EVA) glove designs, and accepted the risk of using the current flight gloves, Phase VI, for exploration missions. However, as design reference missions mature, the risks of using heritage hardware have highlighted the need for developing robust new glove technologies. To address the technology gap, the NASA Space Technology Mission Directorate's Game‐Changing Development Program provided start‐up funding for the High Performance EVA Glove (HPEG) Element as part of the Next Generation Life Support (NGLS) Project in the fall of 2013. The overarching goal of the HPEG Element is to develop a robust glove design that increases human performance during EVA and creates pathway for implementation of emergent technologies, with specific aims of increasing pressurized mobility to 60% of barehanded capability, increasing the durability in on‐pristine environments, and decreasing the potential of gloves to cause injury during use. The HPEG Element focused initial efforts on developing quantifiable and repeatable methodologies for assessing glove performance with respect to mobility, injury potential, thermal conductivity, and abrasion resistance. The team used these methodologies to establish requirements against which emerging technologies and glove designs can be assessed at both the component and assembly levels. The mobility performance testing methodology was an early focus for the HPEG team as it stems from collaborations between the SSA Development team and the JSC Anthropometry and Biomechanics Facility (ABF) that began investigating new methods for suited mobility and fit early in the Constellation Program. The combined HPEG and ABF team used lessons learned from the previous efforts as well as additional reviews of methodologies in physical and occupational therapy arenas to develop a protocol that assesses gloved range of motion, strength, dexterity, tactility, and fit in comparative quantitative terms and also provides qualitative insight to direct hardware design iterations. The protocol was evaluated using five experienced test subjects wearing the EMU pressurized to 4.3psid with three different glove configurations. The results of the testing are presented to illustrate where the protocol is and is not valid for benchmark comparisons. The process for requirements development based upon the results is also presented along with suggested performance values for the High Performance EVA Gloves to be procured in fiscal year 2015.

Aitchison, Lindsay↗

NASA NTRS2016

An Approach for Performance Based Glove Mobility Requirements

The Space Suit Assembly (SSA) Development Team at NASA Johnson Space Center has invested heavily in the advancement of rear-entry planetary exploration suit design but largely deferred development of extravehicular activity (EVA) glove designs, and accepted the risk of using the current flight gloves, Phase VI, for exploration missions. However, as design reference missions mature, the risks of using heritage hardware have highlighted the need for developing robust new glove technologies. To address the technology gap, the NASA Space Technology Mission Directorate's Game-Changing Development Program provided start-up funding for the High Performance EVA Glove (HPEG) Element as part of the Next Generation Life Support (NGLS) Project in the fall of 2013. The overarching goal of the HPEG Element is to develop a robust glove design that increases human performance during EVA and creates pathway for implementation of emergent technologies, with specific aims of increasing pressurized mobility to 60% of barehanded capability, increasing the durability in on-pristine environments, and decreasing the potential of gloves to cause injury during use. The HPEG Element focused initial efforts on developing quantifiable and repeatable methodologies for assessing glove performance with respect to mobility, injury potential, thermal conductivity, and abrasion resistance. The team used these methodologies to establish requirements against which emerging technologies and glove designs can be assessed at both the component and assembly levels. The mobility performance testing methodology was an early focus for the HPEG team as it stems from collaborations between the SSA Development team and the JSC Anthropometry and Biomechanics Facility (ABF) that began investigating new methods for suited mobility and fit early in the Constellation Program. The combined HPEG and ABF team used lessons learned from the previous efforts as well as additional reviews of methodologies in physical and occupational therapy arenas to develop a protocol that assesses gloved range of motion, strength, dexterity, tactility, and fit in comparative quantitative terms and also provides qualitative insight to direct hardware design iterations. The protocol was evaluated using five experienced test subjects wearing the EMU pressurized to 4.3psid with three different glove configurations. The results of the testing are presented to illustrate where the protocol is and is not valid for benchmark comparisons. The process for requirements development based upon the results is also presented along with suggested performance values for the High Performance EVA Gloves currently in development.

Aitchison, Lindsay↗

NASA NTRS1991

Experimental evaluation of multiprocessor cache-based error recovery

Several variations of cache-based checkpointing for rollback error recovery in shared-memory multiprocessors have been recently developed. By modifying the cache replacement policy, these techniques use the inherent redundancy in the memory hierarchy to periodically checkpoint the computation state. Three schemes, different in the manner in which they avoid rollback propagation, are evaluated. By simulation with address traces from parallel applications running on an Encore Multimax shared-memory multiprocessor, the performance effect of integrating the recovery schemes in the cache coherence protocol are evaluated. The results indicate that the cache-based schemes can provide checkpointing capability with low performance overhead but uncontrollable high variability in the checkpoint interval.

Janssens, Bob↗

NASA NTRS2017

Modulation of Bone Marrow Primary Cell Osteoblastogenesis and Cell Senescence by Mechanical Stimulation

Cell and animal studies conducted onboard the International Space Station and formerly the Shuttle flights have provided groundbreaking data illuminating the deleterious biological response of bone to mechanical unloading. Specifically CDKN1A/p-21 a cell senescence protein, was found to be upregulated in osteoprecursor cells of the femur during 15-day spaceflight, leading to the working hypothesis that CDKN1A/p-21 plays a role in inhibition of bone formation via mechanical regulation. To evaluate this hypothesis, utilizing a p-21 knockout mouse-line and relevant wildtype control, we cultured femoral bone marrow primary cells under unloaded (static) and cyclically stretched loading through a 30 day osteoblastogenesis protocol. Morphologic evaluation of the cultures demonstrated that mechanical stretching aligned the cells and increased the presence of defined focal adhesion expressing talin, integrin αvβ3, and PTK2 protein tyrosine kinase 2, also known as focal adhesion kinase (FAK) in both mouse strains. In corroboration with previous investigations of cell survival signals relation to FAK, our study found that with greater concentration of focal adhesions via stretch stimulation the live cell percentage was significantly higher than the unloaded controls (p-21 knockout line: +49.70%, p*=0.009, wildtype control: +18.14%, p*=.01). Also evaluated was the mineralization and ECM secretion capability of the differentiating cells. Von Kossa staining has shown that in the p-21 knockout cells unloaded cells produce more matrix that the stretch stimulated, however the matrix is unorganized presenting in sporadic nodules covering approximately 30% of the culture area at day 14 (n=6 wells) while the stretch stimulated cultures have less mineralization content the surface area containing mineralized matrix is greater (~68% at day 14). Q-PCR evaluation of the p-21 knockout cells revealed that canonical (β-catenin cascade) and non-canonical wnt11 and downstream planar cell polarity (wnt/PCP) pathway molecule RAC1 are prevalently upregulated with mechanical stimulation. Immunofluorescence for β-catenin and RAC1 showed co-localization at the nuclear membrane of the p-21 knockout cells but not the wildtype (n=1) suggesting that molecular communication via the canonical and wnt/PCP pathway are initiated by mechanical loading and experience regulation along the signaling cascade by CDKN1A/p-21. Future investigations will further elucidate this relationship and provide causal data demonstrating mechanical loading’s modulatory effect on p-21 expression change.

Juran, Cassandra M.↗

NASA NTRS1992

CAPTIONALS: A computer aided testing environment for the verification and validation of communication protocols

This paper covers the verification and protocol validation for distributed computer and communication systems using a computer aided testing approach. Validation and verification make up the so-called process of conformance testing. Protocol applications which pass conformance testing are then checked to see whether they can operate together. This is referred to as interoperability testing. A new comprehensive approach to protocol testing is presented which address: (1) modeling for inter-layer representation for compatibility between conformance and interoperability testing; (2) computational improvement to current testing methods by using the proposed model inclusive of formulation of new qualitative and quantitative measures and time-dependent behavior; (3) analysis and evaluation of protocol behavior for interactive testing without extensive simulation.

Feng, C.↗

DOE OSTI2025

Harnessing land-atmosphere interactions to enhance subseasonal-to-seasonal predictability

2025 Advancing Understanding of Land-Atmosphere Interactions and Processes on S2S Predictability Workshop What: 227 registered workshop participants gathered in person (43%) and online (57%) to discuss state-of-the-art scientific understanding and modeling of land-atmosphere interactions and related processes in the context of subseasonal-to-seasonal (S2S) predictability. Topics covered sources of S2S predictability, land model initialization methods, model diagnosis and evaluation metrics, AI/ML analysis and applications, and coordination of future community multi-model S2S forecast focused experiments. To advance the science, this community workshop, organized by NSF NCAR, NOAA, NASA, and DOE, aimed to 1) identify process- and application-oriented metrics for assessing S2S prediction skill and 2) develop experimental protocols for coordinated experiments to isolate, quantify, and understand the role of land-atmosphere interactions in S2S predictability. When: June 16-18, 2025 Where: Boulder, CO, USA, and online.

Land-Atmosphere Interaction↗

DOE OSTI2023

Evaluating the Water Cycle Over CONUS at the Watershed Scale for the Energy Exascale Earth System Model Version 1 (E3SMv1) Across Resolutions

Abstract The water cycle is an important component of the earth system and it plays a key role in many facets of society, including energy production, agriculture, and human health and safety. In this study, the Energy Exascale Earth System Model version 1 (E3SMv1) is run with low‐resolution (roughly 110 km) and high‐resolution (roughly 25 km) configurations—as established by the High Resolution Model Intercomparison Project protocol—to evaluate the atmospheric and terrestrial water budgets over the conterminous United States (CONUS) at the large watershed scale. The warm season water cycle slows down in the HR experiment relative to the LR, with decreasing fluxes of precipitation, evapotranspiration, atmospheric moisture convergence, and runoff. The reductions in these terms exacerbate biases for some watersheds, while reducing them in others. For example, precipitation biases are exacerbated at HR over the Eastern and Central CONUS watersheds, while precipitation biases are reduced at HR over the Western CONUS watersheds. The most pronounced changes with resolution to the water cycle come from reductions in precipitation and evapotranspiration. The reduction in evapotranspiration reduces the biases across nearly all of the CONUS. Additional exploratory metrics show improvements to water cycle extremes (both in precipitation and streamflow), fractional contributions of different storm types to total precipitation, and mountain snowpack.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS2004

PARAGON: A Systematic, Integrated Approach to Aerosol Observation and Modeling

Aerosols are generated and transformed by myriad processes operating across many spatial and temporal scales. Evaluation of climate models and their sensitivity to changes, such as in greenhouse gas abundances, requires quantifying natural and anthropogenic aerosol forcings and accounting for other critical factors, such as cloud feedbacks. High accuracy is required to provide sufficient sensitivity to perturbations, separate anthropogenic from natural influences, and develop confidence in inputs used to support policy decisions. Although many relevant data sources exist, the aerosol research community does not currently have the means to combine these diverse inputs into an integrated data set for maximum scientific benefit. Bridging observational gaps, adapting to evolving measurements, and establishing rigorous protocols for evaluating models are necessary, while simultaneously maintaining consistent, well understood accuracies. The Progressive Aerosol Retrieval and Assimilation Global Observing Network (PARAGON) concept represents a systematic, integrated approach to global aerosol Characterization, bringing together modern measurement and modeling techniques, geospatial statistics methodologies, and high-performance information technologies to provide the machinery necessary for achieving a comprehensive understanding of how aerosol physical, chemical, and radiative processes impact the Earth system. We outline a framework for integrating and interpreting observations and models and establishing an accurate, consistent and cohesive long-term data record.

PARAGON↗