Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “EVALUATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,423 records · Page 79
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Markov Process to Evaluate the Value Proposition of a Risk-Informed Predictive Maintenance Strategy

To achieve high-capacity factors, the nuclear fleet has relied on labor-intensive and time-consuming operation and preventive maintenance programs for plant systems. Manually performed inspection, calibration, testing, and maintenance of plant assets at periodic frequencies, along with time-based replacement of assets irrespective of condition, have resulted in a costly, labor-centric business model. Fortunately, there are technologies that can eliminate unnecessary preventive maintenance activities by deploying risk-informed predictive maintenance, enabling the transition to a technology-centric business model. The technology-centric business model will enable plants to optimize and automate maintenance activities, leading to cost reductions since labor is a rising cost and technology is a declining cost. The implementation of scalable technologies and methodologies across plant systems and across the nuclear fleet is critical for successful deployment of a risk-informed predictive maintenance strategy at commercial nuclear power plants. The work presented in the report is being developed as part of a collaborative research effort between Idaho National Laboratory and Public Service Enterprise Group Nuclear, LLC. This report describes the technical basis using the Markov Process to evaluate the value proposition for the risk-informed predictive maintenance strategy for the circulating water system. The plant process data from the Salem nuclear plant’s circulating water system is utilized to develop a Markov chain risk models and formulation to estimate the loss and gain in revenue based on plant availability. The outcomes presented in this report provides the technical basis for extensive quantitative evaluation of a scalable risk-informed predictive maintenance strategy as part of future research.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

Evaluation of Clamshell Current Coupler for Online Frequency Domain and Spread Spectrum Time Domain Reflectometry to Detect Anomalies in Energized Cables

This document describes adaptation and evaluation of a clamshell inductive current coupler for online reflectometry testing (both frequency domain reflectometry and spread spectrum time domain reflectometry) to evaluate cable insulation degradation and anomalies. Safety-critical nuclear power plant cables were initially qualified for 40 years. However, as plants extend their operating licenses to 60 and 80 years, justification for continued safe operation includes test and monitoring programs. These will become more important as the industry moves to condition based qualification programs. Cable test programs traditionally involve manual interventions to disconnect cables, perform one or several tests, then reconnect the systems, usually during refueling outages occurring only every 18 to 24 months. This poses an operational burden that can be minimized by online testing or periodic connection to a coupler that may remain on the cable of interest or be clamped onto the cable without de-termination. This work investigates the adaptation of a clamshell inductive current coupler for either frequency domain reflectometry or spread-spectrum time domain reflectometry. The reflectometry test instrument injects a broad-band chirp or pseudo-noise signal onto a cable conductor and monitors for a reflected signal indicative of an impedance change caused by a damage condition. The instrument maximum input signal levels are typically 10 to 30 volts or less and the instruments will be damaged if subjected to 60 Hz power line voltages of 110, 220, or 480 VAC. One commercial spread-spectrum time domain reflectometry system has circuitry suitable for voltages up to 1 kV, but typical reflectometry tests are performed on de-energized cables. The clamshell inductive coupler provides >60 dB of 60 Hz attenuation with less than 10 dB loss in the 1-500 MHz test bandwidth of interest. An energized cable was successfully tested up to 6.7 kVp-p and frequency response plots imply that the tests could be extended to 10 kV or higher energized levels.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Thermal Evaluation of CCS and NACS Reference Devices and Adapters

It is important for manufacturers of electric vehicle charging connectors, inlets, and adapters to understand the thermal performance of their devices. Various standards, such as SAE J1772, SAE J3400, IEC 62196, UL 2251, and UL 2252, list temperature limits that charging hardware needs to meet. However, there are currently very limited standardized reference devices against which to measure connector performance, and those that do currently exist generally serve charging currents less than 500A. This can make determining whether a charging connector meets the appropriate temperature limits difficult. Additionally, as automakers and charging station suppliers transition from the SAE J1772 CCS charging standard to SAE J3400 NACS, a number of CCS-to-NACS and NACS-to-CCS adapters are entering the market. These devices are being produced both by well-known automakers/equipment OEMs and lesser-known third-party suppliers, across a wide range of price points and construction qualities. Though SAE J3400/1 and UL 2252 lay out standards for adapter construction, performance and overtemperature response, there is no guarantee that any particular adapter will follow these standards and react to overtemperature events appropriately. This work addresses these issues by developing and evaluating a set of CCS and NACS reference inlet devices to validate the performance of charging connectors in the 500-800A range. The work also evaluates the performance of multiple NACS-to-CCS and CCS-to-NACS charging adapters with respect to UL 2252 temperature limits and SAE J3400/1 overtemperature signaling criteria.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2022

Comprehensive Evaluation for Protective Coatings: Optical, Electrical, Photoelectrochemical, and Spectroscopic Characterizations

Numerous efficient semiconductors suffer from instability in aqueous electrolytes. Strategies utilizing protective coatings have thus been developed to protect these photoabsorbers against corrosion while synergistically improving charge separation and reaction kinetics. Recently, various photoelectrochemical (PEC) protective coatings have been reported with suitable electronic properties to ensure low charge transport loss and reveal the fundamental photoabsorber efficiency. However, protocols for studying the critical figures of merit for protective coatings have yet to be established. For this reason, we propose four criteria for evaluating the performance of a protective coating for PEC water-splitting: stability, conductivity, optical transparency, and energetic matching. We then propose a flow chart that summarizes the recommended testing protocols for quantifying these four performance metrics. In particular, we lay out the stepwise testing protocols to evaluate the energetics matching at a semiconductor/coating/(catalyst)/liquid interface. Finally, we provide an outlook for the future benchmarking needs for coatings.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Fine-scale evaluation of two standard 16S rRNA gene amplicon primer pairs for analysis of total prokaryotes and archaeal nitrifiers in differently managed soils

The advance of high-throughput molecular biology tools allows in-depth profiling of microbial communities in soils, which possess a high diversity of prokaryotic microorganisms. Amplicon-based sequencing of 16S rRNA genes is the most common approach to studying the richness and composition of soil prokaryotes. To reliably detect different taxonomic lineages of microorganisms in a single soil sample, an adequate pipeline including DNA isolation, primer selection, PCR amplification, library preparation, DNA sequencing, and bioinformatic post-processing is required. Besides DNA sequencing quality and depth, the selection of PCR primers and PCR amplification reactions arguably have the largest influence on the results. This study tested the performance and potential bias of two primer pairs, i.e., 515F (Parada)-806R (Apprill) and 515F (Parada)-926R (Quince) in the standard pipelines of 16S rRNA gene Illumina amplicon sequencing protocol developed by the Earth Microbiome Project (EMP), against shotgun metagenome-based 16S rRNA gene reads. The evaluation was conducted using five differently managed soils. We observed a higher richness of soil total prokaryotes by using reverse primer 806R compared to 926R, contradicting to in silico evaluation results. Both primer pairs revealed various degrees of taxon-specific bias compared to metagenome-derived 16S rRNA gene reads. Nonetheless, we found consistent patterns of microbial community variation associated with different land uses, irrespective of primers used. Total microbial communities, as well as ammonia oxidizing archaea (AOA), the predominant ammonia oxidizers in these soils, shifted along with increased soil pH due to agricultural management. In the unmanaged low pH plot abundance of AOA was dominated by the acid-tolerant NS-Gamma clade, whereas limed agricultural plots were dominated by neutral-alkaliphilic NS-Delta/NS-Alpha clades. This study stresses how primer selection influences community composition and highlights the importance of primer selection for comparative and integrative studies, and that conclusions must be drawn with caution if data from different sequencing pipelines are to be compared.

16S rRNA gene amplicon Illumina sequencing↗
DOE OSTI2025

Performance Evaluation of Weather@home2 Simulations over West African Region

Weather and climate forecasting, using climate models, have become essential tools and life-savers in the West African region; in spite of the fact that climate models do not fully comply with attributes of forecast qualities—RASAP: reliability, association, skill, accuracy, and precision. The objective of this paper is to quantitatively evaluate, in comparison to CRU and ERA5 datasets, the RASAP compliance-level of the weather@home2 modeling system (w@h2). Findings from some statistical evaluations show that, to a moderately significant extent, w@h2 model provides useful information during the monsoon seasons; skills to capture the Little Dry Season over the Guinea zone; predictive skills for the onset season; ability to reproduce all the annual characteristics of the surface maximum air temperature over the region; as well as skill to detect heat waves that usually ravage West Africa during the boreal spring. The model displays traces of attributes that are needed for seasonal climate predictions and applications. Deficiencies in the quantitative reproducibility point to the facts that the model does provide a reliability akin to that of regional climate models. This paper further furnishes a prospective user with information on whether the model might be “useful or not” for a particular application.

West Africa↗
DOE OSTI2023

Performance Evaluation of an Occupancy-Based HVAC Control System in an Office Building

As new algorithms incorporate occupancy count information into more sophisticated HVAC control, these technologies offer great potential for reductions in energy costs while enhancing flexibility. This study presents results from a two-year field evaluation of an occupancy-based HVAC control system installed in an office building. Two wings on each of the building’s 2–11 floors were equipped with occupancy counters to learn occupancy patterns. In combination with proprietary machine learning algorithms and thermal modeling, the occupancy data were leveraged to implement optimized start, early closure, and adjustments to fan operation at the air handling unit (AHU) level. This study conducted a holistic evaluation of technical performance, cost-effectiveness analysis, and user satisfaction. Results show the platform reduced weekday AHU run times by 2 h and 35 min per AHU per day during the pandemic time period. Simulation shows that 6.1% annual whole-building savings can be achieved when the building is fully occupied. The results are compared with prior studies, and potential drivers are discussed for future opportunities. The assessment results shed light on the expected in-the-field performance for researchers and industry stakeholders and enabled practical considerations as the technology strives to move beyond research-grade pilot trials into product-grade deployment.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2026

Multi-Semester Mentoring and GPA Trajectories in SPINS: A Longitudinal Program Evaluation of STEM Scholars

This exploratory longitudinal program evaluation examined GPA trajectories among 14 STEM scholars participating in the Scholarly Partnership in Nuclear Security (SPINS) mentoring program at an HBCU. Using de-identified administrative data (37 scholar-semester observations), the study compared baseline and latest term GPAs anchored to each scholar’s first funded semester. A Wilcoxon signed-rank test was used to assess within-student change. Mean GPA increased modestly from 3.46 (SD = 0.30) at baseline to 3.61 (SD = 0.33) at the latest observed semester, with 12 of 14 scholars (85.7%) showing net improvement (median change = +0.12). The Wilcoxon signed-rank test indicated a statistically significant positive shift (W = 18, p = 0.030). However, scholars entered the program with a high baseline GPA, and ceiling effects were evident for several participants. Grounded in Social Cognitive Career Theory, findings suggest that multi-semester participation in SPINS is associated with GPA stability and modest improvement in an already high-performing cohort. Results should be interpreted cautiously given the small sample size and single-group design. The study highlights the value of sustained, culturally responsive mentoring at an HBCU while underscoring the need for larger evaluations with comparison cohorts and broader psychosocial outcomes. An evidence-informed mentoring framework is proposed to strengthen multi-semester support.

42 ENGINEERING↗
DOE OSTI2023

Evaluation of E3SM land model snow simulations over the western United States

Abstract. Seasonal snow has crucial impacts on climate, ecosystems, and humans, but it is vulnerable to global warming. The land component (ELM) of the Energy Exascale Earth System Model (E3SM) mechanistically simulates snow processes from accumulation, canopy interception, compaction, and snow aging to melt. Although high-quality field measurements, remote sensing snow products, and data assimilation products with high spatio-temporal resolution are available, there has been no systematic evaluation of the snow properties and phenology in ELM. This study comprehensively evaluates ELM snow simulations over the western United States at 0.125∘ resolution during 2001–2019 using the Snow Telemetry (SNOTEL) in situ networks, MODIS remote sensing products (i.e., MCD43 surface albedo product), the spatially and temporally complete (STC) snow-covered area and grain size (MODSCAG) and MODIS dust and radiative forcing in snow (MODDRFS) products (STC-MODSCAG/STC-MODDRFS), and the snow property inversion from remote sensing (SPIReS) product and two data assimilation products of snow water equivalent and snow depth – i.e., University of Arizona (UA) and SNOw Data Assimilation System (SNODAS). Overall the ELM simulations are consistent with the benchmarking datasets and reproduce the spatio-temporal patterns, interannual variability, and elevation gradients for different snow properties including snow cover fraction (fsno), surface albedo (αsur) over snow cover regions, snow water equivalent (SWE), and snow depth (Dsno). However, there are large biases of fsno with dense forest cover and αsur in the Rocky Mountains and Sierra Nevada in winter, compared to the MODIS products. There are large discrepancies of snow albedo, snow grain size, and light-absorbing particle-induced snow albedo reduction between ELM and the MODIS products, attributed to uncertainties in the aerosol forcing data, snow aging processes in ELM, and remote sensing retrievals. Against UA and SNODAS, ELM has a mean bias of −20.7 mm (−35.9 %) and −20.4 mm (−35.5 %), respectively, for spring, and −13.8 mm (−27.8 %) and −10.2 mm (−22.2 %), respectively, for winter. ELM shows a relatively high correlation with SNOTEL SWE, with mean correlation coefficients of 0.69 but negative mean biases of −122.7 mm. Compared to the snow phenology of STC-MODSCAG and SPIReS, ELM shows delayed snow accumulation onset dates by 17.3 and 12.4 d, earlier snow end dates by 35.5 and 26.8 d, and shorter snow durations by 52.9 and 39.5 d, respectively. This study underscores the need for diagnosing model biases and improving ELM representations of snow properties and snow phenology in mountainous areas for more credible simulation and future projection of mountain snowpack.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1975

CARETS: A prototype regional environmental information system. Volume 13: Utility of CARETS products to local planners; an evaluation

The Metropolitan Washington Council of Governments (MWCOG) in cooperation with and under contract to the U.S. Geological Survey, conducted an evaluation of the utility of remote-sensor derived land use data produced by the USGS Central Atlantic Regional Ecological Test Site (CARETS) project. Investigators invited representatives of Washington, D.C. metropolitan area planning agencies to a workshop, introduced them to the CARETS products, and asked them to evaluate the products. In follow-up interviews, planners from 12 participating agencies reported general support for the fulI spectrum of CARETS products but gave more positive responses towards products with which they had some familiarity. Planners considered some products of limited utility because of (1) insufficient detail, (2) too small a scale, or (3) lack of technical capability to incorporate the information and products into the current planning process. Some planners expressed doubt about the application of CARETS products in most day-to-day planning activities , which involve specific rezoning requests or site development plans requiring highly localized data. The greatest potential of the CARETS products was in the identification of broad development patterns at the county or regional level. An appendix documents the results of an inventory of local government decisions relating to land use.

Land use planning↗
NASA NTRS2002

Rationally designed fluorescently labeled sulfate-binding protein mutants: evaluation in the development of a sensing system for sulfate

Periplasmic binding proteins from E. coli undergo large conformational changes upon binding their respective ligands. By attaching a fluorescent probe at rationally selected unique sites on the protein, these conformational changes in the protein can be monitored by measuring the changes in fluorescence intensity of the probe which allow the development of reagentless sensing systems for their corresponding ligands. In this work, we evaluated several sites on bacterial periplasmic sulfate-binding protein (SBP) for attachment of a fluorescent probe and rationally designed a reagentless sensing system for sulfate. Eight different mutants of SBP were prepared by employing the polymerase chain reaction (PCR) to introduce a unique cysteine residue at a specific location on the protein. The sites Gly55, Ser90, Ser129, Ala140, Leu145, Ser171, Val181, and Gly186 were chosen for mutagenesis by studying the three-dimensional X-ray crystal structure of SBP. An environment-sensitive fluorescent probe (MDCC) was then attached site-specifically to the protein through the sulfhydryl group of the unique cysteine residue introduced. Each fluorescent probe-conjugated SBP mutant was characterized in terms of its fluorescence properties and Ser171 was determined to be the best site for the attachment of the fluorescent probe that would allow for the development of a reagentless sensing system for sulfate. Three different environment-sensitive fluorescent probes (1,5-IAEDANS, MDCC, and acylodan) were studied with the SBP171 mutant protein. A calibration curve for sulfate was constructed using the labeled protein and relating the change in the fluorescence intensity with the amount of sulfate present in the sample. The detection limit for sulfate was found to be in the submicromolar range using this system. The selectivity of the sensing system was demonstrated by evaluating its response to other anions. A fast and selective sensing system with detection limits for sulfate in the submicromolar range was developed. Copyright 2002 Wiley Periodicals, Inc. Biotechnol Bioeng 78: 517-526, 2002.

Evaluation Studies↗
NASA NTRS1995

Evaluation of nearest-neighbor methods for detection of chimeric small-subunit rRNA sequences

Detection of chimeric artifacts formed when PCR is used to retrieve naturally occurring small-subunit (SSU) rRNA sequences may rely on demonstrating that different sequence domains have different phylogenetic affiliations. We evaluated the CHECK_CHIMERA method of the Ribosomal Database Project and another method which we developed, both based on determining nearest neighbors of different sequence domains, for their ability to discern artificially generated SSU rRNA chimeras from authentic Ribosomal Database Project sequences. The reliability of both methods decreases when the parental sequences which contribute to chimera formation are more than 82 to 84% similar. Detection is also complicated by the occurrence of authentic SSU rRNA sequences that behave like chimeras. We developed a naive statistical test based on CHECK_CHIMERA output and used it to evaluate previously reported SSU rRNA chimeras. Application of this test also suggests that chimeras might be formed by retrieving SSU rRNAs as cDNA. The amount of uncertainty associated with nearest-neighbor analyses indicates that such tests alone are insufficient and that better methods are needed.

NASA Discipline Exobiology↗
NASA NTRS2015

Crew Transportation Technical Standards and Design Evaluation Criteria

Crew Transportation Technical Standards and Design Evaluation Criteria contains descriptions of technical, safety, and crew health medical processes and specifications, and the criteria which will be used to evaluate the acceptability of the Commercial Providers' proposed processes and specifications.

Design Evaluation Criteria↗
NASA NTRS2014

Temperature and Humidity Profiles in the TqJoint Data Group of AIRS Version 6 Product for the Climate Model Evaluation

The Atmospheric Infrared Sounder (AIRS) mission is entering its 13th year of global observations of the atmospheric state, including temperature and humidity profiles, outgoing long-wave radiation, cloud properties, and trace gases. Thus AIRS data have been widely used, among other things, for short-term climate research and observational component for model evaluation. One instance is the fifth phase of the Coupled Model Intercomparison Project (CMIP5) which uses AIRS version 5 data in the climate model evaluation. The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) is the home of processing, archiving, and distribution services for data from the AIRS mission. The GES DISC, in collaboration with the AIRS Project, released data from the version 6 algorithm in early 2013. The new algorithm represents a significant improvement over previous versions in terms of greater stability, yield, and quality of products. The ongoing Earth System Grid for next generation climate model research project, a collaborative effort of GES DISC and NASA JPL, will bring temperature and humidity profiles from AIRS version 6. The AIRS version 6 product adds a new "TqJoint" data group, which contains data for a common set of observations across water vapor and temperature at all atmospheric levels and is suitable for climate process studies. How different may the monthly temperature and humidity profiles in "TqJoint" group be from the "Standard" group where temperature and water vapor are not always valid at the same time? This study aims to answer the question by comprehensively comparing the temperature and humidity profiles from the "TqJoint" group and the "Standard" group. The comparison includes mean differences at different levels globally and over land and ocean. We are also working on examining the sampling differences between the "TqJoint" and "Standard" group using MERRA data.

climate model evaluation↗
NASA NTRS2018

ATD-2 Integrated Arrival/Departure/Surface (IADS) System Phase 1 Evaluations

This document provides an overview of the ATD-2 stakeholder and partner evaluations, also known as Shadow Sessions, held at Charlotte-Douglas International Airport (CLT) in preparation for and during the Phase 1 evaluation period from 9/30/2017 - 9/30/2018. All of the user engagement sessions are listed below, but only a few of the major ones are described in more detail in the rest of this document. This document is comprised of information extracted from the ATD-2 Confluence team collaboration archives.

shadow sessions↗