Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “evaluations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,027 records · Page 57
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Evaluating Northern Hemisphere Growing Season Net Carbon Flux in Climate Models Using Aircraft Observations

Understanding terrestrial ecosystems and their response to anthropogenic climate change requires quantification of land-atmosphere carbon exchange. However, top-down and bottom-up estimates of large-scale land-atmosphere fluxes, including the northern extratropical growing season net flux (GSNF), show significant discrepancies. We developed a data-driven metric for the GSNF using atmospheric carbon dioxide concentration observations collected during the High-Performance Instrumented Airborne Platform for Environmental Research Pole-to-Pole Observations and Atmospheric Tomography Mission flight campaigns. This aircraft-derived metric is bias-corrected using three independent atmospheric inversion systems. We estimate the northern extratropical GSNF to be 5.7 ± 0.3 Pg C and use it to evaluate net biosphere productivity from the Coupled Model Intercomparison Project phase 5 and 6 (CMIP5 and CMIP6) models. While the model-to-model spread in the GSNF has decreased in the CMIP6 models relative to that of the CMIP5 models, there is still disagreement on the magnitude and timing of seasonal carbon uptake with most models underestimating the GSNF and overestimating the length of the growing season relative to the observations. We also use an emergent constraint approach to estimate annual northern extratropical gross primary productivity to be 56 ± 17 Pg C, heterotrophic respiration to be 25 ± 13 Pg C, and net primary productivity to be 28 ± 12 Pg C. The flux inferred from these aircraft observations provides an additional constraint on large-scale gross fluxes in prognostic Earth system models that may ultimately improve our ability to accurately predict carbon-climate feedbacks.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Vibrational metrics for the evaluation of internal conditions in a scaled nuclear dry storage cask

In many countries, permanent repositories for high burnup spent nuclear fuel assemblies have yet to be established. As a result, much of the spent fuel from nuclear reactors is contained within dry storage casks, with many being beyond their designed service life. The assessment of the internal structural integrity of these casks and the fuel assemblies contained therein is of critical importance for both extended storage and transport to permanent repositories. The large size, structural complexity, and inaccessibility of the interior of the casks make this task challenging. To address these difficulties, a 1:6 scaled model based closely on the design of a Transnuclear (TN-32) dry storage cask was fabricated to facilitate controlled studies of these structures in the laboratory. Vibrational spectroscopy was used to evaluate the state of the cargo and internal structures within the cask utilizing only measurements on the outer surface. Using modes identified through Finite Element modeling corresponding to those previously measured on a full-scale TN-32 cask, we report on the development of amplitude- and phase-based metrics that are sensitive to internal conditions in the lab cask. Steel rod bundles and steel shot were used as surrogates for intact and damaged fuel assemblies, and various internal configurations of these materials were investigated. Finally, the metrics were based on acquired spectra involving the (1, 2) global bending mode and the (2, 1) radial-with-shearing mode. The results show that the metrics are sensitive to the condition of a single assembly and have some ability to determine the locations of damaged and empty slots.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

Impact of WELL certification on occupant satisfaction and perceived health, well-being, and productivity: A multi-office pre- versus post-occupancy evaluation

The WELL Building Standard (WELL) is currently one of the most comprehensive building certification programs that aim to enhance the health and well-being of building occupants. However, there is a lack of systematic evaluation of the effectiveness of WELL in achieving its goal. This study investigates the impact of WELL certification on occupant satisfaction with the workplace and occupant perceived health, well-being, and productivity. More than 1300 pre- and post-occupancy survey responses provided by the nearly same cohort of occupants from six companies in North America were quantitatively analyzed. The results showed that transitioning to WELL certified offices from non-WELL certified offices had a positive impact on occupant satisfaction with the workplace and occupant perceived health, well-being, and productivity, with increases in means from pre-to post-occupancy being highly statistically significant. The majority of the studied occupant satisfaction parameters as well as occupant perceived mental health had large effect sizes. While they improved from pre-to post-occupancy, the analysis revealed small effect sizes for occupant perceived physical health and self-assessed productivity. The majority of the effect sizes for the perceived well-being parameters were large and medium. In addition to analyzing the survey responses in aggregate, the responses were examined at the individual company level to confirm the by-company and aggregate findings aligned.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Evaluation of microstructural changes in fresh cement paste using AC impedance spectroscopy vs. oscillation rheology and 1H NMR relaxometry

AC impedance spectroscopy (ACIS) is a promising technique for monitoring the microstructure evolution of fresh cement paste in real-time. This paper compared the change of bulk electric resistivity (ρ{sub bulk}) obtained from ACIS with the developments of storage modulus (G′) and the mean transverse relaxation times (T{sub 2}) of fresh Portland cement pastes within 5 h. It was found that the three different phases (Phase I, II, and III) on the microstructural build-up process of fresh paste can be accurately distinguished by analyzing ρ{sub bulk}, as well as G′ and T{sub 2}. The use of ρ{sub bulk} fails to characterize the microstructural changes in Phase I due to the great sensitivity on the electrical conductivity of the interstitial solution. However, it can successfully reflect the developing features of microstructure in Phases II and III, and reliably evaluate the impacts of water to cement ratio, superplasticizer, and supplementary cementitious materials on the microstructural development.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Multi-site evaluation of stratified and balanced sampling of soil organic carbon stocks in agricultural fields

Estimating soil organic carbon (SOC) stocks in agricultural fields is essential for environmental and agronomic research, management, and policy. Stratified sampling is a classic strategy for estimating mean soil properties, and has recently been codified in SOC monitoring protocols. However, for the specific task of estimating the SOC stock of an agricultural field, concrete guidance is needed for which covariates to stratify on and how much stratification can improve estimation efficiency. It is also unknown how stratified sampling of SOC stocks compares to modern alternatives, notably doubly balanced sampling. To address these gaps, we collected high-density (average of 7 samples ha -1 ) and deep (average of 75 cm) measurements of SOC stocks at eight commercial fields under maize-soybean production in two US Midwestern states. We combined these measurements with a Bayesian geostatistical model to evaluate stratified and balanced sampling strategies that use a set of readily-available geographic, topographic, spectroscopic, and soil survey data. We examined the number of samples needed to achieve a given level of SOC stock estimation accuracy. While stratified sampling using these variables enables an average sample size reduction of 17% (95% CI, 11% to 23%) compared to simple random sampling, doubly balanced sampling is consistently more efficient, reducing sample sizes by 32% (95% CI, 25% to 37%). The data most important to these efficiency gains are a remotely-sensed SOC index, SSURGO estimates of SOC stocks, and the topographic wetness index. We conclude that in order to meet the urgent challenge of climate change, SOC stocks in agricultural fields could be more efficiently estimated by taking advantage of this readily-available data, especially with doubly balanced sampling.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Strategic Training in Transdisciplinary Radiation Science for the 21st Century (STARS21): 15-Year Evaluation of an Innovative Research Training Program

To evaluate the 15-year impact of a transdisciplinary research training program for graduate students, postdoctoral fellows, and clinical trainees focused on radiation science, entitled Strategic Training in Transdisciplinary Radiation Science for the 21st Century (STARS21) with a primary objective to build capacity in radiation research.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2022

Evaluation of Long-Term Outcomes and Toxicity After Stereotactic Phosphorus-32–Based Intracavitary Brachytherapy in Patients With Cystic Craniopharyngioma

Interstitial brachytherapy based on phosphorus-32 (P-32) has an established role as a minimally invasive treatment modality for patients with cystic craniopharyngioma. However, reporting on long-term outcomes with toxicity profiles for large cohorts is lacking in the literature. The purpose of this study is therefore to evaluate the long-term visual, endocrinal, and neurocognitive functions in what is the largest patient series having received this treatment to date.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2022

Utility of Circulating MicroRNA-150 for Rapid Evaluation of Bone Marrow Depletion After Radiation and Efficiency of Bone Marrow Reconstitution

Total body irradiation (TBI) is a common myeloablative preparative regimen used in acute myeloid and lymphoblastic leukemia patients before allogenic hematopoietic stem cell transplantation (HSCT). The inefficient clearance of tumor cells and radiation-induced toxicity to normal tissues is attributed to relapse and morbidity in a significant fraction of patients. Developing biomarkers that indicate an individual's physiological response to radiation will allow personalized treatment and follow-up. We investigated the utility of circulating microRNA150-5p (miR150) for evaluation of radiation dose response.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2021

SWAT model application for evaluating agricultural conservation practice effectiveness in reducing phosphorous loss from the Western Lake Erie Basin

Lake Erie is threatened by eutrophication and harmful algal blooms due to excess nutrient loading from agricultural sources. Agricultural conservation practices (ACPs) have been developed and implemented to reduce nutrient losses but estimating ACP effectiveness is challenging. The Soil and Water Assessment Tool (SWAT) has been used to investigate ACP effectiveness for water quality improvement. Many SWAT applications have been developed by different investigators to evaluate ACP effectiveness for reducing nutrient, particularly phosphorus (P), loading in the agriculturally-dominated Western Lake Erie Basin (WLEB). Our objective is to establish what has been achieved by past modeling research and make suggestions for future applications and improvements. We synthesized the findings of 28 SWAT modeling studies within the WLEB. Models generally performed satisfactorily against accepted criteria for streamflow and sediment, but performance for P loads, like soluble reactive P, was mostly “unsatisfactory”. The “unsatisfactory” performance maybe due to imperfections and idealizations in model formulations and/or parameterization. Thus, simulations of P transport and transformation processes need improvement. In addition, model parameter selection is the key part of model set-up. Most SWAT modeling studies used default values during initial set-up, then performed calibration and validation. It was found that the calibrated P related parameter values varied widely across different studies, even within the same watershed with some values unrealistic for the study areas. The phenomena of different combinations of model parameters producing similar outputs indicates equifinality. Equifinality in the baseline model may impact results when ACPs are incorporated. Furthermore, the unrealistic values used in ACP assessment undermine the credibility of ACP effectiveness. Future model applications should try to re-examine the calibrated P parameters and make sure they are realistic for the study area as well as reduce equifinality by constraining the model with characterization of watershed conditions, better understanding of hydrologic processes, and parameter values based on real-world observations. As a result, future model applications should focus on improving P transport and transformation processes, using measured watershed characteristics for parameterization, and improving reflections of climate change, which could result in more accurate assessments of ACP effectiveness to meet targeted goals.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Evaluation of distributed process-based hydrologic model performance using only a priori information to define model inputs

Fully distributed, integrated surface–subsurface hydrological models (ISSHMs) have seen renewed interest due to availability of better software, high performance computing facilities, and high-resolution, spatially extensive data products. ISSHMs are valuable as tools for advancing system understanding as they can resolve multiple processes defined on the plot scale including three-dimensional interaction of surface water and groundwater. Here, we evaluated the performance of an ISSHM, the Advanced Terrestrial Simulator (ATS), on seven diverse catchments across the continental US using widely available data products to define model inputs without calibration. We compare the ATS-simulated streamflow and evapotranspiration with gauge observations and MODIS-derived evapotranspiration, respectively. Using the Kling-Gupta Efficiency (KGE) as metric, ATS with default data products performed reasonably well at 6 of 7 catchments for streamflow. However, in one of those 6 catchments ATS had poor performance on baseflow and ATS’s overall performance was thus judged to be inadequate despite the acceptable KGE. ATS performance for evapotranspiration was good in all 7 catchments using default data products. In the two catchments where ATS streamflow performance using default data products was not acceptable, the performance was significantly improved by using local information on subsurface properties below the soil. We also compare the model-simulated streamflow and evapotranspiration with the Sacramento soil moisture accounting (SAC-SMA) model, a semi-distributed model that was calibrated on a catchment-by-catchment basis. Uncalibrated ATS performance is comparable to the calibrated SAC-SMA model in terms of streamflow while ATS performance is similar to or better (much better in certain catchments) in reproducing MODIS-derived evapotranspiration. Reasonably good performance of ATS without catchment-specific calibration provides new confidence in the ISSHM class of models and community data products as tools for advancing understanding of watershed function in a changing environment.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Diagnosing nuclear power plant pipe wall thinning due to flow accelerated corrosion using a passive, thermal non-destructive evaluation method: Feasibility assessment via numerical experiments

Flow accelerated corrosion (FAC) in nuclear power plant pipes is one of the leading causes of accidents, fatalities, damage and outages. Current FAC identification methods employ expensive sensing technology and are “active” methods, where the response of the piping system to an externally-generated thermal, mechanical or optical excitation must be measured. As a result, these techniques require a disruptive and time-consuming setup. Here we propose a method that utilizes pipe surface temperature measurements to passively monitor for FAC-induced pipe wall thinning without the need for expensive equipment or post-installation setup time. This diagnostic method utilizes a simulation data-driven diagnostic model to estimate the amount of thickness reduction in a pipe based on changes in measured steady-state pipe temperatures. In order to reduce the computational burden of generating large, simulation-based datasets, the behavior of the insulation of the pipe was modeled using a suitably calibrated heat transfer boundary parameter. Additionally, global sensitivity analysis was performed to determine system parameter(s), such as the temperature of water flowing inside the pipe, which significantly affect the steady state pipe wall temperature and could cause errors in diagnosis. Two diagnostic models, one using only the change in steady-state temperature as an indicator for FAC-induced pipe wall thinning and the other using water temperature as an additional diagnostic model input were evaluated for their ability to estimate thickness reductions in a pipe using simulated pipe wall temperature data. For the numerical experiments conducted in this work, both models estimated wall thickness with errors within 0.5 mm, indicating that the proposed technique can potentially be used as a low-cost, first-pass method for FAC monitoring.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2025

Non-destructive evaluation and machine learning methods for inspection of spent nuclear fuel canisters: A state-of-the-art review

Nuclear energy is among the cleanest and most efficient energy sources currently available. The operation of nuclear power plants (NPPs) produces large amounts of high-level radioactive waste known as spent nuclear fuel (SNF). Currently, large amounts of SNF is stored in dry cask storage systems (DCSSs) for extended interim storage until a permanent disposal solution becomes available. During the extended interim storage, the DCSS, particularly the SNF canisters, may degrade and abnormal conditions may occur. Therefore, non-destructive evaluation (NDE) and machine learning (ML) approaches are necessary for inspection of SNF canisters. This paper presents a state-of-the-art review of literature by summarizing recent progress made on the applications of NDE and ML for inspection of SNF canisters. Sixteen NDE methods are examined and compared: visual inspection, ultrasonic guided waves (UGWs), laser-based approaches, acoustic emission (AE), eddy current testing (ECT), non-invasive acoustic sensing, dynamic modal testing, cosmic ray muons tomography, neutron imaging, gamma rays detection, fiber optical sensors, through-wall communications, X-ray computed tomography (CT), vibrothermography, monoenergetic photon sources, and surface acoustic wave (SAW) sensors. The technology readiness level (TRL) for each method is assessed and compared. Recent publications on ML-enhanced visual inspection, AE, non-invasive acoustic sensing, dynamic modal testing, and neutron imaging for SNF canisters are summarized and future research needs are identified. In conclusion, this review article provides a convenient reference on the state-of-the-art applications of NDE and ML methods for inspection of SNF canisters.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2021

Autonomous nondestructive evaluation of resistance spot welded joints

The application of non-destructive evaluation approaches has attracted strong interests in modern automotive industries. Here, we present an autonomous deep-computing framework to analyze raw videos from infrared systems and to predict weld nugget shape and size with unprecedented accuracy and speed. In a comprehensive training and testing experiment with 90 videos (seven sets of welding material stack-ups), a new method was developed to assemble sufficient datasets for neural network training. Our framework successfully predicts all the nugget shapes with F1 scores that range from 0.84 to 0.92. The total training time on Nvidia DGX station takes less than 10 min for each set of welding material stack-up. The real inference time of an individual dataset (with 30 video frames) takes about 0.005 s. The procedure and methods developed in the study can be applied to other image-based weld property prediction, as well as other manufacturing processes. Furthermore, our well-trained neural networks take limited memory resources (2.3 MB) and are suitable for embedded microprocessors for in-situ welding quality control as edge computing within an intelligent welding framework.

42 ENGINEERING↗
DOE OSTI2026

Comprehensive assessment of metrology techniques for heliostat efficiency and performance evaluation

Concentrating solar power plants, specifically central receiver type systems and their heliostat field, are struggling with negative reputation in the USA, due to perceived underperformance and reliability issues. This is in part due to a lack of standards for performance assessment as well as overly simplified techno-economical models. A better understanding of influences and losses along the solar radiation path from the sun, across the solar collector to the receiver, increases the fidelity of heliostat efficiency assessment as well as solar field performance predictions. Such data are currently scarce and require a complete set of metrology capabilities to evaluate direct solar irradiance, sun shape, atmospheric attenuation, reflectance, collector shape, slope errors and total beam dispersion. In preparation for establishing a 3rd party metrology platform in collaboration with Sandia National Labs, NLR conducted a scoping study on available metrology. We present an extensive overview of techniques and commercial systems for each category. Our work includes an analysis to increase understanding of strengths and limitations of the many techniques used for surface shape and slope measurement. This applies to a controlled, indoor or outdoor laboratory environment assessing a single heliostat.

14 SOLAR ENERGY↗
DOE OSTI2021

An evaluation of electricity system technology competitiveness metrics: The case for profitability

In this work we develop standardized functional forms for electricity technology competitiveness metrics and show how the mathematical relationship between value and cost can affect the robustness of the metric. Here, we make the case to replace established metrics with economic profitability metrics – including a new profitability-based adjustment to LCOE. These profitability metrics are shown to be more robust for evaluating technology competitiveness by keeping comparisons on an equivalent monetary basis.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2023

The June 2012 North American Derecho: A Testbed for Evaluating Regional and Global Climate Modeling Systems at Cloud‐Resolving Scales

Abstract In this paper, we introduce a testbed for evaluating and comparing climate modeling systems at cloud resolving scales using hindcasts of the June 2012 North American derecho. To demonstrate its utility for model intercomparison, the testbed is applied to two models: the regionally‐refined Simple Cloud‐Resolving E3SM Atmosphere Model (SCREAM) at 6.5, 3.25 and 1.625 km grid spacing and the Weather Research and Forecasting (WRF) model with 3.2 and 1.6 km grid spacing. We find the simulation results to be highly sensitive to the initial conditions (ICs), initialization time, and model configurations, with ICs from the Rapid Refresh producing the best simulation. Significant improvement is identified in both models as horizontal grid spacing is refined. While a propagation delay of approximately 2 hr is found in both models, SCREAM at 1.625 km simulates the observed bow echo structure of the derecho well and predicts strong surface gusts that exceed 30 m/s. In comparison, WRF has difficulty producing surface wind over 25 m/s, with wind gusts in WRF 42%–46% lower than in SCREAM. However, WRF has a lower bias in simulating cloud top temperature and extent, but overestimates precipitation intensity. Both models reproduce the observed outgoing longwave radiation spatial patterns well (Pearson correlation >0.88), but, compared with NEXRAD observations, simulate generally larger areas of composite radar reflectivity >40 dBZ and underestimate the precipitating area by ∼47%.

2012 North American derecho↗
DOE OSTI2023

Evaluating the Representations of Atmospheric Rivers and Their Associated Precipitation in Reanalyses With Satellite Observations

Atmospheric rivers (ARs) are filaments of enhanced horizontal moisture transport in the atmosphere. Due to their prominent role in the meridional moisture transport and regional weather extremes, ARs have been studied extensively in recent years. Yet, the representations of ARs and their associated precipitation on a global scale remains largely unknown. In this study, we developed an AR detection algorithm specifically for satellite observations using moisture and the geostrophic winds derived from 3D geopotential height field from the combined retrievals of the Atmospheric Infrared Sounder and the Advanced Microwave Sounding Unit on NASA Aqua satellite. This algorithm enables us to develop the first global AR catalog based solely on satellite observations. The satellite–based AR catalog is then combined with the satellite–based precipitation (Integrated Muti–SatellitE Retrievals for GPM) to evaluate the representations of ARs and AR–induced precipitation in reanalysis products. Here our results show that the spreads in AR frequency and AR length distribution are generally small across data sets, while the spread in AR width is relatively larger. Reanalysis products are found to consistently underestimate both mean and extreme AR–related precipitation. However, all reanalyses tend to precipitate too often under AR conditions, especially over low latitude regions. This finding is consistent with the “drizzling” bias which has plagued generations of climate models. Overall, the findings of this study can help to improve the representations of ARs and associated precipitation in reanalyses and climate models.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Recommendations for Comprehensive and Independent Evaluation of Machine Learning‐Based Earth System Models

Abstract Machine learning (ML) is a revolutionary technology with demonstrable applications across multiple disciplines. Within the Earth science community, ML has been most visible for weather forecasting, producing forecasts that rival modern physics‐based models. Given the importance of deepening our understanding and improving predictions of the Earth system on all time scales, efforts are now underway to develop Earth‐system models (ESMs) capable of representing all components of the coupled Earth system (or their aggregated behavior) and their response to external changes over long timescales. Building trust in ESMs is a much more difficult problem than for weather forecast models, not least because the model must represent the alternate (e.g., future or paleoclimatic) coupled states of the system for which there are no direct observations. Given that the physical principles that enable predictions about the response of the Earth system are often not explicitly coded in these ML‐based models, demonstrating the credibility of ML‐based ESMs thus requires us to build evidence of their consistency with the physical system. To this end, this paper puts forward five recommendations to enhance comprehensive, standardized, and independent evaluation of ML‐based ESMs to strengthen their credibility and promote their wider use.

54 ENVIRONMENTAL SCIENCES↗