SEARCH · Engineering Papers

Results for “evaluations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 937 records · Page 52

All sources NASA NTRS DOE OSTI

DOE OSTI2021

Entropy Pair Functional Theory: Direct Entropy Evaluation Spanning Phase Transitions

We prove that, within the class of pair potential Hamiltonians, the excess entropy is a universal, temperature-independent functional of the density and pair correlation function. This result extends Henderson’s theorem, which states that the free energy is a temperature dependent functional of the density and pair correlation. The stationarity and concavity of the excess entropy functional are discussed and related to the Gibbs–Bugoliubov inequality and to the free energy. We apply the Kirkwood approximation, which is commonly used for fluids, to both fluids and solids. Approximate excess entropy functionals are developed and compared to results from thermodynamic integration. The pair functional approach gives the absolute entropy and free energy based on simulation output at a single temperature without thermodynamic integration. We argue that a functional of the type, which is strictly applicable to pair potentials, is also suitable for first principles calculation of free energies from Born–Oppenheimer molecular dynamics performed at a single temperature. In conclusion, this advancement has the potential to reduce the evaluation the free energy to a simple modification to any procedure that evaluates the energy and the pair correlation function.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

DOE OSTI2021

Voltage Regulation Performance Evaluation of Distributed Energy Resource Management via Advanced Hardware-in-the-Loop Simulation

This paper evaluates the performance of coordinated control across advanced distribution management systems (ADMS), distributed energy resources (DERs), and distributed energy resource management systems (DERMS) using an advanced hardware-in-the-loop (HIL) platform. This platform provides a realistic laboratory testing environment, including accurate dynamic modeling of a real-world distribution system from a utility partner, real controllers (ADMS and DERMS), physical power hardware (DERs), and standard communications protocols. One grid service—voltage regulation—is evaluated to show the performance of the coordinated grid automation system. The testing results demonstrate that the coordinated DERMS and ADMS system can effectively regulate system voltages within target operation limits using DERs. The realistic laboratory HIL testing results give utilities confidence in adopting the grid automation systems to manage DERs to achieve system-level control and operation objectives (e.g., voltage regulation). This helps utilities mitigate potential risks (e.g., instability) prior to field deployment.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2021

Evaluation of Electrodialysis Desalination Performance of Novel Bioinspired and Conventional Ion Exchange Membranes with Sodium Chloride Feed Solutions

Electrodialysis (ED) desalination performance of different conventional and laboratory-scale ion exchange membranes (IEMs) has been evaluated by many researchers, but most of these studies used their own sets of experimental parameters such as feed solution compositions and concentrations, superficial velocities of the process streams (diluate, concentrate, and electrode rinse), applied electrical voltages, and types of IEMs. Thus, direct comparison of ED desalination performance of different IEMs is virtually impossible. While the use of different conventional IEMs in ED has been reported, the use of bioinspired ion exchange membrane has not been reported yet. The goal of this study was to evaluate the ED desalination performance differences between novel laboratory‑scale bioinspired IEM and conventional IEMs by determining (i) limiting current density, (ii) current density, (iii) current efficiency, (iv) salinity reduction in diluate stream, (v) normalized specific energy consumption, and (vi) water flux by osmosis as a function of (a) initial concentration of NaCl feed solution (diluate and concentrate streams), (b) superficial velocity of feed solution, and (c) applied stack voltage per cell-pair of membranes. A laboratory‑scale single stage batch-recycle electrodialysis experimental apparatus was assembled with five cell‑pairs of IEMs with an active cross-sectional area of 7.84 cm2. In this study, seven combinations of IEMs (commercial and laboratory-made) were compared: (i) Neosepta AMX/CMX, (ii) PCA PCSA/PCSK, (iii) Fujifilm Type 1 AEM/CEM, (iv) SUEZ AR204SZRA/CR67HMR, (v) Ralex AMH-PES/CMH-PES, (vi) Neosepta AMX/Bare Polycarbonate membrane (Polycarb), and (vii) Neosepta AMX/Sandia novel bioinspired cation exchange membrane (SandiaCEM). ED desalination performance with the Sandia novel bioinspired cation exchange membrane (SandiaCEM) was found to be competitive with commercial Neosepta CMX cation exchange membrane.

42 ENGINEERING↗

DOE OSTI2023

Diagnostic Evaluation of the IS1081-Targeted Real-Time PCR for Detection of Mycobacterium bovis DNA in Bovine Milk Samples

The ability of Mycobacterium bovis (M. bovis) to survive in bovine milk has emerged as a serious public health concern. The first objective of this study was to evaluate the diagnostic utility of IS1081-targeted real-time PCR for the detection of M. bovis DNA in different fractions of bovine milk. In a model study, bovine milk samples were spiked with serially diluted M. bovis BCG to investigate the detection limit of M. bovis DNA in whole milk and milk fractions (cream, pellet, and pellet + cream combined) using IS1081 real-time PCR. The assay was then used to detect M. bovis DNA in whole milk and milk fractions from naturally infected animals. The results showed that the IS1081 real-time PCR was more sensitive when detecting M. bovis DNA in the cream layer alone and cream + pellet combined compared to whole milk or the pellet alone. While PCR-based diagnostic assays for the detection of M. bovis in milk samples provide a quicker diagnostic tool for bovine tuberculosis, safe processing, and handling of M. bovis-infected milk samples remain a challenge and pose a human health risk. PrimeStore Molecular Transport Medium (MTM) has been shown to rapidly inactivate infected specimens while preserving nucleic acid for subsequent Molecular analysis. Therefore, the secondary objective of this study was to evaluate the ability of MTM to inactivate M. bovis BCG in spiked milk samples as well as its ability to preserve BCG DNA for the PCR assay. The results showed that MTM can successfully inactivate BCG alone or in spiked milk samples while preserving DNA for the PCR assay. The CT values of M. bovis BCG alone and spiked milk samples aliquoted in MTM and without MTM were similar at various dilutions. Taken together, our results indicate that using DNA extracted from the milk cream fraction alone or combined milk cream and pellet improved the recovery rate of M. bovis DNA in bovine milk samples. MTM has the potential to provide a safe and rapid sample processing tool for M. bovis inactivation in milk samples and preserve DNA for molecular diagnostics.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2023

Evaluation of DNA Vaccine Candidates against Foot-and-Mouth Disease Virus in Cattle

We evaluated four DNA vaccine candidates for their ability to produce virus-like particles (VLPs) and elicit a protective immune response against Foot-and-mouth disease virus (FMDV) in cattle. Two traditional DNA plasmids and two DNA minicircle constructs were evaluated. Both the pTarget O1P1-3C plasmid and O1P1-3C minicircle encoded a wild-type FMDV 3C protease to process the P1-2A polypeptide, whereas the O1P1-HIV-3CT minicircle used an HIV-1 ribosomal frameshift to down-regulate expression of a mutant 3C protease. A modified pTarget plasmid with a reduced backbone size, mpTarget O1P1-3C LT , used a 3C protease containing two mutations reported to enhance expression. All constructs produced mature FMDV P1 cleavage products in transfected cells, as seen by western blot analysis. Three constructs, O1P1-3C minicircles, pTarget O1P1-3C, and mpTarget O1P1-3C LT plasmids, produced intracellular VLP crystalline arrays detected by electron microscopy. Despite VLP formation in vitro, none of the DNA vaccine candidates elicited protection from clinical disease when administered independently. Administration of pTarget O1P1-3C plasmid enhanced neutralizing antibody titers when used as a priming dose prior to administration of a conditionally licensed adenovirus-vectored FMD vaccine. Further work is needed to develop these DNA plasmid-based constructs into standalone FMD vaccines in cattle.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

DOE OSTI2026

FIREFLY: heat load and particle exhaust approximations for rapid evaluation of divertor designs

The divertor in a magnetic confinement fusion reactor is an essential component for power dissipation and particle removal. The FIREFLY package for rapid evaluation of divertor designs is presented as an extension of the FLARE code for field line reconstruction from a flux tube mesh. First, divertor loads are approximated with a simplified heat transport model. Neutralized particles are then sampled from the resulting load distribution, and the EIRENE code is used to track molecules and atoms in a plasma background while accounting for dissociation, charge exchange and ionization. Particles are removed on pumping surfaces in order to estimate the exhaust efficiency for a given divertor geometry. Optimization of the divertor geometry for more efficient particle exhaust is explored by using W7-X as an example, and the sensitivity to model parameters for the plasma background in the proxy calculations is evaluated.

mesh generation, magnetic field lines, scrape-off ↗

DOE OSTI2020

An evaluation of global organic aerosol schemes using airborne observations

Chemical transport models have historically struggled to accurately simulate the magnitude and variability of observed organic aerosol (OA), with previous studies demonstrating that models significantly underestimate observed concentrations in the troposphere. In this study, we explore two different model OA schemes within the standard GEOS-Chem chemical transport model and evaluate the simulations against a suite of 15 globally distributed airborne campaigns from 2008 to 2017, primarily in the spring and summer seasons. These include the ATom, KORUS-AQ, GoAmazon,FRAPPE, SEAC4RS, SENEX, DC3, CalNex, OP3, EUCAARI, ARCTAS and ARCPAC campaigns and provide broad coverage over a diverse set of atmospheric composition regimes – anthropogenic, biogenic, pyrogenic and remote. The schemes include significant differences in their treatment of the primary and secondary components of OA – a “simple scheme” that models primary OA (POA) as non-volatile and takes a fixed-yield approach to secondary OA (SOA) formation and a “complex scheme” that simulates POA as semi-volatile and uses a more sophisticated volatility basis set approach for non-isoprene SOA, with an explicit aqueous uptake mechanism to model isoprene SOA. Despite these substantial differences, both the simple and complex schemes perform comparably across the aggregate dataset in their ability to capture the observed variability (with an R2 of 0.41 and 0.44, respectively). The simple scheme displays greater skill in minimizing the overall model bias (with a normalized mean bias of 0.04 compared to 0.30 for the complex scheme). Across both schemes, the model skill in reproducing observed OA is superior to previous model evaluations and approaches the fidelity of the sulfate simulation within the GEOS-Chem model. However,there are significant differences in model performance across different chemical source regimes, classified here into seven categories.Higher-resolution nested regional simulations indicate that model resolution is an important factor in capturing variability in highly localized campaigns, while also demonstrating the importance of well-constrained emissions inventories and local meteorology, particularly over Asia. Our analysis suggests that a semi-volatile treatment of POA is superior to anon-volatile treatment. It is also likely that the complex scheme parameterization overestimates biogenic SOA at the global scale. While this study identifies factors within the SOA schemes that likely contribute to OA model bias (such as a strong dependency of the bias in the complex scheme on relative humidity and sulfate concentrations), comparisons with the skill of the sulfate aerosol scheme in GEOS-Chem indicate the importance of other drivers of bias, such as emissions, transport and deposition, that are exogenous to the OA chemical scheme.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2022

Evaluation of interactive and prescribed agricultural ammonia emissions for simulating atmospheric composition in CAM-chem

Abstract. Ammonia (NH3) plays a central role in the chemistry of inorganic secondary aerosols in the atmosphere. The largest emission sector for NH3 is agriculture, where NH3 is volatilized from livestock wastes and fertilized soils. Although the NH3 volatilization from soils is driven by the soil temperature and moisture, many atmospheric chemistry models prescribe the emission using yearly emission inventories and climatological seasonal variations. Here we evaluate an alternative approach where the NH3 emissions from agriculture are simulated interactively using the process model FANv2 (Flow of Agricultural Nitrogen, version 2) coupled to the Community Atmospheric Model with Chemistry (CAM-chem). We run a set of 6-year global simulations using the NH3 emission from FANv2 and three global emission inventories (EDGAR, CEDS and HTAP) and evaluate the model performance using a global set of multi-component (atmospheric NH3 and NH4+, and NH4+ wet deposition) in situ observations. Over East Asia, Europe and North America, the simulations with different emissions perform similarly when compared with the observed geographical patterns. The seasonal distributions of NH3 emissions differ between the inventories, and the comparison to observations suggests that both FANv2 and the inventories would benefit from more realistic timing of fertilizer applications. The largest differences between the simulations occur over data-scarce regions. In Africa, the emissions simulated by FANv2 are 200 %–300 % higher than in the inventories, and the available in situ observations from western and central Africa, as well as NH3 retrievals from the Infrared Atmospheric Sounding Interferometer (IASI) instrument, are consistent with the higher NH3 emissions as simulated by FANv2. Overall, in simulating ammonia and ammonium concentrations over regions with detailed regional emission inventories, the inventories based on these details (HTAP, CEDS) capture the atmospheric concentrations and their seasonal variability the best. However these inventories cannot capture the impact of meteorological variability on the emissions, nor can these inventories couple the emissions to the biogeochemical cycles and their changes with climate drivers. Finally, we show with sensitivity experiments that the simulated time-averaged nitrate concentration in air is sensitive to the temporal resolution of the NH3 emissions. Over the CASTNET monitoring network covering the US, resolving the NH3 emissions hourly instead monthly reduced the positive model bias from approximately 80 % to 60 % of the observed yearly mean nitrate concentration. This suggests that some of the commonly reported overestimation of aerosol nitrate over the US may be related to unresolved temporal variability in the NH3 emissions.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

A single-point modeling approach for the intercomparison and evaluation of ozone dry deposition across chemical transport models (Activity 2 of AQMEII4)

A primary sink of air pollutants and their precursors is dry deposition. Dry deposition estimates differ across chemical transport models, yet an understanding of the model spread is incomplete. Here, we introduce Activity 2 of the Air Quality Model Evaluation International Initiative Phase 4 (AQMEII4). We examine 18 dry deposition schemes from regional and global chemical transport models as well as standalone models used for impact assessments or process understanding. We configure the schemes as single-point models at eight Northern Hemisphere locations with observed ozone fluxes. Single-point models are driven by a common set of site-specific meteorological and environmental conditions. Five of eight sites have at least 3 years and up to 12 years of ozone fluxes. The interquartile range across models in multiyear mean ozone deposition velocities ranges from a factor of 1.2 to 1.9 annually across sites and tends to be highest during winter compared with summer. No model is within 50 % of observed multiyear averages across all sites and seasons, but some models perform well for some sites and seasons. For the first time, we demonstrate how contributions from depositional pathways vary across models. Models can disagree with respect to relative contributions from the pathways, even when they predict similar deposition velocities, or agree with respect to the relative contributions but predict different deposition velocities. Both stomatal and nonstomatal uptake contribute to the large model spread across sites. Our findings are the beginning of results from AQMEII4 Activity 2, which brings scientists who model air quality and dry deposition together with scientists who measure ozone fluxes to evaluate and improve dry deposition schemes in the chemical transport models used for research, planning, and regulatory purposes.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

Mid-Atlantic US observations of radiocarbon in CO 2 : fossil and biogenic source partitioning and model evaluation

Accurately quantifying regional anthropogenic CO 2 fluxes is fundamental to improving our understanding of the carbon cycle and for creating effective carbon mitigation policies, and the radiocarbon to total carbon ratio in atmospheric CO 2 (Δ 14 CO 2 ) is a robust tracer of fossil fuel CO 2 that can discriminate between biogenic and fossil fuel CO 2 sources. NASA's Atmospheric Carbon and Transport-America (ACT-America) airborne mission between 2016 and 2019 aimed to improve the accuracy of regional greenhouse gas flux estimates, through refining our understanding and characterization of fluxes and flux uncertainties in models. Δ 14 CO 2 observations from 26 flights are presented for examining seasonal CO 2 source partitioning in the Mid-Atlantic USA. Observed variability in boundary layer CO 2 at timescales ranging from intra-day to seasonal was largely driven by biogenic CO 2 (CO 2bio ) variability that ranged from −19.7 ppm in summer to 16.2 ppm in fall, while fossil fuel CO 2 (CO 2ff ) variability remained at 3.3±2.0 ppm. Carbonyl sulfide uptake was well-correlated with CO 2bio uptake, and examining this relationship, as well as that between CO 2 and CO 2bio variability reinforces the seasonal extent of gross primary productivity response throughout ACT-America. We use airborne Δ 14 CO 2 flask sampling alongside in situ carbon monoxide measurements to calculate high-frequency CO 2ff and evaluate the magnitude and diurnal variability of modeled CO 2ff , deducing likely transport errors in an example flight. Although ACT-America CO 2ff signals were attenuated due to the broad source regions sampled, results illustrate the value of Δ 14 CO 2 sampling and observation-based methodologies for regional CO 2 flux attribution, evaluation and improvement of modeled CO 2 .

Baier, Bianca C. [National Oceanic and Atmospheric↗

DOE OSTI2025

Warm-phase microphysical evolution in large-eddy simulations of tropical cumulus congestus: evaluating drop size distribution evolution using polarimetry retrievals, in situ measurements, and a thermal-based framework

Owing to uncertainties in convective microphysics processes, improving parameterizations in Earth system models (ESMs) can benefit from observationally constrained cases suitable for scaling between cloud-resolving models and ESMs. We propose a benchmark large-eddy simulation (LES) cumulus congestus case study from the NASA Cloud, Aerosol, and Monsoon Processes Philippines Experiment (CAMP 2 Ex) for evaluating and improving ESMs in single-column model (SCM) mode. We seek observational constraints using novel polarimetric retrievals and in situ cloud microphysics measurements. Simulations using bulk and bin microphysics initialized with observed aerosol profiles are compared to cloud-top retrievals of cloud droplet effective radius (R eff ), effective variance (ν eff ), and number concentration (N d ) from the airborne Research Scanning Polarimeter (RSP). Both schemes reproduce characteristics of cloud-top N d and R eff that increase and decrease with altitude, respectively. Cloud-top N d is low-biased relative to RSP retrievals in both schemes, potentially due to limitations in both simulations and retrieval assumptions. Cloud-top R eff is low-biased in the bulk scheme but reasonably reproduced by the bin scheme. Profiles of N d and R eff are sensitive to the collision–coalescence process and the vertical variation in aerosol size distribution. Comparison of simulated and in situ droplet size distributions (DSDs) shows that, to first order, integrated moments are always sensitive to sizes < ~ 30 µm and can also be sensitive to larger sizes if the DSDs are sufficiently broad, with implications for the assumed maximum observed size retrieved by the RSP. The bin scheme captures the observed extended tail of the DSD, while the bulk scheme is unable to due to parametric constraints. Differences in expected relationships between in situ measurements of cloud cores and cloud-top retrievals by RSP demonstrate difficulty in constraining well the case presented herein. Finally, a thermal-tracking framework demonstrates that the dilution of N d throughout a thermal's lifetime is heavily determined by collision–coalescence and the height-varying aerosol distribution and that, in the absence of these, the impact of entrainment on diluting N d is largely offset by secondary activation. Implications for evaluating warm-phase convective microphysics schemes in ESMs and translating results for use on global, space-based polarimetry platforms are discussed.

Stanford, McKenna Wallace [Columbia Univ., New Yor↗

DOE OSTI2019

Evaluation of ARM tethered-balloon system instrumentation for supercooled liquid water and distributed temperature sensing in mixed-phase Arctic clouds

A tethered-balloon system (TBS) has been developed and is being operated by Sandia National Laboratories (SNL) on behalf of the U.S. Department of Energy's (DOE) Atmospheric Radiation Measurement (ARM) User Facility in order to collect in situ atmospheric measurements within mixed-phase Arctic clouds. Periodic tethered-balloon flights have been conducted since 2015 within restricted airspace at ARM's Advanced Mobile Facility 3 (AMF3) in Oliktok Point, Alaska, as part of the AALCO (Aerial Assessment of Liquid in Clouds at Oliktok), ERASMUS (Evaluation of Routine Atmospheric Sounding Measurements using Unmanned Systems), and POPEYE (Profiling at Oliktok Point to Enhance YOPP Experiments) field campaigns. The tethered-balloon system uses helium-filled 34 m 3 helikites and 79 and 104 m 3 aerostats to suspend instrumentation that is used to measure aerosol particle size distributions, temperature, horizontal wind, pressure, relative humidity, turbulence, and cloud particle properties and to calibrate ground-based remote sensing instruments. Supercooled liquid water content (SLWC) sondes using the vibrating-wire principle, developed by Anasphere Inc., were operated at Oliktok Point at multiple altitudes on the TBS within mixed-hase clouds for over 200 h. Sonde-collected SLWC data were compared with liquid water content derived from a microwave radiometer, Ka-band ARM zenith radar, and ceilometer at the AMF3, as well as liquid water content derived from AMF3 radiosonde flights. The in situ data collected by the Anasphere sensors were also compared with data collected simultaneously by an alternative SLWC sensor developed at the University of Reading, UK; both vibrating-wire instruments were typically observed to shed their ice quickly upon exiting the cloud or reaching maximum ice loading. Temperature sensing measurements distributed with fiber optic tethered balloons were also compared with AMF3 radiosonde temperature measurements. Combined, the results indicate that TBS-distributed temperature sensing and supercooled liquid water measurements are in reasonably good agreement with remote sensing and radiosonde-based measurements of both properties. From these measurements and sensor evaluations, tethered-balloon flights are shown to offer an effective method of collecting data to inform and constrain numerical models, calibrate and validate remote sensing instruments, and characterize the flight environment of unmanned aircraft, circumventing the difficulties of in-cloud unmanned aircraft flights such as limited flight time and in-flight icing.

47 OTHER INSTRUMENTATION↗

DOE OSTI2022

Evaluating cloud liquid detection against Cloudnet using cloud radar Doppler spectra in a pre-trained artificial neural network

Detection of liquid-containing cloud layers in thick mixed-phase clouds or multi-layer cloud situations from ground-based remote-sensing instruments still poses observational challenges, yet improvements are crucial since the existence of multi-layer liquid layers in mixed-phase cloud situations influences cloud radiative effects, cloud lifetime, and precipitation formation processes. Hydrometeor target classifications such as from Cloudnet that require a lidar signal for the classification of liquid are limited to the maximum height of lidar signal penetration and thus often lead to underestimations of liquid-containing cloud layers. Here we evaluate the Cloudnet liquid detection against the approach of Luke et al. (2010) which extracts morphological features in cloud-penetrating cloud radar Doppler spectra measurements in an artificial neural network (ANN) approach to classify liquid beyond full lidar signal attenuation based on the simulation of the two lidar parameters particle backscatter coefficient and particle depolarization ratio. We show that the ANN of Luke et al. (2010) which was trained under Arctic conditions can successfully be applied to observations at the mid-latitudes obtained during the 7-week-long ACCEPT field experiment in Cabauw, the Netherlands, in 2014. In a sensitivity study covering the whole duration of the ACCEPT campaign, different liquid-detection thresholds for ANN-predicted lidar variables are applied and evaluated against the Cloudnet target classification. Independent validation of the liquid mask from the standard Cloudnet target classification against the ANN-based technique is realized by comparisons to observations of microwave radiometer liquid-water path, ceilometer liquid-layer base altitude, and radiosonde relative humidity. In addition, a case-study comparison against the cloud feature mask detected by the space-borne lidar aboard the CALIPSO satellite is presented. Three conclusions were drawn from the investigation. First, it was found that the threshold selection criteria of liquid-related lidar backscatter and depolarization alone control the liquid detection considerably. Second, all threshold values used in the ANN framework were found to outperform the Cloudnet target classification for deep or multi-layer cloud situations where the lidar signal is fully attenuated within low liquid layers and the cloud radar is able to detect the microphysical fingerprint of liquid in higher cloud layers. Third, if lidar data are available, Cloudnet is at least as good as the ANN. The times when Cloudnet outperforms the ANN in liquid detections are often associated with situations where cloud dynamics smear the imprint of cloud microphysics on the radar Doppler spectra.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Shortwave Array Spectroradiometer-Hemispheric (SAS-He): design and evaluation

A novel ground-based radiometer, referred to as the Shortwave Array Spectroradiometer-Hemispheric (SAS-He), is introduced. This radiometer uses the shadow-band technique to report total irradiance and its direct and diffuse components frequently (every 30 s) with continuous spectral coverage (350–1700 nm) and moderate spectral (~2.5 nm ultraviolet–visible and ~6 nm shortwave-infrared) resolution. The SAS-He's performance is evaluated using integrated datasets collected over coastal regions during three field campaigns supported by the US Department of Energy's Atmospheric Radiation Measurement (ARM) program, namely the (1) Two-Column Aerosol Project (TCAP; Cape Cod, Massachusetts), (2) Tracking Aerosol Convection Interactions Experiment (TRACER; in and around Houston, Texas), and (3) Eastern Pacific Cloud Aerosol Precipitation Experiment (EPCAPE; La Jolla, California). We compare (i) aerosol optical depth (AOD) and total optical depth (TOD) derived from the direct irradiance, as well as (ii) the diffuse irradiance and direct-to-diffuse ratio (DDR) calculated from two components of the total irradiance. As part of the evaluation, both AOD and TOD derived from the SAS-He direct irradiance are compared to those provided by a collocated Cimel sunphotometer (CSPHOT) at five (380, 440, 500, 675, 870 nm) and two (1020, 1640 nm) wavelengths, respectively. Additionally, the SAS-He diffuse irradiance and DDR are contrasted with their counterparts offered by a collocated multifilter rotating shadowband radiometer (MFRSR) at six (415, 500, 615, 675, 870, 1625 nm) wavelengths. Overall, reasonable agreement is demonstrated between the compared products despite the challenging observational conditions associated with varying aerosol loadings and diverse types of aerosols and clouds. For example, the AOD- and TOD-related values of root mean square error remain within 0.021 at 380, 440, 500, 675, 870, 1020, and 1640 nm wavelengths during the three field campaigns.

47 OTHER INSTRUMENTATION↗

DOE OSTI2024

A globally sampled high-resolution hand-labeled validation dataset for evaluating surface water extent maps

Effective monitoring of global water resources is increasingly critical due to climate change and population growth. Advancements in remote sensing technology, specifically in spatial, spectral, and temporal resolutions, are revolutionizing water resource monitoring, leading to more frequent and high-quality surface water extent maps using various techniques such as traditional image processing and machine learning algorithms. However, satellite imagery datasets contain trade-offs that result in inconsistencies in performance, such as disparities in measurement principles between optical (e.g., Sentinel-2) and radar (e.g., Sentinel-1) sensors and differences in spatial and spectral resolutions among optical sensors. Therefore, developing accurate and robust surface water mapping solutions requires independent validations from multiple datasets to identify potential biases within the imagery and algorithms. However, high-quality validation datasets are expensive to build, and few contain information on water resources. For this purpose, we introduce a globally sampled, high-spatial-resolution dataset labeled using 3 m PlanetScope imagery. Our surface water extent dataset comprises 100 images, each with a size of 1024×1024 pixels, which were sampled using a stratified random sampling strategy covering all 14 biomes. We highlighted urban and rural regions, lakes, and rivers, including braided rivers and coastal regions. We evaluated two surface water extent mapping methods using our dataset – Dynamic World, based on Sentinel-2, and the NASA IMPACT model, based on Sentinel-1. Dynamic World achieved a mean intersection over union (IoU) of 72.16 % and F1 score of 79.70 %, while the NASA IMPACT model had a mean IoU of 57.61 % and F1 score of 65.79 %. Performance varied substantially across biomes, highlighting the importance of evaluating models on diverse landscapes to assess their generalizability and robustness. Our dataset can be used to analyze satellite products and methods, providing insights into their advantages and drawbacks. Our dataset offers a unique tool for analyzing satellite products, aiding the development of more accurate and robust surface water monitoring solutions. The dataset can be accessed via https://doi.org/10.25739/03nt-4f29.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Evaluating integrated surface/subsurface permafrost thermal hydrology models in ATS (v0.88) against observations from a polygonal tundra site

Numerical simulations are essential tools for understanding the complex hydrologic response of Arctic regions to a warming climate. However, strong coupling among thermal and hydrological processes on the surface and in the subsurface and the significant role that subtle variations in surface topography have in regulating flow direction and surface storage lead to significant uncertainties. Careful model evaluation against field observations is thus important to build confidence.We evaluate the integrated surface/subsurface permafrost thermal hydrology models in the Advanced Terrestrial Simulator (ATS) against field observations from polygonal tundra at the Barrow Environmental Observatory. ATS couples a multiphase, 3D representation of subsurface thermal hydrology with representations of overland nonisothermal flows, snow processes, and surface energy balance. We simulated thermal hydrology of a 3D ice-wedge polygon with geometry that is abstracted but broadly consistent with the surface microtopography at our study site. The simulations were forced by meteorological data and observed water table elevations in ice-wedge polygon troughs. With limited calibration of parameters appearing in the soil evaporation model, the 3-year simulations agreed reasonably well with snow depth, summer water table elevations in the polygon center, and high-frequency soil temperature measurements at several depths in the trough, rim, and center of the polygon. Upscaled evaporation is in good agreement with flux tower observations. The simulations were found to be sensitive to parameters in the bare soil evaporation model, snowpack, and the lateral saturated hydraulic conductivity.Timing of fall freeze-up was found to be sensitive to initial snow density, illustrating the importance of including snow aging effects. The study provides new support for an emerging class of integrated surface/subsurface permafrost simulators.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Reduced Complexity Model Intercomparison Project Phase 1: introduction and evaluation of global-mean temperature response

Reduced-complexity climate models (RCMs) are critical in the policy and decision making space, and are directly used within multiple Intergovernmental Panel on Climate Change (IPCC) reports to complement the results of more comprehensive Earth system models. To date, evaluation of RCMs has been limited to a few independent studies. Here we introduce a systematic evaluation of RCMs in the form of the Reduced Complexity Model Intercomparison Project (RCMIP). We expect RCMIP will extend over multiple phases, with Phase 1 being the first. In Phase 1, we focus on the RCMs' global-mean temperature responses, comparing them to observations, exploring the extent to which they emulate more complex models and considering how the relationship between temperature and cumulative emissions of CO2 varies across the RCMs. Our work uses experiments which mirror those found in the Coupled Model Intercomparison Project (CMIP), which focuses on complex Earth system and atmosphere–ocean general circulation models. Using both scenario-based and idealised experiments, we examine RCMs' global-mean temperature response under a range of forcings. We find that the RCMs can all reproduce the approximately 1°C of warming since pre-industrial times, with varying representations of natural variability, volcanic eruptions and aerosols. We also find that RCMs can emulate the global-mean temperature response of CMIP models to within a root-mean-square error of 0.2°C over a range of experiments. Furthermore, we find that, for the Representative Concentration Pathway (RCP) and Shared Socioeconomic Pathway (SSP)-based scenario pairs that share the same IPCC Fifth Assessment Report (AR5)-consistent stratospheric-adjusted radiative forcing, the RCMs indicate higher effective radiative forcings for the SSP-based scenarios and correspondingly higher temperatures when run with the same climate settings. In our idealised setup of RCMs with a climate sensitivity of 3°C, the difference for the ssp585–rcp85 pair by 2100 is around 0.23°C(±0.12°C) due to a difference in effective radiative forcings between the two scenarios. Phase 1 demonstrates the utility of RCMIP's open-source infrastructure, paving the way for further phases of RCMIP to build on the research presented here and deepen our understanding of RCMs.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

A multi-year short-range hindcast experiment with CESM1 for evaluating climate model moist processes from diurnal to interannual timescales

Abstract. We present a multi-year short-range hindcast experiment and its experimental design for better evaluation of both the mean state and variability of atmospheric moist processes in climate models from diurnal to interannual timescales and facilitate model development. We used the Community Earth System Model version 1 as the base model and performed a suite of 3 d hindcasts initialized every day starting at 00:00 Z from 1997 to 2012. Three processes – the diurnal cycle of clouds during different cloud regimes over the central US, precipitation and diabatic heating associated with the Madden–Julian Oscillation (MJO), and the response of precipitation, surface radiative and heat fluxes, as well as zonal wind stress to sea surface temperature anomalies associated with the El Niño–Southern Oscillation – are evaluated as examples to demonstrate how one can better utilize simulations from this experiment to gain insights into model errors and their connection to physical parameterizations or large-scale state. This is achieved by comparing the hindcasts with corresponding long-term observations for periods based on different phenomena. These analyses can only be done through this multi-year hindcast approach to establish robust statistics of the processes under well-controlled large-scale environment because these phenomena are either a result of interannual climate variability or only happen a few times in a given year (e.g., MJO, or cloud regime types). Furthermore, comparison of hindcasts to the typical simulations in climate mode with the same model allows one to infer what portion of a model's climate error directly comes from fast errors in the parameterizations of moist processes. As demonstrated here, model biases in the mean state and variability associated with parameterized moist processes usually develop within a few days and manifest within weeks to affect the simulations of large-scale circulation and ultimately the climate mean state and variability. Therefore, model developers can achieve additional useful understanding of the underlying problems in model physics by conducting a multi-year hindcast experiment.

54 ENVIRONMENTAL SCIENCES↗