Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49

Slag Management of Carbon Feedstock Used in Gasification FY17 TCF between Eastman Chemical and NETL (Final Report)

NETL, in collaboration with Eastman Chemical Corp (Kingsport, TN), targeted the joint evaluation and refinement of a slag management program developed by NETL (NETL IP, patent applied for) to control gasifier slag properties formed from ash in individual or combinations of different coal-based carbon feedstock materials and specific slag modifiers used in gasification. Slag forms from mineral or organic-metallic impurities in the carbon feedstock that melt at the high temperatures of gasification, coalescing to form a liquid (slag) that must flow from the gasifier. Slag additives, also known as slag modifiers, are often added to the carbon feedstock to modify the ash chemistry and achieve desired slag flow properties at target temperatures used in gasification. If slag does not flow from a gasifier, its buildup within the gasification chamber will cause either gasifier shutdown to physically remove the slag (consuming time and damaging the protective refractory lining), or the gasification temperature must be increased to lower slag viscosity so it can flow from the gasifier, leading to greater refractory wear/corrosion, along with increased fouling and downstream component wear. Because of these issues, gasification is typically targeted at the lowest temperature possible where slag will flow in a controlled manner (a temperature range called T100 for the lowest temperature, with T250 being the highest temperature where the slag has achieved the desired fluidity). That temperature range also needs to yield a desired syngas composition, highlighting the importance of knowing and being able to control carbon feedstock slag viscosity and the temperature of thermal breakdown of the carbon feedstock. Slag viscosity varies with changes in the gasification chamber temperature, oxygen partial pressure, and slag chemistry. The slag model work with Eastman Chemical targeted predicting and controlling molten coal ash slag behavior at specific gasification conditions. The final goal of the refined model was to develop/refine the NETL slag model so a gasifier operator would be able to predict slag behavior prior to purchasing or using a carbon feedstock and control slag properties once a carbon feedstock is being gasified, allowing a gasifier user to determine what mineral additives or blends of different carbon materials would be needed to achieve desired slag properties at targeted gasification conditions. For a given carbon feedstock and desired gasification condition, the actual gasification cost and slag behavior would be able to be predicted using the slag management program in advance of purchasing or using the carbon feedstock – allowing accurate control of slag ash behavior in real time. As part of the TCF project work with Eastman Chemical, the viscosity of several ash compositions of interest to them would be measured and used to populate the slag model, along with a large database of historical slag temperature, chemistry, and viscosity information they possess – information that would in-crease the predictive accuracy of the slag management model with slag ash chemistry of interest to them. As part of the model evaluation and refinement, the predictive model and its database will be installed on computers at Eastman Chemical and used to manage slag properties in a gasifier during real-time operation of their gasifier. In summary, success of the slag management program at Eastman Chemical would support its use by other gasifier operators to manage slag chemistry and properties over other desired gasification temperature ranges, allowing greater process control and efficiency of their carbon feedstock conversion during gasification.

01 COAL, LIGNITE, AND PEAT↗

Evaluation of Full Reynolds Stress Turbulence Models in FUN3D

Full seven-equation Reynolds stress turbulence models are a relatively new and promising tool for todays aerospace technology challenges. This paper uses two stress-omega full Reynolds stress models to evaluate challenging flows including shock-wave boundary layer interactions, separation and mixing layers. The Wilcox and the SSGLRR full second-moment Reynolds stress models are evaluated for four problems: a transonic two-dimensional diffuser, a supersonic axisymmetric compression corner, a compressible planar shear layer, and a subsonic axisymmetric jet. Simulation results are compared with experimental data and results using the more commonly used Spalart-Allmaras (SA) one-equation and the Menter Shear Stress Transport (SST) two-equation models.

computational fluid dynamics↗

2D reactive transport model of shale chemical weathering and biogeochemical fluxes along a mountainous hillslope, East River Watershed, Colorado: Input files and simulation results

This data package contains input files and simulation results for a two-dimensional (2D) reactive transport model used to quantitatively analyze the coupled hydrological and biogeochemical processes governing shale weathering and associated biogeochemical fluxes under realistic environmental conditions in the high-elevation East River Watershed. These data support the conclusions presented in Stolze et al. (Water Resources Research, under review), "Model-based interpretation of solute exports and carbon partitioning during shale weathering in a mountainous hillslope". The model simulates atmospheric-subsurface gas exchange, subsurface water flow, and shale weathering processes under dynamic, year-scale conditions along a shale-underlain hillslope located in the East River watershed. The simulations were performed using the PFLOTRAN flow and reactive transport code and executed on the Perlmutter supercomputer to leverage its large-scale parallel computing capabilities. The data package contains two zipped folders, "model_input_files" and "simulation_results", and one readme.txt file. "model_input_files" contains the necessary input files to run the calibrated base-base model presented in Stolze et al. (Water Resources Research, under review). "simulation_results" contains a single hdf5 file ("Output_2D_hillslope_model.h5") which includes the results of simulation performed using the base-case model. This file can be opened with HDFView 3.1.4, Python, or MATLAB. "readme.txt" contains relevant information about the base-case model and provides guidelines on how to run the associated input files provided in the folder "model_input_files". Furthermore, readme.txt provides information regarding the model results provided in "Output_2D_hillslope_model.h5" such as matrix dimensionality and output units. Field datasets used to evaluate model performance were collected at three monitoring wells located along a hillslope transect (PLM1, PLM2, and PLM3). Dissolved ion concentration data were collected from November 2016 to October 2021 for Ca, Mg, DIC, Na, K, SO4 (Dong et al., 2025 - dic_npoc_data_2014_2024.zip - DOI:10.15485/1660459; Williams et al., 2025 - anion_data_2014_2024.zip - DOI:10.15485/1668054; Dong et al., 2025 - cation_data_2014_2024.zip - DOI:10.15485/1668055). Note that we used the files named er_PLM1_xx_yy, er_PLM2_xx_yy, and er_PLM3_xx_yy where xx stands for the name of the aqueous species and yy stands for the depth where the measurements were performed. Soil water content ([0 - 1] m) and water table depth were collected from November 2016 to October 2021 (Wan et al., 2024 - Dynamic_water_table__depthsFig2b.csv and Soil_water_content_Fig4e.csv - DOI:10.15485/2322567). Gaseous CO2 concentration were collected from October 2020 to December 2021(Wan et al., 2024 - Soil_CO2_concentrations_Fig4h.csv - DOI:10.15485/2322567) Gaseous CO2 flux from the subsurface to the atmosphere were collected in the vicinity of PLM2 from October 2019 to May 2022 (Wu et al., 2025). Soil microbial biomass concentration was measured from August 2016 to June 2017 (Sorensen et al., 2019 - 2017_East_River_Pumphouse_Microbial_Biomass__1_.csv - DOI:10.15485/1577267) All field data are published as CSV files compatible with Microsoft Excel, MATLAB, and Python, or as text files. The coordinates of the monitoring wells and the CO2(g) flux sensor in the coordinate system WGS84 are: -PLM1: [38.9197710 ; -106.9492750] -PLM2: [38.9201580 ; -106.9487170] -PLM3: [38.9207843 ; -106.9483668] -PLM4: 38.9210060 ; -106.9479528] -CO2(g) flux sensor: [38.9199180 ; -106.9489906] ------------------------------------------------------------------------------------------- This work was supported by the Watershed Function Science Focus Area at Lawrence Berkeley National Laboratory funded by the US Department of Energy, Office of Science, Biological and Environmental Research under Contract No. DE-AC02-05CH11231. This research used resources of the National Energy Research Scientific Computing Center (NERSC), a Department of Energy User Facility using NERSC award BER-ERCAP 23980, BER-ERCAP 28550, and BER-ERCAP 33789.

54 ENVIRONMENTAL SCIENCES↗

Fluoride-Cooled High-Temperature Pebble-Bed Reactor Reference Plant Model Updates

This work presents the latest improvements to, and investigations performed with, the Fluoride-Cooled High-Temperature Pebble-Bed Reactor reference plant models for the United States Nuclear Regulatory Commission. These models, developed with the Comprehensive Reactor Analysis Bundle, or BlueCRAB, serve as the foundation for the future development of detailed design evaluation models based on license applications. BlueCRAB is the code suite proposed for non-light-water reactor systems safety analyses, and it incorporates various simulation tools developed by the Nuclear Energy Advance Modeling and Simulation program, including the Griffin code for reactor physics, the Pronghorn and SAM codes for core thermal fluids, the BISON code for solid conduction and fuel performance, and the SAM code for system analysis. The primary objective of this work is to assess the level of readiness of BlueCRAB for modeling fluoride-cooled high-temperature pebble-bed reactors. We first developed numerical models in BlueCRAB that include the key physics for this technology, ensuring an adequate level of fidelity for modeling the core performance during accident scenarios. This was followed by simulation of transient scenarios, two loss-of-forced-cooling events (one protected and one unprotected), and two control rod withdrawal events (one delayed and one prompt supercritical reactivity insertion). The analysis includes comparisons between the 2-D thermal fluid porous media models in Pronghorn and SAM, comparisons between coupled Pronghorn-Griffin and coupled SAM-Griffin models for two loss-of-forced cooling events and one control rod withdrawal event, and comparisons between SAM single-solve and domain-overlapping approaches for multi-scale thermal fluid coupling. In addition, we performed comparisons between 3-D, 2-D, and 0-D neutronic models for the two control rod withdrawal scenarios with Pronghorn-Griffin. The results show that the BlueCRAB models led to physically intuitive solutions for the scenarios examined. The changes in the various scalar and vector fields such as the neutron flux, power, temperatures, densities, pressures, and velocities are all within the expected ranges, and their distributions can be explained from the system response of the transients and the geometric and material variations. Several comparisons suggest that the porous media models in Pronghorn and SAM can lead to similar solutions, even though they are based on different methodologies. The simulations demonstrate that there are differences between the various levels of fidelity, and it is advisable to have flexible tools that can cover the breadth and depth of needs that may arise in future technical evaluations. We believe that BlueCRAB’s capabilities represent a significant asset for confirmatory analyses aimed at resolving important safety questions.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Evaluation of interfacial area transport models for horizontal bubbly flow

This paper presents evaluation results of interfacial area transport equation (IATE) for horizontal air-water bubbly flow. The steady-state one-dimensional, one-group IATE for adiabatic air-water bubbly flow developed by Talley [1] is employed in the current evaluation study. The models evaluated include: (a) drift-flux-based closure relations for void-weighted bubble velocity and void fraction; (b) frictional pressure drop model based on the Lockhart-Martinelli approach; (c) bubble interaction mechanisms; and (d) covariance associated with asymmetric bubble distribution in horizontal two-phase flow. In order to evaluate the models, a local two-phase flow database obtained by the four-sensor conductivity probe in fourteen different test conditions is employed, which covers a wide range of flow conditions in horizontal bubbly flow regime, with superficial liquid and gas velocities ranging from 3.50-6.00 m/s and 0.09- 1.00 m/s, respectively. It is demonstrated that both the void weighted bubble velocity and void fraction are predicted well with an average percent difference of ±2.7%. The fictional pressure loss can be predicted with an average percent difference of ±1.12%. The covariance parameters calculated from the modeling approach generally compare well with those calculated from experimental data within ±20% difference. It is found that the IATE generally predicts the measured interfacial area concentration with an average percent difference of ±5.7%. Furthermore, the effect of liquid velocity on individual bubble interaction mechanisms is investigated. It is found that both the contributions of random collision and turbulent impact decrease as liquid velocity decreases. (authors)

42 ENGINEERING↗

Discerning Deception: An Empirically-Driven Agent-Based Model of Expert Evaluation of Scientific Content

Both human subject experiments and computational, modeling and simulations have been used to study detection of deception. This work aims to combine these two methods by integrating empirically-derived information (from human subject experiments) into agent-based models to generate novel insights into the complex problems of detection of disinformation content. Computational experiments are used to simulate across multiple scenarios for evaluation and decision-making regarding the validity of potentially deceptive scientific documents. Factors influencing the human agent behaviors in the model were identified through a human subject experiment that was conducted to evaluate and characterize decision making related to disinformation discernment. Correlation and regression analyses were used to translate insights from the human subjects experiment to inform the parameterization of agent features and scenario development. Three scenarios were evaluated with the agent-based models to help evaluate the replicability of the simulations (validation analysis) and assess the influence of human agent and document features (sensitivity analyses). A replication of the human participant experiment demonstrated that the agent-based simulations compare favorably to empirical findings. The agent-based modeling was then used to conduct sensitivity analysis on the accuracy of deception detection as a function of document proportions and human agent features. Results indicate that precision values are adversely impacted when the proportion of deceptive documents is lower in the overall sample, whereas recall values are more sensitive to changes in human agent features. These findings indicate important nuances in accuracy evaluations that should be further considered (including consideration of potential alternate metrics) in future agent-based models of disinformation. Additional areas for future exploration include extension of simulations to consider other ways to align the agent-based model design with psychological theory and inclusion of agent-agent interactions, especially as it pertains to sharing of scientific information within an organizational context.

99 GENERAL AND MISCELLANEOUS↗

Projected increase of the East Asian summer monsoon ( Meiyu ) in Taiwan by climate models with variable performance

Abstract The active phase of the East Asian summer monsoon (EASM) in Taiwan during May and June, known as Meiyu , produces substantial precipitation for water uses in all sectors of society. Following a companion study that analysed the historical increase in the Meiyu precipitation, the present study conducted model evaluation and diagnosis based on the EASM lifecycle over Taiwan. Higher and lower skill groups were identified from 17 Couple Model Intercomparison Project Phase 5 (CMIP5) models, with five models in each group. Despite the difference in model performance, both groups projected a substantial increase in the Meiyu precipitation over Taiwan. In the higher skill group, weak circulation changes and reduced low‐level convergence point to a synoptically unfavourable condition for precipitation. In the lower skill group, intensified low‐level southwesterly winds associated with a deepened upper level trough enhance moisture pooling. Thus, the projected increase in Meiyu precipitation will likely occur through the combined effects of (1) the extension of a strengthened North Pacific anticyclone enhancing southwesterlies; and (2) more systematically, the Clausius–Clapeyron relationship that increases precipitation intensity in a warmer climate. The overall increase in the Meiyu precipitation projected by climate models of variable performance supports the observed tendency toward more intense rainfall in Taiwan and puts its early June 2017 extreme precipitation events into perspective.

Tung, Yu‐Shiang↗

Integrating State Data Assimilation and Innovative Model Parameterization Reduces Simulated Carbon Uptake in the Arctic and Boreal Region

Model representation of carbon uptake and storage is essential for accurate projection of the response of the arctic-boreal zone to a rapidly changing climate. Land model estimates of LAI and aboveground biomass that can have a marked influence on model projections of carbon uptake and storage vary substantially in the arctic and boreal zone, making it challenging to correctly evaluate model estimates of Gross Primary Productivity (GPP). To understand and correct bias of LAI and aboveground biomass in the Community Land Model (CLM), we assimilated the 8-day Moderate Resolution Imaging Spectroradiometer (MODIS) LAI observation and a machine learning product of annual aboveground biomass into CLM using an Ensemble Adjustment Kalman Filter (EAKF) in an experimental region including Alaska and Western Canada. Assimilating LAI and aboveground biomass reduced these model estimates by 58% and 72%, respectively. The change of aboveground biomass was consistent with independent estimates of canopy top height at both regional and site levels. The International Land Model Benchmarking system assessment showed that data assimilation significantly improved CLM's performance in simulating the carbon and hydrological cycles, as well as in representing the functional relationships between LAI and other variables. Here, to further reduce the remaining bias in GPP after LAI bias correction, we re-parameterized CLM to account for low temperature suppression of photosynthesis. The LAI bias corrected model that included the new parameterization showed the best agreement with model benchmarks. Combining data assimilation with model parameterization provides a useful framework to assess photosynthetic processes in LSMs.

58 GEOSCIENCES↗

Bimodality in simulated precipitation frequency distributions and its relationship with convective parameterizations

Abstract Bimodality in precipitation frequency distributions is often evident in atmospheric models, but rarely in observations. This study i) proposes a metric to objectively quantify the bimodality in precipitation distributions, ii) evaluates model simulations contributed to the Coupled Model Intercomparison Project (CMIP) phase 5 (CMIP5), phase 6 (CMIP6), and the DYnamics of the Atmospheric general circulation Modeled On Non-hydrostatic Domains (DYAMOND) project by comparing them to satellite-based and reanalysis precipitation products, and iii) investigates possible origins of bimodal precipitation distributions. Our results reveal that about 83% (20 out of 24) of CMIP5 and 70% (21 out of 30) of CMIP6 models used in this study exhibit bimodal distributions. The few DYAMOND models that use a deep convective parameterization also show bimodal distributions, while most DYAMOND models do not. Predictably, the bimodality originates from the separation of precipitation process between resolved grid-scale and parameterized subgrid-scale. However, in a larger number of models bimodality arises from the parameterized subgrid-scale convective precipitation alone.

54 ENVIRONMENTAL SCIENCES↗

Poster — Thur Eve — 37: Respiratory gating with an Elekta flattening filter free photon beam

In cases where surgery is not possible for lung cancer treatment, stereotactic body radiation therapy (SBRT) may be an option. One problem when treating this type of cancer is the motion of the lungs caused by the patient's respiration. It is possible to reduce the impact of this movement with the use of respiratory gating. By combining respiratory gating with a flattening filter free (FFF) photon beam linac, the increased treatment time caused by a reduced beam-on time of respiratory gating methods can be compensated by the inherent increased dose rate of FFF beams. This project's aim is to create hardware and software interfaces allowing free respiration gating on an Elekta Synergy-S linac specially modified to deliver 6 MV FFF photon beams. First, a printed circuit board was created for reading the signal from a Bellows Belt from Philips (a respiration monitor belt) and transmitting an On/Off signal to the accelerator. A software was also developed to visualize patient respiration. Secondly, a FFF model was created with the Pinnacle treatment planning system from Philips. Gamma (Γ) analysis (2%, 2 mm) was used to evaluate model. For fields going from 5.6 × 5.6 to 12 × 12 cm{sup 2}, central axis depth dose model fitting shows an average gamma value of 0.2 and 100% of gamma values remain under the Γ = 1 limit. For smaller fields (0.8 × 0.8 and 1.6 × 1.6 cm{sup 2}), Pinnacle has more trouble trying to fit the measurements, overestimating dose in penumbra and buildup regions.

60 APPLIED LIFE SCIENCES↗

Selection of an appropriate animal model for study of bone loss in weightlessness

Prolonged weightlessness in space flight results in a slow progressive demineralization of bone accompanied by an increased calcium output in the urine resulting in negative calcium balances. This possibly irreversible bone loss may constitute a serious limiting factor to long duration manned space flight. A number of preventative measures have been suggested, i.e., exercise during flight, dietary calcium supplements, use of specific prophylactic drugs. In order to facilitate research in these areas it is necessary to develop appropriate ground-based animal models that simulate the human condition of osteoporsis. An appropriate animal model would permit bone density studies, calcium balance studies, biochemical analyses, ground-based simulation models of weightlessness (bed rest, restraint, immobilization) and the planning of inflight experiments. Several animal models have been proposed in the biomedical research literature, but have inherent deficiencies. The purpose of this project was to evaluate models in the literature and determine which of these most closely simulates the phenomenon of bone loss in humans with regard to growth, bone remodeling, structural, chemical and mineralization similarities to human. This was accomplished by a comprehensive computer assisted literature search and report. Three animal models were examined closely for their relative suitability: the albino rat, monkey, and Beagle.

Wolinsky, I.↗

Integrating State Data Assimilation and Innovative Model Parameterization Reduces Simulated Carbon Uptake in the Arctic and Boreal Region

Model representation of carbon uptake and storage is essential for accurate projection of the response of the arctic‐boreal zone to a rapidly changing climate. Land model estimates of LAI and aboveground biomass that can have a marked influence on model projections of carbon uptake and storage vary substantially in the arctic and boreal zone, making it challenging to correctly evaluate model estimates of Gross Primary Productivity (GPP). To understand and correct bias of LAI and aboveground biomass in the Community Land Model (CLM), we assimilated the 8‐day Moderate Resolution Imaging Spectroradiometer (MODIS) LAI observation and a machine learning product of annual aboveground biomass into CLM using an Ensemble Adjustment Kalman Filter (EAKF) in an experimental region including Alaska and Western Canada. Assimilating LAI and aboveground biomass reduced these model estimates by 58% and 72%, respectively. The change of aboveground biomass was consistent with independent estimates of canopy top height at both regional and site levels. The International Land Model Benchmarking system assessment showed that data assimilation significantly improved CLM's performance in simulating the carbon and hydrological cycles, as well as in representing the functional relationships between LAI and other variables. To further reduce the remaining bias in GPP after LAI bias correction, we re‐parameterized CLM to account for low temperature suppression of photosynthesis. The LAI bias corrected model that included the new parameterization showed the best agreement with model benchmarks. Combining data assimilation with model parameterization provides a useful framework to assess photosynthetic processes in LSMs.

land data assimilation↗

Advanced methods for uncertainty quantification in tail regions of climate model predictions.

Conventional methods for uncertainty quantification are generally challenged in the 'tails' of probability distributions. This is specifically an issue for many climate observables since extensive sampling to obtain a reasonable accuracy in tail regions is especially costly in climate models. Moreover, the accuracy of spectral representations of uncertainty is weighted in favor of more probable ranges of the underlying basis variable, which, in conventional bases does not particularly target tail regions. Therefore, what is ideally desired is a methodology that requires only a limited number of full computational model evaluations while remaining accurate enough in the tail region. To develop such a methodology, we explore the use of surrogate models based on non-intrusive Polynomial Chaos expansions and Galerkin projection. We consider non-conventional and custom basis functions, orthogonal with respect to probability distributions that exhibit fat-tailed regions. We illustrate how the use of non-conventional basis functions, and surrogate model analysis, improves the accuracy of the spectral expansions in the tail regions. Finally, we also demonstrate these methodologies using precipitation data from CCSM simulations.

54 ENVIRONMENTAL SCIENCES↗

Evaluating Secondary Inorganic Aerosols in Three Dimensions

The spatial distribution of aerosols and their chemical composition dictates whether aerosols have a cooling or a warming effect on the climate system. Hence, properly modeling the three-dimensional distribution of aerosols is a crucial step for coherent climate simulations. Since surface measurement networks only give 2-D data, and most satellites supply integrated column information, it is thus important to integrate aircraft measurements in climate model evaluations. In this study, the vertical distribution of secondary inorganic aerosol (i.e., sulfate, ammonium, and nitrate) is evaluated against a collection of 14 AMS flight campaigns and surface measurements from 2000 to 2010 in the USA and Europe. GISS ModelE2 is used with multiple aerosol microphysics (MATRIX, OMA) and thermodynamic (ISORROPIA II, EQSAM) configurations. Our results show that the MATRIX microphysical scheme improves the model performance for sulfate, but that there is a systematic underestimation of ammonium and nitrate over the USA and Europe in all model configurations. In terms of gaseous precursors, nitric acid concentrations are largely underestimated at the surface while overestimated in the higher levels of the model. Heterogeneous reactions on dust surfaces are an important sink for nitric acid, even high in the troposphere. At high altitudes, nitrate formation is calculated to be ammonia limited. The underestimation of ammonium and nitrate in polluted regions is most likely caused by a too simplified treatment of the NH3/NH4(+) partitioning which affects the HNO3/NO3(-) partitioning.

aerosols↗

Using Satellite and ARM Observations to Evaluate Cold Air Outbreak Cloud Transitions in E3SM Global Storm‐Resolving Simulations

Abstract This study examines marine boundary layer cloud regime transition during a cold air outbreak (CAO) over the Norwegian Sea, simulated by a global storm‐resolving model (GSRM) known as the Simple Cloud‐Resolving Energy Exascale Earth System Model Atmosphere Model (SCREAM). By selecting observational references based on a combination of large‐scale conditions rather than strict time‐matched comparisons, this study finds that SCREAM qualitatively captures the CAO cloud transition, including boundary layer growth, cloud mesoscale structure, and phase partitioning. SCREAM also accurately locates the greatest ice and liquid in the mesoscale updrafts, however, underestimates supercooled liquid water in cumulus clouds. The model evaluation approach adopted by this study takes advantages of the existing computational‐expensive global simulations of GSRM and the available observations to understand model performance and can be applied to assessments of other cloud regimes in different regions. Such practice provides valuable guidance on the future effort to correct and improve biased model behaviors.

54 ENVIRONMENTAL SCIENCES↗

Contributions to Loss Across the Magnetopause During an Electron Dropout Event

Abstract Dropout events are dramatic decreases in radiation belt electron populations that can occur in as little as 30 minutes. Loss to magnetopause due to a combination of magnetopause shadowing and outward radial transport plays a significant role in these events. We examine the dropout of relativistic electron populations during the October 2012 geomagnetic storm using simulated electron phase space density, evaluating the contribution of different processes to losses across the magnetopause. We compare loss contribution from outward transport calculated using a standard empirical radial diffusion model that assumes a dipolar geomagnetic field to an event‐specific radial diffusion model evaluated with a non‐dipolar geomagnetic field. We additionally evaluate the contribution of Shabansky type 1 particles, which bounce along magnetic field lines with local equatorial maxima, to the loss calculated during this event. We find that the empirical radial diffusion model with a dipolar background field underestimates the contribution of radial diffusion to this dropout event by up to 10% when compared to the event‐specific, non‐dipolar radial diffusion model. We additionally find that including Shabansky type 1 particles in the initial electron phase space density, that is, allowing some magnetic field lines distorted from the typical single‐minima configuration in drift shell construction, increases the calculated loss by an average of 0.75%. This shows that the treatment of the geomagnetic field significantly impacts the calculation of electron losses to the magnetopause during dropout events, with the non‐dipolar treatment of radial diffusion being essential to accurately quantify the loss of outer radiation belt populations.

79 ASTRONOMY AND ASTROPHYSICS↗

Evaluating Deception Detection Model Robustness To Linguistic Variation

With the increasing use of automated, machine learning-driven tools and the downstream impact that algorithmic judgements can have, it is critical to develop models that are robust to evolving or manipulated inputs. Evaluating the reliability of multimodal models across linguistic variations to understand model susceptibility to intentional linguistic adversarial attacks as well as natural linguistic variations is essential in this pursuit. We present extensive analysis of model robustness and susceptibility to linguistic variations in the setting of deceptive news detection, a difficult classification task that is an increasingly important problem to solve with the impact of misinformation spread online. We evaluate the effectiveness of incorporating adversarial defense strategies and measure model susceptibility to state-of-the-art adversarial attacks using two types of linguistic attacks — character and word perturbations. We consider two multiclass prediction tasks — a 3-way classification of tweets as trustworthy, propaganda, or disinformation; and a 4-way classification as clickbait, hoax, satire, or conspiracy — and compare the performance of three embeddings that have been state-of-the-art for several NLP tasks — GloVe, ELMo, and BERT — to highlight consistent trends in susceptibility, high confidence misclassifications, and high impact failures. We find that character or mixed ensemble models are the most effective defense mechanisms and that character perturbations are a more effective attack than word perturbations for deception classification.

adversarial evaluation↗

Quantifying Progress Across Different CMIP Phases With the ESMValTool

Abstract More than 40 model groups worldwide are participating in the Coupled Model Intercomparison Project Phase 6 (CMIP6), providing a new and rich source of information to better understand past, present, and future climate change. Here, we use the Earth System Model Evaluation Tool (ESMValTool) to assess the performance of the CMIP6 ensemble compared to the previous generations CMIP3 and CMIP5. While CMIP5 models did not capture the observed pause in the increase in global mean surface temperature between 1998 and 2013, the historical CMIP6 simulations agree well with the observed recent temperature increase, but some models have difficulties in reproducing the observed global mean surface temperature record of the second half of the twentieth century. While systematic biases in annual mean surface temperature and precipitation remain in the CMIP6 multimodel mean, individual models and high‐resolution versions of the models show significant reductions in many long‐standing biases. Some improvements are also found in the vertical temperature, water vapor, and zonal wind speed distributions, and root‐mean‐square errors for selected fields are generally smaller with reduced intermodel spread and higher average skill in the correlation patterns relative to observations. An emerging property of the CMIP6 ensemble is a higher effective climate sensitivity with an increased range between 2.3 and 5.6 K. A possible reason for this increase in some models is improvements in cloud representation resulting in stronger shortwave cloud feedbacks than in their predecessor versions.

Bock, L.↗