Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Error Modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,621 records · Page 90

Design of a Particle Shadow-graph Velocimetry and Size (PSVS) System to Determine Particle Size and Density Distributions in Hanford Nuclear Tank Wastes - 12280

Accurate particle size and density distributions for nuclear tank waste materials are essential information that helps determine the engineering requirements for a host of waste management unit operations (e.g., tank mixing, pipeline transport, and filtration). The most prevalent approach for determining particle size and density distribution is highly laborious and involves identifying individual particles using scanning electron microscope/x-ray diffraction and then acquiring the density of the materials from the technical literature. Other methods simply approximate individual particle densities by assuming chemical composition, rather than obtaining actual measurements of particle density. To overcome these limitations, a Particle Shadow-graph Velocimetry and Size (PSVS) system has been designed to simultaneously obtain particle size and density distributions for a broad range of Hanford tank waste materials existing as both individual particles and agglomerates. The PSVS system uses optical hardware, a temperature-controlled settling column, and particle introduction chamber to accurately and reproducibly obtain images of settling particles. Image analysis software provides a highly accurate determination of both particle terminal velocity and equivalent spherical particle diameter. The particle density is then calculated from Newton's terminal settling theory. The PSVS system was designed to accurately image particle/agglomerate sizes between 10 and 1000 μm and particle/agglomerate densities ranging from 1.4 to 11.5 g/cm{sup 3}, where the maximum terminal velocity does not exceed 10 cm/s. Preliminary testing was completed with standard materials and results were in good agreement with terminal settling theory. Recent results of this method development are presented, as well as experimental design. The primary goal of these PSVS system tests was to obtain accurate and reproducible particle size and velocity measurements to estimate particle densities within 20 percent of direct measured density values. The average percent error observed in particle densities was 4.8, 8.2, and 25.8 percent for S1D3 (high-density soda-lime glass), S3D4 (zirconia), and S1D2 (soda-lime glass) beads, respectively. The maximum measured particle density error observed was 14.5, 21.0, and 58.4, for S1D3, S3D4, and S1D2 beads, respectively. Multiple sources of error can exist that contribute to inaccurate estimates of particle density using the PSVS approach. Two significant influences observed were thermal convective currents in the settling column fluid and non-spherical (irregular) particle shapes in the standard test materials. Experimental results using buoyant beads suggest thermal convective currents can influence the movement of settling particles as much as 4 mm/s. These thermal convective currents are clearly a significant concern for smaller and less-dense particles/agglomerates which have terminal velocities of the same magnitude. Significant effort went into the design and fabrication of a thermal control system for the PSVS settling column. However, small temperature variations (<0.3 deg. C) are difficult to prevent and measure accurately. Therefore, although designing the thermal control system was necessary, it is not considered the only solution to minimize error due to thermal convective currents. The use of small diameter (10 to 27 μm) polyethylene buoyant beads (in low concentrations) during actual settling experiments may be necessary to provide insight into particle-particle interactions and fluid velocity correction factors to account for potential influences from thermal convective currents. Future testing will incorporate the buoyant beads into the analysis technique when the suspension fluid is chemically compatible. The use of the Newton's law to calculate particle/agglomerate densities assumes spherical particle shapes. As the actual particle/agglomerates diverge from spherical, the margin of error increases. The selection of high quality (in density and shape) monodispersed particle standards was a direct attempt to reduce the uncertainties associated with non-spherical or irregular particles and to only observe the PSVS method and analysis error. While investigating the source of data scatter for the S1D3 bead (nominal 700 μm) standard, significant irregular particles where discovered. Yet, a subsequent investigation into the S3D4 bead standard was also conducted and it was determined that 60 percent of the particles had a 0.9 to 0.8 centricity, 32 percent were between 0.8 and 0.7, only 7 percent were between 1.0 and 0.9, and the remaining 1 percent of the particles had centricities between 0.7 and 0.6. Contrast this with the S1D3 bead standard, where 100 percent of particles had centricities between 0.95 and 0.98, upon applying the centricity filter. The influence of the non-spherical shape of the S3D4 bead standard is evident when comparing a 3.9 percent average density error for S1D3 glass bead standard with an 8.3 percent average density error for the S3D4 bead standard. Model corrections for non-spherical shape must be implemented to account for these measurement errors during future method validation and system performance assessments. In addition, further work is needed to resolve the higher than expected velocities for the smaller S1D2 particles. Initial measurements conducted with buoyant beads as fluid velocity tracers indicate that fluid velocities can be subtracted from the increased particle velocities to determine the particle terminal velocity, regardless of the surrounding fluid velocity. However, this approach is in its infancy and will need to be carefully and methodically validated. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Uncertainty Quantification with MCMC method and BFBT Data

The reliability of predictions of the system codes is closely related to the validation of their physical models. For example, the accuracy of void fraction prediction in a Boiling Water Reactor (BWR) using TRACE code depends on the uncertainties of closure relations developed for the two-phase flow models. This work focus on quantifying the uncertainties of two physical models, interfacial drag model and subcooled boiling model, using Markov Chain Monte Carlo (MCMC) method and BFBT experimental benchmark data. We applied the MCMC and MLE algorithms to BFBT benchmark data and estimated the uncertainty distribution of two model parameters: subcooled boiling heat transfer coefficient and interfacial drag (bubbly/slug rod bundle) coefficient. These algorithms tend to give various estimation results. Despite the differences in these algorithms, we find that the estimation results are consistent. After obtaining the uncertainty estimates, we validated the uncertainty estimates by applying the estimated distributions of model parameters to TRACE prediction. The new predictions succeed in reducing the void fraction prediction error, but it is not possible to eliminate all prediction error. We are only adjusting two model parameters, and there exists uncertainties in all model parameters. Application of the algorithms to other physical models and experimental data will be helpful for future work. (authors)

42 ENGINEERING↗

Improved Regional and TeleseismicP-Wave Travel-Time Prediction and Event Location Using a Global 3D Velocity Model

A global validation dataset of 116 seismic events and 20,977 associated Pn and P arrivals is used to assess travel-time prediction and event location accuracy for the global-scale, 3D, P-wave velocity model called LLNL-G3Dv3 (Simmons et al., 2012). Strong regional trends that are observed for ak135 travel-time residuals are largely removed when LLNL-G3Dv3 is used for prediction. The 25th–75th quantile spread of travel-time residuals is reduced by 30%–40% at teleseismic distances, and the spread is reduced by ~60% at regional distances (<16°). Epicenter error decreases when more data are used to constrain event locations until more than ~40 arrivals times are used. At which point, epicenter error reduction tends to plateau. Median epicenter errors for the ak135 and LLNL-G3Dv3 models plateau at ~8:0 and ~5:5 km, respectively, for teleseismic P datasets. Median epicenter errors for the ak135 and LLNL-G3Dv3 models plateau at ~12:0 and ~4:0 km, respectively, for regional Pn datasets. We demonstrate that spatially correlated travel-time residual errors for the ak135 model lead to increasing epicenter error when ~40 to ~100 Pn arrivals are used to constrain the location. The effect of correlated error is mitigated by LLNL-G3Dv3, for which epicenter error steadily decreases to ~4 km when 100 Pn arrivals are used. The median area of 0.95 epicenter probability bounds for ak135 and LLNL-G3Dv3 are 1811 and 758 km 2 , respectively. The ak135 ellipses are inflated to achieve the desired rate of true events occurring inside the probability region, whereas LLNLG3Dv3 error ellipses based on empirical residual distributions cover the true location at the expected rate because location bias is minimal.

58 GEOSCIENCES↗

Quantifying Errors in Effective Cluster Interactions of Lattice Gas Cluster Expansions

The promise of lattice gas (LG) cluster expansions (CEs) is that they can describe a given system property to any level of accuracy since the orthogonal “cluster basis functions” span the complete space of available configurations. Such an approach can be constructed to an arbitrarily large surface of a finite number of distinct adsorption sites. Unfortunately, this is only true for the case of an ideal, fixed lattice decorated with components at precise lattice points (the lattice “sites”) with no distortions or relaxations subsequently allowed. Since most systems, and surfaces specifically, do not conform to such an ideal set of constraints, errors in LG CEs must be expected or CE convergence severely hampered. Beyond this, numerical errors in the provided data can complicate the proper construction of a truly predictive and/or physically significant CE. In this work, we show here how reliance on typical statistical tools like confidence intervals cannot be expected to provide an accurate representation of the uncertainty of effective cluster interactions (ECIs) in the CE due to the nature of the target ab initio data and the nature of CEs themselves. We develop a method for estimating these errors that does not rely on statistical assumptions about the model or data. We then use these ECI errors to quantify fundamental consequences on the uncertainty of ECIs in CEs built from O/Fe(100) data whose surface and adsorbates have been allowed to relax in a typical manner and from O/Fe(100) data whose surface and adsorbates are fixed in ideal lattice positions. We also quantify the effect of using a different density functional theory exchange–correlation functional, using these ECI errors to assess the significance in any deviations. In both cases, our method is shown to have remarkable utility in the quantification of errors in the ECIs of CEs. While we stick to the lattice gas convention in this work, the method is equally applicable to the Ising convention or, in principle, any linear model of sufficient complexity.

08 HYDROGEN↗

Calibration of a distributed flood forecasting model with input uncertainty using a Bayesian framework

In the process of calibrating distributed hydrological models, accounting for input uncertainty is important, yet challenging. In this study, we develop a Bayesian model to estimate parameters associated with a geomorphology‐based hydrological model (GBHM). The GBHM model uses geomorphic characteristics to simplify model structure and physically based methods to represent hydrological processes. We divide the observed discharge into low‐ and high‐flow data, and use the first‐order autoregressive model to describe their temporal dependence. We consider relative errors in rainfall as spatially distributed variables and estimate them jointly with the GBHM parameters. The joint posterior probability distribution is explored using Markov chain Monte Carlo methods, which include Metropolis‐Hastings, delay rejection adaptive Metropolis, and Gibbs sampling methods. We evaluate the Bayesian model using both synthetic and field data sets. The synthetic case study demonstrates that the developed method generally is effective in calibrating GBHM parameters and in estimating their associated uncertainty. The calibration ignoring input errors has lower accuracy and lower reliability compared to the calibration that includes estimation of the input errors, especially under model structure uncertainty. The field case study shows that calibration of GBHM parameters under complex field conditions remains a challenge. Although jointly estimating input errors and GBHM parameters improves the continuous ranked probability score and the consistency of the predictive distribution with the observed data, the improvement is incremental. To better calibrate parameters in a distributed model, such as GBHM here, we need to develop a more complex model and incorporate much more information.

54 ENVIRONMENTAL SCIENCES↗

Low-rank separated representation surrogates of high-dimensional stochastic functions: Application in Bayesian inference

This study introduces a non-intrusive approach in the context of low-rank separated representation to construct a surrogate of high-dimensional stochastic functions, e.g., PDEs/ODEs, in order to decrease the computational cost of Markov Chain Monte Carlo simulations in Bayesian inference. The surrogate model is constructed via a regularized alternative least-square regression with Tikhonov regularization using a roughening matrix computing the gradient of the solution, in conjunction with a perturbation-based error indicator to detect optimal model complexities. The model approximates a vector of a continuous solution at discrete values of a physical variable. The required number of random realizations to achieve a successful approximation linearly depends on the function dimensionality. The computational cost of the model construction is quadratic in the number of random inputs, which potentially tackles the curse of dimensionality in high-dimensional stochastic functions. Furthermore, this vector-valued separated representation-based model, in comparison to the available scalar-valued case, leads to a significant reduction in the cost of approximation by an order of magnitude equal to the vector size. The performance of the method is studied through its application to three numerical examples including a 41-dimensional elliptic PDE and a 21-dimensional cavity flow.

97 MATHEMATICS AND COMPUTING↗

Editorial: Resolving atmospheric flow in complex environments: recent experiments in terrain and forest canopies

The characterization of atmospheric flows in complex environments, which may include steep terrain slopes and heterogeneous vegetation and/or forest cover, is a long-standing challenge in boundary-layer meteorology. Atmospheric observations are complicated by the presence of transient, terrain-induced flow features, forest-canopy-atmosphere interactions, and atmospheric stability effects, not to mention the logistical hurdles involved with instrument deployment, data analysis, and quality control. Furthermore, challenges in atmospheric modeling arise due to numerical errors associated with complex terrain flows, as well as reliance on simplified parameterizations for unresolved processes such as turbulent mixing and land-surface or forest-canopy-atmosphere interactions. These modeling challenges are exacerbated in the so-called “gray zone,” wherein features of interest have length scales that are similar to the model grid spacing, or when the principal flow layer is smaller than the grid spacing (e.g., slope flows).

54 ENVIRONMENTAL SCIENCES↗

Statistical and systematic errors in the measurement of weak-lensing Minkowski functionals: Application to the Canada-France-Hawaii Lensing Survey

The measurement of cosmic shear using weak gravitational lensing is a challenging task that involves a number of complicated procedures. We study in detail the systematic errors in the measurement of weak-lensing Minkowski Functionals (MFs). Specifically, we focus on systematics associated with galaxy shape measurements, photometric redshift errors, and shear calibration correction. We first generate mock weak-lensing catalogs that directly incorporate the actual observational characteristics of the Canada-France-Hawaii Lensing Survey (CFHTLenS). We then perform a Fisher analysis using the large set of mock catalogs for various cosmological models. We find that the statistical error associated with the observational effects degrades the cosmological parameter constraints by a factor of a few. The Subaru Hyper Suprime-Cam (HSC) survey with a sky coverage of ∼1400 deg{sup 2} will constrain the dark energy equation of the state parameter with an error of Δw {sub 0} ∼ 0.25 by the lensing MFs alone, but biases induced by the systematics can be comparable to the 1σ error. We conclude that the lensing MFs are powerful statistics beyond the two-point statistics only if well-calibrated measurement of both the redshifts and the shapes of source galaxies is performed. Finally, we analyze the CFHTLenS data to explore the ability of the MFs to break degeneracies between a few cosmological parameters. Using a combined analysis of the MFs and the shear correlation function, we derive the matter density Ω{sub m0}=0.256±{sub 0.046}{sup 0.054}.

79 ASTRONOMY AND ASTROPHYSICS↗

Machine learning and process-based modeling of spatiotemporal changes in active layer thickness across Alaska

Permafrost degradation poses a growing threat to infrastructure stability and ecosystem resilience in the rapidly warming Arctic. We investigated the spatiotemporal dynamics of active layer thickness (ALT) across Alaska by integrating field observations, environmental datasets, a physically based Stefan model, and machine learning (ML) techniques. Using weather projections from the Coupled Model Intercomparison Project Phase 6 under two Shared Socioeconomic Pathways (SSP 2-4.5 and SSP 5-8.5), we assessed ALT sensitivity to projected future weather conditions. The random forest (RF) model outperformed the Stefan approach in predicting ALT on the training dataset (R² = 0.84 vs. 0.53) but demonstrated lower generalizability on the test dataset (R² = 0.24 vs. 0.54). The root mean square error (RMSE) for the RF model for training and testing ranged from 14 to 22 cm, compared to 17 and 18 cm for the Stefan model. Variable importance analysis revealed that mean annual temperature and slope angle were the strongest predictors of ALT, accounting for 19% and 18% of the variance, respectively, followed by sediment transport index (14%) and stream power index (11%). Comparative analysis of baseline ALT predictions showed the Stefan model tended to project a thicker active layer (mean ± SD: 65 ± 16 cm), compared to the RF model (mean ± SD: 59 ± 8.8) cm). Both models indicated a latitudinal gradient in ALT, with shallower depths at higher latitudes. Projected ALT increases by 2100 were estimated at 3.3 ± 2.2 cm under SSP 2-4.5 and 5.9 ± 4.0 cm under SSP 5-8.5 for the ML model, whereas the Stefan model projected substantially larger increases of 13 ± 2.6 cm (SSP 2-4.5) and 28 ± 4.4 cm (SSP5-8.5). Spatial analysis showed the greatest ALT increases in northern Alaska, with relatively smaller changes in southern regions. These findings highlight the complex, multifactorial nature of ALT dynamics and the value of hybrid modeling approaches. As rising temperatures accelerate permafrost thaw, changes in ALT can disrupt ecosystems, damage infrastructures, and enhance the release of stored soil carbon, highlighting the urgent need for improved predictive capabilities to inform adaptation strategies in the Arctic.

Climate sciences↗

Validation of the IRI-2016 model with Indian NavIC data for future navigation applications

The position accuracy of Navigation with Indian Constellation (NavIC) system is affected by several sources of errors. Among them, the Ionospheric Time Delay (ITD) error is the most predominant one which depends upon the total electron content (TEC) present in the ionosphere. The ITD variations are more intense over low latitude regions due to the equatorial anomaly effects. Hence, modelling of ITD error is necessary. The International Reference Ionosphere (IRI)-2016 model is one of the standard global ionospheric models to estimate the Vertical TEC (VTEC). This paper discusses about the VTEC deviations due to the IRI-2016 model over low latitude Hyderabad station, Indian region using NavIC, Global Positioning System and Global Navigation Satellite System signals at corresponding Ionospheric Pierce Point latitude and longitudes for all months and various Kp indices during the low solar activity year 2017. In this work, cross correlation coefficient, the metric norm (L2N), Symmetric Kullbacke Leibler Distance metrics are used to evaluate the performance of IRI-2016 model TEC with NavIC, GPS and GLONASS data. From the results, it is found that TEC predicted by the IRI-2016 model produced smaller estimation errors with NavIC data over Indian region. The obtained results will be helpful for future updates of IRI model.

42 ENGINEERING↗

The potential of different artificial neural network (ANN) techniques in daily global solar radiation modeling based on meteorological data

The main objective of present study is to predict daily global solar radiation (GSR) on a horizontal surface, based on meteorological variables, using different artificial neural network (ANN) techniques. Daily mean air temperature, relative humidity, sunshine hours, evaporation, and wind speed values between 2002 and 2006 for Dezful city in Iran (32 16'N, 48 25'E), are used in this study. In order to consider the effect of each meteorological variable on daily GSR prediction, six following combinations of input variables are considered: (I)Day of the year, daily mean air temperature and relative humidity as inputs and daily GSR as output. (II)Day of the year, daily mean air temperature and sunshine hours as inputs and daily GSR as output. (III)Day of the year, daily mean air temperature, relative humidity and sunshine hours as inputs and daily GSR as output. (IV)Day of the year, daily mean air temperature, relative humidity, sunshine hours and evaporation as inputs and daily GSR as output. (V)Day of the year, daily mean air temperature, relative humidity, sunshine hours and wind speed as inputs and daily GSR as output. (VI)Day of the year, daily mean air temperature, relative humidity, sunshine hours, evaporation and wind speed as inputs and daily GSR as output. Multi-layer perceptron (MLP) and radial basis function (RBF) neural networks are applied for daily GSR modeling based on six proposed combinations. The measured data between 2002 and 2005 are used to train the neural networks while the data for 214 days from 2006 are used as testing data. The comparison of obtained results from ANNs and different conventional GSR prediction (CGSRP) models shows very good improvements (i.e. the predicted values of best ANN model (MLP-V) has a mean absolute percentage error (MAPE) about 5.21% versus 10.02% for best CGSRP model (CGSRP 5)). (author)

14 SOLAR ENERGY↗

Enhanced physics-constrained deep neural networks for modeling vanadium redox flow battery

Numerical simulation has become indispensable in advancing cost-effective process optimization and control of flow batteries. We propose an enhanced version of the physics-constrained deep neural network (PCDNN) approach to provide high-accuracy voltage predictions in the vanadium redox flow batteries (VRFBs). The purpose of the PCDNN approach is to enforce the physics-based zero-dimensional (0D) VRFB model in a neural network to assure model generalization for various battery operation conditions. However, limited by the simplifications of the 0D model, the PCDNN cannot capture sharp voltage changes in the extreme SOC regions. To improve the accuracy of voltage prediction at extreme ranges, we introduce a second (enhanced) DNN to mitigate the prediction errors carried from the 0D model itself and call the resulting approach enhanced PCDNN (ePCDNN). By comparing with experimental data, we demonstrate that the ePCDNN approach can accurately capture the voltage response throughout the charge–discharge cycle, including the tail region of the voltage discharge curve. The loss function for training the ePCDNN is designed to be flexible by adjusting the weights of the physics-constrained DNN and the enhanced DNN. In conclusion, this allows the ePCDNN framework to be transferable to battery systems with variable physical model fidelity.

25 ENERGY STORAGE↗

Interpretable ensemble learning unveils main aerosol optical properties in predicting cloud condensation nuclei number concentration

Variations in cloud condensation nuclei number concentration (N CCN ) significantly influence cloud microphysics, yet direct N CCN measurements remain challenging. Here, we present an N CCN ensemble learning (NEL) model utilizing ensemble learning and interpretability analysis on aerosol optical parameters. Validated at two land sites, two ocean sites and one polar site within the Atmospheric Radiation Measurement program, the mean absolute percentage error range of the NEL model across different environments is from 12% to 36%, demonstrating high accuracy. Key findings reveal that aerosol optical parameters can serve as predictors for N CCN . Aerosol scattering and backscattering coefficients, absorption coefficient, backscatter fraction (BSF), and Ångström exponent (AE) are positively correlated with N CCN , while single scattering albedo shows negative correlations. N CCN prediction at land sites is highly sensitive to BSF, largely driven by the backscattering coefficient, as fine particles dominate in these sites. At ocean sites, N CCN prediction is more sensitive to AE, primarily influenced by the scattering coefficient, due to the higher proportion of larger particles. At the polar site, N CCN prediction shows sensitivity to both BSF and AE, mainly driven by the scattering coefficient, as polar sites are cleaner and contain larger particles. These differences reflect the variation in particle size and number concentration across different environments.

Atmospheric science↗

Spectral characteristics of background error covariance and multiscale data assimilation

The spatial resolutions of numerical atmospheric and oceanic circulation models have steadily increased over the past decades. Horizontal grid spacing down to the order of 1 km is now often used to resolve cloud systems in the atmosphere and sub-mesoscale circulation systems in the ocean. These fine resolution models encompass a wide range of temporal and spatial scales, across which dynamical and statistical properties vary. In particular, dynamic flow systems for small scales can become spatially localized and temporarily intermittent. An analysis shows that the background correlation length scale is larger than 75 km for streamfunctions, even for a 2-km resolution model, and larger than 25 km for water vapor mixing ratios. The theoretical analyses suggest that such correlation length scales prevent the currently used data assimilation schemes from constraining spatial scales smaller than 150 km for streamfunctions and 50 km for water vapor mixing ratios. These results highlight the necessity of fundamentally modifying the currently used data assimilation algorithm for assimilating high-resolution observations into the aforementioned fine resolution models. A multiscale methodology based on scale decomposition is suggested, and challenges are discussed.

Li, Zhijin↗

Results of the Simulation of the HTR-Proteus Core 4.2 Using PEBBED-COMBINE: FY10 Report

ABSTRACT The Idaho National Laboratory’s deterministic neutronics analysis codes and methods were applied to the computation of the core multiplication factor of the HTR-Proteus pebble bed reactor critical facility. This report is a follow-on to INL/EXT-09-16620 in which the same calculation was performed but using earlier versions of the codes and less developed methods. In that report, results indicated that the cross sections generated using COMBINE-7.0 did not yield satisfactory estimates of keff. It was concluded in the report that the modeling of control rods was not satisfactory. In the past year, improvements to the homogenization capability in COMBINE have enabled the explicit modeling of TRIS particles, pebbles, and heterogeneous core zones including control rod regions using a new multi-scale version of COMBINE in which the 1-dimensional discrete ordinate transport code ANISN has been integrated. The new COMBINE is shown to yield benchmark quality results for pebble unit cell models, the first step in preparing few-group diffusion parameters for core simulations. In this report, the full critical core is modeled once again but with cross sections generated using the capabilities and physics of the improved COMBINE code. The new PEBBED-COMBINE model enables the exact modeling of the pebbles and control rod region along with better approximation to structures in the reflector. Initial results for the core multiplication factor indicate significant improvement in the INL’s tools for modeling the neutronic properties of a pebble bed reactor. Errors on the order of 1.6-2.5% in keff are obtained; a significant improvement over the 5-6% error observed in the earlier This is acceptable for a code system and model in the early stages of development but still too high for a production code. Analysis of a simpler core model indicates an over-prediction of the flux in the low end of the thermal spectrum. Causes of this discrepancy are under investigation. New homogenization techniques and assumptions were used in this analysis and as such, they require further confirmation and validation. Further refinement and review of the complex Proteus core model are likely to reduce the errors even further.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Tau-REx I: A next generation retrieval code for exoplanetary atmospheres

Spectroscopy of exoplanetary atmospheres has become a well established method for the characterization of extrasolar planets. We here present a novel inverse retrieval code for exoplanetary atmospheres. T-REx(Tau Retrieval for Exoplanets) is a line-by-line radiative transfer fully Bayesian retrieval framework. T-REx includes the following features:(1) the optimized use of molecular line lists from the ExoMol project; (2) an unbiased atmospheric composition prior selection, through custom built pattern recognition software; (3) the use of two independent algorithms to fully sample the Bayesian likelihood space: nested sampling as well as a more classical Markov Chain Monte Carlo approach; (4) iterative Bayesian parameter and model selection using the full Bayesian Evidence as well as the Savage–Dickey Ratio for nested models; and (5) the ability to fully map very large parameter spaces through optimal code parallelization and scalability to cluster computing. In this publication we outline the T-REx framework and demonstrate, using a theoretical hot-Jupiter transmission spectrum, the parameter retrieval and model selection. We investigate the impact of signal-to-noise ratio and spectral resolution on the retrievability of individual model parameters, both in terms of error bars on the temperature and molecular mixing ratios as well as its effect on the model’s global Bayesian evidence.

79 ASTRONOMY AND ASTROPHYSICS↗

Systematic and objective evaluation of Earth system models: PCMDI Metrics Package (PMP) version 3

Systematic, routine, and comprehensive evaluation of Earth system models (ESMs) facilitates benchmarking improvement across model generations and identifying the strengths and weaknesses of different model configurations. By gauging the consistency between models and observations, this endeavor is becoming increasingly necessary to objectively synthesize the thousands of simulations contributed to the Coupled Model Intercomparison Project (CMIP) to date. The Program for Climate Model Diagnosis and Intercomparison (PCMDI) Metrics Package (PMP) is an open-source Python software package that provides quick-look objective comparisons of ESMs with one another and with observations. The comparisons include metrics of large- to global-scale climatologies, tropical inter-annual and intra-seasonal variability modes such as the El Niño–Southern Oscillation (ENSO) and Madden–Julian Oscillation (MJO), extratropical modes of variability, regional monsoons, cloud radiative feedbacks, and high-frequency characteristics of simulated precipitation, including its extremes. The PMP comparison results are produced using all model simulations contributed to CMIP6 and earlier CMIP phases. An important objective of the PMP is to document the performance of ESMs participating in the recent phases of CMIP, together with providing version-controlled information for all datasets, software packages, and analysis codes being used in the evaluation process. Among other purposes, this also enables modeling groups to assess performance changes during the ESM development cycle in the context of the error distribution of the multi-model ensemble. Quantitative model evaluation provided by the PMP can assist modelers in their development priorities. In this paper, we provide an overview of the PMP, including its latest capabilities, and discuss its future direction.

54 ENVIRONMENTAL SCIENCES↗