Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Systematics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Using Large Ensembles to Identify Regions of Systematic Biases in Moderate-to-Heavy Daily Precipitation

Because of internal variability in both the real-world and global climate models, it is unclear whether disagreement between models and observations reflects true systematic differences, or different phasing of internal variability in the short observational period. Here, we address this issue through an examination of moderate-to-heavy precipitation in large ensembles of global climate models. We find that model inconsistency with a global observational product is lowest for extratropical precipitation in northern hemisphere winter. The inconsistency is systematically greater for the southern hemisphere winter, but the difference between hemispheres could be due to observational quality. Moderate-to-heavy extratropical winter precipitation is less inconsistent than moderate-to-heavy tropical precipitation in most models. Within the tropics, moderate-to-heavy precipitation is particularly inconsistent with the reference in regions including the Caribbean (especially during JJA), the northern and southern flanks of the Pacific and Atlantic ITCZ, and the Indian Ocean.

58 GEOSCIENCES↗

Systematic Benchmarking of Climate Models: Methodologies, Applications, and New Directions

As climate models become increasingly complex, there is a growing need to comprehensively and systematically assess model performance with respect to observations. Given the increasing number and diversity of climate model simulations in use, the community has moved beyond simple model intercomparison and toward developing methods capable of benchmarking a large number of simulations against a suite of climate metrics. Here, we present a detailed review of evaluation and benchmarking methods and approaches developed in the last decade, focusing primarily on scientific implications for Coupled Model Intercomparison Project (CMIP) simulations and CMIP6 results that contributed to the Intergovernmental Panel on Climate Change (IPCC) Sixth Assessment Report (AR6). Based on this review, we explain the resulting contemporary philosophy of model benchmarking, and provide clear distinctions and definitions of the terms model verification, process validation, evaluation, and benchmarking. While significant progress has been made in model development based on systematic evaluation and benchmarking efforts, some climate system biases still remain. The development of open‐source community software packages has played a fundamental role in identifying areas of significant model improvement and bias reduction. We review the key features of several software packages that have been commonly used over the past decade to evaluate and benchmark global and regional climate models. Additionally, we discuss best practices for the selection of evaluation and benchmarking metrics and for interpreting the obtained results, the importance of selecting suitable sources of reference data and accurate uncertainty quantification.

Environmental sciences↗

Systematic softening in universal machine learning interatomic potentials

Machine learning interatomic potentials (MLIPs) have introduced a new paradigm for atomic simulations. Recent advancements have led to universal MLIPs (uMLIPs) that are pre-trained on diverse datasets, providing opportunities for universal force fields and foundational machine learning models. However, their performance in extrapolating to out-of-distribution complex atomic environments remains unclear. In this study, we highlight a consistent potential energy surface (PES) softening effect in three uMLIPs: M3GNet, CHGNet, and MACE-MP-0, which is characterized by energy and force underprediction in atomic-modeling benchmarks including surfaces, defects, solid-solution energetics, ion migration barriers, phonon vibration modes, and general high-energy states. The PES softening behavior originates primarily from the systematically underpredicted PES curvature, which derives from the biased sampling of near-equilibrium atomic arrangements in uMLIP pre-training datasets. Our findings suggest that a considerable fraction of uMLIP errors are highly systematic, and can therefore be efficiently corrected. We argue for the importance of a comprehensive materials dataset with improved PES sampling for next-generation foundational MLIPs.

36 MATERIALS SCIENCE↗

TDCOSMO. I. An exploration of systematic uncertainties in the inference of $H_0$ from time-delay cosmography

Time-delay cosmography of lensed quasars has achieved 2.4% precision on the measurement of the Hubble constant, H0. As part of an ongoing effort to uncover and control systematic uncertainties, we investigate three potential sources: 1- stellar kinematics, 2- line-of-sight effects, and 3- the deflector mass model. To meet this goal in a quantitative way, we reproduced the H0LiCOW/SHARP/STRIDES (hereafter TDCOSMO) procedures on a set of real and simulated data, and we find the following. First, stellar kinematics cannot be a dominant source of error or bias since we find that a systematic change of 10% of measured velocity dispersion leads to only a 0.7% shift on H0 from the seven lenses analyzed by TDCOSMO. Second, we find no bias to arise from incorrect estimation of the line-of-sight effects. Third, we show that elliptical composite (stars + dark matter halo), power-law, and cored power-law mass profiles have the flexibility to yield a broad range in H0 values. However, the TDCOSMO procedures that model the data with both composite and power-law mass profiles are informative. If the models agree, as we observe in real systems owing to the “bulge-halo” conspiracy, H0 is recovered precisely and accurately by both models. If the two models disagree, as in the case of some pathological models illustrated here, the TDCOSMO procedure either discriminates between them through the goodness of fit, or it accounts for the discrepancy in the final error bars provided by the analysis. This conclusion is consistent with a reanalysis of six of the TDCOSMO (real) lenses: the composite model yields H0 = 74.0−1.8+1.7 km s−1 Mpc−1, while the power-law model yields 74.2−1.6+1.6 km s−1 Mpc−1. In conclusion, we find no evidence of bias or errors larger than the current statistical uncertainties reported by TDCOSMO.

79 ASTRONOMY AND ASTROPHYSICS↗

Toward a systematic improvement of the fixed-node approximation in diffusion Monte Carlo for solids—A case study in diamond

While Diffusion Monte Carlo (DMC) is in principle an exact stochastic method for ab initio electronic structure calculations, in practice, the fermionic sign problem necessitates the use of the fixed-node approximation and trial wavefunctions with approximate nodes (or zeros). This approximation introduces a variational error in the energy that potentially can be tested and systematically improved. Here, we present a computational method that produces trial wavefunctions with systematically improvable nodes for DMC calculations of periodic solids. These trial wavefunctions are efficiently generated with the configuration interaction using a perturbative selection made iteratively (CIPSI) method. A simple protocol in which both exact and approximate results for finite supercells are used to extrapolate to the thermodynamic limit is introduced. This approach is illustrated in the case of the carbon diamond using Slater–Jastrow trial wavefunctions including up to one million Slater determinants. Fixed-node DMC energies obtained with such large expansions are much improved, and the fixed-node error is found to decrease monotonically and smoothly as a function of the number of determinants in the trial wavefunction, a property opening the way to a better control of this error. The cohesive energy extrapolated to the thermodynamic limit is in close agreement with the estimated experimental value. Interestingly, this is also the case at the single-determinant level, thus, indicating a very good error cancellation in carbon diamond between the bulk and atomic total fixed-node energies when using single-determinant nodes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Systematic characterization of unknown compounds via dimensionality reduction of time series

Analysis of ambient aerosols provides valuable insight into particle sources and formation chemistry. However, due to the complexity of atmospheric data and the dynamic nature of aerosol composition, a substantial fraction of data often become discarded by conventional analysis methods. Furthermore, a large fraction of chemical species within those data are unidentifiable due to a lack of matching spectral information, resulting in suboptimal characterization of chemical composition. Previous work has demonstrated techniques for cataloging analytes in a chromatographic dataset by deconvolution of mass spectra, but integration of these analytes throughout a large dataset remains time consuming. Here, we present a method to automatically identify an ion for quantitation for single-ion chromatogram based peak fitting and integration, enabling comprehensive integration of analytes with minimal user interaction. The resulting time series are clustered with a machine-learning based dimensionality reduction technique to systematically investigate the underlying characteristics of the categorized analytes and gain new insights into the chemical composition and physicochemical properties of the unidentifiable analytes. We apply these methods to existing atmospheric datasets collected in Manacapuru, Brazil during the GoAmazon2014/5 campaign to identify new analytes and interpret their variability and transformations in the atmosphere. The analysis results generate 408 time series from cataloged analytes of interest, and the clustering of those time series with spherical k-means results in 8 distinct clusters. We find the analytes form clusters based on their distinct physicochemical properties, demonstrating the method’s ability to systematically identify and selectively filter contaminants and instrumental analytes and characterize the unidentifiable analytes.

54 ENVIRONMENTAL SCIENCES↗

Robustness of cosmic birefringence measurement against Galactic foreground emission and instrumental systematics

The polarization of the cosmic microwave background (CMB) can be used to search for parity-violating processes like that predicted by a Chern-Simons coupling to a light pseudoscalar field. Such an interaction rotates E modes into E modes in the observed CMB signal through an effect known as cosmic birefringence. Even though isotropic birefringence can be confused with the rotation produced by a miscalibration of the detectors' polarization angles, the degeneracy between both effects is broken when Galactic foreground emission is used as a calibrator. Here, in this work, we use realistic simulations of the High-Frequency Instrument of the Planck mission to test the impact that Galactic foreground emission and instrumental systematics have on the recent birefringence measurements obtained through this technique. Our results demonstrate the robustness of the methodology against the miscalibration of polarization angles and other systematic effects, like intensity-to-polarization leakage, beam leakage, or cross-polarization effects. However, our estimator is sensitive to the EB correlation of polarized foreground emission. Here we propose to correct the bias induced by dust EB by modeling the foreground signal with templates produced in Bayesian component-separation analyses that fit parametric models to CMB data. Acknowledging the limitations of currently available dust templates like that of the Commander sky model, high-precision CMB data and a characterization of dust beyond the modified blackbody paradigm are needed to obtain a definitive measurement of cosmic birefringence in the future.

79 ASTRONOMY AND ASTROPHYSICS↗

Fiducial-cosmology-dependent systematics for the DESI 2024 full-shape analysis

We assess the impact of the fiducial cosmology choice on cosmological inference from full-shape (FS) fits of the galaxy power spectrum in the DESI 2024 Data Release 1 (DR1). Using a suite of AbacusSummit DR1 mock catalogues based on the Planck 2018 best-fit cosmology, we quantify potential systematic shifts introduced by analysing the data under five secondary cosmologies — featuring variations in matter density, thawing dark energy, higher effective number of neutrino species, reduced clustering amplitude, and the DESI DR1 BAO best-fit w 0 w a CDM cosmology — relative to DESI's baseline Planck 2018 cosmology. We investigate two complementary FS analysis approaches: full-modelling (FM) and ShapeFit (SF), each with distinct sensitivities to the assumed fiducial model. Across all tracers, we find for FM that systematic shifts induced by fiducial cosmology mismatches remain well below the DESI DR1 statistical uncertainties, with maximum deviations of 0.22σ DR1 in ΛCDM scenarios and 0.12σ DR1+SN when including SN Ia mock data in extended w 0 w a CDM fits. For SF, the shifts in the compressed parameters remain below 0.45σ DR1 for all tracers and cosmologies.

dark energy experiments↗

Probing Systematic Bias in Low-redshift Type Ia Supernova Measurements by Cross Analyzing Surface Brightness and Hubble Residuals

For low-redshift (z < 0.1) SN Ia samples used in several cosmological analyses over the past decade, we probe for systematic bias by looking for correlations between surface brightness (SB) measurements and Hubble residuals (HR). For 292 SNe Ia, we measure SB at the location of the SN Ia from publicly available Pan-STARRS (PS1) images. The Hubble residuals are from two recent measurements with low-z SNe Ia that overlap the PS1 footprint: (1) the DES 3 yr cosmology analysis, with 120 overlapping low-z SNe Ia from the Harvard-Smithsonian Center for Astrophysics surveys and Carnegie Supernova Project, and (2) the PS1 single-telescope analysis, with 172 overlapping low-z SNe Ia from the Foundation Supernova Survey. This study is motivated by previous reports of anomalous inefficiencies and flux scatter for transients on bright galaxies. Here, we compare HR distributions of the bright and faint halves of the SB distribution: the mean HR values differ by ${\rm{\Delta }}\overline{\mathrm{HR}}$ = 0.031 ± 0.018, consistent with no difference at the 2σ level. We also perform a Kolmogorov–Smirnov (KS) test for the bright and faint half HR distributions, and conclude that the two distributions are statistically consistent with a KS p-value of 0.07. However, if future studies with larger data sets find ${\rm{\Delta }}\overline{\mathrm{HR}}\sim 0.03$ with high significance, this difference would be a leading systematic uncertainty in measurements of the dark energy equation of state, w.

79 ASTRONOMY AND ASTROPHYSICS↗

The impact of light polarization effects on weak lensing systematics

ABSTRACT A fraction of the light observed from edge-on disc galaxies is polarized due to two physical effects: selective extinction by dust grains aligned with the magnetic field and scattering of the anisotropic starlight field. Since the reflection and transmission coefficients of the reflecting and refracting surfaces in an optical system depend on the polarization of incoming rays, this optical polarization produces both (a) a selection bias in favour of galaxies with specific orientations and (b) a polarization-dependent point spread function (PSF). In this work, we build toy models to obtain for the first time an estimate for the impact of polarization on PSF shapes and the impact of the selection bias due to the polarization effect on the measurement of the ellipticity used in shear measurements. In particular, we are interested in determining if this effect will be significant for Wide-Field Infrared Survey Telescope (WFIRST). We show that the systematic uncertainties in the ellipticity components are 8 × 10−5 and 1.1 × 10−4 due to the selection bias and PSF errors respectively. Compared to the overall requirements on knowledge of the WFIRST PSF ellipticity (4.7 × 10−4 per component), both of these systematic uncertainties are sufficiently close to the WFIRST tolerance level that more detailed studies of the polarization effects or more stringent requirements on polarization-sensitive instrumentation for WFIRST are required.

79 ASTRONOMY AND ASTROPHYSICS↗

Removing imaging systematics from galaxy clustering measurements with Obiwan: application to the SDSS-IV extended Baryon Oscillation Spectroscopic Survey emission-line galaxy sample

This article presents the application of a new tool, Obiwan, which uses image simulations to determine the selection function of a galaxy redshift survey and calculate three-dimensional (3D) clustering statistics. Obiwan relies on a forward model of the process by which images of the night sky are transformed into a 3D large-scale structure catalogue, and offers several advantages over more traditional map-based techniques – such as operating on individual exposures and adopting a maximum likelihood approach. The photometric pipeline automatically detects and models galaxies and then generates a catalogue of such galaxies with detailed information for each one of them, including their location, redshift, and so on. Systematic biases in the imaging data are therefore imparted into the catalogues and must be accounted for in any scientific analysis of their information content. Obiwan simulates this process for samples selected from the Legacy Surveys imaging data. This imaging data will be used to select target samples for the next-generation Dark Energy Spectroscopic Instrument (DESI) experiment. Here, we apply Obiwan to a portion of the SDSS-IV extended Baryon Oscillation Spectroscopic Survey emission-line galaxies (ELGs). Systematic biases in the data are clearly identified and removed. We compare the 3D clustering results to those obtained by the map-based approach applied to the complete eBOSS Data Release 16 (DR16) sample. We find the results are consistent, thereby validating the eBOSS DR16 ELG catalogues, which is used to obtain cosmological results.

79 ASTRONOMY AND ASTROPHYSICS↗

Dark Energy Survey Year 3 results: galaxy clustering and systematics treatment for lens galaxy samples

ABSTRACT In this work, we present the galaxy clustering measurements of the two DES lens galaxy samples: a magnitude-limited sample optimized for the measurement of cosmological parameters, maglim, and a sample of luminous red galaxies selected with the redmagic algorithm. maglim/redmagic sample contains over 10 million/2.5 million galaxies and is divided into six/five photometric redshift bins spanning the range z ∈ [0.20, 1.05]/z ∈ [0.15, 0.90]. Both samples cover 4143 $\deg ^2$ over which we perform our analysis blind, measuring the angular correlation function with an S/N ∼ 63 for both samples. In a companion paper, these measurements of galaxy clustering are combined with the correlation functions of cosmic shear and galaxy–galaxy lensing of each sample to place cosmological constraints with a 3 × 2pt analysis. We conduct a thorough study of the mitigation of systematic effects caused by the spatially varying survey properties and we correct the measurements to remove artificial clustering signals. We employ several decontamination methods with different configurations to ensure the robustness of our corrections and to determine the systematic uncertainty that needs to be considered for the final cosmology analyses. We validate our fiducial methodology using lognormal mocks, showing that our decontamination procedure induces biases no greater than 0.5σ in the (Ωm, b) plane, where b is the galaxy bias.

79 ASTRONOMY AND ASTROPHYSICS↗

Stellar population analysis of MaNGA early-type galaxies: IMF dependence and systematic effects

We study systematics associated with estimating simple stellar population (SSP) parameters – age, metallicity [M/H], α-enhancement [α/Fe], and initial mass function (IMF) shape – and associated M * /L gradients, of elliptical slow rotators (E-SRs), fast rotators (E-FRs), and S0s from stacked spectra of galaxies in the MaNGA survey. These systematics arise from (i) how one normalizes the spectra when stacking; (ii) having to subtract emission before estimating absorption line strengths; (iii) the decision to fit the whole spectrum or just a few absorption lines; (iv) SSP model differences (e.g. isochrones, enrichment, IMF). The MILES+Padova SSP models, fit to the H β , 〈Fe〉, TiO 2SDSS , and [MgFe] Lick indices in the stacks, indicate that out to the half-light radius R e : (a) ages are younger and [α/Fe] values are lower in the central regions but the opposite is true of [M/H]; (b) the IMF is more bottom-heavy in the center, but is close to Kroupa beyond about R e /2; (c) this makes M * /L about 2 × larger in the central regions than beyond R e /2. While the models of Conroy et al. return similar [M/H] and [α/Fe] profiles, the age and (hence) M * /L profiles can differ significantly even for solar abundances and a Kroupa IMF; different responses to non-solar abundances and IMF parametrization further compound these differences. There are clear (model independent) differences between E-SRs, E-FRs, and S0s: younger ages and less enhanced [α/Fe] values suggest that E-FRs and S0s are not SSPs, but relaxing this assumption is unlikely to change their inferred M * /L gradients significantly.

79 ASTRONOMY AND ASTROPHYSICS↗

Comparing the DES-SN5YR and Pantheon+ SN cosmology analyses: investigation based on ‘evolving dark energy or supernovae systematics’?

Recent cosmological analyses measuring distances of type Ia supernovae (SNe Ia) and baryon acoustic oscillations (BAO) have all given similar hints at time-evolving dark energy. To examine whether underestimated SN Ia systematics might be driving these results, Efstathiou (2025) compared overlapping SN events between Pantheon+ and DES-SN5YR (20 per cent SNe are in common), and reported evidence for an $\sim$0.04 mag offset between the low- and high-redshift distance measurements of this subsample of events. If this offset is arbitrarily subtracted from the entire DES-SN5YR sample, the preference for evolving dark energy is reduced. In this paper, we show that this offset is mostly due to different corrections for Malmquist bias between the two samples; therefore, an object-to-object comparison can be misleading. Malmquist bias corrections differ between the two analyses for several reasons. First, DES-SN5YR used an improved model of SN Ia luminosity scatter compared to Pantheon+ but the associated scatter-model uncertainties are included in the error budget. Secondly, improvements in host mass estimates in DES-SN5YR also affected SN standardized magnitudes and their bias corrections. Thirdly, and most importantly, the selection functions of the two compilations are significantly different, hence the inferred Malmquist bias corrections. Even if the original scatter model and host properties from Pantheon+ are used instead, the evidence for evolving dark energy from CMB, DESI BAO Year 1 and DES-SN5YR is only reduced from 3.9$\sigma$ to 3.3$\sigma$, consistent with the error budget. Finally, in this investigation, we identify an underestimated systematic uncertainty related to host galaxy property uncertainties, which could increase the final DES-SN5YR error budget by 3 per cent. In conclusion, we confirm the validity of the published DES-SN5YR results.

79 ASTRONOMY AND ASTROPHYSICS↗

Multicriteria Measures to Assess the Sustainability of Diets: A Systematic Review

Abstract Context Assessing the overall sustainability of a diet is a challenging undertaking requiring a holistic approach capable of addressing the multicriteria nature of this concept. Objective The aim was to identify and summarize the multicriteria measures used to assess the sustainability characteristics of diets reported at the individual level by healthy adults. Data Sources Articles were identified via PubMed, Scopus, and Web of Science. The search strategy consisted of key words and MeSH terms, and was concluded in September 2022, covering references in English, Spanish, and Portuguese. Data Extraction This systematic review followed the PRISMA guidelines. The search identified 5663 references, from which 1794 were duplicates. Two reviewers independently screened the titles and abstracts of each of the 3869 records and the full-text of the 144 references selected. Of these, 7 studies met the inclusion criteria. Data Analysis A total of 6 multicriteria measures were identified: 3 different Sustainable Diet Indices, the Quality Environmental Costs of Diet, the Quality Financial Costs of Diet, and the Environmental Impact of Diet. All of these incorporated a health/nutrition dimension, while the environmental and economic dimensions were the second and the third most integrated, respectively. A sociocultural sustainability dimension was included in only 1 of the measures. Conclusion Despite some methodological concerns in the development and validation process of the identified measures, their inclusion is considered indispensable in assessing the transition towards sustainable diets in future studies. Systematic Review Registration PROSPERO registration no. CRD42022358824.

Rei, Mariana (ORCID:0000000189453708)↗

Beta-Decay Half-Lives beyond 54 Ca: A Systematic Survey of Decay Properties Approaching the Neutron Dripline

In an experiment performed at the Facility for Rare Isotope Beams (FRIB) using the FRIB Decay Station initiator, 15 new half-lives of isotopes near 54 Ca were measured. A new method of extracting lifetimes from experimental data, taking into account the unknown 𝛽-delayed neutron emission branches of very neutron-rich nuclei, was developed to enable systematic uncertainty analysis. The experiment observed a dramatic change in the half-life systematics for the isotopes with neutron number 𝑁 = 34. Beyond 𝑁 = 34, the decline of nuclear lifetime is much slower, leading to longer than anticipated lifetimes for near-dripline nuclei. State-of-the-art shell-model calculations can explain the experimental results, revealing the imprint of shell effects and the need for modification of single-particle neutron states. In conclusion, the results from a newly developed quasiparticle random phase approximation model with potential for making global predictions were also tested against the experimental results and good agreement was found.

Physics - Nuclear physics and radiation physics↗

Systematic comparison and cross-validation of fixed-node diffusion Monte Carlo and phaseless auxiliary-field quantum Monte Carlo in solids

Quantum Monte Carlo (QMC) methods are some of the most accurate methods for simulating correlated electronic systems. Here, we investigate the compatibility, strengths, and weaknesses of two such methods, namely, diffusion Monte Carlo (DMC) and auxiliary-field quantum Monte Carlo (AFQMC). The multideterminant trial wave functions employed in both approaches are generated using the configuration interaction using a perturbative selection made iteratively (CIPSI) technique. Complete basis-set full configuration interaction energies estimated with CIPSI are used as a reference in this comparative study between DMC and AFQMC. By focusing on a set of canonical finite–size solid-state systems, we show that both QMC methods can be made to systematically converge towards the same energy once basis-set effects and systematic biases have been removed. AFQMC shows a much smaller dependence on the trial wave function than DMC while simultaneously exhibiting a much larger basis-set dependence. We outline some of the remaining challenges and opportunities for improving these approaches.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Cohesion and excitations of diamond-structure silicon by quantum Monte Carlo: Benchmarks and control of systematic biases

We have carried out quantum Monte Carlo (QMC) calculations of silicon crystal focusing on the accuracy and systematic biases that affect the electronic structure characteristics. The results show that 64 and 216 atom supercells provide an excellent consistency for extrapolated energies per atom in the thermodynamic limit for ground, excited, and ionized states. We have calculated the ground state cohesion energy with both systematic and statistical errors below ≈ 0.05 eV. The ground state exhibits a fixed-node error of only 1.3(2)% of the correlation energy, suggesting an unusually high accuracy of the corresponding single-reference trial wave function. We obtain a very good agreement between optical and quasiparticle gaps that affirms the marginal impact of excitonic effects. Our most accurate results for band gaps differ from the experiments by about 0.2 eV. This difference is assigned to a combination of residual finite-size and fixed-node errors. In conclusion, we have estimated the crystal Fermi level referenced to vacuum that enabled us to calculate the edges of valence and conduction bands in agreement with experiments.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗