Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “VALIDATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 775 records · Page 43
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Electromagnetic shower reconstruction and energy validation with Michel electrons and π 0 samples for the deep-learning-based analyses in MicroBooNE

This article presents the reconstruction of the electromagnetic activity from electrons and photons (showers) used in the MicroBooNE deep learning-based low energy electron search. The reconstruction algorithm uses a combination of traditional and deep learning-based techniques to estimate shower energies. We validate these predictions using two v μ -sourced data samples: charged/neutral current interactions with final state neutral pions and charged current interactions in which the muon stops and decays within the detector producing a Michel electron. Both the neutral pion sample and Michel electron sample demonstrate agreement between data and simulation. Finally, the absolute shower energy scale is shown to be consistent with the relevant physical constant of each sample: the neutral pion mass peak and the Michel energy cutoff.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

A new calibration method for charm jet identification validated with proton-proton collision events at $\sqrt{s}$ =13 TeV

Many measurements at the LHC require efficient identification of heavy-flavour jets, i.e. jets originating from bottom (b) or charm (c) quarks. An overview of the algorithms used to identify c jets is described and a novel method to calibrate them is presented. This new method adjusts the entire distributions of the outputs obtained when the algorithms are applied to jets of different flavours. It is based on an iterative approach exploiting three distinct control regions that are enriched with either b jets, c jets, or light-flavour and gluon jets. Results are presented in the form of correction factors evaluated using proton-proton collision data with an integrated luminosity of 41.5 fb$^{-1}$ at √s = 13 TeV, collected by the CMS experiment in 2017. The closure of the method is tested by applying the measured correction factors on simulated data sets and checking the agreement between the adjusted simulation and collision data. Furthermore, a validation is performed by testing the method on pseudodata, which emulate various mismodelling conditions. The calibrated results enable the use of the full distributions of heavy-flavour identification algorithm outputs, e.g. as inputs to machine-learning models. Thus, they are expected to increase the sensitivity of future physics analyses.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Validation of the VUV-reflective coating for next-generation liquid xenon detectors

Abstract Coating detector materials with films highly reflective in the vacuum ultraviolet region improves sensitivity of the next-generation rare-event detectors that use liquid xenon. In this work, we investigate the MgF 2 -Al-MgF 2 coating designed to achieve high reflectance at 175 nm, the mean wavelength of liquid xenon (LXe) scintillation. The coating was applied to an unpolished, passivated copper substrate mimicking a realistic detector component of the proposed nEXO experiment, as well as to two unpassivated substrates with “high” and “average” levels of polishing. After confirming the composition and morphology of the thin-film coating using TEM and EDS, the samples underwent reflectance measurements in LXe and gaseous nitrogen (GN2). Measurements in LXe exposed the coated samples to -100°C for several hours. No peeling of the coatings was observed after several thermal cycles. Polishing is found to strongly correlate with the measured specular reflectance (R spec ). In particular, 5.8(5)% specular spike reflectance in LXe was measured for the realistic sample at 20° of incidence, while the values for similar angles of incidence on the high and average polish samples are 62.3(1.3)% and 27.4(7)%, respectively. At large angles (66°–75°), theR spec in LXe for the three samples increases to 23(5)%, 80(8)%, and 84(18)%, respectively. The R spec at around 45° was measured in both GN2 and LXe for average polish sample and shows a reasonable agreement. Importantly, the total reflectance of the samples is comparable and estimated to be 92(8)%, 85(8)%, and 83(8)% in GN2 for the realistic, average, and high polish samples, respectively. This is considered satisfactory for the next-generation LXe experiments that could benefit from using reflective films, such as nEXO and DARWIN, thus validating the design of the coating.

Instruments & Instrumentation↗
DOE OSTI2021

Experimental validation of the Finite Element-Multibody model of a cryomodule during road transportation

The present activity aims to test the Transportation Tooling (TT) designed for the Cryomodule SSR1 at Fermilab facilities. The tests consisted of road transportation trials of a cryomodule sub-assembly, suspended on a truck using the designed TT. The truck drove along a path inside Fermilab facilities. The trial was performed at an approximate speed of about 25 km/h, which is close to the transportation conditions of the complete Cryomodule. Several accelerometers were mounted on the Transportation Tooling frame and the cryomodule sub-assembly. This allowed comparing the vibration behavior of the inner frame of the TT with the solicitation coming from the truck loading bed, to assess the filtering capabilities of the tooling. Also, the acceleration of the main components could be monitored during the whole transportation, to obtain a validation of the developed numerical model.

43 PARTICLE ACCELERATORS↗
DOE OSTI2026

Validating and Comparing Energy Estimation Methods at Water Resource Recovery Facilities

Water resource recovery facilities play a crucial role in the water-energy nexus, consuming a substantial amount of energy in the United States. Growing treatment volumes and more stringent water quality standards are expected to increase the amount of energy needed to treat wastewater, but accurately estimating energy consumption and potential remains challenging due to variability in scale, treatment methods, and effluent treatment standards. In this study, we used publicly available data to evaluate the accuracy of methods for estimating energy consumption and generation, then quantified uncertainty based on key factors like flow rate, treatment level, and geographic location. To validate methods, we estimated energy consumption and generation at the facility-level, then compared estimates to self-reported data from utilities in major U.S. cities. We found that process models of treatment trains under best practice configurations were accurate relative to other methods for estimating electricity use, total energy use, and electricity generation from biogas utilization, and less complex methods based on effluent treatment level and prime movers also performed well for estimating electricity consumption and generation, respectively. Applying the evaluated methods to a national inventory of treatment facilities, we estimate that annual energy consumption ranged from 56.3 x 10^3 to 82.5 x 10^3 TJ in 2012 and 83.6 x 10^3 to 127 x 10^3 TJ in 2042. Our results indicate that not all estimation methods are suited for every use case, so we recommend that researchers and practitioners select an estimation method based on data availability and desired computational intensity.

Hodson, Abigayle↗
DOE OSTI2022

Source scaling comparison and validation in Central Italy: data intensive direct S waves versus the sparse data coda envelope methodology

SUMMARY Robustness of source parameter estimates is a fundamental issue in understanding the relationships between small and large events; however, it is difficult to assess how much of the variability of the source parameters can be attributed to the physical source characteristics or to the uncertainties of the methods and data used to estimate the values. In this study, we apply the coda method by Mayeda et al. using the coda calibration tool (CCT), a freely available Java-based code (https://github.com/LLNL/coda-calibration-tool) to obtain a regional calibration for Central Italy for estimating stable source parameters. We demonstrate the power of the coda technique in this region and show that it provides the same robustness in source parameter estimation as a data-driven methodology [generalized inversion technique (GIT)], but with much fewer calibration events and stations. The Central Italy region is ideal for both GIT and coda approaches as it is characterized by high-quality data, including recent well-recorded seismic sequences such as L'Aquila (2009) and Amatrice–Norcia–Visso (2016–2017). This allows us to apply data-driven methods such as GIT and coda-based methods that require few, but high-quality data. The data set for GIT analysis includes ∼5000 earthquakes and more than 600 stations, while for coda analysis we used a small subset of 39 events spanning 3.5 < Mw < 6.33 and 14 well-distributed broad-band stations. For the common calibration events, as well as an additional 247 events (∼1.7 < Mw < ∼5.0) not used in either calibration, we find excellent agreement between GIT-derived and CCT-derived source spectra. This confirms the ability of the coda approach to obtain stable source parameters even with few calibration events and stations. Even reducing the coda calibration data set by 75 per cent, we found no appreciable degradation in performance. This validation of the coda calibration approach over a broad range of event size demonstrates that this procedure, once extended to other regions, represents a powerful tool for future routine applications to homogeneously evaluate robust source parameters on a national scale. Furthermore, the coda calibration procedure can homogenize the Mw estimates for small and large events without the necessity of introducing any conversion scale between narrow-band measures such as local magnitude (ML) and Mw, which has been shown to introduce significant bias.

Morasca, Paola (ORCID:0000000265254867)↗
DOE OSTI2020

Dark Energy Survey Year 3 results: cosmology with moments of weak lensing mass maps – validation on simulations

ABSTRACT We present a simulated cosmology analysis using the second and third moments of the weak lensing mass (convergence) maps. The second moment, or variances, of the convergence as a function of smoothing scale contains information similar to standard shear two-point statistics. The third moment, or the skewness, contains additional non-Gaussian information. The analysis is geared towards the third year (Y3) data from the Dark Energy Survey (DES), but the methodology can be applied to other weak lensing data sets. We present the formalism for obtaining the convergence maps from the measured shear and for obtaining the second and third moments of these maps given partial sky coverage. We estimate the covariance matrix from a large suite of numerical simulations. We test our pipeline through a simulated likelihood analyses varying 5 cosmological parameters and 10 nuisance parameters and identify the scales where systematic or modelling uncertainties are not expected to affect the cosmological analysis. Our simulated likelihood analysis shows that the combination of second and third moments provides a 1.5 per cent constraint on S8 ≡ σ8(Ωm/0.3)0.5 for DES Year 3 data. This is 20 per cent better than an analysis using a simulated DES Y3 shear two-point statistics, owing to the non-Gaussian information captured by the inclusion of higher order statistics. This paper validates our methodology for constraining cosmology with DES Year 3 data, which will be presented in a subsequent paper.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Cluster cosmology with anisotropic boosts: validation of a novel forward modelling analysis and application on SDSS redMaPPer clusters

We present a novel analysis for cluster cosmology that fully forward models the abundances, weak lensing, and the clustering of galaxy clusters. Our analysis notably includes an empirical model for the anisotropic boosts impacting the lensing and clustering signals of optical clusters. These boosts arise from a preferential selection of clusters surrounded by anisotropic large-scale structure, a consequence of the limited discrimination between line-of-sight interlopers and true cluster members offered by photometric surveys. We validate our analysis via a blind cosmology challenge on mocks, and find that we can obtain tight and unbiased cosmological constraints without informative priors or external calibrations on any of our model parameters. We then apply our analysis on the SDSS redMaPPer clusters, and find results favoring low Ωm and high σ8, combining to yield the lensing strength constraint $S_8 = 0.715_{-0.021}^{+0.024}$. We investigate potential drivers behind these results through a series of post-unblinding tests, noting that our results are consistent with existing cluster cosmology constraints but clearly inconsistent with other CMB/LSS based cosmology results. From these tests, we find hints that a suppression in the cluster lensing signal may be driving our results.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Primordial non-Gaussianity with angular correlation function: integral constraint and validation for DES

ABSTRACT Local primordial non-Gaussianity (PNG) is a promising observable of the underlying physics of inflation, characterized by $f_{\rm NL}^{\rm loc}$. We present the methodology to measure $f_{\rm NL}^{\rm loc}$ from the Dark Energy Survey (DES) data using the two-point angular correlation function (ACF) with scale-dependent bias. One of the focuses of the work is the integral constraint (IC). This condition appears when estimating the mean number density of galaxies from the data and is key in obtaining unbiased $f_{\rm NL}^{\rm loc}$ constraints. The methods are analysed for two types of simulations: ∼246 goliat-png N-body small area simulations with fNL equal to −100 and 100, and 1952 Gaussian ice-cola mocks with fNL = 0 that follow the DES angular and redshift distribution. We use the ensemble of goliat-png mocks to show the importance of the IC when measuring PNG, where we recover the fiducial values of fNL within the 1σ when including the IC. In contrast, we found a bias of ΔfNL ∼ 100 when not including it. For a DES-like scenario, we forecast a bias of ΔfNL ∼ 23, equivalent to 1.8σ, when not using the IC for a fiducial value of fNL = 100. We use the ice-cola mocks to validate our analysis in a realistic DES-like set-up finding it robust to different analysis choices: best-fitting estimator, the effect of IC, BAO damping, covariance, and scale choices. We forecast a measurement of fNL within σ(fNL) = 31 when using the DES-Y3 BAO sample, with the ACF in the 1 deg < θ < 20 deg range.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

The Alcock–Paczynski effect from Lyman- α forest correlations: analysis validation with synthetic data

The three-dimensional distribution of the Ly α forest has been extensively used to constrain cosmology through measurements of the baryon acoustic oscillations (BAO) scale. However, more cosmological information could be extracted from the full shapes of the Ly α forest correlations through the Alcock–Paczynski (AP) effect. In this work, we prepare for a cosmological analysis of the full shape of the Ly α forest correlations by studying synthetic data of the extended Baryon Oscillation Spectroscopic Survey (eBOSS). We use a set of 100 eBOSS synthetic data sets in order to validate such an analysis. These mocks undergo the same analysis process as the real data. We perform a full-shape analysis on the mean of the correlation functions measured from the 100 eBOSS realizations, and find that our model of the Ly α correlations performs well on current data sets. We show that we are able to obtain an unbiased full-shape measurement of D M /D H (z eff ), where D M is the transverse comoving distance, D H is the Hubble distance, and z eff is the effective redshift of the measurement. We test the fit over a range of scales, and decide to use a minimum separation of r min = 25 h –1 Mpc. Here, we also study and discuss the impact of the main contaminants affecting Ly α forest correlations, and give recommendations on how to perform such analysis with real data. While the final eBOSS Ly α BAO analysis measured D M /D H (z eff = 2.33) with 4 per cent statistical precision, a full-shape fit of the same correlations could provide an $\sim 2~{{\ \rm per\ cent}}$ measurement.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Validating sequential Monte Carlo for gravitational-wave inference

Nested sampling (NS) is the preferred stochastic sampling algorithm for gravitational-wave inference for compact binary coalescences. It can handle the complex nature of the gravitational-wave likelihood surface and provides an estimate of the Bayesian model evidence. However, there is another class of algorithms that meets the same requirements, but has not been used for gravitational-wave analyses: sequential Monte Carlo (SMC), an extension of importance sampling that maps samples from an initial density to a target density via a series of intermediate densities. In this work, we validate a type of SMC algorithm, called persistent sampling (PS), for gravitational-wave inference. We consider a range of different scenarios including binary black holes and binary neutron stars and real and simulated data and show that PS produces results that are consistent with NS whilst being, on average, 2 times more efficient and 2.74 times faster. This demonstrates that PS is a viable alternative to NS that should be considered for future gravitational-wave analyses.

black hole mergers↗
DOE OSTI2025

Validation of the ESPRESSO wavelength calibration using iodine absorption cell spectra

ABSTRACT High-quality wavelength calibration is crucial for science cases like radial-velocity studies of exoplanets, the search for a possible variation of fundamental constants, and the redshift drift experiment. However, for state-of-the-art spectrographs, it has become difficult to verify the wavelength calibration on sky because no astrophysical source provides spectra with sufficiently stable or accurate wavelength information. We therefore propose to use iodine absorption cells to validate the wavelength calibration. Observing a bright and featureless star through the iodine cell emulates an astrophysical target with exactly known spectral features that can be analysed like any other science target, allowing to verify the wavelength calibration derived from the internal calibration sources and to identify systematics in the data processing. As demonstration, we temporarily installed an $\mathrm{I_2}$ absorption cell at ESPRESSO. Employing a full forward modelling approach of the $\mathrm{I_2}$ spectrum, including the instrumental line-spread function, we demonstrate wavelength calibration accuracy at the level of a few $\mathrm{m\,s^{-1}}$. We also show that wavelength measurements do depend on the geometry of the light-injection into the spectrograph fibers. This highlights the importance of probing exactly the same light path as science targets, something not possible with internal calibration sources alone. We also demonstrate excellent radial-velocity stability at the ${{< 20\, \mathrm{cm\,s^{-1}}}}$ level in a full end-to-end fashion, from sky to data product. Our study therefore showcases the great potential of absorption cells for the verification and long-term monitoring of the wavelength calibration as well as the unique insights they can provide.

Schmidt, Tobias M. (ORCID:0000000248337273)↗
DOE OSTI2022

MIBiG 3.0: a community-driven effort to annotate experimentally validated biosynthetic gene clusters

Abstract With an ever-increasing amount of (meta)genomic data being deposited in sequence databases, (meta)genome mining for natural product biosynthetic pathways occupies a critical role in the discovery of novel pharmaceutical drugs, crop protection agents and biomaterials. The genes that encode these pathways are often organised into biosynthetic gene clusters (BGCs). In 2015, we defined the Minimum Information about a Biosynthetic Gene cluster (MIBiG): a standardised data format that describes the minimally required information to uniquely characterise a BGC. We simultaneously constructed an accompanying online database of BGCs, which has since been widely used by the community as a reference dataset for BGCs and was expanded to 2021 entries in 2019 (MIBiG 2.0). Here, we describe MIBiG 3.0, a database update comprising large-scale validation and re-annotation of existing entries and 661 new entries. Particular attention was paid to the annotation of compound structures and biological activities, as well as protein domain selectivities. Together, these new features keep the database up-to-date, and will provide new opportunities for the scientific community to use its freely available data, e.g. for the training of new machine learning models to predict sequence-structure-function relationships for diverse natural products. MIBiG 3.0 is accessible online at https://mibig.secondarymetabolites.org/.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Validation of the DESI DR2 measurements of baryon acoustic oscillations from galaxies and quasars

The Dark Energy Spectroscopic Instrument (DESI) Data Release 2 (DR2) galaxy and quasar clustering data represents a significant expansion of data from Data Release 1 (DR1), providing improved statistical precision in baryon acoustic oscillation (BAO) constraints across multiple tracers, including bright galaxies, luminous red galaxies, emission line galaxies, and quasars. In this paper, we validate the BAO analysis of DR2. We present the results of robustness tests on the blinded DR2 data and, after unblinding, consistency checks on the unblinded DR2 data. All results are compared with those obtained from a suite of mock catalogs that replicate the selection and clustering properties of the DR2 sample. We confirm the consistency of DR2 BAO measurements with DR1 while achieving a reduction in statistical uncertainties due to the increased survey volume and completeness. The combined BAO precision, including both statistical and systematic errors, improves from ∼0.52% in DR1 to 0.30% in DR2—a factor of 1.7 gain. We assess the impact of analysis choices, including different data vectors (correlation function vs power spectrum), modeling approaches and systematics treatments, and an assumption of the Gaussian likelihood, finding that our BAO constraints are stable across these variations and assumptions with a few minor refinements to the baseline setup of the DR1 BAO analysis. We summarize a series of pre-unblinding tests that confirmed the readiness of our analysis pipeline, the final systematic errors, and the DR2 BAO analysis baseline. The successful completion of these tests led to the unblinding of the DR2 BAO measurements, ultimately leading to the DESI DR2 cosmological analysis, with their implications for the expansion history of the Universe and the nature of dark energy presented in the DESI key paper (companion paper).

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Modeling and experimental validation of dynamical effects in Bragg coherent x-ray diffractive imaging of finite crystals

Bragg coherent diffractive imaging (BCDI) is a noninvasive microscopy technique that can visualize the shape and internal lattice deviations of crystals with nanoscale spatial resolution and picometer deformation sensitivity. Its strain imaging capability relies on Fourier transform–based iterative phase retrieval algorithms, which are mostly developed under the kinematical approximation. Such approximation prohibits the application of BCDI on larger crystals, which are commonly seen in most emerging functional materials. Understanding the dynamical effect in BCDI, as well as developing a validated method for modeling BCDI at the dynamical diffraction limit, is crucial for applying BCDI to hierarchical systems that contain micron-sized crystals and grains. Thus we report a comparative study on the impact of dynamical diffraction effects by comparing the reconstruction results from two measurements of the same crystal. Forward simulation is implemented to show subtle changes of interference fringes in the diffraction pattern due to the dynamical diffraction, and is compared directly with the experimental data.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Model validation and error attribution for a drifting qubit

Qubit performance is often reported in terms of a variety of single-value metrics, each providing a facet of the underlying noise mechanism limiting performance. However, the value of these metrics may drift over long timescales, and reporting a single number for qubit performance fails to account for the low-frequency noise processes that give rise to this drift. Here, in this work, we demonstrate how we can use the distribution of these values to validate or invalidate candidate noise models. We focus on the case of randomized benchmarking (RB), where typically a single error rate is reported but this error rate can drift over time when multiple passes of RB are performed. We show that using a statistical test as simple as the Kolmogorov-Smirnov statistic on the distribution of RB error rates can be used to rule out noise models, assuming the experiment is performed over a long enough time interval to capture relevant low frequency noise. With confidence in a noise model, we show how care must be exercised when performing error attribution using the distribution of drifting RB error rate.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2020

Validity of standard model EFT studies of V H and V V production at NLO

The production of $W^±H, ZH, W^+W^-$, and $W^±Z$ pairs probes non-Standard-Model interactions of quarks, gauge bosons, and the Higgs boson. New effects can be parameterized in terms of an effective field theory (EFT) where the Lagrangian is expanded in terms of higher-dimension operators suppressed by increasing powers of a high scale Λ. We examine the importance of including next-to-leading-order QCD corrections in global fits to the coefficients of the EFT. The numerical implications on the fits due to different approaches to enforcing the validity of the EFT are quantified. We pay particular attention to the dependence of the fits on the ex-pansion in 1/Λ 2 since the differences between results calculated at $\mathcal{O}$(1/Λ 2 ) and $\mathcal{O}$(1/Λ 4 ) may give insight into the possible significance of dimension-8 effects.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

Optical galaxy cluster mock catalogs with realistic projection effects: Validations with the SDSS clusters

Galaxy clusters identified in optical imaging surveys suffer from projection effects: Physically unassociated galaxies along a cluster’s line of sight can be counted as its members and boost the observed richness (the number of cluster members). To model the impact of projection on cluster cosmology analyses, we apply a halo occupation distribution model to 𝑁-body simulations to simulate the red galaxies contributing to cluster members, and we use the number of galaxies in a cylinder along the line of sight (counts in cylinders) to model the impact of projection on cluster richness. We compare three projection models: uniform, quadratic, and Gaussian, and we convert between them by matching their effective cylinder volumes. We validate our mock catalogs using SDSS redMaPPer clusters’ data vectors, including counts vs richness, stacked lensing signal, spectroscopic redshift distribution of member galaxies, and richness remeasured on a redshift grid. We find the former two are insensitive to the projection model, while the latter two favor a quadratic projection model with a width of ≈180 ℎ −1 Mpc (equivalent to the volume of a uniform model with a width of 100 ℎ −1 Mpc and a Gaussian model with a width of 110 ℎ −1 Mpc, or a Gaussian redshift error of 0.04). Furthermore, our framework provides an efficient and flexible way to model optical cluster data vectors, paving the way for a simulation-based joint analysis for clusters, galaxies, and shear.

79 ASTRONOMY AND ASTROPHYSICS↗