Engineering PapersSearch

SEARCH · Engineering Papers

Results for “BLINDNESS”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Validating the galaxy and quasar catalog-level blinding scheme for the DESI 2024 analysis

In the era of precision cosmology, ensuring the integrity of data analysis through blinding techniques is paramount — a challenge particularly relevant for the Dark Energy Spectroscopic Instrument (DESI). DESI represents a monumental effort to map the cosmic web, with the goal to measure the redshifts of tens of millions of galaxies and quasars. Given the data volume and the impact of the findings, the potential for confirmation bias poses a significant challenge. To address this, we implement and validate a comprehensive blind analysis strategy for DESI Data Release 1 (DR1), tailored to the specific observables DESI is most sensitive to: Baryonic Acoustic Oscillations (BAO), Redshift-Space Distortion (RSD) and primordial non-Gaussianities (PNG). We carry out the blinding at the catalog level, implementing shifts in the redshifts of the observed galaxies to blind for BAO and RSD signals and weights to blind for PNG through a scale-dependent bias. We validate the blinding technique on mocks as well as on data by applying a second blinding layer to perform a series of sanity checks; the latter allows probing complexities in real data not captured in mocks. We find that the blinding strategy alters the data vector in a controlled way, and the BAO and RSD analysis choices are robust to blinding. The successful validation of the blinding strategy paves the way for the unblinded DESI DR1 analysis, alongside future blind analyses with DESI and other surveys.

79 ASTRONOMY AND ASTROPHYSICS

Catalog-level blinding on the bispectrum for DESI-like galaxy surveys

We evaluate the performance of the catalog-level blind analysis technique (blinding) presented in Brieden et al. (2020) in the context of a fixed template power spectrum and bispectrum analysis. This blinding scheme, which is tailored for galaxy redshift surveys similar to the Dark Energy Spectroscopic Instrument (DESI), has two components: the so-called “AP blinding” (concerning the dilation parameters α$_{∥}$, α$_{⊥}$) and “RSD blinding” (redshift space distortions, affecting the growth rate parameter f). Through extensive testing, including checks for the RSD part in cubic boxes, the impact of AP blinding on mocks with realistic survey sky coverage, and the implementation of a full AP+RSD blinding pipeline, our analysis demonstrates the effectiveness of the technique in preserving the integrity of cosmological parameter estimation when the analysis includes the bispectrum statistic. We emphasize the critical role of sophisticated — and difficult to accidentally unblind — blinding methods in precision cosmology.

79 ASTRONOMY AND ASTROPHYSICS

Blinding scheme for the scale-dependence bias signature of local primordial non-Gaussianity for DESI 2024

The next generation of spectroscopic surveys is expected to achieve an unprecedented level of accuracy in the measurement of cosmological parameters. To avoid confirmation bias and thereby improve the reliability of these results, blinding procedures become a standard practice in the cosmological analyses of such surveys. Blinding is especially crucial when the impact of observational systematics is important relative to the cosmological signal, and a detection of that signal would have significant implications. This is the case for local primordial non-gaussianity, as probed by the scale-dependent bias of the galaxy power spectrum at large scales that are heavily sensitive to the dependence of the target selection on the imaging quality, known as imaging systematics. We propose a blinding method for the scale-dependent bias signature of local primordial non-gaussianity at the density field level which consists in generating a set of weights for the data that replicate the scale-dependent bias. The applied blinding is predictable, and can be straightforwardly combined with other catalog-level blinding procedures that have been designed for the baryon acoustic oscillation and redshift space distortion signals. The procedure is validated through simulations that replicate data from the first year of observation of the Dark Energy Spectroscopic Instrument, but may find applications to other upcoming spectroscopic surveys.

79 ASTRONOMY AND ASTROPHYSICS

Smokescreen: A Python package for data vector blinding and encryption in cosmological analyses

Smokescreen is an open-source Python library for data-vector concealment (blinding) in cosmological analyses. Data-vector blinding works by applying cosmology-dependent shifts to the observed data vector, moving it away from the true cosmological signal without affecting its statistical properties, so that analysts cannot infer the true result until the analysis is frozen and the blinding is lifted. The package computes these shifts using Firecrown likelihoods applied to data vectors stored in the SACC format, ensuring that the theoretical model used for blinding is identical to that used for inference whilst remaining agnostic to the specific observable being blinded. To prevent accidental unblinding, the original SACC file, containing the true cosmology, is encrypted. Although developed for the Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST), Smokescreen is applicable to any experiment using Firecrown likelihoods and the SACC data format.

Loureiro, Arthur [Stockholm U., OKC; Imperial Coll

Alcock-Paczynski Blinding Scheme for the Ly-$α$ Forest Analysis

We present and validate a blinding method for the Lyman-$α$ (Ly$α$) forest analysis based on a modification of the Alcock-Paczynski test. In order to hide the background expansion history, the method employs a geometrical shift of each quasar (QSO) forest in wavelength space, once the quasar continuum has been fitted and the fluctuation field is extracted. The redshift positions for the QSO sample are also changed in a consistent manner. We show that the method remains effective when applied to real data, where contamination from metals and Lyman-$β$ is intrinsically mixed with the Lyman-$α$ forest. This limitation is primarily visible in the 1D correlation function, where other blinding strategies can mitigate the effect. To assess its effectiveness, the prescription is tested against a series of datasets of increasing complexity: from idealized low-noise mocks, to realistic DESI year one synthetic datasets, and finally to data from DESI first data release (DR1), using both the auto (Ly$α\times$Ly$α$) and cross (Ly$α\times$ QSO) correlations. We find that the method robustly shifts the BAO peak position from the 3D correlation functions to the expected value for cosmology changes of around 5% in the matter content, without altering the shape of the posteriors in the model parameters. In conclusion, this catalog-level blinding strategy is a viable method for cosmological inference with the Lyman-$α$ forest, particularly if a cross-analysis with other tracers using the same blinding strategy is pursued.

Perez-Sanchez, G. [Guanajuato U.] (ORCID:000900096

Feature review of photovoltaic modeling software utilizing blind performance assessment

While confidence in photovoltaic (PV) modeling software has always been essential, the rapid pace of new PV plant developments makes accuracy and credibility more critical than ever. Independent assessments, particularly through blind modeling comparisons, are therefore necessary to ensure unbiased benchmarking across PV modeling software. Previous studies have been limited by a narrow range of models compared, anonymized results, or system size. This study presents results from the first-ever onymous blind modeling comparison, evaluated using both lab- and utility-scale fixed-tilt, monofacial, south-facing systems at sub-hourly time intervals. Seven commercially used PV software tools were compared: 3E SynaptiQ, PlantPredict, PVsyst, RatedPower, SAM, SolarFarmer, and Solargis Evaluate. Predictions were submitted directly by software representatives, providing unique insights into each software’s implementation and resulting prediction behavior. Notable features, including plane-of-array (POA) transposition model, module temperature model, shading model, and performance model were analyzed and compared. Four summary tables compile these features of the software, serving as a resource to help users understand the methodological differences and select the most suitable software for their applications. The software tools show deviations from mean error in annual yield up to 2.5 % in the lab-scale system, increasing to 6.0 % for the utility-scale system. These differences arise from a combination of user decisions and the inherent behavior of the software, indicating the need for continuous and rigorous validation of modeling methods using these software tools against complex, real-world systems.

14 SOLAR ENERGY

Blind QC trend presentation

Blind testing is used to evaluate performance of the radiobioassay laboratory. DOE-STD-1112-2019 requires a radiobioassay program to perform blind testing at a documented frequency including accuracy, false positive, false negative, and sensitivity evaluations. INL trends accuracy determinations over time for bias, agreement, and precision. Trends have been identified for certain isotopes in urine and feces that have not been fully explained. This presentation will review those identified trends and discuss possible causes and solutions.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA

Enhanced UV–Vis Rejection Ratio in Metal/BaTiO 3 /β–Ga 2 O 3 Solar–Blind Photodetectors

The fabrication and characterization of metal/BaTiO 3 /β-Ga 2 O 3 solar-blind photodetectors are reported. β-Ga 2 O 3 is a promising material for solar-blind photodetectors due to its large bandgap and the availability of low defect-density melt-grown substrates. In this work, structures are introduced that employ high-permittivity dielectric/semiconductor heterojunctions to enhance the performance of a Schottky photodetector. It is shown that integrating the high-k dielectric BaTiO 3 reduces the dark current by ≈10 4 , all but eliminates illumination induced Schottky barrier lowering, and increases the UV–vis rejection ratio by a factor greater than 9 × 10 3 compared to a Schottky photodetector. It is hypothesized that the high permittivity of the dielectric overcomes the influence of self-trapped holes in Ga 2 O 3 to reduce the peak electric field at the dielectric/metal interface, thereby eliminating the effects of Schottky barrier lowering on illuminated β-Ga 2 O 3 photodetectors. Additionally, it is hypothesized that the increase in the UV–vis rejection ratio is caused by the “dead layer” that forms at the BaTiO 3 /Pt interface.

36 MATERIALS SCIENCE

The seventh blind test of crystal structure prediction: structure generation methods

A seventh blind test of crystal structure prediction was organized by the Cambridge Crystallographic Data Centre featuring seven target systems of varying complexity: a silicon and iodine-containing molecule, a copper coordination complex, a near-rigid molecule, a cocrystal, a polymorphic small agrochemical, a highly flexible polymorphic drug candidate, and a polymorphic morpholine salt. In this first of two parts focusing on structure generation methods, many crystal structure prediction (CSP) methods performed well for the small but flexible agrochemical compound, successfully reproducing the experimentally observed crystal structures, while few groups were successful for the systems of higher complexity. A powder X-ray diffraction (PXRD) assisted exercise demonstrated the use of CSP in successfully determining a crystal structure from a low-quality PXRD pattern. The use of CSP in the prediction of likely cocrystal stoichiometry was also explored, demonstrating multiple possible approaches. Crystallographic disorder emerged as an important theme throughout the test as both a challenge for analysis and a major achievement where two groups blindly predicted the existence of disorder for the first time. Additionally, large-scale comparisons of the sets of predicted crystal structures also showed that some methods yield sets that largely contain the same crystal structures.

Chemistry

The Tribomechadynamics Research Challenge: Confronting blind predictions for the linear and nonlinear dynamics of a thin-walled jointed structure with measurement results

The present article summarizes the submissions to the Tribomechadynamics Research Challenge announced in 2021. The task was a blind prediction of the vibration behavior of a system comprising a thin plate clamped on two sides via bolted joints. Both geometric and frictional contact nonlinearities are expected to be relevant. Provided were the CAD models and technical drawings of all parts as well as assembly instructions. The main objective was to predict the frequency and damping ratio of the lowest-frequency mode as function of the amplitude. Many different prediction approaches were pursued, ranging from well-known methods to very recently developed ones. After the submission deadline, the system has been fabricated and tested. The aim of this article is to evaluate the current state of the art in modeling and vibration prediction, and to provide directions for future methodological advancements.

42 ENGINEERING

Requirements on the gain calibration for LiteBIRD polarisation data with blind component separation

The detection of primordial B modes of the cosmic microwave background (CMB) could provide information about the early stages of the Universe's evolution. The faintness of this signal requires exquisite calibration accuracy and control of instrumental systematic effects which otherwise could bias the measurements. In this work, we study the impact of an imperfect relative polarisation gain calibration on the recovered value of the tensor-to-scalar ratio r for the LiteBIRD experiment, through the application of the blind Needlet Internal Linear Combination (NILC) foreground-cleaning method. We derive requirements on the relative calibration accuracy of the overall polarisation gain (Δg ν ) for each LiteBIRD frequency channel. Our results show that minimum variance techniques, as NILC, are less sensitive to systematic gain calibration uncertainties compared to a parametric approach, if the latter is not equipped with a proper modelling of these instrumental effects. In this study, the most stringent requirements are found in the channels where the CMB signal is relatively brighter, with the tightest constraints at 166 GHz (Δg ν ≈ 0.16%). This differs from the outcome of an analogous analysis performed with a parametric method, where the tightest requirements are obtained for the foreground-dominated channels. Gain calibration uncertainties, corresponding to the derived requirements, are then simultaneously propagated into all frequency channels. By doing so, we find that the overall impact on estimated r is lower than the total gain systematic budget for LiteBIRD approximately by a factor 5, due to the correlations of the impacts of gain calibration uncertainties in different frequency channels. In order to decouple the systematic effect from the specific choice of the model, we derive the requirements assuming constant spectral parameters for the foreground emission. To assess the robustness of the obtained results against more realistic scenarios, we repeat the analysis assuming sky models of intermediate and high complexity. In these further cases, we adopt an optimised NILC pipeline, called the Multi-Clustering NILC (MC-NILC). We find that the impact of gain calibration uncertainties on r is lower than the LiteBIRD gain systematics budget for the intermediate-complexity sky model. For the high-complexity case, instead, it would be necessary to tighten the requirements by a factor 1.8.

79 ASTRONOMY AND ASTROPHYSICS

The seventh blind test of crystal structure prediction: structure ranking methods

A seventh blind test of crystal structure prediction has been organized by the Cambridge Crystallographic Data Centre. The results are presented in two parts, with this second part focusing on methods for ranking crystal structures in order of stability. The exercise involved standardized sets of structures seeded from a range of structure generation methods. Participants from 22 groups applied several periodic DFT-D methods, machine learned potentials, force fields derived from empirical data or quantum chemical calculations, and various combinations of the above. In addition, one non-energy-based scoring function was used. Results showed that periodic DFT-D methods overall agreed with experimental data within expected error margins, while one machine learned model, applying system-specific AIMnet potentials, agreed with experiment in many cases demonstrating promise as an efficient alternative to DFT-based methods. For target XXXII, a consensus was reached across periodic DFT methods, with consistently high predicted energies of experimental forms relative to the global minimum (above 4 kJ mol −1 at both low and ambient temperatures) suggesting a more stable polymorph is likely not yet observed. The calculation of free energies at ambient temperatures offered improvement of predictions only in some cases (for targets XXVII and XXXI). Several avenues for future research have been suggested, highlighting the need for greater efficiency considering the vast amounts of resources utilized in many cases.

Chemistry

A MUSE source-blind survey for emission from the circumgalactic medium

The recent detection of optical emission lines from the circumgalactic medium (CGM) in combined, large samples of low-redshift, normal galaxy spectra hints at the potential to map the cool (∼10 4 kelvin) CGM in individual, representative galaxies. Using archival data from a forefront instrument (MUSE) on the VLT, we present a source-blind, wide-redshift-range (z∼ 0 to 5) narrowband imaging survey for CGM emission. Our detected, resolved emission line sources are cataloged and include a 30-kiloparsec-wide Hα source likely tracing the CGM of a low-mass galaxy (stellar mass ∼ 10 8.78±0.42 solar mass) atz= 0.1723, a 60-kiloparsec-wide Ly α structure associated with a galaxy atz= 3.9076, and a 130-kiloparsec (∼r vir )–wide [O II] feature revealing an interaction between a galaxy pair atz= 1.2480. The Hα velocity field for the low-mass galaxy suggests that the CGM is more chaotic or turbulent than the galaxy disk, while that for the interacting galaxies shows large-scale (∼50 kiloparsec) coherent motions.

Science & Technology - Other Topics

RNA-Puzzles Round V: blind predictions of 23 RNA structures

RNA-Puzzles is a collective endeavor dedicated to the advancement and improvement of RNA three-dimensional structure prediction. With agreement from structural biologists, RNA structures are predicted by modeling groups before publication of the experimental structures. We report a large-scale set of predictions by 18 groups for 23 RNA-Puzzles: 4 RNA elements, 2 Aptamers, 4 Viral elements, 5 Ribozymes and 8 Riboswitches. We describe automatic assessment protocols for comparisons between prediction and experiment. Our analyses reveal some critical steps to be overcome to achieve good accuracy in modeling RNA structures: identification of helix-forming pairs and of non-Watson–Crick modules, correct coaxial stacking between helices and avoidance of entanglements. Three of the top four modeling groups in this round also ranked among the top four in the CASP15 contest.

59 BASIC BIOLOGICAL SCIENCES