Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data bias”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

Adversarial methods to reduce simulation bias in neutrino interaction event filtering at liquid argon time projection chambers

For current and future neutrino oscillation experiments using large liquid argon time projection chambers (LAr-TPCs), a key challenge is identifying neutrino interactions from the pervading cosmic-ray background. Rejection of such background is often possible using traditional cut-based selections, but this typically requires the prior use of computationally expensive reconstruction algorithms. This work demonstrates an alternative approach of using a 3D submanifold sparse convolutional network trained on low-level information from the scintillation light signal of interactions inside LAr-TPCs. This technique is applied to example simulations from ICARUS, the far detector of the short baseline neutrino program at Fermilab. The results of the network, show that cosmic background is reduced by up to 76.3% whilst neutrino interaction selection efficiency remains over 98.9%. We further present a way to mitigate potential biases from imperfect input simulations by applying domain adversarial neural networks (DANNs), for which modified simulated samples are introduced to imitate real data and a small portion of them are used for adversarial training. A series of mock-data studies are performed and demonstrate the effectiveness of using DANNs to mitigate biases, showing neutrino interaction selection efficiency performances significantly better than that achieved without the adversarial training.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Aggregation bias and its drivers in large‐scale flood loss estimation: A Massachusetts case study

Abstract Large‐scale estimations of flood losses are often based on spatially aggregated inputs. This makes risk assessments vulnerable to aggregation bias, a well‐studied, sometimes substantial outcome in analyses that model fine‐grained spatial phenomena at coarse spatial units. To evaluate this potential in the context of large‐scale flood risk assessments, we use data from a high‐resolution flood hazard model and structure inventory for over 1.3 million properties in Massachusetts and examine how prominent data aggregation approaches affect the magnitude and spatial distribution of flood loss estimates. All considered aggregation approaches rely on aggregate structure inventories but differ in whether flood hazard is also aggregated. We find that aggregating only structure inventories slightly underestimates overall losses (−10% bias), and when flood hazard data is spatially aggregated to even relatively small spatial units (census block), statewide aggregation bias can reach +366%. All aggregation‐based procedures fail to capture the spatial covariation of inputs distributions in the upper tails that disproportionately generate total expected losses. Our findings are robust to several key assumptions, add important context to published risk assessments and highlight opportunities to improve flood loss estimation uncertainty quantification.

54 ENVIRONMENTAL SCIENCES↗

Extracting the Breakout Distance from the ECOT Trajectories: Gaussian Process Regression Approach

Enhanced Corner Turning (ECOT) experiments provide an important metric of performance of high explosive (HE) formulations. The breakout distance is a single scalar value that characterizes the corner turning efficiency of an HE. Extracting the breakout distance from the raw ECOT results, whether experimental or simulated, is a conceptually straightforward procedure which, however, is non-unique, especially in the presence of noise. More specifically, this procedure involves numerical smoothing and selecting particular values for parameters of this smoothing introduces human bias. In this work, we propose to use the Gaussian process regression to analyze ECOT results. This analysis involves the effective smoothing of the data, thus allowing for accurate extraction of the breakout distance. Most importantly, the parameters of this smoothing can be inferred from the ECOT data itself, rendering the approach effectively parameter-free and thus diminishing the human bias. An additional benefit of the Gaussian process regression, being a statistical inference method, is that not just the value of the breakout distance, but also its confidence interval can be extracted from the data. This report introduces the Gaussian process regression, as applied to ECOT, and demonstrates its usefulness by extracting the breakout distances for a selection of experimental and simulated data.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Simulating the Effect of p-n Junction Fields on TRPL Transients of Thin-Film CdTe Solar Cells

Bias-dependent time-resolved photoluminescence (TRPL) transients of thin CdTe solar cells were simulated with the goal of characterizing the effect of p-n junction fields on photoluminescence decays. It was found that, although bulk lifetime could be accurately determined in field-free samples, electric field effects in solar cells lead to systematic underestimation of bulk lifetime. Modulating field strength with the application of external bias was found to have a major impact, a result corroborated by experimental data. In particular, p-n junction fields effects were found to be effectively suppressed when a cell is put far into forward bias, enabling accurate measurement of bulk lifetime in p-n junction structures.

CdTe↗

Comparison of Social Media, Syndromic Surveillance, and Microbiologic Acute Respiratory Infection Data: Observational Study

Internet data can be used to improve infectious disease models. However, the representativeness and individual-level validity of internet-derived measures are largely unexplored as this requires ground truth data for study. This study sought to identify relationships between Web-based behaviors and/or conversation topics and health status using a ground truth, survey-based dataset. This study leveraged a unique dataset of self-reported surveys, microbiological laboratory tests, and social media data from the same individuals toward understanding the validity of individual-level constructs pertaining to influenza-like illness in social media data. Logistic regression models were used to identify illness in Twitter posts using user posting behaviors and topic model features extracted from users’ tweets. Of 396 original study participants, only 81 met the inclusion criteria for this study. Of these participants’ tweets, we identified only two instances that were related to health and occurred within 2 weeks (before or after) of a survey indicating symptoms. It was not possible to predict when participants reported symptoms using features derived from topic models (area under the curve [AUC]=0.51; P=.38), though it was possible using behavior features, albeit with a very small effect size (AUC=0.53; P≤.001). Individual symptoms were also generally not predictable either. The study sample and a random sample from Twitter are predictably different on held-out data (AUC=0.67; P≤.001), meaning that the content posted by people who participated in this study was predictably different from that posted by random Twitter users. Individuals in the random sample and the GoViral sample used Twitter with similar frequencies (similar @ mentions, number of tweets, and number of retweets; AUC=0.50; P=.19). To our knowledge, this is the first instance of an attempt to use a ground truth dataset to validate infectious disease observations in social media data. The lack of signal, the lack of predictability among behaviors or topics, and the demonstrated volunteer bias in the study population are important findings for the large and growing body of disease surveillance using internet-sourced data.

59 BASIC BIOLOGICAL SCIENCES↗

Evaluating algorithmic bias on biomarker classification of breast cancer pathology reports

Objectives: This work evaluated algorithmic bias in biomarkers classification using electronic pathology reports from female breast cancer cases. Bias was assessed across 5 subgroups: cancer registry, race, Hispanic ethnicity, age at diagnosis, and socioeconomic status. Materials and Methods: We utilized 594 875 electronic pathology reports from 178 121 tumors diagnosed in Kentucky, Louisiana, New Jersey, New Mexico, Seattle, and Utah to train 2 deep-learning algorithms to classify breast cancer patients using their biomarkers test results. We used balanced error rate (BER), demographic parity (DP), equalized odds (EOD), and equal opportunity (EOP) to assess bias. Results: We found differences in predictive accuracy between registries, with the highest accuracy in the registry that contributed the most data (Seattle Registry, BER ratios for all registries >1.25). BER showed no significant algorithmic bias in extracting biomarkers (estrogen receptor, progesterone receptor, human epidermal growth factor receptor 2) for race, Hispanic ethnicity, age at diagnosis, or socioeconomic subgroups (BER ratio <1.25). DP, EOD, and EOP all showed insignificant results. Discussion: We observed significant differences in BER by registry, but no significant bias using the DP, EOD, and EOP metrics for socio-demographic or racial categories. This highlights the importance of employing a diverse set of metrics for a comprehensive evaluation of model fairness. Conclusion: A thorough evaluation of algorithmic biases that may affect equality in clinical care is a critical step before deploying algorithms in the real world. We found little evidence of algorithmic bias in our biomarker classification tool. Artificial intelligence tools to expedite information extraction from clinical records could accelerate clinical trial matching and improve care.

60 APPLIED LIFE SCIENCES↗

Modeling neutrino-induced scale-dependent galaxy clustering for photometric galaxy surveys

Abstract The increasing statistical precision of photometric redshift surveys requires improved accuracy of theoretical predictions for large-scale structure observables to obtain unbiased cosmological constraints. In ΛCDM cosmologies, massive neutrinos stream freely at small cosmological scales, suppressing the small-scale power spectrum. In massive neutrino cosmologies, galaxy bias modeling needs to accurately relate the scale-dependent growth of the underlying matter field to observed galaxy clustering statistics. In this work, we implement a computationally efficient approximation of the neutrino-induced scale-dependent bias (NISDB). Through simulated likelihood analyses of Dark Energy Survey Year 3 (DESY3) and Legacy Survey of Space and Time Year 1 (LSSTY1) synthetic data that contain an appreciable NISDB, we examine the impact of linear galaxy bias and neutrino mass modeling choices on cosmological parameter inference. We find model misspecification of the NISDB approximation and neutrino mass models to decrease the constraining power of photometric galaxy surveys and cause parameter biases in the cosmological interpretation of future surveys. We quantify these biases and devise mitigation strategies.

Astronomy & Astrophysics↗

Photo-zSNthesis: Converting Type Ia Supernova Lightcurves to Redshift Estimates via Deep Learning

Abstract Upcoming photometric surveys will discover tens of thousands of Type Ia supernovae (SNe Ia), vastly outpacing the capacity of our spectroscopic resources. In order to maximize the scientific return of these observations in the absence of spectroscopic information, we must accurately extract key parameters, such as SN redshifts, with photometric information alone. We present Photo- z SNthesis, a convolutional neural network-based method for predicting full redshift probability distributions from multi-band supernova lightcurves, tested on both simulated Sloan Digital Sky Survey (SDSS) and Vera C. Rubin Legacy Survey of Space and Time data as well as observed SDSS SNe. We show major improvements over predictions from existing methods on both simulations and real observations as well as minimal redshift-dependent bias, which is a challenge due to selection effects, e.g., Malmquist bias. Specifically, we show a 61× improvement in prediction bias 〈Δ z 〉 on PLAsTiCC simulations and 5× improvement on real SDSS data compared to results from a widely used photometric redshift estimator, LCFIT+Z. The PDFs produced by this method are well constrained and will maximize the cosmological constraining power of photometric SNe Ia samples.

79 ASTRONOMY AND ASTROPHYSICS↗

Combining Planck and SPT Cluster Catalogs: Cosmological Analysis and Impact on the Planck Scaling Relation Calibration

We provide the first combined cosmological analysis of the South Pole Telescope (SPT) and Planck cluster catalogs. The aim is to provide an independent calibration for Planck scaling relations, exploiting the cosmological constraining power of the SPT-SZ cluster catalog and its dedicated weak lensing (WL) and X-ray follow-up observations. We build a new version of the Planck cluster likelihood. In the νΛ CDM scenario, focusing on the mass slope and mass bias of Planck scaling relations, we find ${\alpha }_{\mathrm{SZ}}={1.49}_{-0.10}^{+0.07}$ and ${\left(1-b\right)}_{\mathrm{SZ}}={0.69}_{-0.14}^{+0.07}$, respectively. The results for the mass slope show a ~4 σ departure from the self-similar evolution, α SZ ~ 1.8. This shift is mainly driven by the matter density value preferred by SPT data, Ωm = 0.30 ± 0.03, lower than the one obtained by Planck data alone, ${{\rm{\Omega }}}_{m}={0.37}_{-0.06}^{+0.02}$. The mass bias constraints are consistent both with outcomes of hydrodynamical simulations and external WL calibrations, (1 – b) ~ 0.8, and with results required by the Planck cosmic microwave background cosmology, (1 – b) ~ 0.6. From this analysis, we obtain a new catalog of Planck cluster masses M 500 . We estimate the ratio between the published Planck M SZ masses and our derived masses M 500 , as a "measured mass bias," ${\left(1-b\right)}_{M}$. We analyze the mass, redshift, and detection noise dependence of ${\left(1-b\right)}_{M}$, finding an increasing trend toward high redshift and low mass. These results mimic the effect of departure from self-similarity in cluster evolution, showing different dependencies for the low-mass, high-mass, low-z, and high-z regimes.

79 ASTRONOMY AND ASTROPHYSICS↗

Plutonium in Manhattan Project workers: Using autopsy data to evaluate organ content and dose estimates based on urine bioassay with implications for radiation epidemiology

Purpose Radiation dose estimates in epidemiology typically rely on intake predictions based on urine bioassay measurements. The purpose of this article is to compare the conventional dosimetric estimates for radiation epidemiology with the estimates based on additional post-mortem tissue radiochemical analysis results. Methods The comparison was performed on a unique group of 11 former Manhattan Project nuclear workers, who worked with plutonium in the 1940s, and voluntarily donated their bodies to the United States Transuranium and Uranium Registries. Results Post-mortem organ activities were predicted using different sets of urine data and compared to measured activities. Use of urinalysis data collected during the exposure periods overestimated the systemic (liver+skeleton) deposition of 239 Pu by 155±134%, while the average bias from using post-exposure urinalyses was –4±50%. Committed effective doses estimated using early urine data differed from the best estimate by, on average, 196±193%; inclusion of follow-up urine measurements in analyses decreased the mean bias to 0.6±36.3%. Cumulative absorbed doses for the liver, red marrow, bone surface, and brain were calculated for the actual commitment period. Conclusion On average, post-exposure urine bioassay results were in good agreement with post-mortem tissue analyses and were more reliable than results of urine bioassays collected during the exposure.

60 APPLIED LIFE SCIENCES↗

Quasi-Classical Trajectory Calculation of Rate Constants Using an Ab Initio Trained Machine Learning Model (aML-MD) with Multifidelity Data

Machine learning (ML) provides a great opportunity for the construction of models with improved accuracy in classical molecular dynamics (MD). However, the accuracy of a ML trained model is limited by the quality and quantity of the training data. Generating large sets of accurate ab initio training data can require significant computational resources. Furthermore, inconsistent or incompatible data with different accuracies obtained using different methods may lead to biased or unreliable ML models that do not accurately represent the underlying physics. Recently, transfer learning showed its potential for avoiding these problems as well as for improving the accuracy, efficiency, and generalization of ML models using multifidelity data. In this work, ab initio trained ML-based MD (aML-MD) models are developed through transfer learning using DFT and multireference data from multiple sources with varying accuracy within the Deep Potential MD framework. Further, the accuracy of the force field is demonstrated by calculating rate constants for the H + HO 2 → H 2 + 3 O 2 reaction using quasi-classical trajectories. We show that the aML-MD model with transfer learning can accurately predict the rate constants while reducing the computational cost by more than five times compared to the use of more expensive quantum chemistry training data sets. Hence, the aML-MD model with transfer learning shows great potential in using multifidelity data to reduce the computational cost involved in generating the training set for these potentials.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Seeing through noise in power laws

Despite widespread claims of power laws across the natural and social sciences, evidence in data is often equivocal. Modern data and statistical methods reject even classic power laws such as Pareto’s law of wealth and the Gutenberg–Richter law for earthquake magnitudes. We show that the maximum-likelihood estimators and Kolmogorov–Smirnov (K-S) statistics in widespread use are unexpectedly sensitive to ubiquitous errors in data such as measurement noise, quantization noise, heaping and censorship of small values. This sensitivity causes spurious rejection of power laws and biases parameter estimates even in arbitrarily large samples, which explains inconsistencies between theory and data. We show that logarithmic binning by powers of λ > 1 attenuates these errors in a manner analogous to noise averaging in normal statistics and that λ thereby tunes a trade-off between accuracy and precision in estimation. Binning also removes potentially misleading within-scale information while preserving information about the shape of a distribution over powers of λ, and we show that some amount of binning can improve sensitivity and specificity of K-S tests without any cost, while more extreme binning tunes a trade-off between sensitivity and specificity. We therefore advocate logarithmic binning as a simple essential step in power-law inference.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Seeing through noise in power laws

Despite widespread claims of power laws across the natural and social sciences, evidence in data is often equivocal. Modern data and statistical methods reject even classic power laws such as Pareto’s law of wealth and the Gutenberg–Richter law for earthquake magnitudes. We show that the maximum-likelihood estimators and Kolmogorov–Smirnov (K-S) statistics in widespread use are unexpectedly sensitive to ubiquitous errors in data such as measurement noise, quantization noise, heaping and censorship of small values. This sensitivity causes spurious rejection of power laws and biases parameter estimates even in arbitrarily large samples, which explains inconsistencies between theory and data. We show that logarithmic binning by powers of λ > 1 attenuates these errors in a manner analogous to noise averaging in normal statistics and that λ thereby tunes a trade-off between accuracy and precision in estimation. Binning also removes potentially misleading within-scale information while preserving information about the shape of a distribution over powers of λ, and we show that some amount of binning can improve sensitivity and specificity of K-S tests without any cost, while more extreme binning tunes a trade-off between sensitivity and specificity. We therefore advocate logarithmic binning as a simple essential step in power-law inference.

97 MATHEMATICS AND COMPUTING↗

Phonon-informed Neural Thermal Scattering (NeTS) Optimization for Crystalline Graphite and Beryllium Metal

Fast neutrons born from fission lose energy through scattering interactions in the process of slowing-down. As neutrons thermalize to the order of $k$ $b$ $T$ (where $k$ $b$ is the Boltzmann constant, and $T$ is the temperature of the medium), their de Broglie wavelength and energy approaches the order of inter-atomic spacing and quantized lattice vibrations, i.e., phonons. At thermal energies, the thermal scattering law (TSL), i.e., $S$($α, β$), captures crystal binding contributions to the total reaction rate, or cross section. This dimensionless material property describes the energy ($β$) and momentum ($α$) exchanges available in a medium. Currently, $S$($α, β$) is evaluated in the Full Law Analysis Scattering System Hub (FLASSH) code for discrete inputs and stored as ENDF/B File 7 for 0-phonon elastic (MT 2) and n-phonon inelastic (MT 4) processes. Further processing recasts $S$($α, β$) into cumulative distribution functions for sampling post-collision scattering kinematics. In practice, interpolation schemes are employed to access data between tabulated values. An improvement to this juncture of the nuclear data pipeline is supplying cross sections on-the-fly (OTF), as has been developed for the un-resolved resonance region to minimize non-physical interpolation errors. This capability may improve simulation accuracy for accident and transient analyses, where rapidly varying changes in temperature and pressure are difficult to predict beforehand. To do so, deep artificial neural networks (ANNs) can be employed which collapse non-linear, complex data into a lightweight dictionary of neural weights and biases. This has been successfully demonstrated for the hydrogen in light water $S$($α, β$) dataset in the form of a Neural Thermal Scattering (NeTS) module. In this work, the NeTS framework is extended to consider the impact of material-dependent dynamical features on optimal neural pre-processing and architecture design decisions, such as number of neurons per hidden layer, residual skip connections and neural depth. New NeTS modules for crystalline graphite and beryllium metal illuminate a novel correlation between dynamical nonlinearity and optimal neural parametrization when deploying $S$($α, β$) on-the-fly.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Statistical Downscaling of Climate Models for Solar Resource Assessment

This study presents the development of statistical models to efficiently downscale future projections of solar irradiance for solar energy applications. A climate data set simulated from a Regional Climate Model (RCM) obtained from the North American Coordinated Regional Climate Downscaling Experiment (NA-CORDEX) is selected as input to the statistical models to create high-resolution global horizontal irradiance (GHI) over the contiguous United States (CONUS). Our approach builds statistical downscaling models that (1) regrid RCM data (0.22 degree and daily spatiotemporal resolution), (2) correct bias of GHI projections, (3) downscale the future GHI project from daily-scale to hourly-scale, and (4) spatially downscale to generate GHI at 8-km resolution. To calibrate and validate the statistical models, we adapt and use the National Solar Radiation Database (NSRDB). Preliminary results show that the statistical downscaling approach downscales future projections of GHI under two climate scenarios (RCP4.5 and RCP8.5) with a nBIAS of 3%, nMAE of 34% and nRMSE of 46% estimated against NSRDB for the contiguous United State. This presentation will summarize the implemented methodology and validation results as well as future extension of this research.

climate data↗

How Low Can You Go? Using Synthetic 3D Imagery to Drastically Reduce Real-World Training Data for Object Detection

Deep convolutional neural networks (DCNNs) currently provide state-of-the-art performance on image classification and object detection tasks, and there are many global security mission areas where such models could be extremely useful. Crucially, the success of these models is driven in large part by the widespread availability of high-quality open source data sets such as Image Net, Common Objects in Context (COCO), and KITTI, which contain millions of images with thousands of unique labels. However, global security relevant objects-of-interest can be difficult to obtain: relevant events are low frequency and high consequence; the content of relevant images is sensitive; and adversaries and proliferators seek to obscure their activities. For these cases where exemplar data is hard to come-by, even fine-tuning an existing model with available data can be effectively impossible. Recent work demonstrated that models can be trained using a combination of real-world and synthetic images generated from 3D representations; that such models can exceed the performance of models trained using real-world data alone; and that the generated images need not be perfectly realistic (Tremblay, et al., 2018). However, this approach still required hundreds to thousands of real-world images for training and fine tuning, which for sparse, global security-relevant datasets can be an unrealistic hurdle. In this research, we validate the performance and behavior of DCNN models as we drive the number of real-world images used for training object detection tasks down to a minimal set. We perform multiple experiments to identify the best approach to train DCNNs from an extremely small set of real-world images. In doing so, we: Develop state-of-the-art, parameterized 3D models based on real-world images and sample from their parameters to increase the variance in synthetic image training data; Use machine learning explainability techniques to highlight and correct through targeted training the biases that result from training using completely synthetic images; and Validate our results by comparing the performance of the models trained on synthetic data to one another, and to a control model created by fine-tuning an existing ImageNet-trained model with a limited number (hundreds) of real-world images.

97 MATHEMATICS AND COMPUTING↗

Quantifying albedo susceptibility biases in shallow clouds

The evaluation of radiative forcing associated with aerosol–cloud interactions remains a significant source of uncertainty in future climate projections. The problem is confounded by the fact that aerosol particles influence clouds locally and that averaging to larger spatial and/or temporal scales carries biases that depend on the heterogeneity and spatial correlation of the interacting fields and the nonlinearity of the responses. Mimicking commonly applied satellite data analyses for calculation of albedo susceptibility S o , we quantify S o aggregation biases using an ensemble of 127 large eddy simulations of marine stratocumulus. We explore the cloud field properties that control this spatial aggregation bias and quantify the bias for a large range of shallow stratocumulus cloud conditions manifesting a variety of morphologies and ranges of cloud fractions. We show that S o spatial aggregation biases can be on the order of hundreds of percent, depending on the methodology. Key uncertainties emanate from the typically applied adiabatic drop concentration N d retrieval, the correlation between aerosol and cloud fields, and the extent to which averaging reduces the variance in cloud albedo A c and N d . So biases are more often positive than negative and are highly correlated with biases in the liquid water path adjustment. Temporal aggregation biases are shown to offset spatial aggregation biases. Both spatial and temporal biases have significant implications for observationally based assessments of aerosol indirect effects and our inferences of underlying aerosol–cloud–radiation effects.

54 ENVIRONMENTAL SCIENCES↗

CMDV-RRM: Representation of Clouds and Convection Across Scales in E3SM (Final Report)

We have made three accomplishments as a participant of the LLNL-led CMDV-RRM project. The first is the derivation of 3D high-resolution atmospheric variational analysis (VAR) at 2 x 2 km resolution by integrating ARM data and operational analysis for a domain of approximately 450 x 400 km centered at the ARM SGP facility for several MC3E convective events and used the analyzed data to evaluate E3SM RRM and as forcing data for E3SM SCM. The second accomplishment is the demonstration of elevated maximum moist static energy during the night over the ARM SGP that was not accounted for in the default E3SM convection scheme. The third accomplishment is the explanation of the cause of the dry and warm biases over the SGP common to many climate models by using ARM data. We found that the precipitation deficit associated with lack of strong rainfall events in the summer is the main cause of the warm bias over the SGP.

42 ENGINEERING↗