Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data bias”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Cosmology from weak lensing peaks and minima with Subaru Hyper Suprime-Cam Survey first-year data

We present cosmological constraints derived from peak counts, minimum counts, and the angular power spectrum of the Subaru Hyper Suprime-Cam first-year (HSC Y1) weak lensing shear catalogue. Weak lensing peak and minimum counts contain non-Gaussian information and hence are complementary to the conventional two-point statistics in constraining cosmology. In this work, we forward-model the three summary statistics and their dependence on cosmology, using a suite of N-body simulations tailored to the HSC Y1 data. We investigate systematic and astrophysical effects including intrinsic alignments, baryon feedback, multiplicative bias, and photometric redshift uncertainties. We mitigate the impact of these systematics by applying cuts on angular scales, smoothing scales, signal-to-noise ratio bins, and tomographic redshift bins. By combining peaks, minima, and the power spectrum, assuming a flat-ΛCDM model, we obtain S 8 ≡ σ 8 $\sqrt{Ω_m/0.3}$ = 0.810$^{+0.022}_{-0.026}$⁠, a 35 per cent tighter constraint than that obtained from the angular power spectrum alone. Our results are in agreement with other studies using HSC weak lensing shear data, as well as with Planck 2018 cosmology and recent CMB lensing constraints from the Atacama Cosmology Telescope and the South Pole Telescope.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Deciphering the Scattering of Mechanically Driven Polymers Using Deep Learning

Here, we present a deep learning approach for analyzing two-dimensional scattering data of semiflexible polymers under external forces. In our framework, scattering functions are compressed into a three-dimensional latent space using a Variational Autoencoder (VAE), and two converter networks establish a bidirectional mapping between the polymer parameters (bending modulus, stretching force, and steady shear) and the scattering functions. The training data are generated using off-lattice Monte Carlo simulations to avoid the orientational bias inherent in lattice models, ensuring robust sampling of polymer conformations. The feasibility of this bidirectional mapping is demonstrated by the organized distribution of polymer parameters in the latent space. By integrating the converter networks with the VAE, we obtain a generator that produces scattering functions from given polymer parameters and an inferrer that directly extracts polymer parameters from scattering data. While the generator can be utilized in a traditional least-squares fitting procedure, the inferrer produces comparable results in a single pass and operates 3 orders of magnitude faster. This approach offers a scalable automated tool for polymer scattering analysis and provides a promising foundation for extending the method to other scattering models, experimental validation, and the study of time-dependent scattering data.

Ding, Lijie [Oak Ridge National Laboratory (ORNL),↗
DOE OSTI2023

Combining Remotely Sensed Evapotranspiration and an Agroecosystem Model to Estimate Center‐Pivot Irrigation Water Use at High Spatio‐Temporal Resolution

Abstract Estimating irrigation water use accurately is critical for sustainable irrigation and studying terrestrial water cycle in irrigated croplands. However, irrigation is not monitored in most places, and current estimations of irrigation water use has coarse spatial and/or temporal resolutions. This study aims to estimate irrigation water use at the daily and field scale through the proposed model‐data fusion framework, which is achieved by particle filtering with two configurations (concurrent, CON, and sequential, SEQ) by assimilating satellite‐based evapotranspiration (ET) observations into an advanced agroecosystem model, ecosys . Two types of experiments using synthetic and real ET observations were conducted to study the efficacy of the proposed framework for estimating irrigation water use at the irrigated fields in eastern and western Nebraska, United States. The experiments using synthetic ET observations indicated that, for two major sources of uncertainties of ET difference between observations and model simulations, which are bias and noise, noise had larger impacts on degrading the estimation performance of irrigation water use than bias. For the experiments using real ET observations, monthly and annual estimations of irrigation water use matched well with farmer irrigation records, with Pearson correlation coefficient ( r ) around 0.80 and 0.50, respectively. Although detecting daily irrigation records was very challenging, our method still gave a good performance with RMSE, BIAS, and r around 2.90, 0.03, and 0.4 mm/d, respectively. Our proposed model‐data fusion framework for estimating irrigation water use at high spatio‐temporal resolution could contribute to regional water management, sustainable irrigation, and better tracking terrestrial water cycle.

Environmental Sciences & Ecology↗
DOE OSTI2026

Mitigating Algorithmic Bias in Cancer Site Classification Models

Purpose Integrating artificial intelligence in cancer diagnostics has improved tumor classification beyond rule-based systems. Despite these advancements, these models may still encode demographic biases. We conducted a large-scale, applied bias-probing study of a deep learning–based cancer site classifier to quantify race information encoded in document embeddings. We then evaluated how performance changes when race-correlated embedding dimensions are removed in a post-training sensitivity analysis. Methods The cancer site classifier was trained using 3.5 million electronic cancer pathology reports from six of the National Cancer Institute's SEER registries. We trained a hierarchical self-attention network to generate 400-dimensional document embeddings. These embeddings were used to train two downstream, gradient-boosted decision tree classifiers: one to classify the cancer sites and another to predict racial categories. We identified overlapping features by intersecting the top 50 feature-importance rankings from the site and race models and computed their cumulative feature importance in each model. As a post hoc sensitivity analysis, we progressively pruned these overlapping dimensions, retrained the site model, and compared overall macro-F1 and accuracy, race-stratified macro-F1, and group fairness metrics on the basis of demographic parity and equalized odds before and after pruning. Results The analysis revealed minimal feature overlap between the cancer site and race prediction models, and the cumulative importance scores indicated a negligible influence of racial information on clinical predictions. Post-training pruning of overlapping features did not compromise the models' diagnostic accuracy, with a 0.07% loss in accuracy. Conclusion Our findings demonstrate that HiSAN-generated embeddings from SEER data can be used effectively in cancer site classification without significant demographic bias influencing the outcomes. Post-training pruning therefore functions as a practical audit and sensitivity check.

Shivanna, Abhishek [ORNL] (ORCID:0009000665228593)↗
DOE OSTI2026

Gearbox bearing crack growth prognostics and uncertainty quantification with physics-informed machine learning

This paper introduces the extreme theory of functional connections (X-TFC), a physics-informed machine learning algorithm, and tailors it to estimate the remaining useful life (RUL) of wind turbine gearbox bearings experiencing fatigue crack growth. Unlike purely data-driven methods, X-TFC embeds a physics model, based on Head's theory in this work, into its training objective. The core of X-TFC is a random-projection single-layer neural network trained via an extreme learning machine, which requires only limited damage progression data and solves for output weights with a least-squares optimization algorithm. A composite loss function balances the network's fit to observed degradation data against the residuals of the governing crack growth differential equation, ensuring the learned damage trajectory remains physically plausible. When applied to a vibration-based health-index (HI) dataset measured during the growth of a crack on the inner ring of a high-speed bearing in a wind turbine gearbox (Bechhoefer and Dubé, 2020), X-TFC achieves near-zero prediction bias. Even when trained on only the first 10 %–20 % of the damage progression data, with sufficient physics weighting its predictions remain monotonic and smooth, delivering high prognosability and trendability. To quantify the epistemic uncertainty, we employ a Monte Carlo ensemble of independently initialized X-TFC models trained on noise-perturbed data, which yields confidence intervals around each RUL estimate and captures both model-parameter and epistemic uncertainty. In addition to a vibration-based HI, we demonstrate that the proposed framework can be directly applied to a supervisory control and data acquisition (SCADA) data-based HI (Eftekhari Milani et al., 2026) measured during similar wind turbine gearbox bearing crack faults, preserving its accuracy and interpretability. This extension shows the versatility of our approach, which is applicable to bearings of multiple gearbox manufacturers, models, and ratings using only SCADA data. By integrating domain knowledge with machine learning, X-TFC offers a rapid, reliable tool for crack prognostics. Its adaptability to other bearing failure modes, such as pitch bearing ring cracks, positions X-TFC as a powerful enabler of data-driven, physics-informed asset management in the wind energy sector and beyond.

17 WIND ENERGY↗
DOE OSTI2026

Inverse Mapping of the Collision Kernel and Wall Flux Scaling in a Tall Convection‐Cloud Chamber Using Local Sensors and Knowledge‐Informed Deep Learning

Droplet collision–coalescence is a crucial process in cloud physics, but accurately representing this process under different dynamical conditions remains challenging. A proposed future convective‐cloud chamber aims to investigate this key process, but the method for observing it remains unclear, even though it is theoretically established that collision‐coalescence will occur. This study serves as a proof‐of‐concept demonstration of how knowledge‐informed deep learning, combined with measurement data from local sensors in the chamber, can be used to estimate the collision kernels, which determine how the droplet size distribution evolves during collision‐coalescence. In addition to estimating the collision kernel, we also address wall fluxes, another uncertain but important process that acts as a source of heat and moisture in the chamber. Ensemble runs of large‐eddy simulations are conducted by scaling the wall fluxes and the collision kernel, while the measured flow and cloud properties are used as inputs for a neural network. Results indicate that this approach successfully maps the scaling of wall fluxes and the collision kernel with biases of approximately 1% or less relative to the range of the target data. This proof‐of‐concept lays the groundwork for future applications; when the real measurements are available, real sensor data combined with the trained model presented in this work will enable estimation of the actual wall fluxes and collision kernel.

cloud chamber↗
DOE OSTI2020

Machine learning and ligand binding predictions: A review of data, methods, and obstacles

We report that computational predictions of ligand binding is a difficult problem, with more accurate methods being extremely computationally expensive. The use of machine learning for drug binding predictions could possibly leverage the use of biomedical big data in exchange for time-intensive simulations. This paper reviews current trends in the use of machine learning for drug binding predictions, data sources to develop machine learning algorithms, and potential problems that may lead to overfitting and ungeneralizable models. A few popular datasets that can be used to develop virtual high-throughput screening models are characterized using spatial statistics to quantify potential biases. We can see from evaluating some common benchmarks that good performance correlates with models with high-predicted bias scores and models with low bias scores do not have much predictive power. A better understanding of the limits of available data sources and how to fix them will lead to more generalizable models that will lead to novel drug discovery.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Nonequilibrium steady-state thermoelectrics of Kondo-correlated quantum dots

The transport across a Kondo-correlated quantum dot coupled to two leads with independent temperatures and chemical potentials is studied using a controlled nonperturbative, and in this sense numerically exact, treatment based on a hybrid numerical renormalization group combined with time-dependent density matrix renormalization group (NRG-tDMRG). In the Kondo regime, for sufficiently large fixed voltage bias V ≳ T K , with T K the Kondo temperature, we find a peak in the conductance vs the temperature gradient Δ⁢T = T R - T L across left and right lead. Focusing then on zero voltage bias but finite ΔT far beyond linear response, we reveal the dependence of the characteristic zero-bias conductance on the individual lead temperatures. Here, we find that the finite-Δ⁢T data behaves quantitatively similar to linear response with an effective equilibrium temperature derived from the different lead temperatures. The regime of sign changes in the Seebeck coefficient, signaling the presence of Kondo correlations, and its dependence on the individual lead temperatures provide a complete picture of the Kondo regime in the presence of finite-temperature gradients. The results from the zero-bias conductance and Seebeck coefficient studies unveil an approximate “Kondo circle” in the T L /T R plane as the regime within which the Kondo correlations dominate. We also study the heat current and the corresponding heat conductance vs finite Δ⁢T. We provide a polynomial fit for our numerical results for the thermocurrent as a function of the individual lead temperatures, which may be used to fit experimental data in the Kondo regime.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2025

Accurate Dark Energy Constraints via the Precise Characterization of Galaxy Intrinsic Alignment Coupled with Shear and Redshift Interference

One of the most fundamental mysteries we face in physics is understanding what the nature of the dark energy component of our Universe is that causes the accelerated expansion of space. A powerful way to study dark energy is via weak gravitational lensing due to large-scale structure in the Universe, which we observe as tiny distortions in the shapes of very distant galaxies due to the bending of light by foreground mass. The Dark Energy Survey (DES) and Vera C. Rubin Observatory Legacy Survey of Space and Time (LSST) were designed to enable unprecedented measurements of these distortions in the shapes of galaxies to study dark energy. The intrinsic shapes of galaxies before they are distorted by weak gravitational lensing can cancel out some of the effects of lensing to obscure or bias what we infer about the nature of dark energy. This research program has led to improved image-level simulations of the Rubin Observatory LSST data. These simulations have made it possible to characterize for the first time the cosmic impact of these intrinsic shapes on biasing weak gravitational lensing calibration. This work will inform crucial improvements in methodology for studying dark energy with weak gravitational lensing at the precision promised by the the Rubin Observatory LSST over the next decade to ensure we are able to infer unbiased information about the nature of dark energy.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Resolving root causes of experiment discrepancies guided by machine learning

Abstract Scientists rely on accurate experimental data to explain nature and then harness this knowledge for applications addressing human needs. However, discrepancies between experiments of the same observable can impede scientific progress if one does not understand the underlying causes. Here, we developed a process that unravels data discrepancies by first using Bayesian machine learning to relate discrepancies to few of many, potentially biasing metadata features that encode experiment procedures. This machine learning output guides human experts to study discrepancy causes by simulating suspicious aspects of historical experiments or designing modern ones to address open questions. The study findings then lead to rejecting or correcting historical data on firm scientific bases. This process is demonstrated for the energy spectrum of neutrons emitted promptly (<1 ns) after fission of 252 Cf, a trusted nuclear physics Standard. It reduces the spread in experimental 252 Cf spectra by up to a factor of 6.

Neudecker, D. (ORCID:0000000339200627)↗
DOE OSTI2022

An independent analysis of bias sources and variability in wind plant pre-construction energy yield estimation methods

The wind resource assessment community has long had the goal of reducing the bias between wind plant pre-construction energy yield assessment (EYA) and the observed annual energy production (AEP). This comparison is typically made between the 50% probability of exceedance (P50) value of the EYA and the long-term corrected operational AEP (hereafter OA P50), and is known as the P50 bias. The industry has critically lacked an independent analysis of bias reduction investigated across multiple consultants to identify the greatest sources of uncertainty and variance in the EYA process and the best opportunities for uncertainty reduction. The present study addresses this gap by benchmarking consultant methodologies against each other and against operational data at a scale not seen before in industry collaborations. We consider data from 10 wind plants and evaluate discrepancies between eight consultancies in the steps taken from estimates of gross to net energy. Consultants tend to overestimate the gross energy produced at the turbines and then compensate by further overestimating downstream losses, leading to a mean P50 bias near zero, still with significant variability among the individual wind plants. Within our data sample, we find that consultant estimates of all loss categories, except environmental losses, tend to reduce the project-to-project variability of the P50 bias. The disagreement between consultants, however, remains flat throughout the addition of losses. Finally, we find that differences in consultants’ estimates of project performance can lead to differences up to $10/MWh in the levelized cost of energy for a wind plant.

Todd, Austin C.↗
DOE OSTI2026

Iterative HOMER with uncertainties

We present iHOMER, an iterative version of the HOMER method to extract Lund fragmentation functions from experimental data. Through iterations, we address the information gap between latent and observable phase spaces and systematically remove bias. To quantify uncertainties on the inferred weights, we use a combination of Bayesian neural networks and uncertainty-aware regression. We find that the combination of iterations and uncertainty quantification produces well-calibrated weights that accurately reproduce the data distribution. A parametric closure test shows that the iteratively learned fragmentation function is compatible with the true fragmentation function.

Butter, Anja [Heidelberg Univ. (Germany); Sorbonne↗
DOE OSTI2022

Association of clonal hematopoiesis mutations with clinical outcomes: A systematic review and meta-analysis

Clonal hematopoiesis (CH) mutations are common among individuals without known hematologic disease. CH mutations have been associated with numerous adverse clinical outcomes across many different studies. We systematically reviewed the available literature for clinical outcomes associated with CH mutations in patients without hematologic disease. We searched PubMed, EMBASE, and Scopus for eligible studies. Three investigators independently extracted the data, and each study was verified by a second author. Risk of bias was assessed using the Newcastle-Ottawa Scale. We identified 32 studies with 56 cohorts that examine the association between CH mutations and clinical outcomes. We conducted meta-analyses comparing outcomes among individuals with and without detectable CH mutations. We conducted meta-analyses for cardiovascular diseases (nine studies; HR = 1.61, 95% CI = 1.26–2.07, p = .0002), hematologic malignancies (seven studies; HR = 5.59, 95% CI = 3.31–9.45, p < .0001), therapy-related myeloid neoplasms (four studies; HR = 7.55, 95% CI = 4.3–13.57, p < .001), and death (nine studies; HR = 1.34, 95% CI = 1.2–1.5, p < .0001). The cardiovascular disease analysis was further stratified by variant allele fraction (VAF) and gene, which showed a statistically significant association only with a VAF of ≥ 10% (HR = 1.42, 95% CI = 1.24–1.62, p < .0001), as well as statistically significant associations for each gene examined with the largest magnitude of effect found for CH mutations in JAK2 (HR = 3.5, 95% CI = 1.84–6.68, p < .0001). Analysis of the association of CH mutations with hematologic malignancy demonstrated a numeric stepwise increase in risk with increasing VAF thresholds. This analysis strongly supports the association of CH mutations with a clinically meaningful increased risk of adverse clinical outcomes among individuals without hematologic disease, particularly with increasing VAF thresholds.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Utilizing ensemble learning for performance and power modeling and improvement of parallel cancer deep learning CANDLE benchmarks

Abstract Machine learning (ML) continues to grow in importance across nearly all domains in modeling to learn from data. Often a tradeoff exists between a model's ability to minimize bias and variance. In this article, we utilize ensemble learning to combine linear, nonlinear, and tree‐/rule‐based ML methods to cope with the bias‐variance tradeoff and result in more accurate models. We use the datasets collected for two parallel cancer deep learning CANDLE benchmarks, NT3 and P1B2, to build performance and power models based on hardware performance counters using single‐object and multiple‐objects ensemble learning to identify the most important counters for improvement on the Cray XC40 Theta at Argonne National Laboratory. Based on the insights from these models, we improve the performance and energy of P1B2 and NT3 by optimizing the deep learning environments TensorFlow, Keras, Horovod, and Python under the huge page size of 8 MB. Experimental results show that ensemble learning not only produces more accurate models but also provides more robust performance counter ranking. We achieve up to 61.15% performance improvement and up to 62.58% energy saving for P1B2 and up to 55.81% performance improvement and up to 52.60% energy saving for NT3 on up to 24,576 cores.

Wu, Xingfu↗
DOE OSTI2025

SPARTA: A flux adjustment methodology to interpret complex experiments

For the accurate determination of reactivity from a detector count rate, correction of spatial effects is of prime importance. This spatial correction is often provided using simulation methodologies, but this may introduce a bias if the result of the experiment is also used as input data for the simulation. Here, this work presents a flux adjustment methodology able to infer experimental reactivity and correction of spatial effects without the need for a simulation. It can process the signal from a complex experiment such as a heat balance measurement in the TREAT reactor, where control rods are continuously adjusted to maintain a constant power. In the present work, this methodology successfully computed the reactivity and the local spatial variation of the flux of a generated signal. It also proved to be robust against noise and errors on kinetic parameters and provides a credible interpretation of a heat balance experiment in TREAT. Efficiency of flux adjustment methods for complex experiment enable a better experiment interpretation less reliant on nuclear data evaluation.

73 - NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

How production networks amplify economic growth

Technological improvement is the most important cause of long-term economic growth. In standard growth models, technology is treated in the aggregate, but an economy can also be viewed as a network in which producers buy goods, convert them to new goods, and sell the production to households or other producers. We develop predictions for how this network amplifies the effects of technological improvements as they propagate along chains of production, showing that longer production chains for an industry bias it toward faster price reduction and that longer production chains for a country bias it toward faster growth. These predictions are in good agreement with data from the World Input Output Database and improve with the passage of time. The results show that production chains play a major role in shaping the long-term evolution of prices, output growth, and structural change.

99 GENERAL AND MISCELLANEOUS↗
DOE OSTI2020

Many-body electronic structure of LaScO 3 by real-space quantum Monte Carlo

We present real space quantum Monte Carlo (QMC) calculations of the scandate LaSc0 3 that proved to be challenging for traditional electronic structure approaches due to strong correlation effects resulting in inaccurate band gaps from DFT and GW methods when compared with existing experimental data. Besides calculating an accurate QMC band gap corrected for supercell size biases and in agreement with numerous experiments, we also predict the cohesive energy of the crystal using the standard fixed-node QMC without any empirical or non-variational parameters. We show that promotion (optical) gap and fundamental gap agree with each other illustrating a clear absence of significant excitonic effects in the ideal crystal. We obtained these results in perfect consistency in two independent tracks that employ different basis sets (plane wave vs. localized gaussians), different codes for generating orbitals (QUANTUM ESPRESSO vs. CRYSTAL), different QMC codes (QMCPACK vs. QWALK) and different high-accuracy pseudopotentials (ccECPs vs. Troullier-Martins) presenting the maturity and consistency of QMC methodology and tools for studies of strongly correlated problems.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗