Data coverage, biases, and trends in a global citizen‐science resource for monitoring avian diversity
Explore the source record for details and available documents.
Frank A. La Sorte↗
SEARCH · Engineering Papers
Results for “Data bias”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Model-Biased, Data-Driven Adaptive Failure Prediction
This final report, which contains a research summary and a viewgraph presentation, addresses clustering and data simulation techniques for failure prediction. The researchers applied their techniques to both helicopter gearbox anomaly detection and segmentation of Earth Observing System (EOS) satellite imagery.
Leen, Todd K.↗
Californium-252 production at the High Flux Isotope Reactor - I: Validation study using campaign data
This paper presents a series of 252 Cf production validation and code-to-code comparison studies performed based on data from the production campaigns at the High Flux Isotope Reactor (HFIR). These studies support efforts to convert HFIR from using highly enriched uranium (HEU) fuel to low-enriched uranium (LEU) fuel. HFIR must maintain its world-class performance and missions following this conversion, and because 252 Cf is a vital neutron-emitting radioisotope used for a variety of high-impact applications (e.g., reactor startup, cancer treatment), the ability to efficiently produce 252 Cf must be preserved. In this work, the HFIRCON, Shift, ORIGEN, and TCOMP codes were deployed, and several sets of data libraries were investigated to better understand the calculation codes and the data biases. As-loaded target composition data, as-run irradiation history data, and post-irradiation measurements from recent multi-cycle irradiation campaigns of the HEU core were used to validate and determine methodology biases. Further, the findings demonstrated a good agreement, with results falling within 3 standard deviations of measurements. This paper lays the ground work for the second paper, which evaluates and compares 252 Cf production and safety metrics with the HEU core and a proposed LEU core.
07 ISOTOPE AND RADIATION SOURCES↗
Temperature Humidity and Sea Level Pressure Increments Induced by 1DVAR Analysis of GPS Refractivity
The Global Positioning System (GPS) transmitted signals are affected by the atmosphere. Using the radio occultation technique, where a receiver is placed on a low-Earth-orbiting platform. it is possible to perform soundings. by measuring the bending angles of the rays. The information can be converted into atmospheric refractivity. We have developed a one dimensional variational (1DVAR) analysis that uses GPS/MET 1995 refractivity and 6-hour FVDAS (Finite Volume Data Assimilation System) forecasts as background information to constrain the retrievals. The analysis increments are defined as 1DVAR minus background temperature, humidity and sea level pressure. Before assimilating the 1DVAR profiles into the FVDAS. the increments need to be understood. First, some bias could be induced in the retrievals when confronted with actual biased data: second. bias in the back-round could create undesired bias in the retrievals. Anv bias in the analyses will ultimately change the climatology of the model the retrievals will be assimilated into. We relate the increments to the reduction of the difference between observed minus computed refractivity profiles. We also point out the difference in the mean increments using backgrounds which have assimilated either NESDIS TIROS Operational Vertical Sounder (TOVS) operational retrievals or Data Assimilation Office (DAO) TOVS interactive retrievals. The climatology of the model in terms of refractivity is significantly different and this impacts the GPS 1DVAR increments. This testifies that changing the basic load of assimilated data has an influence on the impact the GPS data may have in a DAS.
Poli, Paul↗
Neuromorphic learning of continuous-valued mappings from noise-corrupted data. Application to real-time adaptive control
The ability of feed-forward neural network architectures to learn continuous valued mappings in the presence of noise was demonstrated in relation to parameter identification and real-time adaptive control applications. An error function was introduced to help optimize parameter values such as number of training iterations, observation time, sampling rate, and scaling of the control signal. The learning performance depended essentially on the degree of embodiment of the control law in the training data set and on the degree of uniformity of the probability distribution function of the data that are presented to the net during sequence. When a control law was corrupted by noise, the fluctuations of the training data biased the probability distribution function of the training data sequence. Only if the noise contamination is minimized and the degree of embodiment of the control law is maximized, can a neural net develop a good representation of the mapping and be used as a neurocontroller. A multilayer net was trained with back-error-propagation to control a cart-pole system for linear and nonlinear control laws in the presence of data processing noise and measurement noise. The neurocontroller exhibited noise-filtering properties and was found to operate more smoothly than the teacher in the presence of measurement noise.
Troudet, Terry↗
MAGSAT data processing: A report for investigators
The in-flight attitude and vector magnetometer data bias recovery techniques and results are described. The attitude bias recoveries are based on comparisons with a magnetic field model and are thought to be accurate to 20 arcsec. The vector magnetometer bias recoveries are based on comparisons with the scalar magnetometer data and are thought to be accurate to 3 nT or better. The MAGSAT position accuracy goals of 60 m radially and 300 m horizontally were achieved for all but the last 3 weeks of Magsat lifetime. This claim is supported by ephemeris overlap statistics and by comparisons with ephemerides computed with an independent orbit program using data from an independent tracking network. MAGSAT time determination accuracy is estimated at 1 ms. Several errors in prelaunch assumptions regarding data time tags, which escaped detection in prelaunch data tests, and were discovered and corrected postlaunch are described. Data formats and products, especially the Investigator-B tapes, which contain auxiliary parameters in addition to the basic magnetometer and ephemeris data, are described.
Langel, R. A.↗
Comparison of four learning-based methods for predicting groundwater redox status
Knowing the location where groundwater denitrification occurs, or by proxy the groundwater redox status (oxic, mixed, and anoxic), is valuable information for assessing and managing potential agricultural land-use impacts on freshwater quality. We compare the efficacy of supervised (Linear Discriminant Analysis LDA; Boosted Regression Trees, BRT; and Random Forest, RF) and unsupervised (Modified Self-Organizing Map, MSOM) learning-based methods to predict groundwater redox status in the agriculturally dominated Tasman, Waikato, and Wellington regions of New Zealand. Thresholds applied to regional groundwater-quality samples provide redox status variables and learn heuristics constrained by these variables and applied to spatial factors (climate, elevation, geologic, hydrology soils, and well depth) identify optimal sets of regional predictor variables. A split-sample approach is used to train and test the learning methods ability to predict redox status using the optimal predictor variables. Overall, the supervised methods demonstrate a prediction bias toward oxic conditions and inability to perform statistically well when using independent regional data; for example, consider kappa statistics for BRT (Tasman: 0.42, Waikato: 0.38, Wellington: 0.17), RF (Tasman: 0.42, Waikato: 0.47, Wellington: 0.17 and LDA (Tasman: 0.46, Waikato: 0.32, Wellington: 0.17). By contrast, the unsupervised method performs statistically well when predicting oxic, mixed, and anoxic conditions and corresponding depths when using independent regional data; for example, consider MSOM kappa statistics for Tasman: 0.78, Waikato: 0.80, Wellington: 0.76. The unsupervised learning method provides the added benefits of being (1) able to combine predictions into 3D regional anoxic probability plots for interpreting the spatial influence of paleosols and groundwater flowpaths on redox status, and (2) readily extended to map 3D redox status across New Zealand and other countries despite data bias and sparsity.
machine learning algorithms, Random Forest, booste↗
Challenges in predicting protein-protein interactions of understudied viruses: Arenavirus-human interactions
Understanding protein-protein interactions (PPIs) between viruses and host organisms is crucial for uncovering infection mechanisms and identifying potential therapeutic targets. The ability to generalize PPI predictive models across understudied viruses presents a significant challenge. In this work, we use arenavirus-human PPIs to illustrate the difficulties associated with model generalization, which are compounded by a lack of both positive and negative data. We employ a Transfer Learning approach to investigate arenavirus-human PPIs by utilizing models trained on better-studied virus-human and human-human PPIs. Additionally, we curate and assess four types of negative sampling datasets to evaluate their impact on model performance. Despite the overall high accuracies (93–99 %) and AUPRC scores (0.8–0.9) appearing promising, further analysis indicates that these performance metrics can be misleading due to data leakage, data bias, and overfitting, especially concerning under-represented viral proteins. We reveal these gaps and assess the impact of data imbalance using standard k-fold cross-validation and Independent Blind Testing with a Balanced Dataset, resulting in a drop in accuracy below 50 %. We propose a viral protein-specific evaluation framework that categorizes viral proteins into majority and minority classes based on their representation in the dataset, enabling comparison of model performance across these groups using balanced accuracies. This framework offers a more robust evaluation of model generalizability, addressing biases inherent in standard evaluation techniques and paving the way for more reliable PPI prediction models for understudied viruses.
59 BASIC BIOLOGICAL SCIENCES↗
Assimilation of Aura Ozone Data and Comparisons with In Situ Observations
Ozone data from the Ozone Monitoring Instrument (OMI) and the Microwave Limb Sounder (MLS) onboard EOS Aura satellite were assimilated into the Goddard Earth Observing System Version 4 (GEOS-4) ozone assimilation system. Comparison of assimilated ozone with ozone sonde and MOZAIC data indicate an agreement within 10% in the lower stratosphere, where dynamical processes dominate. Assimilation of OMI and MLS data improves tropospheric column estimates in the Atlantic region, but leads to an overestimation in the tropical Pacific in comparison with SHADOZ sondes. Transport and data biases are considered in order to understand these discrepancies. Comparisons of assimilated tropospheric ozone columns with ozone sonde data reveal root-mean-square (RMS) differences of 2.9 to 7.2 DU, which are typically smaller than the model-sonde RMS differences. Four different definitions of the tropopause using temperature lapse rate, potential vorticity (PV) and isentropic surfaces or ozone isosurfaces are compared with respect to their global impact on the estimated tropospheric ozone column. The largest sensitivity in the tropospheric ozone column is found near the subtropical jet, where the ozone or PV determined tropopause typically lies below the lapse rate tropopause.
Stajner, Ivanka↗
Statistics and topology of the COBE differential microwave radiometer first-year sky maps
We use statistical and topological quantities to test the Cosmic Background Explorer (COBE) Differential Microwave Radiometer (DMR) first-year sky maps against the hypothesis that the observed temperature fluctuations reflect Gaussian initial density perturbations with random phases. Recent papers discuss specific quantities as discriminators between Gaussian and non-Gaussian behavior, but the treatment of instrumental noise on the data is largely ignored. The presence of noise in the data biases many statistical quantities in a manner dependent on both the noise properties and the unknown cosmic microwave background temperature field. Appropriate weighting schemes can minimize this effect, but it cannot be completely eliminated. Analytic expressions are presented for these biases, and Monte Carlo simulations are used to assess the best strategy for determining cosmologically interesting information from noisy data. The genus is a robust discriminator that can be used to estimate the power-law quadrupole-normalized amplitude, Q(sub rms-PS), independently of the two-point correlation function. The genus of the DMR data is consistent with Gaussian initial fluctuations with Q(sub rms-PS) = (15.7 +/- 2.2) - (6.6 +/- 0.3)(n - 1) micro-K, where n is the power-law index. Fitting the rms temperature variations at various smoothing angles gives Q(sub rms-PS) = 13.2 +/- 2.5 micro-K and n = 1.7(sup (+0.3) sub (-0.6)). While consistent with Gaussian fluctuations, the first year data are only sufficient to rule out strongly non-Gaussian distributions of fluctuations.
Smoot, G. F.↗
Photometric redshift estimation with convolutional neural networks and galaxy images: Case study of resolving biases in data-driven methods
Deep-learning models have been increasingly exploited in astrophysical studies, but these data-driven algorithms are prone to producing biased outputs that are detrimental for subsequent analyses. In this work, we investigate two main forms of biases: class-dependent residuals, and mode collapse. We do this in a case study, in which we estimate photometric redshift as a classification problem using convolutional neural networks (CNNs) trained with galaxy images and associated spectroscopic redshifts. We focus on point estimates and propose a set of consecutive steps for resolving the two biases based on CNN models, involving representation learning with multichannel outputs, balancing the training data, and leveraging soft labels. The residuals can be viewed as a function of spectroscopic redshift or photometric redshift, and the biases with respect to these two definitions are incompatible and should be treated individually. We suggest that a prerequisite for resolving biases in photometric space is resolving biases in spectroscopic space. Experiments show that our methods can better control biases than benchmark methods, and they are robust in various implementing and training conditions with high-quality data. Our methods hold promises for future cosmological surveys that require a good constraint of biases, and they may be applied to regression problems and other studies that make use of data-driven models. Nonetheless, the bias-variance tradeoff and the requirement of sufficient statistics suggest that we need better methods and optimized data usage strategies.
79 ASTRONOMY AND ASTROPHYSICS↗
Optimal adjustment sets for causal query estimation in partially observed biomolecular networks
Abstract Causal query estimation in biomolecular networks commonly selects a ‘valid adjustment set’, i.e. a subset of network variables that eliminates the bias of the estimator. A same query may have multiple valid adjustment sets, each with a different variance. When networks are partially observed, current methods use graph-based criteria to find an adjustment set that minimizes asymptotic variance. Unfortunately, many models that share the same graph topology, and therefore same functional dependencies, may differ in the processes that generate the observational data. In these cases, the topology-based criteria fail to distinguish the variances of the adjustment sets. This deficiency can lead to sub-optimal adjustment sets, and to miss-characterization of the effect of the intervention. We propose an approach for deriving ‘optimal adjustment sets’ that takes into account the nature of the data, bias and finite-sample variance of the estimator, and cost. It empirically learns the data generating processes from historical experimental data, and characterizes the properties of the estimators by simulation. We demonstrate the utility of the proposed approach in four biomolecular Case studies with different topologies and different data generation processes. The implementation and reproducible Case studies are at https://github.com/srtaheri/OptimalAdjustmentSet.
59 BASIC BIOLOGICAL SCIENCES↗
Assimilation of scalar versus horizontal gradient information from the VAS into a mesoscale model
Comparisons are made between analyses and forecasts which incorporate VAS geopotential data as either scalar or horizontal gradient information for a case study on the AVE/VAS day of Mar. 6, 1982. On this day, incorporating the VAS information in analysis as a variational constraint on horizontal geopotential gradients significantly mitigated the effects of large data biases which made VAS assimilation by standard scalar methods very difficult. A subsequent forecast made from the gradient assimilation was superior to one made from the standard analysis and of comparable quality in geopotentials to a control forecast from synoptic data. Most impact was noted in the forecasts of vertical motion and precipitation in the gradient vs this control simulation.
Diak, George↗
Development and validation of HERWIG 7 tunes from CMS underlying-event measurements
This paper presents new sets of parameters (“tunes”) for the underlying-event model of the ${\textsc {herwig}} \,7$ event generator. These parameters control the description of multiple-parton interactions (MPI) and colour reconnection in ${\textsc {herwig}} \,7$, and are obtained from a fit to minimum-bias data collected by the CMS experiment at $\sqrt{s}=0.9$, 7, and $13 \,\text {Te}\text {V} $. The tunes are based on the NNPDF 3.1 next-to-next-to-leading-order parton distribution function (PDF) set for the parton shower, and either a leading-order or next-to-next-to-leading-order PDF set for the simulation of MPI and the beam remnants. Predictions utilizing the tunes are produced for event shape observables in electron-positron collisions, and for minimum-bias, inclusive jet, top quark pair, and Z and W boson events in proton-proton collisions, and are compared with data. Each of the new tunes describes the data at a reasonable level, and the tunes using a leading-order PDF for the simulation of MPI provide the best description of the data.
72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
Ten questions concerning Large Language Models (LLMs) for building applications
Large Language Models (LLMs) are emerging as powerful AI tools capable of transforming how building information is collected, processed, analyzed, and applied across diverse research areas. Their capabilities can help building operators, facility managers and other stakeholders such as designers, architects and engineers by providing actionable insights for decision-making across planning, construction, operations, and maintenance of buildings and facilities. This paper explores ten key questions concerning the role of LLMs in shaping sustainable, intelligent, and human-centric buildings. From fundamental definitions to advanced applications, we examine how LLMs facilitate decision-making across the life cycle of buildings and energy systems. LLMs can enhance life cycle assessments (LCA), building energy simulations, and real-time data integration, empowering more efficient and adaptive human-AI environments. They can also contribute to streamlining regulatory compliance, improving post-occupancy evaluations, and fostering more inclusive and participatory design processes. Additionally, this paper addresses the ethical challenges posed by LLMs, such as bias, data privacy, and environmental impacts, and explores their potentials in advancing intelligent digital twins (DT) for ongoing building operations and maintenance. Built upon our applied research using LLMs and the review of tools, datasets, and research gaps, we provide a forward-looking perspective on how LLMs can drive innovation, collaboration, and productivity in the built environment while supporting ethical and effective implementation.
32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
A statistical evaluation and comparison of VISSR Atmospheric Sounder (VAS) data and corresponding rawinsonde measurements
Three mesoscale sounding data sets from the VISSR Atmospheric Sounder (VAS) produced using different retrieval techniques were evaluated of corresponding ground truth rawinsonde data for 6-7 March 1982. Mean, standard deviations, and RMS differences between the satellite and rawinsonde parameters were calculated over gridded fields in central Texas and Oklahoma. Large differences exist between each satellite data set and the ground truth data. Biases in the satellite temperature and moisture profiles seem extremely dependent upon the three dimensional structure of the atmosphere and range from 1 deg to 3 deg C for temperature and 3 deg to 6 deg C for dewpoint temperature. Atmospheric gradients of basic and derived parameters determined from the VAS data sets produced an adequate representation of the mesoscale environment but their magnitudes were often reduced by 30 to 50%.
Source record↗
Satellite Remote Sensing to Assess Cyanobacterial Bloom Frequency Across the United States at Multiple Spatial Scales
Cyanobacterial blooms can have negative effects on human health and local ecosystems. Field monitoring of cyanobacterial blooms can be costly, but satellite remote sensing has shown utility for more efficient spatial and temporal monitoring across the United States. Here, satellite imagery was used to assess the annual frequency of surface cyanobacterial blooms, defined for each satellite pixel as the percentage of images for that pixel throughout the year exhibiting detectable cyanobacteria. Cyanobacterial frequency was assessed across 2,196 large lakes in 46 states across the continental United States (CONUS) using imagery from the European Space Agency’s Ocean and Land Colour Imager for the years 2017 through 2019. In 2019, across all satellite pixels considered, annual bloom frequency had a median value of 4% and a maximum value of 100%, the latter indicating that for those satellite pixels, a cyanobacterial bloom was detected by the satellite sensor for every satellite image considered. In addition to annual pixel-scale cyanobacterial frequency, results were summarized at the lake- and state-scales by averaging annual pixel-scale results across each lake and state. For 2019, average annual lake-scale frequencies also had a maximum value of 100%, and Oregon and Ohio had the highest average annual state-scale frequencies at 65% and 52%. Pixel-scale frequency results can assist in identifying portions of a lake that are more prone to cyanobacterial blooms, while lake- and state-scale frequency results can assist in the prioritization of sampling resources and mitigation efforts. Satellite imagery is limited by the presence of snow and ice, as imagery collected in these conditions are quality flagged and discarded. Thus, annual bloom frequencies within nine climate regions were investigated to determine whether missing data biased results in climate regions more prone to snow and ice, given that their annual summaries would be weighted toward the summer months when cyanobacterial blooms tend to occur. Results were unbiased by the time period selected in most climate regions, but a large bias was observed for the Northwest Rockies and Plains climate region. Moderate biases were observed for the Ohio Valley and the Southeast climate regions. Finally, a clustering analysis was used to identify areas of high and low cyanobacterial frequency across CONUS based on average annual lake-scale cyanobacterial frequencies for 2019. Several clusters were identified that transcended state, watershed, and eco-regional boundaries. Combined with additional data, results from the clustering analysis may offer insight regarding large-scale drivers of cyanobacterial blooms.
remote sensing↗