Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data quality analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Mammalian Chromosome Analysis and Sorting by Flow Cytometry

The analysis of chromosomes by flow cytometry is termed flow cytogenetics, and it involves the analysis and sorting of single mitotic chromosomes in suspension. The study of flow karyograms provides insight into chromosome number and structure to provide information on chromosomal DNA content and can enable the detection of deletions, translocations, or any forms of aneuploidy. Beyond its clinical applications, flow cytogenetics greatly contributed to the Human Genome Project through the ability to sort pure populations of chromosomes for gene mapping, cloning, and the construction of DNA libraries. Maximizing the potential of these important applications of flow cytogenetics relies on precise instrument setup and optimal sample processing, both of which impact the accuracy and quality of the data that are generated. This article is a compilation of the existing protocols that describe the stepwise methodology of accumulating, isolating, and staining metaphase chromosomes to prepare single-chromosome suspensions for flow cytometric analysis and sorting. Although the chromosome preparation protocols have remained largely unchanged, cytometer technology has advanced dramatically since these protocols were originally developed. Advances in cytometry technologies offer new and exciting approaches for understanding and monitoring chromosomal aberrations, but the hallmark of these protocols remains their simplicity in methodologies and reagent requirements and the accuracy of data resolvable to every chromosome of the cell.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Robust Spectral Anomaly Detection in EELS Spectral Images via 3D Convolutional Variational Autoencoders

Abstract A 3D Convolutional Variational Autoencoder (3D‐CVAE) is introduced for automated anomaly detection in electron energy‐loss spectroscopy spectrum imaging (EELS‐SI) data. This approach leverages the full 3D structure of EELS‐SI data to detect subtle spectral anomalies while preserving both spatial and spectral correlations across the datacube. By employing cross‐entropy loss and training on bulk spectra, the model learns to reconstruct bulk features characteristic of the defect‐free material. In exploring methods for anomaly detection, both the 3D‐CVAE approach and principal component analysis (PCA) are evaluated, testing their performance using FeL‐edge ΔEpeak shifts designed to simulate material defects. These results show that 3D‐CVAE achieves superior anomaly detection and maintains consistent performance across various shift magnitudes. The method demonstrates clear bimodal separation between bulk and anomalous spectra, enabling reliable classification. Further analysis verifies that lower‐dimensional representations are robust to anomalies in the data. While performance advantages over PCA diminish with decreasing anomaly concentration, our method maintains high reconstruction quality even in challenging, noise‐dominated spectral regions. This approach provides a robust framework for unsupervised automated detection of spectral anomalies in EELS‐SI data, particularly valuable for analyzing complex material systems.

Chemistry↗
DOE OSTI2020

Sampling Subjective Polygons for Patch-Based Deep Learning Land-Use Classification in Satellite Images

Model generalization remains a key challenge in the analysis of large amounts of heterogeneous satellite image data. One major limiting factor in developing generalizable models, in the context of supervised learning, is the lack of high quality training datasets. A model's capacity to perform well on new data is often inhibited by imbalance and bias in the data that was used for training. This is especially a problem when using convolutional neural networks to classify urban land-use in satellite images. Notable dataset imbalance issues in this application include land-use type imbalance and image scene imbalance. To begin understanding these dataset imbalance problems in more detail, we develop and test a number of sampling methods for generating training image datasets from subjective training polygons for urban land-use classification. We investigate sampling at different point densities as a means to reduce content repetition and therefore content imbalance and bias in the training image dataset.

Arndt, Jacob↗
DOE OSTI2024

Dark Energy Survey: Galaxy sample for the baryonic acoustic oscillation measurement from the final dataset

In this paper, we present and validate the galaxy sample used for the analysis of the baryon acoustic oscillation (BAO) signal in the Dark Energy Survey (DES) Y6 data. The definition is based on a color and redshift-dependent magnitude cut optimized to select galaxies at redshifts higher than 0.6, while ensuring a high-quality photo- z determination. The optimization is performed using a Fisher forecast algorithm, finding the optimal i -magnitude cut to be given by i < 19.64 + 2.894 z ph . For the optimal sample, we forecast an increase in precision in the BAO measurement of ∼ 25 % with respect to the Y3 analysis. Our BAO sample has a total of 15,937,556 galaxies in the redshift range 0.6 < z ph < 1.2 , and its angular mask covers 4 , 273.42 deg 2 to a depth of i = 22.5 . We validate its redshift distributions with three different methods: directional neighborhood fitting algorithm (DNF), which is our primary photo- z estimation; direct calibration with spectroscopic redshifts from VIPERS, which is a spectroscopic galaxy sample that overlaps with our BAO sample and is complete within our selection cuts; and clustering redshift using SDSS galaxies. The fiducial redshift distribution is a combination of these three techniques performed by modifying the mean and width of the DNF distributions to match those of VIPERS and clustering redshift. In this paper, we also describe the methodology used to mitigate the effect of observational systematics, which is analogous to the one used in the Y3 analysis. This paper is one of the two dedicated to the analysis of the BAO signal in DES Y6. In its companion paper, we present the angular diameter distance constraints obtained through the fitting to the BAO scale.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

A large interlaboratory electron diffraction study of monolayer graphene

Standardisation of data collection and analysis is essential to enable commercialisation of 2D materials in a wide range of technologies. Selected area electron diffraction (SAED) in the transmission electron microscope (TEM) is one of the key methods for distinguishing monolayer from bilayer and few-layer graphene by comparing the 1st and 2nd order diffraction spot intensities. Yet there are many factors that can affect the reliability of data collection and interpretation, causing the measurement of monolayer samples to deviate from the literature boundary condition of $I_{\{\bar{2}110\}}$$/$$I_{\{1\bar{1}00\}}$ < 1 for monolayer graphene (1LG). Here we present the results of a large interlaboratory SAED comparison study, where 15 international laboratories measured and analysed nominally identical samples of chemical vapour deposited graphene. Large variations were observed in the measured ratios of diffraction spot intensities, with the largest variance associated with poor quality SAED data resulting from inadequate specimen handling and storage. To inform the reliable determination of monolayer thickness from SAED patterns we provide a description of best practice for specimen handling, TEM operation, data collection and analysis. This work was undertaken within VAMAS Technical Working Area 41: Graphene and related 2D materials—Project 9, the results of which have been directly incorporated into ISO/TS 21356–2 for the characterisation of graphene sheets. We find that when this methodology is followed, 1LG can be distinguished from bilayer or thicker material with high confidence where analysis of a single SAED pattern gives $I_{\{\bar{2}110\}}$$/$$I_{\{1\bar{1}00\}}$ < 1.2, even in the absence of precise specimen tilting.

2D materials↗
DOE OSTI2023

Fuel performance uncertainty quantification and sensitivity analysis in the presence of epistemic and aleatoric sources of uncertainties

Fuel performance modeling and simulation includes many uncertain parameters from models to boundary conditions, manufacturing parameters and material properties. These parameters exhibit large uncertainties and can have an epistemic or aleatoric nature, something that renders fuel performance code-to-code and code-to-measurements comparisons for complex phenomena such as the pellet cladding mechanical interaction (PCMI) very challenging. Additionally, PCMI and other complex phenomena found in fuel performance modeling and simulation induce strong discontinuities and non-linearities that can render difficult to extract meaningful conclusions form uncertainty quantification (UQ) and sensitivity analysis (SA) studies. In this work, we develop and apply a consistent treatment of epistemic and aleatoric uncertainties for both UQ and SA in fuel performance calculations and use historical benchmark-quality measurement data to demonstrate it. More specifically, the developed methodology is applied to the OECD/NEA Multi-physics Pellet Cladding Mechanical Interaction Validation benchmark. A cold ramp test leading to PCMI is modeled. Two measured quantities of interest are considered: the cladding axial elongation during the irradiations and the cladding outer diameter after the cold ramp. The fuel performance code used to perform the simulation is FAST. The developed methodology involves various steps including a Morris screening to decrease the number of uncertain inputs, a nested loop approach for propagating the epistemic and aleatoric sources of uncertainties, and a global SA using Sobol indices. The obtained results indicate that the fuel and cladding thermal conductivities as well as the cladding outer diameter uncertainties are the three inputs having the largest impact on the measured quantities. More importantly, it was found that the epistemic uncertainties can have a significant impact on the measured quantities and can affect the outcome of the global sensitivity analysis.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2023

PCAfold 2.0—Novel tools and algorithms for low-dimensional manifold assessment and optimization

We describe an update to our open-source Python package, PCAfold, designed to help researchers generate, analyze and improve low-dimensional data manifolds. In the current version, PCAfold 2.0, we introduce novel tools and algorithms for assessing and optimizing low-dimensional manifolds. This includes a method that generates a “map” of local feature sizes that can help pinpoint researchers to problematic regions on a manifold. We introduce a novel cost function that characterizes the quality of a manifold topology with a single number. We develop two algorithms for feature selection based on principal component analysis (PCA) that use the cost function as an objective function to minimize. We introduce a quantity of interest (QoI)-aware dimensionality reduction strategy where data projections are computed using an artificial neural network and are directly optimized towards representing various projection-independent and projection-dependent QoIs. We also introduce an implementation of partition of unity networks (POUnets) for efficient reconstruction of QoIs from low-dimensional manifolds based on combining neural network classification with localized polynomial regression. Our software can be broadly applicable in all domains of science and engineering that aim to reduce data dimensionality, as well as in the fundamental research on representation learning.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Methods for Incorporating Model Uncertainty into Exoplanet Atmospheric Analysis

A key goal of exoplanet spectroscopy is to measure atmospheric properties, such as abundances of chemical species, in order to connect them to our understanding of atmospheric physics and planet formation. In this new era of high-quality JWST data, it is paramount that these measurement methods are robust. When comparing atmospheric models to observations, multiple candidate models may produce reasonable fits to the data. Typically, conclusions are reached by selecting the best-performing model according to some metric. This ignores model uncertainty in favor of specific model assumptions, potentially leading to measured atmospheric properties that are overconfident and/or incorrect. In this paper, we compare three ensemble methods for addressing model uncertainty by combining posterior distributions from multiple analyses: Bayesian model averaging, a variant of Bayesian model averaging using leave-one-out predictive densities, and stacking of predictive distributions. We demonstrate these methods by fitting the Hubble Space Telescope (HST) + Spitzer transmission spectrum of the hot Jupiter HD 209458b using models with different cloud and haze prescriptions. All of our ensemble methods lead to uncertainties on retrieved parameters that are larger but more realistic and consistent with physical and chemical expectations. Since they have not typically accounted for model uncertainty, uncertainties of retrieved parameters from HST spectra have likely been underreported. We recommend stacking as the most robust model combination method. Our methods can be used to combine results from independent retrieval codes and from different models within one code. They are also widely applicable to other exoplanet analysis processes, such as combining results from different data reductions.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

RNA language models predict mutations that improve RNA function

Structured RNA lies at the heart of many central biological processes, from gene expression to catalysis. RNA structure prediction is not yet possible due to a lack of high-quality reference data associated with organismal phenotypes that could inform RNA function. We present GARNET (Gtdb Acquired RNa with Environmental Temperatures), a new database for RNA structural and functional analysis anchored to the Genome Taxonomy Database (GTDB). GARNET links RNA sequences to experimental and predicted optimal growth temperatures of GTDB reference organisms. Using GARNET, we develop sequence- and structure-aware RNA generative models, with overlapping triplet tokenization providing optimal encoding for a GPT-like model. Leveraging hyperthermophilic RNAs in GARNET and these RNA generative models, we identify mutations in ribosomal RNA that confer increased thermostability to the Escherichia coli ribosome. The GTDB-derived data and deep learning models presented here provide a foundation for understanding the connections between RNA sequence, structure, and function.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Coupled-channels analysis of pion and η electroproduction within the Jülich-Bonn-Washington model

Pion and η electroproduction data are jointly analyzed for the first time, up to a center-of-mass energy of 1.6 GeV. The framework is a dynamical coupled-channels model, based on the recent Jülich-Bonn-Washington analysis of pion electroproduction data for the same energy range. Comparisons are made to a number of single-channel η electroproduction fits. By comparing multipoles of comparable fit quality, we find some of these amplitudes are well determined over the near-threshold region, while others will require fits over an extended energy range.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Radiometric Standards and Best Practices: Recent Progress

International standards and best practices for solar resource assessments provide assurance for traceable measurements associated with a low uncertainty. This benefits the solar energy industry by reducing the investment risks through heightened confidence in the solar resource information. NREL, in collaboration with international organizations, such as subcommittees G03 of ASTM (Radiometry) and TC180/SC1 of ISO (Climate measurement and data), recently revised some standards that are widely used by the solar industry. These include radiometric standards that assist in (i) maintaining calibration traceability; (ii) uncertainty analysis; (iii) measurement quality assurance, and (iv) establishing reference spectral irradiance distributions. The latter are widely used by the solar community to evaluate the actual absorptance, reflectance, and transmittance of solar energy materials, or the performance of solar energy devices and systems, relative to standard conditions. This paper provides a summary of the recent changes brought to these standards as a way to better support the solar energy industry.

industries↗
DOE OSTI2021

Online Detection of Low-Quality Synchrophasor Data Considering Frequency Similarity

Here, this letter proposes a new approach for online detection of low-quality synchrophasor data under both normal and event conditions. The proposed approach utilizes the features of synchrophasor data in time and frequency domains to distinguish multiple regional PMU signals and detect low-quality synchrophasor data. It is more effective to detect low-quality data with apparently indistinguishable profiles. Case studies from recorded synchrophasor measurements verify the effectiveness of the proposed approach for detecting low-quality synchrophasor data in frequency, voltage magnitude and voltage angle.

42 ENGINEERING↗
DOE OSTI2020

Resource Analysis of NP Kunta Solar Park Site (White Paper)

India has set a target of 175 GW of renewable energy (RE) capacity by 2022 and 450 GW by 2030. Flexibility is key for efficient integration of renewables. The modern-day RE plants are grid-friendly and can also provide this flexibility. A pilot to demonstrate this flexibility by implementing automatic generation control (AGC) at a solar plant is being done by the U.S. Agency for International Development (USAID) under USAID’s Greening the Grid (GTG) Program and Renewable Integration & Sustainable Energy (RISE) initiative. This paper presents the resource variability analysis of the 250-MW NP Kunta solar plant site where the AGC pilot project is being implemented. This paper also demonstrates the use of publicly available resource quality data, which can be utilized by various stakeholders to better understand the variability of any existing or potential RE site in India and possibly increase confidence in decisions or help to understand the impacts that can be expected.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2025

Applying a Multisector Scenario Framework to Evaluate Past and Future Public Surface Water Supply Infrastructure Strategies in Texas

Datasets supporting the index model and scenario analysis used in evaluating surface water supply strategies across different water system types in Texas. These data underpin the scenario development and application of five key indicators: Water Availability Index (WAI), Water Quality Index (WQI), Energy Requirement Index (ERI), Water Treatment Cost (WTC), and Water Infrastructure Cost (WIC). The datasets are organized by system type—stream reaches (flowlines), waterbodies, and reservoirs—and include both raw and standardized index values. The integrated datasets also provide scenario classifications (original and adjusted) based on infrastructure and planning priorities, enabling comparison across Shared Socioeconomic Pathways (SSPs). Additional strategy-level data are included to support evaluation of state-level new reservoir projects in relation to cost and availability tradeoffs. Please refer to the README file provided in Files for more details. Descriptions of the datasets are provided below. Dataset(s) Descriptions Folder: Index_model_database.zip Subfolder: Stream_reach.zip Fl_wf.csv, Fl_wq.csv, Fl_er.csv, Fl_wf_wtcUV.csv, Fl_wf_wtcnoUV.csv, Fl_allfac_wic1.csv, Fl_allfac_wic2.csvDatasets for computing WAI, WQI, ERI, WTC, and WIC for surface water systems classified as stream reaches (flowlines). Subfolder: Waterbody.zip Wb_wf.csv, Wb_wq.csv, Wb_er.csv, Wb_wf_wtcUV.csv, Wb_wf_wtcnoUV.csv, Wb_allfac_wic1.csv, Wb_allfac_wic2.csvEquivalent index model datasets for waterbodies, reflecting hydrologic and infrastructure attributes specific to impounded natural systems. Subfolder: Reservoir.zip Rs_wf.csv, Rs_wq.csv, Rs_er.csv, Rs_wf_wtcUV.csv, Rs_wf_wtcnoUV.csv, Rs_allfac_wic1.csv, Rs_allfac_wic2.csvIndex model datasets specific to regulated reservoir systems, incorporating both resource indicators and cost parameters. Folder: Integrated data.zip combined_merged_data.csv, combined_merged_data_scenario.csvDatasets integrating index model indicators (both raw and scaled) with scenario classifications, including adjustments reflecting SSP-aligned transitions and planning shifts. Folder: Additional data.zip wai_supplystrat_wic_merged.csvCurated dataset capturing proposed major reservoir-based municipal water supply strategies in Texas. Integrates site-level planning data with estimated capital infrastructure costs and water availability scores for comparative assessment.

geospatial↗
DOE OSTI2023

Statistical Treatise on Critical Biodiesel (B100) Quality Properties in the United States from 2004-2022

The quality of neat biodiesel (B100) is critical for ensuring biodiesel blends used in diesel-powered vehicles do not adversely impact engine performance. In the United States, B100 is required to meet ASTM International's purity and fuel property requirements in D6751, "Standard Specification for Biodiesel Fuel Blend Stock (B100) for Middle Distillate Fuels." Here we review the development of this standard for the different grades of B100. The BQ-9000 program, which currently covers over 90% of U.S. and Canadian production volumes, is also described. Engine and original equipment manufacturers have expressed a desire for credible, third-party data on values of various ASTM B100 properties in the commercial market to inform their efforts to address future emissions and durability requirements. To address this need, the National Renewable Energy Laboratory published data from analysis and testing of monthly samples from BQ-9000 producers from calendar years 2017-2022, resulting in 300-500 data points (i.e., individual fuel samples) per year. These data and a statistical evaluation of properties including the average, mean, standard deviation, and 95th or 5th percentile are presented. The results show very consistent and high-quality B100 produced in this time frame. Additionally, we review the results of earlier quality surveys conducted in the United States between 2004 and 2011, revealing how quality has changed over time in response to ASTM standard revisions, as well as the significant overall improvement in quality for modern biodiesel production.

ASTM standard↗
DOE OSTI2023

Building an Efficient Cluster Cosmology Software Package for Modeling Cluster Counts and Lensing

We introduce a software suite developed for galaxy cluster cosmological analysis with the Dark Energy Survey Data. Cosmological analyses based on galaxy cluster number counts and weak-lensing measurements need efficient software infrastructure to explore an increasingly large parameter space, and account for various cosmological and astrophysical effects. Our software package is designed to model the cluster observables in a wide-field optical survey, including galaxy cluster counts, their averaged weak-lensing masses, or the cluster's averaged weak-lensing radial signals. To ensure maximum efficiency, this software package is developed in C++ in the CosmoSIS software framework, making use of the CUBA integration library. We also implement a testing and validation scheme to ensure the quality of the package. We demonstrate the effectiveness of this development by applying the software to the Dark Energy Survey Year 1 galaxy cluster cosmological data sets, and acquired cosmological constraints that are consistent with the fiducial Dark Energy Survey analysis.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

MVP: a modular viromics pipeline to identify, filter, cluster, annotate, and bin viruses from metagenomes

While numerous computational frameworks and workflows are available for recovering prokaryote and eukaryote genomes from metagenome data, only a limited number of pipelines are designed specifically for viromics analysis. With many viromics tools developed in the last few years alone, it can be challenging for scientists with limited bioinformatics experience to easily recover, evaluate quality, annotate genes, dereplicate, assign taxonomy, and calculate relative abundance and coverage of viral genomes using state-of-the-art methods and standards. Here, we describe Modular Viromics Pipeline (MVP) v.1.0, a user-friendly pipeline written in Python and providing a simple framework to perform standard viromics analyses. MVP combines multiple tools to enable viral genome identification, characterization of genome quality, filtering, clustering, taxonomic and functional annotation, genome binning, and comprehensive summaries of results that can be used for downstream ecological analyses. Overall, MVP provides a standardized and reproducible pipeline for both extensive and robust characterization of viruses from large-scale sequencing data including metagenomes, metatranscriptomes, viromes, and isolate genomes. As a typical use case, we show how the entire MVP pipeline can be applied to a set of 20 metagenomes from wetland sediments using only 10 modules executed via command lines, leading to the identification of 11,656 viral contigs and 8,145 viral operational taxonomic units (vOTUs) displaying a clear beta-diversity pattern. Further, acting as a dynamic wrapper, MVP is designed to continuously incorporate updates and integrate new tools, ensuring its ongoing relevance in the rapidly evolving field of viromics. MVP is available at https://gitlab.com/ccoclet/mvp and as versioned packages in PyPi and Conda.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Evaluation of Weakly Informed Priors for FLEX Data

On behalf of the U. S. Nuclear Regulatory Commission (NRC), Idaho National Laboratory (INL) has reviewed the development and use of “weakly informed prior” (WIP) probability distributions to obtain industry-wide failure probability and rate distributions for portable “FLEX” equipment, as documented in the Pressurized Water Reactor Owner’s Group (PWROG) report, FLEX Equipment Data Collection and Analysis (PWROG 18043-P) by MM Degonish. The review includes a description of the methods used by the PWROG analysts. It also includes an implementation of those methods for comparison purposes and an implementation of two constrained-noninformative (CN) distributions for further WIP comparisons. The report documents several issues that the review identified in the development of the WIP distributions. They relate to the quality and representativeness of the current portable “FLEX” component data, the choice of informed distributions for related installed components, and the lack of verification for the factors chosen to weaken the information from the installed components. Two errors occurred in the computations: the posterior distribution of the WIP was used to modify the WIP itself, resulting in a lack of independence between the WIP and the data; and an error was made in the conversion of WIP mean and variance values to beta distributions. The INL reviewers think the WIP distributions presented in the report are untenable for use in risk assessments at the present time because of these issues.

99 GENERAL AND MISCELLANEOUS↗