Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data quality analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Pipeline for Integrated Projects in Energy Systems (PIPES): A Tool for Integrated System Planning [Slides]

The Pipeline for Integrated Projects in Energy Systems (PIPES) is a comprehensive project, data, and workflow management tool designed for integrated modeling teams. PIPES facilitates the management of data requirements, tasks, and progress tracking, serving as a higher-level integration layer that works across various data and modeling software. This tool integrates models, data, and tools to perform large-scale, integrated analysis work at scale. PIPES is designed to streamline integrated modeling projects, enhance collaboration, and ensure the quality and efficiency of data management and workflow processes. This presentation introduces PIPES a multi-model tool for integrated system planning; it describes the underlying architecture, deep dives into common user workflows, and outlines the upcoming development roadmap beyond its current alpha state.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2023

Evolving efforts to maintain and improve XPS analysis quality in an era of increasingly diverse uses and users

Based on literature analysis, X-ray photoelectron spectroscopy (XPS) use continues to increase exponentially. This increased use is accompanied by anecdotal reports and systematic analyses indicating a growing presence of significantly flawed data analyses. Recognition of this problem within the surface analysis community has increased with an understanding that both inexperienced users and increased use of XPS outside the surface analysis community contribute to the problem. The XPS community has initiated several efforts to help address the problem, which is not unique to XPS. This paper describes some of the specific problems identified and some of the community efforts intended to address them. Here, we describe activities focused on three specific issues: (i) requests for detailed guides and protocols and bite-sized versions of information for non-experts, (ii) incomplete data and analysis reporting, and (iii) the high rate of peak fitting problems. A 2019 survey identified the need for guides, protocols, and standards to assist XPS users. One set of such guides has been published, and another is being assembled. Providing incremental bites of useful information is the goal of a series of papers on specific challenges to surface analysis with example solutions has been initiated as Notes and Insights papers in Surface and Interface Analysis. Examination of XPS-containing papers finds that information to establish the credibility and reproducibility of XPS results is often very incomplete. Unfortunately, ISO and ASTM standards require an amount of parameter reporting that seems excessive and unrealistic for many research publications. Initial approaches to develop and distribute a graded approach to parameter reporting are briefly described. Multiple efforts are underway to address the high rate of problems associated with photoelectron peak fitting. These include guides to peak fitting, guides to peak identification and fitting for specific elements, and the development of a peak fitting social network. The fitting social network is designed to facilitate interactions between new and experienced XPS users; analysts trying to fit XPS data (for publication or other reasons) can ask questions and establish dynamic conversations. Encouraging and enabling high-quality XPS analysis and reporting requires several different types of effort from all members of the surface and interface analysis community.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2025

RTN-095: The Vera C. Rubin Observatory Data Preview 1

We present Rubin Data Preview 1 (DP1), the first release of data from the NSF-DOE Vera C. Rubin Observatory, consisting of raw and calibrated single-epoch images, coadds, difference images, detection catalogs, and other derived data products. DP1 is based on 1792 science-grade optical/near-infrared exposures acquired over 48 distinct nights by the Rubin Commissioning Camera, LSSTComCam, on the Simonyi Survey Telescope at the Summit Facility on Cerro Pachón, Chile during the first on-sky commissioning campaign in late 2024. DP1 covers a total of ~15 sq. deg. over seven roughly equally-sized non-contiguous fields, each independently observed in six broad photometric bands, ugrizy, spanning a range of stellar densities and latitudes and overlapping with external reference datasets. The median image quality across all bands, measured by the FWHM of the point-spread function, is approximately 1.13 arcseconds, with the sharpest images reaching about 0.65 arcseconds. DP1 contains approximately 2.3 million distinct astrophysical objects, of which 1.6 million are extended in at least one band, and 431 solar system objects, of which 93 are new discoveries. DP1 is approximately 3.5 TB in size and available to Rubin data rights holders via the Rubin Science Platform, a cloud-based environment for the analysis of petascale astronomical data. While small compared to future LSST releases, its high quality and diversity of data support a broad range of early science investigations across all four LSST themes, providing a valuable opportunity to engage with Rubin data ahead of the start of full operations in late 2025.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Assessment of BQ-9000 Biodiesel Properties for 2020 (CRADA CRD-15-593)

Biodiesel producers in the United States and Canada can voluntarily participate in the industry's BQ-9000 quality assurance program. This is the fourth in a series of reports documenting biodiesel quality from participating producers. Participants in the BQ-9000 program were requested to voluntarily provide data to a third-party team. This team anonymized and randomized the data prior to providing to the National Renewable Energy Laboratory (NREL) for analysis and reporting. The critical quality parameters analyzed are: sodium and potassium, calcium and magnesium, phosphorus, flash point and alcohol control, water and sediment, cloud point, acid number, free and total glycerin, monoglycerides, sulfur, oxidation stability, and cold soak filterability test (CSFT). The statistical analysis for these parameters is presented in Table ES-1.

09 BIOMASS FUELS↗
DOE OSTI2020

ATLAS data quality operations and performance for 2015–2018 data-taking

The ATLAS detector at the Large Hadron Collider reads out particle collision data from over 100 million electronic channels at a rate of approximately $100$ kHz, with a recording rate for physics events of approximately 1 kHz. Before being certified for physics analysis at computer centres worldwide, the data must be scrutinised to ensure they are clean from any hardware or software related issues that may compromise their integrity. Prompt identification of these issues permits fast action to investigate, correct and potentially prevent future such problems that could render the data unusable. This is achieved through the monitoring of detector-level quantities and reconstructed collision event characteristics at key stages of the data processing chain. This paper presents the monitoring and assessment procedures in place at ATLAS during 2015-2018 data-taking. Through the continuous improvement of operational procedures, ATLAS achieved a high data quality efficiency, with 95.6% of the recorded proton-proton collision data collected at $\sqrt{s}=13$ TeV certified for physics analysis.

43 PARTICLE ACCELERATORS↗
DOE OSTI2023

BigNeuron: a resource to benchmark and predict performance of algorithms for automated tracing of neurons in light microscopy datasets

BigNeuron is an open community bench-testing platform with the goal of setting open standards for accurate and fast automatic neuron tracing. We gathered a diverse set of image volumes across several species that is representative of the data obtained in many neuroscience laboratories interested in neuron tracing. Here, we report generated gold standard manual annotations for a subset of the available imaging datasets and quantified tracing quality for 35 automatic tracing algorithms. The goal of generating such a hand-curated diverse dataset is to advance the development of tracing algorithms and enable generalizable benchmarking. Together with image quality features, we pooled the data in an interactive web application that enables users and developers to perform principal component analysis, t-distributed stochastic neighbor embedding, correlation and clustering, visualization of imaging and tracing data, and benchmarking of automatic tracing algorithms in user-defined data subsets. The image quality metrics explain most of the variance in the data, followed by neuromorphological features related to neuron size. Furthermore, we observed that diverse algorithms can provide complementary information to obtain accurate results and developed a method to iteratively combine methods and generate consensus reconstructions. The consensus trees obtained provide estimates of the neuron structure ground truth that typically outperform single algorithms in noisy datasets. However, specific algorithms may outperform the consensus tree strategy in specific imaging conditions. Finally, to aid users in predicting the most accurate automatic tracing results without manual annotations for comparison, we used support vector machine regression to predict reconstruction quality given an image volume and a set of automatic tracings.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Improved quality metrics for association and reproducibility in chromatin accessibility data using mutual information

Correlation metrics are widely utilized in genomics analysis and often implemented with little regard to assumptions of normality, homoscedasticity, and independence of values. This is especially true when comparing values between replicated sequencing experiments that probe chromatin accessibility, such as assays for transposase-accessible chromatin via sequencing (ATAC-seq). Such data can possess several regions across the human genome with little to no sequencing depth and are thus non-normal with a large portion of zero values. Despite distributed use in the epigenomics field, few studies have evaluated and benchmarked how correlation and association statistics behave across ATAC-seq experiments with known differences or the effects of removing specific outliers from the data. Here, we developed a computational simulation of ATAC-seq data to elucidate the behavior of correlation statistics and to compare their accuracy under set conditions of reproducibility. Using these simulations, we monitored the behavior of several correlation statistics, including the Pearson’s R and Spearman’s ρ coefficients as well as Kendall’s τ and Top–Down correlation. We also test the behavior of association measures, including the coefficient of determination R 2 , Kendall’s W, and normalized mutual information. Our experiments reveal an insensitivity of most statistics, including Spear man’s ρ, Kendall’s τ, and Kendall’s W, to increasing differences between simulated ATAC-seq replicates. The removal of co-zeros (regions lacking mapped sequenced reads) between simulated experiments greatly improves the estimates of correlation and association. After removing co-zeros, the R 2 coefficient and normalized mutual information display the best performance, having a closer one-to-one relationship with the known portion of shared, enhanced loci between simulated replicates. When comparing values between experimental ATAC-seq data using a random forest model, mutual information best predicts ATAC-seq replicate relationships. Collectively, this study demonstrates how measures of correlation and association can behave in epigenomics experiments. We provide improved strategies for quantifying relationships in these increasingly prevalent and important chromatin accessibility assays.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

International interlaboratory compilation of trace element concentrations in the CUP-2 uranium ore concentrate standard

Herein, a nuclear forensics investigation involving a uranium ore concentrate relies on accurate and precise analysis of impurities. Analytical data defensibility requires the use of reference materials as part of quality control. This study presents a compilation of trace element concentration results of the CUP-2 Uranium Ore Concentrate Standard measured by 11 different laboratories. The laboratories employed various dissolution methods, analytical preparation methods, and instrumental platforms. The data presented here contain concentrations of 66 impurities with up to 138 individual data points for each impurity. Consensus values have been assigned to each impurity following a statistical analysis of the data set.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
DOE OSTI2021

Serial femtosecond and serial synchrotron crystallography can yield data of equivalent quality: A systematic comparison

For the two proteins myoglobin and fluoroacetate dehalogenase, we present a systematic comparison of crystallographic diffraction data collected by serial femtosecond (SFX) and serial synchrotron crystallography (SSX). To maximize comparability, we used the same batch of micron-sized crystals, the same sample delivery device, and the same data analysis software. Overall figures of merit indicate that the data of both radiation sources are of equivalent quality. For both proteins, reasonable data statistics can be obtained with approximately 5000 room-temperature diffraction images irrespective of the radiation source. The direct comparability of SSX and SFX data indicates that the quality of diffraction data obtained from these samples is linked to the properties of the crystals rather than to the radiation source. Therefore, for other systems with similar properties, time-resolved experiments can be conducted at the radiation source that best matches the desired time resolution.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

Optimized spatial information for 1990, 2000, and 2010 U.S. census microdata

Abstract We report on the successful completion of a project to upgrade the positional accuracy of every response to the 1990, 2000, and 2010 U.S. decennial censuses. The resulting data set, called Optimized Spatial Census Information Linked Across Time (OSCILAT), resides within the restricted-access data warehouse of the Federal Statistical Research Data Center (FSRDC) system where it is available for use with approval from the U.S. Census Bureau. OSCILAT greatly improves the accuracy and completeness of spatial information for older censuses conducted prior to major quality improvements undertaken by the Bureau. Our work enables more precise spatial and longitudinal analysis of census data and supports exact tabulations of census responses for arbitrary spatial units, including tabulating responses from 1990, 2000, and 2010 within 2020 block boundaries for precise measures of change over time for small geographic areas.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
DOE OSTI2020

The Efficacy and Safety of Mesalamine and Probiotics in Mild‐to‐Moderate Ulcerative Colitis: A Systematic Review and Meta‐Analysis

Objective . To evaluate the efficacy and safety of mesalamine in conjunction with probiotics for ulcerative colitis. Methods . Random controlled trials (RCTs) were searched in PubMed, EMBASE, Cochrane Library, China National Knowledge Infrastructure, Wanfang, and VIP (VIP Database for Chinese Technical Periodicals) from inception to October 2019. Methodological quality was assessed by the Cochrane Collaboration tool. The quality of evidence was rated by the Grading of Recommendations, Assessment, Development, and Evaluation (GRADE). Data analysis was carried out in Review Manager 5.3. Results . A total of fifteen studies met the criteria for inclusion. Thirteen studies reported the clinical efficacy, three studies provided data on the clinical symptom scores, two trials reported disease activity index, four studies evaluated endoscopic score, and twelve studies reported adverse events. For ulcerative colitis (UC), mesalamine and probiotics had better clinical efficacy than mesalamine alone (≤8 weeks: RR = 1.12, 95% CI: 1.07–1.18, P < 0.0001; >8 weeks: RR = 1.25, 95% CI: 1.11–1.41, P = 0.0003). On the clinical symptom scores, disease activity index, and endoscopic score, UC patients receiving mesalamine and probiotics had significant difference than patients receiving mesalazine alone (MD = −2.02, 95% CI: −3.28 to −0.76, P = 0.002; MD = −1.20, 95% CI: −1.76 to −0.65, P < 0.001; and MD = −0.42, 95% CI: −0.61 to −0.23, P < 0.0001, respectively). There was no statistically significant difference in adverse events between the two groups (RR = 0.88, 95% CI: 0.54 to 1.43, P = 0.60). Conclusion . Our meta‐analysis results supported that mesalamine and probiotics were effective and safe in treating ulcerative colitis.

Tian, Chunying↗
DOE OSTI2022

Perspectives on Microfluidics for the Study of Asphaltenes in Upstream Hydrocarbon Production: A Minireview

The utilization of microfluidics has generated deep insights into asphaltene precipitation mechanisms and oil–water emulsion stabilization. Agglomeration and precipitation of asphaltenes can cause flow assurance problems during the extraction and transportation of crude oil. Change in temperature, pressure, reservoir conditions, and solvents can change the local environment, leading to asphaltene precipitation. Understanding asphaltene properties and precipitation pathways becomes critical in devising mitigation methods, demulsifiers, and suitable conditions during hydrocarbon processing. Microfluidics has helped in high throughput measurement studies, understanding critical processing conditions, fast demulsifier screening, and the effect of solvent concentration on deposition, generating useful information for utilization at the point of resource extraction facilitating improved resource management. It has become possible to capture the porous, complex nature of reservoir formations and the interaction of chemicals during precipitation through integrated analytics and visualization studies available only through microfluidics. The use of droplet microfluidics, with optical microscopy and high-speed imaging to study the oil–water interface, has resulted in greater understanding of the role of asphaltenes in interfacial properties and emulsion stabilization. Here, this minireview highlights the crucial aspects of microfluidics that have been used to understand physicochemical behavior and dynamics of asphaltene deposition. Some of the unique devices have been presented focusing on the key elements of microfluidics design, fabrication, and analysis, as the insight obtained from microfluidics strongly depends on the device design and the controllability of the experimental parameters. Successful implementation of microfluidics for efficient and controlled experiments, short analysis time scales and rapid screening, and generation of high-quality, reliable data that convey asphaltene deposition issues and interface behavior in emulsions shows the importance of microsystems for advancing knowledge in hydrocarbon production and processing.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

Post-fire time series photos from five sites across the Oak Creek watershed, Washington

This dataset supports a broader study examining wildfire impacts on hydrologic connectivity across 5 sites within the Oak Creek watershed and the resulting biogeochemical impacts. Sites were selected using the Advanced Terrestrial Simulator (ATS) hydrologic model to identify locations with varying groundwater contributions and hydrologic responses across different burn severity scenarios. The Retreat Fire burned from July 23 to August 2, 2024, affecting all five sites. This dataset provides time series game camera photos, while the broader study includes continuous water quality monitoring, biogeochemical sampling of water and soils, precipitation data, and organic matter analysis. The other data types and additional metadata (include site environmental information) can be found at https://data.ess-dive.lbl.gov/datasets/doi:10.15485/3018020. Because this study is ongoing, this data package will be updated regularly to include newly collected photos. For details on how to navigate data packages generated by this project, see https://data.ess-dive.lbl.gov/portals/PNNLRiverCorridorSFA/About. In addition to a readme, this data package also includes a file-level metadata (FLMD) file that describes each file and a data dictionary (DD) that describes all column/row headers and variable definitions. This dataset is comprised of (1) file-level metadata; (2) data dictionary; (3) field metadata; (4) readme; (5) field protocol; and (6) folders of game camera photos. The game camera photos are organized by site with subfolders by month of collection. The field metadata contains a subset of the information collected that is most relevant to photo-processing. The full set of field metadata can be found at https://data.ess-dive.lbl.gov/datasets/doi:10.15485/3018020. All files are .csv, .pdf, or .jpg.

Burn severity↗
DOE OSTI2021

Towards improved guidelines for cost evaluation of carbon capture and storage

The white paper is an effort to draw up a set of CCS costing guidelines in three complementary areas where further guidelines and better practices are needed, and where efforts are underway to address those topics. The first area of study tackles the establishment of improved guidelines for cost evaluation of advanced low-carbon technology (such as a new CO 2 capture process or a novel power plant design). The second area of study focuses on CCS from non-power industries while the final area addresses quality assurance and uncertainty evaluations of data and models used in CCS cost analysis.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Generative AI for Power Grid Operations

Generative artificial intelligence (AI) has captured into the mainstream, demonstrating capabilities that once belonged solely to the realm of human cognition. From defeating world champions in complex games to generating human-quality text and images, Generative AI has proven its potential to revolutionize countless industries. The electric power grid is no exception. Generative AI's ability to process vast amounts of data rapidly, assist decision support and identify patterns could significantly enhance power grid operations. For example, Generative AI could improve state estimation where measurements are not available or integrate renewable energy sources more efficiently with probabilistic forecasting. The key contributions of this whitepaper are outlined below: (1) Comprehensive overview of Generative AI's applications in power grid operations: It highlights the opportunities in areas such as forecasting, state estimation, and demonstrating the potential for enhancing efficiency, reliability, and resilience. (2) Expanding Generative AI's impact through synergies with emerging technologies: The paper introduce NREL developed eGridGPT and explores how AI orchestration, multi-agent systems, and Digital Twins can collaborate to optimize grid operations, addressing the complexities of a decarbonized and electrified future. (3) In-depth analysis of challenges in implementing Generative AI: This includes considerations like data availability and quality, model validation, certification, and ethical concerns, ensuring responsible AI deployment. (4) Emphasizing human-AI collaboration: The whitepaper underscores the importance of trustworthy, transparency, and explainability in AI systems to promote seamless interaction between human operators and AI, ultimately improving decision-making. (5) Exploring future research and development: It identifies critical areas for further advancement to fully realize Generative AI's potential in power grid operations. This whitepaper serves as a valuable resource for researchers, practitioners, and policymakers looking to harness Generative AI for a more reliable, stable, and cost-effective power grid.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

NMF-Based Anomaly Detection in CMS 2D Tracking Occupancy Histograms

The CMS experiment relies on Data Quality Monitoring (DQM) to ensure that recorded collision data are suitable for physics analysis. During LHC Run 3, each run contains many lumisections and tracking monitoring elements, making offline inspection challenging, especially for localized detector effects that may appear only for short periods of time. This poster presents an unsupervised machine-learning approach to identify anomalous lumisections in CMS tracking occupancy histograms using Non-Negative Matrix Factorization (NMF). The workflow uses offline CMS DQMIO tracking histograms retrieved with the CMS DIALS API and organized as two-dimensional occupancy maps for each lumisection. After selecting stable lumisections, the occupancy maps are normalized and arranged into a non-negative data matrix. The NMF model learns a compact set of basis patterns describing normal tracking occupancy. Each lumisection is then reconstructed from these learned components, and the reconstruction error is used as an anomaly score. Large residuals indicate occupancy patterns that deviate from normal detector behavior and are flagged for further inspection. This NMF-based approach provides a fast and interpretable way to flag lumisections whose tracking occupancy patterns differ from normal detector behavior. Preliminary studies show sensitivity to known tracking anomalies, and ongoing work is focused on validating the method across additional Run 3 Pixel and Strip detector issues.

Rodríguez Ramos, Iliomar [Puerto Rico U., Mayaguez↗
DOE OSTI2023

Assessment of BQ-9000 Biodiesel Properties for 2022

This is the sixth in a series of reports documenting the quality of biodiesel from U.S. and Canadian-based producers that participate in the BQ-9000 program, the biodiesel industry voluntary quality assurance program. Participants agreed to provide monthly data on critical quality parameters for calendar year 2022. The quality data was provided to a team of experts, who removed any identifying company information and provided anonymized data to the National Renewable Energy Laboratory (NREL) for statistical analysis.

09 BIOMASS FUELS↗