Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data quality analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

ProvSec: Open Cybersecurity System Provenance Analysis Benchmark Dataset with Labels

System provenance forensic analysis has been studied by a large body of research work. This area needs fine granularity data such as system calls along with event fields to track the dependencies of events. While prior work on security datasets has been proposed, we found a useful dataset of realistic attacks and details that are needed for high-quality provenance tracking is lacking. We created a new dataset of eleven vulnerable cases for system forensic analysis. It includes the full details of system calls including syscall parameters. Realistic attack scenarios with real software vulnerabilities and exploits are used. For each case, we created two sets of benign and adversary scenarios which are manually labeled for supervised machine-learning analysis. In addition, we present an algorithm to improve the data quality in the system provenance forensic analysis. We demonstrate the details of the dataset events and dependency analysis of our dataset cases.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Deep-learning methods for contrast enhancement and artifact reduction in cryo-electron tomography: a systematic analysis of the state of the art and proposed improvements

Cryo-electron tomography (cryo-ET) has emerged as the preferred technique for visualizing the organization of macromolecular complexes in situ and resolving their structures at subnanometre resolution [Tegunov et al. (2021)View full citation, Nat. Methods, 18, 186–193]. Despite improvements in data quality as a result of advances in detector technology, microscope stability and stage precision, the analysis and interpretation of tomograms remains challenging due to a low signal-to-noise ratio and reconstruction artifacts stemming from experimental constraints in specimen tilt during data collection resulting in a missing wedge in the Fourier space. Recently, self-supervised deep-learning methods have been proposed for contrast enhancement and reduction of resolution anisotropy in reconstructed tomograms. Here, we evaluate several state-of-the-art deep-learning methods which aim to improve the interpretability of cryo-ET reconstructions, with a focus on their performance on downstream tasks of template matching, sub­tomogram averaging and segmentation. We propose new training architectures and a loss function based on Fourier shell correlation that show improved performance over the standard U-Net with L1/L2 losses. We demonstrate our analysis on four diverse experimental datasets: purified 80S ribosomes, in situ Chlamydomonas reinhardtii, immature HIV-1 virus-like particles and INS-1E cells.

contrast enhancement↗
DOE OSTI2021

Constraints on effective field theory couplings using 311.2 days of LUX data

We report here the results of an Effective Field Theory (EFT) WIMP search analysis using LUX data. We build upon previous LUX analyses by extending the search window to include nuclear recoil energies up to $\sim$180 keV$_{nr}$, requiring a reassessment of data quality cuts and background models. In order to use a binned Profile Likelihood statistical framework, the development of new analysis techniques to account for higher-energy backgrounds was required. With a 3.14$\times10^4$ kg$\cdot$day exposure using data collected between 2014 and 2016, we set 90\% C.L. exclusion limits on non-relativistic EFT WIMP couplings to neutrons and protons, providing the most stringent constraints on a significant fraction of the possible EFT WIMP interactions. Additionally, we report world-leading exclusion limits on inelastic EFT WIMP-nucleon recoils.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Analytical methods for online data quality assessment

This chapter provides a comprehensive overview of the main steps for algorithmic sensor signal quality assessment, which can enhance the decision-making process for water resource recovery facility (WRRF) operation and optimization. It introduces the concept of redundancy as the basis for data quality assessment. It also explains the typical data processing pipeline, which consists of preliminary analysis, data pre-processing, and specific algorithmic approaches. Each of these processes is presented and discussed in three separate sections. Importantly, this chapter introduces the main approaches for data quality assessment, provides guidelines for selecting the most suitable one and the key performance indicators to evaluate them and explains how to collect metadata through such an algorithmic approach.

Aguado, Daniel↗
DOE OSTI2020

Assessment of the frequency and nature of erroneous x-ray photoelectron spectroscopy analyses in the scientific literature

Here, this study was undertaken to understand the extent and nature of problems in x-ray photoelectron spectroscopy (XPS) data reported in the literature. It first presents an assessment of the XPS data in three high-quality journals over a six-month period. This analysis of 409 publications showing XPS spectra provides insight into how XPS is being used, identifies the common mistakes or errors in XPS analysis, and reveals which elements are most commonly analyzed. More than 65% of the 409 papers showed fitting of XP spectra. An ad hoc group (herein identified as “the committee”) of experienced XPS analysts reviewed these spectra and found that peak fitting was a common source of significant errors. The papers were ranked based on the perceived seriousness of the errors, which ranged from minor to major. Major errors, which, in the opinion of the ad hoc committee, can render the interpretation of the data meaningless, occurred when fitting protocols ignored underlying physics and chemistry or contained major errors in the analysis. Consistent with other materials analysis data, ca. 30% of the XPS data or analysis was identified as having major errors. Out of the publications with fitted spectra, ca. 40% had major errors. The most common elements analyzed by XPS in the papers sampled and researched at an online database, include carbon, oxygen, nitrogen, sulfur, and titanium. A scrutiny of the papers showing carbon and oxygen XPS spectra revealed the classes of materials being studied and the extent of problems in these analyses. As might be expected, C 1s and O 1s analyses are most often performed on sp2-type materials and inorganic oxides, respectively. These findings have helped focus a series of XPS guides and tutorials that deal with common analysis issues. The extent of problematic data is larger than the authors had expected. Quantification of the problem, examination of some of the common problem areas, and the development of targeted guides and tutorials may provide both the motivation and resources that enable the community to improve the overall quality and reliability of XPS analysis reported in the literature.

Major, George H.↗
DOE OSTI2020

Characteristics and Variability of the Nearshore Wave Resource on the U.S. West Coast

Characterizing the nearshore wave resource at a regional scale poses a great challenge because high-quality wave data are required. This paper presents a detailed analysis of nearshore wave climate and resource characterization on the U.S. West Coast based on a 32-year, regional wave hindcast. Resource characterization closely followed the International Electrotechnical Commission standards. The wave hindcast data were generated from an unstructured-grid SWAN model with approximately 300 m grid resolution in the nearshore region. Statistics of six IEC wave resource parameters at the 50 m water depth were calculated for four sub-regions along the coast, including Washington, Oregon, and Northern and Southern California. Results indicate that the Washington and Oregon coast has a similar nearshore wave resource. The wave resource in Southern California is significantly less than that of the Washington and Oregon coast. Alongshore and cross-shore variabilities of wave power were assessed. Temporal variability, at seasonal, inter-annual, and decadal scales were analyzed. Overall, strong seasonal variation is observed; high wave energy occurs in the winter months and calm seas in the summer. Finally, extreme environmental conditions, i.e., the 100-year extreme environmental contours, for different locations along the West Coast were investigated.

wave resource characterization, nearshore, west co↗
DOE OSTI2024

AmpSuite

Seismic amplitudes offer vital information about explosion source characteristics, including discrimination and yield estimation. To take advantage of this, we developed an interactive Python package to measure, control data quality, generate broad area propagation models and perform discrimination and estimate yield. Propagation models are essential in support of transportable yield and broad area discrimination. The key benefit of this package will be its ability to continuously integrate data and new techniques. The AmpSuite framework will provide standardized, repeatable, and accurate model generation and characterization routines. The capability is crucial for monitoring agencies tasked with rapid and high-quality seismic event characterization. The AmpSuite software includes a series of independent modules to perform: • Direct Phase Amplitude Measurement and Storage • Coda Envelope Measurement and Storage • Data Quality Control • New Propagation Model Developments • Seismic Discrimination and Analysis • Yield Estimation and supporting utility software. The AmpSuite software provides comprehensive solutions for monitoring agencies seeking to optimize model generation and event analysis within a contemporary Python framework. Stakeholders (AFTAC) have begun to move towards the Python language for scientific analysis as a new workforce emerges.

Alfaro, Richard↗
DOE OSTI2023

Machine learning in analytical spectroscopy for nuclear diagnostics [Invited]

Analytical spectroscopy methods have shown many possible uses for nuclear material diagnostics and measurements in recent studies. In particular, the application potential for various atomic spectroscopy techniques is uniquely diverse and generates interest across a wide range of nuclear science areas. Over the last decade, techniques such as laser-induced breakdown spectroscopy, Raman spectroscopy, and x-ray fluorescence spectroscopy have yielded considerable improvements in the diagnostic analysis of nuclear materials, especially with machine learning implementations. These techniques have been applied for analytical solutions to problems concerning nuclear forensics, nuclear fuel manufacturing, nuclear fuel quality control, and general diagnostic analysis of nuclear materials. The data yielded from atomic spectroscopy methods provide innovative solutions to problems surrounding the characterization of nuclear materials, particularly for compounds with complex chemistry. Implementing these optical spectroscopy techniques can provide comprehensive new insights into the chemical analysis of nuclear materials. In particular, recent advances coupling machine learning methods to the processing of atomic emission spectra have yielded novel, robust solutions for nuclear material characterization. This review paper will provide a summation of several of these recent advances and will discuss key experimental studies that have advanced the use of analytical atomic spectroscopy techniques as active tools for nuclear diagnostic measurements.

Rao, Ashwin P. (ORCID:0000000319312568)↗
DOE OSTI2024

Cool GTL for the Conversion of Biogas to Jet Fuel

Cool GTL is a new process under development for conversion of biogas from digestors or CO2 +H2 to high quality drop in jet fuel. Cool GTL is designed to be a streamlined simplified low cost process which can be cost effective for small scale biogas applications. Cool GTL has the advantage that it uses a high activity bi-reforming catalyst, in a streamlined electric reformer design, to make the synthesis gas for a high conversion slurry fischer Tropsch process followed by a trailing wax cracking reactor. In this way high quality jet fuel can be directly produced. Recent experimental test data will be presented showing product quality. The life cycle analysis LCA will also be presented as well.

09 BIOMASS FUELS↗
DOE OSTI2025

STZ: A High Quality and High Speed Streaming Lossy Compression Framework for Scientific Data

Error-bounded lossy compression is one of the most efficient solutions to reduce the volume of scientific data. For lossy compression, progressive decompression and random-access decompression are critical features that enable on-demand data access and flexible analysis workflows. However, these features can severely degrade compression quality and speed. To address these limitations, we propose a novel streaming compression framework that supports both progressive decompression and random-access decompression while maintaining high compression quality and speed. Our contributions are three-fold: (1) we design the first compression framework that simultaneously enables both progressive decompression and random-access decompression; (2) we introduce a hierarchical partitioning strategy to enable both streaming features, along with a hierarchical prediction mechanism that mitigates the impact of partitioning and achieves high compression quality—even comparable to state-of-the-art (SOTA) non-streaming compressor SZ3; and (3) our framework delivers high compression and decompression speed, up to 6.7 × faster than SZ3.

Wang, Daoce [University of Nebraska, Omaha]↗
DOE OSTI2026

Comparability of Liquid Chromatography Tandem Mass Spectrometry Analysis of Dissolved Organic Matter across Laboratories

Non-targeted liquid chromatography tandem highresolution mass spectrometry (LC−MS/MS) is increasingly applied for the structure-resolved chemical analysis of dissolved organic matter (DOM). With new developments in MS instrumentation and analysis software, the approach has gained substantial momentum over the past decade. However, achieving high-quality analytical data that is reproducible and comparable across laboratories can be a bottleneck in non-targeted metabolomics and organic matter chemical analysis, especially for data reuse in repository-scale analyses. Understanding the capabilities as well as challenges of comparing LC−MS/MS data from different laboratories is necessary for inferring global trends from public data sets. To illuminate instrumentation factors that drive differences and variability, we used a standardized data analysis pipeline, including classical (CMN) and featurebased molecular networking (FBMN), to analyze data from a ring trial by 24 laboratories on identical sample sets of algal and DOM extracts that were mixed in predefined concentrations and spiked with standards. Our results showed that data sets from similar mass spectrometer types with unified instrument parameters were qualitatively comparable, resolving the same general trends and shared mass spectral features. Interlaboratory comparability was best for high-intensity features, while low-intensity features showed greater detection variability. Our analysis also highlights challenges when comparing data from instruments with different acquisition rates or operating with less standardized methods. Lastly, we provide recommendations for data integration, public data sharing, standardization, and best practices for standardized LC−MS/MS data acquisition, which will be critical for long-term time series and intercomparability of DOM chemical analyses.

DOM↗
DOE OSTI2023

Accurate Prediction of Algal Biomass Lipid, Protein, and Carbohydrate Composition with Machine Learning Regression Modelling of Near-IR Spectra

During large scale algal biomass cultivation, it is difficult to reliably control relative composition to target levels. Rapid determination of chemical composition is feasible by using near infrared (NIR) spectral data. We sought to build and improve on reliable high-throughput screening prediction method based on partial least squares regression (PLSR) by the application of artificial neural networks (ANN) and associated optimization strategies. The algal biomass sample set was designed and created in an iterative process of culturing in physiologically diverse conditions at the GAI field site, followed by compositional analyses at NREL. The workflow allowed us to identify gaps in compositional space for informing the subsequent cultivation and sampling efforts and generated a high quality set of 210 unique samples with chemical analysis results, spectral scanning data, and cultivation metadata. We observed a significant improvement in the performance of carbohydrate content predictions using an optimized ANN model compared to PLSR, with > 16% reduction in mean absolute percent error (MAPE) when tested on the same set of reserved data. The optimized ANN models for FAME and protein prediction performed exceptionally well with 5.99% and 5.09% MAPE, respectively. Application of these methods to detection and quantification of minor biomass constituents that are relevant to certain product streams has shown positive preliminary results, opening the possibility for extensions to the outputs of this powerful data type. All models are accompanied by prediction uncertainties and unsupervised spectral outlier detection to alert an operator to unreliable spectral data. These tools can be deployed for rapid determination of algal culture status, and cultivation and biomass quality improvement.

algal biofuels↗
DOE OSTI2023

Efforts to enhance reproducibility in a human performance research project

Background: Ensuring the validity of results from funded programs is a critical concern for agencies that sponsor biological research. In recent years, the open science movement has sought to promote reproducibility by encouraging sharing not only of finished manuscripts but also of data and code supporting their findings. While these innovations have lent support to third-party efforts to replicate calculations underlying key results in the scientific literature, fields of inquiry where privacy considerations or other sensitivities preclude the broad distribution of raw data or analysis may require a more targeted approach to promote the quality of research output. Methods: We describe efforts oriented toward this goal that were implemented in one human performance research program, Measuring Biological Aptitude, organized by the Defense Advanced Research Project Agency's Biological Technologies Office. Our team implemented a four-pronged independent verification and validation (IV&V) strategy including 1) a centralized data storage and exchange platform, 2) quality assurance and quality control (QA/QC) of data collection, 3) test and evaluation of performer models, and 4) an archival software and data repository. Results: Our IV&V plan was carried out with assistance from both the funding agency and participating teams of researchers. QA/QC of data acquisition aided in process improvement and the flagging of experimental errors. Holdout validation set tests provided an independent gauge of model performance. Conclusions: In circumstances that do not support a fully open approach to scientific criticism, standing up independent teams to cross-check and validate the results generated by primary investigators can be an important tool to promote reproducibility of results.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Quantitative Risk Analysis of High Safety Significant Safety-related Digital Instrumentation and Control Systems in Nuclear Power Plants using IRADIC Technology

This report documents the activities performed by Idaho National Laboratory (INL) during fiscal year (FY) 2021 for the U.S. Department of Energy (DOE) Light Water Reactor Sustainability (LWRS) Program, Risk Informed Systems Analysis (RISA) Pathway, digital instrumentation and control (DI&C) Risk Assessment project. In FY-2019, the RISA Pathway initiated a project to develop a risk assessment strategy for delivering a strong technical basis to support effective, licensable, and secure DI&C technologies for digital upgrades/designs. An integrated risk assessment technology for the DI&C systems (IRADIC technology) was proposed for this strategy, which aims to (1) provide a best-estimate risk-informed capability to quantitatively and accurately estimate the safety margin obtained from plant modernization, especially for the High Safety Significant Safety-related (HSSSR) DI&C systems, (2) develop an advanced risk assessment technology to support transition from analog to DI&C technologies for nuclear industry, (3) assure the long-term safety and reliability of vital HSSSR DI&C systems, (4) reduce uncertainty in costs and support integration of DI&C systems in the plant. To achieve these technical goals and deal with the expensive licensing justifications from regulatory insights, the IRADIC technology is instructive for nuclear vendors and utilities to effectively lower the costs associated with digital compliance and speed industry advances by: (1) defining an integrated risk-informed analysis process for DI&C upgrade, including hazard analysis, reliability analysis, and consequence analysis, (2) applying systematic and risk-informed tools to address common cause failures (CCFs) and quantify responding failure probabilities for DI&C technologies, particularly software CCFs, (3) evaluating the impact of digital failures at the individual level, system level, and plant level, (4) providing insights and suggestions on designs to manage the risks; thus, to support the development, licensing, and deployment of advanced DI&C technologies on nuclear power plant (NPPs). In this report, an approach for performing software CCF analysis, given limited data, is developed and demonstrated using a case study of a highly redundant digital reactor trip system. Consequence analysis is also performed based on different accident scenarios. Results indicate that plant modernization including the improvement of HSSSR DI&C systems will make great benefits to plant safety by providing more safety margins to accident management. In addition, a novel approach is proposed in this report for the quantification of software hazards when sufficient operational and testing data available. The method incorporates software development quality as well as strong analysis techniques to identify and link software defects to potential failure modes. The approach includes both semantic and test-based analysis to detect failures that can exist in different stages of the software development life cycle. This method is applied to an advanced human system interface relevant to reactor trip safety developed from the APR 1400 design.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

Data-Informed Synthetic Networks of Water Distribution Systems for Resilience Analysis in Puerto Rico

The increasing potential of infrastructure disruptions calls for high-quality infrastructure models to be used in resilience analysis and decision making. Unfortunately, many utilities and communities do not have access to accurate and detailed models due to a lack of data and resources. Furthermore, security restrictions on sharing infrastructure models present roadblocks to research, analysis, and decision making. Recent advances in the development of synthetic water distribution models provide a potential solution to this problem. There is an opportunity to improve these methods by leveraging incomplete pipe datasets to aid synthetic network generation. To address this gap, we developed a methodology for synthetic network generation that incorporates partial pipe data using a modification of the minimum cost flow algorithm for network generation and pipe sizing. This methodology demonstrates how partial pipe data can be leveraged to improve site-specific synthetic network generation. For the study area of Mayagüez, Puerto Rico, a synthetic model generated using 50% of real pipe data matches the pressure of the validation system with an average error of 23.5 m of head, which improves upon the average error of 31.6 m of head produced by a synthetic model generated using no data of the real pipes. Additionally, synthetic networks are shown to replicate the pressure response under a disruption scenario of the validation network, suggesting potential use in resilience analysis.

resilience analysis↗
DOE OSTI2024

First observations from the Kr multi-monochromatic x-ray imager for time and spatially resolved diagnosis of hot implosion cores

This paper presents initial findings from the recently deployed Kr multi-monochromatic x-ray imager (Kr MMI) at the Omega laser facility. The experiment focuses on exploring implosion dynamics in exploding pusher capsules at three distinct initial gas fill densities. Utilizing time-gated and spatially integrated measurements, core size, electron temperature (Te), and electron densities (ne) are extracted through the analysis of the spectral region encompassing the Kr He α and its satellite lines. A comprehensive spectral database, incorporating atomic kinetics, spectroscopic-quality radiation transport, and Stark broadened line shapes, has been developed for rigorous data analysis. These measurements underscore the utility of the new Kr MMI instrument, which, combined with sophisticated analysis techniques, enables the diagnosis of plasma conditions at Te>2000 eV, thereby extending the capabilities beyond the prior Ar MMI design. This is an important stepping stone for achieving time-gated and space-resolved diagnostics of electron temperature, electron density, and heat transport in high temperature implosion cores.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2020

Electrical Energy Storage Data Submission Guidelines

Energy storage technologies are positioned to play a substantial role in power delivery systems. They are being touted as an effective new resource to maintain reliability and allow for increased penetration of renewable energy. However, due to their relative infancy, there is a lack of knowledge on how these resources truly operate over time. Data analysis can help ascertain the operational and performance characteristics of these emerging technologies. Rigorous testing and data analysis are important for all stakeholders to ensure a safe, reliable system that performs predictably on a macro level. Standardizing testing and analysis approaches to verifying the performance of energy storage devices, equipment, and systems when integrating them into the grid will improve the understanding and benefit of energy storage over time from technical and economic vantage points. Demonstrating the life-cycle value and capabilities of energy storage systems begins with the data the provider supplies for analysis. After review of energy storage data received from several providers, it has become clear that some of these data are inconsistent and incomplete, raising the question of their efficacy for robust analysis. This report reviews and proposes general guidelines such as sampling rates and data points that providers must supply for robust data analysis to take place. Consistent guidelines are the basis of the proper protocol and ensuing standards to (a) reduce the time it takes data to reach those who are providing analysis; (b) allow them to better understand the energy storage installations; and (c) enable them to provide high-quality analysis of the installations. This report is intended to serve as a starting point for what data points should be provided when monitoring. As battery technologies continue to advance and the industry expands, this report will be updated to remain current.

25 ENERGY STORAGE↗