Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data quality analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Stakeholder analysis for designing an urban air quality data governance ecosystem in smart cities

Cities, the world over, are fuelling economic growth. At the same time, rapid urbanization is a root cause of serious environmental damage. Recent WHO global air pollution guidelines highlight air pollution as a critical environmental threat along with climate change. To address these threats, smart cities and clean air programs are on a rise. In smart cities, data and Information and Communication Technologies (ICT) are major drivers of city transformations. The 4th Industrial Revolution (4IR) technologies such as the Internet of Things (IoT), big data, artificial intelligence (AI), and cloud computing have the potential to accelerate these transformations toward urban resilience. However, the success of smart cities and clean air programs depends on cohesive multi-sector stakeholder contributions. This study conducted interdisciplinary participative stakeholder analysis to understand the data, and sectorial challenges, to outline the technological opportunities to facilitate clean air programs in Indian smart cities. The research highlights gaps due to siloed stakeholder operations, lack of data calibration, non-alignment of smart city and air quality management services, non-availability of health exposure data, and difficulty in translating scientific data into implementable actions. Stakeholders expressed potential ‘fit for the purpose’ use of IoT devices, satellites, smartphones, and mobility data augmented by AI methods in bridging these gaps. In conclusion, the analysis points toward a need to develop an easily accessible and ubiquitous urban data governance ecosystem enabling seamless cross-sector data exchanges to build trusting relationships among the stakeholders across the air quality management value chain.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

Data Fusion to Enhance Quality Control and Analysis with Instruments at the Marine and Coastal Research Laboratory

Deploying environmental monitoring instruments in the marine environment can be challenging, facing challenges around device survivability, biofouling and corrosion, and consistent data collection. This project explores the use of data fusion – the process of integrating multiple data sources to produce more consistent, accurate, and useful information – to build a consistent long-term monitoring system at the Marine and Coastal Research Laboratory (MCRL) in Sequim, Washington. Unused instruments that had been acquired from past projects were inventoried and deployments planned on the MCRL pier and floating dock. A total of 8 instruments were deployed including a tide gauge, hydrophone, acoustic Doppler current profiler (ADCP), photosynthetically active radiation (PAR) sensors, meteorological station, and three water quality sensors. Deployments were planned to be well-protected around the pier structure and a maintenance schedule was created for cleaning and recalibration. An automated data pipeline was created to aggregate data on edge computers that push data to Amazon Web Services (AWS) cloud storage every 15 minutes, performing automated quality control and data transformations using the Time Series Data Analytical Toolkit (TSDAT). Continued efforts are underway to maintain this system into the future, take a data-driven approach to maintenance scheduling, improve the reliability of the system, and share the data with a variety of end-users.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Los Alamos National Laboratory 2022 Annual Site Environmental Report (Rev. 2)

Los Alamos National Laboratory (Laboratory) annual site environmental reports are prepared each year by the Laboratory’s environmental organizations as required by U.S. Department of Energy Order 231.1B, Administrative Change 1, Environment, Safety, and Health Reporting, and Order 458.1, Administrative Change 4, Radiation Protection of the Public and the Environment. The chapters in this report discuss our compliance with environmental laws, regulations, and orders (Chapter 2, Compliance Summary); how we manage the Laboratory’s environmental performance and assure the quality of data from analysis of environmental samples (Chapter 3, Environmental Programs and Analytical Data Quality); how we monitor for air emissions of radioactive materials and for weather conditions (Chapter 4, Air Quality); how we monitor for effects of Laboratory operations on groundwater quality (Chapter 5, Groundwater Protection); how we monitor the levels of chemicals and radionuclides in storm water runoff and sediment (Chapter 6, Watershed Quality); how we monitor for the levels and effects of chemicals and radionuclides in plants, animals, soil, and vegetation (Chapter 7, Ecosystem Health); and finally, what radioactive dose or risk from chemical exposure that members of the public could experience as a result of Laboratory operations (Chapter 8, Public Dose and Risk Assessment).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Quality Analysis of Baseline Time-Lapse CSEM Data CarbonSAFE Project, North Dakota

Conference presentation at International Meeting for Applied Geoscience & Energy (IMAGE), Houston, TX, August 28 – September 2, 2022. When a series of time-lapse CSEM surveys are designed to measure the often-small variations in signal seen in CCUS projects, the primary concern must be collecting the highest-quality data and reducing as much noise as possible. This includes optimization during planning and feasibility, careful and consistent quality checks in the field, and transparent and repeatable postprocessing steps. We apply this practice to a baseline (prior to CO 2 injection) CSEM data set collected for a time-lapse survey in Center, North Dakota, as a part of the North Dakota CarbonSAFE project, and describe the rigorous quality control and assessment methods used, including noise removal and data validation with 1D and 3D inversion to tie results to borehole logs. The final result is an accurate and representative CSEM data set and information that stakeholders can use to inform future time-lapse survey costs and designs.

20 FOSSIL-FUELED POWER PLANTS↗
DOE OSTI2025

SAXS Assistant: Automated SAXS analysis for structural discovery in biologics and polymeric nanoparticles

Small-angle x-ray scattering (SAXS) is a powerful technique for assessing macromolecular structure. High-throughput SAXS is limited by the time-consuming and, at times, subjective nature of SAXS data interpretation. Here, we present SAXS Assistant, a Python-based script that streamlines SAXS data analysis to extract features for machine learning (ML) and key structural parameters, including the Guinier radius of gyration (R g ), pair distance distribution function (PDDF)-derived R g , maximum particle dimension (D max ), and Kratky plots. The script builds upon BioXTAS RAW and validates reliability via Guinier/PDDF R g agreement, an important indicator of well-measured data sets. For assistance in D max estimation, a multilayer perceptron regressor was trained with 1940 data files from the Small Angle Scattering Biological Data Bank. The model achieved a test set performance R 2 = 0.90 and mean absolute error = 11.7 Å. Training exclusively with experimental data translates analyses from researchers, including experts in the field, to the ML model, which helps assess D max estimations from PDDF. Gaussian mixture model clustering was implemented to classify profiles into structural classes based on entries in the Small Angle Scattering Biological Data Bank. Users may therefore assess the similarity between experimental samples and known biomolecular shapes within the mapped repository entries. This probabilistic clustering aids in quantifying information from Kratky and generating shape-descriptive features. SAXS Assistant accelerates SAXS data analysis through enforced quality control, ML-ready outputs, and flags for low-confidence results. In addition to providing the ability to analyze large data sets at high throughput, this tool is versatile and may serve researchers in both biological and synthetic polymer research fields.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Anatomy of Continuous Mars SEIS and Pressure Data from Unsupervised Learning

The seismic noise recorded by the Interior Exploration using Seismic Investigations, Geodesy, and Heat Transport (InSight) seismometer (Seismic Experiment for Interior Structure [SEIS]) has a strong daily quasi-periodicity and numerous transient microevents, associated mostly with an active Martian environment with wind bursts, pressure drops, in addition to thermally induced lander and instrument cracks. That noise is far from the Earth’s microseismic noise. Quantifying the importance of nonstochasticity and identifying these microevents is mandatory for improving continuous data quality and noise analysis techniques, including autocorrelation. Cataloging these events has so far been made with specific algorithms and operator’s visual inspection. We investigate here the continuous data with an unsupervised deep-learning approach built on a deep scattering network. This leads to the successful detection and clustering of these microevents as well as better determination of daily cycles associated with changes in the intensity and color of the background noise. We first provide a description of our approach, and then present the learned clusters followed by a study of their origin and associated physical phenomena. We show that the clustering is robust over several Martian days, showing distinct types of glitches that repeat at a rate of several tens per sol with stable time differences. We show that the clustering and detection efficiency for pressure drops and glitches is comparable to or better than manual or targeted detection techniques proposed to date, noticeably with an unsupervised approach. Finally, here we discuss the origin of other clusters found, especially glitch sequences with stable time offsets that might generate artifacts in autocorrelation analyses. We conclude with presenting the potential of unsupervised learning for long-term space mission operations, in particular, for geophysical and environmental observatories.

58 GEOSCIENCES↗
DOE OSTI2020

PVAnalytics [SWR-20-33]

PVAnalytics inputs long term (multiple years) photovoltaic (PV) outdoor sensor data and completes autonomous quality assurance (QA) analysis on the data. Time series data from individual sensors such as electric meters, inverter outputs, irradiance, and temperature sensors are compared to physically expected outputs of these sensors under clear sky conditions based on the latitude, longitude, and orientation of the PV system. PVAnalytics outputs as QA pass or fail for each sensor, reasons determined for failure, time series flags identifying QA thresholds have been exceeded, flags for sunny days, the time zone found for the given sensor, sensor drift, time periods for passing data, and results of orientation checks.

Muller, Matthew↗
DOE OSTI2024

guppy i : a code for reducing the storage requirements of cosmological simulations

ABSTRACT As cosmological simulations have grown in size, the permanent storage requirements of their particle data have also grown. Even modest simulations present a major logistical challenge for the groups which run these boxes and researchers without access to high performance computing facilities often need to restrict their analysis to lower quality data. In this paper, we present guppy, a compression algorithm and code base tailored to reduce the sizes of dark matter-only cosmological simulations by approximately an order of magnitude. guppy is a ‘lossy’ algorithm, meaning that it injects a small amount of controlled and uncorrelated noise into particle properties. We perform extensive tests on the impact that this noise has on the internal structure of dark matter haloes, and identify conservative accuracy limits which ensure that compression has no practical impact on single-snapshot halo properties, profiles, and abundances. We also release functional prototype libraries in C, Python, and Go for reading and creating guppy data.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Exploring Renewable Energy Opportunities in Select Southeast Asian Countries: A Geospatial Analysis of the Levelized Cost of Energy of Utility-Scale Wind and Solar Photovoltaics

The costs of renewable energy-based electricity generation have fallen precipitously in recent years to levels that are increasingly competitive with traditional generation such as fossil fuel-based generation. As these costs become increasingly competitive, private developers, policymakers, and energy system planners are searching for opportunities to harness high-quality renewable energy resources. Developing economies are setting ambitious targets and exploring how cost-effective, grid-connected renewable energy options can help power economic growth and meet growing electricity demands. This includes the member states of the Association of Southeast Asian Nations (ASEAN) that are determined to reach a target of 23% of renewable energy in the region's total primary energy supply by 2025. A critical gap to identifying opportunities and scaling up renewable energy is the lack of quality data and analyses to support decisions on the investment and deployment of renewables - including wind and solar photovoltaics (PV). This work supports decision making by providing high-quality data and spatial analysis of the cost of utility-scale wind and solar PV generation in select countries of Southeast Asia - specifically, the ASEAN member states. Generation costs are expressed as the levelized cost of energy (LCOE) - a commonly used metric that represents the net present value of the unit cost of electricity during the lifetime of a particular electricity generation technology. This is the first spatial estimate of LCOE for these technologies within the ASEAN member states - providing insights into the roles that renewable energy resource quality and other factors may play in generation costs.

14 SOLAR ENERGY↗
DOE OSTI2022

Design of a Test Article and Test Facility to Investigate Flow-Induced Vibration of a Helical Coil Steam Generator

NuScale Power LLC (NuScale) is developing a small modular reactor (SMR) with unique design features and arrangements that require testing to provide quality data for safety analysis codes and design validation, as well as for technology maturation. A multi-phase testing program is underway at NuScale to demonstrate that its unique helical coil steam generator design is not susceptible to flow-induced vibration during operation. The phases of the testing program include modal testing of individual tubes during test article fabrication and modal and flow testing after test article completion. NuScale has contracted SIET S.p.A. in Piacenza, Italy for the design and fabrication of the test article and test facility. In-fabrication testing was performed at the site of test article build in Cremosano, Italy. Modal testing and flow testing of the completed test article will be performed at SIET’s facilities in Piacenza. This paper discusses the design of the test article and test facility, including supporting systems, required to generate the quality data required to support NuScale’s comprehensive vibration assessment program as part of the overall licensing effort for NuScale’s first-of-a-kind small modular light water reactor.

Flow-induced vibration, helical coil, steam genera↗
DOE OSTI2024

SARS-CoV-2 wastewater variant surveillance: pandemic response leveraging FDA’s GenomeTrakr network

ABSTRACT Wastewater surveillance has emerged as a crucial public health tool for population-level pathogen surveillance. Supported by funding from the American Rescue Plan Act of 2021, the FDA‘s genomic epidemiology program, GenomeTrakr, was leveraged to sequence SARS-CoV-2 from wastewater sites across the United States. This initiative required the evaluation, optimization, development, and publication of new methods and analytical tools spanning sample collection through variant analyses. Version-controlled protocols for each step of the process were developed and published on protocols.io. A custom data analysis tool and a publicly accessible dashboard were built to facilitate real-time visualization of the collected data, focusing on the relative abundance of SARS-CoV-2 variants and sub-lineages across different samples and sites throughout the project. From September 2021 through June 2023, a total of 3,389 wastewater samples were collected, with 2,517 undergoing sequencing and submission to NCBI under the umbrella BioProject,PRJNA757291. Sequence data were released with explicit quality control (QC) tags on all sequence records, communicating our confidence in the quality of data. Variant analysis revealed wide circulation of Delta in the fall of 2021 and captured the sweep of Omicron and subsequent diversification of this lineage through the end of the sampling period. This project successfully achieved two important goals for the FDA’s GenomeTrakr program: first, contributing timely genomic data for the SARS-CoV-2 pandemic response, and second, establishing both capacity and best practices for culture-independent, population-level environmental surveillance for other pathogens of interest to the FDA. IMPORTANCE This paper serves two primary objectives. First, it summarizes the genomic and contextual data collected during a Covid-19 pandemic response project, which utilized the FDA’s laboratory network, traditionally employed for sequencing foodborne pathogens, for sequencing SARS-CoV-2 from wastewater samples. Second, it outlines best practices for gathering and organizing population-level next generation sequencing (NGS) data collected for culture-free, surveillance of pathogens sourced from environmental samples.

Microbiology↗
DOE OSTI2022

Simulation process and data flow for a large system dynamics model

This paper documents the workflow and supporting technologies that a large system dynamics model, the biomass scenario model, employs to streamline the data preparation, simulation, quality control, and analysis process at the National Renewable Energy Laboratory. The workflow centers on automation of routine aspects of the flow of data between data stores, simulations, and visualizations. It enforces quality checks on data, reproducibility of computations, and traceability of results, while maintaining complete archives of modeling and analysis artifacts. The resulting frictionless simulation/analysis environment supports large-scale sensitivity analysis, interactive creation of ensembles of simulations, and rapid visualization-based exploration of simulation results.

09 BIOMASS FUELS↗
DOE OSTI2023

Using taxa-based approaches to delineate stream macroinvertebrate assemblage responses to stressor gradients in modified alluvial agroecosystems

Alluvial plain landscapes are some of the most agriculturally productive lands in the world but often have modified stream ecosystems due to cultivation history. This context requires consideration when establishing water quality management goals. We analyzed state water quality databases to demonstrate that Mississippi Alluvial Plain (MAP) ecoregion streams have elevated specific conductivity (SC) and nutrients and lower macroinvertebrate local and regional taxa pools compared to streams in other ecoregions, potentially reducing the efficacy of traditional biomonitoring approaches within the region. To overcome these challenges, we used threshold indicator taxa analysis (TITAN) to compare macroinvertebrate assemblage responses to water quality gradients among ecoregions in Mississippi. We identified individual taxa and assemblage-level responses to increasing water quality degradation in MAP streams. Observed responses occurred at higher concentrations for SC, total organic carbon (TOC) and total phosphorus (TP), but not total nitrogen (TN) relative to other ecoregions. These responses appeared to be driven by a large proportion of indicator taxa considered tolerant or unresponsive in other ecoregions, responding negatively to increasing water quality stressors in MAP streams. Our observed assemblage-level stressor responses to WQ gradients in MAP streams demonstrate shifting tolerance in highly altered ecosystems may require adjustments to recovery expectations but also provide useful measures for monitoring improvements in regional water quality. For example, our observed macroinvertebrate assemblage response to increasing TP identified a management goal similar to guidance based on distributional analysis of water quality data within the MAP ecoregion (0.11 vs 0.128 mg L –1 ) and thus provide some biological basis for previously identified nutrient goals for the region. Our approach can guide and monitor success of nutrient reduction efforts in MAP watersheds and other alluvial plain agroecosystems where reference conditions do not exist, and local and regional taxa pools are less diverse and may not support full recovery of ecological assemblages. While our results are promising, they should also be compared with more sensitive and less habitat-limited biological assemblages (e.g., algae or bacteria) to better understand complex ecological responses to best management practices designed to increase sustainability of high production agricultural regions.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

TRACER Radar b1 Data Processing: Corrections, Calibrations, and Processing Report

The U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility deployed the first ARM Mobile Facility (AMF1) to Houston, Texas for the Tracking Aerosol Convection Interactions Experiment (TRACER) field campaign. The TRACER campaign was conducted from October 1, 2021 to September 30, 2022, with an intensive operational period (IOP) from June 1 to September 30, 2022. To investigate the life cycles of convective cells in the polluted and humid urban environment of Houston, ARM deployed cloud and precipitation radars, including the C-band Scanning ARM Precipitation Radar (CSAPR2), the X/Ka-band Scanning ARM Cloud Radar (SACR), and the Ka-band ARM Zenith cloud Radar (KAZR), as shown in Figure 1. This report presents an analysis of radar data quality, hardware calibrations, and radar data corrections.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Spatio-Temporal Denoising Graph Autoencoders with Data Augmentation for Missing Photovoltaic Data Imputation

The integration of the global Photovoltaic (PV) market with real time data-loggers has enabled large scale PV data analytical pipelines for power forecasting and long-term reliability assessment of PV fleets. Nevertheless, the performance of PV data analysis heavily depends on the quality of PV timeseries data. This paper proposes a novel Spatio-Temporal Denoising Graph Autoencoder (STD-GAE) framework to impute missing PV Power Data. STDGAE exploits temporal correlation, spatial coherence, and value dependencies from domain knowledge to recover missing data. It is empowered by two modules. (1) To cope with sparse yet various scenarios of missing data, STD-GAE incorporates a domain-knowledge aware data augmentation module that creates plausible variations of missing data patterns. This generalizes STD-GAE to robust imputation over different seasons and environment. (2) STD-GAE nontrivially integrates spatiotemporal graph convolution layers (to recover local missing data by observed “neighboring” PV plants) and denoising autoencoder (to recover corrupted data from augmented counterpart) to improve the accuracy of imputation accuracy at PV fleet level. We have evaluated our proposed model on two realworld PV datasets. Experimental results show that STD-GAE can achieve a gain of 43.14% in imputation accuracy and remains less sensitive to missing rate, different seasons, and missing scenarios, compared with state-of-the-art data imputation methods such as MIDA and LRTC-TNN.

Fan, Yangxin↗
DOE OSTI2021

Field Data Analysis and Modeling of Drillstring Vibrations to Identify Inefficiency in Deep Geothermal Drilling

One challenge that hinders efficient drilling and causes downhole tool failures is severe drillstring vibrations. The objective of this paper is to identify the root cause of drillstring vibrations in deep geothermal wells and investigate their effect on drilling performance using data analytics and vibration modeling. A near-bit sub was utilized to collect vibration data, where the burst data was used to obtain the drillstring torsional natural frequency. The data showed that the highest lateral acceleration and stick-slip severities (SSS) occur at the higher mechanical specific energy (MSE) range, while the low vibration levels were encountered in the optimum range of the MSE curve. The elevated SSS levels consistently occur at the low to mid-range of applied RPM and the highest sonic velocity. Additionally, the lateral acceleration levels are higher at the low to mid-range of the applied RPM. The effect of drillstring vibration on drilling performance was recognized by the presented MSE analysis.

15 GEOTHERMAL ENERGY↗
DOE OSTI2024

Comparative Performance of Three Eye-Tracking Devices in Detection of Mild Traumatic Brain Injury in Acute Versus Chronic Subject Populations

ABSTRACT Introduction Presently, traumatic brain injury (TBI) triage in field settings relies on symptom-based screening tools such as the updated Military Acute Concussion Evaluation. Objective eye-tracking may provide an alternative means of neurotrauma screening due to sensitivity to neurotrauma brain-health changes. Previously, the US Army Medical Research and Development Command Non-Invasive NeuroAssessment Devices (NINAD) Integrated Product Team identified 3 commercially available eye-tracking devices (SyncThink EYE-SYNC, Oculogica EyeBOX, NeuroKinetics IPAS) as meeting criteria toward being operationally effective in the detection of TBI in service members. We compared these devices to assess their relative performance in the classification of mild traumatic brain injury (mTBI) subjects versus normal healthy controls. Materials and Methods Participants 18 to 45 years of age were assigned to Acute mTBI, Chronic mTBI, or Control group per study criteria. Each completed a TBI assessment protocol with all 3 devices counterbalanced across participants. Acute mTBI participants were tested within 72 hours following injury whereas time since last injury for the Chronic mTBI group ranged from months to years. Discriminant analysis was undertaken to determine device classification performance in separating TBI subjects from controls. Area Under the Curves (AUCs) were calculated and used to compare the accuracy of device performance. Device-related factors including data quality, the need to repeat tests, and technical issues experienced were aggregated for reporting. Results A total of 63 participants were recruited as Acute mTBI subjects, 34 as Chronic mTBI subjects, and 119 participants without history of TBI as controls. To maximize outcomes, poorer quality data were excluded from analysis using specific criteria where possible. Final analysis utilized 49 (43 male/6 female, mean [x̅] age = 24.3 years, SD [s] = 5.1) Acute mTBI subjects, and 34 (33 male/1 female, x̅ age = 38.8 years, s = 3.9) Chronic mTBI subjects were age- and gender-matched as closely as possible with Control subjects. AUCs obtained with 80% of total dataset ranged from 0.690 to 0.950 for the Acute Group and from 0.753 to 0.811 for the Chronic mTBI group. Validation with the remaining 20% of dataset produced AUCs ranging from 0.600 to 0.750 for Acute mTBI group and 0.490 to 0.571 for the Chronic mTBI group. Conclusions Potential eye-tracking detection of mTBI, per training model outcomes, ranged from acceptable to excellent for the Acute mTBI group; however, it was less consistent for the Chronic mTBI group. The self-imposed targeted performance (AUC of 0.850) appears achievable, but further device improvements and research are necessary. Discriminant analysis models differed for the Acute versus Chronic mTBI groups, suggesting performance differences in eye-tracking. Although eye-tracking demonstrated sensitivity in the Chronic group, a more rigorous and/or longitudinal study design is required to evaluate this observation. mTBI injuries were not controlled for this study, potentially reducing eye-tracking assessment sensitivity. Overall, these findings indicate that while eye-tracking remains a viable means of mTBI screening, device-specific variability in data quality, length of testing, and ease of use must be addressed to achieve NINAD objectives and DoD implementation.

General & Internal Medicine↗