Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data quality analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

SAXS Assistant: Automated SAXS analysis for structural discovery in biologics and polymeric nanoparticles

Small-angle x-ray scattering (SAXS) is a powerful technique for assessing macromolecular structure. High-throughput SAXS is limited by the time-consuming and, at times, subjective nature of SAXS data interpretation. Here, we present SAXS Assistant, a Python-based script that streamlines SAXS data analysis to extract features for machine learning (ML) and key structural parameters, including the Guinier radius of gyration (R g ), pair distance distribution function (PDDF)-derived R g , maximum particle dimension (D max ), and Kratky plots. The script builds upon BioXTAS RAW and validates reliability via Guinier/PDDF R g agreement, an important indicator of well-measured data sets. For assistance in D max estimation, a multilayer perceptron regressor was trained with 1940 data files from the Small Angle Scattering Biological Data Bank. The model achieved a test set performance R 2 = 0.90 and mean absolute error = 11.7 Å. Training exclusively with experimental data translates analyses from researchers, including experts in the field, to the ML model, which helps assess D max estimations from PDDF. Gaussian mixture model clustering was implemented to classify profiles into structural classes based on entries in the Small Angle Scattering Biological Data Bank. Users may therefore assess the similarity between experimental samples and known biomolecular shapes within the mapped repository entries. This probabilistic clustering aids in quantifying information from Kratky and generating shape-descriptive features. SAXS Assistant accelerates SAXS data analysis through enforced quality control, ML-ready outputs, and flags for low-confidence results. In addition to providing the ability to analyze large data sets at high throughput, this tool is versatile and may serve researchers in both biological and synthetic polymer research fields.

36 MATERIALS SCIENCE↗
NASA NTRS2020

Improving Quantitative Laboratory Analysis of Phycobiliproteins to Provide High Quality Validation Data for Ocean Color Remote Sensing Algorithm

Identification and characterization of phytoplankton communities and their physiology is a primary aim of NASA's PACE satellite mission. The concentration and composition of phytoplankton pigments modulate the spectral distribution of light emanating from the ocean, which is measured by ocean color satellites, and thus provide critical information on phytoplankton community composition and physiological parameters. One diagnostic class of pigments not routinely well-characterized is the phycobiliproteins (PBPs), and NASA has a requirement to collect and distribute high quality in situ data in support of data product validation activities for ocean color missions. Phycobiliproteins are light-harvesting proteins that are the predominant photosynthetic pigments in some classes of phytoplankton including cyanobacteria, such as Synechococcus, Trichodesmium, and Microcystis. With the advance of hyperspectral ocean color sensors such as on PACE (expected to launch in late 2022), it is essential that we implement routine analysis of PBPs that satisfies several considerations: reproducible, high extraction efficiency for a variety of environments, and Suitable for large scale analysis. Published techniques for PBP analysis vary in recommendations for: collection, extraction, disruption mode, and analysis; evidence suggests the variation in results may depend at least in part on the species and even strain(s) of interest. Experiments that tested variations in these parameters have drawn very different conclusions regarding extraction efficiency and reproducibility. Cyanobacteria are more difficult to extract than other PBP-containing algae such as cryptophytes, but can be important primary producers. We used a cryptophyte (Rhodomonas salina) and cyanobacterium (Synechococcus sp.) to compare extraction efficiencies of water samples concentrated via centrifugation to filtered samples using two different extraction buffers (phosphate and asolectin-CHAPS). Samples were analyzed on a fluorometer configured for PC and PE detection. The results have important implications for collection and storage of samples for routine analysis; some previous studies (although not all) have suggested that filtered samples have a much lower extraction efficiency than whole water samples.

Kenemer, Christopher↗
DOE OSTI2021

Anatomy of Continuous Mars SEIS and Pressure Data from Unsupervised Learning

The seismic noise recorded by the Interior Exploration using Seismic Investigations, Geodesy, and Heat Transport (InSight) seismometer (Seismic Experiment for Interior Structure [SEIS]) has a strong daily quasi-periodicity and numerous transient microevents, associated mostly with an active Martian environment with wind bursts, pressure drops, in addition to thermally induced lander and instrument cracks. That noise is far from the Earth’s microseismic noise. Quantifying the importance of nonstochasticity and identifying these microevents is mandatory for improving continuous data quality and noise analysis techniques, including autocorrelation. Cataloging these events has so far been made with specific algorithms and operator’s visual inspection. We investigate here the continuous data with an unsupervised deep-learning approach built on a deep scattering network. This leads to the successful detection and clustering of these microevents as well as better determination of daily cycles associated with changes in the intensity and color of the background noise. We first provide a description of our approach, and then present the learned clusters followed by a study of their origin and associated physical phenomena. We show that the clustering is robust over several Martian days, showing distinct types of glitches that repeat at a rate of several tens per sol with stable time differences. We show that the clustering and detection efficiency for pressure drops and glitches is comparable to or better than manual or targeted detection techniques proposed to date, noticeably with an unsupervised approach. Finally, here we discuss the origin of other clusters found, especially glitch sequences with stable time offsets that might generate artifacts in autocorrelation analyses. We conclude with presenting the potential of unsupervised learning for long-term space mission operations, in particular, for geophysical and environmental observatories.

58 GEOSCIENCES↗
DOE OSTI2020

PVAnalytics [SWR-20-33]

PVAnalytics inputs long term (multiple years) photovoltaic (PV) outdoor sensor data and completes autonomous quality assurance (QA) analysis on the data. Time series data from individual sensors such as electric meters, inverter outputs, irradiance, and temperature sensors are compared to physically expected outputs of these sensors under clear sky conditions based on the latitude, longitude, and orientation of the PV system. PVAnalytics outputs as QA pass or fail for each sensor, reasons determined for failure, time series flags identifying QA thresholds have been exceeded, flags for sunny days, the time zone found for the given sensor, sensor drift, time periods for passing data, and results of orientation checks.

Muller, Matthew↗
DOE OSTI2024

guppy i : a code for reducing the storage requirements of cosmological simulations

ABSTRACT As cosmological simulations have grown in size, the permanent storage requirements of their particle data have also grown. Even modest simulations present a major logistical challenge for the groups which run these boxes and researchers without access to high performance computing facilities often need to restrict their analysis to lower quality data. In this paper, we present guppy, a compression algorithm and code base tailored to reduce the sizes of dark matter-only cosmological simulations by approximately an order of magnitude. guppy is a ‘lossy’ algorithm, meaning that it injects a small amount of controlled and uncorrelated noise into particle properties. We perform extensive tests on the impact that this noise has on the internal structure of dark matter haloes, and identify conservative accuracy limits which ensure that compression has no practical impact on single-snapshot halo properties, profiles, and abundances. We also release functional prototype libraries in C, Python, and Go for reading and creating guppy data.

79 ASTRONOMY AND ASTROPHYSICS↗
NASA NTRS2023

System for Photogrammetry, Imaging, Detection, and Ranging, Software Design

Kennedy Space Center (KSC) uses high level pan/tilt camera systems in order to capture data for image analysis. As of right now, we know that current camera systems need to be man-operated, range greatly in costs, and are supplied by third parties. This project, System for Photogrammetric Imaging, Detection, and Ranging, otherwise known as SPIDR, aims to provide high quality image analysis from data drawn from the pan/tilt camera system to upgrade KSC’s ability to take images, and improve space flight and tracking. What this abstract will do, is explain the software needed to carry out such important tasks.

R.S. Kim↗
DOE OSTI2020

Exploring Renewable Energy Opportunities in Select Southeast Asian Countries: A Geospatial Analysis of the Levelized Cost of Energy of Utility-Scale Wind and Solar Photovoltaics

The costs of renewable energy-based electricity generation have fallen precipitously in recent years to levels that are increasingly competitive with traditional generation such as fossil fuel-based generation. As these costs become increasingly competitive, private developers, policymakers, and energy system planners are searching for opportunities to harness high-quality renewable energy resources. Developing economies are setting ambitious targets and exploring how cost-effective, grid-connected renewable energy options can help power economic growth and meet growing electricity demands. This includes the member states of the Association of Southeast Asian Nations (ASEAN) that are determined to reach a target of 23% of renewable energy in the region's total primary energy supply by 2025. A critical gap to identifying opportunities and scaling up renewable energy is the lack of quality data and analyses to support decisions on the investment and deployment of renewables - including wind and solar photovoltaics (PV). This work supports decision making by providing high-quality data and spatial analysis of the cost of utility-scale wind and solar PV generation in select countries of Southeast Asia - specifically, the ASEAN member states. Generation costs are expressed as the levelized cost of energy (LCOE) - a commonly used metric that represents the net present value of the unit cost of electricity during the lifetime of a particular electricity generation technology. This is the first spatial estimate of LCOE for these technologies within the ASEAN member states - providing insights into the roles that renewable energy resource quality and other factors may play in generation costs.

14 SOLAR ENERGY↗
NASA NTRS2020

Learning instrument invariant characteristics for generating high-resolution global coral reef maps

Coral reefs are one of the most biologically complex and diverse ecosystems within the shallow marine environment. Unfortunately, these underwater ecosystems are threatened by a number of anthropogenic challenges, including ocean acidification and warming, overfishing, and the continued increase of marine debris in oceans. This requires a comprehensive assessment of the world's coastal environments, including a quantitative analysis on the health and extent of coral reefs and other associated marine species, as a vital Earth Science measurement. However, limitations in observational and technological capabilities inhibit global sustained imaging of the marine environment. Harmonizing multimodal data sets acquired using different remote sensing instruments presents additional challenges, thereby limiting the availability of good quality labeled data for analysis. In this work, we develop a deep learning model for extracting domain invariant features from multimodal remote sensing imagery and creating high-resolution global maps of coral reefs by combining various sources of imagery and limited hand-labeled data available for certain regions. This framework allows us to generate, for the first time, coral reef segmentation maps at 2-meter resolution, which is a significant improvement over the kilometer-scale state-of-the-art maps. Additionally, this framework doubles accuracy and IoU metrics over baselines that do not account for domain invariance.

Domain Adaptation↗
NASA NTRS1994

A fixed-lag Kalman smoother for retrospective data assimilation

Analyses incorporating future data, as well as current and past data, are termed retrospective analyses. In this paper, the fixed-lag Kalman smoother (FLKS) is proposed as a means of providing retrospective analysis capability in data assimilation. The FLKS is a direct generalization of the Kalman filter. It incorporates all data observed up to and including some fixed amount of time past each analysis time. A computationally efficient form of the FLKS is derived. A simple scalar examination of the FLKS demonstrates that incorporating future data improves analyses the most in the presence of dynamical instabilities, for accurate models and for accurate observations. An implementation of the FLKS for two-dimensional linear shallow-water model corroborates the scalar analysis. The numerical experiments also demonstrate the ability of the FLKS to propagate information upstream as well as downstream, thus improving analysis quality substantially in data voids.

Cohn, Stephen E.↗
DOE OSTI2022

Design of a Test Article and Test Facility to Investigate Flow-Induced Vibration of a Helical Coil Steam Generator

NuScale Power LLC (NuScale) is developing a small modular reactor (SMR) with unique design features and arrangements that require testing to provide quality data for safety analysis codes and design validation, as well as for technology maturation. A multi-phase testing program is underway at NuScale to demonstrate that its unique helical coil steam generator design is not susceptible to flow-induced vibration during operation. The phases of the testing program include modal testing of individual tubes during test article fabrication and modal and flow testing after test article completion. NuScale has contracted SIET S.p.A. in Piacenza, Italy for the design and fabrication of the test article and test facility. In-fabrication testing was performed at the site of test article build in Cremosano, Italy. Modal testing and flow testing of the completed test article will be performed at SIET’s facilities in Piacenza. This paper discusses the design of the test article and test facility, including supporting systems, required to generate the quality data required to support NuScale’s comprehensive vibration assessment program as part of the overall licensing effort for NuScale’s first-of-a-kind small modular light water reactor.

Flow-induced vibration, helical coil, steam genera↗
NASA NTRS1999

Analysis and Application of Airborne Thermal Data at the Local Level Salt Lake City, Utah

Expanding cities are transforming periurban environments such as agricultural land, natural grasslands, forests, wetlands, and and land, into urban surfaces, such as asphalt and concrete. This transformation is part of a process defined as "urban heat island". The urban surfaces get much hotter during the daylight hours in the summer than the natural or vegetated environment. The heat builds up creating a dome effect over the city making it many degrees hotter than it's surrounding area. The impacts from this, which include higher usage of air conditioners, water, etc., are numerous and costly. As cities expand, this problem is exacerbated. It is necessary to incorporate better quality data into urban analysis and for establishing methods that systematically and objectively monitor growth and change due to increased urbanization. NASA initiated Project Atlanta in 1997 "as an interdisciplinary remote sensing study to observe and measure the growth and development of the urban heat island effect over Atlanta, and its associated impacts". This project has recently included Salt Lake City, among others, in the study of the development and effects of "urban heat islands". NASA has made available to Salt Lake City, high resolution, 10 meter, multispectral thermal data collected in June 1998. The data collection was part of a special NASA over-flight, a mission supported by the U.S. EPA in conjunction with their Urban Heat Island (UHI) Mitigation Initiative. Salt Lake City is one of three pilot cities selected to participate in this unique initiative. Hence, this project constitutes a rare opportunity to capitalize upon state-of-the-art NASA technology and link it to an urban community very concerned about rapid growth and development. This data will enhance existing data and be used for improving technical tools used to plan for Utah's future.

Dudley-Murphy, Elizabeth A.↗
DOE OSTI2024

SARS-CoV-2 wastewater variant surveillance: pandemic response leveraging FDA’s GenomeTrakr network

ABSTRACT Wastewater surveillance has emerged as a crucial public health tool for population-level pathogen surveillance. Supported by funding from the American Rescue Plan Act of 2021, the FDA‘s genomic epidemiology program, GenomeTrakr, was leveraged to sequence SARS-CoV-2 from wastewater sites across the United States. This initiative required the evaluation, optimization, development, and publication of new methods and analytical tools spanning sample collection through variant analyses. Version-controlled protocols for each step of the process were developed and published on protocols.io. A custom data analysis tool and a publicly accessible dashboard were built to facilitate real-time visualization of the collected data, focusing on the relative abundance of SARS-CoV-2 variants and sub-lineages across different samples and sites throughout the project. From September 2021 through June 2023, a total of 3,389 wastewater samples were collected, with 2,517 undergoing sequencing and submission to NCBI under the umbrella BioProject,PRJNA757291. Sequence data were released with explicit quality control (QC) tags on all sequence records, communicating our confidence in the quality of data. Variant analysis revealed wide circulation of Delta in the fall of 2021 and captured the sweep of Omicron and subsequent diversification of this lineage through the end of the sampling period. This project successfully achieved two important goals for the FDA’s GenomeTrakr program: first, contributing timely genomic data for the SARS-CoV-2 pandemic response, and second, establishing both capacity and best practices for culture-independent, population-level environmental surveillance for other pathogens of interest to the FDA. IMPORTANCE This paper serves two primary objectives. First, it summarizes the genomic and contextual data collected during a Covid-19 pandemic response project, which utilized the FDA’s laboratory network, traditionally employed for sequencing foodborne pathogens, for sequencing SARS-CoV-2 from wastewater samples. Second, it outlines best practices for gathering and organizing population-level next generation sequencing (NGS) data collected for culture-free, surveillance of pathogens sourced from environmental samples.

Microbiology↗
NASA NTRS1981

Estimating the quality of pasturage in the municipality of Paragominas (PA) by means of automatic analysis of LANDSAT data

The use of LANDSAT data to evaluate pasture quality in the Amazon region is demonstrated. Pasture degradation in deforested areas of a traditional tropical forest cattle-raising region was estimated. Automatic analysis using interactive multispectral analysis (IMAGE-100) shows that 24% of the deforested areas were occupied by natural vegetation regrowth, 24% by exposed soil, 15% by degraded pastures, and 46% was suitable grazing land.

Dejesusparada, N.↗
NASA NTRS2005

AIRSAR Automated Web-based Data Processing and Distribution System

In this paper, we present an integrated, end-to-end synthetic aperture radar (SAR) processing system that accepts data processing requests, submits processing jobs, performs quality analysis, delivers and archives processed data. This fully automated SAR processing system utilizes database and internet/intranet web technologies to allow external users to browse and submit data processing requests and receive processed data. It is a cost-effective way to manage a robust SAR processing and archival system. The integration of these functions has reduced operator errors and increased processor throughput dramatically.

WEB SERVICES↗
DOE OSTI2022

Simulation process and data flow for a large system dynamics model

This paper documents the workflow and supporting technologies that a large system dynamics model, the biomass scenario model, employs to streamline the data preparation, simulation, quality control, and analysis process at the National Renewable Energy Laboratory. The workflow centers on automation of routine aspects of the flow of data between data stores, simulations, and visualizations. It enforces quality checks on data, reproducibility of computations, and traceability of results, while maintaining complete archives of modeling and analysis artifacts. The resulting frictionless simulation/analysis environment supports large-scale sensitivity analysis, interactive creation of ensembles of simulations, and rapid visualization-based exploration of simulation results.

09 BIOMASS FUELS↗
DOE OSTI2023

Using taxa-based approaches to delineate stream macroinvertebrate assemblage responses to stressor gradients in modified alluvial agroecosystems

Alluvial plain landscapes are some of the most agriculturally productive lands in the world but often have modified stream ecosystems due to cultivation history. This context requires consideration when establishing water quality management goals. We analyzed state water quality databases to demonstrate that Mississippi Alluvial Plain (MAP) ecoregion streams have elevated specific conductivity (SC) and nutrients and lower macroinvertebrate local and regional taxa pools compared to streams in other ecoregions, potentially reducing the efficacy of traditional biomonitoring approaches within the region. To overcome these challenges, we used threshold indicator taxa analysis (TITAN) to compare macroinvertebrate assemblage responses to water quality gradients among ecoregions in Mississippi. We identified individual taxa and assemblage-level responses to increasing water quality degradation in MAP streams. Observed responses occurred at higher concentrations for SC, total organic carbon (TOC) and total phosphorus (TP), but not total nitrogen (TN) relative to other ecoregions. These responses appeared to be driven by a large proportion of indicator taxa considered tolerant or unresponsive in other ecoregions, responding negatively to increasing water quality stressors in MAP streams. Our observed assemblage-level stressor responses to WQ gradients in MAP streams demonstrate shifting tolerance in highly altered ecosystems may require adjustments to recovery expectations but also provide useful measures for monitoring improvements in regional water quality. For example, our observed macroinvertebrate assemblage response to increasing TP identified a management goal similar to guidance based on distributional analysis of water quality data within the MAP ecoregion (0.11 vs 0.128 mg L –1 ) and thus provide some biological basis for previously identified nutrient goals for the region. Our approach can guide and monitor success of nutrient reduction efforts in MAP watersheds and other alluvial plain agroecosystems where reference conditions do not exist, and local and regional taxa pools are less diverse and may not support full recovery of ecological assemblages. While our results are promising, they should also be compared with more sensitive and less habitat-limited biological assemblages (e.g., algae or bacteria) to better understand complex ecological responses to best management practices designed to increase sustainability of high production agricultural regions.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2024

TRACER Radar b1 Data Processing: Corrections, Calibrations, and Processing Report

The U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility deployed the first ARM Mobile Facility (AMF1) to Houston, Texas for the Tracking Aerosol Convection Interactions Experiment (TRACER) field campaign. The TRACER campaign was conducted from October 1, 2021 to September 30, 2022, with an intensive operational period (IOP) from June 1 to September 30, 2022. To investigate the life cycles of convective cells in the polluted and humid urban environment of Houston, ARM deployed cloud and precipitation radars, including the C-band Scanning ARM Precipitation Radar (CSAPR2), the X/Ka-band Scanning ARM Cloud Radar (SACR), and the Ka-band ARM Zenith cloud Radar (KAZR), as shown in Figure 1. This report presents an analysis of radar data quality, hardware calibrations, and radar data corrections.

54 ENVIRONMENTAL SCIENCES↗