Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data quality analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

PIPES (Pipeline for Integrated Projects in Energy Systems) [SWR-24-89]

The Pipeline for Integrated Projects in Energy Systems (PIPES) is a comprehensive project, data, and workflow management tool designed for integrated modeling teams. PIPES facilitates the management of data requirements, tasks, and progress tracking, serving as a higher-level integration layer that works across various data and modeling software. This tool integrates models, data, and tools to perform large-scale, integrated analysis work at scale. PIPES is designed to streamline integrated modeling projects, enhance collaboration, and ensure the quality and efficiency of data management and workflow processes. https://github.com/nrel-pipes/pipes-api https://github.com/nrel-pipes/pipes-web https://github.com/nrel-pipes/nrel-pipes

Gu, Jianli↗
DOE OSTI2025

Pipeline for Integrated Projects in Energy Systems (PIPES): A Tool for Integrated System Planning [Slides]

The Pipeline for Integrated Projects in Energy Systems (PIPES) is a comprehensive project, data, and workflow management tool designed for integrated modeling teams. PIPES facilitates the management of data requirements, tasks, and progress tracking, serving as a higher-level integration layer that works across various data and modeling software. This tool integrates models, data, and tools to perform large-scale, integrated analysis work at scale. PIPES is designed to streamline integrated modeling projects, enhance collaboration, and ensure the quality and efficiency of data management and workflow processes. This presentation introduces PIPES a multi-model tool for integrated system planning; it describes the underlying architecture, deep dives into common user workflows, and outlines the upcoming development roadmap beyond its current alpha state.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2023

Evolving efforts to maintain and improve XPS analysis quality in an era of increasingly diverse uses and users

Based on literature analysis, X-ray photoelectron spectroscopy (XPS) use continues to increase exponentially. This increased use is accompanied by anecdotal reports and systematic analyses indicating a growing presence of significantly flawed data analyses. Recognition of this problem within the surface analysis community has increased with an understanding that both inexperienced users and increased use of XPS outside the surface analysis community contribute to the problem. The XPS community has initiated several efforts to help address the problem, which is not unique to XPS. This paper describes some of the specific problems identified and some of the community efforts intended to address them. Here, we describe activities focused on three specific issues: (i) requests for detailed guides and protocols and bite-sized versions of information for non-experts, (ii) incomplete data and analysis reporting, and (iii) the high rate of peak fitting problems. A 2019 survey identified the need for guides, protocols, and standards to assist XPS users. One set of such guides has been published, and another is being assembled. Providing incremental bites of useful information is the goal of a series of papers on specific challenges to surface analysis with example solutions has been initiated as Notes and Insights papers in Surface and Interface Analysis. Examination of XPS-containing papers finds that information to establish the credibility and reproducibility of XPS results is often very incomplete. Unfortunately, ISO and ASTM standards require an amount of parameter reporting that seems excessive and unrealistic for many research publications. Initial approaches to develop and distribute a graded approach to parameter reporting are briefly described. Multiple efforts are underway to address the high rate of problems associated with photoelectron peak fitting. These include guides to peak fitting, guides to peak identification and fitting for specific elements, and the development of a peak fitting social network. The fitting social network is designed to facilitate interactions between new and experienced XPS users; analysts trying to fit XPS data (for publication or other reasons) can ask questions and establish dynamic conversations. Encouraging and enabling high-quality XPS analysis and reporting requires several different types of effort from all members of the surface and interface analysis community.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
NASA NTRS1977

Land use change detection with LANDSAT-2 data for monitoring and predicting regional water quality degradation

The author has identified the following significant results. Comparison between LANDSAT 1 and 2 imagery of Arkansas provided evidence of significant land use changes during the 1972-75 time period. Analysis of Arkansas historical water quality information has shown conclusively that whereas point source pollution generally can be detected by use of water quality data collected by state and federal agencies, sampling methodologies for nonpoint source contamination attributable to surface runoff are totally inadequate. The expensive undertaking of monitoring all nonpoint sources for numerous watersheds can be lessened by implementing LANDSAT change detection analyses.

Macdonald, H.↗
DOE OSTI2025

RTN-095: The Vera C. Rubin Observatory Data Preview 1

We present Rubin Data Preview 1 (DP1), the first release of data from the NSF-DOE Vera C. Rubin Observatory, consisting of raw and calibrated single-epoch images, coadds, difference images, detection catalogs, and other derived data products. DP1 is based on 1792 science-grade optical/near-infrared exposures acquired over 48 distinct nights by the Rubin Commissioning Camera, LSSTComCam, on the Simonyi Survey Telescope at the Summit Facility on Cerro Pachón, Chile during the first on-sky commissioning campaign in late 2024. DP1 covers a total of ~15 sq. deg. over seven roughly equally-sized non-contiguous fields, each independently observed in six broad photometric bands, ugrizy, spanning a range of stellar densities and latitudes and overlapping with external reference datasets. The median image quality across all bands, measured by the FWHM of the point-spread function, is approximately 1.13 arcseconds, with the sharpest images reaching about 0.65 arcseconds. DP1 contains approximately 2.3 million distinct astrophysical objects, of which 1.6 million are extended in at least one band, and 431 solar system objects, of which 93 are new discoveries. DP1 is approximately 3.5 TB in size and available to Rubin data rights holders via the Rubin Science Platform, a cloud-based environment for the analysis of petascale astronomical data. While small compared to future LSST releases, its high quality and diversity of data support a broad range of early science investigations across all four LSST themes, providing a valuable opportunity to engage with Rubin data ahead of the start of full operations in late 2025.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Assessment of BQ-9000 Biodiesel Properties for 2020 (CRADA CRD-15-593)

Biodiesel producers in the United States and Canada can voluntarily participate in the industry's BQ-9000 quality assurance program. This is the fourth in a series of reports documenting biodiesel quality from participating producers. Participants in the BQ-9000 program were requested to voluntarily provide data to a third-party team. This team anonymized and randomized the data prior to providing to the National Renewable Energy Laboratory (NREL) for analysis and reporting. The critical quality parameters analyzed are: sodium and potassium, calcium and magnesium, phosphorus, flash point and alcohol control, water and sediment, cloud point, acid number, free and total glycerin, monoglycerides, sulfur, oxidation stability, and cold soak filterability test (CSFT). The statistical analysis for these parameters is presented in Table ES-1.

09 BIOMASS FUELS↗
DOE OSTI2020

ATLAS data quality operations and performance for 2015–2018 data-taking

The ATLAS detector at the Large Hadron Collider reads out particle collision data from over 100 million electronic channels at a rate of approximately $100$ kHz, with a recording rate for physics events of approximately 1 kHz. Before being certified for physics analysis at computer centres worldwide, the data must be scrutinised to ensure they are clean from any hardware or software related issues that may compromise their integrity. Prompt identification of these issues permits fast action to investigate, correct and potentially prevent future such problems that could render the data unusable. This is achieved through the monitoring of detector-level quantities and reconstructed collision event characteristics at key stages of the data processing chain. This paper presents the monitoring and assessment procedures in place at ATLAS during 2015-2018 data-taking. Through the continuous improvement of operational procedures, ATLAS achieved a high data quality efficiency, with 95.6% of the recorded proton-proton collision data collected at $\sqrt{s}=13$ TeV certified for physics analysis.

43 PARTICLE ACCELERATORS↗
DOE OSTI2023

BigNeuron: a resource to benchmark and predict performance of algorithms for automated tracing of neurons in light microscopy datasets

BigNeuron is an open community bench-testing platform with the goal of setting open standards for accurate and fast automatic neuron tracing. We gathered a diverse set of image volumes across several species that is representative of the data obtained in many neuroscience laboratories interested in neuron tracing. Here, we report generated gold standard manual annotations for a subset of the available imaging datasets and quantified tracing quality for 35 automatic tracing algorithms. The goal of generating such a hand-curated diverse dataset is to advance the development of tracing algorithms and enable generalizable benchmarking. Together with image quality features, we pooled the data in an interactive web application that enables users and developers to perform principal component analysis, t-distributed stochastic neighbor embedding, correlation and clustering, visualization of imaging and tracing data, and benchmarking of automatic tracing algorithms in user-defined data subsets. The image quality metrics explain most of the variance in the data, followed by neuromorphological features related to neuron size. Furthermore, we observed that diverse algorithms can provide complementary information to obtain accurate results and developed a method to iteratively combine methods and generate consensus reconstructions. The consensus trees obtained provide estimates of the neuron structure ground truth that typically outperform single algorithms in noisy datasets. However, specific algorithms may outperform the consensus tree strategy in specific imaging conditions. Finally, to aid users in predicting the most accurate automatic tracing results without manual annotations for comparison, we used support vector machine regression to predict reconstruction quality given an image volume and a set of automatic tracings.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2004

Archive and Analysis of Data Collected Aboard the University of Washington's Convair-580 Research Aircraft in CLAMS

Work under this grant has been concerned with: (a) quality-assurance (QA) checking of the data collected on the University of Washington s (UW) Convair- 580 in the Chesapeake Lighthouse and Measurements for Satellites (CLAMS) field study in the Summer of 2001, (b) providing these data to the Langley DAAC, (c) providing specific data to users as requested, (d) analysis of portions of the data and publication of results, and (e) presentation of CLAMS results at workshop and conferences.

Hobbs, Peter V.↗
NASA NTRS2023

Non-Gaussian Ensemble Filtering and Adaptive Inflation for Soil Moisture Data Assimilation

The rank histogram filter (RHF) and the ensemble Kalman filter (EnKF) are assessed for soil moisture estimation using perfect model (identical twin) synthetic data assimilation experiments. The primary motivation is to gauge the impact on analysis quality attributable to the consideration of non-Gaussian forecast error distributions. Using the NASA Catchment land surface model, the two filters are compared at 18 globally-distributed single-catchment locations for a 10-year experiment period. It is shown that both filters yield adequate estimates of soil moisture, with the RHF having a small but significant performance advantage. Most notably, the RHF systematically increases the normalized information contribution (NIC) score of the mean absolute bias by 0.05 over that of the EnKF for surface, root-zone and profile soil moisture. The RHF also increases the NIC score for the anomaly correlation of surface soil moisture by 0.02 over that of the EnKF (at a 5% significance level). Results also demonstrate that the performance of both filters is somewhat improved when the ensemble priors are adaptively inflated to offset the negative effects of systematic errors.

Soil moisture↗
DOE OSTI2023

Improved quality metrics for association and reproducibility in chromatin accessibility data using mutual information

Correlation metrics are widely utilized in genomics analysis and often implemented with little regard to assumptions of normality, homoscedasticity, and independence of values. This is especially true when comparing values between replicated sequencing experiments that probe chromatin accessibility, such as assays for transposase-accessible chromatin via sequencing (ATAC-seq). Such data can possess several regions across the human genome with little to no sequencing depth and are thus non-normal with a large portion of zero values. Despite distributed use in the epigenomics field, few studies have evaluated and benchmarked how correlation and association statistics behave across ATAC-seq experiments with known differences or the effects of removing specific outliers from the data. Here, we developed a computational simulation of ATAC-seq data to elucidate the behavior of correlation statistics and to compare their accuracy under set conditions of reproducibility. Using these simulations, we monitored the behavior of several correlation statistics, including the Pearson’s R and Spearman’s ρ coefficients as well as Kendall’s τ and Top–Down correlation. We also test the behavior of association measures, including the coefficient of determination R 2 , Kendall’s W, and normalized mutual information. Our experiments reveal an insensitivity of most statistics, including Spear man’s ρ, Kendall’s τ, and Kendall’s W, to increasing differences between simulated ATAC-seq replicates. The removal of co-zeros (regions lacking mapped sequenced reads) between simulated experiments greatly improves the estimates of correlation and association. After removing co-zeros, the R 2 coefficient and normalized mutual information display the best performance, having a closer one-to-one relationship with the known portion of shared, enhanced loci between simulated replicates. When comparing values between experimental ATAC-seq data using a random forest model, mutual information best predicts ATAC-seq replicate relationships. Collectively, this study demonstrates how measures of correlation and association can behave in epigenomics experiments. We provide improved strategies for quantifying relationships in these increasingly prevalent and important chromatin accessibility assays.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS2005

Seasonal-scale Observational Data Analysis and Atmospheric Phenomenology for the Cold Land Processes Experiment

The Cold Land Processes Experiment (CLPX) experiment emphasized the development of a strong synergism between process-oriented understanding, land surface models and microwave remote sensing. Our work sought to investigate which topographically- generated atmospheric phenomena are most relevant to the CLPX MSA's for the purpose of evaluating their climatic importance to net local moisture fluxes and snow transport through the use of high-resolution data assimilation/atmospheric numerical modeling techniques. Our task was to create three long-term, scientific quality atmospheric datasets for quantitative analysis (for all CLPX researchers) and provide a summary of the meteorologically-relevant phenomena of the three MSAs (see Figure) over northern Colorado. Our efforts required the ingest of a variety of CLPX datasets and the execution an atmospheric and land surface data assimilation system based on the Navier-Stokes equations (the Local Analysis and Prediction System, LAPS, and an atmospheric numerical weather prediction model, as required) at topographically- relevant grid spacing (approx. 500 m). The resulting dataset will be analyzed by the CLPX community as a part of their larger research goals to determine the relative influence of various atmospheric phenomena on processes relevant to CLPX scientific goals.

Poulos, Gregory S.↗
NASA NTRS2002

Progress in Search for Antihelium with BESS

We have searched for antihelium nuclei in cosmic rays using the data obtained from balloon flights of the BESS magnetic spectrometer. The search was mainly based on track-quality selection, followed by rigidity analysis, and on the time-of-flight and dE/dx measurements by the scintillation counter hodoscope. We analysed all the data collected during 1993-2000 with a common analysis procedure. No antihelium nuclei events were found in the energy range from 1 to 14 GV. In order to determine a new upper limit, we have simulated the loss in the air and in the instrument of He (He-bar) using the GEANT/GHEISHA code. Combined with the data collected in 1993 through 2000, a new 95 % confidence upper limit for the ratio of He-bar/He at the top of the atmosphere of 6.8 x 10(exp -7) has been obtained to be after correcting for the interactions in the air and in the instruments.

Sasaki, M.↗
NASA NTRS1977

Proceedings of the Eleventh International Symposium on Remote Sensing of Environment, volume 2

Application and processing of remotely sensed data are discussed. Areas of application include: pollution monitoring, water quality, land use, marine resources, ocean surface properties, and agriculture. Image processing and scene analysis are described along with automated photointerpretation and classification techniques. Data from infrared and multispectral band scanners onboard LANDSAT satellites are emphasized.

Source record↗
DOE OSTI2022

International interlaboratory compilation of trace element concentrations in the CUP-2 uranium ore concentrate standard

Herein, a nuclear forensics investigation involving a uranium ore concentrate relies on accurate and precise analysis of impurities. Analytical data defensibility requires the use of reference materials as part of quality control. This study presents a compilation of trace element concentration results of the CUP-2 Uranium Ore Concentrate Standard measured by 11 different laboratories. The laboratories employed various dissolution methods, analytical preparation methods, and instrumental platforms. The data presented here contain concentrations of 66 impurities with up to 138 individual data points for each impurity. Consensus values have been assigned to each impurity following a statistical analysis of the data set.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
NASA NTRS1981

Analysis of GOES imagery and digitized data for the SEV-UPS period, August 1979

In support of the Southeastern Virginia Urban Plume Study (SEV-UPS), GOES satellite imagery was analyzed for the month of August 1979. The analyzed GOES images provide an additional source of meteorological input useful in the evaluation of air quality data collected during the month long period of the SEV-UPS experiment. In addition to the imagery analysis, GOES digitized data were analyzed for the period of August 6 to 11, during which a regional haze pattern was detectable in the imagery. The results of the study indicate that the observed haze patterns correspond closely with areas shown in surface based measurements to have reduced visibilities and elevated pollution levels. Moreover, the results of the analysis of digitized data indicate that digital reflectance counts can be directly related to haze intensity both over land and ocean. The model results agree closely with the observed GOES digital reflectance counts, providing further indication that satellite remote sensing can be a useful tool for monitoring regional elevated pollution episodes.

Bowley, C. J.↗
NASA NTRS1998

Flight Acoustics Measurement Techniques and Applications

Careful consideration must be given to data acquisition and analysis techniques in the design of experiments for the measurement of noise generated by flight vehicles. Although noise measurement locations and data reduction procedures are specified for aircraft certification by FAA and ICAO directives, for example, there are virtually no established procedures for aircraft noise measurement for other purposes. To optimize the quality and quantity of information obtained in a flight acoustics experiment, microphone layout, data acquisition, and analysis must be tailored to the specific test objective. This paper will review flight acoustics technology at NASA Langley Research Center developed over the past decade. In particular, the paper will focus on flight experiments performed for three diverse objectives: (1) research applications, such as noise prediction code validation, (2) noise impact modeling, and (3) noise abatement flight procedures. To best achieve these diverse objectives, different deployments of microphone systems on the ground are required, and different data analysis techniques are needed. In all cases, accurate positioning of the aircraft synchronized in time with the data recording is necessary. However, there are some restrictions on flight operations unique to each case for the methods to properly work.

Preisser, J. S.↗
NASA NTRS1993

Short Arc Orbit Determination for Altimeter Calibration and Validation on TOPEX/Poseidon

TOPEX/Poseidon (T/P) is a joint mission of US NASA and French CNES design launched August 10, 1992. It carries two radar altimeters which alternately share a common antenna. There are two project designated verification sites, a NASA site off the coast at Pt. Conception, CA, and a CNES site near Lampedusa Island in the Mediterranean Sea. Altimeter calibration and validation for T/P is performed over these highly instrumented sites by comparing the spacecraft's altimeter radar range to computed range based on in situ measurements which include the estimated orbit position. This paper presents selected results of orbit determination over each of these sites to support altimeter verification. A short arc orbit determination technique is used to estimate a locally accurate position determination of T/P from less than one revolution of satellite laser ranging (SLR) data. This technique is relatively insensitive to gravitational and nongravitational force modeling errors and is therefore essentially geometrical. The quality of these short arc orbits is demonstrated by covariance analysis and by comparison to orbits determined from longer arcs of data and other tracking data types, such as DORIS and Global Positioning System Demonstration Receiver (GPSDR) data.

radar↗