Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data sets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2014

A system to detect cerebral aneurysms in multimodality angiographic data sets

Purpose: The early detection of cerebral aneurysms plays a major role in preventing subarachnoid hemorrhage. The authors present a system to automatically detect cerebral aneurysms in multimodal 3D angiographic data sets. The authors’ system is parametrizable for contrast-enhanced magnetic resonance angiography (CE-MRA), time-of-flight magnetic resonance angiography (TOF-MRA), and computed tomography angiography (CTA). Methods: Initial volumes of interest are found by applying a multiscale sphere-enhancing filter. Several features are combined in a linear discriminant function (LDF) to distinguish between true aneurysms and false positives. The features include shape information, spatial information, and probability information. The LDF can either be parametrized by domain experts or automatically by training. Vessel segmentation is avoided as it could heavily influence the detection algorithm. Results: The authors tested their method with 151 clinical angiographic data sets containing 112 aneurysms. The authors reach a sensitivity of 95% with CE-MRA data sets at an average false positive rate per data set (FP{sub DS}) of 8.2. For TOF-MRA, we achieve 95% sensitivity at 11.3 FP{sub DS}. For CTA, we reach a sensitivity of 95% at 22.8 FP{sub DS}. For all modalities, the expert parametrization led to similar or better results than the trained parametrization eliminating the need for training. 93% of aneurysms that were smaller than 5 mm were found. The authors also showed that their algorithm is capable of detecting aneurysms that were previously overlooked by radiologists. Conclusions: The authors present an automatic system to detect cerebral aneurysms in multimodal angiographic data sets. The system proved as a suitable computer-aided detection tool to help radiologists find cerebral aneurysms.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2012

A multi-data set comparison of the vertical structure of temperature variability and change over the Arctic during the past 100 years

We compare the daily, interannual, and decadal variability and trends in the thermal structure of the Arctic troposphere using eight observation-based, vertically resolved data sets, four of which have data prior to 1948. Comparisons on the daily scale between historical reanalysis data and historical upper-air observations were performed for Svalbard for the cold winters 1911/1912 and 1988/1989, the warm winters 1944/1945 and 2005/2006, and the International Geophysical Year 1957/1958. Excellent agreement is found at mid-tropospheric levels. Near the ground and at the tropopause level, however, systematic differences are identified. On the interannual time scale, the correlations between all data sets are high, but there are systematic biases in terms of absolute values as well as discrepancies in the magnitude of the variability. The causes of these differences are discussed. While none of the data sets individually may be suitable for trend analysis, consistent features can be identified from analyzing all data sets together. To illustrate this, we examine trends and 20-year averages for those regions and seasons that exhibit large sea-ice changes and have enough data for comparison. In the summertime Pacific Arctic and the autumn eastern Canadian Arctic, the lower tropospheric temperature anomalies for the recent two decades are higher than in any previous 20-year period. In contrast, mid-tropospheric temperatures of the European Arctic in the wintertime of the 1920s and 1930s may have reached values as high as those of the late 20th and early 21st centuries.

Meteorology & Atmospheric Sciences↗
DOE OSTI2020

Quantifying concordance of correlated cosmological data sets

We develop estimators of agreement and disagreement between correlated cosmological data sets. These account for data correlations when computing the significance of both tensions and excess confirmation while remaining statistically optimal. We discuss and thoroughly characterize different approaches commenting on the ones that have the best behavior in practical applications. We complement the calculation of their statistical distribution within the Gaussian model with one estimator that takes non-Gaussianities fully into account. To illustrate the use of our techniques, we apply these estimators to supernovae measurements of the distance-redshift relation, absolutely calibrated by the local distance ladder. The suite of best estimators that we discuss finds results that are in excellent agreement between estimators and find no indications of significant internal inconsistencies in this data set above the 1% probability threshold. Furthermore, this shows the robustness of local determinations of the Hubble constant to features in the distance-redshift relation.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2017

Evolutionary optimization of PAW data-sets for accurate high pressure simulations

We examine the challenge of performing accurate electronic structure calculations at high pressures by comparing the results of all-electron full potential linearized augmented-plane-wave calculations, as implemented in the WIEN2k code, with those of the projector augmented wave (PAW) method, as implemented in Quantum ESPRESSO or Abinit code. In particular, we focus on developing an automated and consistent way of generating transferable PAW data-sets that can closely produce the all electron equation of state defined from zero to arbitrary high pressures. The technique we propose is an evolutionary search procedure that exploits the ATOMPAW code to generate atomic data-sets and the Quantum ESPRESSO software suite for total energy calculations. We demonstrate different aspects of its workability by optimizing PAW basis functions of some elements relatively abundant in planetary interiors. In addition, we introduce a new measure of atomic data-set goodness by considering their performance uniformity over an extended pressure range. - Highlights: • An attempt made to achieve the AE-FLAPW accuracy, at the favorable computational efficiency of the PAW approach for an outspread pressure range. • Provided an automatic and consistent route for developing efficient and transferable PAW data-sets. • Explicated an improved measure for the goodness of data-sets by including uniformity of the data-set performance over an extended pressure range.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2025

Data Set Analysis to Reduce Uncertainty in Formula Assignments of Ultrahigh Resolution Mass Spectra

Environmental samples contain a vast array of organic compounds with diverse elemental compositions and heteroatom content. Molecular formula assignments of ultrahigh resolution mass spectra (HRMS) hold promise for elucidating the molecular composition of these compounds. However, the need to account for an assortment of heteroatoms increases the uncertainty associated with individual assignments – and ultimately the ecological, biological, and biogeochemical insights gleaned from the assignments. To address this challenge, we introduce a formula assignment strategy that leverages HRMS data sets to improve assignment confidence, filter false assignments, and mitigate bias in assignment routines. The strategy, implemented using CoreMS, first identifies the highest confidence assignment for a recurring ion in a data set by assessing the mass accuracy and isotopologue similarity of all assignments to the ion across the data set. The second component of the strategy examines the consistency of mass errors for an assigned ion throughout a data set and flags formulas with statistically unlikely deviations in mass error. Here, we illustrate the application and utility of the strategy by comparing its results against documented misassignment patterns within a set of oceanographic samples that were measured with 21 T Fourier Transform Ion Cyclotron Resonance Mass Spectrometry. Because the efficacy of our strategy improves with data set size, it is particularly useful for enhancing assignment confidence in large HRMS data sets common in studies of environmental systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

MicroBooNE Public Data Sets: a Collaborative Tool for LArTPC Software Development

Among liquid argon time projection chamber (LArTPC) experiments MicroBooNE is the one that continually took physics data for the longest time (2015-2021), and represents the state of the art for reconstruction and analysis with this detector. Recently published analyses include oscillation physics results, searches for anomalies and other BSM signatures, and cross section measurements. LArTPC detectors are being used in current experiments such as ICARUS and SBND, and being planned for future experiments such as DUNE. MicroBooNE has recently released to the public two of its data sets, with the goal of enabling collaborative software developments with other LArTPC experiments and with AI or computing experts. These data sets simulate neutrino interactions on top of off-beam data, which include cosmic ray background and noise. The data sets are released in two formats: the native art/ROOT format used internally by the collaboration and familiar to other LArTPC experts, and the HDF5 format which contains reduced and simplified content and is suitable for usage by the broader community. This contribution presents the open data sets, discusses their motivation, the technical implementation, and the extensive documentation -- all inspired by FAIR principles. Finally, opportunities for collaborations are discussed.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2018

Parallel k-means Clustering of Geospatial Data Sets Using Manycore CPU Architectures

The increasing availability of high-resolution geospatiotemporal data sets from sources such as observatory networks, remote sensing platforms, and computational Earth system models has opened new possibilities for knowledge discovery and mining of weather, climate, ecological, and other geoscientific data sets fused from disparate sources. Many of the standard tools used on individual workstations are impractical for the analysis and synthesis of data sets of this size; however, new algorithmic approaches that can effectively utilize the complex memory hierarchies and the extremely high levels of parallelism available in state-of-the-art high-performance computing platforms can enable such analysis. Here, we describe pKluster, an open-source tool we have developed for accelerated k-means clustering of geospatial and geospatiotemporal data, and discuss algorithmic modifications and code optimizations we have made to enable it to effectively use parallel machines based on novel CPU architectures—such as the Intel “Knights Landing” Xeon Phi and Skylake Xeon processors—with many cores and hardware threads, and employing significant single instruction, multiple data (SIMD) parallelism. We outline some applications of the code in ecology and climate science contexts and present a detailed discussion of the performance of the code for one such application, LiDAR-derived vertical vegetation structure classification.

Mills, Richard T↗
DOE OSTI2018

Application of Genetic Algorithm (GA) Assisted Partial Least Square (PLS) Analysis on Trilinear and Non-trilinear Fluorescence Data Sets to Quantify the Fluorophores in Multifluorophoric Mixtures: Improving Quantification Accuracy of Fluorimetric Estimations of Dilute Aqueous Mixtures

Excitation-emission matrix fluorescence (EEMF) and total synchronous fluorescence spectroscopy (TSFS) are the 2 fluorescence techniques that are commonly used for the analysis of multifluorophoric mixtures. These 2 fluorescence techniques are conceptually different and provide certain advantages over each other. The manual analysis of such highly correlated large volume of EEMF and TSFS towards developing a calibration model is difficult. Partial least square (PLS) analysis can analyze the large volume of EEMF and TSFS data sets by finding important factors that maximize the correlation between the spectral and concentration information for each fluorophore. However, often the application of PLS analysis on entire data sets does not provide a robust calibration model and requires application of suitable pre-processing step. The present work evaluates the application of genetic algorithm (GA) analysis prior to PLS analysis on EEMF and TSFS data sets towards improving the precision and accuracy of the calibration model. The GA algorithm essentially combines the advantages provided by stochastic methods with those provided by deterministic approaches and can find the set of EEMF and TSFS variables that perfectly correlate well with the concentration of each of the fluorophores present in the multifluorophoric mixtures. The utility of the GA assisted PLS analysis is successfully validated using (i) EEMF data sets acquired for dilute aqueous mixture of four biomolecules and (ii) TSFS data sets acquired for dilute aqueous mixtures of four carcinogenic polycyclic aromatic hydrocarbons (PAHs) mixtures. In the present work, it is shown that by using the GA it is possible to significantly improve the accuracy and precision of the PLS calibration model developed for both EEMF and TSFS data set. Hence, GA must be considered as a useful pre-processing technique while developing an EEMF and TSFS calibration model.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

MS25: Materials Science-Focused Benchmark Data Set for Machine Learning Interatomic Potentials

Here, we present MS25, a benchmark data set for evaluating machine learning interatomic potentials (MLIPs) across diverse materials-relevant systems including MgO surfaces, liquid water, zeolites, a catalytic Pt surface reaction, high-entropy alloys (HEAs), and disordered Zr-oxides. Five MLIP architectures (MACE, NequIP, Allegro, MTP, and Torch-ANI) are trained and tested, focusing not only on traditional metrics (energies, forces, and stresses) but also explicitly validating derived physical observables such as lattice constants, volumes, and reaction barriers. We find that most models reach comparable accuracy on standard error metrics across the simple systems, although equivariant MLIPs offer 1.5–2× improvements over nonequivariant MLIPs in energy and force error for structurally complex or compositionally disordered environments such as HEAs and Zr–O systems. Our analysis highlights that low errors in energy and force predictions do not guarantee reliable observables, emphasizing the necessity of explicit validation. We demonstrate limitations in cross-framework transferability, as models trained on one zeolite framework (CHA) fail to reliably generalize to predictions of structurally distinct frameworks (e.g., MFI). Size-extensive tests show some dependence on system size for MgO, resulting from forced periodicity. The HEA and Zr–O data sets are identified as challenging tests for future benchmarks and MLIP model architecture developments as they show significant differentiation in error between MLIP architectures and are still relatively difficult at 1000 training images. Moving forward, we recommend that benchmarking efforts shift their focus from marginal accuracy improvements in energy and force errors toward identifying and understanding model failure modes, rigorously assessing transferability, and evaluating how their errors affect observable predictions. For researchers looking to choose an MLIP architecture, we suggest selecting equivariant MLIP architectures if the complexity of the system is a challenge. For simple materials problems, auxiliary features such as integration with molecular dynamics engines, trade-offs between computational data set generation cost vs MLIP inference speed, and framework integration may play a more important decision factor than small differences in error metrics that are unlikely to matter for production-level research.

chemical structure↗
DOE OSTI2015

Statistical tests on clustered global earthquake synthetic data sets

Abstract We study the ability of statistical tests to identify nonrandom features of earthquake catalogs, with a focus on the global earthquake record since 1900. We construct four types of synthetic data sets containing varying strengths of clustering, with each data set containing on average 10,000 events over 100 years with magnitudes above M = 6. We apply a suite of statistical tests to each synthetic realization in order to evaluate the ability of each test to identify the sequences of events as nonrandom. Our results show that detection ability is dependent on the quantity of data, the nature of the type of clustering, and the specific signal used in the statistical test. Data sets that exhibit a stronger variation in the seismicity rate are generally easier to identify as nonrandom for a given background rate. We also show that we can address this problem in a Bayesian framework, with the clustered data sets as prior distributions. Using this new Bayesian approach, we can place quantitative bounds on the range of possible clustering strengths that are consistent with the global earthquake data. At M = 7, we can estimate 99th percentile confidence bounds on the number of triggered events, with an upper bound of 20% of the catalog for global aftershock sequences, with a stronger upper bound on the fraction of triggered events of 10% for long‐term event clusters. At M = 8, the bounds are less strict due to the reduced number of events. However, our analysis shows that other types of clustering could be present in the data that we are unable to detect. Our results aid in the interpretation of the results of statistical tests on earthquake catalogs, both worldwide and regionally.

Daub, Eric G.↗
DOE OSTI2014

Band Limited Correlation Estimates for A(ξω/U) and B(ηω/U) Using Beresh et. al. 2013 Data Sets

Here we discuss an improved Corcos (Corcos (1963), (1963)) style cross spectral density utilizing zero pressure gradient, supersonic (Beresh et. al. (2013)) data sets. Using the connection between narrow band measurements with broadband cross-spectral density, i.e. Γ(ξ ,η ,ω )= Φ (ω) A(ωη/U )exp (-i ωξ/U) we focus on estimating coherence expressions of the form: A (ξω nb /U) and B (ηω nb / U) where ω nb denotes the narrow band frequency, i.e. the band center frequency value and ξ and η are sensors spacing in streamwise/longitudinal and cross-stream/lateral directions, respectively. A methodology to estimate the parameters which retains the Corcos exponential functional form, A(ξω/U)=exp(-k lat ηω/U) but identifies new parameters (constants) consistent with the Beresh et. al. data sets is discussed. The Corcos result requires that the data be properly explained by self-similar variable: ξω/U and ηω/U. The longitudinal (streamwise) variable ξω/U tends to provide a better data collapse, while, consistent with the literature the lateral ηω/U is only successful for higher band center frequencies. Assuming the similarity variables provide a useful description of the data, the longitudinal coherence decay constant result using the Beresh et. al. data sets yields a value for the longitudinal constant k long ≈0.36-0.28 that is approximately 3x larger than the “traditional” (low speed, large Reynolds number and zero pressure gradient) of k long ≈0.11. We suggest that the most likely reason that the Beresh et. al. data sets incur increased longitudinal decay which results in reduced coherence lengths is due to wall shear induced compression causing an adverse pressure gradient. Focusing on the higher band center frequency measurements where the frequency dependent similarity variables are applicable, the lateral or transverse coherence decay constant k lat ≈0.7 is consistent with the “traditional” (low speed, large Reynolds number and zero pressure gradient). It should be noted, that the longitudinal/streamwise coherence decay deviates from the value observed by other researchers while the lateral/ cross-stream value is consistent has been observed by other researchers. We believe that while the measurements used to obtain new decay constant estimates are from internal wind tunnel tests, they likely provide a useful estimate expected reentry flow behavior and are therefore recommended for use. These data could also be useful in determining the uncertainty of correlation length for a uncertainty quantification (UQ) analysis.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Simulating the Autonomous Future: A Look at Virtual Vehicle Environments and How to Validate Simulation Using Public Data Sets

The rapid evolution of autonomous vehicles (AVs) has exposed the need for fast-paced development and testing processes of a variety of perception, planning, and control algorithms. To expedite development, the AV industry and researchers leverage virtual vehicle environments to simulate a range of test scenarios that may otherwise be costly or difficult to conduct on a real test track. However, the various virtual environments may have different results depending on the fidelity of various simulation features, such as vehicle dynamics, sensor simulation, and environment recreation. Herein, this tutorial article examines a proposed framework for constructing, parameterizing, and validating a virtual vehicle environment using an existing AV data set. First, an overview of several open source and commercially available simulation tools, including their associated workflows, for scene and scenario creation is presented. Next, various open AV data sets are examined to inform the data set selection for the validation framework. Then, an example workflow of recreating a real-world scene from the selected data set in a simulation tool with various emulated sensors parameterized to match the data set is demonstrated. Finally, an example AV-perception algorithm is subjected to data streams from virtual and real-world environments and suggested metrics for analyzing the results are discussed.

42 ENGINEERING↗
DOE OSTI2021

An Extreme-Preserving Long-Term Gridded Daily Precipitation Data Set for the Conterminous United States

Extreme daily precipitation contributes to flooding that can cause significant economic damages, and so is important to properly capture in gridded meteorological data sets. This work examines precipitation extremes, the mean precipitation on wet days, and fraction of wet days in two widely used gridded data sets over the conterminous U.S. (CONUS). When compared to the underlying station observations, the gridded data show a 27% reduction in annual 1-day maximum precipitation, 25% increase in wet day fraction, 1.5 to 2.5 day increase in mean wet spell length, 30% low bias in 20-year return values of daily precipitation, and 25% decrease in mean precipitation on wet days. It is shown these changes arise primarily from the time-adjustment applied to put the precipitation gauge observations into a uniform time frame, with the gridding process playing a lesser role. A new daily precipitation data set is developed that omits the time-adjustment (as well as extending the gridded data by 7 years) and is shown to perform significantly better in reproducing extreme precipitation metrics. When the new data set is used to force a land surface model, annually averaged 1-day maximum runoff increases 38% compared to the original data, annual mean runoff increases 17%, evapotranspiration drops 2.3%, and fewer wet days leads to a 3.3% increase in estimated solar insolation. Consequently, these changes are large enough to affect portrayals of flood risk and water balance components important for ecological and climate-change applications across the CONUS.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2013

A new data set for estimating organic carbon storage to 3 m depth in soils of the northern circumpolar permafrost region

High-latitude terrestrial ecosystems are key components in the global carbon cycle. The Northern Circumpolar Soil Carbon Database (NCSCD) was developed to quantify stocks of soil organic carbon (SOC) in the northern circumpolar permafrost region (a total area of 18.7 × 10 6 km 2 ). The NCSCD is a geographical information system (GIS) data set that has been constructed using harmonized regional soil classification maps together with pedon data from the northern permafrost region. Previously, the NCSCD has been used to calculate SOC storage to the reference depths 0–30 cm and 0–100 cm (based on 1778 pedons). It has been shown that soils of the northern circumpolar permafrost region also contain significant quantities of SOC in the 100–300 cm depth range, but there has been no circumpolar compilation of pedon data to quantify this deeper SOC pool and there are no spatially distributed estimates of SOC storage below 100 cm depth in this region. Here we describe the synthesis of an updated pedon data set for SOC storage (kg C m -2 ) in deep soils of the northern circumpolar permafrost regions, with separate data sets for the 100–200 cm (524 pedons) and 200–300 cm (356 pedons) depth ranges. These pedons have been grouped into the North American and Eurasian sectors and the mean SOC storage for different soil taxa (subdivided into Gelisols including the sub-orders Histels, Turbels, Orthels, permafrost-free Histosols, and permafrost-free mineral soil orders) has been added to the updated NCSCDv2. The updated version of the data set is freely available online in different file formats and spatial resolutions that enable spatially explicit applications in GIS mapping and terrestrial ecosystem models. While this newly compiled data set adds to our knowledge of SOC in the 100–300 cm depth range, it also reveals that large uncertainties remain. In conclusion, identified data gaps include spatial coverage of deep (> 100 cm) pedons in many regions as well as the spatial extent of areas with thin soils overlying bedrock and the quantity and distribution of massive ground ice.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2019

Curated Test Fault Data Set

The curated fault experiment data set consists of tagged and fully described time series representing measured faults from the AFDD test building (ORNLs Flexible Research Platform [FRP]), including baseline performance and faulty performance. A total of 10 different faults are tested for 49 different faulted and unfaulted scenarios with various fault intensity levels. Additional Contacts: Principal investigator: Matt Leach Matt.Leach@nrel.gov Experiments coordinator: Piljae Im imp1@ornl.gov Document preparation: Janghyun Kim Janghyun.Kim@nrel.gov

AFDD↗
DOE OSTI2011

ARM Cloud Retrieval Ensemble Data Set (ACRED)

This document describes a new Atmospheric Radiation Measurement (ARM) data set, the ARM Cloud Retrieval Ensemble Data Set (ACRED), which is created by assembling nine existing ground-based cloud retrievals of ARM measurements from different cloud retrieval algorithms. The current version of ACRED includes an hourly average of nine ground-based retrievals with vertical resolution of 45 m for 512 layers. The techniques used for the nine cloud retrievals are briefly described in this document. This document also outlines the ACRED data availability, variables, and the nine retrieval products. Technical details about the generation of ACRED, such as the methods used for time average and vertical re-grid, are also provided.

54 ENVIRONMENTAL SCIENCES↗