Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Dataset”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45
All sourcesNASA NTRSDOE OSTI
DOE OSTI2015

Non-local gravity and comparison with observational datasets

We study the cosmological predictions of two recently proposed non-local modifications of General Relativity. Both models have the same number of parameters as ΛCDM, with a mass parameter m replacing the cosmological constant. We implement the cosmological perturbations of the non-local models into a modification of the CLASS Boltzmann code, and we make a full comparison to CMB, BAO and supernova data. We find that the non-local models fit these datasets very well, at the same level as ΛCDM. Among the vast literature on modified gravity models, this is, to our knowledge, the only example which fits data as well as ΛCDM without requiring any additional parameter. For both non-local models parameter estimation using Planck +JLA+BAO data gives a value of H{sub 0} slightly higher than in ΛCDM.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2018

Using research networks to create the comprehensive datasets needed to assess nutrient availability as a key determinant of terrestrial carbon cycling

A wide range of research shows that nutrient availability strongly influences terrestrial carbon (C) cycling and shapes ecosystem responses to environmental changes and hence terrestrial feedbacks to climate. Nonetheless, our understanding of nutrient controls remains far from complete and poorly quantified, at least partly due to a lack of informative, comparable, and accessible datasets at regional-to-global scales. A growing research infrastructure of multi-site networks are providing valuable data on C fluxes and stocks and are monitoring their responses to global environmental change and measuring responses to experimental treatments. These networks thus provide an opportunity for improving our understanding of C-nutrient cycle interactions and our ability to model them. However, coherent information on how nutrient cycling interacts with observed C cycle patterns is still generally lacking. Here, we argue that complementing available C-cycle measurements from monitoring and experimental sites with data characterizing nutrient availability will greatly enhance their power and will improve our capacity to forecast future trajectories of terrestrial C cycling and climate. Therefore, we propose a set of complementary measurements that are relatively easy to conduct routinely at any site or experiment and that, in combination with C cycle observations, can provide a robust characterization of the effects of nutrient availability across sites. In addition, we discuss the power of different observable variables for informing the formulation of models and constraining their predictions. Most widely available measurements of nutrient availability often do not align well with current modelling needs. This highlights the importance to foster the interaction between the empirical and modelling communities for setting future research priorities.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2014

Conformations of macromolecules and their complexes from heterogeneous datasets

We explain a new generation of algorithms capable of mapping the structure and conformations of macromolecules and their complexes from large ensembles of heterogeneous snapshots, and demonstrate the feasibility of determining both discrete and continuous macromolecular conformational spectra. These algorithms naturally incorporate conformational heterogeneity without resort to sorting and classification, or prior knowledge of the type of heterogeneity present. They are applicable to single-particle diffraction and image datasets produced by X-ray lasers and cryo-electron microscopy, respectively, and particularly suitable for systems not easily amenable to purification or crystallization.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Search for Majorana Neutrinos with the Complete KamLAND-Zen Dataset

We present a search for neutrinoless double-beta (0⁢𝜈⁢𝛽⁢𝛽) decay of 136 Xe using the full KamLAND-Zen 800 dataset with 745 kg of enriched xenon, corresponding to an exposure of 2.1 ton yr of 136 Xe. This updated search benefits from a more than twofold increase in exposure, recovery of photo-sensor gain, and reduced background from muon-induced spallation of xenon. Combining with the search in the previous KamLAND-Zen phase, we obtain a lower limit for the 0⁢𝜈⁢𝛽⁢𝛽 decay halflife of 𝑇$^{0⁢𝜈}_{1/2}$ >3.8 ×10 26 yr at 90% CL, a factor of 1.7 improvement over the previous limit. The corresponding upper limits on the effective Majorana neutrino mass are in the range 28–122 meV using phenomenological nuclear matrix element calculations.

Abe, S. [Tohoku University] (ORCID:000000022110513↗
DOE OSTI2025

Dark energy survey: Modeling strategy for multiprobe cluster cosmology and validation for the full six-year dataset

Here, we introduce an updated To&Krause2021 model for joint analyses of cluster abundances and large-scale two-point correlations of weak lensing and galaxy and cluster clustering (termed CL+3×2 pt analysis) and validate that this model meets the systematic accuracy requirements of analyses with the statistical precision of the final Dark Energy Survey (DES) Year 6 (Y6) dataset. The validation program consists of two distinct approaches, (i) identification of modeling and parametrization choices and impact studies using simulated analyses with each possible model misspecification and (ii) end-to-end validation using mock catalogs from customized Cardinal simulations that incorporate realistic galaxy populations and DES-Y6-specific galaxy and cluster selection and photometric redshift modeling, which are the key observational systematics. In combination, these validation tests indicate that the model presented here meets the accuracy requirements of DES-Y6 for CL+3×2 pt based on a large list of tests for known systematics. In addition, we also validate that the model is sufficient for several other data combinations: the CL+GC subset of this data vector (excluding galaxy–galaxy lensing and cosmic shear two-point statistics) and the CL+3×2 pt+BAO+SN (combination of CL+3×2 pt with the previously published Y6 DES baryonic acoustic oscillation and Y5 supernovae data).

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Expanding on the BRIAR Dataset: A Comprehensive Whole Body Biometric Recognition Resource at Extreme Distances and Real-World Scenarios (Collections 1-4)

The state-of-the-art in biometric recognition algorithms and operational systems has advanced quickly in recent years providing high accuracy and robustness in more challenging collection environments and consumer applications. However, the technology still suffers greatly when applied to non-conventional settings such as those seen when performing identification at extreme distances or from elevated cameras on buildings or mounted to UAVs. This paper summarizes an extension to the largest dataset currently focused on addressing these operational challenges, and describes its composition as well as methodologies of collection, curation, and annotation.

Cornett, David [ORNL] (ORCID:0000000222910860)↗
DOE OSTI2023

Predicting Power Outage During Extreme Weather with EAGLE-I and NWS Datasets

Extreme weather events, such as hurricanes, severe thunderstorms, and floods can significantly disrupt power grid systems, leading to electrical outages that result in inconvenience, economic losses, and life-threatening situations. There is a growing need for a robust and precise predictive model to forecast power outages, which will help prioritize emergency response before, during, and after extreme weather events. In this paper, we introduce machine-learning models that predict power outage risk at the state level during and after extreme weather events. We jointly utilized two publicly available datasets: the U.S. historical power outage data collected by the Environment for Analysis of Geo-Located Energy Information (EAGLE-I™) system, and the National Weather Service historical weather alert data sets. We highlight our initial result and discuss future work aimed at enhancing the model's robustness and accuracy for real-world applications.

Lee, Sangkeun (Matt)↗
DOE OSTI2017

Quantification of Arctic Soil and Permafrost Properties Using Ground-Penetrating Radar and Electrical Resistivity Tomography Datasets

Improving understanding of Arctic ecosystem climate feedback and parameterization of models that simulate freeze-Thaw dynamics require advances in quantifying soil and snow properties. Due to the significant spatiotemporal variability of soil properties and the limited information provided by point-scale measurements (e.g., cores), geophysical methods hold potential for improving soil and permafrost characterization. In this study, we evaluate the use of a ground-penetrating radar (GPR) to estimate thaw layer thickness, snow depth, and ice-wedge characteristics in an ice-wedge-dominated tundra region near Barrow, AK, USA. To this end, we analyze GPR and point-scale measurements collected along several parallel transects at the end of the growing season and the end of frozen season. In addition, we compare the structural information extracted from the GPR data with electrical resistivity tomography (ERT) information about ice-wedge characteristics. Our study generally highlights the value of GPR data collected in the frozen season, when conditions lead to the improved GPR signal-To-noise ratio, facilitate data acquisition, and reduce acquisition-related ecosystem disturbance relative to growing season. We document for the first time that GPR data collected during the frozen season can provide reliable estimates of active layer thickness and geometry of ice wedges. We find that the ice-wedge geometry extracted from GPR data collected during the frozen season is consistent with ERT data, and that GPR data can be used to constrain the ERT inversion. Consistent with recent studies, we also find that GPR data collected during the frozen season can provide good estimates of snow thickness, and that GPR data collected during the growing season can provide reliable estimate thaw depth. As a result, our quantification of the value of the GPR and ERT data collected during growing and frozen seasons paves the way for coupled inversion of the datasets to improve understanding of permafrost variability.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2019

Decoding crystallography from high-resolution electron imaging and diffraction datasets with deep learning

While machine learning has been making enormous strides in many technical areas, it is still massively underused in transmission electron microscopy. To address this, a convolutional neural network model was developed for reliable classification of crystal structures from small numbers of electron images and diffraction patterns with no preferred orientation. Diffraction data containing 571,340 individual crystals divided among seven families, 32 genera, and 230 space groups were used to train the network. Despite the highly imbalanced dataset, the network narrows down the space groups to the top two with over 70% confidence in the worst case and up to 95% in the common cases. As examples, we benchmarked against alloys to two-dimensional materials to cross-validate our deep-learning model against high-resolution transmission electron images and diffraction patterns. We present this result both as a research tool and deep-learning application for diffraction analysis.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Simultaneous cross-evaluation of heterogeneous E. coli datasets via mechanistic simulation

The extensive heterogeneity of biological data poses challenges to analysis and interpretation. Construction of a large-scale mechanistic model of Escherichia coli enabled us to integrate and cross-evaluate a massive, heterogeneous dataset based on measurements reported by various groups over decades. We identified inconsistencies with functional consequences across the data, including that the total output of the ribosomes and RNA polymerases described by data are not sufficient for a cell to reproduce measured doubling times, that measured metabolic parameters are neither fully compatible with each other nor with overall growth, and that essential proteins are absent during the cell cycle—and the cell is robust to this absence. Finally, considering these data as a whole leads to successful predictions of new experimental outcomes, in this case protein half-lives.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

ATLAS flavour-tagging algorithms for the LHC Run 2 $pp$ collision dataset

The flavour-tagging algorithms developed by the ATLAS Collaboration and used to analyse its dataset of $\sqrt{s}$ = 13 TeV $pp$ collisions from Run 2 of the Large Hadron Collider are presented. These new tagging algorithms are based on recurrent and deep neural networks, and their performance is evaluated in simulated collision events. These developments yield considerable improvements over previous jet-flavour identification strategies. At the 77% $b$-jet identification efficiency operating point, light-jet (charm-jet) rejection factors of 170 (5) are achieved in a sample of simulated Standard Model $t\bar{t}$ events; similarly, at a $c$-jet identification efficiency of 30%, a light-jet ($b$-jet) rejection factor of 70 (9) is obtained.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Ultrafast Error-bounded Lossy Compression for Scientific Datasets

Today's scientific high-performance computing applications and advanced instruments are producing vast volumes of data across a wide range of domains, which impose a serious burden on data transfer and storage. Error-bounded lossy compression has been developed and widely used in the scientific community because it not only can significantly reduce the data volumes but also can strictly control the data distortion based on the user-specified error bound. Existing lossy compressors, however, cannot offer ultrafast compression speed, which is highly demanded by numerous applications or use cases (such as in-memory compression and online instrument data compression). In this paper, we propose a novel ultrafast error-bounded lossy compressor that can obtain fairly high compression performance on both CPUs and GPUs and with reasonably high compression ratios. The key contributions are threefold. (1) We propose a generic error-bounded lossy compression framework---called SZx---that achieves ultrafast performance through its novel design comprising only lightweight operations such as bitwise and addition/subtraction operations, while still keeping a high compression ratio. (2) We implement SZx on both CPUs and GPUs and optimize the performance according to their architectures. (3) We perform a comprehensive evaluation with six real-world production-level scientific datasets on both CPUs and GPUs. Experiments show that SZx is 2~16x faster than the second-fastest existing error-bounded lossy compressor (either SZ or ZFP) on CPUs and GPUs, with respect to both compression and decompression.

Yu, Xiaodong↗
DOE OSTI2023

DDStore: Distributed Data Store for Scalable Training of Graph Neural Networks on Large Atomistic Modeling Datasets

Graph neural networks (GNNs) are a class of Deep Learning models used in designing atomistic materials for effective screening of large chemical spaces. To ensure robust prediction, GNN models must be trained on large volumes of atomistic data on leadership class supercomputers. Even with the advent of modern architectures that consist of multiple storage layers that include node-local NVMe devices in addition to device memory for caching large datasets, extreme-scale model training faces I/O challenges at scale.We present DDStore, an in-memory distributed data store designed for GNN training on large-scale graph data. DDStore provides a hierarchical, distributed, data caching technique that combines data chunking, replication, low-latency random access, and high throughput communication. DDStore achieves near-linear scaling for training a GNN model using up to 1000 GPUs on the Summit and Perlmutter supercomputers, and reaches up to a 6.15x reduction in GNN training time compared to state-of-the-art methodologies.

Choi, Jong Youl↗
DOE OSTI2024

Remark on Algorithm 1012: Computing Projections with Large Datasets

In ACM TOMS Algorithm 1012, the DELAUNAYSPARSE software is given for performing Delaunay interpolation in medium to high dimensions. When extrapolating outside the convex hull of the training set, DELAUNAYSPARSE calls the nonnegative least squares solver DWNNLS to compute projections onto the convex hull. However, DWNNLS and many other available sum-of-squares optimization solvers were not intended for usage with many variable problems, which result from the large training sets that are typical in machine learning applications. Thus, a new PROJECT subroutine is given, based on the highly customizable quadratic program solver BQPD. This solution is shown to be as robust as DELAUNAYSPARSE for projection onto both synthetic and real-world datasets, where other available solvers frequently fail. Although it is intended as an update for DELAUNAYSPARSE, due to the difficulty and prevalence of the problem, this solution is likely to be of external interest as well.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Intelligent Sampling of Extreme-Scale Turbulence Datasets for Accurate and Efficient Spatiotemporal Model Training

With the end of Moore’s law and Dennard scaling, efficient training increasingly requires rethinking data volume. Can we train better models with significantly less data via intelligent subsampling? To explore this, we develop SICKLE, a sparse intelligent curation framework for efficient learning, featuring a novel maximum entropy (MaxEnt) sampling approach, scalable training, and energy benchmarking. We compare MaxEnt with random and phase-space sampling on large direct numerical simulation (DNS) datasets of turbulence. Evaluating SICKLE at scale on Frontier, we show that subsampling as a preprocessing step can, in many cases, improve model accuracy and substantially lower energy consumption, with observed reductions of up to 38×.

Brewer, Wes [ORNL] (ORCID:0000000236393956)↗
DOE OSTI2026

Dataset for the paper titled "Investigating the relationship between bolide entry angle and apparent direction of infrasound signal arrivals"

This dataset includes outputs generated for the journal publication titled: "Investigating the relationship between bolide entry angle and apparent direction of infrasound signal arrivals". The outputs include .csv files with model-generated synthetic trajectories of asteroids entering Earth at a variety of impact and approach (azimuthal) angles. All outputs are based on hypothetical but realistic scenarios.

Herrera, Natalie [Sandia National Laboratories (SN↗