Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “datasets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Predicting Power Outage During Extreme Weather with EAGLE-I and NWS Datasets

Extreme weather events, such as hurricanes, severe thunderstorms, and floods can significantly disrupt power grid systems, leading to electrical outages that result in inconvenience, economic losses, and life-threatening situations. There is a growing need for a robust and precise predictive model to forecast power outages, which will help prioritize emergency response before, during, and after extreme weather events. In this paper, we introduce machine-learning models that predict power outage risk at the state level during and after extreme weather events. We jointly utilized two publicly available datasets: the U.S. historical power outage data collected by the Environment for Analysis of Geo-Located Energy Information (EAGLE-I™) system, and the National Weather Service historical weather alert data sets. We highlight our initial result and discuss future work aimed at enhancing the model's robustness and accuracy for real-world applications.

Lee, Sangkeun (Matt)↗
DOE OSTI2020

Simultaneous cross-evaluation of heterogeneous E. coli datasets via mechanistic simulation

The extensive heterogeneity of biological data poses challenges to analysis and interpretation. Construction of a large-scale mechanistic model of Escherichia coli enabled us to integrate and cross-evaluate a massive, heterogeneous dataset based on measurements reported by various groups over decades. We identified inconsistencies with functional consequences across the data, including that the total output of the ribosomes and RNA polymerases described by data are not sufficient for a cell to reproduce measured doubling times, that measured metabolic parameters are neither fully compatible with each other nor with overall growth, and that essential proteins are absent during the cell cycle—and the cell is robust to this absence. Finally, considering these data as a whole leads to successful predictions of new experimental outcomes, in this case protein half-lives.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

ATLAS flavour-tagging algorithms for the LHC Run 2 $pp$ collision dataset

The flavour-tagging algorithms developed by the ATLAS Collaboration and used to analyse its dataset of $\sqrt{s}$ = 13 TeV $pp$ collisions from Run 2 of the Large Hadron Collider are presented. These new tagging algorithms are based on recurrent and deep neural networks, and their performance is evaluated in simulated collision events. These developments yield considerable improvements over previous jet-flavour identification strategies. At the 77% $b$-jet identification efficiency operating point, light-jet (charm-jet) rejection factors of 170 (5) are achieved in a sample of simulated Standard Model $t\bar{t}$ events; similarly, at a $c$-jet identification efficiency of 30%, a light-jet ($b$-jet) rejection factor of 70 (9) is obtained.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Ultrafast Error-bounded Lossy Compression for Scientific Datasets

Today's scientific high-performance computing applications and advanced instruments are producing vast volumes of data across a wide range of domains, which impose a serious burden on data transfer and storage. Error-bounded lossy compression has been developed and widely used in the scientific community because it not only can significantly reduce the data volumes but also can strictly control the data distortion based on the user-specified error bound. Existing lossy compressors, however, cannot offer ultrafast compression speed, which is highly demanded by numerous applications or use cases (such as in-memory compression and online instrument data compression). In this paper, we propose a novel ultrafast error-bounded lossy compressor that can obtain fairly high compression performance on both CPUs and GPUs and with reasonably high compression ratios. The key contributions are threefold. (1) We propose a generic error-bounded lossy compression framework---called SZx---that achieves ultrafast performance through its novel design comprising only lightweight operations such as bitwise and addition/subtraction operations, while still keeping a high compression ratio. (2) We implement SZx on both CPUs and GPUs and optimize the performance according to their architectures. (3) We perform a comprehensive evaluation with six real-world production-level scientific datasets on both CPUs and GPUs. Experiments show that SZx is 2~16x faster than the second-fastest existing error-bounded lossy compressor (either SZ or ZFP) on CPUs and GPUs, with respect to both compression and decompression.

Yu, Xiaodong↗
DOE OSTI2023

DDStore: Distributed Data Store for Scalable Training of Graph Neural Networks on Large Atomistic Modeling Datasets

Graph neural networks (GNNs) are a class of Deep Learning models used in designing atomistic materials for effective screening of large chemical spaces. To ensure robust prediction, GNN models must be trained on large volumes of atomistic data on leadership class supercomputers. Even with the advent of modern architectures that consist of multiple storage layers that include node-local NVMe devices in addition to device memory for caching large datasets, extreme-scale model training faces I/O challenges at scale.We present DDStore, an in-memory distributed data store designed for GNN training on large-scale graph data. DDStore provides a hierarchical, distributed, data caching technique that combines data chunking, replication, low-latency random access, and high throughput communication. DDStore achieves near-linear scaling for training a GNN model using up to 1000 GPUs on the Summit and Perlmutter supercomputers, and reaches up to a 6.15x reduction in GNN training time compared to state-of-the-art methodologies.

Choi, Jong Youl↗
DOE OSTI2024

Remark on Algorithm 1012: Computing Projections with Large Datasets

In ACM TOMS Algorithm 1012, the DELAUNAYSPARSE software is given for performing Delaunay interpolation in medium to high dimensions. When extrapolating outside the convex hull of the training set, DELAUNAYSPARSE calls the nonnegative least squares solver DWNNLS to compute projections onto the convex hull. However, DWNNLS and many other available sum-of-squares optimization solvers were not intended for usage with many variable problems, which result from the large training sets that are typical in machine learning applications. Thus, a new PROJECT subroutine is given, based on the highly customizable quadratic program solver BQPD. This solution is shown to be as robust as DELAUNAYSPARSE for projection onto both synthetic and real-world datasets, where other available solvers frequently fail. Although it is intended as an update for DELAUNAYSPARSE, due to the difficulty and prevalence of the problem, this solution is likely to be of external interest as well.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Intelligent Sampling of Extreme-Scale Turbulence Datasets for Accurate and Efficient Spatiotemporal Model Training

With the end of Moore’s law and Dennard scaling, efficient training increasingly requires rethinking data volume. Can we train better models with significantly less data via intelligent subsampling? To explore this, we develop SICKLE, a sparse intelligent curation framework for efficient learning, featuring a novel maximum entropy (MaxEnt) sampling approach, scalable training, and energy benchmarking. We compare MaxEnt with random and phase-space sampling on large direct numerical simulation (DNS) datasets of turbulence. Evaluating SICKLE at scale on Frontier, we show that subsampling as a preprocessing step can, in many cases, improve model accuracy and substantially lower energy consumption, with observed reductions of up to 38×.

Brewer, Wes [ORNL] (ORCID:0000000236393956)↗
DOE OSTI2026

Dataset for the paper titled "Investigating the relationship between bolide entry angle and apparent direction of infrasound signal arrivals"

This dataset includes outputs generated for the journal publication titled: "Investigating the relationship between bolide entry angle and apparent direction of infrasound signal arrivals". The outputs include .csv files with model-generated synthetic trajectories of asteroids entering Earth at a variety of impact and approach (azimuthal) angles. All outputs are based on hypothetical but realistic scenarios.

Herrera, Natalie [Sandia National Laboratories (SN↗
DOE OSTI2024

Idaho National Laboratory Quality Of Service Dataset

The code is designed to run tests to generate and collect data from a Wi-Fi network using OPENWRT or a simulated a 5G network using Open5gs and UERANSIM. The tests simulate the network performing downloads or uploads of various files with a varying number of concurrent users. The tests use tcpdump to collect the network traffic but only stores the summarized data. The summarized datasets will be included.

Krome, Cameron [Idaho National Laboratory (INL), I↗
DOE OSTI2025

Contribution to Open Molecules Dataset (coordcomplexsampling)

The Open Molecules Dataset is a project led by external collaborators, focused on the production of a wide diversity of molecular chemistries. This project will include high-throughput electronic structure calculations on metal coordination complexes, biomolecules, and electrolytes. Solvation effects, conformers, chemical reactivity, and spin/charge sampling will be pursued for elements on the periodic table up to, but not including the actinides. We aim to contribute code related to sampling for transition metal complexes, in particular, and expand software capabilities related to other thrusts desired.

Taylor, Michael G. [Los Alamos National Laboratory↗
DOE OSTI2025

SUNSet: The Software Understanding for National Security Dataset Repo

SAND2025-00511O SUNSet: The Software Understanding for National Security Dataset Repo serves as a repository for software understanding researchers to conduct systematic research in the field. It provides a platform for storing questions, answers, and scripts related to software programs, supporting research in software understanding. The repository is a nascent effort aimed at exploring the support needed by researchers and documenting how software understanding questions can be addressed using existing tools. The software consists of a simple database and front end interface for easy access and management of the stored information. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Amon, Tod [Sandia National Lab. (SNL-CA), Livermor↗
DOE OSTI2022

DRB-ML-Dataset

This datastet contains kernels extracted from OpenMP microbenchmarks collected in DataRaceBench. The purpose of this dataset is to serve as training data for machine learning with programming language processing (PLP).

Lin, Pei-Hung↗
DOE OSTI2021

Sea Surface Salinity Reemergence in an Updated North Atlantic In Situ Salinity Dataset

Monthly sea surface salinity (SSS) fields are constructed from observations, using objective mapping on a 1° x 1° grid in the Atlantic between 30°S and 50°N in the 1970-2016 period in an update of the dataset of Reverdin et al. Data coverage is heterogeneous, with increased density in 2002 when Argo floats become available, high density along Voluntary Observing Ship lines, and low density south of 10°S. Using lag correlation, the seasonal reemergence of SSS anomalies is investigated between 20° and 50°N in 5° x 5° boxes during the 1993-2016 period, both locally and remotely following the displacements of the deep mixed-layer waters estimated from virtual float trajectories derived from the daily AVISO surface geostrophic currents. Although SSS data are noisy, local SSS reemergence is detected in about half of the boxes, notably in the northeast and southeast, while little reemergence is seen in the central and part of the eastern subtropical gyre. In the same period, sea surface temperature (SST) reemergence is found only slightly more frequently, reflecting the short data duration. However, taking geostrophic advection into account degrades the detection of remote SSS and even SST reemergence. When anomalies are averaged over broader areas, robust evidence of a second and third SSS reemergence peak is found in the northeastern and southeastern parts of the domain, indicating long cold-season persistence of large-scale SSS anomalies, while only a first SST reemergence is seen. Finally, an oceanic reanalysis is used to confirm that the correlation analysis indeed reflects the reemergence of subsurface salinity anomalies.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Predicting discomfort from glare with pedestrian-scale lighting: A comparison of candidate models using four independent datasets

After dark, pedestrians may experience discomfort from glare caused by outdoor lighting. While several models for measuring discomfort have been proposed, there is no consensus as to which model should be used. The performances of different models were investigated using datasets from four independent studies, comparing the degree of association between model predictions and subjective ratings, and the ability of a model to distinguish between discomfort and non-discomfort situations. The models tested are those proposed by Petherbridge and Hopkinson in 1950, Schmidt-Clausen and Bindels in 1974, Bullough et al. in 2008 and Lin et al. in 2014 and 2015. They also include two quantities: direct illuminance at the eye from the glare source and average source luminance. Of the models tested, the best performance was found using either the model proposed by Bullough et al. in 2008 or by direct illuminance at the eye.

Abboushi, B.↗
DOE OSTI2021

SARS-CoV2 Protein-Ligand Simulation Dataset: Layer 2 (Lowest Temperature Extracted Protein Coordinate Trajectories)

Protein-only trajectories of the lowest-temperature window (310K) extracted from temperature replica-exchange molecular dynamics simulations of 23 different SARS CoV-2 systems, including S Protein ACE2-receptor binding-domain, MPro, PLPro, NSP3 ADRP (X-domain/macrodomain/phosphatase), NSP15 (endoribonuclease), NSP9, NSP10, NSP16, and N-protein N-terminus. Systems were prepared with charmm-gui and simulated using the GROMACS simulation software suite. Trajectories are provided in compressed dcd format with accompanying coordinate/topology files in pdb and psf formats. This data supplements the data release, DOI: 10.13139/OLCF/1650650 ('SARS-CoV2 Protein-Ligand Simulation Dataset: Layer 1 (Simulation Initial Conditions and Parameters)')

59 BASIC BIOLOGICAL SCIENCES↗