Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Distribution”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

NuDustC++

NuDustc++ is a nucleating and sputtering dust code. It takes in the temperature-density profiles, abundance data, and chemistry network. It creates a binned size distribution from user input data to track certain grain sizes. NuDustc++ loads the data and calculates where and when a shock is detected in the input data. Using a runge-Kutta DoPri 5 integrator, it calculates nucleation and growth of grains by solving a system of coupled non-linear ODEs. It calculates sputtering based on the presence or lack of a shock by either integrating over energy or summing up the sputtering yield contributions per gas species. It is used to determine and track dust grain nucleation, growth, and erosion (sputtering) in gaseous systems to determine characteristics of the produced grain distribution.

Stangl, Sarah↗
DOE OSTI2022

Scalable training of graph convolutional neural networks for fast and accurate predictions of HOMO-LUMO gap in molecules

Abstract Graph Convolutional Neural Network (GCNN) is a popular class of deep learning (DL) models in material science to predict material properties from the graph representation of molecular structures. Training an accurate and comprehensive GCNN surrogate for molecular design requires large-scale graph datasets and is usually a time-consuming process. Recent advances in GPUs and distributed computing open a path to reduce the computational cost for GCNN training effectively. However, efficient utilization of high performance computing (HPC) resources for training requires simultaneously optimizing large-scale data management and scalable stochastic batched optimization techniques. In this work, we focus on building GCNN models on HPC systems to predict material properties of millions of molecules. We use HydraGNN, our in-house library for large-scale GCNN training, leveraging distributed data parallelism in PyTorch. We use ADIOS, a high-performance data management framework for efficient storage and reading of large molecular graph data. We perform parallel training on two open-source large-scale graph datasets to build a GCNN predictor for an important quantum property known as the HOMO-LUMO gap. We measure the scalability, accuracy, and convergence of our approach on two DOE supercomputers: the Summit supercomputer at the Oak Ridge Leadership Computing Facility (OLCF) and the Perlmutter system at the National Energy Research Scientific Computing Center (NERSC). We present our experimental results with HydraGNN showing (i) reduction of data loading time up to 4.2 times compared with a conventional method and (ii) linear scaling performance for training up to 1024 GPUs on both Summit and Perlmutter.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

End-of-Winter Snow Depth, Temperature, Density and SWE Measurements at Teller Road Site, Seward Peninsula, Alaska, 2016-2018

Measurements of end-of-winter snow properties were collected at the NGEE Arctic Teller Road Site at mile marker 27 (TL_MM27) for three consecutive years - 2016, 2017, and 2018. This dataset contains one *.pdf user guide and four *.csv data files spatially distributed values of snow depth, snow water equivalent (SWE), temperature at the snow surface and at the bottom of the snowpack, and snow density as a function of depth from top of snowpack. Data was collected toward the end of the winter season, typically in late March or early April, when the snowpack would be near its maximum. In 2016, snow depth measurements were taken using either a thaw probe or avalanche probe. In 2017 and 2018 a Snow-Hydro MagnaProbe http://www.snowhydro.com/products/column2.html was used to improve collection efficiency and enhance spatial coverage. The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), a research effort to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

The Draco Dwarf Spheroidal Galaxy in the First Year of Dark Energy Spectroscopic Instrument Data

We investigate the spatial distribution, kinematics, and metallicity of stars in the Draco dwarf spheroidal galaxy using data from the Dark Energy Spectroscopic Instrument (DESI). We identify 155 high-probability members of Draco using line-of-sight velocity and metallicity information derived from DESI spectroscopy along with Gaia Data Release 3 proper motions. We find a mean line-of-sight velocity of −290.62 ± 0.80 km s −1 with dispersion = $9.57$$^{+0.66}_{–0.62}$ km s −1 and mean metallicity [Fe/H] = −2.10 ± 0.04, consistent with previous results. We also find that Draco has a steep metallicity gradient within the half-light radius, and a metallicity gradient that flattens beyond the half-light radius. We identify eight high-probability members outside the King tidal radius, four of which we identify for the first time. These extratidal stars are not preferentially aligned along the orbit of Draco. We compute an average surface brightness of 34.02 mag arsec –2 within an elliptical annulus from the King tidal radius of 48'.1–81′.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

SynBio QC-Library QC (LibQC) v2.0.0

This software is a pipeline used to identify the distribution of user-specified sequences in oligo pools that have been sequenced on the MiSeq platform for quality control purposes. The software counts instances of user-specified sequences (inserts or spacers) identified in sequencing data, returning the distribution of sequences in each pool and the length distribution of all the sequences. Among other types similar types of projects, this can be used to assess the quality of a guideRNA library once it has been inserted into the vector of choice to ensure that there is an even distribution of all the individual protospacers in the pool. This pipeline uses many freely available open source libraries, the value added is that in our application the steps of the pipeline are defined in Workflow Description Language (WDL) and run through the Cromwell workflow engine in Docker containers, for easy distribution and set up.

Simirenko, Lisa↗
DOE OSTI2025

Graph-Learning-Assisted State and Event Tracking for Solar-Penetrated Power Grids with Heterogeneous Data Sources

Unlike transmission systems, distribution systems do not typically contain sufficient metering to enable real-time state estimation. The lack of sufficient real-time measurements prohibits accurate and timely monitoring of the state of distribution systems. As a result, control and optimal operation of distribution systems, especially those containing large numbers of renewable generation units are not possible without proper data and information about the current state of the system. The main motivation of this project is to address this shortcoming by developing an approach which provides “predicted” real-time measurements so that they can be used to execute a distribution system state estimator. Thus, the objective of the project is to make the distribution systems fully observable, such that the hosting capacity for solar generation can be accurately estimated, and unnecessary solar curtailments can be avoided. In order to accomplish this goal, the project investigated the use of a grid-model-informed machine learning (ML) tool which integrates heterogeneous data streams obtained from AMI meters, SCADA as well as PMU measurements and created synchronous measurement snapshots for the state estimator (SE); and developed a hybrid robust SE which provides not only accurate state estimates but also real-time feedback for the ML model refinement.

14 SOLAR ENERGY↗
DOE OSTI2023

Data Analytics for Residential PV from Permit to Interconnect (Final Technical Report)

The main objective of this research is to provide novel insights into the effects of permitting, inspection, and interconnection (PII) processes on PV system installations—and in particular, into the relationship between PII processes and adoption timelines. This research can then be used to clarify the potential effect of various process changes on reducing PII timelines, customer cancellation rates, and related costs nationwide. NREL completed this research by assembling a data set of distributed, largely residential rooftop solar systems less than 50 kilowatts in size from participating solar installers. NREL produced five publications describing the effects that PII processes can have on adoption timelines nationwide, in addition to publishing an interactive data viewer with five years of PII cycle time data. This tool can be used by stakeholders to identify potential adoption timelines by local government.

14 SOLAR ENERGY↗
DOE OSTI2023

Efforts to enhance reproducibility in a human performance research project

Background: Ensuring the validity of results from funded programs is a critical concern for agencies that sponsor biological research. In recent years, the open science movement has sought to promote reproducibility by encouraging sharing not only of finished manuscripts but also of data and code supporting their findings. While these innovations have lent support to third-party efforts to replicate calculations underlying key results in the scientific literature, fields of inquiry where privacy considerations or other sensitivities preclude the broad distribution of raw data or analysis may require a more targeted approach to promote the quality of research output. Methods: We describe efforts oriented toward this goal that were implemented in one human performance research program, Measuring Biological Aptitude, organized by the Defense Advanced Research Project Agency's Biological Technologies Office. Our team implemented a four-pronged independent verification and validation (IV&V) strategy including 1) a centralized data storage and exchange platform, 2) quality assurance and quality control (QA/QC) of data collection, 3) test and evaluation of performer models, and 4) an archival software and data repository. Results: Our IV&V plan was carried out with assistance from both the funding agency and participating teams of researchers. QA/QC of data acquisition aided in process improvement and the flagging of experimental errors. Holdout validation set tests provided an independent gauge of model performance. Conclusions: In circumstances that do not support a fully open approach to scientific criticism, standing up independent teams to cross-check and validate the results generated by primary investigators can be an important tool to promote reproducibility of results.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

A hybrid architecture for volt-var control in active distribution grids

Modern active distribution grids are characterized by the increasing penetration of distributed energy resources (DERs). The proper coordination and scheduling of a large numbers of these small-scale and spatially distributed DERs is necessary, and warrants the use of novel distributed approaches. In this paper, we propose a hybrid volt-var control architecture for the distribution grid, which leverages existing centralized and local approaches to planning, decision making, and control, and augments it with distributed optimization and distributed control for DER management. First, we propose a convex model to describe the power physics of distribution grids of meshed topology and unbalanced structure, based on current injection and McCormick Envelopes. Second, we employ the distributed proximal atomic coordination (PAC) algorithm to coordinate DERs to provide voltage support. We implement volt-var optimization by optimally coordinating DERs including PV smart inverters and demand response. We present results using the IEEE-34 bus network, using real data from a distribution feeder in Hawaii, to model load and PV generation. Different levels of DER penetration and objective functions are simulated. Finally, our results show the need for the coordination of DERs to improve voltage profiles, even in networks with existing voltage control devices. Further, we show the need for flexible reactive power capabilities to achieve desired grid performance.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

A Data-Driven Global Sensitivity Analysis Framework for Three-Phase Distribution System with PVs

Global sensitivity analysis (GSA) of distribution systems with respect to stochastic PV and load variations plays an important role in designing optimal voltage control schemes. This paper proposes a data-driven framework for GSA of distribution systems. In particular, two representative surrogate modeling-based approaches are developed, including the traditional Gaussian process-based and the analysis of variance (ANOVA) kernel ones. The key idea is to develop a surrogate model that captures the hidden global relationship between voltage and real and reactive power injections from the historical data. With the surrogate model, the Sobol indices can be conveniently calculated through either the sampling-based method or the analytical method to assess the global sensitivity of voltage to variations of PV and load power injections. The sampling-based method approximates the Sobol indices using Monte Carlo simulations while the analytical method calculates them by resorting to the ANOVA expansion framework. Comparison results with other model-based GSA methods on the unbalanced three-phase IEEE 37-bus and 123-bus distribution systems show that the proposed framework can achieve much higher computational efficiency with negligible loss of accuracy. The results on a real 240-node distribution system using actual smart meter data further validate the feasibility and scalability of the proposed framework.

14 SOLAR ENERGY↗
DOE OSTI2024

Investigating the influence of particle distribution on force and torque statistics using hierarchical machine learning

An accurate representation of hydrodynamic force and torque experienced by every particle in a distribution can be obtained from particle resolved (PR) simulations. These unique quantities are influenced by the deterministic position of surrounding particles. However, systems simulated with this methodology are typically limited to particles due to the involved computational cost. This resource requirement is a major bottleneck in analyzing the effect of variations in particle distribution. Here, this article attempts to address this bottleneck by availing relatively inexpensive deep learning models. The surrogate models that we employ in this article use a physics‐based hierarchical framework and symmetry‐preserving neural networks to achieve robustness with limited training data. This article first performs additional generalizability tests on PR data of distinct distributions that are not involved in the training process. The models are then deployed on several different particle distributions. Impact of clustering and structure on the observed statistics are investigated.

42 ENGINEERING↗
DOE OSTI2026

Distributed Resilience in High-Energy Physics Data Acquisition

Historical experience in the High-Performance Computing community teaches us that as computing systems grow, the instance of failures goes from rare to a regular occurrence. A survey of the growth in the size and complexity of Data AcQuisition (DAQ) networks in High-Energy Physics (HEP) experiments reveals that these networks are scaling exponentially, trending to a point where automated fault handling should be considered over the current manual practice, especially given the rarity of data such as in DUNE's mission to observe core-collapse supernovae. We propose a general system, DiDAQt, which is designed to provide fault detection and handling in HEP DAQs specifically, through MPI-like primitives that allow it to be added easily to existing systems. We evaluate the scalability and response time of a prototype on the FABRIC national testbed, with results indicating sufficient scalability for current and near-future DAQs as well as practical response times (under 1 microsecond decision time).

Wolosewicz, A. [IIT, Chicago]↗