Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Data Distribution”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 865 records · Page 48
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Evaluation and Suitability of Using SERI QC Software for Estimating Measurement Uncertainty

SERI QC is a robust solar data quality assessment software tool that has been in continuous use for more than three decades. This report (the first of six in the Data Quality and Uncertainty Integration project) reviews and evaluates the software to determine its suitability for determining the estimated expanded measurement uncertainty of solar measurement data by including operational factors. Using redundancy incorporated in three-component (global, direct, diffuse) solar measurements, SERI QC can quantify the standard uncertainty estimates for estimating uncertainty. With minor modifications, SERI QC will provide an operational uncertainty to be used in conjunction with the National Renewable Energy Laboratory method for instrument uncertainty to provide an integrated estimate of solar measurement data sets. These modifications will capitalize on SERI QC's evaluation of data quality, including data input validation and a variety of built-in solar routines, and will further develop the utility of the software.

14 SOLAR ENERGY↗
DOE OSTI2025

Desmearing two-dimensional small-angle neutron scattering data by central moment expansions

Resolution smearing is a critical challenge in the quantitative analysis of two-dimensional small-angle neutron scattering (SANS) data, particularly in studies of soft-matter flow and deformation using SANS. Here, we present a central moment expansion technique to address smearing in anisotropic scattering spectra, offering a model-free desmearing methodology. By accounting for directional variations in resolution smearing and enhancing computational efficiency, this approach reconstructs desmeared intensity distributions from smeared experimental data. Computational benchmarks using interacting hard-sphere fluids and Gaussian chain models validate the accuracy of the method, while simulated noise analyses confirm its robustness under experimental conditions. Experimental validation using rheological SANS data from shear-induced micellar structures demonstrates the practicality and effectiveness of the proposed algorithm. The desmearing technique provides a powerful tool for advancing the quantitative analysis of anisotropic scattering patterns, enabling precise insights into the interplay between material microstructure and macroscopic flow behavior.

anisotropic scattering spectra↗
DOE OSTI2022

Implementation Aspects of Smart Grids Cyber-Security Cross-Layered Framework for Critical Infrastructure Operation

Communication networks in power systems are a major part of the smart grid paradigm. It enables and facilitates the automation of power grid operation as well as self-healing in contingencies. Such dependencies on communication networks, though, create a roam for cyber-threats. An adversary can launch an attack on the communication network, which in turn reflects on power grid operation. Attacks could be in the form of false data injection into system measurements, flooding the communication channels with unnecessary data, or intercepting messages. Using machine learning-based processing on data gathered from communication networks and the power grid is a promising solution for detecting cyber threats. In this paper, a co-simulation of cyber-security for cross-layer strategy is presented. The advantage of such a framework is the augmentation of valuable data that enhances the detection as well as identification of anomalies in the operation of the power grid. The framework is implemented on the IEEE 118-bus system. The system is constructed in Mininet to simulate a communication network and obtain data for analysis. A distributed three controller software-defined networking (SDN) framework is proposed that utilizes the Open Network Operating System (ONOS) cluster. According to the findings of our suggested architecture, it outperforms a single SDN controller framework by a factor of more than ten times the throughput. This provides for a higher flow of data throughout the network while decreasing congestion caused by a single controller’s processing restrictions. Furthermore, our CECD-AS approach outperforms state-of-the-art physics and machine learning-based techniques in terms of attack classification. The performance of the framework is investigated under various types of communication attacks.

cross-layered↗
DOE OSTI2021

Energy dependent calculations of fission product, prompt, and delayed neutron yields for neutron induced fission on 235 U, 238 U, and 239 Pu

In this article, we perform energy-dependent calculations of independent and cumulative fission product yields for 235 U, 238 U, and 239 Pu in the first chance fission region. Starting with the primary fission fragment distributions taken from available experimental data and analytical functions based on assumptions for the excitation energy and spin-parity distributions, the Hauser-Feshbach statistical decay treatment for fission fragment de-excitation is applied to more than 1,000 fission fragments for the incident neutron energies up to 5 MeV. The calculated independent yields are then used as an input of β-decay calculations to produce the cumulative yield, and summation calculations are performed. Model parameters in these procedures are adjusted by applying the Bayesian technique at the thermal energy for 235 U and 239 Pu and in the fast energy range for 238 U. The calculated fission observable quantities, such as the energy-dependent cumulative yields, and prompt and delayed neutron yields, are compared with available experimental data. We also study the possible impact of the second chance fission opening on the energy dependence of the delayed neutron yield by on the opening of second chance fission on the energy dependence calculation.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Fault-Tolerant Deep Learning Cache with Hash Ring for Load Balancing in HPC Systems

Large-scale DL on HPC systems like Frontier and Summit uses distributed node-local caching to address scalability and performance challenges. However, as these systems grow more complex, the risk of node failures increases, and current caching approaches lack fault tolerance, jeopardizing large-scale training jobs. We analyzed six months of SLURM job logs from Frontier and found that over 30% of jobs failed after an average of 75 minutes. To address this, we propose fault-tolerance strategies that recache data lost from failed nodes using a hash ring technique for balanced data recaching in the distributed node-local caching, reducing reliance on the PFS. Our extensive evaluations on Frontier showed that the hash ring-based recaching approach reduced training time by approximately 25% compared to the approach that redirects I/O to the PFS after node failures and demonstrated effective load balancing of training data across nodes.

Lee, Seoyeong↗
DOE OSTI2023

Assessment of Sodium Thermal Stratification Models Utilizing the TSTF Benchmark

As a result of certain transient scenarios, a thermally stratified layer of liquid sodium can develop in the bulk coolant volumes of a sodium-cooled fast reactor (SFR). In addition to the effects a stratification layer has on the temperature of the heat transport system, a stratification layer can also influence the transition to and establishment of natural circulation flow, which plays an important role in passive cooling and the inherent safety of a pool-type SFR. Therefore, the ability to accurately capture thermal stratification phenomena is important when demonstrating the safety basis of a pool-type SFR during transient sequences. The present work assesses various computational models with different fidelities in their ability to predict thermal stratification in the upper plenum of an SFR. Each computational model will be assessed using the data generated at the Thermal Stratification Test Facility (TSTF) located at the University of Wisconsin-Madison. Using measured flow rate and inlet temperature data, the measured temperature distributions of the tests are compared to the predictions of the lumped volume-based models in SAS4A/SASSYS-1, a 1D-based model in SAM, and a 3-D computational fluid dynamics (CFD) model using STAR-CCM+. The relative performance of the various computational methods is assessed with respect to key metrics such as bulk coolant temperature distribution and plenum exit temperature. A total of eight tests are analyzed, covering different combinations of flow rates (3 and 10 GPM) and upper internal structure (UIS) configurations (none, solid, porous, and open) The perfect mixing model of SAS4A/SASSYS-1 provides the highest accuracy when the flow rate is high and there is no UIS in the test vessel, as high flow rate injection promotes thermal mixing of the sodium in the test vessel. For most of the analyzed tests, the stratified volume model of SAS4A/SASSYS-1 is able to predict the delay in the outlet temperature drop and temperature distribution in the test vessel by a small number of layers to represent thermal stratification. However, the stratified volume model can only simulate a maximum of three temperature layers within a volume and when a layer approaches the elevation of the outlet, the predicted outlet temperature can demonstrate rapid, non-physical changes. The 1-D axial mixing model of SAM provides results that agree reasonably well with the measured data in the prediction of the temporal evolution of the outlet temperature with the exception of the case with a high flow rate and no UIS. The SAM 1-D model has a similar level of accuracy to CFD results when it comes to predicting the outlet temperature. CFD shows overall good agreement in predicting the temperature distribution in the test vessel and outlet temperature. As CFD can model the test vessel geometry in detail, it performs well in the cases of complex geometries such as tests that included a UIS and internal flow through the UIS resulting in active mixing of the coolant in the test vessel. Each of the models discussed in the present work has the potential to be useful during the various stages of reactor design, analysis, and licensing. The lumped-volume approach can be applied for fast turnaround safety calculations to obtain overall reactor behavior during transients. The 1-D models provide improved accuracy when stratification is expected for a relatively low increase in the computational cost. The CFD model can be utilized for confirmatory analysis of the 1-D model, when experimental measurements are not available.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2022

Dark Energy Survey Year 3 results: calibration of lens sample redshift distributions using clustering redshifts with BOSS/eBOSS

ABSTRACT We present clustering redshift measurements for Dark Energy Survey (DES) lens sample galaxies used in weak gravitational lensing and galaxy clustering studies. To perform these measurements, we cross-correlate with spectroscopic galaxies from the Baryon Acoustic Oscillation Survey (BOSS) and its extension, eBOSS. We validate our methodology in simulations, including a new technique to calibrate systematic errors that result from the galaxy clustering bias, and we find that our method is generally unbiased in calibrating the mean redshift. We apply our method to the data, and estimate the redshift distribution for 11 different photometrically selected bins. We find general agreement between clustering redshift and photometric redshift estimates, with differences on the inferred mean redshift found to be below |Δz| = 0.01 in most of the bins. We also test a method to calibrate a width parameter for redshift distributions, which we found necessary to use for some of our samples. Our typical uncertainties on the mean redshift ranged from 0.003 to 0.008, while our uncertainties on the width ranged from 4 to 9 per cent. We discuss how these results calibrate the photometric redshift distributions used in companion papers for DES Year 3 results.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Assessments of epistemic uncertainty using Gaussian stochastic weight averaging for fluid-flow regression

Here, we use Gaussian stochastic weight averaging (SWAG) to assess the epistemic uncertainty associated with neural-network-based function approximation relevant to fluid flows. SWAG approximates a posterior Gaussian distribution of each weight, given training data, and a constant learning rate. Having access to this distribution, it is able to create multiple models with various combinations of sampled weights, which can be used to obtain ensemble predictions. The average of such an ensemble can be regarded as the 'mean estimation', whereas its standard deviation can be used to construct 'confidence intervals', which enable us to perform uncertainty quantification (UQ) with regard to the training process of neural networks. We utilize representative neural-network-based function approximation tasks for the following cases: (i) a two-dimensional circular-cylinder wake; (ii) the DayMET dataset (maximum daily temperature in North America); (iii) a three-dimensional square-cylinder wake; and (iv) urban flow, to assess the generalizability of the present idea for a wide range of complex datasets. SWAG-based UQ can be applied regardless of the network architecture, and therefore, we demonstrate the applicability of the method for two types of neural networks: (i) global field reconstruction from sparse sensors by combining convolutional neural network (CNN) and multi-layer perceptron (MLP); and (ii) far-field state estimation from sectional data with two-dimensional CNN. We find that SWAG can obtain physically-interpretable confidence-interval estimates from the perspective of epistemic uncertainty. This capability supports its use for a wide range of problems in science and engineering.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Predicting Emission Source Terms in a Reduced-Order Fire Spread Model—Part 1: Particulate Emissions

A simple, easy-to-evaluate, surrogate model was developed for predicting the particle emission source term in wildfire simulations. In creating this model, we conceptualized wildfire as a series of flamelets, and using this concept of flamelets, we developed a one-dimensional model to represent the structure of these flamelets which then could be used to simulate the evolution of a single flamelet. A previously developed soot model was executed within this flamelet simulation which could produce a particle size distribution. Executing this flamelet simulation 1200 times with varying conditions created a data set of emitted particle size distributions to which simple rational equations could be tuned to predict a particle emission factor, mean particle size, and standard deviation of particle sizes. These surrogate models (the rational equation) were implemented into a reduced-order fire spread model, QUIC-Fire. Using QUIC-Fire, an ensemble of simulations were executed for grassland fires, southeast U.S. conifer forests, and western mountain conifer forests. Resulting emission factors from this ensemble were compared against field data for these fire classes with promising results. Also shown is a predicted averaged resulting particle size distribution with the bulk of particles produced to be on the order of 1 μm in size.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

The kinematic properties of Milky Way stellar halo populations

ABSTRACT In the Gaia era, stellar kinematics are extensively used to study Galactic halo stellar populations, to search for halo structures, and to characterize the interface between the halo and hot disc populations. We use distribution function-based models of modern data sets with 6D phase space data to qualitatively describe a variety of kinematic spaces commonly used in the study of the Galactic halo. Furthermore, we quantitatively assess how well each kinematic space can separate radially anisotropic from isotropic halo populations. We find that scaled action space (the ‘action diamond’) is superior to other commonly used kinematic spaces at this task. We present a new, easy to implement selection criterion for members of the radially anisotropic Gaia–Enceladus merger remnant. Assuming a 1:1 ratio of Gaia–Enceladus stars to more isotropic halo, we find our selection achieves a sample purity of 86 per cent in our models with respect to contamination from the more isotropic halo. We compare this criterion to literature criteria, finding that it produces the highest purity in the resulting samples, at the expense of a modest reduction in completeness. We also show that selection biases that underlie nearly all contemporary spectroscopic data sets can noticeably impact the E−Lz distribution of samples in a manner that may be confused for real substructure. We conclude by providing recommendations for how authors should use stellar kinematics in the future to study the Galactic stellar halo.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2020

Value-of-Information Analysis of a Fracture Prediction Method

A core-based fracture prediction method is used to illustrate a Value of Information (VOI) decision-analysis protocol to inform completion decisions in tight-gas sandstones. The ratio of late host-rock cement to available pore volume or degradation index uses petrographic observations of cement distributions in core (including sidewall cores) to predict whether nearby but unsampled fractures (widths > 0.5 to 1 mm) are sealed (non-conductive) or open (conductive). Measurements from four sandstone plays suggest that the index correctly predicts open vs. sealed fractures with an accuracy in excess of 80%. The value added is calculated using Bayesian inference in which accuracy of the index serves as the likelihood of the prior distribution of open fractures to assess the posterior probability that data represent a useful predictor of producibility. VOI of the prediction method is more than three times the cost to acquire the data. VOI is most sensitive to play-specific geologic and cost parameters including cost to drill, expected revenue from a successful well, cost of completion, cost of acquiring data for the index, and fracture probability distributions. The approach provides a way to value acquiring fracture data and points to a need for zone-specific production data in tight-gas sandstones.

02 PETROLEUM↗
DOE OSTI2025

A Convolution Neural Network for Voltage Event Classification at a Photovoltaic Inverter

This paper presents a convolutional neural network (CNN) developed to identify voltage events in photovoltaic (PV) inverters. The CNN is trained on synthetic data generated using the IEEE 13-bus distribution feeder model and evaluated on field measured data collected from Energy Northwest’s Horn Rapids Solar, Storage, and Training (HRSST) facility. The study focuses on two common voltage events: faults and voltage sags. The CNN is configured to analyze voltage and current waveforms from three-phase PV systems, demonstrating excellent accuracy during training. Field data from the HRSST facility is employed to assess its real-world performance, where the CNN achieves perfect identification of faults and voltage sags in a sample of nine events. This work highlights the potential of the proposed method to enhance PV protection schemes, providing a robust foundation for improved voltage event detection and grid reliability.

Cornachione, Matthew A.↗
DOE OSTI2024

A Data-Driven Approach for High-Impedance Fault Localization in Distribution Systems

Accurate and quick identification of high-impedance faults (HIFs) is critical for the reliable operation of distribution systems. Unlike other faults in power grids, HIFs are very difficult to detect by conventional overcurrent relays due to the low fault current. Although HIFs can be affected by various factors, the voltage-current characteristics can substantially imply how the system responds to the disturbance and thus provides opportunities to effectively localize HIFs. In this work, we propose a data-driven approach for the identification of HIF events. To tackle the nonlinearity of the voltage-current trajectory, first, we formulate optimization problems to approximate the trajectory with piecewise functions. Then we collect the function features of all segments as inputs and use the support vector machine approach to efficiently identify HIFs at different locations. Numerical studies on the IEEE 123-node test feeder demonstrate the validity and accuracy of the proposed approach for real-time HIF identification.

explainable artificial intelligence↗
DOE OSTI2024

A Data-Driven Approach for High-Impedance Fault Localization in Distribution Systems: Preprint

Accurate and quick identification of high-impedance faults (HIFs) is critical for the reliable operation of distribution systems. Unlike other faults in power grids, HIFs are very difficult to detect by conventional overcurrent relays due to the low fault current. Although HIFs can be affected by various factors, the voltage-current characteristics can substantially imply how the system responds to the disturbance and thus provides opportunities to effectively localize HIFs. In this work, we propose a data-driven approach for the identification of HIF events. To tackle the nonlinearity of the voltage-current trajectory, first, we formulate optimization problems to approximate the trajectory with piecewise functions. Then we collect the function features of all segments as inputs and use the support vector machine approach to efficiently identify HIFs at different locations. Numerical studies on the IEEE 123-node test feeder demonstrate the validity and accuracy of the proposed approach for real-time HIF identification.

explainable artificial intelligence↗
DOE OSTI2022

Smart sensor for online situational awareness in power grids

Waveforms in power grids typically reveal a certain pattern with specific features and peculiarities driven by the system operating conditions, internal and external uncertainties, etc. This prompts an observation of different types of waveforms at the measurement points (substations). An innovative next-generation smart sensor technology includes a measurement unit embedded with sophisticated analytics for power grid online surveillance and situational awareness. The smart sensor brings additional levels of smartness into the existing phasor measurement units (PMUs) and intelligent electronic devices (IEDs). It unlocks the full potential of advanced signal processing and machine learning for online power grid monitoring in a distributed paradigm. Within the smart sensor are several interconnected units for signal acquisition, feature extraction, machine learning-based event detection, and a suite of multiple measurement algorithms where the best-fit algorithm is selected in real-time based on the detected operating condition. Embedding such analytics within the sensors and closer to where the data is generated, the distributed intelligence mechanism mitigates the potential risks to communication failures and latencies, as well as malicious cyber threats, which would otherwise compromise the trustworthiness of the end-use applications in distant control centers. The smart sensor achieves a promising classification accuracy on multiple classes of prevailing conditions in the power grid and accordingly improves the measurement quality across the power grid.

Dehghanian, Payman↗
DOE OSTI2022

Hardware-accelerated inference for real-time gravitational-wave astronomy

The field of transient astronomy has seen a revolution with the first gravitational-wave detections and the arrival of multi-messenger observations they enabled. Transformed by the first detection of binary black hole and binary neutron star mergers, computational demands in gravitational-wave astronomy are expected to grow by at least a factor of two over the next five years as the global network of kilometer-scale interferometers are brought to design sensitivity. With the increase in detector sensitivity, real-time delivery of gravitational-wave alerts will become increasingly important as an enabler of multi-messenger followup. In this work, we report a novel implementation and deployment of deep learning inference for real-time gravitational-wave data denoising and astrophysical source identification. This is accomplished using a generic Inference-as-a-Service model that is capable of adapting to the future needs of gravitational-wave data analysis. Overall, our implementation allows seamless incorporation of hardware accelerators and also enables the use of commercial or private (dedicated) as-a-service computing. Based on our results, we propose a paradigm shift in low-latency and offline computing in gravitational-wave astronomy. Such a shift can address key challenges in peak-usage, scalability and reliability, and provide a data analysis platform particularly optimized for deep learning applications. The achieved sub-millisecond scale latency will also be relevant for any machine learning-based real-time control systems that may be invoked in the operation of near-future and next generation ground-based laser interferometers, as well as the front-end collection, distribution and processing of data from such instruments.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

Scaling neural simulations in STACS

Abstract As modern neuroscience tools acquire more details about the brain, the need to move towards biological-scale neural simulations continues to grow. However, effective simulations at scale remain a challenge. Beyond just the tooling required to enable parallel execution, there is also the unique structure of the synaptic interconnectivity, which is globally sparse but has relatively high connection density and non-local interactions per neuron. There are also various practicalities to consider in high performance computing applications, such as the need for serializing neural networks to support potentially long-running simulations that require checkpoint-restart. Although acceleration on neuromorphic hardware is also a possibility, development in this space can be difficult as hardware support tends to vary between platforms and software support for larger scale models also tends to be limited. In this paper, we focus our attention on Simulation Tool for Asynchronous Cortical Streams (STACS), a spiking neural network simulator that leverages the Charm++ parallel programming framework, with the goal of supporting biological-scale simulations as well as interoperability between platforms. Central to these goals is the implementation of scalable data structures suitable for efficiently distributing a network across parallel partitions. Here, we discuss a straightforward extension of a parallel data format with a history of use in graph partitioners, which also serves as a portable intermediate representation for different neuromorphic backends. We perform scaling studies on the Summit supercomputer, examining the capabilities of STACS in terms of network build and storage, partitioning, and execution. We highlight how a suitably partitioned, spatially dependent synaptic structure introduces a communication workload well-suited to the multicast communication supported by Charm++. We evaluate the strong and weak scaling behavior for networks on the order of millions of neurons and billions of synapses, and show that STACS achieves competitive levels of parallel efficiency.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Dynamic Boundary Microgrids Under Privatization Considerations

Microgrids have physical, electrical, and logical (data, network, and ownership) boundaries. To power unserved customer loads during an outage, microgrids can extend the traditional operational boundaries. This can become complex when considering microgrid-to-microgrid (M2M) interactions where sensitive information such as competitive microgrid operational data is not shared. This work proposes an optimization method coordinated between microgrid controllers and distribution management systems that limits data sharing. The method involves a competitive bidding strategy that maximizes unserved load coverage while minimizing resource utilization and sensitive operational data sharing among entities. The work is validated on a two-microgrid system with photovoltaic and energy storage systems and curves of load derived from real world residential buildings datasets. Results show that the proposed method, when applied for three distinct use cases of energy storage sufficiency to cover the predefined boundary and/or the expanded boundary, can successfully select and bid the available load coverage.

Starke, Michael [ORNL] (ORCID:0000000221211195)↗