Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “distributed algorithm”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,045 records · Page 58
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Quantitative x ray phase contrast imaging of oblique shock wave–interface interactions

Oblique shock wave–interface interactions of gases and liquids have been extensively studied in shock tubes using optical methods to measure equation-of-state (EOS) parameters. However, this is difficult with solids due to their opaqueness to visible light. X ray phase contrast imaging (XPCI) has the penetrative strength to probe solids while still being sensitive to mass density and enhancing the visibility of material boundaries. We investigate the accuracy and repeatability of measuring the mean value of the average mass density (areal density divided by thickness) over region S (B S ) and flow deflection angle (θ) from XPCI images of a sample. To that end, a Hough transform-based method for measuring θ is developed. To measure B S , the XPCI image intensity probability density function (PDF) is modeled accounting for the spatial distribution of x ray energy, scintillator response, and pulse-to-pulse variation in the x ray intensity. In addition, a Monte Carlo-based algorithm for computing the B S PDF is developed. Both methods are validated on an impact-generated oblique shock wave interacting at a solid polymer-to-polymer interface. Furthermore this is accomplished through a comparison to hydrodynamic simulations using well-established EOS. Under the modeling framework for the XPCI image intensity, B S is computed with an accuracy of < 0.1% and precision of 3%–5%, while θ has an uncertainty of 0.2°, respectively. This shows that the XPCI-based model that is developed here could be an invaluable tool for high-fidelity testing of hydrodynamic models in shock polar configurations.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

Polarized and unpolarized gluon PDFs: Generative machine learning applications for lattice QCD matrix elements at short distance and large momentum

Lattice quantum chromodynamics (QCD) calculations share a defining challenge by requiring a small finite range of spatial separation z between quark/gluon bilinears for controllable power corrections in the perturbative QCD factorization, and a large hadron boost p z for a successful determination of collinear parton distribution functions (PDFs). However, these two requirements make the determination of PDFs from lattice data very challenging. We present the application of generative machine learning algorithms to estimate the polarized and unpolarized gluon correlation functions utilizing short-distance data and extending the correlation up to z p z ≲ 14 , surpassing the current capabilities of lattice QCD calculations. We train physics-informed machine learning algorithms to learn from the short-distance correlation at z ≲ 0.36 fm and take the limit, p z → ∞ , thereby minimizing possible contamination from the higher-twist effects for a successful reconstruction of the polarized gluon PDF. We also expose the bias and problems with underestimating uncertainties associated with the use of model-dependent and overly constrained functional forms, such as x α ( 1 − x ) β and its variants to extract PDFs from the lattice data. We propose the use of generative machine learning algorithms to mitigate these issues and present our determination of the polarized and unpolarized gluon PDFs in the nucleon. Published by the American Physical Society 2025

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

A General State Estimation Formulation for Three-Phase Unbalanced Power Systems

Almost all of the three-phase state estimation algorithms assume existence of a reference bus whose phase angles are perfectly balanced. This assumption is quite realistic for transmission systems, and also for most distribution systems that are connected to a strong transmission system where transmission side can modeled by a balanced reference bus. However, for distribution systems having high penetration of renewable sources or for microgrids operating in islanded mode, the assumption of a balanced reference bus will not be realistic. While there are recent publications focusing on this problem, formulation of the three-phase unbalanced state estimation problem with proper treatment of the reference bus remains unaddressed. In this paper, a new formulation will be described where an accurate state estimation solution can be obtained for any unbalanced threephase system irrespective of its operating conditions (balanced or highly unbalanced), configuration (isolated microgrid, connected to transmission system, etc.) and whether or not it contains any synchronous generators. Validation of the proposed formulation will be carried out via simulations.

State Estimation, Distribution System, Unbalanced ↗
DOE OSTI2024

Short-Term Probabilistic Solar Forecasting via Reinforcement Learning over ECMWF

In this paper, we present an innovative reinforcement learning approach for short-term solar forecasting, leveraging data from the European Centre for Medium-Range Weather Forecasts (ECMWF). The methodology begins with the application of the System Advisor Model (SAM) to transform various ECMWF numerical weather prediction members into predictive photovoltaic power generation. To enhance the precision of deterministic forecasting, we introduce a dynamic model selection algorithm based on Q-learning. This algorithm dynamically identifies and utilizes the most accurate ensemble member for forecasting purposes. Furthermore, we employ a support vector regression surrogate model with a Gaussian distribution to generate probabilistic forecasts, providing a holistic view of solar energy generation uncertainty. To expedite the training process and make it more practical for real-world applications, we integrate a rolling update workflow. This innovative workflow reduces the training period from months to a mere 19 days, making our method highly efficient. Numerical results of the case study show that in comparison to benchmark models, the proposed method improves the deterministic and probabilistic solar forecasting accuracy by up to 40.84% and 48.42%, respectively.

ensemble forecasting↗
DOE OSTI2020

Distributed-Memory Parallel Symmetric Nonnegative Matrix Factorization

We develop the first distributed-memory parallel implementation of Symmetric Nonnegative Matrix Factorization (SymNMF), a key data analytics kernel for clustering and dimensionality reduction. Our implementation includes two different algorithms for SymNMF, which give comparable results in terms of time and accuracy. The first algorithm is a parallelization of an existing sequential approach that uses solvers for non symmetric NMF. The second algorithm is a novel approach based on the Gauss-Newton method. It exploits second-order information without incurring large computational and memory costs. We evaluate the scalability of our algorithms on the Summit system at Oak Ridge National Laboratory, scaling up to 128 nodes (4,096 cores) with 70% efficiency. Additionally, we demonstrate our software on an image segmentation task.

Eswar, Srinivas↗
DOE OSTI2024

Sensitivity of modelled passive margin stratigraphy to variations in sea level, sediment supply and subsidence

Abstract We produced a 10 Myr synthetic stratigraphic section using a forward stratigraphic model that generates marine deltaic stratigraphy over geological timescales. We recursively fit the model using a Bayesian inversion algorithm to test: (1) if it could be accurately reconstructed; (2) if the parameters used to create it could be recovered; and (3) the sensitivity of the model output to given model parameters and the attendant physical processes. The original synthetic stratigraphic section was produced with cyclical sea‐level variations of 40 and 30 m with 2.4 and 10 Myr periods respectively. Sediment was also supplied cyclically, in 2.4 and 10 Myr cycles with amplitudes of 30 and 80 tons/100 kyr, respectively, varying from a mean of 232 tons/100 kyr. Parameter values were sampled to fit the model using a Markov chain Monte Carlo algorithm, resulting in a ±5 m (1σ) variation between the experimental output and the original. Sea level varied by ±7 m (1σ) within the posterior distribution of parameters. As a result, both the 10 Myr and 2.4 Myr sea‐level cycles could be extracted from the original output. The variation in sediment supply was approximately ±38 tons/100 kyr (1σ) and, as a result, only the larger long‐term supply variations could be accurately recovered in refitting the model. The variation in thermal, flexural and total subsidence across those parameter sets is less than ±10 m (1σ). The original section experienced 150 m of total subsidence at the depocentre. Our results demonstrate the distinct and interpretable imprint of sea level and subsidence on continental margin stratigraphy can be quantified. Moreover, we conclude that sea‐level change produces a defined effect on the geometries of stratigraphic architecture, and that techniques applied for the purpose of delineating sea‐level variation from continental margin strata have a well‐founded conceptual basis.

Schmelz, William J.↗
DOE OSTI2022

Measuring representative volume elements from high-resolution grain-scale strain fields

Most crystalline materials present a highly heterogeneous response at the microscale, which can be affected by both internal factors (such as microstructural parameters) and external factors (such as loading). Relating microscale inhomogeneities to the macroscale response of a material requires the use of homogenisation techniques, usually based on the concept of a representative volume element (RVE)—the smallest volume of material that represents the global average response. Here, in this work, we present a new and robust experimental method of measuring the size of a strain-based RVE from high-resolution grain-scale strain fields obtained using digital image correlation (DIC). The proposed method is based on the statistical (stereological) nature of the RVE, which has been widely adopted in numerical studies, and involves dividing a strain field into randomly selected regions of varying sizes and statistically analysing the distributions of average strains within them. To validate the new method, we generate a large number of synthetic strain fields from a fractional Gaussian noise algorithm. The proposed stereological method is shown to be capable of producing reliable RVE measurements from a very large range of possible microscale strain fields while at the same time being robust in that it can produce RVE measurement results even in cases where other existing methods may be unable to do so. The proposed method has a low field-of-view requirement, only needing a field-of-view about 1.2 times as large as the RVE to produce reliable measurements. In addition, the stereological method offers significant flexibility since its statistical nature allows for control over how strict the RVE measurement should be in each case.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Avatar Tools

Supervised machine learning is the process of using past experience to predict the future. "Ensembles" are a machine-learning meta-method that can be applied to most machine learning algorithms. Ensembles generally greatly improve accuracy, reduce or remove most of the design issues presented by machine learning, and are admirably suited to parallel and distributed computation. The Avatar Tools codes are an implementation of ensembles specifically for decision trees. Some features that distinguish Avatar Tools from other "ensembles for decision trees" codes are: (1) Does the bookkeeping necessary for out of bag (OOB) validation. (2) Can use OOB validation to automatically determine optimal ensemble size. (3) Provides an MPI-based parallel implementation, for distributed operation. (4) Provides convenient tools for cross-validation, to assess the accuracy provided by a training set. SAND2020-3858 M Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Siefert, Christopher↗
DOE OSTI2021

Multiscale characterization and representation of variability in ceramic matrix composites

Low density, high strength, and high creep and oxidation resistance properties of ceramic matrix composites (CMCs) make them an ideal choice for use in extreme environments in space and military applications. This paper presents a detailed characterization study of structural and manufacturing flaws in Carbon fiber Silicon-Carbide-Nitride matrix (C/SiNC) CMCs at different length-scales. Energy-dispersive spectroscopy (EDS) is used for the chemical characterization of the material’s elemental constituents. High-resolution multiscale graphs obtained from scanning electron microscope (SEM) and confocal laser scanning microscope (LSM) are used to characterize the distribution and morphology of defects at different length scales. This is followed by the classification and quantification of the common manufacturing defects. An image processing algorithm based on the image segmentation process is developed to quantify the variability of various scale-dependent architectural parameters. Finally, a three-dimensional stochastic representative volume element (SRVE) generation algorithm is developed to provide precise representations of material textures at multiple length scales. The developed algorithm accurately accounts for material features and flaws based on a range of multiscale structural and defects characterization results.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Factors controlling marine aerosol size distributions and their climate effects over the northwest Atlantic Ocean region

Abstract. Aerosols over Earth's remote and spatially extensive ocean surfaces have important influences on planetary climate. However, these aerosols and their effects remain poorly understood, in part due to the remoteness and limited observations over these regions. In this study, we seek to understand factors that shape marine aerosol size distributions and composition in the northwest Atlantic Ocean region. We use the GEOS-Chem model with the TwO-Moment Aerosol Sectional (TOMAS) microphysics algorithm model to interpret measurements collected from ship and aircraft during the four seasonal campaigns of the North Atlantic Aerosols and Marine Ecosystems Study (NAAMES) conducted between 2015 and 2018. Observations from the NAAMES campaigns show enhancements in the campaign-median number of aerosols with diameters larger than 3 nm in the lower troposphere (below 6 km), most pronounced during the phytoplankton bloom maxima (May/June) below 2 km in the free troposphere. Our simulations, combined with NAAMES ship and aircraft measurements, suggest several key factors that contribute to aerosol number and size in the northwest Atlantic lower troposphere, with significant regional-mean (40–60∘ N and 20–50∘ W) cloud-albedo aerosol indirect effect (AIE) and direct radiative effect (DRE) processes during the phytoplankton bloom. These key factors and their associated simulated radiative effects in the region include the following: (1) particle formation near and above the marine boundary layer (MBL) top (AIE: −3.37 W m−2, DRE: −0.62 W m−2); (2) particle growth due to marine secondary organic aerosol (MSOA) as the nascent particles subside into the MBL, enabling them to become cloud-condensation-nuclei-sized particles (AIE: −2.27 W m−2, DRE: −0.10 W m−2); (3) particle formation and growth due to the products of dimethyl sulfide, above and within the MBL (−1.29 W m−2, DRE: −0.06 W m−2); (4) ship emissions (AIE: −0.62 W m−2, DRE: −0.05 W m−2); and (5) primary sea spray emissions (AIE: +0.04 W m−2, DRE: −0.79 W m−2). Our results suggest that a synergy of particle formation in the lower troposphere (particularly near and above the MBL top) and growth by MSOA contributes strongly to cloud-condensation-nuclei-sized particles with significant regional radiative effects in the northwest Atlantic. To gain confidence in radiative effect magnitudes, future work is needed to understand (1) the sources and temperature dependence of condensable marine vapors forming MSOA, (2) primary sea spray emissions, and (3) the species that can form new particles in the lower troposphere and grow these particles as they descend into the marine boundary layer.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Harnessing stratospheric diffusion barriers for enhanced climate geoengineering

Stratospheric sulfate aerosol geoengineering is a proposed method to temporarily intervene in the climate system to increase the reflectance of shortwave radiation and reduce mean global temperature. In previous climate modeling studies, choosing injection locations for geoengineering aerosols has, thus far, only utilized the average dynamics of stratospheric wind fields instead of accounting for the essential role of time-varying material transport barriers in turbulent atmospheric flows. Here we conduct the first analysis of sulfate aerosol dispersion in the stratosphere, comparing what is now a standard fixed-injection scheme with time-varying injection locations that harness short-term stratospheric diffusion barriers. We show how diffusive transport barriers can quickly be identified, and we provide an automated injection location selection algorithm using short forecast and reanalysis data. Within the first 7 d days of transport, the dynamics-based approach is able to produce particle distributions with greater global coverage than fixed-site methods with fewer injections. Additionally, this enhanced dispersion slows aerosol microphysical growth and can reduce the effective radii of aerosols up to 200–300 d after injection. While the long-term dynamics of aerosol dispersion are accurately predicted with transport barriers calculated from short forecasts, the long-term influence on radiative forcing is more difficult to predict and warrants deeper investigation. Statistically significant changes in radiative forcing at timescales beyond the forecasting window showed mixed results, potentially increasing or decreasing forcing after 1 year when compared to fixed injections. We conclude that future feasibility studies of geoengineering should consider the cooling benefits possible by strategically injecting sulfate aerosols at optimized time-varying locations. Our method of utilizing time-varying attracting and repelling structures shows great promise for identifying optimal dispersion locations, and radiative forcing impacts can be improved by considering additional meteorological variables.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

CBRN Situational Awareness Tools for the Modern Age

CBRN Situational awareness (SA) should be a key operational requirement in the CNI area of discussion, not only for the “boots-on-the-ground” warfighter, but at a strategic level. For example, maneuver plans will need to be developed for contamination avoidance and battlefield survivability. Large datasets from instruments dispersed across the battlefield will thus need to be collected and processed into a holistic assessment of the radiological hazard. From there, hazard maps then must be distributed at the tactical level, all while continuing to effectively engage a peer adversary. This vision represents a network of sensors, software tools, data processing algorithms, communications suites, and common operational picture (COP) platforms working in concert to inform warfighters and command echelons alike of evolving nuclear and radiological hazards. This complex system-of-systems and the ultimate goal of effective engagement in a nuclear or radiological-hazard battlefield can be achieved through pursuit of improvement in collaborative SA tools.

Becker, Eric M.↗
DOE OSTI2025

Enhancing Cluster Identification in Atom Probe Tomography Data Using Transfer Learning

Atom Probe Tomography (APT) is a powerful technique for visualizing the atomic-scale distribution of solutes in materials, but quantitative cluster analysis of APT datasets remains a challenge due to the need for subjective parameter selection in clustering algorithms. While distance-based and density-based methods such as HDBSCAN are widely used, their performance is highly sensitive to user-defined parameters, which undermines reproducibility and accuracy. This study proposes an image-based, deep learning-aided workflow for automating parameter selection and cluster detection in APT data analysis. By projecting 3D APT point clouds onto 2D planes, we leverage pretrained convolutional neural networks (ConvNeXt-Tiny and ResNet-50) through transfer learning to predict the number of clusters present in synthetic datasets. The output is used to guide K-means clustering and estimate HDBSCAN parameters, specifically minimum cluster size and minimum sample points. This approach reduces reliance on manual parameter tuning, improving consistency and scalability. The methodology demonstrates the feasibility of using image-based deep learning for interpreting complex spatial patterns in APT data, enabling faster and more objective analysis. The complete workflow and code are made publicly available to support reproducibility and future research.

Density-based clustering↗
DOE OSTI2021

ArborX

ArborX library tackles a problem of efficiently finding geometric objects that are close in space. Variations of this problem, such as finding the nearest neighbors of a point, or finding all objects within a certain distance, are inherent components of applications in many fields. The data may be large so that solving the problem efficiently may require significant computational resources, such as multiple processors or accelerators such as general purpose GPUs. ArborX' main advantage in its ability to solve large problems efficiently utilizing a combination of distributed and on-node parallelism. ArborX can be run efficiently on a wide variety of hardware, including GPUs from different vendors, which distinguishes it from other available libraries which typically choose only few of these. The other advantage is that it supports both types of user problems: spatial problems (useful for intersections and finding objects within certain distance), and nearest neighbor problems. ArborX also supports flexible interface in its interaction with a user. Particularly, it allows a user to call user's own function on a positive match, a functionality not rarely available in other libraries. ArborX implements construction and traversal algorithms using efficient tree structures, such as bounding volume hierarchy (BVH). At its core, it uses linear BVH for its low construction cost and sufficient quality. ArborX is written using C++, and is parallelized using the message passing interface (MPI) for the distributed communication, and the Kokkos library for on-node parallelism. This approach allows ArborX to be run on a wide variety of hardware, from common laptops and desktops to supercomputers while using the same codebase. ArborX also implements several advanced algorithms using geometric search, such as density-based clustering algorithm DBSCAN.

ECP↗
DOE OSTI2024

An Evaluation of Sustainable Power System Resilience in the Face of Severe Weather Conditions and Climate Changes: A Comprehensive Review of Current Advances

Natural disasters pose significant threats to power distribution systems, intensified by the increasing impacts of climate changes. Resilience-enhancement strategies are crucial in mitigating the resulting social and economic damages. Hence, this review paper presents a comprehensive exploration of weather management strategies, augmented by recent advancements in machine learning algorithms, to show a sustainable resilience assessment. By addressing the unique challenges posed by diverse weather conditions, we propose flexible and intelligent solutions to navigate disaster complications effectively. This proposition emphasizes sustainable practices that not only address immediate disaster complications, but also prioritize long-term resilience and adaptability. Furthermore, the focus extends to mitigation strategies and microgrid technologies adapted to distribution systems. Through statistical analysis and mathematical formulations, we highlight the critical role of these advancements in mitigating severe weather conditions and ensuring the system reliability.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

A Hybrid DC Fault Primary Protection Algorithm for Multi-Terminal HVdc Systems

Protection against dc faults is one of the main technical hurdles faced when operating converter-based HVdc systems. Protection becomes even more challenging for multi-terminal dc (MTdc) systems with more than two terminals/converter stations. In this paper, a hybrid primary fault detection algorithm for MTdc systems is proposed to detect a broad range of failures. Sensor measurements, i.e., line currents and dc reactor voltages measured at local terminals, are first processed by a top-level context clustering algorithm. For each cluster, the best fault detector is selected among a detector pool according to a rule resulting from a learning algorithm. The detector pool consists of several existing detection algorithms, each performing differently across fault scenarios. The proposed hybrid primary detection algorithm: i) offers superior performance compared to an individual detector through a data-driven approach; ii) detects all major fault types including pole-to-pole (P2P), pole-to-ground (P2G), and external dc faults; iii) identifies faults with various fault locations and impedances; iv) is more robust to noisy sensor measurements compared to existing methods; v) does not require exhaustive simulation and sampling for training the model. Performance and effectiveness of the proposed algorithm are evaluated and verified based on time-domain simulations in the PSCAD/EMTDC software environment. The results confirm satisfactory operation, accuracy, and detection speed of the proposed algorithm under various fault scenarios.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2021

Multi-Area Model-Free State Estimation via Distributed Tensor Decomposition

This paper proposes a model-free method for distribution system state estimation based on tensor completion using canonical polyadic decomposition. In particular, we consider a setting where the network is divided into multiple areas. The measured physical quantities at buses located in the same area are processed by an area controller. A third-order tensor is constructed to collect these measured quantities. The measurements are analyzed locally to recover the full state information of the network. A closed-form iterative algorithm based on the alternating direction method of multipliers is developed to obtain the low-rank factors of the whole network state tensor where information exchange happens only between neighboring areas. To demonstrate the efficacy of the developed algorithm, numerical simulations are carried out using an IEEE test system.

alternating direction method of multipliers↗
DOE OSTI2023

Protecting Customer Privacy Through Distributed Energy Resource Anonymization

Due to their stochastic nature, the increase of Renewable Energy Resources (RERs) as a primary source of energy for power grids creates challenges regarding the reliability and resilience of the system. In order to combat these obstacles, expansion of Distributed Energy Resources (DERs) and their participation in Demand Response (DR) programs is necessary. Widespread participation requires prioritizing customer privacy and addressing concerns that may arise regarding communication between DERs and the Grid Service Provider (GSP). This paper discusses the use of flow reservation resources to split the operating cycles of DER load profiles into unique phases. The splitting of phases increases anonymization of the DERs by making it more difficult to determine the individual characteristics of the device. We discuss an example of this using simulated DER load profile data and examine the resulting effectiveness by using a machine learning algorithm for classification, called Support Vector Machine (SVM).

Distributed Energy Resource, Anonymization, Renewa↗