SEARCH · Engineering Papers

Results for “distributed analytics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

All sources NASA NTRS DOE OSTI

DOE OSTI2021

Considerations for Distributed Energy Resource Integration in Puerto Rico: DOE Multi-Lab Grid Modeling Support for Puerto Rico; Analytical Support for Interconnection and IEEE Std 1547-2018 National Renewable Energy Laboratory (Task 3.0)

To ensure the sustainable long-term recovery of Puerto Rico's electric power grid from hurricanes María and Irma and to build capacity to manage future potential natural disasters in the most secure and resilient way, the U.S. Department of Energy (DOE) convened experts from multiple national laboratories to develop a comprehensive set of data, models, analytic tools, and studies, considering inputs from a wide variety of stakeholder groups, to support technically sound recommendations for Puerto Rico's energy investment decisions. A resilient electric grid is vital to Puerto Rico's security, economy, and way of life, and it will provide the foundation for essential services that people and businesses on the island rely on every day. This report shows progress for a grid modeling task under the DOE-sponsored project that is a collaboration among the National Renewable Energy Laboratory (NREL) and other national laboratories. In Phase 1 of the multilab effort to support Puerto Rico's recovery, NREL provided the utility company Puerto Rico Electric Power Authority (PREPA) recommendations for a new framework of interconnection standards to accelerate the integration of utility-scale, transmission-connected renewable electrical generation and energy storage that ensure cross-technology compatibility and enable high deployment levels without compromising grid reliably, safety, or security. This Phase 2 report focuses on the interconnection of distributed energy resources (DERs) to the electric distribution system in Puerto Rico. This report is intended to familiarize the reader with Puerto Rico's distribution infrastructure and operational practices and procedures that are relevant to DER interconnection. The report also provides considerations for streamlining the interconnection process given the expected increase in deployments resulting from Puerto Rico's renewable portfolio standard (RPS) goal of 100% renewables by 2050. Accordingly, the report identifies considerations and concerns associated with the increase in intermittent generation, strategies for DER interconnection best practices, and the potential use of the latest technological solutions identified in the latest revision of the Institute of Electrical and Electronics Engineers (IEEE) 1547-2018 interconnection standard.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2020

DEEP Solar: Data DrivEn Modeling and Analytics for Enhanced System Layer ImPlementation

Realizing the SETO 2030 mission of reducing solar energy costs to 3-5 c/kWh will require innovative enabling research on effective, cost-efficient integration of local PV within distribution systems. However, the intermittent and variable nature of PVs compels operators to impose conservative hosting capacity constraints. Given the extremely high variability of (intermittent and unpredictable) solar energy generation, relaxing the capacity constraints (which are currently around 15%) and achieving 100% or greater integration of renewables will require a fundamental transformation of the power grid via the utilization of exponentially larger amounts of AMI enabled fine-grained data. To address the challenges in increasing the penetration of renewable energy based DERs, this project envisions an Enhanced System Layer (ESL) at the distribution network level that is reliable, cost-effective and scalable to millions of Distributed Energy Resources (DERs)/devices. This includes developing: 1) Transformative and highly scalable machine learning based predictive analytics tools that plug into distribution system planning and provide real-time situational awareness at the distribution level for short and long-term operational planning. The tools will be built using novel data-driven energy models of millions of active nodes with AMI, 2) Adaptive stochastic analysis and optimization algorithms for real-time grid operations, 3) Dynamic Scenario Analysis using parallel Cloudenabled implementations with < 1 minute computational cycle times.

14 SOLAR ENERGY↗

DOE OSTI2021

An economic assessment of behind-the-meter photovoltaics paired with batteries on the Hawaiian Islands.

Due to natural variability and uncertainty, the ever-increasing penetration of solar generation in Hawaii presents challenges to power grid operators to maintain reliable system operation. Demand response (DR) has the potential to be a cost-effective tool for Hawaii to reach its aggressive renewable energy goals while maintaining the reliability of power grids. The Hawaii Public Utilities Commission has approved the Hawaiian Electric Company's revised portfolio of DR programs. The companies have released a grid services purchase agreement and subscribed an initial tranche of load into their DR programs. This paper presents innovative analytical methods and comprehensive economic assessment for distributed photovoltaics (PV) paired with battery energy storage systems (BESSs) for two new DR programs, including fast frequency response and capacity grid service. Optimal dispatch and sizing methods are proposed for the paired system considering different tariff schedules and PV compensation programs across five islands. It was found that while the best resource configuration and potential economic benefits vary with tariff structure, a BESS paired with PV can be optimally dispatched to generate multiple value streams simultaneously. Compensation from DR programs is an important value stream to help increase the cost-effectiveness of the integrated system.

Battery energy storage system↗

DOE OSTI2024

Custom Accessors: Enabling Scalable Data Ingestion, (Re-)Organization, and Analysis on Distributed Systems

The emerging class of high velocity and high volume data analytic workflows comprise interwoven data ingestion, organization, and processing stages, with ingestion and organization steps often contributing comparable or even higher computational costs than actual processing steps. Since complex workflows consist of a variety of phases that view and use data differently, being able to construct efficient, scalable, distributed data structures (arrays, vectors, sets, maps, and multi-maps) is essential and requires custom methods to extend and shrink containers, analyze and position data, and, maintain globallyconsistent meta-data. In this paper, we propose a novel datastructure access paradigm based on the concept of Accessors. At a high level, accessors are customizable callable objects that can modify the behavior of insert, read, update, and delete operations for distributed containers while preserving atomicity guarantees. Accessors provide a very clean and natural way to implement a variety of programming patterns, e.g., conditional insertion/deletion and cascading computations, which would be otherwise hard (or even impossible) to express in parallel and distributed settings without using locks. We demonstrate the practicality and usefulness of our approach with two representative use cases and study the performance of these applications on a distributed High-Performance Computing system. Our analysis highlights that our proposed abstraction allows for an effective overlapping and concurrent execution of different workflow steps (e.g., data ingestion and analysis), which in a conventional analytics pipeline would execute sequentially, contributing cumulatively to the overall latency.

Castellana, Vito G. [BATTELLE (PACIFIC NW LAB)] (O↗

DOE OSTI2021

Combination of cluster number counts and two-point correlations: validation on mock Dark Energy Survey

ABSTRACT We present a method of combining cluster abundances and large-scale two-point correlations, namely galaxy clustering, galaxy–cluster cross-correlations, cluster autocorrelations, and cluster lensing. This data vector yields comparable cosmological constraints to traditional analyses that rely on small-scale cluster lensing for mass calibration. We use cosmological survey simulations designed to resemble the Dark Energy Survey Year 1 (DES-Y1) data to validate the analytical covariance matrix and the parameter inferences. The posterior distribution from the analysis of simulations is statistically consistent with the absence of systematic biases detectable at the precision of the DES-Y1 experiment. We compare the χ2 values in simulations to their expectation and find no significant difference. The robustness of our results against a variety of systematic effects is verified using a simulated likelihood analysis of DES-Y1-like data vectors. This work presents the first-ever end-to-end validation of a cluster abundance cosmological analysis on galaxy catalogue level simulations.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2020

Analytic stability boundaries for compressional and global Alfvén eigenmodes driven by fast ions. I. Interaction via ordinary and anomalous cyclotron resonances

Conditions for net fast ion drive are derived for beam-driven, sub-cyclotron compressional (CAE) and global (GAE) Alfvén eigenmodes, such as those routinely observed in spherical tokamaks such as NSTX(-U) and MAST. Both co- and counter-propagating CAEs and GAEs are investigated, driven by the ordinary and anomalous Doppler-shifted cyclotron resonance with fast ions. Whereas prior results were restricted to vanishingly narrow distributions in velocity space, broad parameter regimes are identified in this work which enable an analytic treatment for realistic fast ion distributions generated by neutral beam injection. The simple, approximate conditions derived in these regimes for beam distributions of realistic width compare well to the numerical evaluation of the full analytic expressions for fast ion drive. Additionally, previous results in the very narrow beam case are corrected and generalized to retain all terms in ω/ω ci and |k ∥ /k ⊥ |, which are often assumed to be small parameters but can significantly modify the conditions of drive and damping when they are non-negligible. Lastly, favorable agreement is demonstrated between the approximate stability criterion, simulation results, and a large database of NSTX observations of cntr-GAEs.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2021

Anisotropic colloidal interactions & assembly in AC electric fields

In this work, we match experimental and simulated configurations of anisotropic epoxy colloidal particles in high frequency AC electric fields by identifying analytical potentials for dipole-field and dipole-dipole interactions. We report an inverse Monte Carlo simulation algorithm to determine optimal fits of analytical potentials by matching simulated and experimental distribution functions for non-uniform liquid, liquid crystal, and crystal microstructures in varying amplitude electric fields. Two potentials that include accurate particle volume and dimensions along with a concentration dependent prefactor quantitatively capture experimental observations. At low concentrations, an effective ellipsoidal point dipole potential works well, whereas a novel stretched point dipole potential is found to be suitable at all concentrations, field amplitudes, and degrees of ordering. The simplicity, accuracy, and adjustability of the stretched point dipole potential suggest it can be applied to model field mediated microstructures and assembly of systematically varying anisotropic particle shapes.

42 ENGINEERING↗

DOE OSTI2025

Spatially resolved charge-transfer kinetics at the quantum dot–microbe interface using fluorescence lifetime imaging microscopy

Integrating the optoelectronic properties of quantum dots (QDs) with biological enzymatic systems to form microbe-semiconductor biohybrids offers promising prospects for both solar-to-chemical conversion and light-modulated biochemical processes. Developing these nano–bio hybrid systems necessitates a deep understanding of charge-transfer dynamics at the nano–bio interface. Photoexcited carrier transfer from QDs to microbes is driven by complex interactions, with emerging insights into the relevant thermodynamic and kinetic factors. The heterogeneities of both microbes and QD ensembles pose significant challenges in mechanistic understanding, which is critical for designing advanced nano–bio hybrids. We used fluorescence lifetime imaging microscopy to analyze charge transfer between a CdSe QD film andShewanella oneidensismicrobes. We correlated the spatiotemporal fluorescence data with an analytical model. Our analysis revealed two distinct distributions of QD de-excitation pathways. The characteristics of these distributions: 1) a faster transfer rate ( k ¯ E T 1 = 1.5 10 9 s - 1 ), with a lower acceptor number ( N ¯ a 1 = 0.03 ) and 2) a slower transfer rate ( k ¯ E T 2 = 4.1 10 8 s - 1 ) with a higher acceptor number ( N ¯ a 2 = 0.18 ). We assign these distributions to the indirect and direct electron transfer mechanisms, respectively. Our findings demonstrate how spectroscopic imaging can uncover fundamental electron transfer mechanisms at complex interfaces, offering valuable design principles for future nano–bio hybrids.

Science & Technology - Other Topics↗

DOE OSTI2022

Nonadiabatic dissociation of molecular Bose-Einstein condensates: Competition between chemical reactions

Here, we provide a framework to solve generic models describing the dissociation of multiple molecular Bose Einstein condensates in a nonadiabatic regime. The competition between individual chemical reactions can lead to non-trivial dependence on critical components such as path interference and symmetries, thus, affecting the final distribution of atomic population. We find an analytical solution for an illustrative example model involving four atomic modes. When the system parameters satisfy CPT symmetry, where C is charge conjugation, P is parity, and T is time-reversal symmetry, our solution predicts a population imbalance between atomic modes that is exponentially sensitive to system parameters. However, a weakly broken symmetry alters the population in each atomic mode and can reverse the population imbalance. Our solution also demonstrates a strong quantum correlation between atomic modes that leads to the spontaneous production of atoms in a multi-mode squeezed state. Moreover, in our framework, a time-dependent non-Hermitian quantum mechanics naturally manifests which can alternatively be realized experimentally in photonic systems.

74 ATOMIC AND MOLECULAR PHYSICS↗

DOE OSTI2021

Intrusion Detection for Cybersecurity of Power Electronics Dominated Grids: Inverters PQ Set-Points Manipulation

This work provides cybersecurity analytics for a high photovoltaic (PV) penetrated distribution network, representing future power electronics dominated grid (PEDG). Firstly, the impact of active and reactive power (PQ) set-points manipulation on the network is studied. Then, an intrusion detection system (IDS) is developed for identifying the potentially compromised PV inverters in the network. The proposed IDS is based on defining the normal, safe, and abnormal operation regions of the PV inverters from point of view of the steady state voltage stability of the network. These three-operation regions are identified by utilizing active power, reactive power, and voltage (PQV) limits of each specific grid-following inverter in the network. Each grid-following inverter's PQV contour includes the information of network topology, inverter ratings, and inverter controller. The developed PQ limits are integrated into the centralized secondary control layer for realization of the proposed IDS. Furthermore, the proposed secondary control layer is capable of providing remedial actions during an anomaly event to enhance the grid resiliency. The theoretical analyses are verified by several attack scenarios for a network of grid-following inverters.

41 EE - Solar Energy Technologies Office (EE-4S)↗

DOE OSTI2022

A Theory for the Response of Tropical Moist Convection to Mechanical Orographic Forcing

Abstract Spatial patterns of tropical rainfall are strongly influenced by mountains. Although theories for precipitation induced by convectively stable upslope ascent exist for the midlatitudes, these do not represent the interaction of moist convection with orographic forcing. Here, we present a theory for convective precipitation produced by the mechanical interaction of a tropical ridge with a basic-state horizontal wind. Deviations from this basic state are represented as the sum of a “dry” perturbation, due to the stationary orographic gravity wave, and a “moist” perturbation that carries the convective response. The moist component dynamics are subject to the weak temperature gradient approximation; they are forced by the dry mode’s influence on lower-tropospheric moisture and temperature. Analytical solutions provide estimates of the precipitation distribution, including peak precipitation, upstream extent, and rain shadow extent. The theory can be used with several degrees of complexity depending on the technique used to compute the dry mode, which can be drawn from linear mountain wave theory or full numerical simulations. To evaluate the theory, we use a set of convection-permitting simulations with a flow-perpendicular ridge in a long channel. The theory makes a good prediction for the cross-slope precipitation profile, indicating that the organization of convective rain by orography can be quantitatively understood by considering the effect of stationary orographic gravity waves on a lower-tropospheric convective quasi-equilibrium state.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2026

Temporal Coarse Graining for Classical Stochastic Noise in Quantum Systems

Simulations of quantum systems with Hamiltonian classical stochastic noise can be challenging when the noise exhibits temporal correlations over a multitude of time scales, such as for 1/f noise in solid-state quantum information processors. Here we present an approach for simulating Hamiltonian classical stochastic noise that performs temporal coarse-graining by effectively integrating out the high-frequency components of the noise. We focus on the case where the stochastic noise can be expressed as a sum of Ornstein-Uhlenbeck processes. Temporal coarse-graining is then achieved by conditioning the stochastic process on a coarse realization of the noise, expressing the conditioned stochastic process in terms of a sum of smooth, deterministic functions and bridge processes with boundaries fixed at zero, and performing the ensemble average over the bridge processes. For Ornstein-Uhlenbeck processes, the deterministic components capture all dependence on the coarse realization, and the stochastic bridge processes are not only independent but taken from the same distribution with correlators that can be expressed analytically, allowing the associated noise propagators to be precomputed once for all simulations. This combination of noise trajectories on a coarse time grid and ensemble averaging over bridge processes has practical advantages, such as a simple concatenation rule, that we highlight with numerical examples.

Albash, Tameem [Sandia National Lab. (SNL-NM), Alb↗

DOE OSTI2020

Analyzing the Validity of Brazilian Testing Using Digital Image Correlation and Numerical Simulation Techniques

Characterizing the mechanical behavior of rocks plays a crucial role to optimize the fracturing process in unconventional reservoirs. However, due to the intrinsic anisotropy and heterogeneity in unconventional resources, fracture process prediction remains the most significant challenge for sustainable and economic hydrocarbon production. During the deformation tracking under compression, deploying conventional methods (strain gauge, extensometer, etc.) is insufficient to measure the deformation since the physical attachment of the device is restricted to the size of the sample, monitoring limited point-wise deformation, producing difficulties in data retrieval, and a tendency to lose track in failure points, etc. Where conventional methods are limited, the application of digital image correlation (DIC) provides detailed and additional information of strain evolution and fracture patterns under loading. DIC is an image-based optical method that records an object with a camera and monitors the random contrast speckle pattern painted on the facing surface of the specimen. To overcome the existing limitations, this paper presents numerical modeling of Brazilian disc tests under quasi-static conditions to understand the full-field deformation behaviors and finally, it is validated by DIC. As the direct tensile test has limitations in sample preparation and test execution, the Brazilian testing principle is commonly used to evaluate indirectly the tensile strength of rocks. The two-dimensional numerical model was built to predict the stress distribution and full-field deformation on Brazilian disc under compression based on the assumptions of a homogenous, isotropic and linear elastic material. The uniaxial compression test was conducted using the DIC technique to determine the elastic properties of Spider Berea sandstone, which were used as inputs for the simulation model. The model was verified by the analytical solution and compared with the digital image correlation. The numerical simulation results showed that the solutions matched reasonably with the analytical solutions where the maximum deviation of stress distribution was obtained as 14.59%. The strain evolution (normal and shear strains) and displacements along the central horizontal and vertical planes were investigated in three distinguishable percentages of peak loads (20%, 40%, and 90%) to understand the deformation behaviors in rock. The simulation results demonstrated that the strain evolution contours consistently matched with DIC generated contours with a reasonable agreement. The changes in displacement along the central horizontal and vertical planes showed that numerical simulation and DIC generated experimental results were repeatable and matched closely. In terms of validation, Brazilian testing to measure the indirect tensile strength of rocks is still an issue of debate. The numerical model of fracture propagation supported by digital image correlation from this study can be used to explain the fracturing process in the homogeneous material and can be extended to non-homogeneous cases by incorporating heterogeneity, which is essential for rock mechanics field applications.

58 GEOSCIENCES↗

DOE OSTI2024

Proton Shell Gaps in N = 28 Nuclei from the First Complete Spectroscopy Study with FRIB Decay Station Initiator

The first complete measurement of the $β$-decay strength distribution of $_{17}^{45}$Cl 28 was performed at the Facility for Rare Isotope Beams (FRIB) with the FRIB Decay Station Initiator during the second FRIB experiment. The measurement involved the detection of neutrons and $γ$ rays in two focal planes of the FRIB Decay Station Initiator in a single experiment for the first time. This enabled an analytical consistency in extracting the $β$-decay strength distribution over the large range of excitation energies, including neutron unbound states. Here, we observe a rapid increase in the $β$-decay strength distribution above the neutron separation energy in $_{18}^{45}$Ar 27 . This was interpreted to be caused by the transitioning of neutrons into protons excited across the Z = 20 shell gap. The SDPF-MU interaction with reduced shell gap best reproduced the data. The measurement demonstrates a new approach that is sensitive to the proton shell gap in neutron rich nuclei according to SDPF-MU calculations.

39 ≤ A ≤ 58↗

DOE OSTI2024

A variance deconvolution estimator for efficient uncertainty quantification in Monte Carlo radiation transport applications

Monte Carlo simulations are at the heart of many high-fidelity simulations and analyses for radiation transport systems. As is the case with any complex computational model, it is important to propagate sources of input uncertainty and characterize how they affect model output. Unfortunately, uncertainty quantification (UQ) is made difficult by the stochastic variability that Monte Carlo transport solvers introduce. The standard method to avoid corrupting the UQ statistics with the transport solver noise is to increase the number of particle histories, resulting in very high computational costs. In this contribution, we propose and analyze a sampling estimator based on the law of total variance to compute UQ variance even in the presence of residual noise from Monte Carlo transport calculations. Here, we rigorously derive the statistical properties of the new variance estimator, compare its performance to that of the standard method, and demonstrate its use on neutral particle transport model problems involving both attenuation and scattering physics. We illustrate, both analytically and numerically, the estimator’s statistical performance as a function of available computational budget and the distribution of that budget between UQ samples and particle histories. We show analytically and corroborate numerically that the new estimator is unbiased, unlike the standard approach, and is more accurate and precise than the standard estimator for the same computational budget.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2021

Model for nuclear spin product-state distributions of ultracold chemical reactions in magnetic fields

Based on a theoretical model where the nuclear spins remain unchanged during a collision, we provide an analytical and general expression for the nuclear spin state-to-state distribution of an ultracold diatom-diatom chemical reaction in a magnetic field, for given rotational transitions of the molecules. It simply requires knowledge of the field-dependent eigenfunctions of the molecular reactants and products of the chemical reaction. The final state-to-state distribution drastically changes with the magnetic field. When the distribution is summed over all the final products, a simplified expression is found where only the knowledge of the eigenfunctions of the molecular reactants is required. The present theoretical formalism has been successfully used to explain the magnetic field behavior of the product-state distribution in chemical reactions of ultracold KRb molecules [Hu et al., Nat. Chem. 13, 435 (2021)].

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2024

GraphTango: A Hybrid Representation Format for Efficient Streaming Graph Updates and Analysis

Abstract Streaming graph processing performs batched updates and analytics on a time-evolving graph. The underlying representation format of the graph largely determines the throughputs of these updates and analytics phases. Existing representation formats usually employ variations of hash tables or adjacency lists. However, a recent study showed that the adjacency-list-based approaches perform poorly on heavy-tailed graphs, and the hash table-based approaches suffer on short-tailed graphs. We propose GraphTango, a hybrid representation format that provides excellent update and analytics throughput regardless of the graph’s degree distribution. GraphTango dynamically switches among three different formats based on a vertex’s degree: (i) Low-degree vertices store the edges directly with the neighborhood metadata, confining accesses to a single cache line, (2) Medium-degree vertices use adjacency lists, and (3) High-degree vertices use hash tables as well as adjacency lists. In this case, the adjacency list provides fast traversal during the analytics phase, while the hash table provides constant-time lookups during the update phase. We further optimized the performance by designing an open-addressing-based hash table that fully utilizes every fetched cache line. In addition, we developed a thread-local lock-free memory pool that allows fast growing/shrinking of the adjacency lists and hash tables in a multi-threaded environment. We evaluated GraphTango with the help of the SAGA-Bench framework and compared it with four other representation formats: Stinger, Degree-aware Robin Hood Hashing, and two adjacency list-based formats with different workload balancing scheme. On average, GraphTango provides 4.5x higher insertion throughput, 3.2x higher deletion throughput, and 1.1x higher analytics throughput over the next best format. Furthermore, we integrated GraphTango with the state-of-the-art graph processing frameworks DZiG and RisGraph. Compared to the vanilla DZiG and vanilla RisGraph , [ GraphTango + DZiG ] and [ GraphTango + RisGraph ] reduces the average batch processing time by 2.3x and 1.5x, respectively.

Ahmed, Alif↗

DOE OSTI2020

Mapping valence electron distributions with multipole density formalism using 4D-STEM

Recent advancement in aberration correction and detector technology opened a door to various applications using 4D-STEM, which yields a diffraction pattern for each scanning position within a crystal unit-cell in scanning transmission electron microscopy (STEM) and generates incredible amounts of data in momentum space. Currently 4D-STEM analysis relies on the center-of-mass of the diffraction patterns in electric field and charge density mapping. It only derives the total projected charge density and is limited to phase objects, e.g. extremely thin samples. Here, we propose a new analytical method to accurately map aspherical valence electron distributions with atom-centered multipolar functions formalism using the whole 4D-STEM dataset. We demonstrate that, with the full dynamical calculations for various sample thicknesses, the method is sensitive not only to the miniscule charge transfer, but also to the atomic site symmetry and aspherical electron orbitals. The process of the refinement is much more robust and reliable than quantitative convergent beam electron diffraction.

4D-STEM↗