SEARCH · Engineering Papers

Results for “distribution adaptation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 811 records · Page 45

All sources NASA NTRS DOE OSTI

DOE OSTI2024

Multi-level Monte Carlo methods in chemical applications with Lennard-Jones potentials and other landscapes with isolated singularities

We describe and compare outcomes of various Multi-Level Monte Carlo (MLMC) method variants, motivated by the potential of improved computational efficiency over rejection based Monte Carlo, which scales poorly with problem dimension. With an eye toward its application to computational chemical physics, we test MLMC's ability to sample trajectories on two problems — a familiar double-well potential, with known stationary distributions, and a Lennard-Jones solid potential (a Galton Board). By sampling Brownian motion trajectories, we are able to compute expectations of observable averages. These multi-basin potential energy problems capture the essence of the challenges with using MLMC, namely, maintaining correspondence of sample paths as time-resolution is varied. Addressing this challenge properly can lead to MLMC significantly outperforming standard Monte Carlo path sampling. We describe the essence of this problem and suggest strategies that circumvent diverging multilevel sample paths for an important class of problems. In the tests we also compare the computational cost of several, “adaptive,” variants of MLMC. Our results demonstrate that MLMC overcomes the collision, time scale limitation of the more familiar Brownian path MC samplers, and our implementation provides tunable error thresholds, making MLMC a promising candidate for application to larger and more complex molecular systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2024

Geothermal play fairway analysis, part 1: Example from the Snake River Plain, Idaho

The Snake River Plain (SRP) volcanic province overlies the track of the Yellowstone hotspot, a thermal anomaly that extends deep into the mantle. Most of the area is underlain by a basaltic volcanic province that overlies a mid-crustal intrusive complex, which in turn provides the long-term heat flux needed to sustain geothermal systems. Previous studies have identified several known geothermal resource areas within the SRP. For the geothermal study presented herein, our goals were to: (1) adapt the methodology of Play Fairway Analysis (PFA) for geothermal exploration to create a formal basis for its application to geothermal systems, (2) assemble relevant data for the SRP from publicly available and private sources, and (3) build a geothermal PFA model for the SRP and identify the most promising plays, using GIS-based software tools that are standard in the petroleum industry. The study focused on identifying three critical resource parameters for exploitable hydrothermal systems in the SRP: heat source, reservoir and recharge permeability, and cap or seal. Data included in the compilation for heat source were heat flow, distribution and ages of volcanic vents, groundwater temperatures, thermal springs and wells, helium isotope anomalies, and reservoir temperatures estimated using geothermometry. Reservoir and recharge permeability was inferred from the analysis of stress orientations and magnitudes, post-Miocene faults, and subsurface structural lineaments based on magnetics and gravity data. Data for cap or seal included the distribution of impermeable lake sediments and clay-seal associated with hydrothermal alteration below the regional aquifer. These data were used to compile Common Risk Segment maps for heat, permeability, and seal, which were combined to create a Composite Common Risk Segment map for all southern Idaho that reflects the risk associated with geothermal resource exploration and identifies favorable resource tracks. Our regional assessment indicated that undiscovered geothermal resources may be located in several areas of the SRP. Two of these areas, the western SRP and Camas Prairie, were selected for more detailed assessment, during which heat, permeability, and seal were evaluated using newly collected field data and smaller grid parameters to refine the location of potential resources. These higher resolution assessments illustrate the flexibility of our approach over a range of scales.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

MimicGAN: Robust Projection onto Image Manifolds with Corruption Mimicking

In the past few years, Generative Adversarial Networks (GANs) have dramatically advanced our ability to represent and parameterize high-dimensional, non-linear image manifolds. As a result, they have been widely adopted across a variety of applications, ranging from challenging inverse problems like image completion, to problems such as anomaly detection and adversarial defense. A recurring theme in many of these applications is the notion of projecting an image observation onto the manifold that is inferred by the generator. In this context, Projected Gradient Descent (PGD) has been the most popular approach, which essentially optimizes for a latent vector that minimizes the discrepancy between a generated image and the given observation. However, PGD is a brittle optimization technique that fails to identify the right projection (or latent vector) when the observation is corrupted, or perturbed even by a small amount. Such corruptions are common in the real world, for example images in the wild come with unknown crops, rotations, missing pixels, or other kinds of non-linear distributional shifts which break current encoding methods, rendering downstream applications unusable. To address this, we propose corruption mimicking—a new robust projection technique, that utilizes a surrogate network to approximate the unknown corruption directly at test time, without the need for additional supervision or data augmentation. The proposed method is significantly more robust than PGD and other competing methods under a wide variety of corruptions, thereby enabling a more effective use of GANs in real-world applications. Finally, more importantly, we show that our approach produces state-of-the-art performance in several GAN-based applications—anomaly detection, domain adaptation, and adversarial defense, that benefit from an accurate projection.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2026

Long-Range Fit: A Software Package for the Representation and Study of Long-Range Molecular Interactions

Describing intermolecular forces is fundamental to modeling and predicting the behavior of molecular systems. In particular, long-range molecular interactions─with electrostatic, induction, and dispersion as the main components─play a critical role, especially for low-temperature and low-density regimes. Long-range interactions are often described through perturbation theory, representing the electronic charge distribution via a multipolar series of the moments and polarizability tensors corresponding to each molecule. However, while the theory is well established, obtaining the resulting analytical expressions (and their practical implementation) constitutes a highly complex and system-dependent task. To address this challenge, we developed long-range-fit (LRF), an interactive and user-friendly software package designed to automate the generation and fitting of long-range interaction terms for arbitrary molecules in nondegenerate (ground or excited) electronic states. We have derived and implemented all terms up to 15th order, without approximations, via a spherical tensor representation, with symmetry adaptation to all molecular point-group symmetries. The resulting potential energy surface is compatible with most representations of the close interaction region.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2026

Modulating charge transport via 2 MeV He + irradiation in VO 2

Vanadium dioxide (VO 2 ) is of interest for adaptive electronic applications such as neuromorphic neuristor devices and variable emissivity or tunable thermal control materials, thanks to its key property—a metal–insulator transition (MIT) at 68 °C that is accompanied by a dramatic change in electrical and optical properties. To improve performance in these roles, it is critical to develop approaches to engineer transport properties and the MIT behavior. While many documented techniques exist to modulate the MIT and film resistivities via lattice strain and chemical doping, less is known about the effects of ion irradiation on the intrinsic properties of VO 2 , despite the ability to control the spatial distribution of irradiation beams and the prevalence of high energy ion implantation in the semiconductor industry. The impact of irradiation of different acceleration energies on the responses of VO 2 is of specific interest, as charged particle energy generally impacts both the resulting defect profile and corresponding transport behavior. Here, we demonstrate that 2 MeV He ions at equivalent calculated displacements per atom, in two different types of films, can create remarkable changes to the nature of charge transport in VO 2 , especially in the low-temperature insulating phase. Simulation of resulting changes in electrical conductivity reveals that He ion irradiation offers a strategy to increase both oscillation frequency and the signal transmission. These results provide insights into the intentional design of defect populations to modulate transport for neuromorphic VO 2 devices.

Gurrola, Rebeca M. [Texas A & M Univ., College Sta↗

DOE OSTI2021

Consensus International Solar Resource Standards and Best Practices Development

Standardization and best practices of data sets and models enable the industry to develop widely accepted protocols adapted to various stages of solar project development and operations. In collaboration with the International Energy Agency Photovoltaic Power Systems Programme Task 16, the National Renewable Energy Laboratory (NREL) developed and regularly updates the Best Practices Handbook for the Collection and Use of Solar Resource Data for Solar Energy Applications. In collaboration with ASTM's radiometry subcommittee, NREL leads the development of various radiometric standards. These contribute to increased accuracy in the measurement of the solar resource available to conversion systems and boost the development and improvement of radiative models. These models can then provide the long-term geographic or climatic distribution of solar radiation for areas where measured solar data are not available. Further, these standards play a preeminent role in all aspects of solar energy projects, including standard conditions, methods and instrumentation, accelerated testing, and service lifetime of materials.

ASTM↗

DOE OSTI2020

Are You Resilient? Site Energy and Water Resilience Indicators

There is growing interest among operators of individual or co-located facilities to plan for utility disruptions caused by natural hazards and threats. Energy and water resilience at the site level can be characterized as the ability to withstand, adapt, and recover from an energy and/or water supply disruption. But how can a site’s energy and water resilience posture be measured? An evaluation framework with clear performance measures or indicators can help organizations establish what it means to be energy and water resilient and assess progress towards meeting resilience goals across sites and over time. Tracking a consistent set of indicators can help organizations identify problem areas that should be addressed and ascertain if energy and water resilience has improved as a result of investments or operational or policy changes. Resilience indicators also provide a means for organizations with geographically distributed sites to identify common problem areas that may require higher-level attention. This paper outlines an approach that organizations can use to measure site energy and water resilience. This approach was developed by Pacific Northwest National Laboratory for the U.S. Department of Energy’s Federal Energy Management Program as part of an effort to help federal agencies plan for energy and water resilience in a more systematic and rigorous way. The paper defines a general structure for defining energy and water resilience indicators, and provides example indicators and potential rating methods.

resilience, metrics for resilience, site resilienc↗

DOE OSTI2023

Reinforcement Learning-based Output Structured Feedback for Distributed Multi-Area Power System Frequency Control

Load frequency control (LFC) is a key factor to maintain the stable frequency in multi-area power systems. As the modern power systems evolve from centralized to decentralized paradigm, LFC needs to consider the decentralized scheme that considers limited information from the information-exchange graph for the generator control of each interconnected area. This paper aims to solve a data-driven constrained LQR problem with mean-variance risk constraints and output structured feedback, and applies this framework to solve the LFC problem in multi-area power systems. By reformulating the constrained optimization problem into a minimax problem, the stochastic gradient descent max-oracle (SGDmax) algorithm with zero-order policy gradient (ZOPG) is adopted to find the optimal feedback gain from the learning, while guaranteeing the convergence. In addition, to improve the adaptation of the proposed learning method to new or varying models, we construct an emulator grid that approximates the dynamics of a physical grid and performs training based on this model. Once the feedback gain is obtained from the emulator grid, it is applied to the physical grid with a robustness test to check whether the controller from the approximated emulator applies to the actual system. Numerical tests show that the obtained feedback controller can successfully control the frequency of each area, while mitigating the uncertainty from the loads, with reliable robustness that ensures the adaptability of the obtained feedback gain to the actual physical grid.

Kwon, Kyung-bin↗

DOE OSTI2024

Needle bacterial community structure across the species range of limber pine

Abstract Bacteria on and inside leaves can influence forest tree health and resilience. The distribution and limits of a tree species’ range can be influenced by various factors, with biological interactions among the most significant. We investigated the processes shaping the bacterial needle community across the species distribution of limber pine, a widespread Western conifer inhabiting a range of extreme habitats. We tested four hypotheses: (i) Needle community structure varies across sites, with site-specific factors more important to microbial assembly than host species selection; (ii) dispersal limitation structures foliar communities across the range of limber pine; (iii) the relative significance of dispersal and selection differs across sites in the tree species range; and (iv) needle age structures bacterial communities. We characterized needle communities from the needle surface and tissue of limber pine and co-occurring conifers across 16 sites in the limber pine distribution. Our findings confirmed that site characteristics shape the assembly of bacterial communities across the host species range and showed that these patterns are not driven by dispersal limitation. Furthermore, the strength of selection by the host varied by site, possibly due to differences in available microbes. Our study, by focusing on trees in their natural setting, reveals real needle bacterial dynamics in forests, which is key to understanding the balance between stochastic and deterministic processes in shaping forest tree-microbe interactions. Such understanding will be necessary to predict or manipulate these interactions to support forest ecosystem productivity or assist plant migration and adaptation in the face of global change.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2021

Predicting images for the dynamics of stellar clusters ( π-DOC ): a deep learning framework to predict mass, distance, and age of globular clusters

ABSTRACT Dynamical mass estimates of simple systems such as globular clusters (GCs) still suffer from up to a factor of 2 uncertainty. This is primarily due to the oversimplifications of standard dynamical models that often neglect the effects of the long-term evolution of GCs. Here, we introduce a new approach to measure the dynamical properties of GCs, based on the combination of a deep-learning framework and the large amount of data from direct N-body simulations. Our algorithm, π-DOC (Predicting Images for the Dynamics Of stellar Clusters) is composed of two convolutional networks, trained to learn the non-trivial transformation between an observed GC luminosity map and its associated mass distribution, age, and distance. The training set is made of V-band luminosity and mass maps constructed as mock observations from N-body simulations. The tests on π-DOC demonstrate that we can predict the mass distribution with a mean error per pixel of 27 per cent, and the age and distance with an accuracy of 1.5 Gyr and 6 kpc, respectively. In turn, we recover the shape of the mass-to-light profile and its global value with a mean error of 12 per cent, which implies that we efficiently trace mass segregation. A preliminary comparison with observations indicates that our algorithm is able to predict the dynamical properties of GCs within the limits of the training set. These encouraging results demonstrate that our deep-learning framework and its forward modelling approach can offer a rapid and adaptable tool competitive with standard dynamical models.

Chardin, Jonathan↗

DOE OSTI2024

Performance Characterization and Provenance of Distributed Task-based Workflows on HPC Platforms

Understanding performance and provenance of task-based workflows poses significant challenges, particularly in distributed configurations where resources are shared by multiple applications. Task-based workflow management systems further complicate performance predictability because of their dynamicity that subtly alters task execution order from run to run. In this paper we propose a layered characterization framework for performance and task provenance for Dask.distributed workflows running on high-performance computing (HPC) platforms. It collects data from jobs, the workflow management system, and the operating system to aid in understanding the performance of these workflows. Our approach encompasses three main contributions: first, an extension of Dask.distributed to capture high-fidelity task provenance using Mochi data services; second, the adaptation of the established HPC I/O characterization tool Darshan to gather high-fidelity I/O data, thereby enhancing the granularity of our analysis; and third, a framework to combine and process the collected data and provide helpful insights into performance characterization and reproducibility, alongside our lessons learned.

Dask↗

DOE OSTI2026

CORE-BFS: Communication-Optimized REctangular-partitioned BFS Achieving 160.845 TeraTEPS on Frontier Supercomputer

Distributed Breadth-First Search (BFS) is fundamental to many large-scale graph applications, but its performance on parallel systems is often limited by high communication overhead. This paper presents CORE-BFS, an extremely scalable GPU-based BFS implementation that introduces a unique rectangular 2D partitioning-based design for Frontier supercomputer. To further improve performance, we propose four key optimizations: (1) Rectangular 2D-partition specific data formats that use two compressed row and one compressed column status array bitmaps combined with a Double Compressed Sparse Row (DCSR) format per partition, reducing memory footprint and inter-rank traffic; (2) Adaptive frontier & communication strategy that unifies top-down and bottom-up traversal on the rectangular layout, uses lazy synchronization in top-down levels, and switches variants based on frontier size to minimize communication overhead; (3) Frontier-split degree-aware update that maps frontier vertices to thread-centric, wavefront-centric, and block-centric kernels based on their degree to improve GPU utilization and memory coalescing; (4) Row-reduction pipeline that overlaps bottom-up adjacency list processing with row-wise bitmap reduction to hide inter-rank latency. Together, these techniques increase parallelism while reducing memory and communication overhead. On the Graph500 benchmark, CORE - BFS scales up to 9,248 Frontier nodes with scale-42 graphs and reaches 160.845 TTEPS, delivering a 5.42 × speedup over our previous Frontier implementation.

Yang, Haoshen [Rutgers University]↗

DOE OSTI2023

Developing an Evolutionary Baseline Model for Humans: Jointly Inferring Purifying Selection with Population History

Building evolutionarily appropriate baseline models for natural populations is not only important for answering fundamental questions in population genetics—including quantifying the relative contributions of adaptive versus nonadaptive processes—but also essential for identifying candidate loci experiencing relatively rare and episodic forms of selection (e.g., positive or balancing selection). Here, a baseline model was developed for a human population of West African ancestry, the Yoruba, comprising processes constantly operating on the genome (i.e., purifying and background selection, population size changes, recombination rate heterogeneity, and gene conversion). Specifically, to perform joint inference of selective effects with demography, an approximate Bayesian approach was employed that utilizes the decay of background selection effects around functional elements, taking into account genomic architecture. This approach inferred a recent 6-fold population growth together with a distribution of fitness effects that is skewed towards effectively neutral mutations. Importantly, these results further suggest that, although strong and/or frequent recurrent positive selection is inconsistent with observed data, weak to moderate positive selection is consistent but unidentifiable if rare.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2022

A Novel Data Segmentation Method for Data-driven Phase Identification

This paper presents a smart meter phase identification algorithm for two cases: meter-phase-label-known and meter-phase-label-unknown. To improve the identification accuracy, a data segmentation method is proposed to exclude data segments that are collected when the voltage correlation between smart meters on the same phase is weakened. Then, using the selected data segments, a hierarchical clustering method is used to calculate the correlation distances and cluster the smart meters. If the phase labels are unknown, a Connected-Triple-based Similarity (CTS) method is adapted to further improve the phase identification accuracy of the ensemble clustering method. The methods are developed and tested on both synthetic and real feeder data sets. Here, simulation results show that the proposed phase identification algorithm outperforms the state-of-the-art methods in both accuracy and robustness.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2023

Developing Frequency Stability Constraint for Unit Commitment Problem Considering High Penetration of Renewables

As zero-carbon electricity systems become the trend of future grid, the system inertia provided by conventional synchronous generators (SGs) keeps decreasing. The resultant lower system inertia will inevitably cause frequency stability problem, especially in the first few seconds following disturbance. To tackle this challenge, this paper proposes a frequency stability constraint for power systems unit commitment problem by considering the fast frequency responses (FFRs) from inverter-based resources (IBRs). Our developed frequency stability constraint is grounded on an analytical frequency nadir estimation framework that considers both SG and IBR dynamics. The accuracy of our frequency nadir estimation framework is validated by most severe N-1 contingency simulation result in a real island system. Then, the adaptive inertia frequency stability constraint is derived by performing sensitivity analysis with our frequency nadir estimation framework. Finally, we demonstrate the effectiveness of our developed frequency stability constraint with one year day-ahead unit commitment results of the island system.

fast frequency response↗

DOE OSTI2021

Deep Reinforcement Scheduling of Energy Storage Systems for Real-time Voltage Regulation in Unbalanced LV Networks with High PV Penetration

The ever-growing higher penetration of distributed energy resources (DERs) in low-voltage (LV) distribution systems brings both opportunities and challenges to voltage support and regulation. This paper proposes a deep reinforcement learning (DRL)-based scheduling scheme of energy storage systems (ESSs) to mitigate system voltage deviations in unbalanced LV distribution networks. The ESS-based voltage regulation problem is formulated as a multi-stage quadratic stochastic program, with the objective of minimizing the expected total daily voltage regulation cost while satisfying operational constraints. While existing voltage regulation methods are mostly focused on onetime- step control, this paper explores a day-horizon systemwide voltage regulation problem. In other words, the size of action and state spaces are extremely high-dimensional and need to be delicately handled. Furthermore, in order to overcome the difficulty of modeling uncertainties and develop a realtime solution, a learn-to-schedule feedback control framework is proposed by adapting the problem to a model-free DRL setting. The proposed algorithm is tested on a customized 6-bus system and a modified IEEE 34-bus system. Simulation results validate the effectiveness and near-optimality of voltage regulation by ESS in comparison with a deterministic quadratic program solution.

Wang, Shengyi↗

DOE OSTI2024

3D Multiresolution Velocity Model Fusion with Probability Graphical Models

ABSTRACT The variability in spatial resolution of seismic velocity models obtained via tomographic methodologies is attributed to many factors, including inversion strategies, ray-path coverage, and data integrity. Integration of such models, with distinct resolutions, is crucial during the refinement of community models, thereby enhancing the precision of ground-motion simulations. Toward this goal, we introduce the probability graphical model (PGM), combining velocity models with heterogeneous resolutions and nonuniform data point distributions. The PGM integrates data relations across varying resolution subdomains, enhancing detail within low-resolution (LR) domains by utilizing information and prior knowledge from high-resolution (HR) subdomains through a maximum posterior problem. Assessment of efficacy, utilizing both 2D and 3D velocity models—consisting of synthetic checkerboard models and a fault-zone model from Ridgecrest, California—demonstrates noteworthy improvements in accuracy, compared to state-of-the-art fusion techniques. Specifically, we find reductions of 30% and 44% in computed travel-time residuals for 2D and 3D models, respectively, as compared to conventional smoothing techniques. Unlike conventional methods, the PGM’s adaptive weight selection facilitates preserving and learning details from complex, nonuniform HR models and applies the enhancements to the LR background domain.

Geochemistry & Geophysics↗

DOE OSTI2023

STREAM: A Scalable Federated HPC Telemetry Platform

Obtaining and analyzing high performance computing (HPC) telemetry in real time is a complex task that can impact algo- rithmic performance, operating costs, and ultimately scientific outcomes. If your organization operates multiple HPC systems, filesystems, and clusters, telemetry streams can be synthesized in order to ease operational and analytics burden. In order to collect this telemetry, the Oak Ridge Leadership Computing Facility (OLCF) has deployed STREAM (Streaming Telemetry for Resource Events, Analytics, and Monitoring), which is a distributed and high-performance message bus based on Apache Kafka. STREAM collects center-wide performance information and must interface with many sources, including five HPE deployed supercomputers, each with their own Kafka cluster which is managed by HPCM. OLCF Supercomputers and their attached scratch filesystems currently send more than 300 million messages to over 200 topics producing around 1.3 Terabytes per day of telemetry data to STREAM. This paper describes the architectural principles that enable STREAM to be both resilient and highly performant while supporting multiple upstream Kafka clusters and other data sources. It also discusses the design challenges and decisions faced in adapting our existing system- monitoring infrastructure to support the first Exascale computing platform.

Adamson, Ryan↗