Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

Multi-Source Data Aggregation and Real-Time Anomaly Classification and Localization in Power Distribution Systems

This paper proposes a real-time anomaly location and classification framework for power distribution systems to simultaneously determine the type of anomaly (i.e., short-circuit fault, cyber attack, DER switching) and its location. The proposed framework employs the data aggregation module to collect the measurement data from multiple field devices operating at different sampling rates, such as protection relays and D-PMUs. The output of the data aggregation is then fed into a multi-task learning-based long-based short-term memory (MTL-LSTM) to classify the type of anomaly and the location in two separate tasks. The proposed MTL-LSTM approach can be utilized in real-time operation in order to distinguish between normal and several anomalous operations and locate the anomaly. The proposed framework is tested on a modified IEEE 33-bus test feeder benchmark that integrates solar generation and energy storage. Furthermore, the results show that the proposed framework can locate and classify anomalies for several operation conditions with more than 96% accuracy. Further experiments highlight the impact of aggregating multiple sources of data on the performance of the proposed model.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Long-Term Stability in Perovskite Solar Cells Through Atomic Layer Deposition of Tin Oxide

Robust contact schemes that boost stability and simplify the production process are needed for perovskite solar cells (PSCs). We codeposited perovskite and hole-selective contact while protecting the perovskite to enable deposition of SnOx/Ag without the use of a fullerene. The SnOx, prepared through atomic layer deposition, serves as a durable inorganic electron transport layer. Tailoring the oxygen vacancy defects in the SnOx layer led to power conversion efficiencies (PCEs) of >25%. Our devices exhibit superior stability over conventional p-i-n PSCs, successfully meeting several benchmark stability tests. They retained >95% PCE after 2000 hours of continuous operation at their maximum power point under simulated AM1.5 illumination at 65degrees C. Additionally, they boast a certified T97 lifetime exceeding 1000 hours.

c60↗

Modeling Large-Scale Slim Fly Networks Using Parallel Discrete-Event Simulation

As supercomputers approach exascale performance, the increased number of processors translates to an increased demand on the underlying network interconnect. We present that the slim fly network topology, a new low-diameter, low-latency, and low-cost interconnection network, is gaining interest as one possible solution for next-generation supercomputing interconnect systems. In this article, we present a high-fidelity slim fly packet-level model leveraging the Rensselaer Optimistic Simulation System (ROSS) and Co-Design of Exascale Storage (CODES) frameworks. We validate the model with published work before scaling the network size up to an unprecedented 1 million compute nodes and confirming that the slim fly observes peak network throughput at extreme scale. In addition to synthetic workloads, we evaluate large-scale slim fly models with real communication workloads from applications in the Design Forward program with over 110,000 MPI processes. We show strong scaling of the slim fly model on an Intel cluster achieving a peak network packet transfer rate of 2.3 million packets per second and processing over 7 billion discrete events using 128 MPI tasks. Enabled by the strong performance capabilities of the model, we perform a detailed application trace and routing protocol performance study. Lastly, through analysis of metrics such as packet latency, hop count, and congestion, we find that the slim fly network is able to leverage simple minimal routing and achieve the same performance as more complex adaptive routing for tested DOE benchmark applications.

97 MATHEMATICS AND COMPUTING↗

Land Ice Verification and Validation Kit

To address a pressing need to better understand the behavior and complex interaction of ice sheets within the global Earth system, significant development of continental-scale, dynamical ice-sheet models is underway. The associated verification and validation process of these models is being coordinated through a new, robust, python-based extensible software package, the Land Ice Verification and Validation toolkit (LIVV). This release provides robust and automated verification and a performance evaluation on LCF platforms. The performance V&V involves a comprehensive comparison of model performance relative to expected behavior on a given computing platform. LIVV operates on a set of benchmark and test data, and provides comparisons for a suite of community prioritized tests, including configuration and parameter variations, bit-4-bit evaluation, and plots of tests where differences occur.

Source record↗

GRIDAPPSD/distopf (33583-E)

DistOPF is an open-source Python package providing a three-phase, asymmetric optimal power flow (OPF) tool specifically designed for distribution systems. The key inventive features include: - Asymmetrical 3-phase OPF modeling for distribution systems with unbalanced phases - Comprehensive control optimization supporting both active (P) and reactive (Q) power control variables - Built-in visualization and validation tools - Standard test system benchmarking platform for algorithm development and comparison - Modular CSV-based input system using Pandas DataFrames for flexible model specification - Standard power distribution model importer enabling direct conversion from CIM and OpenDSS format to optimization-ready models - Multiple solve interface compatibility (PYOMO, CVXPY, SciPy) with automatic solver selection based on problem type

Gray, Nathan [Pacific Northwest National Laborator↗

A Survey of Recent Advances in Transmission Network Switching

Optimal Transmission Switching for electric power networks is a research topic of great interest for both researchers and electric power engineers. Transmission switching is commonly considered a corrective mechanism tool for overloaded networks; however in recent years it has been sought as a means to reduce power loss in the network. Ultimately the objective of this analysis is to provide smart tools for power and economic dispatch planning, allowing utilities and engineers to utilize existing infrastructure as a means of automatic control. The optimization problem is a complex multi-objective search including criteria such as system power loss, equality/non-equality constraints, islanding management, and radial topology configuration in the case of distribution networks. Many optimization methods have been adopted for the transmission switching problem in past years using various heuristic search algorithms. The scope of methodology extends from tried and true methods such as simulated annealing to more modern methods like neural network optimization. Solution benchmarks under consideration commonly include solution state accuracy, computational burden and solution time. The objective of this presentation is to provide a comprehensive account of development in transmission switching methodologies. Benchmarking and testing strategies will be discussed as well as application of the Transmission Expansion Planning Tool in finding transmission switching solutions. Limited Discrepancy Search (LOS) and Probe Discrepancy Search (PDS) Algorithms are compared with more classic optimization strategies, as seen in defining literature and publications in this research field.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Reinvestigation into Closure Predictions of Room D at the Waste Isolation Pilot Plant

Room D was an in-situ, isothermal, underground experiment conducted at theWaste Isolation Pilot Plant between 1984 and 1991. The room was carefully instrumented to measure the horizontal and vertical closure immediately upon excavation and for several years thereafter. Early finite element simulations of salt creep around Room D under predicted the vertical closure by 4.5×, causing investigators to explore a series of changes to the way Room D was modeled. Discrepancies between simulations and measurements were resolved through a series of adjustments to model parameters, which were openly acknowledged in published reports. Interest in Room D has been rekindled recently by the U.S./German Joint Project III and Project WEIMOS, which seek to improve the predictions of rock salt constitutive models. Joint Project participants calibrate their models solely against laboratory tests, and benchmark the models against underground experiments, such as room D. This report describes updating legacy Room D simulations to today’s computational standards by rectifying several numerical issues. Subsequently, the constitutive model used in previous modeling is recalibrated two different ways against a suite of new laboratory creep experiments on salt extracted from the repository horizon of the Waste Isolation Pilot Plant. Simulations with the new, laboratory-based, calibrations under predict Room D vertical closure by 3.1×. A list of potential improvements is discussed.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Reinvestigation into Closure Predictions of Room D at the Waste Isolation Pilot Plant

Room D was an in-situ, isothermal, underground experiment conducted at the Waste Isolation Pilot Plant between 1984 and 1991. The room was carefully instrumented to measure the horizontal and vertical closure immediately upon excavation and for several years thereafter. Early finite element simulations of salt creep around Room D under-predicted the vertical closure by 4.5×, causing investigators to explore a series of changes to the way Room D was modeled. Discrepancies between simulations and measurements were resolved through a series of adjustments to model parameters, which were openly acknowledged in published reports. Interest in Room D has been rekindled recently by the U.S./German Joint Project III and Project WEIMOS, which seek to improve the predictions of rock salt constitutive models. Joint Project participants calibrate their models solely against laboratory tests, and benchmark the models against underground experiments, such as room D. This report describes updating legacy Room D simulations to today’s computational standards by rectifying several numerical issues. Subsequently, the constitutive model used in previous modeling is recalibrated two different ways against a suite of new laboratory creep experiments on salt extracted from the repository horizon of the Waste Isolation Pilot Plant. Simulations with the new, laboratory-based, calibrations under-predict Room D vertical closure by 3.1×. A list of potential improvements is discussed.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

A Numerical Tool for the Design of Enhanced Geothermal Reservoirs based on Modeling of Thermo-Hydro-Mechanical Processes and Explicit Representation of 3D Discrete Fracture Networks

This project has developed a coupled thermo-hydro-mechanical numerical modeling tool for prediction of energy production from Enhanced Geothermal Reservoirs (EGS). The tool is unique because it can explicitly represent thousands of pre-existing natural fractures. The capabilities developed in this project were built on the already existing expertise of Itasca arising from thirty years of research and development in discrete element modeling of fractured rocks. A thermal module suitable for analysis of different heat transfer mechanisms in fractured rocks percolated by fluids was developed and coupled with the already existing hydro-mechanical calculation in 3DEC, a commercial software for analysis of jointed rock based on the discrete element method (DEM). The heat transfer module simulates heat conduction, heat advection by moving fluid in rock fractures, and convective heat exchange at the fracture walls between the rock and the moving fluid. Techniques for spatial discretization of heat transfer in EGS-type problems were evaluated, and a boundary layer meshing approach was developed. Also, given the significant differences in time scale of physical processes involved, temporal integration schemes for coupled advection-diffusion processes and coupled thermal-hydro-mechanical processes were developed by taking advantage of both implicit and explicit time integration and also optimizing the coupling intervals. These improvements were necessary for modeling EGS reservoirs. Also, the DFN capacities in 3DEC were extended to include a larger number of fractures. Research was carried out on approaches to simplify the DFN so that the model can meet computational demands, while preserving thermo-hydro-mechanical characteristics of the DFN. The developed modules were coupled with the already existing capabilities of 3DEC. The results were presented as a submitted conference paper (Riahi et al., 2018a). A series of benchmark and test examples showed the developed capabilities. Finally, the developed tool was tested for a large-scale reservoir model for longer periods of injection and production. The thermal draw-down curves were generated and presented. The project successfully met all the milestones laid out in the proposal. Results demonstrated the feasibility of developing a fast and reliable software for the EGS community to use for assessment and prediction of reservoir performance. Some of its applications include assessment of stimulated volume and produced temperature and power. It can also be used for improved engineering, design and optimization of EGS reservoirs as well as other unconventional resources such as shale gas. Finally, the 3D analysis presented in this study showed that simulating EGS reservoirs with tens of thousands of fractures is feasible, and confirmed that the developed tool can serve toward meeting the goals and objectives of Geothermal Technologies Office in overcoming technical barriers associated with commercial EGS development.

15 GEOTHERMAL ENERGY↗

CMDV (CM)4 Project - University of Washington contribution. Final report

The original goal of this project was to diagnose and improve CLUBB, the turbulence and cloud fraction parameterization used in DOE’s E3SM model. For this purpose, we planned to use large-eddy simulation (LES) and ARM observations from the NE Pacific Ocean and the SGP site, in coordination with ARM’s LASSO program. It was determined that for these cloud regimes, many of the turbulent ‘moment closures’ which underlie CLUBB’s mathematical formulation are inconsistent with LES, which is an appropriate benchmark for testing this. The research assistant found that these closures could be more accurately formulated using machine learning using the LES as a training dataset. However the resulting parameterization proved to quickly drift away from physical plausibility. A novel machine-learning based boundary layer parameterization called MARBLE based on matching the time evolution of a parameterized cloud-topped boundary layer to reanalysis was then developed and published.

54 ENVIRONMENTAL SCIENCES↗

Improving and testing machine learning methods for benchmarking soil carbon dynamics representation of land surface models

Representation of soil organic carbon (SOC) dynamics in Earth system models (ESMs) is a key source of uncertainty in predicting carbon climate feedbacks. The magnitude of this uncertainty can be reduced by accurate representation of environmental controllers of SOC stocks in ESMs. In this study, we used data of environmental factors, field SOC observations, ESM projections and machine learning approaches to identify dominant environmental controllers of SOC stocks and derive functional relationships between environmental factors and SOC stocks. Our derived functional relationships predicted SOC stocks with similar accuracy as the machine learning approach. We used the derived relationships to benchmark the coupled model intercomparison project phase six ESM representation of SOC stocks. We found divergent environmental control representation in ESMs in comparison to field observations. Representation of SOC in ESMs can be improved by including additional environmental factors and representing their functional relationships with SOC consistent with observations.

54 ENVIRONMENTAL SCIENCES↗

On Final Results From the Muon $g\mathrm{-}2$ Experiment at Fermilab

The Muon g-2 Experiment at Fermilab has measured the muon anomalous magnetic moment, a_mu, with unprecedented precision, leveraging a dataset from Runs 1 6 that is 21 times larger than its Brookhaven predecessor. This talk will present the experiment s final result, which serves as a benchmark for testing the Standard Model with high precision. The measurement was performed in a storage ring with a highly uniform magnetic field, where precise beam dynamics understanding is vital to determine the muon anomalous precession frequency. Key to this effort were advanced simulation tools including COSY INFINITY, precise fringe field modeling, and calculations of beam dynamics characteristics like tunes and chromaticity. We will conclude by exploring how the experiment's findings reshape our understanding of particle physics.

Valetov, Eremey [Michigan State U.]↗

K-shell Emission from O vi Near 19 Å

Abstract Laboratory measurements of O vi K-shell emission lines are presented that are situated near the O viii Ly α line at 19 Å. The data provide additional rest-frame references for velocity determinations based on absorption features in the spectra of warm absorbers in active galactic nuclei and other astrophysical objects. They also provide benchmarks for testing atomic structure calculations of energy levels with electrons in a high principal quantum number ( n = 3, 4). Excellent agreement is found with our calculations using the many-body perturbation theory method, and we provide a complete listing of the O vi energy levels calculated with this approach.

Beiersdorfer, Peter (ORCID:000000030127599X)↗

A Parameter-masked Mock Data Challenge for Beyond-two-point Galaxy Clustering Statistics

The past few years have seen the emergence of a wide array of novel techniques for analyzing high-precision data from upcoming galaxy surveys, which aim to extend the statistical analysis of galaxy clustering data beyond the linear regime and the canonical two-point (2pt) statistics. We test and benchmark some of these new techniques in a community data challenge named “Beyond-2pt,” initiated during the Aspen 2022 Summer Program “Large-Scale Structure Cosmology beyond 2-Point Statistics,” whose first round of results we present here. The challenge data set consists of high-precision mock galaxy catalogs for clustering in real space, in redshift space, and on a light cone. Participants in the challenge have developed end-to-end pipelines to analyze mock catalogs and extract unknown (“masked”) cosmological parameters of the underlying ΛCDM models with their methods. The methods represented are density-split clustering, nearest neighbor statistics, BACCO power spectrum emulator, void statistics, LEFTfield field-level inference using effective field theory (EFT), and joint power spectrum and bispectrum analyses using both EFT and simulation-based inference. In this work, we review the results of the challenge, focusing on problems solved, lessons learned, and future research needed to perfect the emerging beyond-2pt approaches. The unbiased parameter recovery demonstrated in this challenge by multiple statistics and the associated modeling and inference frameworks supports the credibility of cosmology constraints from these methods. The challenge data set is publicly available, and we welcome future submissions from methods that are not yet represented.

Krause, Elisabeth [Univ. of Arizona, Tucson, AZ (U↗

SIDM Concerto: Compilation and Data Release of Self-interacting Dark Matter Zoom-in Simulations

We present SIDM Concerto: 14 cosmological zoom-in simulations in cold dark matter (CDM) and self-interacting dark matter (SIDM) models based on the Symphony and Milky Way-est suites. SIDM Concerto includes one Large Magellanic Cloud– (LMC-) mass system (host mass ∼10 11 M ⊙ ), two Milky Way (MW) analogs (∼10 12 M ⊙ ), two group-mass hosts (∼10 13 M ⊙ ), and one low-mass cluster (∼10 14 M ⊙ ). Each host contains ≈2 × 10 7 particles and is run in CDM and one or more strong, velocity-dependent SIDM models. Our analysis of SIDM (sub)halo populations over seven subhalo mass decades reveals that (1) the fraction of core-collapsed isolated halos and subhalos peaks at a maximum circular velocity corresponding to the transition of the SIDM cross section from a v −4 to v 0 scaling; (2) SIDM subhalo mass functions are suppressed by ≈50% relative to CDM in LMC, MW, and group-mass hosts but are consistent with CDM in the low-mass cluster host; (3) subhalos’ inner density profile slopes, which are more diverse in SIDM than in CDM, are sensitive to both the amplitude and shape of the SIDM cross section. Our simulations provide a benchmark for testing SIDM predictions with astrophysical observations of field and satellite galaxies, strong lensing systems, and stellar streams. Data products are publicly available at doi:10.5281/zenodo.14933624.

dark matter↗

Investigation of the \(\gamma \)-ray Properties of the \(2^+\) States in \(^{14}\)C

The properties of the 2$^+_1$ and 2$^+_2$ excited states in 14 C were studied in an experiment conducted at Argonne National Laboratory. A 9 Be( 6 Li,pγ) fusion-evaporation reaction and the GRETINA-ORRUBA setup were employed to populate states of 14 C and detect γ-particle coincidence events. Finally, the precise determination of the 2$^+_1$ level energy, complemented by the estimation of the γ-ray branch of the 2$^+_2$ near-threshold state, will serve as a benchmark to test the Shell Model Embedded in the Continuum calculations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

MC&A System Effectiveness Tool (MSET) (Presentation 2)

MSET is a self-assessment or inspection tool utilizing probabilistic risk assessment (PRA) methodology to calculate the system effectiveness of a nuclear facility's material control and accountability (MC&A) system. MSET analyzes the effectiveness of an MC&A system based on defined performance metrics for MC&A functions defined based on U.S. and international best practices and regulations. MSET analysis is based on performance of the entire MC&A system including defense-in-depth attributes and sensitivity analysis of changes in the system, both positive and negative. MSET analysis considers: accounting; containment; access control; surveillance capabilities of the system; and other interfaces with the physical protection systems that provide detection of an unauthorized action. MSET performs a system effectiveness calculation evaluation against a defined performance metric. MSET uses PRA techniques to analyze the MC&A system. MSET is a tool for evaluating the system effectiveness of MC&A systems during self-assessment or external inspection. MSET has been developed, tested, and benchmarked by the U.S. DOE. In collaboration with the U.S. DOE, Rosatom is developing a Russian version (MSET-R) planned for pilot implementation at select material balance areas in 2011. MSET has been shown to be an effective training and communication tool for MC&A.

99 GENERAL AND MISCELLANEOUS↗