Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,783 records · Page 99

A Comprehensive Comparative Study of Active Learning Schemes for Nanophotonics Design

We present a benchmarking study of active learning (AL) schemes for designing planar multilayer nanophotonic metamaterials, where the design tasks are formulated as binary optimization problems. Different surrogate models, including factorization machine (FM), Gaussian process regression (GPR), and convolutional neural network (CNN), combined with different optimization methods, including exhaustive enumeration, discrete particle swarm optimization (DPSO), quantum annealing (QA), hybrid QA, and simulated annealing are studied. The benchmark cases investigated range from small problems with short binary lengths (N = 25) to large problems with N up to 100, focusing on the design of two classes of photonic structures, including antireflective coatings for the long-wavelength infrared region and transparent radiative coolers. For small problems, CNN coupled with DPSO in AL achieves the best performance. As N increases, FM with QA outperforms GPR and CNN. For FM-based AL, hybrid QA yields the best optimization results, particularly in high-dimensional cases (N = 100). These results demonstrate that the optimization method can significantly affect in AL performance as N increases, and that QA-based optimization can provide practical routes for mitigating the optimization bottleneck in high-dimensional problems.

Jung, Serang [Kyung Hee University, Korea]↗

Open‐Source Anaerobic Digestion Modeling Platform, Anaerobic Digestion Model No. 1 Fast (ADM1F)

An open‐source modeling platform, called Anaerobic Digestion Model No. 1 Fast (ADM1F), is introduced to achieve fast and numerically stable simulations of anaerobic digestion processes. ADM1F is compatible with an iPython interface to facilitate model configuration, simulation, data analysis, and visualization. Faster simulations and more stable results are accomplished by implementing an advanced open‐source library of numerical methods called Portable Extensive Toolkit for Scientific Computation (PETSc) to solve the ADM1 system of equations. Leveraging PETSc, ADM1F can consistently complete a steady‐state simulation under 0.2 s, over 99% faster than a benchmark ADM1 model implemented with MATLAB while achieving agreement of model outputs within 1% of those obtained with the benchmark model. For dynamic simulations, however, ADM1F has a computational speed advantage only when the influent characteristics update more frequently than every 4 h. The ability of ADM1F to be useful as a tool to study anaerobic digestion systems is demonstrated through two example implementations of ADM1F: (1) a two‐phase co‐digestion scenario evaluating the impact of the organic loading rate and the substrate composition on reactor performance and stability, and (2) a conventional digester scenario assessing the effectiveness of recovery strategies after disruptions that led to instability. These examples demonstrate how the high simulation speed and the convenience of the iPython interface allow ADM1F to complete complex analyses within minutes, much faster than computational strategies currently reported in the literature.

anaerobic co-digestion↗

Evaluating integration and performance of containerized climate applications on a Hewlett Packard Enterprise Cray system

Containers have taken over large swaths of cloud computing as the most convenient way of packaging and deploying applications. The features that containers offer for packaging and deploying applications translate to high performance computing (HPC) as well. At The National Oceanic and Atmospheric Administration, containers provide an easy way to build and distribute complex HPC applications, allowing faster collaboration, portability, and experiment computer environment reproducibility amongst the scientific community. The challenge arises when applications rely on message passing interface (MPI). This necessitates investigation into how to properly run these applications with their own unique requirements and produce performance on par with native runs. We investigate the MPI performance for benchmarks and containerized climate models for various containers covering selection of compiler and MPI library combinations from the Cray provided programming environments on the Cray XC supercomputer GAEA. Performance from the benchmarks and the climate models shows that for the most part containerized applications perform on par with the natively built applications when the system optimized Cray MPICH libraries are bound into the container, and the hybrid model containers have poor performance in comparison. We also describe several challenges and our solutions in running these containers, particularly challenges with heterogeneous jobs for the containerized model runs.

Abraham, Subil↗

Speedup of UEDGE Parameter Scans Using Machine-Learning Optimized OpenMP Parallelization and a Continuation Solver

This article presents the OpenMP parallelization of the preconditioning Jacobian assembly and right‐hand side residual evaluation in UEDGE. A continuation algorithm, utilizing the internal NKSOL implicit Jacobian‐Free Newton‐Krylov solver to efficiently scan physical parameters, is also presented. The implemented parallelization reduces the computational time for a benchmark scan run on 32 threads by compared to the serial version when using trained random forest regression models to identify the optimal decomposition of the system of equations. Random forest regression models applied to the UEDGE time‐dependent and continuation solver algorithms did not yield meaningful improvement in computational performance. A benchmark DIII‐D gas injection rate scan in the 0.35–0.75 kA interval, performed on a test cluster using the parallelized code and continuation solver, produced 1066 steady‐state solutions with a 22 s average wall‐clock computational time per steady‐state solution.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Evaluating next-generation intensity–duration–frequency curves for design flood estimates in the snow-dominated western United States

Civil infrastructure such as culverts and bridges are commonly designed using precipitation-based intensity-duration-frequency (PREC-IDF) curves, which assume that the occurrence of precipitation is in the form of rainfall and immediately available for the rainfall-runoff process. In snow-dominated regions, where most winter precipitation occurs as snow that melts during spring to early summer, the use of standard PREC-IDF curves may lead to substantial underestimation of design floods and high failure risk of infrastructure. In this context, we developed next-generation IDF (NG-IDF) curves that characterize the actual water reaching the land surface (i.e., rainfall plus snowmelt) to enhance standard infrastructure design in snow-dominated regions. This study evaluates the performance of NG-IDF curves coupled with U.S. Department of Agriculture Technical Release 55 hydrologic model in estimating design floods for 246 snowy locations in different hydroclimate regimes of the western United States. Design flood estimates from a well-validated continuous simulation using a physics-based hydrologic model, the Distributed Hydrology Soil Vegetation Model (DHSVM), were used as the performance benchmark. Compared with the benchmark estimates, the standard PREC-IDF curves led to substantial errors in design flood estimates while the NG-IDF curves significantly reduced these errors. For example, the averaged error in the 50-year design flood estimates over the 246 locations was reduced from 31% with the use of PREC-IDF curves to 12% with the use of NG-IDF curves. Despite the different model structures, the single-event NG-IDF approach versus the continuous simulation DHSVM did not exhibit statistically significant differences in 91% of the 246 locations for the 50-year design flood estimates. We find this indicates a satisfactory performance of NG-IDF curves to estimate design flow under the conditions tested in the snow-dominated western United States. This article also presents technical suggestions and the limitations of infrastructure design using NG-IDF curves for regulatory agencies and practicing engineers.

54 ENVIRONMENTAL SCIENCES↗

Degradation in Photovoltaic Encapsulant Transmittance: Results of the Second PVQAT TG5 Artificial Weathering Study

The optical degradation of encapsulants from ultraviolet (UV) radiation has historically resulted in a significant loss in performance throughout the life of a photovoltaic (PV) module. International Electrotechnical Commission (IEC) test methods have recently been developed to screen for PV encapsulants prone to loss in optical performance. The present study was performed to benchmark polymeric packaging materials relative to IEC 62788-1-4 (covering the measurement of optical transmittance) and IEC 62788-1-7 (on the durability of transmittance), provide feedback toward improvement of the methods, and develop insight regarding optical degradation. Contemporary materials were examined, including poly(ethylene-co-vinyl acetate) (EVA), thermoplastic polyolefin (TPO), polyolefin elastomer (POE), and polyvinyl butyral (PVB) encapsulants; a poly(ethene-co-tetrafluoroethene)/poly(ethylene terephthalate) (ETFE/PET) transparent backsheet; and a polystyrene (PS) working reference material. The use of silica-, specialty-, and rolled-glass was also compared in laminated coupons. Specimen size was separately examined from 2.5 to 12.5 cm. Weathering was performed with a xenon source, using IEC TS 62788-7-2 methods A2, A3, A4, and A5 (chamber temperature of 55 degrees C, 65 degrees C, 75 degrees C, or 85 degrees C), respectively. Characterizations were made using a UV-visible-near-infrared (UV-VIS-NIR) spectrophotometer (transmittance and reflectance, with and without an integrating sphere), a UV-VIS fluorescence spectrophotometer, a camera, and an optical microscope. Performance was analyzed, including solar weighted transmittance, yellowness index, UV cut-off wavelength, and haze (scattering). Separate Arrhenius analyses were performed to assess retention of transmittance and changes in yellowness index. The activation energy for both characteristics was found to range from 15-80 kJ mol-1, with an average of 48 kJ mol-1, similar to the average of 45 kJ mol-1 identified in the previous international PV Quality Assurance Task Force (PVQAT) Task Group 5 (TG5) study of more traditional encapsulants. The separate degradation modes of discoloration and scattering were distinguished in the encapsulants using a comprehensive spectral characterization. Based on these results, the IEC 62788-1-7 pass/fail criteria of 5% change in transmittance was confirmed to identify a known bad encapsulant.

durability↗

Implementation and Validation of a Generalized Actuator Disk Parameterization for Wind Turbine Simulations Within the FastEddy Model

ABSTRACT Fast and accurate large‐eddy simulation (LES) of the atmospheric boundary layer plays a crucial role in advancing wind energy research. Long‐duration wind farm studies at turbine‐resolving scales have become increasingly important to understand the intricate interactions between large wind farms and the atmospheric boundary layer. However, the prohibitive computational cost of these turbulence‐ and turbine‐resolving simulations has precluded such modeling to be exercised on a regular basis. To that end, we implement and validate the generalized actuator disk (GAD) model in the computationally efficient, graphics processing unit (GPU)–resident, LES model FastEddy. We perform single‐turbine simulations under three atmospheric stabilities (neutral, unstable, and stable) and compare them against observations from the Scaled Wind Farm Technology (SWiFT) facility and other LES codes from the recent Wakebench turbine wake model benchmark. Our idealized LES results agree well with observed wake velocity deficit and downstream recovery across stability regimes. Turbine response in terms of rotational speed, generated power, torque, and thrust coefficient are well predicted across stability regimes and are consistent with the LES results from the benchmark. The FastEddy simulations are found to be at least two orders of magnitude more efficient than the traditional CPU‐based LES models, opening the door for realistic LES simulations of full wind plants as a viable standard practice.

17 WIND ENERGY↗

Automated Integration of Continental-Scale Observations in Near-Real Time for Simulation and Analysis of Biosphere–Atmosphere Interactions

The National Ecological Observatory Network (NEON) is a continental-scale observatory with sites across the US collecting standardized ecological observations that will operate for multiple decades. To maximize the utility of NEON data, we envision edge computing systems that gather, calibrate, aggregate, and ingest measurements in an integrated fashion. Edge systems will employ machine learning methods to cross-calibrate, gap-fill and provision data in near-real time to the NEON Data Portal and to High Performance Computing (HPC) systems, running ensembles of Earth system models (ESMs) that assimilate the data. For the first time gridded EC data products and response functions promise to offset pervasive observational biases through evaluating, benchmarking, optimizing parameters, and training new machine learning parameterizations within ESMs all at the same model-grid scale. Leveraging open-source software for EC data analysis, we are already building software infrastructure for integration of near-real time data streams into the International Land Model Benchmarking (ILAMB) package for use by the wider research community. We will present a perspective on the design and integration of end-to-end infrastructure for data acquisition, edge computing, HPC simulation, analysis, and validation, where Artificial Intelligence (AI) approaches are used throughout the distributed workflow to improve accuracy and computational performance.

Durden, David J.↗

ChatPORT: Fine-Tuned LLM for Easy Code {PORT}ing

Fine-tuning existing LLMs for specialized tasks has become a very attractive alternative due to its low cost and quick development cycle. With many pre-trained LLMs available, it is an increasingly complex task to choose the correct model as the starting point or base model. In this work we discuss ChatPORT - a specialized fine-tuned LLM geared towards providing correctly translated codes from one programming model to another. We evaluate a number of base models and compare and contrast their features and characteristics that make them a viable starting point. In this paper, we focus on the OpenMP offload porting capabilities of ChatPORT. We build our training data using kernels from the Heterogeneous Computing Benchmarks (HeCBench) [12] and the OpenMP Validation and Verification suite [5] to fine-tune the base models. We then test the model using unseen kernels extracted from the HeCBench benchmark suite. Our results show that: (1) not all open LLMs geared towards HPC are aware of programming models like OpenMP, (2) although all base models benefit from fine-tuning they learn differently and produce different correctness rates, (3) depending on the memory size and compute resource available, different base models can be used for fine-tuning without significantly affecting the quality of transpiled code they generate, (4) fine-tuning improved the correctness rate of the LLM by an average of 43.2%, and (5) feedback-based training data further increased the correctness rate by an average of 6% over the LLMs tested.

Pophale, Swaroop [ORNL] (ORCID:0000000185446367)↗

Comparative studies of 2HDMs under the Higgs boson precision measurements

We perform comparative studies for four types of the two Higgs Doublet Models (2HDMs) under the precision measurements of the Standard Model (SM) Higgs observables at the proposed Higgs factories. We explore the discovery potential based on the hypothetical deviations in the precision data for the 2HDMs up to one-loop level. We find 5σ observability from the χ2 fitting in a significant theory parameter space at future Higgs factories. For the Type-I 2HDM, regions with cos(β - α) ≲ -0.1 or cos(β - α) ≳ 0.08 are discoverable at more than 5σ level. For the other three types of 2HDMs, the 5σ region is even bigger: | cos(β - α)| ≳ 0.02 for tan β ~ 1. At small and large values of tan β, the region in cos(β - α) is further tightened. We examine the extent to which the different 2HDM theories may be distinguishable from one to the other at the 95% Confidence Level with four benchmark points as case studies. We show that a large part of the parameter space of the other types of 2HDMs can be distinguished from the benchmark points of the target model. The impacts of loop corrections are found to be significant in certain parameter regions.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

The physics potential of a reactor neutrino experiment with Skipper CCDs: Measuring the weak mixing angle

We analyze in detail the physics potential of an experiment like the one recently proposed by the vIOLETA collaboration: a kilogram-scale Skipper CCD detector deployed 12 meters away from a commercial nuclear reactor core. This experiment would be able to detect coherent elastic neutrino nucleus scattering from reactor neutrinos, capitalizing on the exceptionally low ionization energy threshold of Skipper CCDs. To estimate the physics reach, we elect the measurement of the weak mixing angle as a case study. We choose a realistic benchmark experimental setup and perform variations on this benchmark to understand the role of quenching factor and its systematic uncertainties, background rate and spectral shape, total exposure, and reactor antineutrino flux uncertainty. We take full advantage of the reactor flux measurement of the Daya Bay collaboration to perform a data driven analysis which is, up to a certain extent, independent of the theoretical un- certainties on the reactor antineutrino flux. We show that, under reasonable assumptions, this experimental setup may provide a competitive measurement of the weak mixing angle at few MeV scale with neutrino-nucleus scattering.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Dark scalars and heavy neutral leptons at DarkQuest

The proposed DarkQuest beam dump experiment, a modest upgrade to the existing SeaQuest/SpinQuest experiment, has great potential for uncovering new physics within a dark sector. We explore both the near-term and long-term prospects for observing two distinct, highly-motivated hidden sector benchmark models: heavy neutral leptons and Higgs-mixed scalars. We comprehensively examine the particle production and detector acceptance at DarkQuest, including an updated treatment of meson production, and light scalar production through both bremsstrahlung and gluon-gluon fusion. In both benchmark models, DarkQuest will provide an opportunity to probe previously inaccessible interesting regions of parameter space on a fairly short timescale when compared to other proposed experiments.

79 ASTRONOMY AND ASTROPHYSICS↗

Search for heavy resonances and quantum black holes in eμ, eτ, and μτ final states in proton-proton collisions at $\sqrt{s}$ = 13 TeV

A search is reported for heavy resonances and quantum black holes decaying into eμ, eτ, and μτ final states in proton-proton collision data recorded by the CMS experiment at the CERN LHC during 2016–2018 at $\sqrt{s}$ = 13 TeV, corresponding to an integrated luminosity of 138 fb -1 . The eμ, eτ, and μτ invariant mass spectra are reconstructed, and no evidence is found for physics beyond the standard model. Upper limits are set at 95% confidence level on the product of the cross section and branching fraction for lepton flavor violating signals. Three benchmark signals are studied: resonant τ sneutrino production in R parity violating supersymmetric models, heavy Z' gauge bosons with lepton flavor violating decays, and nonresonant quantum black hole production in models with extra spatial dimensions. Resonant τ sneutrinos are excluded for masses up to 4.2TeV in the eμ channel, 3.7TeV in the eτ channel, and 3.6TeV in the μτ channel. A Z' boson with lepton flavor violating couplings is excluded up to a mass of 5.0TeV in the eμ channel, up to 4.3Te V in the eτ channel, and up to 4.1TeV in the μτ channel. Quantum black holes in the benchmark model are excluded up to the threshold mass of 5.6TeV in the eμ channel, 5.2TeV in the eτ channel, and 5.0TeV in the μτ channel. In addition, model-independent limits are extracted to allow comparisons with other models for the same final states and similar event selection requirements. The results of these searches provide the most stringent limits available from collider experiments for heavy particles that undergo lepton flavor violating decays.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Thermophysical Properties of Liquid Tritium: A Path Integral Monte Carlo Study

Here, we present worm-algorithm, path integral Monte Carlo simulations of bulk liquid tritium. The simulations are benchmarked against empirically known thermophysical properties of liquid deuterium and liquid tritium. Results for the pair correlation function, chemical potential, isothermal compressibility, isochoric heat capacity, and single-particle momentum distributions are reported. Given the benchmark comparisons, our predictions of liquid tritium properties are expected to be accurate to within a few percent. Our simulations unambiguously demonstrate the significance of nuclear quantum effects to the properties of liquid tritium. In particular, under saturated vapor pressure, the average molecular kinetic energy of the liquid is found to be more than 60% higher than the value expected from the classical equipartition theorem.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

A Particle-in-Cell Method for Plasmas with a Generalized Momentum Formulation, Part I: Model Formulation

Here, this paper formulates a new particle-in-cell method for the Vlasov–Maxwell system. Under the Lorenz gauge condition, Maxwell’s equations for the electromagnetic fields can be written as a collection of scalar and vector wave equations. The use of potentials for the fields motivates the adoption of a Hamiltonian formulation for particles that employs the generalized (conjugate) momentum. A notable advantage offered by the Hamiltonian formulation is the elimination of time derivatives in the Lorenz gauge formulation that are required by the standard Newton–Lorentz treatment of the particles. This allows the fields to retain the full time-accuracy guaranteed by the field solver. The resulting updates for particles require only knowledge of the fields and their spatial derivatives. An analytical method for constructing these spatial derivatives is presented that exploits the underlying integral solution used in the field solver for the wave equations. Moreover, these derivatives are demonstrated to converge at the same rate as the fields in both time and space. The Method of Lines Transpose field solver we consider in this work is globally first-order accurate in time and high-order accurate in space (e.g., fourth- and fifth-order) and belongs to a larger class of methods which are unconditionally stable, can address geometry, and leverage $\mathcal {O}(N)$ fast summation methods for efficiency. We demonstrate the method on several well-established benchmark problems on bounded domains, including a plasma sheath as well as a relativistic particle beam. The efficacy of the proposed formulation is established by comparing with a second-order accurate finite-difference time-domain method that employs a leapfrog time advance for particles and a charge conserving map suitable for bounded domains. The new method shows mesh-independent numerical heating properties even in cases where the plasma Debye length is smaller than the grid spacing. This is an important feature of the new method for problems defined on bounded domains, because it permits the use of coarser grids in space in the representation of the fields. Such a capability has significant implications for the simulation of plasmas in bounded domains with complex geometry, where the ratio between the largest and smallest cells can vary significantly. The use of high-order spatial approximations in the new method also means that fewer grid points are required in order to achieve a fixed accuracy. Our results also suggest that the new method can be used with fewer simulation particles per cell compared to the benchmark explicit method, which permits further computational savings.

97 MATHEMATICS AND COMPUTING↗

Voronoi Meshing to Accurately Capture Geological Structure in Subsurface Simulations

Mesh generation lies at the interface of geological modeling and reservoir simulation. Highly skewed or very small grid cells may be necessary to accurately capture the geometry of geological features, but the resulting poorly scaled or small grid cells can have a substantial negative impact on simulator accuracy and speed. One way to minimize numerical errors caused by gridding complex structures is to simulate on high-quality Voronoi meshes, which reduce grid orientation effects in fluid flow. This work presents a complete methodology to create Voronoi simulation grids, model fluid flow in complex geological systems, and visualize the results. A recently developed Voronoi meshing method that can automatically generate provably good unstructured meshes that conform to input surfaces creating closed volumes is used. Initially an analytical benchmark simulation is presented to validate the quality of the meshes and simulation results and demonstrate the superiority of simulation results using Voronoi meshes over flexed-hexahedral meshes on a domain with internal features. Next, meshes are created for test structures representing four of the most common geological features in the subsurface: layering, pinch-out, an interior lens that tapers to zero thickness on all sides and a fault with offset. Two benchmark flow simulations are run for each test structure. Finally, a realistic geological example for CO 2 injection into an anticline is simulated. Three realizations of the Voronoi mesh at the same resolution are generated for the simulations. Each mesh is highly refined near the injection wells and coarse in areas of less interest. These three meshes are used to model the CO 2 plume in the subsurface as it migrates to the top of the structure and then fills downward. Simulations on the meshes with randomly generated elements inside the input volumes each give slightly different fingering patterns for the viscous-unstable buoyant gas flow. The results presented in this work show a promising step towards utilizing fully automated Voronoi meshing for subsurface flow simulations in complex geology.

58 GEOSCIENCES↗

Error-mitigated data-driven circuit learning on noisy quantum hardware

Application-level benchmarks measure how well a quantum device performs meaningful calculations. In the case of parameterized circuit training, the computational task is the preparation of a target quantum state via optimization over a loss landscape. This is complicated by various sources of noise, fixed hardware connectivity, and generative modeling, the choice of target distribution. Gradient-based training has become a useful benchmarking task for noisy intermediate-scale quantum computers because of the additional requirement that the optimization step uses the quantum device to estimate the loss function gradient. In this work, we use gradient-based data-driven circuit learning to qualitatively evaluate the performance of several superconducting platform devices and present results that show how error mitigation can improve the training of quantum circuit Born machines with 28 tunable parameters.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Robust implementation of generative modeling with parametrized quantum circuits

Although the performance of hybrid quantum-classical algorithms is highly dependent on the selection of the classical optimizer and the circuit ansätze, a robust and thorough assessment on-hardware of such features has been missing to date. From the optimizer perspective, the primary challenge lies in the solver’s stochastic nature, and their significant variance over the random initialization. Therefore, a robust comparison requires one to perform several training curves for each solver before one can reach conclusions about their typical performance. Since each of the training curves requires the execution of thousands of quantum circuits in the quantum computer, such a robust study remained a steep challenge for most hybrid platforms available today. In this work, we leverage on Rigetti’s Quantum Cloud Services (QCS™) to overcome this implementation barrier, and we study the on-hardware performance of the data-driven quantum circuit learning (DDQCL) for three different state-of-the-art classical solvers, and on two-different circuit ansätze associated to different entangling connectivity graphs for the same task. Additionally, we assess the gains in performance from varying circuit depths. To evaluate the typical performance associated with each of these settings in this benchmark study, we use at least five independent runs of DDQCL towards the generation of quantum generative models capable of capturing the patterns of the canonical Bars and Stripes dataset. In this experimental benchmarking, the gradient-free optimization algorithms show an outstanding performance compared to the gradient-based solver. In particular, one of them had better performance when handling the unavoidable noisy objective function to be minimized under experimental conditions.

97 MATHEMATICS AND COMPUTING↗