Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Benchmark testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

The Opus radiative opacity code, a new implementation of the super-transition array method

This report describes the development of our new radiative opacity code Opus, submitted as part of a 2020 Level 2 milestone requirement. This code aims to incorporate the capabilities in existing but separate opacity codes previously developed at LLNL (Opal, Topaz, and Tycho). The first phase in the development, which was to implement the super-transition (STA) method of Bar-Shalom and co-workers is now completed. In this work, we describe the underlying physics, implementation, usage, and regression testing as well as providing numerical examples for the opacity tables of boron, chromium, iron, and nickel. The latter are benchmarked against the LLNL legacy STA code Tycho, with an average absolute relative difference of ~1.5 and 0.5% for Planck and Rosseland opacity means, respectively. The cases where differences are larger are well understood in terms of numerical instabilities near discontinuities of the average degree of ionization inherent to the assumed opacity/equation-of-state model.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

Electrochemical Behaviors of Bilayer Oxygen Electrode for Reversible Solid Oxide Cells

Reducing the resistances of oxygen reduction reaction (ORR) and oxygen evolution reaction (OER) while retaining the stability of an oxygen electrode, even in the presence of air contaminants such as Cr, H2O and CO2, is of paramount importance to the current commercial development of intermediate-temperature reversible solid oxide cells (IT-RSOCs). In this presentation, a multifunctional, coarsening-resistant, air-contaminants-tolerant and yet ORR/OER-active oxygen electrode (OE) for IT-RSOCs is described. The testing results show that new bilayer OE exhibits a much better ORR/OER activity and stability than the single-layer benchmark LSCF-GDC OE. Remarkably, the new bilayer OE also demonstrates an exceptionally high resistance to Cr-attack, a critical issue to the development of commercial meal-interconnect loaded SOFC/SOEC stacks/systems. Theoretical analysis is also presented to understand the fundamental reasons for the improved ORR/OER activity and stability observed under real-world operating conditions.

Huang, Kevin↗
DOE OSTI2023

classLog: Logistic regression for the classification of genetic sequences

Introduction Sequencing and phylogenetic classification have become a common task in human and animal diagnostic laboratories. It is routine to sequence pathogens to identify genetic variations of diagnostic significance and to use these data in realtime genomic contact tracing and surveillance. Under this paradigm, unprecedented volumes of data are generated that require rapid analysis to provide meaningful inference. Methods We present a machine learning logistic regression pipeline that can assign classifications to genetic sequence data. The pipeline implements an intuitive and customizable approach to developing a trained prediction model that runs in linear time complexity, generating accurate output rapidly, even with incomplete data. Our approach was benchmarked against porcine respiratory and reproductive syndrome virus (PRRSv) and swine H1 influenza A virus (IAV) datasets. Trained classifiers were tested against sequences and simulated datasets that artificially degraded sequence quality at 0, 10, 20, 30, and 40%. Results When applied to a poor-quality sequence data, the classifier achieved between >85% to 95% accuracy for the PRRSv and the swine H1 IAV HA dataset and this increased to near perfect accuracy when using the full dataset. The model also identifies amino acid positions used to determine genetic clade identity through a feature selection ranking within the model. These positions can be mapped onto a maximum-likelihood phylogenetic tree, allowing for the inference of clade defining mutations. Discussion Our approach is implemented as a python package with code available at https://github.com/flu-crew/classLog .

Zeller, Michael A.↗
DOE OSTI2025

RAVEN Template for Dynamic Representativity Analysis of the High Temperature Test Facility

These slides present a walkthrough of the template that has been developed for using RAVEN to perform representativity analysis using models of the High Temperature Test Facility and the General Atomics Modular High Temperature Gas-cooled Reactor. The presentation provides participants in the HTTF benchmark with a walkthrough on how to use RAVEN for their sensitivity analysis and how to read results from the MHTGR-350 to perform representativity

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2020

Recent developments in catalyst-related PEM fuel cell durability

Cost and durability remain the two major barriers to the widespread commercialization of polymer electrolyte membrane fuel cell (PEMFC)-based power systems, especially for the most impactful but challenging fuel cell electric vehicle (FCEV) application. Commercial FCEVs are now on the road; however, their PEMFC systems do not meet the cost targets established by the U.S. Department of Energy, primarily due to the high platinum loading needed on the cathode to achieve the requisite performance and lifetime. Furthermore, while the activities of a number of commercial Pt-based alloy cathode catalysts exceed the beginning-of-life (BOL) targets, these activities, and the overall cathode performance, degrade via a variety of mechanisms described herein. Degradation is mitigated in current FCEVs by utilizing a cathode catalyst with a lower BOL activity (e.g., much lower transition metal alloy content and larger BOL nanoparticle size), necessitating higher catalyst loadings, and through the utilization of system controls that avoid conditions known to exacerbate degradation processes, such as limiting the fuel cell stack voltage range. The design and development of active and robust materials and eliminating the need for vehicle mitigation strategies would greatly simplify the operating system, allowing for greater transient operation, avoiding large hybridization, and curtailing of fuel cell power. Although system mitigation strategies have provided the near-term pathway for FCEV commercialization, material-specific solutions are required to further reduce costs and improve operability and efficiency. Future material developments should focus on stabilization of the electrode structure and minimization of the catalyst particle susceptibility to dissolution caused by oxide formation and reduction over PEMFC cathode-relevant operating potentials plus minimization of support corrosion. Ex situ accelerated stress tests have provided insight into the processes responsible for material and performance degradation and will continue to provide useful information on the relative stability of materials and benchmarks for robust and stable materials-based solutions not requiring system mitigation strategies to achieve adequate lifetime.

25 ENERGY STORAGE↗
DOE OSTI2024

Instrumentation for the In-Core Real-Time Mechanical Testing of Structural Materials (INCREASE) Project

Idaho National Laboratory (INL), in collaboration with the Electric Power Research Institute (EPRI), the Nuclear Regulatory Commission (NRC), the French Atomic and Alternative Energies Commission (CEA), the Joint Research Center (JRC), the Nuclear Research and Consultancy Group (NRG), and the Research Center Rez (CVR), started a Joint Experimental Program (JEEP) project that operates within the Nuclear Energy Agency’s Framework for Irradiation Experiments (FIDES II) program in order to develop capabilities for the in-core real-time mechanical testing of structural materials. This effort will focus on designing a shared capsule capable of housing a variety of in-core mechanical testing instrumentation allowing enhanced experiments for the material science community. The outcome of the project would be high-priority, stress relaxation data for stainless-steel-based materials provided by EPRI and CEA. Stress relaxation is a major phenomenon that contributes to material degradation in nuclear reactor components. Currently, nuclear material stress relaxation is assessed both before and after irradiation, using complex and costly post-irradiation examination (PIE) activities. In-situ data would support the development of precision modeling and simulation of this degradation phenomena and would provide validation and benchmarking for existing models using the PIE data. As part of the U.S. Department of Energy Advanced Sensor and Instrumentation (ASI) program, INL has fabricated and tested out-of-core mechanical test instrumentation. This instrumentation was designed for easy adaptation to the irradiation capsule proposed under this JEEP, and can be deployed to measure real-time stress relaxation under pressurized-water reactor (PWR) conditions. This initial effort will partially serve to replace the testing capabilities lost because of shutting down the Halden Boiling Water Reactor (HBWR). The project would provide these capabilities to the international community via a shared capsule design that is easily adaptable to additional material test reactors. The design features will incorporate expansion to PWR and non-light-water reactor (LWR) environments that will be developed in future work. The capsule and instrumentation will be demonstrated in the Massachusetts Institute of Technology Reactor (MITR) for phase I and the Petten High Flux Reactor (HFR) for phase II irradiations to deliver real-time stress relaxation data on high priority stainless steel structural materials.

36 MATERIALS SCIENCE↗
DOE OSTI2023

The Role of Snowmelt Temporal Pattern in Flood Estimation for a Small Snow‐Dominated Basin in the Sierra Nevada

Abstract Prior research confirmed the substantial bias from using precipitation‐based intensity‐duration‐frequency curves (PREC‐IDF) in design flood estimates and proposed next‐generation IDF curves (NG‐IDF) that represent both rainfall and snow processes in runoff generation. This study improves the NG‐IDF technology for a snow‐dominated test basin in the Sierra Nevada. A well‐validated physics‐based hydrologic model, the Distributed Hydrology Soil Vegetation Model (DHSVM), is used to continuously simulate snowmelt and streamflow that are used as benchmark data sets to systematically assess the NG‐IDF technology. We find that, for the studied small snow‐dominated basin, the use of standard rainfall hyetographs in the NG‐IDF technology leads to substantial underestimation of design floods. Thus, we propose probabilistic hyetographs that can represent unique patterns of events with different underlying mechanisms. For the test basin where flooding events are generated entirely by snowmelt, we develop a hyetograph that characterizes snowmelt temporal patterns, which greatly improves the performance of NG‐IDF technology in design flood estimates. In contrast to the standard rainfall hyetographs characterized by a symmetrically peaked, bell‐shaped curve, the snowmelt hyetograph displays a more rapid rise (i.e., greater intensity) and a distinct diurnal pattern influenced by solar energy input. The results also show that the uncertainty of hyetography plays an important role in design flood estimation and can have important implications for future flood projections.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Modeling Multi-Step Organic Reactions: Can Density Functional Theory Deliver Misleading Chemistry?

Many organic reactions are characterized by a complex mechanism with a variety of transition states and intermediates of different chemical natures. Their correct and accurate theoretical characterization critically depends on the accuracy of the computational method used. In this work, we study a complex ambimodal cycloaddition with five transition states, two intermediates, and three products, and we ask whether density functional theory (DFT) can provide a correct description of this type of complex and multifaceted reaction. Our work fills a gap in that most systematic benchmarks of DFT for chemical reactions have considered much simpler reactions. Our results show that many density functionals not only lead to seriously large errors but also differ from one another in predicting whether the reaction is ambimodal. Only a few of the available functionals provide a balanced description of the complex and multifaceted reactions. The parameters varied in the tested functionals are the ingredients, the treatment of medium-range and nonlocal correlation energy, and the inclusion of Hartree–Fock exchange. Furthermore, these results show a clear need for more benchmarks on the mechanisms of large molecules in complex reactions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Disentangling the gap between pure and mixed-gas performance of thin film composite membranes through improved cell design and testing methods

Testing thin film composite (TFC) membrane coupons at low stage-cuts (≤5%) in a sweep-gas permeation system is a common practice to obtain mixed-gas separation properties for benchmarking performance and making scale-up decisions. However, even under these idealized conditions, mixed-gas permeance and selectivity can be more than 30% lower than their pure-gas values, partially due to concentration polarization, an effect that typically intensifies with increased membrane permeance. This study investigates the effect of cell design on mixed-gas testing using PolyActive TM TFC membranes with pure-gas CO 2 permeance of 1700 – 3100 gas permeance unit (GPU), covering the permeance range of most state-of-the-art CO 2 /N 2 separation membranes. Here, we designed and 3D-printed a counter-current permeation cell with enhanced feed and sweep flow efficiency, resulting in a 33 – 41% increase in mixed-gas CO 2 permeance compared to traditional permeation cells. Furthermore, we compared sweep-gas and vacuum permeation methods using traditional permeation cells, revealing that the latter delivers 41% higher mixed-gas CO 2 permeance, because vacuuming effectively minimizes the downstream concentration polarization. These findings highlight the importance of cell design and permeation apparatus selection in lab-scale mixed-gas testing, with strong implications for module design and process optimization at the industrial scale.

mixed gas performance↗
DOE OSTI2020

Leveraging operational information from wastewater injection wells to evaluate CO 2 injection performance for carbon storage applications in the Appalachian Basin

Abstract Geologic parameters, geophysical logging, injection testing, and operational metrics from wastewater injection wells were integrated to develop a preliminary design of a carbon storage facility in the Appalachian Basin. A scattered group of 10–20 commercial wastewater injection wells dispose off produced water from oil and gas wells in the region, utilizing a sequence of stacked deep saline formations for injection zones. These wastewater injection wells provide practical benchmarks for understanding the feasibility of carbon dioxide (CO 2 ) storage. Geologic models were developed based on characterization data from the wastewater injection wells. Reservoir simulations were calibrated according to injection testing and operational data from the wastewater injection wells. Long‐term operational data on injection flow rates and pressures measured in the wastewater injection wells were especially useful to evaluate the performance of carbon storage applications. The simulations were used to estimate injection pressures, radius of CO 2 saturation, and pressure response for industrial scale CO 2 storage applications. Results were also used to provide a design basis in terms of number of injection wells, well spacing, area of review, injection system components, monitoring plan, and CO 2 pipeline distribution system. The analysis demonstrates that there is sufficient injectivity in the deep saline formations in the west‐central Appalachian Basin to store commercial volumes of anthropogenic CO 2 . The geologic system appears suitable for supporting CO 2 injection rates of 0.5–1.0 million metric tons per year at injection pressures below formation fracture pressure in a single well. The long‐term operational data of wastewater injection wells within the study area suggested a lower permeability‐thickness values than indicated by initial reservoir tests. A workflow for developing realistic permeability values for input into reservoir simulations is presented. © 2020 Society of Chemical Industry and John Wiley & Sons, Ltd.

Valluri, Manoj↗
DOE OSTI2025

Adiabatic quantum support vector machines

Adiabatic quantum computers can solve difficult optimization problems (e.g., the quadratic unconstrained binary optimization problem), and they seem well suited to train machine learning models. In this paper, we describe an adiabatic quantum approach for training support vector machines. We show that the time complexity of our quantum approach is an order of magnitude better than the classical approach. Next, we compare the test accuracy of our quantum approach against a classical approach that uses the Scikit-learn library in Python across five benchmark datasets (Iris, Wisconsin Breast Cancer (WBC), Wine, Digits, and Lambeq). We show that our quantum approach obtains accuracies on par with the classical approach. Finally, we perform a scalability study in which we compute the total training times of the quantum approach and the classical approach with an increasing number of features and an increasing number of data points in the training dataset. In conclusion, our scalability results show that the quantum approach obtains a 3.5–4.5x speedup over the classical approach on datasets with many (millions of) features.

Computational Complexity↗
DOE OSTI2022

Dynamic signatures of electronically nonadiabatic coupling in sodium hydride: a rigorous test for the symmetric quasi-classical model applied to realistic, ab initio electronic states in the adiabatic representation

Sodium hydride (NaH) in the gas phase presents a seemingly simple electronic structure making it a potentially tractable system for the detailed investigation of nonadiabatic molecular dynamics from both computational and experimental standpoints. The single vibrational degree of freedom, as well as the strong nonadiabatic coupling that arises from the excited electronic states taking on considerable ionic character, provides a realistic chemical system to test the accuracy of quasi-classical methods to model population dynamics where the results are directly comparable against quantum mechanical benchmarks. Here, using a simulated pump–probe type experiment, this work presents computational predictions of population transfer through the avoided crossings of NaH via symmetric quasi-classical Meyer–Miller (SQC/MM), Ehrenfest, and exact quantum dynamics on realistic, ab initio potential energy surfaces. The main driving force for population transfer arises from the ground vibrational level of the D 1 Σ + adiabatic state that is embedded in the manifold of near-dissociation C 1 Σ + vibrational states. When coupled through a sharply localized first-order derivative coupling most of the population transfers between t = 15 and t = 30 fs depending on the initially excited vibronic wavepacket. While quantum mechanical effects are expected due to the reduced mass of NaH, predictions of the population dynamics from both the SQC/MM and Ehrenfest models perform remarkably well against the quantum dynamics benchmark. Additionally, an analysis of the vibronic structure in the nonadiabatically coupled regime is presented using a variational eigensolver methodology.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Validation of a Hybrid Domain Overlapping Coupling Between SAM and CFD Against the TALL-3D Transients

The System Thermal Hydraulics (STH) code SAM has been coupled to the Computational Fluid Dynamics (CFD) code Simcenter STAR-CCM+ utilizing a hybrid domain overlapping method with an explicit coupling in time. The coupling aims to extend the STH code’s applicability to scenarios where local momentum and energy transfers are important yet difficult for STH codes to capture, such as three-dimensional (3D) mixing. The coupling method’s numerical stability was verified in the past against two closed-loop configurations, and it was validated against a double T-junction experiment with 3D scalar mixing. In the present work, the coupling method is validated against the TALL-3D STH/CFD coupling benchmark facility. TALL-3D is a three-legged, liquid-metal facility with a large, pool-type enclosure (test section) that exhibits 3D flow effects to be modeled by a CFD code. The rest of the system exhibits approximately 1D behavior well-predicted by an STH code. First, the present STAR-CCM+ CFD model of the 3D test section is validated against experimental data. Then, the SAM-STARCCM+ coupled model is validated against six different TALL-3D steady states, including SAM standalone model results for comparison. Lastly, the SAM-STARCCM+ coupled model is validated against two TALL-3D transients, one exhibiting flow reversal in the test section and one exhibiting nonlinear, Limit Cycle Oscillations (LCO). For the first transient, the SAM-STARCCM+ coupled model properly predicts an increase in the test section’s inlet temperature during flow reversal, and this is not predicted by the SAM standalone model. Following flow reversal, the SAM-STARCCM+ coupled model better-predicts the initial flow recovery and following oscillations as the system approaches a final natural circulation state. For the second transient, no true final steady state is observed due to LCO. Neither the SAM-STARCCM+ coupled model nor the SAM standalone model can perfectly capture the experiment’s changing oscillation frequency during the transient. However, the SAM-STARCCM+ coupled model does reproduce the oscillatory feedback observed in the system. This is a significant achievement as the SAM-STARCCM+ coupled model only uses an explicit coupling in time, as opposed to a semi-implicit coupling. In comparison, previous STH/CFD coupling efforts of the TALL-3D facility required semi-implicit coupling to obtain similar results.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2025

Superconducting Qubits Underground

Superconducting qubit devices are highly sensitive to cosmic ray induced quasiparticle poisoning—a challenge for quantum computing. At Fermilab, we utilize an underground testbed called QUIET that significantly decreases the rate of such events. We employ an open-source toolchain, including Qiskit Metal and the SQuADDs library, for device design and simulation prior to fabrication. We then test these chips in QUIET, which is capable of housing many chips, enabling tests of scalability. This presentation will cover our qubit design approach, fabrication capabilities, and first measurements from qubits deployed in QUIET, benchmarking the new facility.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2022

Comprehensive Evaluation for Protective Coatings: Optical, Electrical, Photoelectrochemical, and Spectroscopic Characterizations

Numerous efficient semiconductors suffer from instability in aqueous electrolytes. Strategies utilizing protective coatings have thus been developed to protect these photoabsorbers against corrosion while synergistically improving charge separation and reaction kinetics. Recently, various photoelectrochemical (PEC) protective coatings have been reported with suitable electronic properties to ensure low charge transport loss and reveal the fundamental photoabsorber efficiency. However, protocols for studying the critical figures of merit for protective coatings have yet to be established. For this reason, we propose four criteria for evaluating the performance of a protective coating for PEC water-splitting: stability, conductivity, optical transparency, and energetic matching. We then propose a flow chart that summarizes the recommended testing protocols for quantifying these four performance metrics. In particular, we lay out the stepwise testing protocols to evaluate the energetics matching at a semiconductor/coating/(catalyst)/liquid interface. Finally, we provide an outlook for the future benchmarking needs for coatings.

36 MATERIALS SCIENCE↗
DOE OSTI2021

EXPERIMENTAL STUDIES OF NONLINEAR INTEGRABLE OPTICS

State-of-the-art accelerators at energy and intensity frontiers require increasingly bright and powerful particle beams. In conventional linear lattices, intense beams suffer from collective instabilities, resulting in beam losses and maximum beam intensity limits. This thesis presents experimental studies of a novel lattice design concept, the nonlinear integrable optics (NIO), aimed at enhancing beam stability limits with little to no beam dynamics degradation. Single-particle beam dynamics measurements of two NIO devices, the quasi-integrable octupole system and the fully integrable Danilov-Nagaitsev system, were carried out at the purpose-built Integrable Optics Test Accelerator (IOTA) at Fermilab. Their simulation, hardware design, and commissioning process are presented. Extensive model and analysis algorithm development and benchmarking is described. Electron beam data from two scientific runs is analyzed, yielding frequency and phase space dynamics consisten t with m odels. These results demonstrate viability and advantages of the NIO design, providing the groundwork for proton studies in the strong space-charge regime and future integrable accelerators.

Kuklev, Nikita↗
DOE OSTI2024

Assessment of the CTF subchannel code for modeling a large-break loss-of-coolant accident reflood transient

With increased industry interest in extending reactor operating cycles, the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program has been investigating the behavior of high-burnup fuel during design basis accidents such as the large-break loss-of-coolant accident (LBLOCA) with consideration for risk of fuel fragmentation, relocation, and dispersal (FFRD). As part of that activity, the NEAMS subchannel thermal/ hydraulics (T/H) code, CTF, is being used for modeling of LBLOCA and to determine the impact of subchannel resolution on results. Although CTF includes a wide range of models for LBLOCA conditions, the code has not been used for this application while maintained at Oak Ridge National Laboratory (ORNL) until now. Therefore, here, in this work, a preliminary assessment of several of these models was performed using openly available reflood experimental data from the Flooding Experiments in Blocked Arrays (FEBA) tests. One coarse mesh and one fine mesh model were set up in CTF for high and low flooding rate tests performed in the unblocked FEBA facility. A coarse TRACE model was set up to be as consistent as possible with the coarse CTF model to allow for code-to-code benchmarking. The assessment shows a tendency of the codes to over-predict peak cladding temperature (PCT) near the top of the bundle and to quench early. Advanced spacer grid models were shown to improve upper bundle predictions in CTF. The resolved CTF model over-predicted PCT by a larger degree in the center channels in the low-flooding rate test, and it is believed that the radiative heat transfer model, which was not used in this study, may be needed to correct this over-prediction. Finally, this work demonstrates the importance of the droplet model in determining quench time and vapor temperature and PCT prediction, which necessitates a more in-depth validation of these models in the future.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2024

Resilient Control of Networked Microgrids Using Vertical Federated Reinforcement Learning: Designs and Real-Time Test-Bed Validations

Improving system-level resiliency of networked microgrids against adversarial cyber-attacks is an important aspect in the current regime of increased inverter-based resources (IBRs). To achieve that, this paper contributes in designing a hierarchical control layer, in conjunction with the existing control layers, resilient to adversarial attack signals. Considering model complexities, unknown dynamical behaviors of IBRs, and privacy issues regarding data sharing in multi-party-owned microgrids, designing such a control layer is non-trivial. Here, to tackle these issues, a novel federated reinforcement learning (Fed-RL) method is proposed. To grasp the interconnected dynamics of networked microgrids, the paper develops Federated Soft Actor-Critic (FedSAC) algorithm following the vertical structure of implementing Fed-RL. Next, utilizing the OpenAI Gym interface, we built a custom set-up in GridLAB-D/HELICS co-simulation platform, named Resilient RL Co-simulation (ResRLCoSIM), to train the RL agents with IEEE 123-bus benchmark comprising 3 interconnected microgrids. Finally, the learned policies in the simulation are transferred to the real-time hardware-in-the-loop (HIL) test-bed developed using the high-fidelity Hypersim platform. Finally, experiments show that the simulator-trained RL controllers achieve desirable performance with the test-bed platform, validating the minimization of the sim-to-real gap.

24 POWER TRANSMISSION AND DISTRIBUTION↗