Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Validated Models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Ignition Delay Times and Chemical Kinetic Model Validation for Hydrogen and Ammonia Blending With Natural Gas at Gas Turbine Relevant Conditions

Ignition delay times from undiluted mixtures of natural gas (NG)/H 2 /Air and NG/NH 3 /Air were measured using a high-pressure shock tube at the University of Central Florida. The combustion temperatures were experimentally tested between 1000 and 1500 K near a constant pressure of 25 bar. As mentioned, mixtures were kept undiluted to replicate the same chemistry pathways seen in gas turbine combustion chambers. Recorded combustion pressures exceeded 200 bar due to the large energy release, hence why these were performed at the high-pressure shock tube facility. The data are compared to the predictions of the NUIGMech 1.1 mechanism for chemical kinetic model validation and refinement. An exceptional agreement was shown for stoichiometric conditions in all cases but strayed at lean and rich equivalence ratios, especially in the lower temperature regime of H 2 addition and all temperature ranges of the baseline NG mixture. Hydrogen addition also decreased ignition delay times by nearly 90%, while NH 3 fuel addition made no noticeable difference in ignition time. NG/NH 3 exhibited similar chemistry to pure NG under the same conditions, which is shown in a sensitivity analysis. Here, the reaction CH 3 + O 2 = CH 3 O + O is identified and suggested as a possible modification target to improve model performance. Increasing the robustness of chemical kinetic models via experimental validation will directly aid in designing next-generation combustion chambers for use in gas turbines, which in turn will greatly lower global emissions and reduce greenhouse effects.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2024

A comparison of model validation approaches for echo state networks using climate model replicates

As global temperatures continue to rise, climate mitigation strategies such as stratospheric aerosol injections (SAI) are increasingly discussed, but the downstream effects of these strategies are not well understood. As such, there is interest in developing statistical methods to quantify the evolution of climate variable relationships during the time period surrounding an SAI. Feature importance applied to echo state network (ESN) models has been proposed as a way to understand the effects of SAI using a data-driven model. This approach depends on the ESN fitting the data well. If not, the feature importance may place importance on features that are not representative of the underlying relationships. Typically, time series prediction models such as ESNs are assessed using out-of-sample performance metrics that divide the times series into separate training and testing sets. However, this model assessment approach is geared towards forecasting applications and not scenarios such as the motivating SAI example where the objective is using a data driven model to capture variable relationships. Here, in this paper, we demonstrate a novel use of climate model replicates to investigate the applicability of the commonly used repeated hold-out model assessment approach for the SAI application. Simulations of an SAI are generated using a simplified climate model, and different initialization conditions are used to provide independent training and testing sets containing the same SAI event. The climate model replicates enable out-of-sample measures of model performance, which are compared to the single time series hold-out validation approach. For our case study, it is found that the repeated hold-out sample performance is comparable, but conservative, to the replicate out-of-sample performance when the training set contains enough time after the aerosol injection.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Hydrogen and Ammonia Blending With Natural Gas: Ignition Delay Times and Chemical Kinetic Model Validation at Gas Turbine Relevant Conditions

Abstract Ignition delay times from undiluted mixtures of natural gas (NG)/H2/Air and NG/NH3/Air were measured using a high-pressure shock tube at the University of Central Florida. The combustion temperatures were experimentally tested between 1000–1500 K near a constant pressure of 25 bar. As mentioned, mixtures were kept undiluted to replicate the same chemistry pathways seen in gas turbine combustion chambers. Recorded combustion pressures exceeded 200 bar due to the large energy release, hence why these were performed at the high-pressure shock tube facility. The data is compared to the predictions of the NUIGMech 1.1 mechanism for chemical kinetic model validation and refinement. An exceptional agreement was shown for stoichiometric conditions in all cases but strayed at lean and rich equivalence ratios, especially in the lower temperature regime of H2 addition and all temperature ranges of the baseline NG mixture. Hydrogen addition also decreased ignition delay times by nearly 90%, while NH3 fuel addition made no noticeable difference in ignition time. NG/NH3 exhibited similar chemistry to pure NG under the same conditions, which is shown in a sensitivity analysis. The reaction CH3 + O2 = CH3O + O is identified and suggested as a possible modification target to improve model performance. Increasing the robustness of chemical kinetic models via experimental validation will directly aid in designing next-generation combustion chambers for use in gas turbines, which in turn will greatly lower global emissions and reduce greenhouse effects.

Pierro, Michael↗
DOE OSTI2022

Overview of the TJ-II stellarator research programme towards model validation in fusion plasmas

TJ-II stellarator results on modelling and validation of plasma flow asymmetries due to on-surface potential variations, plasma fuelling physics, Alfvén eigenmodes (AEs) control and stability, the interplay between turbulence and neoclassical (NC) mechanisms and liquid metals are reported. Regarding the validation of the neoclassically predicted potential asymmetries, its impact on the radial electric field along the flux surface has been successfully validated against Doppler reflectometry measurements. Research on the physics and modelling of plasma core fuelling with pellets and tracer encapsulated solid pellet injection has shown that, although post-injection particle radial redistributions can be understood qualitatively from NC mechanisms, turbulence and fluctuations are strongly affected during the ablation process. Advanced analysis tools based on transfer entropy have shown that radial electric fields do not only affect the radial turbulence correlation length but are also capable of reducing the propagation of turbulence from the edge into the scrape-off layer. Direct experimental observation of long range correlated structures show that zonal flow structures are ubiquitous in the whole plasma cross-section in the TJ-II stellarator. Alfvénic activity control strategies using ECRH and ECCD as well as the relation between zonal structures and AEs are reported. Finally, the behaviour of liquid metals exposed to hot and cold plasmas in a capillary porous system container was investigated.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2021

ACCRUE—An Integral Index for Measuring Experimental Relevance in Support of Neutronic Model Validation

A key challenge for the introduction of any design changes, e.g., advanced fuel concepts, first-of-a-kind nuclear reactor designs, etc., is the cost of the associated experiments, which are required by law to validate the use of computer models for the various stages, starting from conceptual design, to deployment, licensing, operation, and safety. To achieve that, a criterion is needed to decide on whether a given experiment, past or planned, is relevant to the application of interest. This allows the analyst to select the best experiments for the given application leading to the highest measures of confidence for the computer model predictions. The state-of-the-art methods rely on the concept of similarity or representativity, which is a linear Gaussian-based inner-product metric measuring the angle—as weighted by a prior model parameters covariance matrix—between two gradients, one representing the application and the other a single validation experiment. This manuscript emphasizes the concept of experimental relevance which extends the basic similarity index to account for the value accrued from past experiments and the associated experimental uncertainties, both currently missing from the extant similarity methods. Accounting for multiple experiments is key to the overall experimental cost reduction by prescreening for redundant information from multiple equally-relevant experiments as measured by the basic similarity index. Accounting for experimental uncertainties is also important as it allows one to select between two different experimental setups, thus providing for a quantitative basis for sensor selection and optimization. The proposed metric is denoted by ACCRUE, short for Accumulative Correlation Coefficient for Relevance of Uncertainties in Experimental validation. Using a number of criticality experiments for highly enriched fast metal systems and low enriched thermal compound systems with accident tolerant fuel concept, the manuscript will compare the performance of the ACCRUE and basic similarity indices for prioritizing the relevance of a group of experiments to the given application.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Adaptive Protection and Validated Models to Enable Deployment of High Penetrations of Solar PV (PV-MOD)

The availability and validation of various PV models in commercial tools differ, with some models not yet thoroughly validated for advanced inverter functionalities and reliable performance under weak system conditions. Many existing models do not fully incorporate new inverter control functions, which can affect system stability. The increasing deployment of solar PV and other inverter-based resources (IBRs), including distributed energy resources (DERs), is influencing the reliable operation of protection schemes in distribution systems and microgrids. Emerging adaptive protection schemes (APS) offer new opportunities for protecting these systems during varying configurations and DER operating conditions, though their demonstration and validation remain limited. Adaptive protection schemes face similar challenges, as they are typically designed for specific configurations. There is a growing need for tools and methodologies to streamline the deployment of adaptive protection for safe and reliable DER integration. The project main objective was to develop and validate high-fidelity generic models of solar PV facilities for stability, protection, EMT, and QSTS analyses. This objective was achieved, and these models can now be integrated into commercial software tools, enabling utilities, vendors, and developers to study high-penetration PV systems more confidently. The project also demonstrated advanced applications of these models, including the design and deployment of adaptive protection schemes in high-penetration field applications and microgrids, supporting grid safety and reliability. Several milestones were reached by the end of the project. A sophisticated inverter test plan was developed, and inverters representative of the North American marketplace were selected. EPRI and NREL tested various inverters, conforming to IEEE standards. Improvements were made to existing generic models of IBR units, IBR plants, and aggregated feeders for various analyses. The first generic electromagnetic transient (EMT) model for a solar PV plant was developed, conforming to IEEE Std 2800™-2022 and validated against laboratory measurements of a 2.2 MVA large-scale battery energy storage system (BESS) inverter. That model was then used to produce reference responses illustrating examples of validated and verified IBR plant models that pass or fail tests for technical minimum capability and performance as specified in the IEEE standard. The developed, tested, and validated generic models can be used for transmission planning, stability assessments, expansion planning, and evaluating potential future IBR interconnection requirements. They can also support interconnection screens and conformity assessments of IBR plants, including solar PV. The project significantly contributed to the ongoing standardization and model-based representation and verification of IBR responses. The project further addressed challenges of common distribution protection schemes with increasing deployment of DER by developing, validating, and demonstrating adaptive protection schemes (APS) that can improve the reliable and safe integration of DER into distribution systems. New APS were designed using improved DER models for three common distribution systems: a radial feeder, a meshed network, and a microgrid. Modeling and hardware-in-the-loop (HIL) testing of the APS were conducted, successfully showing their effectiveness and selectivity. Proof-of-concept field demonstration was achieved for two APS, i.e., one on a radial feeder and another one in a microgrid. Field demonstration could not be achieved for the APS on a meshed network, primarily due apprehension of one utility partner and also due to limited access to the protective algorithms in the network protectors. Guidelines developed from the lessons learned in the project lay out the general process followed in the design, installation, and commissioning of APS for various distribution systems. Distribution utility partners’ apprehension about field demonstration of the new APS were addressed—with varying success—by taking a stepped risk-management approach of modeling of a wide range of sensitivities first, performing in-depth proof-of-concept testing in the laboratory including HIL next, and finally deliberately implementing and commissioning the actual protection equipment and algorithms into parts of—or in parallel operation to—the three real distribution systems. Future work should include pilot projects that further show the acceptable performance of the developed APS before these schemes be rolled out more widely. Inclusion of both utility and original equipment manufacturers (OEMs) in future projects could increase chances of successful field demonstration. Despite challenges in achieving the field demonstration goal of the project for all three APS, the research significantly contributed to the innovation of adaptive protection solutions for scalable and reliable DER integration into distribution systems. This project significantly enhances the understanding of the impact of using appropriate inverter models on distribution and transmission (T&D) systems. By addressing the limitations of existing generic models, the project introduces high-fidelity models for stability, protection, electromagnetic transient (EMT), and quasi-static time series (QSTS) analyses. These models, integrated into commercial software tools, enable utilities, vendors, and developers to confidently study high-penetration PV systems. The project also demonstrates advanced applications, including adaptive protection schemes (APS) for distribution systems and microgrids, ensuring grid safety and reliability. The technical effectiveness and economic feasibility of the methods are evident through the development and validation of sophisticated inverter test plans and the selection of representative inverters. Testing by EPRI and NREL on retail, commercial, and utility-scale inverters, conforming to IEEE standards, underscores the robustness of the models. Improvements to existing generic models for various analyses further enhance their validity and applicability. The project also identifies gaps in common distribution protection schemes and designed new APS using improved DER models, demonstrating their effectiveness through modeling and hardware-in-the-loop (HIL) testing. The project’s benefits to the public are manifold. By advancing the standardization and model-based representation of IBR response, it supports transmission planning, stability assessments, and future IBR interconnection requirements. The generic models can facilitate better communication between transmission planners and developers, supporting expected IBR plant capability and performance. Additionally, the development of APS for radial feeders, meshed networks, and microgrids supports the integration of distributed energy resources (DERs) into distribution systems, enhancing grid reliability and safety. The project’s emphasis on thorough testing and simplicity in design ensures practical and scalable solutions for DER integration.

14 SOLAR ENERGY↗
DOE OSTI2023

Physics model validation of propane and methane for Hydrogen Plus Other Alternative Fuels Risk Assessment Models (HyRAM+)

HyRAM+ is a toolkit that includes fast-running models for the unconstrained (i.e., no wall interactions) dispersion and flames for non-premixed fuels. The models were developed for use with hydrogen, but the toolkit was expanded to include propane and methane in a recent release. Here, in this work we validate the dispersion and flame models for these additional fuels, based on reported literature data. The validation efforts spanned a range of release conditions, from subsonic to underexpanded jets and flames for a range of mass flow rates. In general, the dispersion model works well for both propane and methane although the width of the jet/plume is predicted to be wider than observed in some cases. The flame model tends to over-predict the induced buoyancy for low-momentum flames, while the radiative heat flux agrees with the experimental data reasonably well, for both fuels. The models could be improved but give acceptable predictions for propane and methane behavior for the purposes of risk assessment.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2023

Development of a wind turbine model and simulation platform using an acausal approach: Multiphysics modeling, validation, and control

This article presents the development of the Control-oriented, Reconfigurable, and Acausal Floating Turbine Simulator (CRAFTS). CRAFTS has a modular, hierarchical model architecture that enables rapid and accurate simulation of wind turbines. The architecture facilitates the incorporation of model variants, and its system reconfiguration features help simulate multiple design variants. CRAFTS also supports the integration of models developed on a causality-free platform (e.g., Modelica®) with existing causal models. This article focuses on the validation of a land-based wind turbine models against OpenFAST, an industry-standard platform, for several test cases. Closed-loop scenarios are also tested using the standard ROSCO controller and compared against OpenFAST. In addition, a nonlinear controller developed in our prior work is also evaluated. The test cases demonstrate the user-friendly and computationally efficient capabilities of CRAFTS to facilitate control co-design, assist in incorporating multiphysics models, be adaptable to design variants, and allow for rapid simulations to validate models and evaluate controllers.

17 WIND ENERGY↗
DOE OSTI2021

TEAMER - AquaHarmonics High Fidelity WEC Sim PTO and Control Model Validation, Test Logs and Results

Collaborative effort between AquaHarmonics, Sandia National Laboratories (SNL), and the National Renewable Energy Laboratory (NREL) to revise and validate Aquaharmonics' full wave to wire model, allowing for reduced uncertainty and increased understanding of design requirements of a utility scale wave energy converter (WEC). SNL and NREL in collaboration with AquaHarmonics, will set up and run WEC Simulator (WEC-Sim) models of the AquaHarmonics WEC, building off past model developments for inclusion of custom PTO (power take-off) dynamics. The intent is to review, update, and verify or validate a new WEC-Sim model against wave tank experimental data. Furthermore, the WEC-Sim model will be coupled to an energy storage system model to better understand the wave-to-wire functionality. This data set is described in the "Test Log" excel file. Please refer to that document for details on each specific test date/time, constraint parameters and model hardware setup details. Sim model can be found in the associated MHKDR link below.

16 TIDAL AND WAVE POWER↗
DOE OSTI2024

Selection and Ranking of Experiments from the Halden Database in support of Multiscale Model Validation

Validating fuel performance codes, such as BISON, requires an extensive amount of experiments covering a wide range of operating conditions and fuel types. Within the light-water reactor (LWR) space, there have been several international experimental programs that have contributed to the wealth of available experimental data available for use. One of those international programs, the Halden Reactor Project (HRP), began in 1958 and utilized the Halden Boiling Water Reactor to conduct many highly instrumented experiments until the reactor closed in 2018. Idaho National Laboratory, through the U.S. Department of Energy, has utilized several Halden experiments to perform the initial validation of the BISON code based upon their inclusion in international modeling and simulation benchmarks. Recently, the HRP has provided member organizations a complete copy of all available data, reports, and presentations since the HRP began. This report provides an initial exploration of the data available in the database for use in validating the multiscale models under development in the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program for LWR applications. Ranking tables that identify potential validation cases are provided for the high priority models of interest. It was found that some of the recommended high priority experiments correspond to additional rods in existing assemblies already available in the BISON validation suite. It is expected that several of these cases will be incorporated into future NEAMS milestones in the fuels technical area for increased validation of BISON.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2025

Model validation and error attribution for a drifting qubit

Qubit performance is often reported in terms of a variety of single-value metrics, each providing a facet of the underlying noise mechanism limiting performance. However, the value of these metrics may drift over long timescales, and reporting a single number for qubit performance fails to account for the low-frequency noise processes that give rise to this drift. Here, in this work, we demonstrate how we can use the distribution of these values to validate or invalidate candidate noise models. We focus on the case of randomized benchmarking (RB), where typically a single error rate is reported but this error rate can drift over time when multiple passes of RB are performed. We show that using a statistical test as simple as the Kolmogorov-Smirnov statistic on the distribution of RB error rates can be used to rule out noise models, assuming the experiment is performed over a long enough time interval to capture relevant low frequency noise. With confidence in a noise model, we show how care must be exercised when performing error attribution using the distribution of drifting RB error rate.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2023

The executive disruption model of tinnitus distress: Model validation in two independent datasets using factor score regression

This study presents the executive disruption model (EDM) of tinnitus distress and subsequently validates it statistically using two independent datasets (the Construction Dataset: n = 96 and the Validation Dataset: n = 200). The conceptual EDM was first operationalised as a structural causal model (construction phase). Then multiple regression was used to examine the effect of executive functioning on tinnitus-related distress (validation phase), adjusting for the additional contributions of hearing threshold and psychological distress. For both datasets, executive functioning negatively predicted tinnitus distress score by a similar amount (the Construction Dataset: β = −3.50, p = 0.13 and the Validation Dataset: β = −3.71, p = 0.02). Theoretical implications and applications of the EDM are subsequently discussed; these include the predictive nature of executive functioning in the development of distressing tinnitus, and the clinical utility of the EDM.

Clarke, Nathan A.↗
DOE OSTI2023

X-ray Inspection Model Validation with Physical Dosimetry

A non-functional printed circuit board assembly was developed using ULTIboard and a simple computational transport model was created for use with the Monte Carlo software MCNP. EBT 3 film radiography was used to compare with Monte Carlo simulation to validate the board representation. The computational transport model was then revised to include connection pins, solder balls, highly attenuating internal structures, and copper trace distribution. Results from the revised model were compared to the EBT 3 films to observe improvements to dose profiles. It was found that this method was useful in verifying the placement of components, as the dose profiles were observed to follow the same trends. The experiment was then repeated using XRQA 2 films to achieve the same level of contrast with 1% the dose of EBT 3 films. It was found that high contrast may be achieved using these films to identify major issues with the model geometry, at a cost of dose profile accuracy. A second validation method was applied to the model using 37 CaF 2 thermoluminescent dosimeters (TLDs). TLD measurements were compared with the simplified and complex transport models to identify the features that have the greatest impact on simulation accuracy. The TLD calibration to CaF 2 was found to be accurate within 5.6%, while calibration to dose in Si was found to be accurate within 4.7%. Finally, it was observed that the accurate representation of solder balls and proper modeling of highly attenuating internal structures had the greatest impact on simulation accuracy.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2024

Model Validation and Uncertainty Quantification on the KRUSTY Microreactor Design Using GRIFFIN Neutron Transport Code [Poster]

Argonne National Laboratory (ANL) and INL have developed a GRIFFIN steady state neutronics model for the multiphysics simulations of the Kilopower Reactor Using Sterling TechnologY (KRUSTY) microreactor in the Multiphysics Object Oriented Simulation Environment (MOOSE). The reliability of such deterministic neutronics models can be validated by comparing with computations from Monte Carlo codes (e.g. MCNP, SERPENT, OpenMC, Shift, etc). Furthermore, potential modeling/design improvements can be identified by incorporating uncertainty quantification (UQ), which can be performed by MOOSE’s Stochastic Tools Module (STM). KRUSTY is a prototype for a 5-kW thermal nuclear-powered space reactor. Its primary components consist of nuclear fuel, heat pipes, a control rod, a reflector, and the shielding. The fuel consists of 3 stacked U-7.65Mo cylinders with a hole in the center for the control rod. 8 liquid sodium heat pipes transfer fission energy from the solid fuel block to the Sterling power conversion system where the energy is extracted, and the cooled sodium flows back to the core via capillary action . The movable Boron Carbide control rod regulates the neutron population during startup or when a reactor temperature boost is needed . The beryllium oxide reflector is in 3 places in the reactor; it surrounds the core axially, it lies beneath the core on a platen, and it is present in the shim. The axial and lower reflectors rest on an adjustable stainless-steel platen that moves upward to cover the fuel and help the reactor reach criticality. Lastly, radial stainless steel surrounds the core offering protection from radiation exposure .

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2023

RM3 Wave Tank Validation Model

An approximately 1/75th scale point absorber wave energy absorber was built to validate the testing systems of a 16k gallon single paddle wave tank. The model was build based on the RM3 design and incorporated a linear position sensor, a force transducer, and wetness detection sensors. The data set also includes motion tracking data of the device's two bodies acquired from 4x Qualisys cameras. The tank wave spectrum is measured by 4 ultrasonic water height sensors.

16 TIDAL AND WAVE POWER↗
DOE OSTI2023

Scenario optimization for the tokamak ramp-down phase in RAPTOR: Part A. Analysis and model validation on ASDEX Upgrade

We discuss how the combination of experimental observations and rapid modeling has enabled to improve understanding of the tokamak ramp-down phase in ASDEX Upgrade. A series of dedicated experiments has been performed, to disentangle the effect of individual actuators like plasma current, auxiliary heating and plasma shaping. Optimized discharge termination strategies with increased margin with respect to radiative and vertical stability limits are proposed and tested in experiment. Radiative collapse of the edge $T$ $e$ profile after the HL back-transition is avoided by initially maintaining auxiliary heating during L-mode, showing beneficial effects even after the auxiliary heating is turned off. The capability of the RAPTOR code to model the time evolution of the internal inductance $\ell$ $i3$ has been validated, including the effect of a change in the $I$ $p$ ramp-down rate and the HL transition timing. The reduction of $\ell$ $i3$ caused by rapid compression of the plasma cross-section has been quantitatively recovered in simulations. Successful modeling of the $\ell$ $i3$ time evolution is essential to optimize ramp-down scenarios for future fusion reactors, for which vertical stability and power balance control will be more challenging.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗