SEARCH · Engineering Papers

Results for “model comparison.”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

All sources NASA NTRS DOE OSTI

DOE OSTI2020

The Cloud-resolving model Radar SIMulator (CR-SIM) Version 3.3: description and applications of a virtual observatory

Ground-based observatories use multi-sensor observations to characterize cloud and precipitation properties. One of the challenges is how to design strategies to best use these observations to understand these properties and evaluate weather and climate models. This paper introduces the Cloud resolving model Radar SIMulator (CR-SIM), which uses output from high-resolution cloud resolving models (CRMs) to emulate multi-wavelength, zenith-pointing, and scanning radar observables and multi-sensor (radar and lidar) products. CR-SIM allows direct comparison between an atmospheric model simulation and remote-sensing products using a forward-modeling framework consistent with the microphysical assumptions used in the atmospheric model. CR-SIM has the flexibility to easily incorporate additional microphysical modules, such as microphysical schemes and scattering calculations, and expand the applications to simulate multi-sensor retrieval products. In this paper, we present several applications of CR-SIM for evaluating the representativeness of cloud microphysics and dynamics in a CRM, quantifying uncertainties in radar-lidar integrated cloud products and multi-Doppler wind retrievals, and optimizing radar sampling strategy using observing system simulation experiments. These applications demonstrate the application of CR-SIM as a virtual observatory operator on high-resolution model output for a consistent comparison between model results and observations to aid interpretation of the differences and improve understanding of the representativeness errors due to the sampling limitations of the ground-based measurements. CR-SIM is licensed under the GNU GPL package and both the software and the user guide are publicly available to the scientific community.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Accurate Simulation of Both Sensitivity and Variability for Amazonian Photosynthesis: Is It Too Much to Ask?

Abstract Estimates of Amazon rainforest gross primary productivity (GPP) differ by a factor of 2 across a suite of three statistical and 18 process models. This wide spread contributes uncertainty to predictions of future climate. We compare the mean and variance of GPP from these models to that of GPP at six eddy covariance (EC) towers. Only one model's mean GPP across all sites falls within a 99% confidence interval for EC GPP, and only one model matches EC variance. The strength of model response to climate drivers is related to model ability to match the seasonal pattern of the EC GPP. Models with stronger seasonal swings in GPP have stronger responses to rain, light, and temperature than does EC GPP. The model to data comparison illustrates a trade‐off inherent to deterministic models between accurate simulation of a mean (average) and accurate responsiveness to drivers. The trade‐off exists because all deterministic models simplify processes and lack at least some consequential driver or interaction. If a model's sensitivities to included drivers and their interactions are accurate, then deterministically predicted outcomes have less variability than is realistic. If a GPP model has stronger responses to climate drivers than found in data, model predictions may match the observed variance and seasonal pattern but are likely to overpredict GPP response to climate change. High or realistic variability of model estimates relative to reference data indicate that the model is hypersensitive to one or more drivers.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

The ARM Data-oriented Metrics and Diagnostics Package for Climate Models - A New Tool for Evaluating Climate Models with Field Data

The U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) program User Facility produces ground-based long-term continuous unique measurements for atmospheric state, precipitation, turbulent fluxes, radiation, aerosol, cloud and the land surface, which are collected at multiple sites. These comprehensive datasets have been widely used to calibrate climate models and are proven to be invaluable for climate model development and improvement. This article introduces an evaluation package to facilitate the use of ground-based ARM measurements in climate model evaluation. The ARM data-oriented metrics and diagnostics package (ARM-DIAGS) includes both ARM observational datasets and a Python-based analysis toolkit for computation and visualization. The observational datasets are compiled from multiple ARM data products and specifically tailored for use in climate model evaluation. In addition, ARM-DIAGS also includes simulation data from models participating the Coupled Model Inter-comparison Project (CMIP), which will allow climate-modeling groups to compare a new, candidate version of their model to existing CMIP models. The analysis toolkit is designed to make the metrics and diagnostics quickly available to the model developers.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Benchmark Analysis

Tremendous progress has been achieved in the development of land models and their inclusion in Earth system models (ESMs). However, we still have very limited knowledge on the performance skills of these land models. This chapter introduces benchmark analysis, which is a procedure to measure performance of models against a set of defined standards. The benchmark analysis includes: (1) defining targeted aspects of model performance to be evaluated; (2) testing model performance in comparison with a set of benchmarks; (3) measuring model performance skill through quantitative metrics; and (4) evaluating model performance and offering suggestions for future model improvement.

Luo, Yiqi↗

DOE OSTI2023

Model Inputs, Outputs, and Scripts associated with: “Combined effects of stream hydrology and land use on basin-scale hyporheic zone denitrification in the Columbia River Basin”

This data package is associated with the publication “Combined effects of stream hydrology and land use on basin‐scale hyporheic zone denitrification in the Columbia River Basin”, published in Water Resource Research (Son et al.2022) available at https://doi.org/10.1029/2021WR031131. This data package includes the key model inputs/outputs of the river corridor model for the Columbia River Basin (CRB) and the model source codes used in the manuscript. The model is a carbon-nitrogen-coupled river corridor model (RCM), and the model is used to quantify hyporheic zone (HZ) denitrification at the NHDPLUS stream reach scales. The RCM used in this study combines empirical substrate models derived from observations and three microbially driven reactions, including two-step denitrification and aerobic respiration, are considered within the HZ. The key input data of the model are exchange flux, residence time, and stream solute (dissolved organic carbon (DOC), dissolved oxygen (DO), and nitrate concentrations). These inputs are constant over time and represent long-term averaged values. This study uses the RCM to explore the spatial patterns of HZ denitrification across reaches with different sizes and land use in the CRB. Our main objective is to use the RCM as a virtual reality model, and the machine-learning models as surrogates that encapsulate the complexities of the physics-based model while identifying the importance of different variables that are not evident in the model conceptualization. We do not include a direct comparison of the modeled HZ denitrification and measurements; however, the RCM can capture the overall spatial patterns of the HZ denitrification because the model inputs and its reaction networks are based on well-established theory and a physical-based model. The combination of the model-based predictions and a machine-learning approach (e.g., random forest) is used to improve our understanding of what variables of the model are associated with spatial patterns of the modeled denitrification across reaches with different sizes and land uses, and to develop a proxy model using measurable variables to reproduce the simulated patterns.This dataset contains five folders: (1) model_inputs, (2) model_outputs, (3) Rscripts, (4) figures, and (5) model_codes. It also contains a readme, file level metadata (FLMD), and data dictionary (dd). Please see the FLMD for a list of all the files contained in this data package and descriptions for each. The model_inputs folder contains the model inputs used to drive the model simulations. The model_outputs folder contains key model output files from the river corridor model. The Rscripts folder contains the Rscripts for pre- and post- processing model results. The figures folder contains the raw figures associated with the manuscript. The model_codes folder includes key model source codes/input files. All files are .jpg, .jpeg, .out, .e, .od, .dat, .sub, .F90, .0, .R, .sbx, .cpg, .sbn, .shx, .shp, .dbf, .prj, .tfw, .tif, .xml, .pdf, or .csv.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Verification of the 3-Region Advanced Test Reactor MCNP Model

The verification of the 3-region homogenized fuel Advanced Test Reactor MCNP model. The 3-region model was compared to the 19-plate model found in the 94-CIC report. Flux tallies, energy deposition tallies, and quarter core mesh tallies were used to compare the two models. The 3-region model needed updating in order to make good comparisons between the models. The percent error from the flux and energy deposition tallies data shows that experiment positions inside the flux trap have higher errors than positions outside the fuel ring. The standard deviation data obtained from the mesh tallies shows that the two models agree within two standard deviations throughout the reactor. It is concluded that the model works adequately for what it is used for.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2022

Verification of the 3-Region Advanced Test Reactor MCNP Model

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2025

Inverse model based error detection in beamline optics

Optics tuning in transfer lines and LINACs can be challenging due to the fact that multiple combinations of machine settings can lead to the same diagnostic output. Moreover, the lack of a periodic solution can limit the ability to infer optics in the same way as rings from BPM signals. Model based approaches are often used to assist with the optics tuning in combination with optimization or parameter estimation. Here we have developed a novel approach using machine learning inverse models trained on a known configuration to detect variations in quadrupole settings without explicitly including them in the model. This paper shows a comparison of neural network models and linear models on both a simulation based study and experimental studies conducted at the AGS to RHIC transfer line at Brookhaven National Lab.

43 PARTICLE ACCELERATORS↗

DOE OSTI2023

A diagnostic to measure time-resolved atom column density and Doppler temperature in atomic vapors produced by laser ablation

We report on the development of a diagnostic to measure the time-resolved column density and Doppler temperature of atomic vapors produced by laser ablation. The diagnostic is based on the strong frequency dependence of the atomic susceptibility near an electronic transition in the interrogated atomic species. Interference on the face of a fast photodetector between the several frequency components present in a sinusoidally phase-modulated probe beam will produce a time signature uniquely determined by the column density of atoms in the probed atomic state and the Doppler temperature of the atomic vapor. With the extensive, high precision atomic spectroscopy data available in the literature, it is possible to model the vapor and extract the desired parameters through comparison of the model result with the experimental data.

47 OTHER INSTRUMENTATION↗

DOE OSTI2020

Dosimetric modeling of Tc-99, Cs-137, Np-237, and U-238 in the grass species Andropogon Virginicus: Development and comparison of stylized, voxel, and hybrid phantom geometry

Not provided.

Environmental Sciences & Ecology↗

DOE OSTI2021

Implementation of Additional Models into the MACCS Code for Nearfield Consequence Analysis

The NRC’s Non-Light Water Reactor Vision and Strategy report discusses the MACCS code readiness for nearfield analyses. To increase the nearfield capabilities of MACCS, the plume meander model from Ramsdell and Fosmire was integrated into MACCS and the MACCS plume meander model based on U.S. NRC Regulatory Guide 1.145 was updated. Test cases were determined to verify the plume meander model implementation into MACCS 4.1. The results using the implemented MACCS plume meander models match the comparisons with other codes and analytical calculations. This verifies that the additional MACCS plume meander models have been successfully implemented into MACCS 4.1. This report documents the verification of these model implementations into MACCS and a comparison of the results using

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

DOE OSTI2024

Comparison of steady-state analytical wake models implemented in wind farm analysis software

A common set of mathematical wind turbine wake models are implemented in a few, well-adopted computational tools for wind farm wake modelling. Although the referenced mathematical formulations are common, implementation details may lead to differences in results. This study presents a systematic comparison of the implementation of mathematical wake models in open source, Python-based wind turbine wake modelling software, and a set of the models are directly compared. Despite aligning only the mathematical model parameters and retaining the default computational model parameters, good agreement is found across most of the model implementations, and additional agreement is expected upon further parameters alignment.

17 WIND ENERGY↗

DOE OSTI2024

Transfer Tube Material Properties Obtained from Test Data

A series of tension and compression tests were performed on typical transfer tubes made of 304L corrosion-resistant steel. The results were compiled and converted to true stress and true plastic strain for comparison to numerical models. The parameters of a Johnson-Cook constitutive model and fracture criterion were calibrated to mimic the test data. Comparisons were made between the converted data and the empirical formulas in the Johnson-Cook model. Simulations were performed to evaluate the implementation of the formula in finite element analysis, and the parameters were adjusted to improve the correlation.

36 MATERIALS SCIENCE↗

DOE OSTI2023

Upscaling Wetland Methane Emissions From the FLUXNET–CH4 Eddy Covariance Network (UpCH4 v1.0): Model Development, Network Assessment, and Budget Comparison

Wetlands are responsible for 20%–31% of global methane (CH 4 ) emissions and account for a large source of uncertainty in the global CH 4 budget. Data-driven upscaling of CH 4 fluxes from eddy covariance measurements can provide new and independent bottom-up estimates of wetland CH 4 emissions. Here, we develop a six-predictor random forest upscaling model (UpCH4), trained on 119 site-years of eddy covariance CH 4 flux data from 43 freshwater wetland sites in the FLUXNET-CH4 Community Product. Network patterns in site-level annual means and mean seasonal cycles of CH 4 fluxes were reproduced accurately in tundra, boreal, and temperate regions (Nash-Sutcliffe Efficiency ~0.52–0.63 and 0.53). UpCH4 estimated annual global wetland CH 4 emissions of 146 ± 43 TgCH 4 y –1 for 2001–2018 which agrees closely with current bottom-up land surface models (102–181 TgCH 4 y –1 ) and overlaps with top-down atmospheric inversion models (155–200 TgCH 4 y –1 ). However, UpCH4 diverged from both types of models in the spatial pattern and seasonal dynamics of tropical wetland emissions. We conclude that upscaling of eddy covariance CH 4 fluxes has the potential to produce realistic extra-tropical wetland CH 4 emissions estimates which will improve with more flux data. To reduce uncertainty in upscaled estimates, researchers could prioritize new wetland flux sites along humid-to-arid tropical climate gradients, from major rainforest basins (Congo, Amazon, and SE Asia), into monsoon (Bangladesh and India) and savannah regions (African Sahel) and be paired with improved knowledge of wetland extent seasonal dynamics in these regions.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Comparison of ML-Based Proxy Modeling Strategies: Lessons Learned from the SMART Initiative

Teams of researchers on Task 5 of the SMART project have developed a variety of modeling architectures to predict subsurface behavior during carbon injection and post-injection periods. One important part of this task was to compare the candidate approaches in terms of accuracy, reliability, speed, and memory use, all using a common set of metrics and visualizations for an “apples to apples” comparison. Dr. Jared Schuetter will share the details of this task, the results that were obtained, and the lessons learned.

Schuetter, Jared↗

DOE OSTI2024

DECOVALEX-2023: Task F2 Salt Final Report

The subject of Task F of DECOVALEX-2023 concerns performance assessment modelling of radioactive waste disposal in deep mined repositories. The primary objectives of Task F are to build confidence in the models, methods, and software used for performance assessment (PA) of deep geologic nuclear waste repositories, and/or to bring to the fore additional research and development needed to improve PA methodologies. In Task F2- (salt), these objectives have been accomplished through staged development and comparison of the models and methods used by participating teams in their PA frameworks. Coupled-process submodels and deterministic simulations of the entire PA model for a reference scenario for waste disposal in domal salt have been conducted. The task specification has been updated continuously since the initiation of the project to reflect the staged development of the conceptual repository model and performance metrics. Thermal, hydrological, mechanical, and chemical properties of individual components of the engineered and natural system were chosen for relevance by participating teams. The salt reference case system was characterized using data and measurements collected at relevant underground research laboratories (URLs), field sites, and simulation results from teams with specialized modelling capability. Participating teams made a wide range of model assumptions from compartmentalized networks to full 3D models of the salt formation. No single contributed model includes full-fidelity representation of all the features, events, and processes (FEPs) detailed in the task specification, but almost all features and processes are represented in at least one model. Despite differences in the modelling strategies developed by participating teams, all models indicate that salt compaction and radionuclide diffusion are key processes in the repository, and for the FEPs and model scenario considered, little of the disposed radionuclides will migrate beyond the repository seal over the 100,000 year simulations. In general, the model output quantities have the largest differences over the short term and near the waste. The models tend to be more similar further from waste and at later time. Disparities between the models are believed to be due to differing simplifications from the task specification, some of which are chosen simplifications to reduce complexity, and some are restrictions imposed by the modelling tools. A second round of this task has been accepted for DECOVALEX-2027 in conjunction with Task F1 on crystalline PA modelling. The future round includes waste package heating, improved modelling of salt creep closure, additional comparisons of coupled-process sub-models, and the impact of repository engineering design on radionuclide migration in the repository. Participants will also propose and finalize a set of uncertain inputs for the reference case simulations, propagate these uncertainties in a set of realizations, and conduct sensitivity analyses on the simulation results.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

DOE OSTI2023

A Review on Simulation Models of Cascading Failures in Power Systems

Among various power system disturbances, cascading failures are considered the most serious and extreme threats to grid operations, potentially leading to significant stability issues or even widespread power blackouts. Simulating power systems' behaviors during cascading failures is of great importance to comprehend how failures originate and propagate, as well as to develop effective preventive and mitigative control strategies. The intricate mechanism of cascading failures, characterized by multi-timescale dynamics, presents exceptional challenges for their simulations. This paper provides a comprehensive review of simulation models for cascading failures, providing a systematic categorization and a comparison of these models. The challenges and potential research directions for the future are also discussed.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2026

MESA Isochrones and Stellar Tracks (MIST). III. The White Dwarf Cooling Sequence

We present a substantial update to the MESA Isochrones and Stellar Tracks (MIST) library, extending the MIST model grids and isochrones down the white dwarf (WD) cooling sequence with realistic physics for WD cooling timescales. This work provides a large grid of MESA models for carbon–oxygen core WDs with hydrogen atmospheres (spectral type DA/DC), descended from full prior stellar evolution calculations. The model tracks, isochrones, and WD cooling timescale contours are available on the MIST project website and at doi:10.5281/zenodo.15242047. Our WD models provide a very large, publicly available grid with detailed physics for WD cooling timescales: realistic interior and envelope compositions, with element diffusion and heavy-element sedimentation, nuclear burning at the base of the WD hydrogen envelope, core crystallization, and C/O phase separation. As a large grid of open-source stellar evolution models, these WD models provide both out-of-the-box model tracks for comparison with observations and a framework for building further WD models to investigate variations in WD physics.

Astronomy and AstroPhysics↗