Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Reproducibility”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 919 records · Page 51

Code for BALDR Study 07.04

SAND2024-11256O The Code for BALDR Study 07.04 software reproduces results from the BALDR study concerning "Multilabel Proportion Prediction and Out-of-Distribution Detection on Gamma Spectra of Short-Lived Fission Products." This code can reproduce a scientific study following the step numbers present in the file names. The scientific study uses synthetic and measured data to find the best model for the radioisotope proportion estimation task of interest and generates results. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Morrow, Tyler↗

OLCF Test Harness

Acceptance and regression testing of a High Performance Computing (HPC) system requires an automated and reproducible framework and tool for running and logging results. Manually running tests across a system is labor intensive and prone to reproducibility errors. The OLCF Test Harness (OTH) provides a framework in which to document required tests for a HPC system. The OTH then provides tools to execute and log results of these tests in an automated fashion.

Dietz, Dan [Oak Ridge National Laboratory (ORNL), ↗

Real-Twin

Real-Twin is a unified, model-agnostic scenario generation tool designed to streamline and standardize the evaluation of emerging mobility technologies. It provides an end-to-end framework that includes robust workflows, integrated tools, and comprehensive metrics to generate, calibrate, and benchmark microscopic traffic simulation scenarios across multiple platforms. Key Features of Real-Twin include: - Unified Scenario Generation: generate transferable, simulation-ready scenarios from heterogeneous data sources using a consistent workflow. - Automated Calibration Workflow: bridges simulation and real-world data, minimizing manual effort and making traffic simulation more accessible to researchers and engineers. - Model-Agnostic Compatibility: supports SUMO, VISSIM, and AIMSUN for cross-platform scenario generation and benchmarking. Enables reliable comparisons and reproducibility across different simulation tools. - Consistent Scenarios across Different Simulators: generate comparable simulation scenarios across different microscopic traffic simulators, providing users the ability to conduct benchmarking and cross-validation that are crucial for ensuring the reliability and reproducibility of simulation results. - Emerging Technology Support: includes a scenario database and pipeline for studying autonomous vehicles (AVs), with planned extensions to CAVs, EVs, and other advanced technologies.

Wang, Chieh (Ross) [Oak Ridge National Laboratory ↗

UBW (USLCI-Brightway2) [SWR-25-169]

Life cycle inventory (LCI) data are critical for robust life cycle assessment (LCA), yet many widely used datasets such as the U.S. Life Cycle Inventory (USLCI) are not natively compatible with advanced modeling frameworks like Brightway2. This work presents an automated pipeline to transform USLCI data into a fully functional Brightway2 project. The workflow performs systematic data cleaning, resolves duplicate process and exchange identifiers, and applies allocation to multi-output processes. Technosphere and biosphere flows are harmonized through unit conversions and a bridge mapping to the biosphere3 database, with comprehensive logging of missing flows and cutoff issues. The resulting Brightway2 database is validated using matrix diagnostics to ensure consistency of the technosphere, and is benchmarked via life cycle impact assessment (LCIA) methods such as ReCiPe and IPCC GWP. Outputs include reproducible CSV exports of corrected processes, elementary flows, characterization factors, and LCIA results, alongside backup utilities for project sharing. This pipeline lowers barriers for integrating USLCI data into open-source LCA workflows, enabling reproducible, validated LCA inventories within the Brightway 2 framework.

Ghosh, Tapajyoti [National Laboratory of the Rocki↗

ATcT — Active Thermochemical Tables Python Interface

SF-25-140 atct is a lightweight, Python client for the ATcT v1 API that enables programmatic access to high-accuracy thermochemical data and turnkey reaction-enthalpy analysis. The package implements full v1 endpoint coverage (species lookup by ATcT ID, name, formula, SMILES, InChI, CAS RN; covariance queries; health checks) with robust error handling, retries, and environment-based configuration for local/production endpoints. Beyond data retrieval, atct provides rigorously implemented reaction calculators that propagate uncertainties via either (i) a conventional independent-errors method (0 K or 298.15 K) or (ii) covariance-aware propagation using provided covariances at 298.15 K. Typed data classes ensure transparent, reproducible data structures and carry ATcT Thermochemical Network (TN) version identifiers for provenance. Dual import paths and comprehensive examples facilitate integration into research pipelines, enabling reproducible thermochemical calculations, automated validation, and downstream method development.

Bross, DavidHamilton [Argonne National Laboratory ↗

TEMPEST

This repository solves the problem of driver identification through vehicular and biometric data. Through an embedding-based approach and a novel loss function, we're able to distinguish between different drivers' behaviors. This also provides preprocessing for reproducibility of results.The code preprocesses vehicular data, trains neural networks, and outputs predictions.This code introduces a novel embedding-based neural network with a 91% rank-1 accuracy, as well as all code to reproduce training and results.

Musgrove, Kyle↗

Evaluating the performance of WRF urban schemes and PBL schemes over Dallas-Fort Worth during a dry summer and a wet summer

This study evaluated the Weather Research and Forecasting (WRF) model sensitivity to different planetary boundary layer (PBL) schemes (the YSU and MYJ schemes) and urban schemes including the bulk scheme (BULK), single-layer urban canopy model (UCM), multi-layer building environment parameterization (BEP) model, and multi-layer building energy model (BEM). Daily reinitialization simulations were conducted over Dallas-Fort Worth during a dry summer month (July 2011) and a wet summer month (July 2015) with weaker (stronger) daytime (nocturnal) UHI in 2011 than 2015. All urban schemes overestimated the urban daytime 2m temperature in both summers, but BEP and BEM still reproduced the daytime urban cool island in dry summer. All urban schemes reproduced the nocturnal urban heat island, with BEP producing the weakest one due to its unrealistic urban cooling. BULK and UCM overestimated the urban canopy wind speed, while BEP and BEM underestimated it. The urban schemes showed prominent impact on daytime PBL profiles. UCM+MYJ showed a superior performance than other configurations. The relatively large (small) aspect ratio between building height and road width in UCM (BEM) was responsible for the overprediction (underprediction) of urban canopy temperature. The relatively low (high) building height in UCM (BEM) was responsible for the overprediction (underprediction) of urban canopy wind speed. Improving urban schemes and providing realistic urban parameters were critical for improving urban canopy simulation.

54 ENVIRONMENTAL SCIENCES↗

Differential credibility assessment for statistical downscaling

Climate science is increasingly using (i) ensembles of climate projections from multiple models derived using different assumptions and/or scenarios and (ii) process-oriented diagnostics of model fidelity. Efforts to assign differential credibility to projections and/or models are also rapidly advancing. A framework to quantify and depict the credibility of statistically downscaled model output is presented and demonstrated. Here, the approach employs transfer functions in the form of robust and resilient generalized linear models applied to downscale daily minimum and maximum temperature anomalies at 10 locations using predictors drawn from ERA-Interim reanalysis and two global climate models (GCM; GFDL-ESM2M and MPI-ESM-LR). The downscaled time series are used to derive several impact relevant CLIMDEX temperature indices that are assigned credibility based on (1) the reproduction of relevant large-scale predictors by the GCMs (i.e. fraction of regression beta-weights derived from predictors that are well-reproduced) and (2) the degree of variance in the observations reproduced in the downscaled series following application of a new variance inflation technique. Credibility of the downscaled predictands varies across locations, between the two GCM and is generally higher for minimum temperature than maximum temperature. The differential credibility assessment framework demonstrated here is easy to use and flexible. It can be applied as is to inform decision makers regarding projection confidence, and/or extended to include other components of the transfer functions, and/or used to weight members of a statistically downscaled ensemble.

54 ENVIRONMENTAL SCIENCES↗

Evaluation of the Near-Surface Variables in the HRRR Weather Model Using Observations from the ARM SGP Site

Abstract The performance of version 4 of the NOAA High-Resolution Rapid Refresh (HRRR) numerical weather prediction model for near-surface variables, including wind, humidity, temperature, surface latent and sensible fluxes, and longwave and shortwave radiative fluxes, is examined over the Atmospheric Radiation Measurement (ARM) Southern Great Plains (SGP) region. The study evaluated the model’s bias and bias-corrected mean absolute error relative to the observations on different time scales. Forecasts of near-surface geophysical variables at five SGP sites (HRRR at 3-km scale) were found to agree well with observations, but some consistent observation–forecast differences also occurred. Sensible and latent heat fluxes are the most challenging variables to be reproduced. The diurnal cycle is the main temporal scale affecting observation–forecast differences of the near-surface variables, and almost all of the variables showed different biases throughout the diurnal cycle. Results show that the overestimation of downward shortwave and the underestimation of downward longwave radiative flux are the two major biases found in this study. The timing and magnitude of downward longwave flux, wind speed, and sensible and latent heat fluxes are also different with contributions from model representations, data assimilation limitations, and differences in scales between HRRR and SGP sites. The positive bias in downward shortwave and negative bias in longwave radiation suggests that the model is underestimating cloud fraction in the study domain. The study concludes by showing a brief comparison with version 3 of the HRRR and shows that version 4 has better performance in almost all near-surface variables. Significance Statement A correct representation of the near-surface variables is important for numerical weather prediction models. This study investigates the capability of the latest NOAA High-Resolution Rapid Refresh (HRRRv4) model in simulating the near-surface variables by comparing against the Atmospheric Radiation Measurement (ARM) Southern Great Plains (SGP) in situ observations. Among others, we find that the surface heat fluxes, such as sensible and latent heat fluxes, are the most difficult variables to be reproduced. This study also shows that the diurnal cycle has the dominant impact on the model’s performance, which means the majority of the outputted near-surface variables have the strong diurnal cycle in their bias errors.

54 ENVIRONMENTAL SCIENCES↗

Monsoonal MCS Initiation, Rainfall, and Diurnal Gravity Waves over the Bay of Bengal: Observation and a Linear Model

Abstract Previous observational studies have indicated that mesoscale convective systems (MCSs) contribute the majority of precipitation over the Bay of Bengal (BoB) during the summer monsoon season, yet their initiation and propagation remain incompletely understood. To fill this knowledge gap, we conducted a comprehensive study using a combination of 20-yr satellite observations, MCS tracking, reanalysis data, and a theoretical linear model. Satellite observations reveal clear diurnal propagation signals of MCS initiation frequency and rainfall from the west coast of the BoB toward the central BoB, with the MCS rainfall propagating slightly slower than the MCS initiation frequency. Global reanalysis data indicate a strong association between the offshore-propagating MCS initiation frequency/rainfall and diurnal low-level wind perturbations, implying the potential role of gravity waves. To verify the hypothesis, we developed a 2D linear model that can be driven by realistic meteorological fields from reanalysis. The linear model realistically reproduces the characteristics of offshore-propagating diurnal wind perturbations. The wind perturbations, as well as the offshore propagation signals of MCS initiation frequency and rainfall, are associated with diurnal gravity waves emitted from the coastal regions, which in turn are caused by the diurnal land–sea thermal contrast. The ambient wind speed and vertical wind shear play crucial roles in modulating the timing, propagation, and amplitude of diurnal gravity waves. Using the linear model and satellite observations, we further show that the stronger monsoonal flows lead to faster offshore propagation of diurnal gravity waves, which subsequently control the offshore propagation signals of MCS initiation and rainfall. Significance Statement Rainfall over the Bay of Bengal (BoB) is primarily contributed by large and organized rainfall systems in the summer monsoon season. During this season, these systems are commonly observed over the east coast of India around midnight, the western BoB in the morning, and the central BoB in the afternoon. This eastward rainfall propagation is confirmed by observations, reanalysis data, and a theoretical model to have a strong association with atmospheric diurnal gravity waves. These waves are caused by land–sea thermal contrast and can trigger rainfall systems over the offshore regions. We also found that the diurnal gravity waves, as well as their triggered rainfall systems, can be greatly modulated by the large-scale monsoonal flows. All the above findings improve our understanding of diurnal rainfall cycle over the BoB and may contribute to the future improvement of rainfall forecast over the region.

Meteorology & Atmospheric Sciences↗

The Dual Nature of Entrainment-Mixing Signatures Revealed through Large-Eddy Simulations of a Convection-Cloud Chamber

Abstract Entrainment of subsaturated air into a cloud can influence its optical and microphysical properties in various ways, depending on the droplet evaporation and turbulent mixing time scales. Previous experiments in the Pi convection-cloud chamber have revealed that, given a fixed entrained air property, the mixing of entrained subsaturated air results in complete evaporation of some cloud droplets, with the rest remaining unchanged. This is a signature of inhomogeneous mixing. While comparing the results of entrainment with varying air properties, the mixing signature appears as if the subsaturated air is well mixed with the cloud to evenly reduce the droplets’ size. In other words, taken together, the experiments appear to have the signature of homogeneous mixing. To explore these results in a greater depth, we conduct large-eddy simulations combined with a bin microphysics scheme. Our results reproduce the similar signatures of inhomogeneous and homogeneous mixing, implying that LES can resolve the inhomogeneous mixing when the grid spacing is smaller than the entrained air parcel. Additionally, we observe that increasing the aerosol injection rate enhances the signature of inhomogeneous mixing, while coarser grid spacing diminishes it. Finally, the change in wall fluxes in response to various entrained air properties confirms that the homogeneous signature seen in the analysis of an ensemble of simulations is the result of various equilibrium states. This further strengthens the suggestion that the homogeneous mixing signature found in aircraft observations near the cloud top may result from combining entrainment events of different intensities, possibly caused by various-sized eddies. Significance Statement Large-eddy simulation and size-resolved microphysics can resolve time scales for turbulent mixing and evaporation and, therefore, are well suited for reproducing, extending, and interpreting the entrainment experiment in the Pi convection-cloud chamber. Our simulation results confirm (i) the inhomogeneous mixing signature for an individual entrainment event and (ii) the appearance of homogeneous mixing in an ensemble of entrainment episodes. Furthermore, we demonstrate that the inhomogeneous mixing signature is more pronounced in a polluted cloud, but coarser grid spacing in simulations may compromise the accuracy of this signature. Last, the homogeneous mixing signature results from various equilibrium states established for different entrainment intensities and adjusted wall fluxes, which are challenging to measure experimentally but can be easily analyzed in the simulations.

54 ENVIRONMENTAL SCIENCES↗

Human Contribution to the Increasing Summer Precipitation in Central Asia from 1961 to 2013

We report that the ecosystem and societal development over arid Central Asia, the core connecting region of the Silk Road Economic Belt, are highly sensitive to climate change. The results derived from multiobservational datasets show that summer precipitation over Central Asia has significantly increased by 20.78% from 1961 to 2013. It remains unclear whether anthropogenic forcing has contributed to the summer wetting trend or not. In this study, the corresponding physical processes and contributions of anthropogenic forcing are investigated by comparing reanalysis and experiments of the Community Atmosphere Model, version 5.1 (CAM5.1), from the CLIVAR Climate of the Twentieth Century Plus (C20C+) Project. The observed wetting trend is well reproduced in the simulation driven by all radiative forcings (CAM5-All), but poorly reproduced in the simulation with natural forcings only (CAM5-Nat), confirming the important role of human contribution in the observed wetting trend. Moisture budget analysis shows that the observed wetting trend is dominated by the increasing vertical moisture advection term and results from enhanced vertical motion over nearly all of Central Asia. The observed contributions of moisture budget components to the wetting trend are only captured by CAM5-All experiments. The dynamic contribution is determined by the warm advection anomalies in association with a human-induced meridional uneven warm pattern. Finally, human-induced warming increases the specific humidity over all of Central Asia, increasing (decreasing) the precipitation over the climatological ascent (descent) region in eastern (western) Central Asia.

54 ENVIRONMENTAL SCIENCES↗

The impacts of horizontal resolution on the seasonally-dependent biases of the northeastern Pacific ITCZ in coupled climate models.

Double-ITCZ has puzzled climate model community for more than two decades. Here, we found that over the eastern Pacific, precipitation and sea surface temperature (SST) biases in the NCAR CESM1 are seasonally-dependent, with positive (negative) precipitation/SST biases during boreal summer/fall (winter/spring), although the easterly wind bias persists around the year. This seasonally-dependent bias of precipitation/SST is found to be caused by the failure of the model to reproduce the climatological seasonal wind reversal of North American monsoon. During winter/spring, the climatological easterly wind dominates, so the stronger wind speed in the model enhances the evaporation and lowers the SST. It is opposite when the climatological wind turns to westerly during summer/fall. The easterly wind bias also occurs in the atmospheric model when the observation SST is prescribed, suggesting it is of atmospheric origin. Further, the easterly wind bias is mainly evident in the lower troposphere and quite independent of time, implying the effect of complex and narrow-ranged Central American topography, which is not depicted well in the coarse model resolution. When the model resolution is doubled, both SST and precipitation are improved with the reduced easterly wind bias. During boreal spring, when ITCZ bias is most significant, the northern and southern ITCZ can be improved by 29% and 18.8% respectively in the higher resolution. Finally, we suggest that these seasonally-dependent biases over the eastern Pacific are quite universal among 37 CMIP5 coupled models, and the ongoing CMIP6 project will provide a valuable opportunity to examine whether the bias can be reduced by increasing model resolution.

Song, Fengfei↗

Are 100 Ensemble Members Enough to Capture the Remote Atmospheric Response to +2°C Arctic Sea Ice Loss?

This study presents results from the Polar Amplification Multimodel Intercomparison Project (PAMIP) single-year time-slice experiments that aim to isolate the atmospheric response to Arctic sea ice loss at global warming levels of +2°C. Using two general circulation models (GCMs), the ensemble size is increased up to 300 ensemble members, beyond the recommended 100 members. After partitioning the response in groups of 100 ensemble members, the reproducibility of the results is evaluated, with a focus on the response of the midlatitude jet streams in the North Atlantic and North Pacific. Both atmosphere-only and coupled ocean–atmosphere PAMIP experiments are analyzed. Substantial differences in the midlatitude response are found among the different experiment subsets, suggesting that 100-member ensembles are still significantly influenced by internal variability, which can mislead conclusions. Despite an overall stronger response, the coupled ocean–atmosphere runs exhibit greater spread due to additional ENSO-related internal variability when the ocean is interactive. The lack of consistency in the response is true for anomalies that are statistically significant according to Student’s t and false discovery rate tests. This is problematic for the multimodel assessment of the response, as some of the spread may be attributed to different model sensitivities whereas it is due to internal variability. Here, we propose a method to overcome this consistency issue that allows for more robust conclusions when only 100 ensemble members are used.

58 GEOSCIENCES↗

Intercomparison of Dynamically and Statistically Downscaled Climate Change Projections over the Midwest and Great Lakes Region

Downscaling of global climate model (GCMs) simulations is a key element of regional-to-local-scale climate change projections that can inform impact assessments, long-term planning, and resource management in different sectors. Here, we conduct an intercomparison between statistically and dynamically downscaled GCMs simulations using the hybrid delta (HD) and the Weather Research and Forecast (WRF) Model, respectively, over the Midwest and Great Lakes region to 1) validate their performance in reproducing extreme daily precipitation (P) and daily maximum temperature (T max ) for summer and winter and 2) evaluate projections of extremes in the future. Our results show the HD statistical downscaling approach, which includes large-scale bias correction of GCM inputs, can reproduce observed extreme P and T max reasonably well for both summer and winter. However, raw historical WRF simulations show significant bias in both extreme P and T max for both seasons. Interestingly, the convection-permitting WRF simulation at 4-km grid spacing does not produce better results for seasonal extremes than the WRF simulation at 12 km using a parameterized convection scheme. Despite a broad similarity for winter extreme P projections, the projected changes in the future summer storms are quite different between downscaling methods; WRF simulations show substantial increases in summer extreme precipitation, while the changes projected by the HD approach exhibit moderate decreases overall. The WRF simulations at 4 km also show a pronounced decoupling effect between seasonal totals and extreme daily P for summer, which suggests that there could be more intense summer extremes at two different time scales, with more severe individual convective storms combined with longer summer droughts at the end of the twenty-first century.

54 ENVIRONMENTAL SCIENCES↗

The 1996 Mid-Atlantic Winter Flood: Exploring Climate Risk through a Storyline Approach

Abstract This article explores the application of thermodynamic perturbations to a historical midlatitude, wintertime, rain-on-snow flood event to evaluate how similar events may evolve under different climate forcings. In particular, we generate a hindcast of the 1996 Mid-Atlantic flood using an ensemble of 14-km variable-resolution simulations completed with the U.S. Department of Energy’s global Energy Exascale Earth System Model (E3SM). We show that the event is skillfully reproduced over the Susquehanna River Basin (SRB) by E3SM when benchmarked against in situ observational data and high-resolution reanalyses. In addition, we perform five counterfactual experiments to simulate the flood under preindustrial conditions and four different levels of warming as projected by the Community Earth System Model Large Ensemble. We find a nonlinear response in simulated surface runoff and streamflow as a function of atmospheric warming. This is attributed to changing contributions of liquid water input from a shallower initial snowpack (decreased snowmelt), increased surface temperatures and rainfall rates, and increased soil water storage. Flooding associated with this event peaks from around +1 to +2 K of global average surface warming and decreases with additional warming beyond this. There are noticeable timing shifts in peak runoff and streamflow associated with changes in the flashiness of the event. This work highlights the utility of using storyline approaches for communicating climate risk and demonstrates the potential nonlinearities associated with hydrologic extremes in areas that experience ephemeral snowpack, such as the SRB.

Meteorology & Atmospheric Sciences↗

Surface-Enhanced Raman Scattering (SERS) Studies of Disc-on-Pillar (DOP) Arrays: Contrasting Enhancement Factor with Analytical Performance

The use of nanomachining methods capable of reproducible construction of nano-arrayed devices have revolutionized the field of plasmonic sensing by the introduction of a diversity of rationally engineered designs. Significant strides have been made to fabricate plasmonic platforms with tailored interparticle gaps to improve their performance for surface-enhanced Raman scattering (SERS) applications. Over time, a dichotomy has emerged in the implementation of SERS for analytical applications, the construction of substrates, optimization of interparticle spacing as a means to optimize electromagnetic field enhancement at the localized surface plasmon level, and the substrate sensitivity over extended areas to achieve quantitative performance. Here, we assessed the enhancement factor of plasmonic Ag/SiO 2 /Si disc-on-pillar (DOP) arrays of variable pitch with its analytical performance for quantitative applications. Experimental data were compared with those from finite-difference time-domain (FDTD) simulations used in the optimization of the array dimensions. A self-assembled monolayer (SAM) of benzenethiol rendered highly reproducible signals (RSD ~4–10%) and SERS substrate enhancement factor (SSEF) values in the orders of 10 6 –10 8 for all pitches. Furthermore, spectra corresponding to rhodamine 6G (R6G) and 4-aminobenzoic acid demonstrated the advantages of using the more densely packed DOP arrays with a 160 nm pitch (gap= 40 nm) for quantitation in spite of the strongest SSEF was attained for a pitch of 520 nm corresponding to a 400 nm gap.

36 MATERIALS SCIENCE↗

When does global attention help: a unified empirical study on atomistic graph learning

Graph neural networks (GNNs) are widely used as surrogates for costly experiments and first-principles simulations to study the behavior of compounds at atomistic scale, and their architectural complexity is constantly increasing to enable the modeling of complex physics. While most recent GNNs combine more traditional message passing neural networks (MPNNs) layers to model short-range interactions with more advanced graph transformers (GTs) with global attention mechanisms to model long-range interactions, it is still unclear when global attention mechanisms provide real benefits over well-tuned MPNN layers due to inconsistent implementations, features, or hyperparameter tuning. We introduce the first unified, reproducible benchmarking framework–built on HydraGNN–that enables seamless switching among four controlled model classes: MPNN, MPNN with chemistry/topology encoders, GPS-style hybrids of MPNN with global attention, and fully fused localglobal models with encoders. Using seven diverse open-source datasets for benchmarking across regression and classification tasks, we systematically isolate the contributions of message passing, global attention, and encoder-based feature augmentation. Our study shows that encoder-augmented MPNNs form a robust baseline, while fused localglobal models yield the clearest benefits for properties governed by long-range interaction effects. We further quantify the accuracycompute trade-offs of attention, reporting its overhead in memory. Together, these results establish the first controlled evaluation of global attention in atomistic graph learning and provide a reproducible testbed for future model development.

Equivariant graph neural networks↗