Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “error testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,243 records · Page 69
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

AXI4MLIR: User-Driven Automatic Host Code Generation for Custom AXI-Based Accelerators

Tensor algebra operations represent an important class of algorithms used across many applications, including machine learning, scientific computing, and data analytics. As a result, the efficient generation of custom accelerators for tensor operations has received increased attention. Previous efforts have produced automated tools enabling users to prototype and explore optimized accelerators. However, little effort has been focused on the host-accelerator interaction in these tools. Efficient use of hardware accelerators requires knowledge about the accelerator's capabilities (operations, data formats, and opcode support), the host CPU microarchitecture (e.g., memory hierarchy), the host-accelerator interface, and the application's features (which code regions should be mapped onto an accelerator). Manually rewriting the original applications to facilitate improved custom accelerator mapping is an error-prone and time-consuming endeavor. To cope with this, we propose AXI4MLIR, a new framework to automatically generate and optimize the communication between the host CPU and arbitrary accelerators that implement linear algebra algorithms. AXI4MLIR extends the MLIR compiler framework to automatically generate efficient host-accelerator driver code for accelerators with AXI-based interfaces. Our compiler extensions enable automatic driver code generation while carefully considering the host's memory hierarchy and target accelerator features. To demonstrate the flexibility and utility of AXI4MLIR, we test it with diverse use cases that include different types of accelerators, tiling scenarios, and dataflow schemes. We compare our experimental results to manual implementations of host-accelerator driver code and find that our approach can reduce CPU cache references by 56% and deliver up to a 1.65x speedup.

Bohm Agostini, Nicolas↗
DOE OSTI2021

Intercomparison of Aerosol Instrumental Responses Using AEROTRAK, SMPS, and APS in a Simulated Building

In this work, three aerosol instruments were intercompared by using data collected from field campaigns in a simulated building environment during the last quarter of 2020 from October to December at Oak Ridge National Laboratory. The three aerosol instruments—AeroTrak Model 9110, Scanning Mobility Particle Spectrometer (SMPS) 3080L + 3025A, and Aerodynamic Particle Sizer (APS) 3320—were manufactured by TSI Inc. to perform in situ measurements of particle number concentration in the air. These instruments were co-located in one room in which an aerosol generator was used to produce a defined aerosol population for the instruments to sample and detect in each campaign. The SMPS measured aerosol particles with diameters from 0.01 to 0.7 µm, APS measured aerosol particles with diameters from 0.5 to 20 µm, and AeroTrak measured aerosol particles with diameters from 0.1 to 10 µm. The results suggest that although AeroTrak is fast and easy to use, it does not provide measurements comparable with those obtained by SMPS and APS. The differences in particle counts were orders of magnitude in size (i.e., the AeroTrak data were unreasonably small in the tested scenarios). The results clearly indicate that AeroTrak should not be used in ambient applications in which the level of particle concentration is expected to be high. This would cause difficulty to a campaign in which the dilution factor is unknow a priori. The high particle concentration could also lead to an erroneous aerosol size distribution (e.g., a bimodal size distribution was measured as opposed to a single-mode one). The number concentration limit that AeroTrak is expected to run reliably (i.e., with a counting coincidence error less than ±10%) is approximately three to four per cubic centimeter. This suggests that the instrument is best used in a clean room environment, not in an ambient or indoor application, such as the Flexible Research Platform campaigns.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Photogrammetry: Develop methods for detecting deviations from expected geometry of components in a glovebox environment (Lawrence Livermore National Laboratory Aging and Lifetimes Program FY23, Milestone 8651, Grading Criterion #4)

Measurements in glovebox environments are challenging to conduct. Currently deployed techniques are time consuming and provide limited information. These limitations make current disposition and future assessments of products challenging. In FY23 we developed methods for detecting deviations of components in a glovebox environment that address these shortcomings by rapidly collecting information-dense measurements. Conducted tests demonstrate that camera pose (position and orientation) can be derived for images utilized in the photogrammetry process. This information, in conjunction with common image processing techniques, enables automated detection and size estimation of surface features. First, image processing is used to identify marks, or localized regions, that standout from the surrounding area. Then, the physical size of the region can be estimated because scale can be determined for photogrammetry images. Development of this methods shows that photogrammetry can identify measurable deviations from expected geometries. Although measurement error when using this technique through a glovebox window still needs to be reduced, this capability shows promise for eliminating or reducing the use of tedious manual measurements.

42 ENGINEERING↗
DOE OSTI2022

Chemical Cartography with APOGEE: Mapping Disk Populations with a 2-process Model and Residual Abundances

We apply a novel statistical analysis to measurements of 16 elemental abundances in 34,410 Milky Way disk stars from the final data release (DR17) of APOGEE-2. Building on recent work, we fit median abundance ratio trends [X/Mg] versus [Mg/H] with a 2-process model, which decomposes abundance patterns into a "prompt" component tracing core-collapse supernovae and a "delayed" component tracing Type Ia supernovae. For each sample star, we fit the amplitudes of these two components, then compute the residuals Δ[X/H] from this two-parameter fit. The rms residuals range from ~0.01–0.03 dex for the most precisely measured APOGEE abundances to ~0.1 dex for Na, V, and Ce. The correlations of residuals reveal a complex underlying structure, including a correlated element group comprised of Ca, Na, Al, K, Cr, and Ce and a separate group comprised of Ni, V, Mn, and Co. Selecting stars poorly fit by the 2-process model reveals a rich variety of physical outliers and sometimes subtle measurement errors. Residual abundances allow for the comparison of populations controlled for differences in metallicity and [α/Fe]. Relative to the main disk (R = 3–13 kpc), we find nearly identical abundance patterns in the outer disk (R = 15–17 kpc), 0.05–0.2 dex depressions of multiple elements in LMC and Gaia Sausage/Enceladus stars, and wild deviations (0.4–1 dex) of multiple elements in ω Cen. The residual abundance analysis opens new opportunities for discovering chemically distinctive stars and stellar populations, for empirically constraining nucleosynthetic yields, and for testing chemical evolution models that include stochasticity in the production and redistribution of elements.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Time-Varying Output Delay Compensation-A Model-Free Approach and its Application on Cooperative On-Ramp Merging

This paper presents a model-free approach to compensate for time-varying output delay in networked control systems. The proposed architecture combines a model-free observer and the Smith predictor. The model-free observer estimates the current state while handling modeling errors and uncertainties of the system. The Smith predictor moves the effect of time delay outside the control closed-loop using the estimated delayed output and the actual output of the plant. The proposed method is applied to a cooperative on-ramp merging problem. First, an ultra-local model predictive control is implemented to provide a computationally efficient online speed planner agnostic to the vehicle dynamics. After that, a model-free observer is designed to estimate the current state. Finally, the proposed architecture is tested against a time-varying output delay with an upper bound of 200 milliseconds. The results demonstrate the effectiveness of the proposed method with improved tracking of intervehicle distance.

Waleed khan, Muhammad [The University of Texas at ↗
DOE OSTI2022

Magnetic pair distribution function data using polarized neutrons and ad hoc corrections

Here, we report the first example of magnetic pair distribution function (mPDF) data obtained through the use of neutron polarization analysis. Using the antiferromagnetic semiconductor MnTe as a test case, we present high-quality mPDF data collected on the HYSPEC instrument at the Spallation Neutron Source using longitudinal polarization analysis to isolate the magnetic scattering cross section. Clean mPDF patterns are obtained for MnTe in both the magnetically ordered state and the correlated paramagnet state, where only short-range magnetic order is present. We also demonstrate significant improvement in the quality of high-resolution mPDF data through the application of ad hoc corrections that require only minimal human input, minimizing potential sources of error in the data processing procedure. We briefly discuss the current limitations and future outlook of mPDF analysis using polarized neutrons. Overall, this work provides a useful benchmark for mPDF analysis using polarized neutrons and provides an encouraging picture of the potential for routine collection of high-quality mPDF data.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2025

Learning error distribution kernel‐enhanced neural network methodology for multi‐intersection signal control optimization

Traffic congestion has substantially induced significant mobility and energy inefficiency. Many research challenges are identified in traffic signal control and management associated with artificial intelligence (AI)-based models. For example, developing AI-driven dynamic traffic system models that accurately capture high-resolution traffic attributes and formulate robust control algorithms for traffic signal optimization is difficult. Additionally, uncertainties in traffic system modeling and control processes can further complicate traffic signal system controllability. To partially address these challenges, this study presents a novel, hybrid neural network model enhanced with a probability density function kernel shaping technique to formulate traffic system dynamics better and improve comprehensive traffic network modeling and control. The numerical experimental tests were conducted, and the results demonstrate that the proposed control approach outperforms the baseline control strategies and reduces overall average delays by 11.64% on average. By leveraging the capabilities of this innovative model, this study aims to address major challenges related to traffic congestion and energy inefficiency toward more effective and adaptable AI-based traffic control systems.

Wang, Hong [Oak Ridge National Laboratory (ORNL), ↗
DOE OSTI2026

Flow pattern and void fraction characterization in nitrogen/water flows through a diamond-type triply periodic minimal surface lattice

Here, this study presents, to the authors knowledge, the first experimental investigation on the void fraction and flow patterns in two-phase flows through a diamond-type Triply Periodic Minimal Surface (TPMS) lattice. An additively manufactured TPMS structure was tested under upward co-current flow of a water/nitrogen mixture. Superficial velocities varied for a total of 42 test conditions (gas: 0.01–2.4 m/s; liquid: 0.01–2.4 m/s; mass flux: 20–2370 kg/m 2 ·s). High-speed video and X-ray imaging enabled time-averaged void fraction measurements and identified six distinct flow regimes which were used to develop a flow pattern map. Comparison of the void fraction data with correlations from literature demonstrated the Rouhani and Axelsson (1970) [49] correlation modified by Steiner (1993) [52] provided the best agreement, which was improved with empirically fit coefficients. This approach predicted the void fraction with errors < ±20% for 64% of the data, with a mean absolute percent deviation (MAPD) of 23%. The measured frictional pressure drop was compared to correlations from literature which captured the observed trends but did not provide good accuracy. The best agreement was found after optimizing the empirical coefficients of the Muller-Steinhagen & Heck (1986) [56] correlation; this approach captured 33% of the data within ±20% with a MAPD of 46% over the full range and captured 71% of the data within ±20% a MAPD of 13.3% at mass fluxes >1100 kg/m 2 -s. These results provide foundational insight into TPMS two-phase flow behavior and inform modeling and design of advanced heat exchange components incorporating TPMS geometries.

42 - ENGINEERING↗
DOE OSTI2026

Modeling and Experimental Demonstration of Flux Spreading in Light Trapping Planar-Cavity Solar Enclosed Particle Receivers

This study experimentally validates and numerically models the flux-spreading effect in a light-trapping planar-cavity solar receiver) for particle-based concentrating solar power systems. The receiver's shallow cavity with vertical planar walls redistributes concentrated solar flux, reducing peak intensity and achieving uniform heat flux. On-sun tests at National Renewable Energy Laboratory's High-Flux Solar Furnace under flux up to 1500 kW/m2 measured cavity wall temperatures, which were compared with Monte Carlo ray-tracing (SolTrace) and computational numerical simulations. Three angular absorptance models were evaluated: constant absorptance, a Pyromark-based directional model, and a Fresnel-based Cr2O3 model. The Fresnel-derived model showed the best agreement with experiments, achieving high correlation (PC > 0.85), structural similarity (SSIM > 0.98), and signal-to-noise ratios (PSNR > 40 dB), with temperature prediction errors of 1-11%. Results confirm that flux spreading mitigates local overheating and validate the integrated modeling approach, supporting the solar receiver scalability for high-efficiency, high-temperature concentrating solar power applications.

14 SOLAR ENERGY↗
DOE OSTI2025

Improving tropical cyclone rapid intensification forecasts with satellite measurements of sea surface salinity and calibrated machine learning

Forecasting rapid intensification (RI) of tropical cyclones (TC) is a mission known for large errors. One under-researched factor that affects TC intensification is salinity, which is important for density stratification in certain ocean regions and can affect the surface enthalpy flux under a strengthening hurricane. To investigate the impact and efficacy of using salinity information in state-of-the-art forecasting, we use a statistical model consisting of a variety of machine learning (ML) methods. For salinity data, we use satellite measurements of pre-storm sea surface salinity (SSS) as a proxy for the salinity stratification. We train and test the model on various ocean basins, including the Atlantic, eastern North Pacific and western North Pacific. A calibrator is trained on top of the ML models to correct and enhance probability forecasts. The calibrator significantly improves probability forecasts relative to recent works. The ML model performance is improved with the addition of SSS in the Eastern North Pacific, western North Pacific, and the Caribbean subregion of the North Atlantic, and the overall model performance is better than previous studies. SSS decreases model skill for a model trained on the full Atlantic basin. In the Indian Ocean, SSS is also notably correlated with RI occurrence, but the TC samples are not sufficient to train ML models.

hurricane↗
DOE OSTI2019

Evaluating next-generation intensity–duration–frequency curves for design flood estimates in the snow-dominated western United States

Civil infrastructure such as culverts and bridges are commonly designed using precipitation-based intensity-duration-frequency (PREC-IDF) curves, which assume that the occurrence of precipitation is in the form of rainfall and immediately available for the rainfall-runoff process. In snow-dominated regions, where most winter precipitation occurs as snow that melts during spring to early summer, the use of standard PREC-IDF curves may lead to substantial underestimation of design floods and high failure risk of infrastructure. In this context, we developed next-generation IDF (NG-IDF) curves that characterize the actual water reaching the land surface (i.e., rainfall plus snowmelt) to enhance standard infrastructure design in snow-dominated regions. This study evaluates the performance of NG-IDF curves coupled with U.S. Department of Agriculture Technical Release 55 hydrologic model in estimating design floods for 246 snowy locations in different hydroclimate regimes of the western United States. Design flood estimates from a well-validated continuous simulation using a physics-based hydrologic model, the Distributed Hydrology Soil Vegetation Model (DHSVM), were used as the performance benchmark. Compared with the benchmark estimates, the standard PREC-IDF curves led to substantial errors in design flood estimates while the NG-IDF curves significantly reduced these errors. For example, the averaged error in the 50-year design flood estimates over the 246 locations was reduced from 31% with the use of PREC-IDF curves to 12% with the use of NG-IDF curves. Despite the different model structures, the single-event NG-IDF approach versus the continuous simulation DHSVM did not exhibit statistically significant differences in 91% of the 246 locations for the 50-year design flood estimates. We find this indicates a satisfactory performance of NG-IDF curves to estimate design flow under the conditions tested in the snow-dominated western United States. This article also presents technical suggestions and the limitations of infrastructure design using NG-IDF curves for regulatory agencies and practicing engineers.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

CIRCLEZ : Reliable photometric redshifts for active galactic nuclei computed solely using photometry from Legacy Survey Imaging for DESI

Photometric redshifts for galaxies hosting an accreting supermassive black hole in their center, known as active galactic nuclei (AGNs), are notoriously challenging. At present, they are most optimally computed via spectral energy distribution (SED) fittings, assuming that deep photometry for many wavelengths is available. However, for AGNs detected from all-sky surveys, the photometry is limited and provided by a range of instruments and studies. This makes the task of homogenizing the data challenging, presenting a dramatic drawback for the millions of AGNs that wide surveys such as SRG/eROSITA are poised to detect. This work aims to compute reliable photometric redshifts for X-ray-detected AGNs using only one dataset that covers a large area: the tenth data release of the Imaging Legacy Survey (LS10) for DESI. LS10 provides deep grizW1-W4 forced photometry within various apertures over the footprint of the eROSITA-DE survey, which avoids issues related to the cross-calibration of surveys. We present the results from CIRCLEZ, a machine-learning algorithm based on a fully connected neural network. CIRCLEZ is built on a training sample of 14 000 X-ray-detected AGNs and utilizes multi-aperture photometry, mapping the light distribution of the sources. The accuracy (σNMAD) and the fraction of outliers (η) reached in a test sample of 2913 AGNs are equal to 0.067 and 11.6%, respectively. The results are comparable to (or even better than) what was previously obtained for the same field, but with much less effort in this instance. We further tested the stability of the results by computing the photometric redshifts for the sources detected in CSC2 and Chandra-COSMOS Legacy, reaching a comparable accuracy as in eFEDS when limiting the magnitude of the counterparts to the depth of LS10. The method can be applied to fainter samples of AGNs using deeper optical data from future surveys (for example, LSST, Euclid), granting LS10-like information on the light distribution beyond the morphological type. Along with this paper, we have released an updated version of the photometric redshifts (including errors and probability distribution functions) for eROSITA/eFEDS.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

$Z$-Pinch Interferometry Analysis With the Fourier-Based TNT Code

Here, we present the analysis of interferometry diagnostics with the user-friendly Talbot Numerical Tool (TNT), a Fourier-based postprocessing code that enables real-time assessment of plasma systems. TNT performance was explored with visible and infrared interferometry in pulsed-power-driven Z -pinch configurations to expand its capabilities beyond Talbot X-ray interferometry in the high-intensity laser environment. TNT enabled accurate electron density characterization of magnetically driven plasma flows and shocks through phase-retrieval methods that did not require data modification or masking. TNT demonstrated enhanced resolution, detecting below 4 % fringe shift, which corresponds to 8.7 × 10 15 cm –2 within 28 μ m, approaching the laser probing system limit. TNT was tested against a well-known interferometry analysis software, delivering an average resolving power nearly ten times better (~28 μ m versus ~ 210 μ m) when resolving plasma ablation features. TNT demonstrated higher sensitivity when probing sharp electron density gradients in supersonic shocks. A maximum electron areal density of 4.1 × 10 17 cm –2 was measured in the shocked plasma region, and a minimum electron density detection of ~ 1.0 × 10 15 cm –2 was achieved. When probing colliding plasma flows, the calculations of the effective adiabatic index and the associated errors were improved from γ* = 2.6 ± 1.6 – 1.4 ± 0.2 with TNT postprocessing, contributing valuable data for the interpretation of radiative transport. Additional applications of TNT in the characterization of pulsed-power plasmas and beyond are discussed.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

Novel Technique for Developing Linearized Convex System Models from Experimentally Derived Data

This paper presents a novel technique for generating a convex system model from an experimentally derived data set which features variance among repeated measurements. The convex system model developed as a test case characterizes the dynamic system losses of a vanadium redox flow battery as a function of the active power output and the battery state of charge. The technique hinges on a pre-cleaning via clustering procedure which precedes the formation of a planar convex hull comprised of triangular simplices. The clustering procedure efficiently reduces the experimental data set while mitigating variance among repeated measurements and removes outliers. Ultimately, the lower evelope of the planar convex hull serves as the desired convex system model. The proposed technique reduces systematic model error which is otherwise present when directly developing a planar convex hull model based on an unreduced data set.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Impact of Changes in ENDF/B-VII.1 and ENDF/B-VIII.0 235U Nuclear Data Indicated by NDSE Studies on LLNL Pulsed Sphere Simulations

A recent journal article by J.A. Gomez et al. measured gamma-ray die-off curves of three subcritical static highly-enriched uranium (HEU) assemblies driven by an external neutron source with a new detector system. This new detector system was developed for being used in dynamically driven subcritical assemblies as part of the Neutron Diagnosed Subcritical Experiments (NDSE) program. Simulations of these die-off curves with various nuclear data and comparison to experimental data indicated that a decrease of the ENDF/B-VII.1 235 U(n,inl) cross section by a factor 0.8 and 0.85 for ENDF/B-VIII.0 would lead to better predictions of experimental data. Here, we test the proposed changes with another type of measurement response, namely neutron-leakage spectra emitted in LLNL pulsed sphere measurements. These spheres were pulsed by 14-MeV neutrons produced via the D+T reaction in their center. The proposed changes in nuclear data have a distinctly smaller impact on predicting pulsed-sphere neutron-leakage spectra than for the die-off curves; they lead to a worsened prediction of the inelastic valley of LLNL pulsed-sphere neutron spectra indicating that the proposed change could constitute a compensating error. Changes in the inelastic angular distributions along with the cross section might be worthwhile to study

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Utilization of Synthetic Near-Infrared Spectra via Generative Adversarial Network to Improve Wood Stiffness Prediction

Near-infrared (NIR) spectroscopy is widely used as a nondestructive evaluation (NDE) tool for predicting wood properties. When deploying NIR models, one faces challenges in ensuring representative training data, which large datasets can mitigate but often at a significant cost. Machine learning and deep learning NIR models are at an even greater disadvantage because they typically require higher sample sizes for training. In this study, NIR spectra were collected to predict the modulus of elasticity (MOE) of southern pine lumber (training set = 573 samples, testing set = 145 samples). To account for the limited size of the training data, this study employed a generative adversarial network (GAN) to generate synthetic NIR spectra. The training dataset was fed into a GAN to generate 313, 573, and 1000 synthetic spectra. The original and enhanced datasets were used to train artificial neural networks (ANNs), convolutional neural networks (CNNs), and light gradient boosting machines (LGBMs) for MOE prediction. Overall, results showed that data augmentation using GAN improved the coefficient of determination (R 2 ) by up to 7.02% and reduced the error of predictions by up to 4.29%. ANNs and CNNs benefited more from synthetic spectra than LGBMs, which only yielded slight improvement. All models showed optimal performance when 313 synthetic spectra were added to the original training data; further additions did not improve model performance because the quality of the datapoints generated by GAN beyond a certain threshold is poor, and one of the main reasons for this can be the size of the initial training data fed into the GAN. LGBMs showed superior performances than ANNs and CNNs on both the original and enhanced training datasets, which highlights the significance of selecting an appropriate machine learning or deep learning model for NIR spectral-data analysis. The results highlighted the positive impact of GAN on the predictive performance of models utilizing NIR spectroscopy as an NDE technique and monitoring tool for wood mechanical-property evaluation. Further studies should investigate the impact of the initial size of training data, the optimal number of generated synthetic spectra, and machine learning or deep learning models that could benefit more from data augmentation using GANs.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Temporal Subsampling Diminishes Small Spatial Scales in Recurrent Neural Network Emulators of Geophysical Turbulence

The immense computational cost of traditional numerical weather and climate models has sparked the development of machine learning (ML) based emulators. Because ML methods benefit from long records of training data, it is common to use data sets that are temporally subsampled relative to the time steps required for the numerical integration of differential equations. Here, we investigate how this often overlooked processing step affects the quality of an emulator's predictions. We implement two ML architectures from a class of methods called reservoir computing: (a) a form of Nonlinear Vector Autoregression (NVAR), and (b) an Echo State Network (ESN). Despite their simplicity, it is well documented that these architectures excel at predicting low dimensional chaotic dynamics. We are therefore motivated to test these architectures in an idealized setting of predicting high dimensional geophysical turbulence as represented by Surface Quasi-Geostrophic dynamics. In all cases, subsampling the training data consistently leads to an increased bias at small spatial scales that resembles numerical diffusion. Interestingly, the NVAR architecture becomes unstable when the temporal resolution is increased, indicating that the polynomial based interactions are insufficient at capturing the detailed nonlinearities of the turbulent flow. The ESN architecture is found to be more robust, suggesting a benefit to the more expensive but more general structure. Spectral errors are reduced by including a penalty on the kinetic energy density spectrum during training, although the subsampling related errors persist. Future work is warranted to understand how the temporal resolution of training data affects other ML architectures.

58 GEOSCIENCES↗
DOE OSTI2023

HPC-driven computational reproducibility in numerical relativity codes: a use case study with IllinoisGRMHD

Abstract Reproducibility of results is a cornerstone of the scientific method. Scientific computing encounters two challenges when aiming for this goal. Firstly, reproducibility should not depend on details of the runtime environment, such as the compiler version or computing environment, so results are verifiable by third-parties. Secondly, different versions of software code executed in the same runtime environment should produceconsistent numerical results for physical quantities. In this manuscript, we test the feasibility of reproducing scientific results obtained using theIllinoisGRMHDcode that is part of an open-source community software for simulation in relativistic astrophysics, theEinstein Toolkit. We verify that numerical results of simulating a single isolated neutron star withIllinoisGRMHDcan be reproduced, and compare them to results reported by the code authors in 2015. We use two different supercomputers: Expanse at SDSC, and Stampede2 at TACC. By compiling the source code archived along with the paper on both Expanse and Stampede2, we find thatIllinoisGRMHDreproduces results published in its announcement paper up to errors comparable to round-off level changes in initial data parameters. We also verify that a current version ofIllinoisGRMHDreproduces these results once we account for bug fixes which have occurred since the original publication.

Astronomy & Astrophysics↗