SEARCH · Engineering Papers

Results for “Error estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,117 records · Page 62

All sources NASA NTRS DOE OSTI

DOE OSTI2025

Site C1a - NREL ASSIST (SN12) Thermodynamic Retrievals TROPoe / Derived Data

This dataset contains daily files with thermodynamic profiles retrieved with the optimal estimation physical retrieval TROPoe v0.12 (Turner and Löhnert 2014; Turner and Blumberg 2019; Turner and Löhnert 2021). The profiles are retrieved every 10 minutes from instantaneous observations from the NREL ASSIST-II (SN 12) infrared spectrometer. Observations are noise-filtered but not averaged in time to minimize errors due to non-uniform clouds. Additional input data in TROPoe are cloud base height (CBH), which is a combined data product that uses data from ceilometers at sites A1 and H and scanning lidars from ARM sites C1 and E37. The CBH is weighted inversely proportionally to the distance to the respective site to take into account the spatial variability of clouds (see https://github.com/StefanoWind/ASSIST_analysis/blob/main/awaken_processing/combine_cbh.py). The full pipeline for running the retrieval is available at https://github.com/StefanoWind/TROPoe_processor. Met data was not ingested. In addition to these temporally resolved input data, TROPoe requires an a priori dataset (prior) that provides mean climatological estimates of thermodynamic profiles and specifies how temperature and humidity covary with height as an input (for details see, e.g., Djalalova et al. 2022). The prior is a key component of the retrieval and provides a constraint on the ill-posed inversion problem. A monthly prior was computed from operational radiosonde launches at ARM SGP, OK.

17 WIND ENERGY↗

DOE OSTI2023

Modeled production, oxidation, and transport processes of wetland methane emissions in temperate, boreal, and Arctic regions

Abstract Wetlands are the largest natural source of methane (CH 4 ) to the atmosphere. The eddy covariance method provides robust measurements of net ecosystem exchange of CH 4 , but interpreting its spatiotemporal variations is challenging due to the co‐occurrence of CH 4 production, oxidation, and transport dynamics. Here, we estimate these three processes using a data‐model fusion approach across 25 wetlands in temperate, boreal, and Arctic regions. Our data‐constrained model—iPEACE—reasonably reproduced CH 4 emissions at 19 of the 25 sites with normalized root mean square error of 0.59, correlation coefficient of 0.82, and normalized standard deviation of 0.87. Among the three processes, CH 4 production appeared to be the most important process, followed by oxidation in explaining inter‐site variations in CH 4 emissions. Based on a sensitivity analysis, CH 4 emissions were generally more sensitive to decreased water table than to increased gross primary productivity or soil temperature. For periods with leaf area index (LAI) of ≥20% of its annual peak, plant‐mediated transport appeared to be the major pathway for CH 4 transport. Contributions from ebullition and diffusion were relatively high during low LAI (<20%) periods. The lag time between CH 4 production and CH 4 emissions tended to be short in fen sites (3 ± 2 days) and long in bog sites (13 ± 10 days). Based on a principal component analysis, we found that parameters for CH 4 production, plant‐mediated transport, and diffusion through water explained 77% of the variance in the parameters across the 19 sites, highlighting the importance of these parameters for predicting wetland CH 4 emissions across biomes. These processes and associated parameters for CH 4 emissions among and within the wetlands provide useful insights for interpreting observed net CH 4 fluxes, estimating sensitivities to biophysical variables, and modeling global CH 4 fluxes.

Ueyama, Masahito↗

DOE OSTI2025

Model Form Error Correction for a Black-Box Thermal Battery Heat Transfer Simulation

Thermal batteries are crucial for supplying power to high-consequence engineering applications such as rockets. Computational simulations have been developed to predict thermal battery behavior, but these simulations often suffer from modeling errors, including model form uncertainty. Addressing this uncertainty can be achieved by quantifying either the model discrepancy in the output or the model form error (MFE) in the governing equation. MFE is particularly valuable as it can be better extrapolated beyond observed outputs, which is essential for predictions involving changes in external system loading, system configuration and geometry, or output quantities. This paper employs a state estimation approach to estimate MFE using experimental data and then utilizes machine learning (ML) to model its relationship with state variables. A nonintrusive technique is used to estimate MFE in a black-box thermal battery heat transfer simulation. The trained machine learning model for MFE is then applied to correct simulation predictions under extrapolated initial conditions and battery configurations. In conclusion, the methodology's performance is evaluated using additional experimental data, demonstrating its effectiveness in improving prediction accuracy.

Batteries↗

DOE OSTI2023

Virtual sensing of wind turbine hub loads and drivetrain fatigue damage, Virtuelle Sensoren für die Messung von Hauptwellenlasten und Ermüdungsschäden im Antriebstrang von Windenergieanlagen

Abstract: This paper presents a Digital Twin for virtual sensing of wind turbine aerodynamic hub loads, as well as monitoring the accumulated fatigue damage and remaining useful life in drivetrain bearings based on measurements of the Supervisory Control and Data Acquisition (SCADA) and the drivetrain condition monitoring system (CMS). The aerodynamic load estimation is realized with data-driven regression models, while the estimation of local bearing loads and damage is conducted with physics-based, analytical models. Field measurements of the DOE 1.5 research turbine are used for model training and validation. The results show low errors of 6.4% and 1.1% in the predicted damage at the main and the generator side high-speed bearing respectively. Zusammenfassung: In diesem Aufsatz wird ein digitaler Zwilling für Windenergieanlagen vorgestellt, welcher die virtuelle Erfassung der Hauptwellenlasten und die Zustandsüberwachung von Ermüdungschäden und der verbleibende Nutzungsdauer der Antriebsstranglager ermöglicht. Der digital Zwilling nutzt Messdaten des Supervisory Control and Data Acquisition (SCADA) Systems und des Zustandsüberwachungssystems des Antriebsstranges (CMS). Die Berechnung der Hauptwellenlasten ist mit datenbasierten Regressionsmodellen umgesetzt, während die Berechnung der Lagerkräfte und der Ermüdungsschaden mit physikbasierten Modelle durchgeführt wird. Für die Modellentwicklung und -validierung werden Feldmessdaten der DOE 1.5MW Turbine eingesetzt. Die Abweichungen in den Ermüdungsschäden am Hauptwellenlager und am Generatorwellenlager betragen lediglich 6,4% beziehungsweise 1,1%.

17 WIND ENERGY↗

DOE OSTI2023

On fast simulation of dynamical system with neural vector enhanced numerical solver

The large-scale simulation of dynamical systems is critical in numerous scientific and engineering disciplines. However, traditional numerical solvers are limited by the choice of step sizes when estimating integration, resulting in a trade-off between accuracy and computational efficiency. To address this challenge, we introduce a deep learning-based corrector called Neural Vector (NeurVec), which can compensate for integration errors and enable larger time step sizes in simulations. Our extensive experiments on a variety of complex dynamical system benchmarks demonstrate that NeurVec exhibits remarkable generalization capability on a continuous phase space, even when trained using limited and discrete data. NeurVec significantly accelerates traditional solvers, achieving speeds tens to hundreds of times faster while maintaining high levels of accuracy and stability. Moreover, NeurVec’s simple-yet-effective design, combined with its ease of implementation, has the potential to establish a new paradigm for fast-solving differential equations based on deep learning.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Sub 20 cm -1 computational prediction of the CH bond energy – a case of systematic error in computational thermochemistry

Here, the bond dissociation energy of methylidyne, D 0 (CH), is studied using an improved version of the High-Accuracy Extrapolated ab initio Thermochemistry (HEAT) approach as well as the Feller–Peterson–Dixon (FPD) model chemistry. These calculations, which include basis sets up to nonuple (aug-cc-pCV9Z) quality, are expected to be capable of providing results substantially more accurate than the ca. 1 kJ mol -1 level that is characteristic of standard high-accuracy protocols for computational thermochemistry. The calculated 0 K CH bond energy (27 954 ± 15 cm -1 for HEAT and 27 956 ± 15 cm -1 for FPD), along with equivalent treatments of the CH ionization energy and the CH + dissociation energy (85 829 ± 15 cm -1 and 32 946 ± 15 cm -1 , respectively), were compared to the existing benchmarks from Active Thermochemical Tables (ATcT), uncovering an unexpected difference for D 0 (CH). This has prompted a detailed reexamination of the provenance of the corresponding ATcT benchmark, allowing the discovery and subsequent correction of a systematic error present in several published high-level calculations, ultimately yielding an amended ATcT benchmark for D 0 (CH). Finally, the current theoretical results were added to the ATcT Thermochemical Network, producing refined ATcT estimates of 27 957.3 ± 6.0 cm -1 for D0(CH), 32 946.7 ± 0.6 cm -1 for D 0 (CH + ), and 85 831.0 ± 6.0 cm -1 for IE(CH).

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2024

Cosmological parameter forecasts for a CMB-HD survey

We present forecasts on cosmological parameters for a CMB-HD survey. For a $\Lambda$CDM + $N_{eff}$ + $\sum m_\nu$ model, we find $\sigma(n_s) = 0.0013$ and $\sigma(N_{eff}) = 0.014$ using CMB and CMB lensing multipoles in the range of $\ell \in [30, 20000]$, after adding anticipated residual foregrounds, delensing the acoustic peaks, and adding DESI BAO data. This is about a factor of two improvement in ability to probe inflation via $n_s$ compared to precursor CMB surveys. The $N_{eff}$ constraint can rule out light thermal particles back to the end of inflation with 95% CL; for example, it can rule out the QCD axion in a model-independent way assuming the Universe's reheating temperature was high enough that the axion thermalized. We find that delensing the acoustic peaks and adding DESI BAO tightens parameter constraints. We also find that baryonic effects can bias parameters if not marginalized over, and that uncertainties in baryonic effects can increase parameter error bars; however, the latter can be mitigated by including information about baryonic effects from kinetic and thermal Sunyaev-Zel'dovich measurements by CMB-HD. The CMB-HD likelihood and Fisher estimation codes used here are publicly available; the likelihood is integrated with Cobaya to facilitate parameter forecasting.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2024

Online and Offline Identification of False Data Injection Attacks in Battery Sensors Using a Single Particle Model

The cells in battery energy storage systems are monitored, protected, and controlled by battery management systems whose sensors are susceptible to cyberattacks. False data injection attacks (FDIAs) targeting batteries’ voltage sensors affect cell protection functions and the estimation of critical battery states like the state of charge (SoC). Inaccurate SoC estimation could result in battery overcharging and over discharging, which can have disastrous consequences on grid operations. This paper proposes a three-pronged online and offline method to detect, identify, and classify FDIAs corrupting the voltage sensors of a battery stack. To accurately model the dynamics of the series-connected cells a single particle model is used and to estimate the SoC, the unscented Kalman filter is employed. FDIA detection, identification, and classification was accomplished using a tuned cumulative sum (CUSUM) algorithm, which was compared with a baseline method, the chi-squared error detector. Online simulations and offline batch simulations were performed to determine the effectiveness of the proposed approach. Throughout the batch simulations, the CUSUM algorithm detected attacks, with no false positives, in 99.83% of cases, identified the corrupted sensor in 97% of cases, and determined if the attack was positively or negatively biased in 97% of cases.

25 ENERGY STORAGE↗

DOE OSTI2026

Unbinned extraction of $γ$ from $B\to DK$ with normalizing flows

We introduce an unbinned method for extracting the CKM angle $γ$ from the decay chain $B^\pm \to (D \to K_S π^+ π^-) K^\pm$ using normalizing flows (NFs). The NFs, trained on $D$ decay data, learn a faithful continuous representation of the amplitude and strong phase variation over the $D\to K_Sπ^+π^-$ Dalitz plot whose fidelity improves with increased data sample sizes. With this input, the $B$ decay data can be used to extract the parameters $r_B$, $δ_B$, and $γ$. We test the method on Monte Carlo generated data, where it successfully recovers the injected value of $γ$ within uncertainties. The present implementation propagates statistical uncertainties from finite training data via an ensemble of independently trained flows, and does not attempt to capture the effects of systematic experimental errors. We explore two versions of the method that differ in how the trigonometric constraint on phase variation is encoded, and comment on the possible extension to Bayesian NFs, which would provide direct uncertainty estimates on the learned densities without requiring ensemble training.

Grossman, Yuval [Cornell U., LEPP]↗

DOE OSTI2022

Automatic Calibration of a Geomechanical Model from Sparse Data for Estimating Stress in Deep Geological Formations

Summary In this study, we demonstrate geomechanical modeling with fully automatic parameter calibration to estimate the full geomechanical stress fields of a prospective US carbon dioxide (CO2) storage site, based on sparse measurement data. The goal is to compute full stress tensor field estimates (principal stresses and orientations) that are maximally compatible with observations within the constraints of the model assumptions, thereby extending pointwise, incomplete partial stress measurement to a simulated full formation stress field, as well as a rough assessment of the associated error. We use the Perch site, located in Otsego County, Michigan, USA, as our case study. The input data consist of partial stress tensor information inferred from in-situ borehole tests, geophysical well logs, and processing of seismic data. A static earth model (SEM) of the site was developed, and geomechanical simulation functionality of the open-source MATLAB Reservoir Simulation Toolbox (MRST) was used to model the stress field. Adjoint-based nonlinear optimization was used to adjust boundary conditions and material properties to calibrate simulated results of observations. Results were interpreted through a Bayesian framework. The focus of this paper is to demonstrate how the fully automatic calibration procedure works and discuss the results obtained; it does not attempt a detailed analysis of the stress field in the context of the proposed CO2 storage initiatives. Our work is part of a larger effort to noninvasively determine in-situ stresses in deep formations considered for CO2 storage. Guided by previously published research on geomechanical model calibration, our work presents a novel calibration approach supporting a potentially large number of linear or nonlinear calibration parameters to produce results optimally agreeing with available measurements and thus extend partial pointwise estimates to full tensor fields compatible with the physics of the site.

Engineering↗

DOE OSTI2025

Wet-radome attenuation in ARM cloud radars and its utilization in radar calibration using disdrometer measurements

Abstract. A relative calibration technique has been developed for the US Department of Energy's (DOE's) Atmospheric Radiation Measurement (ARM) user facility Ka-band ARM Zenith Radars (KAZRs). This method uses the signal attenuation caused by water on the radome to estimate reflectivity factor (Ze) offsets. The wet-radome attenuation (WRA) is assumed to follow a log-linear relationship with rainfall rate during light and moderate rain, as measured by a collocated surface disdrometer. The technique has an uncertainty of approximately 3 dB, due to factors such as disdrometer measurement error, rain variability between radar and disdrometer sample volumes, and the fitting function's uncertainty for the WRA behavior. A practical advantage of this WRA-based approach to shorter-wavelength radar monitoring is that, while it requires a reference disdrometer, it proves feasible for a wider range of collocated disdrometer measurements compared to traditional direct disdrometer comparison at the onset of light rain. This technique thus offers a cost-effective monitoring tool for remote or long-term radar deployments. This calibration technique was applied during the ARM Tracking Aerosol Convection Interactions Experiment (TRACER) from October 2021 through September 2022. The estimated Ze offsets were compared against traditional radar calibration and monitoring methods using available datasets from this campaign. Results show that the WRA-based offsets align closely with mean offsets found between cloud radars and from direct disdrometer comparison near the onset of rain, while also reflecting similar offset and campaign-long trends when compared to collocated, independently calibrated radar wind profilers. Nevertheless, overall, the KAZR Ze offsets estimated during TRACER remained stable at approximately 2 dB lower than the disdrometer estimates from the campaign start until the end of June 2022; afterward, the offsets increased to around 7 dB by the campaign's end. This increase is linked to a drop of about 1 dB in transmitter power toward the end of the project.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Galaxy blending effects in deep imaging cosmic shear probes of cosmology

ABSTRACT Upcoming deep imaging surveys such as the Vera C. Rubin Observatory Legacy Survey of Space and Time will be confronted with challenges that come with increased depth. One of the leading systematic errors in deep surveys is the blending of objects due to higher surface density in the more crowded images; a considerable fraction of the galaxies which we hope to use for cosmology analyses will overlap each other on the observed sky. In order to investigate these challenges, we emulate blending in a mock catalogue consisting of galaxies at a depth equivalent to 1.3 yr of the full 10-yr Rubin Observatory that includes effects due to weak lensing, ground-based seeing, and the uncertainties due to extraction of catalogues from imaging data. The emulated catalogue indicates that approximately 12 per cent of the observed galaxies are ‘unrecognized’ blends that contain two or more objects but are detected as one. Using the positions and shears of half a billion distant galaxies, we compute shear–shear correlation functions after selecting tomographic samples in terms of both spectroscopic and photometric redshift bins. We examine the sensitivity of the cosmological parameter estimation to unrecognized blending employing both jackknife and analytical Gaussian covariance estimators. An ∼0.025 decrease in the derived structure growth parameter S8 = σ8(Ωm/0.3)0.5 is seen due to unrecognized blending in both tomographies with a slight additional bias for the photo-z-based tomography. This bias is greater than the 2σ statistical error in measuring S8.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2022

Quantifying modeling uncertainty in simplified beam models for building response prediction

The use of simple models for response prediction of building structures is preferred in earthquake engineering for risk evaluations at regional scales, as they make computational studies more feasible. The primary impediment in their gainful use presently is the lack of viable methods for quantifying (and reducing upon) the modeling errors/uncertainties they bear. This study presents a Bayesian calibration method wherein the modeling error is embedded into the parameters of the model. Here, the method is specifically described for coupled shear-flexural beam models here, but it can be applied to any parametric surrogate model. The major benefit the method offers is the ability to consider the modeling uncertainty in the forward prediction of any degree-of-freedom or composite response regardless of the data used in calibration. The method is extensively verified using two synthetic examples. In the first example, the beam model is calibrated to represent a similar beam model but with enforced modeling errors. In the second example, the beam model is used to represent the detailed finite element model of a 52-story building. Both examples show the capability of the proposed solution to provide realistic uncertainty estimation around the mean prediction.

47 OTHER INSTRUMENTATION↗

DOE OSTI2023

Quantification of Physical and Numerical Mixing in a Coastal Ocean Model Using Salinity Variance Budgets

Numerical mixing, the spurious mixing primarily generated by the discretization of advection, is often significant in estuarine and coastal models due to sharp, energetic fronts. In this study, we compare on- and offline estimates of numerical mixing in a submesoscale-resolving realistic simulation of the ocean state over the Texas-Louisiana continental shelf. While offline estimates of numerical mixing differ from online estimates, offline methods may be the only analysis available. This study offers insight into the differences between the on- and offline methods. We use two methods to estimate numerical mixing offline, based on salinity squared $s^2$ and volume-mean salinity variance $s^{\prime^2}$. Numerical mixing estimated from the $s^{\prime^2}$ budget is generally within 60\% of the magnitude for the online method but captures the temporal variability well. However, the $s^2$ budget compares poorly due to larger truncation errors associated with the tendency and advection terms, which can be reduced by increasing the model output frequency. We also investigate the effects of horizontal resolution on numerical mixing using a two-way nested grid. The volume-integrated numerical mixing constitutes 57\% of the bulk physical mixing -- the mixing prescribed by the turbulence closure scheme -- in the coarse model and may exceed the physical mixing by half an order of magnitude. We find that numerical mixing is reduced by 35\% on average in the nested model, less than expected based on scaling of the numerical mixing for an upwind advection scheme, likely due to new dynamical processes that emerge in the nested simulation.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

Gaussian Process Regression under Computational and Epistemic Misspecification

Gaussian process regression is a classical kernel method for function estimation and data interpolation. In large data applications, computational costs can be reduced using low-rank or sparse approximations of the kernel. This paper investigates the effect of such kernel approximations on the interpolation error. We introduce a unified framework to analyze Gaussian process regression under important classes of computational misspecification: Karhunen-Loève expansions that result in low-rank kernel approximations, multiscale wavelet expansions that induce sparsity in the covariance matrix, and finite element representations that induce sparsity in the precision matrix. Furthermore, our theory also accounts for epistemic misspecification in the choice of kernel parameters.

Gaussian process regression↗

DOE OSTI2022

Challenge Problem 1: Preliminary Model Development and Assessment of Flexible Heat Transfer Modeling Approaches

This report presents the modeling progress of a university consortium studying flexible modeling for turbulent heat transfer. In the context of advanced nuclear reactor design, where challenges include non-unity Prandtl fluids, free and mixed convection, and transitional flow, computational fluid dynamics methods are underutilized due to low confidence in modeling approaches and high computational cost. This report evaluates the performance of engineering CFD models in diabatic, buoyant turbulent flow. It finds that all turbulence models including several variants of the k-ε and k-ω models struggle to predict accurate turbulent momentum and heat transfer in such flows. The Nusselt numbers have been compared between the models and the DNS data, where calculations have been performed for each case and trends have shown a good agreement between DNS estimated Nusselt numbers and available correlations as well as experimental data. A novel DNS correlation for high Pr cases as they are transitioning from mixed convection to natural convection has been proposed. While Nusselt number errors relative to DNS range from 20% to 50%, the models capture similar trends to DNS with respect to Nusselt suppression and amplification under varying levels of buoyancy effect. This report also highlights model form error as a significant contributor to CFD predictions and proposes a framework for quantifying model error and improving confidence in CFD calculations. To improve the predictive capability of engineering CFD models, data-driven approaches for turbulence models are investigated. Theoretical frameworks based on the invariant tensor / vector basis neural networks for prediction of Reynolds stresses and turbulent heat fluxes are employed. The models are developed using direct numerical simulations data for forced convection flows of different fluids in vertical planar channel domain. The framework is implemented in spectral element solvers Nek5000 / nekRS and has shown a potential for future development and consideration of mixed convection flows.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2023

Machine learning models for maintenance cost estimation in delivery trucks using diesel and natural gas fuels

The maintenance costs can represent about 15%–60% of the cost of produced goods depending on the type of goods transported. To comply with stringent emissions regulations, diesel engines are incorporated with complex after-treatment systems that demand increased maintenance. The availability of alternative fuels such as natural gas and propane has fostered the natural gas and propane powertrain systems as well as electrification options for heavy- and medium-duty vehicles. A critical barrier to adopting alternative fuel vehicles has been the lack of knowledge on comparative vehicle maintenance/repair costs with conventional diesel. Moreover, the region of operation, the type of vehicle operation, and seasonal temperature changes also affect the duty cycle which impacts the maintenance and repair costs. This study focuses on estimating the cost-per-mile for heavy-duty vehicles using machine learning models such as random forest, xgboost, neural networks, and a super-learner model. The super-learner model achieved an error as low as 0.0068 $/mile for mean absolute error and 0.0086 $/mile for root mean square error with a coefficient of determination/R-Squared of 97.28%. Specifically, the paper investigates the data collected from the maintenance and repair costs associated with delivery trucks using diesel and natural gas fuels. Since the availability of data is the major constraint, we leveraged the data collected by West Virginia University and the partnership with fleet companies. This allows for additional information related to maintenance costs and fleet-specific maintenance practices of alternative fuel vehicles. This study promotes clean fuel technologies and enables fleet management companies to adopt alternative fuel vehicles in case of similar or lower cost of maintenance compared to diesel vehicles resulting in reduced emissions and total cost of ownership.

Katreddi, Sasanka↗

DOE OSTI2022

Using neural network ensembles to separate ocean biogeochemical and physical drivers of phytoplankton biogeography in Earth system models

Abstract. Earth system models (ESMs) are useful tools for predicting and understanding past and future aspects of the climate system. However, the biological and physical parameters used in ESMs can have wide variations in their estimates. Even small changes in these parameters can yield unexpected results without a clear explanation of how a particular outcome was reached. The standard method for estimating ESM sensitivity is to compare spatiotemporal distributions of variables from different runs of a single ESM. However, a potential pitfall of this method is that ESM output could match observational patterns because of compensating errors. For example, if a model predicts overly weak upwelling and low nutrient concentrations, it might compensate for this by allowing phytoplankton to have a high sensitivity to nutrients. Recently, we demonstrated that neural network ensembles (NNEs) are capable of extracting relationships between predictor and target variables within ocean biogeochemical models. Being able to view the relationships between variables, along with spatiotemporal distributions, allows for a more mechanistically based examination of ESM outputs. Here, we investigated whether we could apply NNEs to help us determine why different ESMs produce different spatiotemporal distributions of phytoplankton biomass. We tested this using three cases. The first and second case used different runs of the same ESM, except that the physical circulations differed between them in the first case, while the biological equations differed between them in the second. Our results indicated that the NNEs were capable of extracting the relationships between variables for different runs of a single ESM, allowing us to distinguish between differences due to changes in circulation (which do not change relationships) from changes in biogeochemical formulation (which do change relationships). In the third case, we applied NNEs to two different ESMs. The results of the third case highlighted the capability of NNEs to contrast the apparent relationships of different ESMs and some of the challenges it presents. Although applied specifically to the ocean components of an ESM, our study demonstrates that Earth system modelers can use NNEs to separate the contributions of different components of ESMs. Specifically, this allows modelers to compare the apparent relationships across different ESMs and observational datasets.

54 ENVIRONMENTAL SCIENCES↗