Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “error testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 865 records · Page 48

LTAU-FF: Loss Trajectory Analysis for Uncertainty in atomistic Force Fields

LTAU (Loss Trajectory Analysis for Uncertainty) is a technique for estimating the uncertainty in a model's predictions for any regression task by approximating the cumulative distribution function (CDF) of the model's errors over the course of training. The approximated CDF, combined with a similarity search algorithm in the model's descriptor space, can then be used to estimate the likelihood that the model's predictions on any given test point will fall below a chosen threshold. LTAU-FF (LTAU in atomistic Force Fields) is the application of LTAU specifically for use with atomistic force fields.

Vita, JoshuaA↗

Resilience Measurement Framework For Post-deployment Artificial Intelligence (ai) Integrated Systems

Resilience is largely defined as the ability to adapt or recover from adverse conditions, stresses, attacks, or compromises on systems that use or are enabled by digital resources. In Artificial Intelligence Management and Research for Advanced Networked Testbed Hub (AMARANTH), resilience is measured in the amount of time it took from the beginning of a testing period for the model to reach predictions outside of the original 95% confidence interval or using the Kullback-Leibler (KL) divergence theorem, the Population Stability Index (PSI), and traditional methods such as root mean squared error (RMSE) threshold. Artificial Intelligence (AI) model drift is of significant concern when deploying AI-integrated systems into critical and/or secure environments. Drift can impact resilience of the AI-integrated system post-deployment and requires consistent maintenance and upkeep to ensure the model is accurate and precise. To quantify model drift and predict the point when a model's drift becomes unacceptable, we describe using Kullback-Leibler (KL) divergence, Population Stability Index (PSI) and/or confidence interval width estimations to determine the point of failure and time to failure of a model post-deployment. Through simple code functions, the KL-divergence, PSI, confidence interval, and root mean squared (RMSE) point of failures can be used to derive when a model needs to be maintained as well as the impact of adversarial action through statistical means.

Yockey, Patience [Idaho National Laboratory (INL),↗

Toward the validation of crowdsourced experiments for lightness perception

Crowdsource platforms have been used to study a range of perceptual stimuli such as the graphical perception of scatterplots and various aspects of human color perception. Given the lack of control over a crowdsourced participant’s experimental setup, there are valid concerns on the use of crowdsourcing for color studies as the perception of the stimuli is highly dependent on the stimulus presentation. Here, we propose that the error due to a crowdsourced experimental design can be effectively averaged out because the crowdsourced experiment can be accommodated by the Thurstonian model as the convolution of two normal distributions, one that is perceptual in nature and one that captures the error due to variability in stimulus presentation. Based on this, we provide a mathematical estimate for the sample size needed to produce a crowdsourced experiment with the same power as the corresponding in-person study. We tested this claim by replicating a large-scale, crowdsourced study of human lightness perception with a diverse sample with a highly controlled, in-person study with a sample taken from psychology undergraduates. Our claim was supported by the replication of the results from the latter. These findings suggest that, with sufficient sample size, color vision studies may be completed online, giving access to a larger and more representative sample. With this framework at hand, experimentalists have the validation that choosing either many online participants or few in person participants will not sacrifice the impact of their results.

97 MATHEMATICS AND COMPUTING↗

Soft Coiled Pneumatic Actuator with Integrated Length-Sensing Function for Feedback Control

SPIRA Coil actuators are formed from thin sheets of PET plastic laminated into a coil shape that unfurls like a “party horn” when inflated, while many soft actuators require large pressures to create only modest strains, SPIRA Coils can easily be designed and fabricated to extend over dramatic distances with relatively low working pressures. Internal metalized PET strips separate in the extended portion of the actuator, creating an electrical circuit with a resistance that corresponds to the actuator length. This paper presents and experimentally validates easy-to-use design models for the actuators’ self-retracting spring stiffness, its pneumatic extension force, and its internal length-sensing electrical resistance. Testing of the self-sensing capabilities demonstrates that the embedded sensor can be used to determine the actuator length with virtually no hysteresis. Feedback control with the resistance-based sensing resulted in length-control errors within 5% of the extended actuator length (i.e., 3 cm of 60 cm).

Greenwood, Jacob R. (ORCID:0000000310897854)↗

A Software/Hardware Framework for Efficient and Safe Emergency Response in Post-Crash Scenarios of Battery Electric Vehicles

The adoption rate of battery electric vehicles (EVs) is rapidly increasing. Electric vehicles differ significantly from conventional internal combustion engine vehicles and vary widely across different manufacturers. Emergency responders (ERs) and recovery personnel may have less experience with EVs and lack timely access to critical information such as the extent of the stranded energy present, high-voltage safety hazards, and post-crash handling procedures in a user-friendly manner. This paper presents a software/hardware interactive tool named Electric Vehicle Information for Incident Response Solutions (EVIRS) to aid in the quick access to emergency response and recovery information. The current prototype of EVIRS identifies EVs using the VIN or Make, Model, and Year, and offers several useful features for ERs and recovery personnel. These features include integration and easy access to emergency response procedures tailored to an identified EV, vehicle structural schematics, the quick identification of battery pack specifications, and more. For EVs that are not severely damaged, EVIRS can perform calculations to estimate stranded energy in the EV’s battery and discharge time for various power loads using either EV dashboard information or operational data accessed through the CAN interface. Knowledge of this information may be helpful in the post-crash handling, management, and storage of an EV. The functionality and accuracy of EVIRS were demonstrated through laboratory tests using a 2021 Ford Mach-E and associated data acquisition system. The results indicated that when the remaining driving range was used as an input, EVIRS was able to estimate the pack voltage with an error of less than 3 V. Conversely, when pack voltage was used as an input, the estimated state of charge (SOC) error was less than 5% within the range of 30–90% SOC. Additionally, other features, such as retrieving emergency response guides for identified EVs and accessing lessons learned from archived incidents, have been successfully demonstrated through EVIRS for quick access. EVIRS can be a valuable tool for emergency responders and recovery personnel, both in action and during offline training, by providing crucial information related to assessing EV/battery safety risks, appropriate handling, de-energizing, transport, and storage in an integrated and user-friendly manner.

25 ENERGY STORAGE↗

How Should Machine Learning Be Successfully Used for Wind Speed Vertical Extrapolation?

An accurate characterization of the wind resource available at hub-height is required for an efficient and bankable wind farm project. However, direct measurement of wind speed at the constantly increasing height of the hub of commercial wind turbines is oftentimes challenging and expensive, so that it is common practice to vertically extrapolate the wind resource from lower and more easily accessible levels. Conventional techniques for wind speed vertical extrapolation include the use of a power law and a logarithmic profile. While simple, the limits in accuracy of these methods have been shown in various studies. Recently, machine learning has been proposed as a new method to vertically extrapolate winds. All the published studies on the topic assess the performance of machine learning techniques in vertically extrapolating the wind resource at the same location where the algorithm has been trained. However, in real-world applications, the wind resource is measured at the instrument location, but it then needs to be extrapolated at hub height at the location of the wind turbines within the find farm. To be able to fully recommend the use of machine learning techniques over the simple power law and logarithmic law, the spatial variability of the performance improvements of the machine learning approaches needs to be assessed. Here, we propose a round-robin validation of a machine learning-based method for wind speed extrapolation. We use 20 months of observations at four locations spanning a 100 km wide region at the Southern Great Plains (SGP) atmospheric observatory, in north-central Oklahoma. At each location, we train a random forest to predict 30-min average wind speed at 143 m AGL. We use as input features lidar wind speed at 65 m AGL, time of day, sonic anemometer wind speed at 4 m AGL, turbulent kinetic energy, and Obukhov length. First, we perform a same-site comparison of the performance of the proposed random forest against the conventional techniques for wind speed extrapolation (namely power law and logarithmic profile, with widely accepted stability corrections). We find that the random forest outperforms the power law in vertically extrapolating wind speed in all the considered stability regimes, with a 33% reduction in MAE for stable conditions, and a 31% reduction in unstable conditions. Similar results are found when comparing predictions of extrapolated winds from the logarithmic profile and the random forest with the observed values. Next, we propose a round-robin validation, to use the random forest trained at each site to extrapolate wind speed at the remaining three sites. We find that the performance of the random forest approach degrades when the algorithm is tested at a site different than the training one. However, even under those circumstances, the machine learning-based approach still outperforms the conventional techniques for wind speed extrapolation, with, on average, a reduction in mean absolute error between 15 and 20% over the conventional methods, with the largest benefits obtained under stable conditions.

Monte Carlo↗

Search for CPT and Lorentz invariance violation in the muon $g -2$ experiment at Fermilab

The Muon g-2 experiment at Fermilab (E989) aims to measure the anomalous magnetic moment of the muon, $a_{\mu}= (g-2)/2$, to a groundbreaking precision of $140$ ppb, obtaining a near four-fold increase in precision over the previous experiment, E821, at the Brookhaven National Laboratory (BNL). The value of $a_{\mu}$ from BNL currently differs from the Standard Model prediction by $\sim 3.7$ standard deviations, suggesting the potential for new physics and therefore, motivating a new experiment.Because the theory predicts this number with high precision, testing the g-factor through experiment provides a stringent test of the SM and can suggest physics beyond the Standard Model. The goal of the Fermilab Muon $g-2$ experiment is to increase the statistical precision by more than a factor of 20 and reduce systematic errors by a factor of 3. By measuring muon precession rate ($\omega_a$) in an external magnetic field, the anomalous magnetic moment will be calculated. This is an incredibly challenging experiment with a unique opportunity to provide new insight into nature. \\ The $g-2$ data also provides a great opportunity for setting the most stringent limits on some of the Standard Model Extension CPT Lorentz violating (LV) parameters in the muon sector. One of the CPT and Lorentz violating signatures that we can look for using $g-2$ data is a sidereal variation of $\omega_a(t)$. Extensive simulation studies confirm that the sensitivity regarding the sidereal varation roughly scales with $\omega_a$ uncertainty. Hence, the $g-2$ experiment at FNAL should be able to reach limits of $\sim 5\times10^{-25}$ GeV. Because the CPT and LV analyses are essentially studies of variations in $\omega_a$ as a function of time and charge, performing an $\omega_a$ analysis sets the stage for the CPT and LV measurement. This dissertation focuses on the methodology of a fully functioning framework and analyzing the Fermilab Muon $g - 2$ Run 2 data containing $\sim 11$ billion events above an energy threshold of $1.7$~GeV.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Towards Realistic and High Fidelity Models for Nuclear Reactor Power Synthesis Simulation with Self-Powered Neutron Detectors

As presented in this report, a weighting function–based inferencing method is being applied to synthesize the power distribution in next-generation and university research reactors based on simulated self power neutron detector (SPND) responses. The overall goal is to assess the impacts of sensor uncertainty and true power distribution perturbations on the error in the synthesized power distribution. Regarding sensor uncertainty, the NuScale Small Modular Reactor (SMR) and the Westinghouse AP1000 serve as testbeds for analyzing the impact of varying the sensor uncertainty, as well as varying the number of sensors per sensor string in the reactor core. The reactor models are informed by Monte Carlo N-Particle (MCNP) neutron flux tallies. For the NuScale SMR and Westinghouse AP1000, the SPND response functions (i.e., the response of the SPNDs to individual segments of fuel) were determined homogeneously. Regarding an analysis of power distribution perturbation detection, the Texas A&M Testing, Research, Isotopes, General Atomics Reactor (TAMU TRIGA) reactor was used as a demonstration case with one particular arrangement of SPNDs; the response functions for this reactor model were determined heterogeneously, making this a uniquely high-fidelity demonstration of perturbation detection. Finally, SPND models generated in the Geometry and Tracking 4 (Geant4) code have been generated and tested for comparison with traditionally implemented analytical SPND models, with the intent for Geant4 integration with the full methodological framework. SPND current outputs as a function of distance from some fuel assembly segment in the NuScale SMR are compared with the analytically determined currents. Results from the sensor uncertainty simulations for the NuScale SMR and AP1000 indicate that the average error in the inferred power distribution on the fuel assembly segment level is reasonably low, being slightly less than the random uncertainty applied to all respective SPNDs in both cores. For example, if all SPNDs in the core have a random uncertainty of 5%, then the corresponding fuel assembly segment level error (i.e. difference between the true and inferred local power) is ~2–3%. However, the maximum error in the inferred power distribution on the fuel assembly segment level can be considerably high (>15%) when SPND random uncertainties start to exceed ~3%. In general, the average and maximum errors in the inferred power distribution were slightly higher in the AP1000 as opposed to the NuScale SMR for the sensor string configurations considered herein. Another result determined from analysis of the sensor uncertainty simulations was that increasing the number of SPNDs per string does not clearly reduce inferred power distribution error and can in fact make the error large in some cases; however, this assessment may skewed due to imposed iteration limits. Results from the perturbation detection demonstration using the high-fidelity TAMU TRIGA model indicate that, given the arrangement of 17 SPND strings and 4 SPNDs per string considered herein, there is a clear, provable ability to infer a localized Gaussian-type peak perturbation in the 3D power distribution. Such a perturbation was detected with an average fuel assembly segment level error of 0.19%, and the general visualization of the detected perturbation clearly indicates that the magnitude and shape were appropriately resolved. Finally, the electrical current output generated by the Geant4 modeled SPND indicates significant magnitude differences than the analytically modeled SPND, demonstrating the need for accurate SPND models which account for finite sensor geometry effects to inform the power synthesis work described herein.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Limitations of reanalysis data for wind power applications

Wind energy resource estimates commonly depend on simulated wind speed profiles generated by reanalysis or weather models due to the lack of long time series measurements with sufficient coverage at relevant heights (roughly 90 m above ground). However, modeled data, including reanalyses, can be noisy and display a wide range of biases and errors, variously attributed to terrain effects, poor coverage of assimilated inputs, and model resolution. Wind generation records, if available at high temporal and geographical resolution, can provide a proxy for wind measurements and allow for evaluation of reanalyses and weather model wind time series. We use a 7-year-long data set of hourly, plant-level generation records from over 100 wind plants across Texas to evaluate two commonly used reanalysis data sets (MERRA2 and ERA5). Additionally, we use 1-year of records (2019) to evaluate an operational, high-resolution regional weather modeling product (HRRR v3). We find that across the region, and across all modeling products, the modeled representation of wind generation (i.e., wind speeds at hub heights passed through a power curve) has relatively small mean errors when aggregated daily, but that accuracy and hourly correlation have a strong diurnal sensitivity. Accuracy and correlation systematically decline through the evening and markedly improve after sunrise. These diurnal patterns persist even in the highest resolution model tested (HRRR v3). We hypothesize the nighttime decline in accuracy is mostly due to poorly represented boundary layer conditions, perhaps related to model representation of stability, while other uncertainties (such as wake effects) play a secondary role.

17 WIND ENERGY↗

Demonstration of 151 Sm analysis using Trinity nuclear debris samples

Here, the long-lived fission product 151 Sm (T 1/2 ≈ 90 y) present in archived dissolved Trinity nuclear test debris samples was analyzed using liquid scintillation counting and the results were compared to the expected values based upon historical analysis results. The measured 151 Sm activities were found to agree with the expected values within experimental error. This demonstration validates the use of this technique in situations where the sample is too old for traditional shorter half-life radioactive fission product signatures such as 99 Mo (T 1/2 = 2.75 d), 97 Zr (T 1/2 = 16.7 h), 147 Nd (T 1/2 = 10.98 d), and 153 Sm (T 1/2 = 46.3 h), or too dilute for determining fissions through stable isotope ratio measurements.

151Sm↗

Non-orthogonal computational grids for studying dislocation motion in phase field approaches

In this work, new non-orthogonal computational grids are implemented into a phase field model called Phase Field Dislocation Dynamics (PFDD). We demonstrate that the new non-orthogonal grid can accommodate multiple slip planes in either the face centered cubic (FCC) or body centered cubic (BCC) crystallographic systems. Here, we show that they avoid numerical errors induced when modeling glide on inclined slip planes in an orthogonal grid. The Gibbs effect that arises in the orthogonal or rotated orthogonal grids is substantially diminished when a non-orthogonal grid is employed. A few test cases demonstrate the effectiveness of using non-orthogonal grids in solving systems with multiple non-planar slip systems.

36 MATERIALS SCIENCE↗

Verification and validation of the Alternative Nonlinear Two-phase Subchannel (ANTS) code

The Alternative Nonlinear Two-phase Subchannel solver (ANTS) code was written to provide a fast-running, steady-state, pin-resolved modeling and simulation tool for analysis of common boiling water reactor (BWR) geometry and common operating conditions. ANTS has been integrated into the Virtual Environment for Reactor Application (VERA) core simulator software, where it can be used to provide a thermal/hydraulic (T/H) subchannel solution that is then used to provide neutronic feedback as well as perform the fuel depletion and temperature solution. Herein, this paper presents the rigorous analysis performed on the ANTS code, which includes both code and solution verification testing, benchmarking with the existing two-phase subchannel capability in VERA, CTF, and validation testing using popular two-phase experiments such as PWR Sub-channel and Bundle Tests (PSBT), BWR Full-size Fine-mesh Bundle Tests (BFBT), Risø, and FRIGG. This assessment was used to qualify ANTS for its intended applications before its use for core-scale, multiphysics BWR simulations. In general, it was found that agreement with experimental data was good; errors were within the range of experimental data uncertainty. Furthermore, code and solution verification confirmed that the governing equations and the most important closure terms were correctly implemented and behaving as expected.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Large-scale simulations of Floquet physics on near-term quantum computers

Abstract Periodically driven quantum systems exhibit a diverse set of phenomena but are more challenging to simulate than their equilibrium counterparts. Here, we introduce the Quantum High-Frequency Floquet Simulation (QHiFFS) algorithm as a method to simulate fast-driven quantum systems on quantum hardware. Central to QHiFFS is the concept of a kick operator which transforms the system into a basis where the dynamics is governed by a time-independent effective Hamiltonian. This allows prior methods for time-independent simulation to be lifted to simulate Floquet systems. We use the periodically driven biaxial next-nearest neighbor Ising (BNNNI) model, a natural test bed for quantum frustrated magnetism and criticality, as a case study to illustrate our algorithm. We implemented a 20-qubit simulation of the driven two-dimensional BNNNI model on Quantinuum’s trapped ion quantum computer. Our error analysis shows that QHiFFS exhibits not only a cubic advantage in driving frequency ω but also a linear advantage in simulation time t compared to Trotterization.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

An Experiment-based Distribution Level Performance Comparison among PMUs

This paper presents a experiment-based distribution level performance comparison among three Phasor Measurement Units (PMUs). Several evaluation criteria, including the total vector error, the phase angle error, the frequency error, the rate of change of frequency, the response time, the settling time, the overshoot, and the algorithm window size, are selected to compare the static and dynamic performances of the PMUs under steady state and step response test conditions. In order to have a more realistic test environment, a test is setup in which PMUs under evaluation have exactly the same input signals. The quantitative experiment result analysis gives an end-user guideline to the PMU selection regarding distribution level applications.

Yin, He↗

An Investigation of LES Wall Modeling for Rayleigh–Bénard Convection via Interpretable and Physics-Aware Feedforward Neural Networks with DNS

Abstract The traditional approach of using the Monin–Obukhov similarity theory (MOST) to model near-surface processes in large-eddy simulations (LESs) can lead to significant errors in natural convection. In this study, we propose an alternative approach based on feedforward neural networks (FNNs) trained on output from direct numerical simulation (DNS). To evaluate the performance, we conduct both a priori and a posteriori tests. In the a priori (offline) tests, we compare the statistics of the surface shear stress and heat flux, computed from filtered DNS input variables, to the stress and flux obtained from the filtered DNS. Additionally, we investigate the importance of various input features using the Shapley additive explanations value and the conditional average of the filter grid cells. In the a posteriori (online) tests, we implement the trained models in the System for Atmospheric Modeling (SAM) LES and compare the LES-generated surface shear stress and heat flux with those in the DNS. Our findings reveal that vertical velocity, a traditionally overlooked flow quantity, is one of the most important input features for determining the wall fluxes. Increasing the number of input features improves the a priori test results but does not always improve the model performance in the a posteriori tests because of the differences in input variables between the LES and DNS. Last, we show that physics-aware FNN models trained with logarithmic and scaled parameters can well extrapolate to more intense convection scenarios than in the training dataset, whereas those trained with primitive flow quantities cannot. Significance Statement The traditional near-surface turbulence model, based on a shear-dominated boundary layer flow, does not represent near-surface turbulence in natural convection. Using a feedforward neural network (FNN), we can construct a more accurate model that better represents the near-surface turbulence in various flows and reveals previously overlooked controlling factors and process interactions. Our study shows that the FNN-generated models outperform the traditional model and highlight the importance of the near-surface vertical velocity. Furthermore, the physics-aware FNN models exhibit the potential to extrapolate to convective flows of various intensities beyond the range of the training dataset, suggesting their broader applicability for more accurate modeling of near-surface turbulence.

54 ENVIRONMENTAL SCIENCES↗

Criterion validity of wrist accelerometry for assessing energy intake via the intake-balance technique

Background: Intake-balance assessments measure energy intake (EI) by summing energy expenditure (EE) with concurrent change in energy storage (ΔES). Prior work has not examined the validity of such calculations when EE is estimated via open-source techniques for research-grade accelerometry devices. The purpose of this study was to test the criterion validity of accelerometry-based intake-balance methods for a wrist-worn ActiGraph device. Methods: Healthy adults (n = 24) completed two 14-day measurement periods while wearing an ActiGraph accelerometer on the non-dominant wrist. During each period, criterion values of EI were determined based on ΔES measured by dual X-ray absorptiometry and EE measured by doubly labeled water. A total of 11 prediction methods were tested, 8 derived from the accelerometer and 3 from non-accelerometry methods (e.g., diet recall; included for comparison). Group-level validity was assessed through mean bias, while individual-level validity was assessed through mean absolute error, mean absolute percentage error, and Bland–Altman analysis. Results: Mean bias for the three best accelerometry-based methods ranged from -167 to 124 kcal/day, versus -104 to 134 kcal/day for the non-accelerometry-based methods. The same three accelerometry-based methods had mean absolute error of 323–362 kcal/day and mean absolute percentage error of 18.1-19.3%, versus 353–464 kcal/day and 19.5-24.4% for the non-accelerometry-based methods. All 11 methods demonstrated systematic bias in the Bland–Altman analysis. Conclusions: Accelerometry-based intake-balance methods have promise for advancing EI assessment, but ongoing refinement is necessary. We provide an R package to facilitate implementation and refinement of accelerometry-based methods in future research (see paulhibbing.com/IntakeBalance).

60 APPLIED LIFE SCIENCES↗

Accelerating Collective Communication in Data Parallel Training across Deep Learning Frameworks

This work develops new techniques within Horovod, a generic communication library supporting data parallel training across deep learning frameworks. In particular, we improve the Horovod control plane by implementing a new coordination scheme that takes advantage of the characteristics of the typical data parallel training paradigm, namely the repeated execution of collectives on the gradients of a fixed set of tensors. Using a caching strategy, we execute Horovod’s existing coordinator-worker logic only once during a typical training run, replacing it with a more efficient decentralized orchestration strategy using the cached data and a global intersection of a bitvector for the remaining training duration. Next, we introduce a feature for end users to explicitly group collective operations, enabling finer grained control over the communication buffer sizes. To evaluate our proposed strategies, we conduct experiments on a world-class supercomputer — Summit. We compare our proposals to Horovod’s original design and observe 2x performance improvement at a scale of 6000 GPUs; we also compare them against tf.distribute and torch.DDP and achieve 12% better and comparable performance, respectively, using up to 1536 GPUs; we compare our solution against BytePS in typical HPC settings and achieve about 20% better performance on a scale of 768 GPUs. Finally, we test our strategies on a scientific application (STEMDL) using up to 27,600 GPUs (the entire Summit) and show that we achieve a near-linear scaling of 0.93 with a sustained performance of 1.54 exaflops (with standard error +- 0.02) in FP16 precision.

Romero, Joshua↗

Evaluating Implementations of the Immersed Boundary Method in the Weather Research and Forecasting Model

The terrain-following coordinate system used by many atmospheric models can cause numerical instabilities due to discretization errors as resolved terrain slopes increase and the grid becomes highly skewed. The immersed boundary (IB) method, which does not require the grid to conform to the terrain, has been shown to alleviate these errors, and has been used successfully for high-resolution atmospheric simulations over steep terrain, including vertical building surfaces. Since many previous applications of IB methods to atmospheric models have used very fine grid resolution (5 m or less), the present study seeks to evaluate IB method performance over a range of grid resolutions and aspect ratios. Two classes of IB algorithms, velocity reconstruction and shear stress reconstruction, are tested within the common framework of the Weather Research and Forecasting (WRF) Model. Performance is evaluated in two test cases, one with flat terrain and the other with the topography of Askervein Hill, both under neutrally stratified conditions. WRF-IB results are compared to similarity theory, observations, and native WRF results. Despite sensitivity to the location at which the IB intersects the model grid, the velocity reconstruction IB method shows consistent performance when used with a hybrid RANS/LES surface scheme. The shear stress reconstruction IB method is not sensitive to the grid intersection, but is less consistent and near-surface velocity errors can occur at coarse resolutions. This study represents an initial investigation of IB method variability across grid resolutions in WRF. Future work will focus on improving IB method performance at intermediate to coarse resolutions.

54 ENVIRONMENTAL SCIENCES↗