SEARCH · Engineering Papers

Results for “Measurement uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

All sources NASA NTRS DOE OSTI

DOE OSTI2023

Nuclear Material Control & Accounting for Pebble Bed Reactors (FY 2023 Summary Report)

This report discusses the work done under the US Department of Energy NE-5 Advanced Reactor Safeguards and Security Program during FY 2023. It provides a summary of material control and accounting (MC&A) for pebble bed reactors (PBRs) and addresses some of the main challenges with current PBR MC&A approaches that will inform safeguards and security by design efforts. The efforts to date have focused on tristructural isotropic (TRISO) pebble fuel material accounting and control including working with partners in industry, loss and production of nuclear material as part of reactor operations, burnup modeling and measurements, uncertainty quantifications for such modeling and measurements, statistical approaches needed, and measurement methods. The unique fuel management and utilization in a PBR, where the fuel in spherical form is introduced and circulates through the reactor, poses special challenges for MC&A. This contrasts with traditional water-cooled reactors in which the fuel is contained in large assemblies and can be easily identified and counted. Even online fueled reactors, such as the CANDU reactors (none of which operate in the United States), are significantly different because the fuel is still contained in relatively large assemblies, is uniquely identified, and the number of assemblies that pass through the core on an annual basis is much fewer than the hundreds of thousands that circulate in a PBR, none of which are uniquely identified. Additionally, the nature of the TRISO fuel results in very low heavy metal loading with each pebble containing less than 10 g of uranium and on the order of less than 1 g of fissile material. This low fuel density and the robustness of the TRISO particles are major features of the TRISO fuel from a safety basis as each TRISO particle and pebble acts as a containment for the nuclear material and fission products during normal and accident conditions. This also results in very low plutonium loading per pebble during normal operations, which is on the order of 0.1 g at full burnup. A major feature of PBRs is that they will allow for significantly higher burnup, on the order of 160 GWd/THM compared to the burnup of traditional LWRs, which is on the order of 45 GWd/THM. This is achieved by monitoring the pebbles as they circulate through the reactor and allowing them to be reintroduced into the core until the desired burnup is achieved and they are removed from the reactor and enter the spent fuel storage areas.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

DOE OSTI2021

On the Feynman-alpha method for reflected fissile assemblies

The Feynman-alpha method is a neutron noise technique that is used to estimate the prompt neutron period of fissile assemblies. The method and quantity are of widespread interest including in applications such as nuclear criticality safety, safeguards and nonproliferation, and stockpile stewardship; the prompt neutron period may also be used to infer the k eff multiplication factor. The Feynman-alpha method is predicated on time-correlated neutron detections that deviate from a Poisson random variable due to multiplication. Traditionally, such measurements are diagnosed with one-region point kinetics, but two-region models are required when the fissile assembly is reflected. This paper presents a derivation of the two-region point kinetics Feynman-alpha equations based on a double integration of the Rossi-alpha equations, develops novel propagation of measurement uncertainty, and validates the theory. Validation is achieved with organic scintillator measurements of weapons-grade plutonium reflected by various amounts of copper to achieve k eff values of 0.83–0.94 and prompt periods of 5–75 ns. The results demonstrate that Feynman-alpha measurements should use the two-region model instead of the one-region model. The simplified one-region model deviates from the validated two-region models by as much as 10% in the estimate of the prompt neutron period, and the two-region model reduces to the one-region model for small amounts of reflector. The Feynman-alpha estimates of the prompt neutron period are compared to those of the Rossi-alpha approach. The comparative results demonstrate that the Feynman-alpha method is more precise than the Rossi-alpha method and more accurate for k eff < 0.92, whereas the Rossi-alpha method is generally more accurate for higher multiplications. Here, the uncertainty propagation developed in this work should be used for all Feynman-alpha measurements and will therein improve fitting accuracy and appropriate precision estimates.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

DOE OSTI2024

Conceptual Design of Neutron Sensor Qualification Device

The Advanced Sensors and Instrumentation Program at Idaho National Laboratory has been formulating strategies to qualify sensors for use in nuclear environments, particularly in irradiation experiments and advanced reactors. When qualifying neutron sensors for use in high-temperature environments, the wide range of neutron flux levels and representative energy spectra presents significant challenges. This paper discusses the development of the Neutron Sensor Qualification Device (NQD), which is designed to test neutron sensors in high temperature controlled environments with known neutron spectra, addressing the spatial and spectral complexities of neutron fluxes in reactor cores. The proposed NQD will be situated in the exposure room at the Armed Forces Radiobiology Research Institute, thus affording a unique capability to expose sensors to high neutron and gamma fluxes. To achieve thermal control, the device will utilize a radiation-hardened tube furnace, accommodating multiple sensors and neutron activation dosimetry wires. Titanium, iron, and cobalt dosimeter wires are chosen from the American Society for Testing and Materials and International Reactor Dosimetry and Fusion File libraries as references for providing energy-dependent fluence measurements. The design ensures precise sensor positioning to minimize mutual shielding and flux perturbation, which are evaluated via Monte Carlo N particle Transport Code (MCNP) simulations. These simulations have informed the development of guidelines on sensor placement within the NQD. The NQD is essential to the qualification of neutron sensors for advanced reactor technologies. It enables controlled testing of a statistically significant number of sensors, thereby supporting assessments of sensor performance across various neutron flux levels and temperatures. This paper highlights the detailed planning for the NQD prototype, along with its inaugural irradiation (scheduled for fiscal year [FY] 2025). The results from this initial testing will be fundamental in evaluating the device’s performance and establishing measurement uncertainty for in-pile neutron sensor measurements.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

DOE OSTI2022

Diffuse back-illumination temperature imaging (DBI-TI), a novel soot thermometry technique

To meet stringent emissions regulations on soot emissions, it is critical to further advance the fundamental understanding of in-cylinder soot formation and oxidation processes. Among several optical techniques for soot quantification, diffuse back-illumination extinction imaging (DBI-EI) has recently gained traction mainly due to its ability to compensate for beam steering, which if not addressed, can cause unacceptably high measurement uncertainty. Until now, DBI-EI has only been used to measure the amount of soot along the line of sight, and here, we extend the capabilities of a DBI-EI setup to also measure in-cylinder soot temperature. This proof of concept of diffuse back-illumination temperature imaging (DBI-TI) as a soot thermometry technique is presented by implementing DBI-TI in a single cylinder, heavy-duty, optical diesel engine to provide 2-D line-of-sight integrated soot temperature maps. The potential of DBI-TI to be an accurate thermometry technique for use in optical engines is analyzed. The achievable accuracy is due in part to simultaneous measurement of the soot extinction, which circumvents the uncertainty in dispersion coefficients that depend on the optical properties of soot and the wavelength of light utilized. Analysis shows that DBI-TI provides temperature estimates that are closer to the mass-averaged soot temperature when compared to other thermometry techniques that are more sensitive to soot temperature closer to the detector. Furthermore, uncertainty analysis and Monte Carlo (MC) simulations provide estimates of the temperature measurement errors associated with this technique. The MC simulations reveal that for the light intensities and optical densities encountered in these experiments, the accuracy of the DBI-TI technique is comparable or even better than other established optical thermometry techniques. Thus, DBI-TI promises to be an easily implementable extension to the existing DBI-EI technique, thereby extending its ability to provide comprehensive line-of-sight integrated information on soot.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2021

Isotopic analysis of sub-nanogram neodymium loads using new ATONA™ amplifiers

The long-term gains of the ATONA™ amplifiers are shown to have less than 1 ppm variability. Repeat measurements of the JNdi-1 reference material demonstrate the ability of the ATONA™ amplification technology to make measurements of 143 Nd/ 144 Nd ratios with 23 ppm external reproducibility on 100-pg loads. The effect of increasing integration time on analytical reproducibility is also displayed as increasing integration time from 10 to 30s reduced the external measurement uncertainty from 37 to 23 ppm. These measurements represent an improvement of more than a factor of 3 in external measurement reproducibility relative to previously published 143 Nd/ 144 Nd measurements of 100-pg loads. Furthermore, this new technology will allow for the measurement of smaller samples for precise isotope ratios and open new avenues of research in the geological and nuclear forensic communities.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2024

The hyperplane of early-type galaxies: using stellar population properties to increase the precision and accuracy of the fundamental plane as a distance indicator

ABSTRACT We use deep spectroscopy from the SAMI (Sydney-AAO Multi-object Integral) Galaxy Survey to explore the precision of the fundamental plane (FP) of early-type galaxies as a distance indicator for future single-fibre spectroscopy surveys. We study the optimal trade-off between sample size and signal-to-noise ratio (SNR), and investigate which additional observables can be used to construct hyperplanes with smaller intrinsic scatter than the FP. We add increasing levels of random noise (parametrized as effective exposure time) to the SAMI spectra to study the effect of increasing measurement uncertainties on the FP- and hyperplane-inferred distances. We find that, using direct-fit methods, the values of the FP and hyperplane best-fitting coefficients depend on the spectral SNR, and reach asymptotic values for a mean $\langle \mathrm{ SNR} \rangle =40\, \mathrm{\mathring{\rm A}}^{-1}$. As additional variables for the FP we consider three stellar-population observables: light-weighted age, stellar mass-to-light ratio, and a novel combination of Lick indices ($I_\mathrm{age}$). For an $\langle \mathrm{ SNR} \rangle =45~\mathrm{\mathring{\rm A}}^{-1}$ (equivalent to 1-h exposure on a 4-m telescope), all three hyperplanes outperform the FP as distance indicators. Being an empirical spectral index, $I_\mathrm{age}$ avoids the model-dependent uncertainties and bias underlying age and mass-to-light ratio measurements, yet yields a 10 per cent reduction of the median distance uncertainty compared to the FP. We also find that, as a by-product, the $I_\mathrm{age}$ hyperplane removes most of the reported environment bias of the FP. After accounting for the different SNR, these conclusions also apply to a 50 times larger sample from SDSS-III (Sloan Digital Sky Survey). However, in this case, only $\mathrm{ age}$ removes the environment bias.

D’Eugenio, Francesco (ORCID:0000000323888172)↗

DOE OSTI2021

3D optical diagnostics for explosively driven deformation and fragmentation

High-speed, optical imaging diagnostics are presented for three-dimensional (3D) quantification of explosively driven metal fragmentation. At early times after detonation, Digital Image Correlation (DIC) provides non-contact measures of 3D case velocities, strains, and strain rates, while a proposed stereo imaging configuration quantifies in-flight fragment masses and velocities at later times. Experiments are performed using commercially obtained RP-80 detonators from Teledyne RISI, which are shown to create a reproducible fragment field at the benchtop scale. DIC measurements are compared with 3D simulations, which have been ‘leveled’ to match the spatial resolution of DIC. Overall, results demonstrate improved ability to identify predicted quantities-of-interest that fall outside of measurement uncertainty and shot-to-shot variability. Similarly, video measures of fragment trajectories and masses allow rapid experimental repetition and provide correlated fragment size-velocity measurements. Measured and simulated fragment mass distributions are shown to agree within confidence bounds, while some statistically meaningful differences are observed between the measured and predicted conditionally averaged fragment velocities. Together these techniques demonstrate new opportunities to improve future model validation.

42 ENGINEERING↗

DOE OSTI2022

Improved Measurements of Galaxy Star Formation Stochasticity from the Intrinsic Scatter of Burst Indicators

Abstract Measurements of short-timescale star formation variations (i.e., “burstiness” or star formation stochasticity) are integral to our understanding of star formation feedback mechanisms and the assembly of stellar populations in galaxies. We expand upon the work of Broussard et al. by introducing a new analysis of galaxy star formation burstiness that accounts for variations in the Q sg = E B − V stars / E B − V gas distribution, a major confounding factor. We use Balmer decrements from the MOSFIRE Deep Evolution Field (MOSDEF) survey to measure Q sg , which we use to construct mock catalogs from the Santa Cruz Semi-Analytic Models and Mufasa cosmological hydrodynamical simulation based on 3D-HST, Fiber Multi-Object Spectrograph (FMOS)-COSMOS, and MOSDEF galaxies with H α detections. The results of the mock catalogs are compared against observations using the burst indicator η = log 10 ( SFR H α / SFR NUV ) , with the standard deviation of the η distribution indicating burstiness. We find decent agreement between mock and observed η distribution shapes; however, the FMOS-COSMOS and MOSDEF mocks show a systematically low median and scatter in η in comparison to the observations. This work also presents the novel approach of analytically deriving the relationship between the intrinsic scatter in η , scatter added by measurement uncertainties, and observed scatter, resulting in an intrinsic burstiness measurement of 0.06–0.16 dex.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2020

Review of thermophysical property methods applied to fueled and un-fueled molten salts

Recent investigation into designs of molten salt reactors (MSR) requires accurate data of candidate salts. Review of the literature shows lacking thermophysical (TP) property data for coolants and fuel-bearing salts of Advanced High Temperature Reactors (AHTR). Measurement uncertainties of current data are even more deficient, and this affects ongoing research where MSR modeling and testing are being performed. Melting temperature, viscosity, density, specific heat capacity, and thermal and electrical conductivity measurements are often not arranged together or discussed in great detail, especially for fuel-bearing salts. Raw data from key findings spanning over 70 years for LiF, LiF-BeF 2 , LiF-NaF-KF, KCl-MgCl 2 , KF-ZrF 4 , and NaF-KF-MgF 2 have been organized and presented here. Brief description of methods used to obtain these results, in addition to the TP data of some of these salts as fuel carriers, has also been discussed. Thermal conductivity data are particularly weak due to older, high-error measurement techniques. More recent measurement systems to evaluate salt thermal conductivity show promise for obtaining consistent absolute values. This work concludes that measurement systems such as transient hot-wire method, forced Rayleigh scattering, and laser flash analysis provide the most promise to fill these data gaps and reduce current uncertainty in thermal conductivity measurements of both fueled and un-fueled molten salts.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2020

A Probabilistic Model-Based Diagnostic Framework for Nuclear Engineering Systems

A fault diagnostic framework was investigated in this study for applications in thermal–hydraulic systems of nuclear power plants. The proposed framework consists of quantitative model-based diagnosis, statistical change detection and probabilistic reasoning. The use of physics-based diagnostic models provides high detection sensitivity and allows noise and measurement uncertainty to be incorporated robustly. Performance-related parametric models for each component are constructed based on first principles. Numerical model residuals are generated using the concept of analytical redundancy. Statistical change detection methods are employed to detect non-zero residuals in the presence of uncertainty. The diagnosis task is performed using Bayesian inference to detect and localize possible faults. Application to a single-phase heat exchanger for demonstration showed that the proposed probabilistic framework can provide improved results in comparison with traditional approaches while remaining less sensitive to false alarms in the presence of measurement and modeling uncertainty.

Bayesian network↗

DOE OSTI2025

Deliverable 6.7-Final Technical Report: Development Summary and Evaluation of the Solar Uncertainty Integrator (SUNI) Software

The Data Quality and Uncertainty Integration Project was a three-year effort to address stakeholder needs for assessing solar radiation resource data quality based on existing tools for estimating radiometer measurement uncertainties and assessing post-measurement data quality. The annual research objectives for the project addressed a logical progression of effort needed to achieve the ultimate project goal of developing the Solar Uncertainty Integrator (SUNI) software. This final technical report summarizes the development process for achieving these key research objectives and addresses the outreach and code development efforts in the final year of the project to develop a new solar irradiance data uncertainty integration software package.

14 SOLAR ENERGY↗

DOE OSTI2021

Prediction of DIII-D Pedestal Structure From Externally Controllable Parameters

The sharp increase of pressure at the edge of a high confinement mode (H-mode) plasma, the pedestal, strongly impacts overall plasma performance. Predicting the pedestal is a necessity to control and optimize tokamak operations. Here, an experimental data-driven machine learning (ML) approach is presented that predicts the pedestal heights and widths of electron density (n e ) and electron temperature (T e ) profiles as well as the separatrix ne from externally controllable parameters such as the plasma shape, heating method and power, and gas puff rate and integrated gas puff. The OMFIT framework was used with DIII-D data to efficiently, robustly, and automatically build a database of pedestal parameters to train machine learning models. Database creation was enabled by the search engine tool for DIII-D data, TokSearch, which parallelizes data fetching, enabling fast searches through basic signals of thousands of DIII-D shots and selection of relevant time intervals. Principal Component Analysis (PCA) separated the database into three clusters that represent classes of plasma shapes that are regularly used in DIII-D. The most important parameters for setting the pedestal structure were plasma current (I p ), toroidal magnetic field (B Φ ), neutral beam heating power (P NBI ) and shaping quantities. The Deep Jointly Informed Neural Networks (DJINN) algorithm was applied to identify suitable neural network (NN) architectures that appropriately capture the features of the pedestal database. Separate NNs were implemented for each pedestal parameter, and ensembling methods were used to improve the prediction accuracy and allowed estimation of the prediction uncertainty. The pedestal predictions of the test dataset lie within the measurement uncertainties of the pedestal parameters. The NN outperformed simple Linear Regression (LR) analysis, indicating non-linear dependencies in the pedestal structure. The presented achievements illustrate a promising path for future research, using feature extraction to infer experimental trends and thereby improve pedestal models as well as deploying NN for a fast pedestal prediction in DIII-D scenario development.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2020

Rossi-alpha Uncertainty Quantification by Analytic, Bootstrap, and Sample Methods to Inform Fitting Best Practices

The prompt neutron period (the negative reciprocal of the prompt neutron decay constant) can be estimated using the Rossi-alpha technique that is predicated on fitting Rossi alpha histograms and of interest in nuclear criticality safety and nonproliferation. The histograms are traditionally fit with a one-exponential model; however, recent work has proposed a two-exponential model to account for reflector induced phenomenon. Until recently, the uncertainty quantification for either model was inadequate (inaccurate and demanded large measurement times). Measurement uncertainty quantification by sample and analytic methods was developed and validated in Ref. The purpose of this transaction is to (i) validate a new bootstrap method by comparing bin-by-bin error bar estimates and (ii) demonstrate how to choose bin widths and reset times to optimize precision and accuracy.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2022

Prediction of DIII-D Pedestal Structure from Externally Controllable Parameters

The sharp increase of pressure at the edge of a high confinement mode (H-mode) plasma, the pedestal, strongly impacts overall plasma performance. Predicting the pedestal is a necessity to control and optimize tokamak operations. An experimental data-driven machine learning (ML) approach is presented that predicts the pedestal heights and widths of electron density (ne) and electron temperature (Te) profiles as well as the separatrix ne from externally controllable parameters such as the plasma shape, heating method and power, and gas puff rate and integrated gas puff. The OMFIT framework was used with DIII-D data to efficiently, robustly, and automatically build a database of pedestal parameters to train machine learning models. Database creation was enabled by the search engine tool for DIII-D data, TokSearch, which parallelizes data fetching, enabling fast searches through basic signals of thousands of DIII-D shots and selection of relevant time intervals. Principal Component Analysis (PCA) separated the database into three clusters that represent classes of plasma shapes that are regularly used in DIII-D. The most important parameters for setting the pedestal structure were plasma current (Ip), toroidal magnetic field (Bφ), neutral beam heating power (PNBI) and shaping quantities. The Deep Jointly Informed Neural Networks (DJINN) algorithm was applied to identify suitable neural network (NN) architectures that appropriately capture the features of the pedestal database. Separate NNs were implemented for each pedestal parameter, and ensembling methods were used to improve the prediction accuracy and allowed estimation of the prediction uncertainty. The pedestal predictions of the test dataset lie within the measurement uncertainties of the pedestal parameters. The NN outperformed simple Linear Regression (LR) analysis, indicating non-linear dependencies in the pedestal structure. The presented achievements illustrate a promising path for future research, using feature extraction to infer experimental trends and thereby improve pedestal models as well as deploying NN for a fast pedestal prediction in DIII-D scenario development.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2020

Uncertainty Propagation from Flux to α and from Time to α in Reaction History

This report documents measurement uncertainty propagation from flux to α and from time to α in gamma reaction history. Analytical formulas are derived, and on the basis of them, their discrete versions are provided to serve for current reaction history software verification, and for development of the future versions of the software. The discrete version is provided for the general case: sparse data with varying time intervals between the data points.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2022

Laser Doppler vibrometry for piezoelectric coefficient ($d_{33}$) measurements in irradiated aluminum nitride

Sensors used for experiments in advanced reactors must survive in harsh environments. Few material systems can be used to construct sensors viable for extreme conditions. Aluminum nitride (AlN) is one such material because it has high thermal stability and radiation resistance and sustains good piezoelectric and dielectric properties at high temperatures. In this work, the piezoelectric coefficient $d_{33}$ of the AlN single-crystal with thermal and irradiation damage was investigated using an indirect method with a laser Doppler vibrometer (LDV). Surface electrodes were deposited on the AlN samples, and the vibration response of the samples to an applied voltage was monitored using the LDV as a function of the excitation frequency. The $d_{33}$ estimation was based on the excitation voltage and the thickness-mode displacement extracted from the LDV measurements. Further, six AlN substrates were irradiated with 8 MeV Al 2+ at three fluences (10 15 , 10 16 , and 10 17 ions/cm 2 ) and two temperatures (300 °C and 500 °C). The $d_{33}$ for the six irradiated samples and one pristine sample were measured, and the measurement uncertainty was estimated based on five repeated tests. All samples were also measured by a commercial piezometer for comparison. The experimental results demonstrate that the piezoelectric coefficients obtained by LDV were about 0.8–1.16 pm/V lower than those obtained by the piezometer. With the compensation of the clamping effect, the corrected LDV values are similar to the piezometer results. Both show similar trends in all samples, which validates the feasibility of the proposed method for $d_{33}$ measurement. Based on the LDV results, the irradiated samples show a 12%–22% decrease in $d_{33}$ compared with the pristine samples. The samples irradiated under the same fluence at a higher temperature (500 °C) demonstrated a lower $d_{33}$ than those at 300 °C. The effect of the retro-reflective tape, sample temperature, and sample size on the $d_{33}$ measurement were also studied.

36 MATERIALS SCIENCE↗

DOE OSTI2023

Prediction on X-ray output of free electron laser based on artificial neural networks

Abstract Knowledge of x-ray free electron lasers’ (XFELs) pulse characteristics delivered to a sample is crucial for ensuring high-quality x-rays for scientific experiments. XFELs’ self-amplified spontaneous emission process causes spatial and spectral variations in x-ray pulses entering a sample, which leads to measurement uncertainties for experiments relying on multiple XFEL pulses. Accurate in-situ measurements of x-ray wavefront and energy spectrum incident upon a sample poses challenges. Here we address this by developing a virtual diagnostics framework using an artificial neural network (ANN) to predict x-ray photon beam properties from electron beam properties. We recorded XFEL electron parameters while adjusting the accelerator’s configurations and measured the resulting x-ray wavefront and energy spectrum shot-to-shot. Training the ANN with this data enables effective prediction of single-shot or average x-ray beam output based on XFEL undulator and electron parameters. This demonstrates the potential of utilizing ANNs for virtual diagnostics linking XFEL electron and photon beam properties.

47 OTHER INSTRUMENTATION↗

DOE OSTI2022

Model Evaluation by Measurements from Collocated Remote Sensors in Complex Terrain

Model improvement efforts involve an evaluation of changes in model skill in response to changes in model physics and parameterization. When using wind measurements from various remote sensors to determine model forecast accuracy, it is important to understand the effects of measurement-uncertainty differences among the sensors resulting from differences in the methods of measurement, the vertical and temporal resolution of the measurements, and the spatial variability of these differences. Here we quantify instrument measurement variability in 80-m wind speed during WFIP2 and its impact on the calculated errors and the change in error from one model version to another. Here the model versions tested involved updates in model physics from HRRRv1 to HRRRv4, and reductions in grid interval from 3 km to 750 m. Model errors were found to be 2–3 m s –1 . Differences in errors as determined by various instruments at each site amounted to about 10% of this value, or 0.2–0.3 m s –1 . Changes in model skill due to physics or grid-resolution updates also differed depending on the instrument used to determine the errors; most of the instrument-to-instrument differences were ~0.1 m s –1 , but some reached 0.3 m s –1 . All instruments at a given site mostly showed consistency in the sign of the change in error. In two examples, though, the sign changed, illustrating a consequence of differences in measurements: errors determined using one instrument may show improvement in model skill, whereas errors determined using another instrument may indicate degradation. This possibility underscores the importance of having accurate measurements to determine the model error.

54 ENVIRONMENTAL SCIENCES↗