SEARCH · Engineering Papers

Results for “timing error evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

All sources NASA NTRS DOE OSTI

DOE OSTI2023

Efficient Bayesian inference with latent Hamiltonian neural networks in No-U-Turn Sampling

When sampling for Bayesian inference, one popular approach in the computational field is to use Hamiltonian Monte Carlo (HMC) and specifically the No-U-Turn Sampler (NUTS), which automatically decides the end time of the Hamiltonian trajectory. However, HMC and NUTS can require numerous numerical gradients of the target density and can prove slow in practice when relying on computationally expensive forward models. We propose Latent Hamiltonian neural networks (L-HNNs) with HMC and NUTS for solving Bayesian inference problems. Once trained, L-HNNs do not require numerical gradients of the target density during sampling, and hence numerous evaluations of the forward computational model. Moreover, L-HNNs satisfy important properties such as perfect time reversibility and Hamiltonian conservation, making them well-suited for use within HMC and NUTS because stationarity can be shown. We also propose the integration of L-HNNs in an online error monitoring scheme, in which numerical gradients of the target density are used for a few samples whenever the L-HNNs prediction errors are large. This online error monitor scheme prevents sample degeneracy in regions of low probability density and ensures robust uncertainty quantification. We demonstrate L-HNNs in NUTS with online error monitoring on several analytical examples involving complex, heavy-tailed, and high-local-curvature probability densities. We then demonstrate the applicability of L-HNNs in NUTS to two computational case studies, namely the Allen-Cahn stochastic partial differential equation and an elliptic partial differential equation with 25 and 50 inference parameters, respectively. Overall, the L-HNNs in NUTS with online error monitoring satisfactorily inferred these probability densities. In conclusion, compared to traditional NUTS, L-HNNs in NUTS with online error monitoring required 1–2 orders of magnitude fewer numerical gradients of the target density and improved the effective sample size (ESS) per gradient (which is a measure of both the sampling quality and the computational expense) by an order of magnitude.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

Regulatory Decision-Making Process Using 'Weight of Evidence: An Evidence Integration Approach' by the State of Washington at the Hanford Site - 20163

Performance Assessment and Environmental Impact Statement Modeling, Human and Ecological Risk Assessments are the tools used by the Washington State Department of Ecology (Ecology) to make regulatory decisions for permitting and cleanup. These efforts all inherently have large amounts of uncertainty no matter how many alternative approaches are attempted. Professional feedback from tribal governments, stakeholders, federal and state regulators, the public and independent peer review groups are taken into account in this process of informed decision making. The process also includes full evaluation of the comments and the associated reviews made by the various peer review groups such as the Low -Level Waste Disposal Facility Federal Review Group (DOE order 435.1) and the Nuclear Regulatory Commission (NRC). The evolution of technology has produced quicker and more efficient fate and transport modeling tools with related quantification of uncertainties and their significance. Groundwater and vadose zone models have been expanded across the entire Hanford site. Many of the technical approaches identified in the Washington State Regulations are updated using current knowledge to better understand the complexities of the Hanford Site using the latest state of the art tools for risk assessment and modeling. More emphasis and time are directed on defining uncertainty and then managing the uncertainty. One added tool is to run sensitivity cases based on informed decision making. The weight of evidence approach considers all relevant information in an integrative assessment that takes into account the kinds of evidence available, the quality and quantity, the uncertainty and error associated with each type, and how they fit together. Evidence of integration involves looking at systematic reviews and evaluating their strengths and weaknesses. In conclusion, Ecology, Washington State's lead regulatory agency at the Hanford site, has had to modify its site closure approach compared to the rest of the state. A more holistic approach dealing with the Hanford site as an integrated system has evolved leading to a defensible informed approach for regulatory closure decisions. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

DOE OSTI2026

Feasibility of Correlation-Aware Inference and Universal Precision Scaling in Bonse–Hart Ultra-Small-Angle Neutron Scattering

Bonse–Hart ultra-small-angle neutron scattering (USANS) provides access to micrometre-scale structure, but useful measurements often require long counting times. In this work, we test whether the expected smoothness of the scattering profile can be exploited to improve data quality at lower counting statistics. We apply a Gaussian-process-based method to Bonse–Hart USANS data and evaluate its performance on pseudo-measurements generated from high-statistics experiments under Poisson statistics. This provides a stringent test of how well the underlying I(Q) profile can be reconstructed when the available counts are substantially reduced. We further show that, in the counting-limited regime, the reconstruction error follows a universal scaling behaviour that differs from the usual independent-counting expectation. At higher counts, the improvement crosses over to a resolution-limited regime set by analyser-angle discretization and rocking-curve width. These results clarify when correlation-aware inference is useful in USANS and provide a practical basis for improving measurement efficiency and beam-time usage.

Tung, Chi-Huan [ORNL] (ORCID:0000000221972074)↗

DOE OSTI2023

Evaluation of Historic Nuclear Cloud Measurement for Entrainment Parameter Determination

We evaluated the uncertainties associated with the entrainment parameters computed from nuclear cloud measurements taken during historic weapon testing campaigns. This evaluation found that variations in the way cloud heights and diameters were defined during the analysis of film records result in very large uncertainties in the entrainment parameters, severely limiting the utility of these data. For the measurements of atmospheric conditions at the time of the tests, the main sources of error are associated with the differences in the location and timing of the soundings.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

DOE OSTI2023

Analysis of Tasks in Autonomous Systems Using the EMRALD Dynamic Risk Assessment Tool

An autonomous system refers to the system that has the power and ability for self-governance in the performance of system functions. Autonomous systems have been actively pursued in a variety of domains such as automotive, aviation, maritime, medicine, and nuclear fields. As an unmanned concept employing the highest automation level, the autonomous system basically performs most of the work in normal operations or emergency situations. However, despite advances in technology, many researchers have noted these systems still require human actions. The nature of human actions on autonomous systems is different than the human actions that are considered in existing systems. Nevertheless, only a few studies have been conducted on 1) characterizing the different types of errors and risks associated with human actions interacting with autonomous systems and 2) how to evaluate human actions in the autonomous operations. As a starting point, this study aims to investigate differences of tasks in autonomous operation compared to those in existing nuclear power plant operation using the Event Modeling Risk Assessment Using Linked Diagram (EMRALD) software. In this paper, insights aspect of human error and time are derived out and discussed based on the output of the EMRALD models.

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2023

Combining Sparse Approximate Factorizations with Mixed-precision Iterative Refinement

The standard LU factorization-based solution process for linear systems can be enhanced in speed or accuracy by employing mixed-precision iterative refinement. Most recent work has focused on dense systems. We investigate the potential of mixed-precision iterative refinement to enhance methods for sparse systems based on approximate sparse factorizations. In doing so, we first develop a new error analysis for LU- and GMRES-based iterative refinement under a general model of LU factorization that accounts for the approximation methods typically used by modern sparse solvers, such as low-rank approximations or relaxed pivoting strategies. We then provide a detailed performance analysis of both the execution time and memory consumption of different algorithms, based on a selected set of iterative refinement variants and approximate sparse factorizations. Our performance study uses the multifrontal solver MUMPS, which can exploit block low-rank factorization and static pivoting. We evaluate the performance of the algorithms on large, sparse problems coming from a variety of real-life and industrial applications showing that mixed-precision iterative refinement combined with approximate sparse factorization can lead to considerable reductions of both the time and memory consumption.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Evaluation of a coastal acoustic buoy for cetacean detections, bearing accuracy and exclusion zone monitoring

Abstract There is strong socio‐political support for offshore wind development in US territorial waters and construction is planned off several east coast states. Some of the planned development sites coincide with important habitat for critically endangered North Atlantic right whales. Both exclusion zones and passive acoustic monitoring are important tools for managing interactions between marine mammals and human activities. Understanding where animals are with respect to exclusion zones is important to avoid costly construction delays while minimizing the potential for negative impacts. Impact piling from construction of hundreds of offshore wind turbines likely require exclusion zones as large as 10 km. We have developed a three‐hydrophone passive acoustic monitoring system that provides bearing information along with marine mammal detections to allow for informed management decisions in real‐time. Multiple units form a monitoring system designed to determine whether marine mammal calls originate from inside or outside of an exclusion zone. In October 2021, we undertook a full system validation, with a focus on evaluating the detection range and bearing accuracy of the system with respect to right whale upcalls. Five units were deployed in Mid‐Atlantic waters and we played more than 3500 simulated right whale upcalls at known locations to characterize the detection function and bearing accuracy of each unit. The modelled results of the detection function error were then used to compare the effectiveness of a bearing‐based system to a single sensor that can only detect a signal but not ascertain directivity. Field trials indicated maximum detection ranges from 4–7.3 km depending on source and ambient noise levels. Simulations showed that incorporating bearing detections provide a substantial improvement in false alarm rates (6 to 12 times depending on number of units, placement and signal to noise conditions) for a small increase in the risk of missed detections inside of an exclusion zone (1%–3%). We show that the system can be used for monitoring exclusion zones and clearly highlight the value of including bearing estimation into exclusion zone monitoring plans while noting that placement and configuration of units should reflect anticipated ambient noise conditions.

17 WIND ENERGY↗

DOE OSTI2021

Scale-Dependent Value of QPF for Real-Time Streamflow Forecasting

Incorporating rainfall forecasts into a real-time streamflow forecasting system extends the forecast lead time. Since quantitative precipitation forecasts (QPFs) are subject to substantial uncertainties, questions arise on the trade-off between the time horizon of the QPF and the accuracy of the streamflow forecasts. This study explores the problem systematically, exploring the uncertainties associated with QPFs and their hydrologic predictability. The focus is on scale dependence of the trade-off between the QPF time horizon, basin-scale, space-time scale of the QPF, and streamflow forecasting accuracy. To address this question, the study first performs a comprehensive independent evaluation of the QPFs at 140 U.S. Geological Survey (USGS) monitored basins with a wide range of spatial scales (~10 – 40,000 km 2 ) over the state of Iowa in the Midwestern United States. The study uses High-Resolution Rapid Refresh (HRRR) and Global Forecasting System (GFS) QPFs for short and medium-range forecasts, respectively. Using Multi-Radar Multi-Sensor (MRMS) quantitative precipitation estimate (QPE) as a reference, the results show that the rainfall-to-rainfall QPF errors are scale-dependent. The results from the hydrologic forecasting experiment show that both QPFs illustrate clear value for real-time streamflow forecasting at longer lead times in the short- to medium-range relative to the no-rain streamflow forecast. The value of QPFs for streamflow forecasting is particularly apparent for basin sizes below 1,000 km 2 . The space-time scale, or reference time t r ) (ratio of forecast lead time to basin travel time) ~ 1 depicts the largest streamflow forecasting skill with a systematic decrease in forecasting accuracy for t r > 1.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Fast and accurate reduced-order modeling of a MOOSE-based additive manufacturing model with operator learning

One predominant challenge in additive manufacturing (AM) is to achieve specific material properties by manipulating manufacturing process parameters during the runtime. Such manipulation tends to increase the computational load imposed on existing simulation tools employed in AM. The goal of the present work is to construct a fast and accurate reduced-order model (ROM) for an AM model developed within the Multiphysics Object-Oriented Simulation Environment (MOOSE) framework, ultimately reducing the time/cost of AM control and optimization processes. Our adoption of the operator learning (OL) approach enabled us to learn a family of differential equations produced by altering process variables in the laser’s Gaussian point heat source. More specifically, we used the Fourier neural operator (FNO) and deep operator network (DeepONet) to develop ROMs for time-dependent responses. Furthermore, we benchmarked the performance of these OL methods against a conventional deep neural network (DNN)-based ROM. Ultimately, we found that OL methods offer comparable performance and, in terms of accuracy and generalizability, even outperform DNN at predicting scalar model responses. The DNN-based ROM afforded the fastest training time. Furthermore, all the ROMs were faster than the original MOOSE model yet still provided accurate predictions. FNO had a smaller mean prediction error than DeepONet, with a larger variance for time-dependent responses. Unlike DNN, both FNO and DeepONet were able to simulate time series data without the need for dimensionality reduction techniques. Finally, the present work can help facilitate the AM optimization process by enabling faster execution of simulation tools while still preserving evaluation accuracy.

36 MATERIALS SCIENCE↗

DOE OSTI2023

Experiences Detecting Defective Hardware in Exascale Supercomputers

In May 2022, the newest supercomputer to top the TOP 500 list was Frontier at Oak Ridge National Laboratory, demonstrating the capability of computing more than 1.1 quintillion (1018) floating-point calculations every second. Driving this ground-breaking rate of computing is Frontier’s more than 37,000 graphics processing units (GPUs) and 9,408 central processing units (CPUs). In total, Frontier contains more than 60 million parts. At this scale, the smallest margin of error may generate hundreds of hardware errors across the system. These errors are capable of directly hindering world-class science performed on Frontier if not found. In this work, we describe and evaluate two strategies for finding hardware-level faults in Frontier’s 9,408 compute nodes. There are two strategies developed: the first uses the Slurm scheduler to scavenge available compute time to run the node screen, the second builds upon the lessons learned in the first strategy and enforces a weekly screen of each node. Using June 2023 as a case study, we find that the first scheduling strategy consumed more than ten times the resources as the second scheduling strategy, but successfully detected five hardware defects in Frontier. We summarize the lessons learned while developing and running a node screen on the world’s first exascale supercomputer.

Hagerty, Nick↗

DOE OSTI2025

Boosting Noise2Inverse via enhanced model selection for denoising computed tomography data

Synchrotron-based x-ray tomographic imaging enables the examination of the internal structure of materials at high spatial and temporal resolution. Experimental constraints can impose dose and time limits on the measurements, introducing a higher level of noise and artifacts in the reconstructed images. Deep learning has emerged as a powerful tool to remove noise from reconstructed images. Recently, the Noise2Inverse method was designed specifically for denoising reconstructed images without requiring paired noisy and clean images. This method creates multiple statistically independent reconstructions used to pair the data in which training involves transforming one reconstruction into the other, and vice versa. Originally designed to be used after a fixed number of epochs, we see in practice that this approach may not produce the optimal model and may unnecessarily waste computational resources. Therefore, we propose an alternative method of identifying the best model during training that aligns with the Noise2Inverse method. During validation, we compare the model output of the multiple reconstructions among each other. We hypothesize that the best model is the one that produces images with the highest similarity, implying a convergence in the predicted material properties and absorption values. To compare model outputs, we consider the absolute error, square error, structural similarity index (SSIM), peak signal-to-noise ratio (PSNR), and cosine similarity. We evaluate our method on two simulated tomography datasets and two, real-world, low-contrast, high-energy x-ray tomography datasets. We show our approach is more effective at determining the best model, up to an increase of 12.50% and 12.53% in SSIM and PSNR, respectively, while only requiring a fifth of the training time compared to the original approach.

CT↗

DOE OSTI2021

Active learning strategy for high fidelity short-term data-driven building energy forecasting

The quality of a data-driven model is heavily dependent on the quality of data. Data from building operation often have data bias problems, which means that the data sample is collected in a way that some members of the intended data population are less likely to be included than others. Data-driven energy forecasting models built on such data hence are biased and could lead to large forecasting errors. Active learning—an effective method to defying data bias—is rarely studied or applied in the area of data-driven building energy forecasting modeling. This paper attempts to fill this gap and explores the application of active learning in data-driven building energy forecasting. The developed strategy in this paper efficiently generate informative training data within a time budget and uses block design to passively consider weather disturbances. The developed active learning strategy is applied and evaluated in both virtual and real-building testbeds against traditional data-driven methods. Via these virtual and real-building evaluation cases, we have demonstrated that the data bias problem typically exists in building operation data is resolved by applying the developed active learning strategy. Furthermore, building energy forecasting models trained from data generated from the active learning strategy have shown improved performances in both model accuracy and model extendibility perspectives. The effectiveness of the block design module is also validated to effectively consider the impact of weather conditions on active learning design.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2020

Deterministic incident-wave elevation prediction in intermediate water depth

Potential performance gains from optimal (non-causal) impedance-matching control of wave energy devices in irregular ocean waves are dependent on deterministic wave elevation prediction techniques that work well in practical applications. Although a number of devices are designed for operation in intermediate water depths, little work has been reported on deterministic wave prediction in such depths. Here, we investigated a deterministic wave-prediction technique based on an approximate propagation model that leads to an analytical formulation, which may be convenient to implement in practice. To improve accuracy, an approach to combine predictions based on multiple up-wave measurement points is evaluated. The overall method is tested using experimental time-series measurements recorded in the U.S. Navy MASK basin in Carderock, MD, USA. For comparison, an alternative prediction approach based on Fourier coefficients is also tested with the same data. Comparison of prediction approaches with direct measurements suggest room for improvement. Possible sources of error including tank reflections are estimated, and potential mitigation approaches are discussed.

16 TIDAL AND WAVE POWER↗

DOE OSTI2025

Bayesian estimation of HIV acquisition dates for prevention trials

Accurate timing estimates of when participants acquire HIV in HIV prevention trials are necessary for determining antibody levels at acquisition. The Antibody-Mediated Prevention (AMP) Studies showed that a passively administered broadly neutralizing antibody can prevent the acquisition of HIV from a neutralization-sensitive virus. We developed a pipeline for estimating the date of detectable HIV acquisition (DDA) in AMP Study participants using diagnostic and viral sequence data. Using a Bayesian strategy that combines three streams of data (REN [rev/vpu/env/Δnef] sequence, GP [gag/Δpol] sequence, and diagnostic) where their 95% credible intervals overlap based on pre-specified criteria and decision rules. We evaluated the performance of our AMP pipeline using PacBio viral sequence data from 41 participants across two prospective acute HIV acquisition cohort studies, FRESH and RV217, with twice-weekly sampling. These cohort studies enrolled young women in South Africa and men and women in Kenya and Thailand, respectively, with a high likelihood of HIV acquisition. In evaluating performance, “true DDA” was the center of bounds between last-negative and first-positive RNA diagnostic tests (median time 4 days, range 2–7 days); bias was the mean difference between estimated and true DDA. Using diagnostic data alone yielded timing estimates with a bias of 2.4 days and root mean square error (RMSE) of 7.9 days. These results were improved using sequence + diagnostic data (bias 1.5 days, RMSE 6.9 days), as well as by restricting sequence-based estimation to samples from ≤5 weeks post-DDA (bias 0.2 days, RMSE 7.8 days).

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2022

Noninvasive acoustic time-of-flight measurements in heated, hermetically-sealed high explosives using a convolutional neural network

In this work, we present a data-driven technique for measuring the time-of-flight through material sealed within a container. Time-of-flight measurement provides a noninvasive means of quantifying the sound speed profile within a material by transmitting an acoustic burst and then measuring the time required for the burst to arrive at an opposing receiver. In a hermetically-sealed cylindrical container, a portion of the acoustic energy propagates through the material as a bulk wave, while the remainder of the acoustic energy propagates around the container walls as guided waves. As a result, interference from the guided waves obscures the bulk arrival, inhibiting measurement of the sound speed. The technique uses a Convolutional Neural Network (CNN) to identify critical features in the measured waveforms and identify bulk wave arrivals. We demonstrate this time-of-flight measurement technique on high explosive-filled containers as they are heated from room temperature to detonation. This is a particularly challenging application for acoustic time-of-flight measurements as the high explosives have significant sound speed gradients as they undergo heating, and they lead to significant attenuation of the bulk wave, as opposed to the guided waves, which do not suffer significant attenuation. We characterize the performance of the CNN as a function of the high explosive temperature and as a function of the CNN hyperparameters. We then provide physical insight into the error trends.

47 OTHER INSTRUMENTATION↗

DOE OSTI2022

QRF4P-NRT: Probabilistic Post-Processing of Near-Real-Time Satellite Precipitation Estimates Using Quantile Regression Forests

Accurate and reliable near-real-time satellite precipitation estimation is of great importance for operational large-scale flood forecasting and drought monitoring. The state-of-the-art precipitation post-processing model is based on a deterministic approach to construct relationships between satellites estimates and ground observations. We propose a probabilistic postprocessor, the Probabilistic Post-Processing of Near-Real-Time Satellite Precipitation Estimates using Quantile Regression Forests (QRF4P-NRT), based on quantile modeling, yielding both deterministic and probabilistic predictions. The experimental design incorporates different solutions of near-real-time predictors to further improve the model performance. Using the Integrated Multi-satellitE Retrievals Early Run for Global Precipitation Measurement Mission (IMERG-E) product as an example, we illustrate that the proposed method significantly improves the overall quality of the raw IMERG-E and is also superior to the bias-corrected product (IMERG Final Run, IMERG-F) at daily scale in a complex mountain basin. Evaluations of the corrected IMERG-E, raw IMERG-E, and IMERG-F using ground observation show that the corrected IMERG-E improves correlation coefficients (0.7), mean error (-0.14 mm/day) and root mean square error (3.3 mm/day) relative to the raw IMERG-E (0.31, -0.72 and 5.5 mm/day) and IMERG-F (0.34, -0.09 and 6.0 mm/day). The error decomposition further confirms that the QRF4P-NRT improves on the various deficiencies of the raw IMERG-E product. The ensemble assessment also demonstrates that the quantile outputs provide reliable prediction spread and sharp prediction intervals. The promising results indicate the great potential of the proposed method for probabilistic post-processing for near-real-time satellite precipitation estimates, and for further applications such as hydrological ensemble forecasting.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Evaluation of Uncertainties in the Anthropogenic SO 2 Emissions in the USA from the OMI Point Source Catalog

Satellite remote sensing is a promising method of monitoring emissions that may be missing in inventories, but the accuracy of these estimates is often not clear. We demonstrate here a comprehensive evaluation of errors in anthropogenic sulfur dioxide (SO 2 ) emission estimates from NASA’s OMI point source catalog for the contiguous US by comparing emissions from the catalog with high-quality emission inventory data over different dimensions including size of individual sources, aggregate vs individual source errors, and potential bias in individual source estimates over time. For sources that are included in the catalog, we find that errors in aggregate (sum of error for all included sources) are relatively low. Errors for individual sources in any given year can be substantial, however, with over- or underestimates in terms of total error ranging from –80 to 110 kt (roughly 10–90th percentile). In this study, we find that these errors are not necessarily random over time and that there can be consistently positive or negative biases for individual sources. We did not find any overall statistical relationship between the degree of isolation of a source and bias, either at a 40 or 70 km scales. For a sub-set of sources where inventory emissions over a radius of 70 km around an OMI detection are larger than twice the emissions within 40 km, the OMI value is consistently overestimated. We find, as expected, that emission sources not included in the catalog are the largest aggregate source of difference between the satellite estimates and inventories, especially in more recent years where source emission magnitudes have been decreasing and note that trends in satellite detections do not necessarily track trends in total emissions. We find that the OMI-based SO 2 emissions are accurate in aggregate, when summed over a number of sources, but must be interpreted more cautiously at the individual source level. Similar analyses would be valuable for other satellite emission estimates; however, in many cases, the appropriate high-quality reference data may need to be generated.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Issue Resolution During the Development of the Performance Assessment for the Savannah River Site Saltstone Disposal Facility - 20125

In 2019, Savannah River Remediation developed a revision to the performance assessment (PA) on behalf of the U.S. Department of Energy (DOE) Savannah River Operations Office (SR) for the near-surface disposal of low-level waste at the Savannah River Site (SRS) Saltstone Disposal Facility (SDF). Soluble waste from SRS Tank Farms undergoes salt processing to remove cesium and other high-activity constituents. The low-activity decontaminated salt solution (DSS) is then immobilized by mixing it into a cementitious waste form known as saltstone. After mixing, the saltstone is poured into leak-tight concrete vaults, known as saltstone disposal units (SDUs), where the waste form cures. By the time of facility closure, the SDF is expected to consist of 15 SDUs with a combined capacity of 1.06 E+09 L (280 Mgal) of cured saltstone. The facility operates under a Disposal Authorization Statement from DOE and a permit from the South Carolina Department of Health and Environmental Control (SCDHEC). Since the start of operations in 1990, the SDF has received almost 6.7 E+07 L (18 Mgal) of DSS, resulting in the safe disposal of 2.7 E+16 Bq (7.3 E+05 Ci) of activity. Due to the radioactive decay of short-lived contaminants, the total remaining activity in the disposed waste is estimated to be approximately 1.4 E+16 Bq (3.9 E+05 Ci), as of September 2018. The Disposal Authorization Statement requires a demonstration that the system of engineered and natural features of the disposal facility will limit releases from the facility and be protective of human health and the environment for at least the next 1,000 years. The long-term performance of the facility was evaluated under the requirements of the DoE's Radioactive Waste Management Manual (US DOE Manual 435.1-1). Simulations were performed to demonstrate that the disposal facility would meet performance objectives specified in the manual. The evaluation was based on numerical models that simulate the releases of contaminants from the saltstone waste form. Contaminants were transported through groundwater and air pathways to points of assessment to evaluate compliance (i.e., 100 m from the SDUs). In addition, the potential consequences of an inadvertent human intrusion (IHI) were also evaluated. A number of issues were overcome during the development of these simulations. These issues were identified as part of internal technical reviews. Simulations are developed by people and people make mistakes, so the internal technical review process is a vital step in PA development. Specific examples of resolved issues include a unit-conversion error, an inappropriate definition for a model boundary condition, a model time-stepping issue, and an error in the calculation for the buildup of contaminants in soil. Actions taken to address these issues resulted in an improved product with a better supported technical basis and more defensible results. The identification and correction of these issues are discussed. By understanding these issues, model developers and technical reviewers working on PAs in the future may avoid repeating these types of mistakes. Transparency with respect to these mistakes builds trust between waste management sites, regulators, and stakeholders. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗