Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Uncertainty analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,765 records · Page 98

Effect of Heat Treatment on Microstructure and Mechanical Property of 316L Stainless Steel Produced by Laser Powder Bed Fusion

The advanced non-light water reactor designs (Gen IV reactors), including molten salt/ very high temperature/ sodium-cooled and lead-cooled fast reactors, typically operate at higher temperatures and more extreme radiation conditions than light water reactors. An intrinsic part of the deployment and progress of Gen IV reactor designs is selecting the most suitable structural material for a specific application. Additive manufacturing (AM), a fairly new process of making physical, three-dimensional objects from a computer design file, is going to completely change the way of design, build and certify nuclear systems. It offers a range of opportunities to produce complex geometries from existing materials, offers new routes for processing of previously difficult to process materials, allows for design of new high-performance materials, and finally facilitates hybridization of dissimilar materials. This emerging technology has successfully produced cars, wind turbine blade molds and even live cells. It could also open up big opportunities for the nuclear industry to quickly deploy technologies at a fraction of the cost. So far, AM techniques have been preliminarily applied in the field of nuclear reactors, including the classical parts such as the pressure vessel of a small reactor with 508-III steel, the bottom nozzle of a fuel assembly with 304L steel, the fuel cladding with zirconium alloy and the integrated impeller of a pump and the multi-channel valve body with 316L steel [6,7]. The AM applications for operating nuclear reactors started in auxiliary plant components and have slowly migrated to metallic reactors and core components, but many of these are not safety critical components. Although many parts used for nuclear reactors have been fabricated by AM techniques, practical applications in engineering are still a long way off due to the uncertainty factors focused on the processing, material properties, analysis methods and application standards, which feeds the safety and life-cycle of the nuclear reactor. Due to rapid, repeated heating and cooling during production, a high dislocation density was present in the AM material. This microstructure feature is unstable at elevated temperature while high temperature is one of the typical operation environments for nuclear reactors. Thus, it is important to understand the thermal effect on the microstructure of AM material. The objectives of this study are to investigate the effect of heat treatment on the microstructure and mechanical properties of 316L stainless steel produced by laser powder bed fusion additive manufacturing, and to determine an appropriate heat treatment practice that will be applied to the lightweight AM lattice-structured material with the same chemistry. The heat treatment study consisted of annealing the samples at a temperature range of 800 to 1200 oC with a 50 oC increment for different times (1-24 hours), followed by vacuum or air cooling. Microstructural characterization was carried out by Scanning Electron Microscope (SEM). Grain size and crystallographic orientation were investigated by Electron Backscatter Diffraction (EBSD). Vickers hardness tests with a 0.5 kg load were employed to determine the hardness of samples after different heat treatments. After heat treatment, the random crystallographic orientation was preserved, and the volume fraction of high-angle grain boundaries (grain boundary misorientation =15 oC) remained the same. The dislocation density decreased with annealing temperature due to recovery. The fine subgrain structures in the as-printed specimen were quite stable up to 1200 oC. Minimal recrystallization was observed up to 1200 oC. Recrystallization initiated only after 8.5 hours at 1200 oC. The SEM images did not show obvious dependence of microstructure on cooling rate. The hardness of the specimens decreased with increasing annealing temperature as a result of the decrease in dislocation density. It is interesting to note that the AM material showed very similar hardness to the wrought material when annealing at similar temperature, although the microstructures are very different. Annealing at 1050 oC for 1 hour followed by air cooling was selected as the heat treatment procedure for the lattice designed lightweight AM 316L material.

36 MATERIALS SCIENCE↗

Automated Direct Perturbation Calculations with SCALE TSUNAMI [Abstract]

In nuclear criticality safety analysis, the sensitivity of the eigenvalue keff to uncertainties in nuclear data and its evaluation are crucial. The TSUNAMI sequences within the SCALE code system offer users various options with both multigroup (MG) and continuous-energy (CE) 3D Monte Carlo (MC) transport capabilities for calculating keff sensitivity coefficients and storing them in a sensitivity data file (SDF). Each methodology available in TSUNAMI offers distinct advantages and limitations, and its effectiveness can vary based on the specific problem being solved. As a best practice, practitioners typically use the direct perturbation (DP) method as a confirmatory step alongside their sensitivity calculations to verify the accuracy of the sensitivity data generated. In this process, DP calculations are usually performed on select nuclides, those considered most important for validating their total sensitivities. However, because of code limitations, analysts use a workaround method when conducting DP calculations for a single nuclide: rather than perturbing the nuclide's microscopic cross section, an equivalent number density for this nuclide is calculated to reflect the effect of a change in the macroscopic cross section due to a perturbation in the microscopic cross section. The current approach requires rerunning the CSAS criticality calculation several times with model changes. Although this method can yield results with acceptable accuracy, it is labor-intensive and prone to errors.

AZURE: SAMMY↗

Optical potential uncertainties on exclusive tens-of-MeV Ar cross sections

Large liquid argon time projection chamber (LArTPC) neutrino detectors, such as those planned for the Deep Underground Neutrino Experiment (DUNE), show considerable promise as a platform for next-generation measurements of supernova neutrinos. Thanks to the neutron excess in $^{40}$Ar as well as the detailed tracking possible with LArTPCs, these detectors are expected to be uniquely capable of measuring supernova electron neutrinos with high statistics and minimal backgrounds. However, these technological advantages come at the price of complexities in data interpretation; reconstruction of the incident energies of supernova neutrinos in a future LArTPC-based analysis will be subject to a variety of systematic uncertainties related to nuclear interaction modeling. In this talk, we present a study of a subset of these uncertainties as implemented in the MARLEY event generator used by DUNE and other LArTPC neutrino experiments. Variations to the optical potential used in the MARLEY nuclear de-excitation model are applied to the calculation of exclusive tens-of-MeV neutrino-nucleus cross sections for the first time, and the impact on observables of interest for supernova neutrino detection is examined. We also discuss prospects for quantifying other sources of uncertainty on the MARLEY neutrino interaction model.

El-Haj, Luca Abu↗

Uncertainty about the Uncertainty [Slides]

A golden standard in science is to repeat an experiment a statistically significant number of times, recording data using the same set of detectors and the same data analysis methodology. In such case experimental error includes both the range of true values generated by repetitions of the experiment, and measurement uncertainty caused by the detector. They are independent. It is a huge and too frequently used simplification, to assume that one can measure multiple repetitions of an identical experiment, resulting in identical true experimental value. Repetitions, as similar is it is experimentally achievable result in a range of the true values rather than in a single value. When modern, very sensitive and well calibrated measurement systems are used, this range is not negligible, and sometimes dominates, in comparison to the measurement uncertainty. Range of true values depends on the physics of the experiment, while measurement uncertainty depends on the measurement method (properties of the detector not of the experiment). When data from one–of–a kind experiment are analyzed, only the measurement uncertainty is reported. It gives no information about the range, in which the true values of experiment would spread if the experiment was repeated. A frequently used approximation, that if a physical quantity is measured as a function of time, only measurement of this quantity, produces uncertainty is also in some real experiments fare to strong. Example: In reaction history time measurement uncertainty propagated to alpha dominated under certain conditions over the flux measurement uncertainty propagated to alpha. Reliability of a data point is in general independent from its measurement uncertainty. However, in practice reliable measurement methods frequently have high measurement uncertainty, while low reliability methods are applied to limit measurement uncertainty. Comparison of reliable data with high measurement uncertainty to not so reliable data measured with low uncertainty is discussed – in different scenarios different data analysis methods are applicable.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Assessment of CTF for Steady-state and Transient Post-CHF Conditions in Support of Time-at-Temperature Modeling Applications

The US nuclear industry is exploring options to improve operational economics and uprate the current fleet of light-water reactors by investigating transitioning to cladding performance–based safety criteria as opposed to the current limit, which requires complete avoidance of critical heat flux (CHF)/dryout. Past experience has shown that not all events leading to a dryout are severe enough to cause fuel performance degradation. Allowing temporary dryout of the fuel—that is, using a time-at-temperature (TaT) strategy—could allow for economic improvements via large power uprates and enhanced operational flexibility for current plants without compromising fuel integrity. To support this effort, the US Department of Energy is executing a comprehensive program that includes generating cladding material data under TaT conditions, developing new mechanistic models, and demonstrating modeling and simulation capabilities for transients of interest. This paper presents work performed to assess the CTF thermal-hydraulics subchannel code. CTF is a package used in the VERA core simulator, which will ultimately be used for TaT analysis. CTF will provide the thermal-hydraulic boundary conditions that will be needed for fuel performance analysis in the BISON code. Quantifying both the accuracy and uncertainty of post-CHF models will therefore be necessary. This paper outlines the strategy for the assessment of TaT and presents the results of using the steady-state and transient dryout experiments of the Boiling Fine-mesh Bundle Tests for CTF validation. The results show that the current model tends to overpredict steady-state critical power. This behavior translates to the transient tests, in which CTF is unable to capture transient dryout behavior. Some discussion of sensitivity analysis work being performed is provided to indicate which models must be further analyzed to properly model transient dryout and its uncertainty.

Salko Jr, Robert [ORNL] (ORCID:0000000253566679)↗

Analysis of AVHRR, CZCS and historical in situ data off the Oregon Coast

The original scientific objectives of this grant were to: (1) characterize the seasonal cycles and interannual variability for phytoplankton concentrations and sea surface temperature (SST) in the California Current using satellite data; and (2) to explore the spatial and temporal relationship between these variables and surface wind forcing. An additional methodological objective was to develop statistical methods for forming mean fields, which minimize the effects of random data gaps and errors in the irregularly sampled CZCS (Coastal Zone Color Scanner) and AVHRR (Advanced Very High Resolution Radiometer) satellite data. A final task was to evaluate the level of uncertainty in the wind fields used for the statistical analysis. Funding in the first year included part of the cost of an image processing system to enable this and other projects to process and analyze satellite data. This report consists of summaries of the major projects carried out with all or partial support from this grant. The appendices include a list of papers and professional presentations supported by the grant, as well as reprints of the major papers and reports.

Strub, P. Ted↗

Comparing traditional and Bayesian approaches to ecological meta‐analysis

Abstract Despite the wide application of meta‐analysis in ecology, some of the traditional methods used for meta‐analysis may not perform well given the type of data characteristic of ecological meta‐analyses. We reviewed published meta‐analyses on the ecological impacts of global climate change, evaluating the number of replicates used in the primary studies ( n i ) and the number of studies or records ( k ) that were aggregated to calculate a mean effect size. We used the results of the review in a simulation experiment to assess the performance of conventional frequentist and Bayesian meta‐analysis methods for estimating a mean effect size and its uncertainty interval. Our literature review showed that n i and k were highly variable, distributions were right‐skewed and were generally small (median n i = 5, median k = 44). Our simulations show that the choice of method for calculating uncertainty intervals was critical for obtaining appropriate coverage (close to the nominal value of 0.95). When k was low (<40), 95% coverage was achieved by a confidence interval (CI) based on the t distribution that uses an adjusted standard error (the Hartung–Knapp–Sidik–Jonkman, HKSJ), or by a Bayesian credible interval, whereas bootstrap or z distribution CIs had lower coverage. Despite the importance of the method to calculate the uncertainty interval, 39% of the meta‐analyses reviewed did not report the method used, and of the 61% that did, 94% used a potentially problematic method, which may be a consequence of software defaults. In general, for a simple random‐effects meta‐analysis, the performance of the best frequentist and Bayesian methods was similar for the same combinations of factors ( k and mean replication), though the Bayesian approach had higher than nominal (>95%) coverage for the mean effect when k was very low ( k < 15). Our literature review suggests that many meta‐analyses that used z distribution or bootstrapping CIs may have overestimated the statistical significance of their results when the number of studies was low; more appropriate methods need to be adopted in ecological meta‐analyses.

Pappalardo, Paula↗

Robust control with structured perturbations

This semi-annual report describes continued progress on the research. Among several approaches in this area of research, our approach to the parametric uncertainties are being matured everyday. This approach deals with real parameter uncertainties which other techniques such as H (sup infinity) optimal control, micron analysis and synthesis, and l(sub 1) optimal control cannot deal. The primary assumption of this approach is that the mathematical models are well obtained so that the most of system uncertainties can be translated into parameter uncertainties of their linear system representations. These uncertainties may be due to modeling, nonlinearity of the physical system, some time-varying parameters, etc. In this report period of research, we are concentrating on implementing a computer aided analysis and design tool based on new results on parametric robust stability. This implementation will help us to reveal further details in this approach.

Keel, Leehyun↗

Data from: Comparing traditional and Bayesian approaches to ecological meta-analysis

Despite the wide application of meta-analysis in ecology, some of the traditional methods used for meta-analysis may not perform well given the type of data characteristic of ecological meta-analyses. We reviewed published meta-analyses on the ecological impacts of global climate change, evaluating the number of replicates used in the primary studies (ni) and the number of studies or records (k) that were aggregated to calculate a mean effect size. We used the results of the review in a simulation experiment to assess the performance of conventional frequentist and Bayesian meta-analysis methods for estimating a mean effect size and its uncertainty interval. Our literature review showed that ni and k were highly variable, distributions were right-skewed, and were generally small (median ni =5, median k=44). Our simulations show that the choice of method for calculating uncertainty intervals was critical for obtaining appropriate coverage (close to the nominal value of 0.95). When k was low (<40), 95% coverage was achieved by a confidence interval based on the t-distribution that uses an adjusted standard error (the Hartung-Knapp-Sidik-Jonkman, HKSJ), or by a Bayesian credible interval, whereas bootstrap or z-distribution confidence intervals had lower coverage. Despite the importance of the method to calculate the uncertainty interval, 39% of the meta-analyses reviewed did not report the method used, and of the 61% that did, 94% used a potentially problematic method, which may be a consequence of software defaults. In general, for a simple random-effects meta-analysis, the performance of the best frequentist and Bayesian methods were similar for the same combinations of factors (k and mean replication), though the Bayesian approaches had higher than nominal (>95%) coverage for the mean effect when k was very low (k<15). Our literature review suggests that many meta-analyses that used z-distribution or bootstrapping confidence intervals may have over-estimated the statistical significance of their results when the number of studies was low; more appropriate methods need to be adopted in ecological meta-analyses.

54 ENVIRONMENTAL SCIENCES↗

Measurements for liquid rocket engine performance code verification

The goal of the rocket engine performance code verification tests is to obtain the I sub sp with an accuracy of 0.25% or less. This needs to be done during the sequence of four related tests (two reactive and two hot gas simulation) to best utilize the loss separation technique recommended in this study. In addition to I sub sp, the measurements of the input and output parameters for the codes are needed. This study has shown two things in regard to obtaining the I sub sp uncertainty within the 0.25% target. First, this target is generally not being realized at the present time, and second, the instrumentation and testing technology does exist to obtain this 0.25% uncertainty goal. However, to achieve this goal will require carefully planned, designed, and conducted testing. In addition, the test-stand (or system) dynamics must be evaluated in the pre-test and post-test phases of the design of the experiment and data analysis, respectively always keeping in mind that a .25% overall uncertainty in I sub sp is targeted. A table gives the maximum allowable uncertainty required for obtaining I sub sp with 0.25% uncertainty, the currently-quoted instrument specification, and present test uncertainty for the parameters. In general, it appears that measurement of the mass flow parameter within the required uncertainty may be the most difficult.

Praharaj, Sarat C.↗

Detailed Evaluation of MODIS Fire Radiative Power Measurements

Satellite remote sensing is providing us tremendous opportunities to measure the fire radiative energy (FRE) release rate or power (FRP) from open biomass burning, which affects many vegetated regions of the world on a seasonal basis. Knowledge of the biomass burning characteristics and emission source strengths of different (particulate and gaseous) smoke constituents is one of the principal ingredients upon which the assessment, modeling, and forecasting of their distribution and impacts depend. This knowledge can be gained through accurate measurement of FRP, which has been shown to have a direct relationship with the rates of biomass consumption and emissions of major smoke constituents. Over the last decade or so, FRP has been routinely measured from space by both the MODIS sensors aboard the polar orbiting Terra and Aqua satellites, and the SEVIRI sensor aboard the Meteosat Second Generation (MSG) geostationary satellite. During the last few years, FRP has been gaining recognition as an important parameter for facilitating the development of various scientific studies relating to the quantitative characterization of biomass burning and their emissions. Therefore, we are conducting a detailed analysis of the FRP products from MODIS to characterize the uncertainties associated with them, such as those due to the MODIS bow-tie effects and other factors, in order to establish their error budget for use in scientific research and applications. In this presentation, we will show preliminary results of the MODIS FRP data analysis, including comparisons with airborne measurements.

Ichoku, Charles↗

Predictive Modeling and Uncertainty Quantification in Condition Monitoring of Active Components: A Reactor Coolant Pump Use Case

This work develops data-driven models for onset of thermal barrier leakage in reactor coolant pumps. It incorporates uncertainty quantification to enhance the reliability and robustness of pre- dictions. Using synthetic data generated by the Generic Pressurized Water Reactor simulator, realistic degradation scenarios were simulated across lifecycle stages—beginning, middle, and end of life. Key variables, including differential pressure, flow rate, vibration, and temperatures, were analyzed using machine learning framework. The fully connected neural network models demonstrated exceptional performance, achieving R2 scores exceeding 0.99 and root mean square errors as low as around 8.23 × 10-2 gallon per minute (gpm) for the three stages of the lifecy- cle. UQ analysis further validated the model’s robustness, with narrow uncertainty bounds during steady-state operations and appropriately wider bounds during transitional phases, reflecting the physical behavior of the system. This work addresses important gaps in real-time condition moni- toring and regulatory compliance by integrating advanced condition monitoring technologies with UQ into IST programs. The ability to detect thermal barrier leakage early and quantify prediction reliability supports optimizing maintenance strategies while ensuring nuclear power plants’ safe and reliable operation.

99 - GENERAL AND MISCELLANEOUS↗

Development of response models for the Earth Radiation Budget Experiment (ERBE) sensors. Part 3: ERBE scanner measurement accuracy analysis due to reduced housekeeping data

The accuracy of scanner measurements was evaluated when the sampling frequency of sensor housekeeping (HK) data was reduced from once every scan to once every eight scans. The resulting increase in uncertainty was greatest for sources with rapid or extreme temperature changes. This analysis focused on the mirror attenuator mosaic (MAM) baffle and plate and scanner radiometer baffle due to their relatively high temperature changes during solar calibrations. Since only solar simulator data were available, the solar temperatures were approximated on these components and the radiative and thermal gradients in the MAM baffle due to reflected sunlight. Of the two cases considered for the MAM plate and baffle temperatures, one uses temperatures obtained from the ground calibration. The other attempt uses temperatures computed from the MAM baffle model. This analysis shows that the heat input variations due largely to the solar radiance and irradiance during a scan cycle are small. It also demonstrates that reasonable intervals longer than the current HK data acquisition interval should not significantly affect the estimation of a radiation field in the sensor field-of-view.

Choi, Sang H.↗

Time-of-Flight Calculations with Multiple Beam Phase Monitors: Calibration, Jitter Analysis & Energy Measurement

This report describes time-of-flight (ToF) beam energy measurements with multiple phase monitors in a beam line with no acceleration. Measurement uncertainty is quantified via rigorous treatment of beam-based phase monitor calibration and jitter analysis of the accelerator system. Experimental results in the Superconducting Linac (SCL) of the Spallation Neutron Source (SNS) are presented.

43 PARTICLE ACCELERATORS↗

Mission-Maps For Outbound Cislunar Transfer Trajectories

This study quantifies the robustness and sensitivity of an outbound cislunar trajectory for a lunar lander in the form of mission-maps, or topological maps that allows either a computer program or mission designer to intuitively optimize the placement of critical outbound correction burns from the derived sensitivity data. The non-linear multi-body dynamics are applied to generate an outbound cislunar reference profile used by a linear covariance analysis (LinCov) tool to compute the expected Δv and trajectory dispersions due to the initial state uncertainty, sensor errors, maneuver execution errors, and disturbance accelerations along the outbound cislunar profile. The rapid performance analysis capabilities of LinCov are complimented with parallel processing techniques to evaluate hundreds and thousands of different translational burn locations, placements, and targeting constraints to identify the combination that minimizes the total Δv usage (nominal plus 3σ Δv) and trajectory dispersions at lunar orbit insertion. This study utilizes a generalized reference targeting algorithm to quickly assess the integrated closed-loop GN&C system performance due to different targeting configurations and constraints. The resulting mission maps provide an intuitive insight to ascertain each trajectory correction maneuver’s (TCM) sensitivity to different burn times along an outbound cislunar trajectory and quickly identify desirable engineering tradeoffs when performing analysis on the number and placement of these burns that nominally zero. Multiple mission maps are generated for a variety of different performance parameters that allow engineers to visually identify optimal solutions for trajectory correction maneuver placements, the number of correction burns, and the targeting constraints for each burn.

GN&C↗

Are models of catalytic removal of O3 by HO(x) accurate? Constraints from in situ measurements of the OH to HO2 ratio

Measurements of the ratio OH/HO2, NO, O3, ClO, and BrO were obtained at altitudes from 15-20 km and latitudes from 15-60 deg N. A method is presented for interpreting the rates of chemical transformations that (1) are responsible for over half the ozone removal rate in the lower stratosphere via reactions of HO2; and (2) control the abundance of HO2 through coupling to nitrogen and halogen radicals. The results show our understanding of the chemical reactions controlling the partitioning of OH and HO2 is complete and accurate and that the potential effects of 'missing chemistry' are strickly constrained in the region of the atmosphere encompassed by the observations. The analysis demonstrates that the sensitivity of the ratio OH/HO2 to changes in NO is described to within 12% by current models. This reduces by more than a factor of 2 the effect of uncertainty in the coupling of hydrogen and nitrogen radicals on the analysis of the potential effects of perturbations to odd notrogen in the lower statosphere.

Cohen, R. C.↗

Failure Bounding And Sensitivity Analysis Applied To Monte Carlo Entry, Descent, And Landing Simulations

In the study of entry, descent, and landing, Monte Carlo sampling methods are often employed to study the uncertainty in the designed trajectory. The large number of uncertain inputs and outputs, coupled with complicated non-linear models, can make interpretation of the results difficult. Three methods that provide statistical insights are applied to an entry, descent, and landing simulation. The advantages and disadvantages of each method are discussed in terms of the insights gained versus the computational cost. The first method investigated was failure domain bounding which aims to reduce the computational cost of assessing the failure probability. Next a variance-based sensitivity analysis was studied for the ability to identify which input variable uncertainty has the greatest impact on the uncertainty of an output. Finally, probabilistic sensitivity analysis is used to calculate certain sensitivities at a reduced computational cost. These methods produce valuable information that identifies critical mission parameters and needs for new technology, but generally at a significant computational cost.

Gaebler, John A.↗