Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Sensitivity Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21

Simple Sensitivity Analysis for Orion GNC

The performance of Orion flight software, especially its GNC software, is being analyzed by running Monte Carlo simulations of Orion spacecraft flights. The simulated performance is analyzed for conformance with flight requirements, expressed as performance constraints. Flight requirements include guidance (e.g. touchdown distance from target) and control (e.g., control saturation) as well as performance (e.g., heat load constraints). The Monte Carlo simulations disperse hundreds of simulation input variables, for everything from mass properties to date of launch.We describe in this paper a sensitivity analysis tool (Critical Factors Tool or CFT) developed to find the input variables or pairs of variables which by themselves significantly influence satisfaction of requirements or significantly affect key performance metrics (e.g., touchdown distance from target). Knowing these factors can inform robustness analysis, can inform where engineering resources are most needed, and could even affect operations. The contributions of this paper include the introduction of novel sensitivity measures, such as estimating success probability, and a technique for determining whether pairs of factors are interacting dependently or independently. The tool found that input variables such as moments, mass, thrust dispersions, and date of launch were found to be significant factors for success of various requirements. Examples are shown in this paper as well as a summary and physics discussion of EFT-1 driving factors that the tool found.

Monte Carlo Simulation↗

Parametric and Sensitivity Analysis of a Steam Generator Model Using Python and Machine-Learning Tools

For this study, we used Python and machine-learning tools to perform a comprehensive parametric and sensitivity analysis on a steam generator (SG) model. (The Python model was based on a previously completed MATLAB framework for the Holtec SMR-160 SG.) We investigated the influence of various input parameters (e.g., heat transfer coefficient [HTC], Nusselt number, and heat exchanger effectiveness) on the system’s output. With machine-learning tools such as the Risk Analysis Virtual Environment (RAVEN), which was developed at Idaho National Laboratory, we were then able to perform an automated analysis of the SG inputs’ effect on the HTC. The analysis results give valuable insights into the performance and optimization of SG systems. We found the inlet mass flow rate (MFR) to have the greatest impact on the HTC, followed closely by the inlet temperature, and then pressure. Shifting of the input parameters causes the location of the maximum HTC along the SG length to change incrementally. The cold leg (CL) MFR was also found to impact the HTC magnitude as well as the location of the maximum HTC. At between 0.4–0.9 of the total SG length, the input parameters experience maximum impact on the HTC, leading us to suggest that sensors be efficiently placed on the SG so as to closely and effectively monitor thermal-hydraulic properties during reactor operation. We also found that the sensitivity data calculated manually agrees with the RAVEN – based data, confirming the same range of maximum sensitivity. However, the RAVEN-based analysis showed that cold leg pressure and hot leg temperature have a greater impact on the heat transfer coefficient than the mass flow rate, implying that a manual sensitivity study taking only two samples is not accurate.

20 FOSSIL-FUELED POWER PLANTS↗

High Accuracy Coronagraph Flight Model For WFIRST–CGI Raw Contrast Sensitivity Analysis

A high-accuracy high-fidelity flight wavefront control (WFC) model is developed for detailed raw contrast sensitivity analysis of WFIRST-CGI. Built upon features of recently testbed validated model, it is further refined to combine a full Fresnel propagation diffraction model for high accuracy contrast truth evaluation, and an economical compact model for WFC purposes. Extensive individual raw contrast error sensitivities are evaluated systematically, both as known imperfections and as unknown calibration errors, for both spectroscopy mode and wide field-of-view mode with shaped pupil coronagraph. More than 90 distinct error items were identified, including system aberrations, optical misalignment, component manufacturing error, telescope interface related errors, etc. The result forms the basis for raw contrast error budget flow down to a sub-system level, where detailed specifications needed to aid in component design and manufacturing, mechanical alignment and instrument integration, and verification and validation operations. Evaluations are mostly automated, making it relatively easy for repeat runs of revised design or at new desired error quantity. Top error sensitivities and contrast floor contributors are discussed and several observations are noted.

Poberezhskiy, Ilya↗

Image quality in thoracic 4D cone-beam CT: A sensitivity analysis of respiratory signal, binning method, reconstruction algorithm, and projection angular spacing

Purpose: Respiratory signal, binning method, and reconstruction algorithm are three major controllable factors affecting image quality in thoracic 4D cone-beam CT (4D-CBCT), which is widely used in image guided radiotherapy (IGRT). Previous studies have investigated each of these factors individually, but no integrated sensitivity analysis has been performed. In addition, projection angular spacing is also a key factor in reconstruction, but how it affects image quality is not obvious. An investigation of the impacts of these four factors on image quality can help determine the most effective strategy in improving 4D-CBCT for IGRT. Methods: Fourteen 4D-CBCT patient projection datasets with various respiratory motion features were reconstructed with the following controllable factors: (i) respiratory signal (real-time position management, projection image intensity analysis, or fiducial marker tracking), (ii) binning method (phase, displacement, or equal-projection-density displacement binning), and (iii) reconstruction algorithm [Feldkamp–Davis–Kress (FDK), McKinnon–Bates (MKB), or adaptive-steepest-descent projection-onto-convex-sets (ASD-POCS)]. The image quality was quantified using signal-to-noise ratio (SNR), contrast-to-noise ratio, and edge-response width in order to assess noise/streaking and blur. The SNR values were also analyzed with respect to the maximum, mean, and root-mean-squared-error (RMSE) projection angular spacing to investigate how projection angular spacing affects image quality. Results: The choice of respiratory signals was found to have no significant impact on image quality. Displacement-based binning was found to be less prone to motion artifacts compared to phase binning in more than half of the cases, but was shown to suffer from large interbin image quality variation and large projection angular gaps. Both MKB and ASD-POCS resulted in noticeably improved image quality almost 100% of the time relative to FDK. In addition, SNR values were found to increase with decreasing RMSE values of projection angular gaps with strong correlations (r ≈ −0.7) regardless of the reconstruction algorithm used. Conclusions: Based on the authors’ results, displacement-based binning methods, better reconstruction algorithms, and the acquisition of even projection angular views are the most important factors to consider for improving thoracic 4D-CBCT image quality. In view of the practical issues with displacement-based binning and the fact that projection angular spacing is not currently directly controllable, development of better reconstruction algorithms represents the most effective strategy for improving image quality in thoracic 4D-CBCT for IGRT applications at the current stage.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

SAGE Intrusion Detection System: Sensitivity Analysis Guided Explainability for Machine Learning.

This report details the results of a three-fold investigation of sensitivity analysis (SA) for machine learning (ML) explainability (MLE): (1) the mathematical assessment of the fidelity of an explanation with respect to a learned ML model, (2) quantifying the trustworthiness of a prediction, and (3) the impact of MLE on the efficiency of end-users through multiple users studies. We focused on the cybersecurity domain as the data is inherently non-intuitive. As ML is being using in an increasing number of domains, including domains where being wrong can elicit high consequences, MLE has been proposed as a means of generating trust in a learned ML models by end users. However, little analysis has been performed to determine if the explanations accurately represent the target model and they themselves should be trusted beyond subjective inspection. Current state-of-the-art MLE techniques only provide a list of important features based on heuristic measures and/or make certain assumptions about the data and the model which are not representative of the real-world data and models. Further, most are designed without considering the usefulness by an end-user in a broader context. To address these issues, we present a notion of explanation fidelity based on Shapley values from cooperative game theory. We find that all of the investigated MLE explainability methods produce explanations that are incongruent with the ML model that is being explained. This is because they make critical assumptions about feature independence and linear feature interactions for computational reasons. We also find that in deployed, explanations are rarely used due to a variety of reason including that there are several other tools which are trusted more than the explanations and there is little incentive to use the explanations. In the cases when the explanations are used, we found that there is the danger that explanations persuade the end users to wrongly accept false positives and false negatives. However, ML model developers and maintainers find the explanations more useful to help ensure that the ML model does not have obvious biases. In light of these findings, we suggest a number of future directions including developing MLE methods that directly model non-linear model interactions and including design principles that take into account the usefulness of explanations to the end user. We also augment explanations with a set of trustworthiness measures that measure geometric aspects of the data to determine if the model output should be trusted.

97 MATHEMATICS AND COMPUTING↗

Probabilistic Sensitivity Analysis for Launch Vehicles with Varying Payloads and Adapters for Structural Dynamics and Loads

This paper examines Probabilistic Sensitivity Analysis (PSA) methods and tools in an effort to understand their utility in vehicle loads and dynamic analysis. Specifically, this study addresses how these methods may be used to establish limits on payload mass and cg location and requirements on adaptor stiffnesses while maintaining vehicle loads and frequencies within established bounds. To this end, PSA methods and tools are applied to a realistic, but manageable, integrated launch vehicle analysis where payload and payload adaptor parameters are modeled as random variables. This analysis is used to study both Regional Response PSA (RRPSA) and Global Response PSA (GRPSA) methods, with a primary focus on sampling based techniques. For contrast, some MPP based approaches are also examined.

McGhee, David S.↗

Sensitivity analysis for characterizing the impact of HNGD model on the prediction of hydrogen redistribution in Zircaloy cladding using BISON code

Hydrogen in zirconium cladding is able to precipitate into zirconium hydrides which impacts cladding integrity. The Hydride Nucleation-Growth-Dissolution (HNGD) model in the BISON code accounts for the precipitation and dissolution kinetics of hydride in Zircaloy material. This paper presents global sensitivity analyses of the HNGD model aiming to enhance our understanding of the hydride precipitation phenomena by quantifying the variance that key parameters have on the prediction of hydrogen behavior under various environmental conditions. Here, model predictions are compared to experimental data obtained under two different conditions: 1) with uniformly precharged specimens subjected to a linear thermal gradient, and 2) specimens precharged with a cathodically applied hydride rim at one end of the sample and subjected to an asymmetric thermal gradient. The Sobol sensitivity analysis identifies the key parameters in the HNGD model for both types of specimens. For linear temperature cases, the heat of transport dominates the accuracy of predictions when no precipitation occurs at the cold end, while Terminal Solid Solubility for Dissolution (TSSD) is the most important parameter when precipitation occurs. A large variation in the predicted hydrogen concentration profiles is found in the range of high TSSD due to the occurrence of precipitation. For asymmetric temperature cases, the solubility coefficient gives the largest impact on the predicted hydrogen distribution, as it determines the amount of solute hydrogen dissolved from the initially applied hydride rim. A large discrepancy in hydrogen distribution between simulations and experiments exists with the asymmetric specimens because BISON simulations fail to predict the precipitation of hydride at the cooler end. Comparative studies using former and updated models verifies the significant impact of the hydride growth mechanism on predicted hydrogen concentration profiles. In particular, when hydride initially exists, changes in TSSD generate a large variation in the predicted amount of precipitation by hydride growth, giving large uncertainty in predicting the hydrogen distribution over the sample length. The outputs characterize the significant impact of the hydride growth mechanism in the HNGD model on predicting hydrogen behavior, and improve the understanding of the precipitation of hydride in Zircaloy cladding within a range of expected environmental conditions. The analyses indicate work is still needed to improve the hydride solvus models in the BISON code to accurately predict experimentally observed hydride concentrations and distributions.

36 MATERIALS SCIENCE↗

Simulation of carbon dioxide injection at the FutureGen2.0 site: Class VI permit model and local sensitivity analysis

Numerical simulation was conducted to evaluate supercritical CO 2 (scCO 2 ) storage in the Mt. Simon sandstone at the FutureGen 2.0 site in Morgan County, Illinois. The simulations illustrate the recent modeling effort conducted to successfully obtain a Class VI permit under the Underground Injection Control Program of the U.S. Environmental Protection Agency. The scCO2 was injected into a highly stratified reservoir, distributed among four lateral wells. Results show that each of the multiple reservoir layers with low permeability traps a fraction of the scCO 2 beneath it so that the injected scCO 2 does not reach the top of the reservoir by the end of the simulation period. Hence, all of the injected scCO 2 is considered to be safely trapped by the stratified structure within the reservoir. A local sensitivity analysis (LSA) was conducted for injectivity and plume size at the end of the 20 year injection period. The LSA indicates that the imposed initial conditions and the hydraulic properties of the injection layer contribute the most to the sensitivity. Overall, the simulation outputs are very sensitive to only a small fraction of the inputs. However, the parameters that are important for controlling CO 2 injectivity are not the same as those controlling the plume area. The three most sensitive inputs for injectivity are the horizontal permeability and the residual aqueous saturation of the injection layer, and the initial fracture-pressure gradient. For the plume area, the most sensitive inputs are the horizontal permeability of the injection layer and the residual aqueous saturation of the two adjacent layers above the injection layer. Furthermore, the advantages of requiring just a single set of simulation results, scalability to the proper parameter errors, and straightforward calculation of the composite sensitivities make the proposed analysis attractive for guiding site characterization, injection well design, estimating AoR uncertainty and, and monitoring network design.

54 ENVIRONMENTAL SCIENCES↗

Shape design sensitivity analysis using domain information

A numerical method for obtaining accurate shape design sensitivity information for built-up structures is developed and demonstrated through analysis of examples. The basic character of the finite element method, which gives more accurate domain information than boundary information, is utilized for shape design sensitivity improvement. A domain approach for shape design sensitivity analysis of built-up structures is derived using the material derivative idea of structural mechanics and the adjoint variable method of design sensitivity analysis. Velocity elements and B-spline curves are introduced to alleviate difficulties in generating domain velocity fields. The regularity requirements of the design velocity field are studied.

Seong, Hwal-Gyeong↗

Sensitivity analysis of VERA-CS and FRAPCON coupling in a multiphysics environment

A demonstration and description of the LOCA Toolkit for US light water reactors (LOTUS) is presented. Through LOTUS, the core simulator VERA-CS developed by CASL is coupled with the fuel performance code FRAPCON. The coupling is performed with consistent uncertainty propagation with all model inconsistencies being well-documented. Monte Carlo sampling is performed on a single 17 × 17 fuel assembly with a three cycle depletion case. Both uncertainty quantification (UQ) and sensitivity analysis (SA) are used at multiple states within the simulation to elucidate the behavior of minimum departure from nucleate boiling ratio (MDNBR), maximum fuel centerline temperature (MFCT), and gap conductance at peak power (GCPP). The SA metrics used are the Pearson correlation coefficient, Sobol sensitivity indices, and the density-based, delta moment independent measures. Results for MDNBR show consistency among all SA measures, as well for all states throughout the fuel lifecycle. MFCT results contain consistent rankings between SA measures, but show differences throughout the lifecycle. GCPP exhibits predominantly linear relations at low and high burnup, but highly nonlinear relations at intermediate burnup due to abrupt shifts between models. As a result, such behavior is largely undetectable to traditional regression or variance-based methods and demonstrates the utility of density-based methods.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Industrial PLC Network Modeling and Parameter Identification Using Sensitivity Analysis and Mean Field Variational Inference

A multiple input multiple output (MIMO) power line communication (PLC) model for industrial facilities was developed that uses the physics of a bottom-up model but can be calibrated like top-down models. The PLC model considers 4-conductor cables (three-phase conductors and a ground conductor) and has several load types, including motor loads. The model is calibrated to data using mean field variational inference with a sensitivity analysis to reduce the parameter space. The results show that the inference method can accurately identify many of the model parameters, and the model is accurate even when the network is modified.

47 OTHER INSTRUMENTATION↗

Efficient sensitivity analysis of the thermal profile in powder bed fusion of metals using hypercomplex automatic differentiation finite element method

Rapid cyclic temperature fluctuation occurring in powder bed fusion of metals using a laser beam (PBF-LB/M) influences the formation of flaws in printed parts. Consequently, there is a pressing need to enhance the quality of printed parts by developing innovative methodologies that can predict thermal histories and help uncover the intricate relationships between process parameters and thermal profiles. Sensitivity Analysis (SA) emerges as an essential tool for this, offering the potential for process optimization and enhanced quality control. Nonetheless, conventional SA methodologies often incur in excessive computational costs and potential numerical approximation errors. Here, to address this technical challenge, we present a novel method for SA that integrates the HYPercomplex-based Automatic Differentiation (HYPAD) technique with transient thermal simulations conducted via the finite element method (FEM). Leveraging this methodology, we efficiently and accurately perform SA for PBF-LB/M processes in a post-processing step. Compared to traditional methods like Finite Differences (FD), HYPAD-FEM required 96 % less computational time for obtaining sensitivities for 22 process parameters, under a comparative study conducted within the context of the 2018–02 AM benchmark of the National Institute of Standards and Technology. In summary, HYPAD-FEM offers superior efficiency and accuracy in SA over conventional methods, delivering the best sensitivity of a model without the need for step-size selection and problem or parameter-based implementations.

36 MATERIALS SCIENCE↗

Use of sensitivity analysis to predict pilot performance as a function of different displays

A technique for objectively evaluating different displays by sensitivity analysis is described. First, the mathematical model used to analyze static displays is developed. The technique is based on formulating functional relationships between the state variables and the variables observable in the display. The matrix of the partial derivatives of the display variables with respect to the state variables, together with the observer's acuity function, is used to calculate expected errors in the state vector estimation. The technique is expanded by the use of Kalman filtering to process a time series of observation vectors. This provides a tool for analyzing displays of dynamic processes by means of a dynamic display evaluation computer program. Results are reported using this program to simulate an Instrument Landing System approach.

Mout, M. L.↗

NEW EXTENDED DEUTERIUM FRACTIONATION MODEL: ASSESSMENT AT DENSE ISM CONDITIONS AND SENSITIVITY ANALYSIS

Observations of deuterated species are useful in probing the temperature, ionization level, evolutionary stage, chemistry, and thermal history of astrophysical environments. The analysis of data from the Atacama Large Millimeter Array and other new telescopes requires an elaborate model of deuterium fractionation. This paper presents a publicly available chemical network with multi-deuterated species and an extended, up-to-date set of gas-phase and surface reactions. To test this network, we simulate deuterium fractionation in diverse interstellar sources. Two cases of initial abundances are considered: (1) atomic except for H{sub 2} and HD, and (2) molecular from a prestellar core. We reproduce the observed D/H ratios of many deuterated molecules, and sort the species according to their sensitivity to temperature gradients and initial abundances. We find that many multiply deuterated species produced at 10 K retain enhanced D/H ratios at temperatures {approx}< 100 K. We study how recent updates to reaction rates affect calculated D/H ratios, and perform a detailed sensitivity analysis of the uncertainties of the gas-phase reaction rates in the network. We find that uncertainties are generally lower in dark cloud environments than in warm infrared dark clouds and that uncertainties increase with the size of the molecule and number of D-atoms. A set of the most problematic reactions is presented. We list potentially observable deuterated species predicted to be abundant in low- and high-mass star-formation regions.

74 ATOMIC AND MOLECULAR PHYSICS↗

Machine Learning Driven Sensitivity Analysis of E3SM Land Model Parameters for Wetland Methane Emissions

Methane (CH 4 ) is globally the second most critical greenhouse gas after carbon dioxide, contributing to 16%–25% of the observed atmospheric warming. Wetlands are the primary natural source of methane emissions globally. However, wetland methane emission estimates from biogeochemistry models contain considerable uncertainty. One of the main sources of this uncertainty arises from the numerous uncertain model parameters within various physical, biological, and chemical processes that influence methane production, oxidation, and transport. Sensitivity Analysis (SA) can help identify critical parameters for methane emission and achieve reduced biases and uncertainties in future projections. This study performs SA for 19 selected parameters responsible for critical biogeochemical processes in the methane module of the Energy Exascale Earth System Model (E3SM) land model (ELM). The impact of these parameters on various CH 4 fluxes is examined at 14 FLUXNET- CH 4 sites with diverse vegetation types. Given the extensive number of model simulations needed for global variance-based SA, we employ a machine learning (ML) algorithm to emulate the complex behavior of ELM methane biogeochemistry. We found that parameters linked to CH 4 production and diffusion generally present the highest sensitivities despite apparent seasonal variation. Comparing simulated emissions from perturbed parameter sets against FLUXNET-CH 4 observations revealed that better performances can be achieved at each site compared to the default parameter values. This presents a scope for further improving simulated emissions using parameter calibration with advanced optimization techniques.

54 ENVIRONMENTAL SCIENCES↗

Boundary formulations for three-dimensional continuum structural shape sensitivity analysis

The direct, singular, boundary element analysis formulation is shown to provide a basis for a computationally efficient and accurate shape design sensitivity analysis approach for the structural response of three-dimensional solid objects. The theoretical formulation for surface displacement and traction component sensitivities, and all components of the stress tensor is presented along with a formulation for the recovery of displacement and stress components in the interior of the object under consideration. Discussion of computational issues related to the overall efficiency of these formulations is given, along with numerical results to demonstrate the accuracy and efficiency of this approach.

Kane, J. H.↗

Selection of infectious medical waste disposal firms by using the analytic hierarchy process and sensitivity analysis

While Taiwanese hospitals dispose of large amounts of medical waste to ensure sanitation and personal hygiene, doing so inefficiently creates potential environmental hazards and increases operational expenses. However, hospitals lack objective criteria to select the most appropriate waste disposal firm and evaluate its performance, instead relying on their own subjective judgment and previous experiences. Therefore, this work presents an analytic hierarchy process (AHP) method to objectively select medical waste disposal firms based on the results of interviews with experts in the field, thus reducing overhead costs and enhancing medical waste management. An appropriate weight criterion based on AHP is derived to assess the effectiveness of medical waste disposal firms. The proposed AHP-based method offers a more efficient and precise means of selecting medical waste firms than subjective assessment methods do, thus reducing the potential risks for hospitals. Analysis results indicate that the medical sector selects the most appropriate infectious medical waste disposal firm based on the following rank: matching degree, contractor's qualifications, contractor's service capability, contractor's equipment and economic factors. By providing hospitals with an effective means of evaluating medical waste disposal firms, the proposed AHP method can reduce overhead costs and enable medical waste management to understand the market demand in the health sector. Moreover, performed through use of Expert Choice software, sensitivity analysis can survey the criterion weight of the degree of influence with an alternative hierarchy.

54 ENVIRONMENTAL SCIENCES↗

Uncertainty quantification and sensitivity analysis for SPERT III E-core reactivity measurement benchmarking

The Special Power Excursion Reactor Test (SPERT) III E-core experiment is important because it provides critical data on reactor behavior under significant reactivity insertions, which is essential for validating computer simulations and ensuring the safety of modern light water reactors. Its design similarities to contemporary reactors make it a valuable resource for understanding and mitigating extreme hazards in nuclear operations. The current study details the application of formal parametric uncertainty quantification and sensitivity analysis to a model of the SPERT-III E-core model for zero power reactivity benchmarking. Additionally, the reactivity impact from various modeling assumptions is quantified. Overall, an conservative estimate for an uncertainty in k$_{\text{eff}}$ of $\pm$1257 was observed. A less conservative, more realistic, uncertainty estimate of $\pm$1096 pcm can be justified by the potential for various parametric uncertainties to become negligible when sampled independently across the ~1400 pins in the core. The experimental results fall within both of these uncertainty bounds. Standardized regression coefficient as well as Sobol indices are used to identify the guide tube thicknesses as the primary contributors to the uncertainty in k$_{\text{eff}}$. Overall, this study provides information on how the uncertainties in input parameters and modeling methods impact simulated k$_{\text{eff}}$ values and can be used to aid model building efforts for future code validation with the SPERT-III E-core experiment.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗