Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Reliability sensitivity index”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

11 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

A functional global sensitivity measure and efficient reliability sensitivity analysis with respect to statistical parameters

Sensitivity analysis and reliability assessment are two important aspects of structural and system safety. Epistemic uncertainty with respect to probabilistic model of input parameters due to lack of knowledge is present in many scarce-data applications and complicates the characterization of uncertainty in model response. In this article, we present two importance measures to evaluate the impact of distribution parameters on the probability distribution function (PDF) of the output and the failure probability. The epistemic uncertainty associated with the distribution parameters is modeled as random variables. Additionally, a modified extended polynomial chaos expansion (MEPCE) approach is introduced in which aleatory and epistemic random variables are modeled and propagated simultaneously while allowing the separate assessment for any single epistemic variable. A MEPCE-based kernel density estimation (KDE) construction provides a composite map from each epistemic variable to the response PDF. The functional global sensitivity index of the PDF with respect to the distribution parameters is thus derived, as a function of output, which is both more informative and more efficient than standard scalar sensitivity measures. Reliability sensitivity indices can be readily evaluated by integrating the global sensitivity index function over the failure zone. Three illustrative examples are used to demonstrate the proposed methodology.

42 ENGINEERING↗
DOE OSTI2026

Added value of site load measurements in probabilistic lifetime extension: a Lillgrund case study

Site-specific fatigue estimation is an essential part of wind turbine lifetime extension, with various methods depending on data availability. The present study compares probabilistic lifetime extension assessment results for rotor blades with and without load measurements. It also addresses two key questions in such assessments: the applicability of the Frandsen model for estimating waked turbulence under complex and mixed wake conditions and the extrapolation of mid-term data over longer time periods. The case study wind turbine is SWT-2.3-93, located at the edge of the Lillgrund wind farm, situated in the Øresund Strait between Denmark and Sweden. The turbine is extensively instrumented, with 5 years of data available from its supervisory control and data acquisition (SCADA) system. Although the Frandsen turbulence estimates deviate in a different manner from measurements at below- and above-rated mean wind speeds, the model remains a conservative approach for fatigue load prediction and reliability. In the current case study, the site-specific assessment using strain gauge measurements yields a 33 % higher annual fatigue reliability index after 35 years compared to a scenario based on the Frandsen estimation combined with ambient environmental data and a generic aeroelastic model. The results also demonstrate that the sensitivity of fatigue reliability to load uncertainty is negligible when load measurements are used directly but relatively high when relying on the Frandsen model in combination with a generic aeroelastic model. Overall, the high variability of the lifetime extension in different scenarios of data availability and accuracy shows the importance and added value of high-quality measurements combined with wind-farm-level SCADA and a model updated in real time (digital twins).

17 WIND ENERGY↗
DOE OSTI2022

Investigating capacity credit sensitivity to reliability metrics and computational methodologies

Assigning capacity value to renewable energy sources (RES) is a challenge faced in planning their integration with the grid. The difficulties stem from the natural characteristics of variability and intermittency of wind and solar sources. The capacity credit (CC) analysis evaluates the system’s actual power output compared with a constant capacity generator, i.e., conventional generator and determines an effective capacity to use for planning and operation. Herein this paper presents different factors that could affect the CC of a system. Two methods are proposed to determine the CC, namely equivalent firm capacity (EFC) and effective load carrying capability (ELCC). Since these methods are based on satisfying reliability criteria, daily loss of load expectation (LOLE), hourly loss of load (LOLH), and expected energy not served (EENS) have been employed as indices. To obtain the CC value, both methods apply two techniques: traditional and optimization. Genetic algorithm (GA) is the optimization approach used in this paper. Then, this work compares the two techniques and shows the superior performance of the optimization approach. Two hybrid systems, stand-alone (SA) and grid-connected (GC) modes, are proposed and used as case studies. The hybrid systems consist of photovoltaic (PV), wind turbine (WT), and battery energy storage system (BESS). In this work, three different scenarios are used to compare capacity credit: system as a whole, only wind, and no batteries. Finally, sensitivity analysis is carried out to examine the impact of varying the wind speed, solar irradiation, and load. It is demonstrated that the choice of reliability index plays an important role in determining the capacity credit and it is shown that EENS is a more comprehensive and consistent index of reliability.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Sensitivity of fatigue reliability in wind turbines: effects of design turbulence and the Wöhler exponent

Fatigue assessment of wind turbines involves three main sources of uncertainty: material resistance, load, and the damage accumulation model. Many studies focus on increasing the accuracy of fatigue load assessment to improve the fatigue reliability. Probabilistic modeling of the wind's turbulence standard deviation is an example of an approach used for this purpose. Editions 3 and 4 of the IEC standard for the design of wind energy generation systems (IEC 61400-1) suggest different probability distributions as alternatives for the representative turbulence in the normal turbulence model (NTM) of edition 1. There are debates on whether the suggested distributions provide conservative reliability levels, as the established design safety factors are calibrated based on the representative turbulence approach. The current study addresses the debate by comparing annual reliability based on different scenarios of NTM using a probabilistic approach. More importantly, it elaborates on the relative importance of load assessment accuracy in defining the fatigue reliability. Using the DTU 10 MW reference wind turbine and the first-order reliability method (FORM), we study the changes in the annual reliability level and its sensitivity to the three main random inputs. We perform the study considering the blade root flapwise and the tower base fore–aft moments, assuming different fatigue exponents in each load channel. The results show that integration over distributions of turbulence in each mean wind speed results in less conservative annual reliability levels than representative turbulence. The difference in the reliability levels varies according to turbulence distribution and the fatigue exponent. In the case of the tower base, the difference in the annual reliability index after 20 years can be up to 50 %. However, the model and material uncertainty have much higher effects on the reliability levels compared to load uncertainty. Knowledge about such differences in the reliability levels due to the choice of turbulence distribution is especially important, as it impacts the extent of lifetime extension through reliability reassessments.

17 WIND ENERGY↗
DOE OSTI2023

Quantifying model prediction sensitivity to model-form uncertainty

Computational and mathematical models are essential to understanding complex systems and phenomena. However, when developing such models, limited knowledge and/or resources necessitates the use of simplifying assumptions. It is therefore crucial to quantify the impact of such simplifying assumptions on the reliability and accuracy of resulting model predictions. This work develops a first-of-its-kind approach to quantify the impact of physics modeling assumptions on predictions. Here, we leverage the emerging field of model-form uncertainty (MFU) representations, which are parameterized modifications to modeling assumptions, in combination with grouped Sobol’ indices to quantitatively measure an assumption’s importance. Specifically, we compute the grouped Sobol’ index for the MFU representation’s parameters as a single importance measure of the assumption for which the MFU representation characterizes uncertainty. To ensure this approach is robust to the subjective choice of how to parameterize a MFU representation, we establish bounds for the difference between sensitivity results for two different MFU representations based on differences in model prediction statistics. The capabilities associated with this approach are demonstrated on three exemplar problems: an upscaled subsurface contaminant transport problem, ablation modeling for hypersonic flight, and nuclear waste repository modeling. We found that our grouped approach is able to assess the impact of modeling assumptions on predictions and offers computational advantages over classical Sobol’ index computation while providing more interpretable results.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Predicting Switchgrass Biomass Yields Using a Spectral Vegetation Index Derived from Multispectral Satellite Imagery

Successful scaling of perennial bioenergy crop production requires a landscape design that optimizes the benefits of finite lands for people, communities, and environments. Utilizing marginal areas is the key to sustainable bioenergy crop production (Ssegane et al., 2015, 2016). Marginal areas are often small-sized lands and unevenly distributed across the agricultural landscape (Ssegane et al., 2016); thus, a systematic, semi-automated remote sensing method is needed as an effective means of estimating bioenergy crop yields across landscapes. Argonne National Laboratory (Argonne) is currently developing a tool, Scaling Up Perennial Bioenergy Economics and Ecosystem Services Tool (SUPERBEEST), to identify marginal agricultural lands and quantify environmental and economic effects of perennial bioenergy crop production systems. The tool aims to provide users a path to foster the sustainable and productive integration of bioenergy crops in the Midwestern agricultural landscape. Reliable, cost-effective, and timely estimation of bioenergy crop yields using remote sensing would help calculate and track the success of integrated bioenergy crops in the landscape for those communities. Argonne previously conducted feasibility studies for estimating biomass yields for bioenergy feedstock, corn and perennial grass using spectral vegetation indices (SVIs)1 derived from optical imagery (Hamada et al., 2015, 2021). In both studies, SVIs, more specifically those sensitive to plant chlorophyll or nitrogen contents, showed potential for estimating or predicting biomass yields with a correlation of determination (R2) ranging from 0.54 to 0.96, indicating a value for further investigation as a viable means of quantifying bioenergy feedstock production across large landscapes. Thus, the goal of this study is to evaluate the feasibility of use of SVIs as a means of estimating or predicting switchgrass biomass yields at harvest using publicly available multispectral satellite imagery. The feasibility analysis was performed using four study areas of mature switchgrass located in Virginia. Objectives are to (1) examine the SVIs and establish their relationships with switchgrass biomass yields at harvest, (2) develop a parsimonious image processing model for predicting at-harvest yields by applying the relationships with the most promising spectral index and (3) map switchgrass yields predicted by the image processing model across the study sites. The calibration to field data will rely on switchgrass biomass yields determined by the baling method, representing a potential challenge to the analysis but an important practical aspect for future applications. With this research design, the study aimed to gain insights into enabling remote sensing-based estimation of bioenergy crop yields in a reliable, cost- effective, and timely manner across large, heterogeneous landscapes.

09 BIOMASS FUELS↗
DOE OSTI2024

Establishing robust correction schemes for improved and reliable ARM-AOS aerosol optical data products

Aerosol light absorption and scattering of solar radiation play an important role in the earth’s atmosphere in terms of direct and semi-direct radiative forcing. Optical parameters of importance to the US Department of Energy (DOE) climate models include absorption and scattering coefficients, single scattering albedo (SSA), absorption Angstrom exponents (AAE), and the asymmetry parameter (g). These parameters depend on aerosol size, shape and composition (refractive index), and are spectrally sensitive in the shortwave region. Additionally, these parameters have a complex dependency on the emission source, especially for carbonaceous aerosols. The DOE Atmospheric Radiation Measurement (ARM) user facility has deployed aerosol observing systems (AOS) containing several filter-based instruments to measure and constrain aerosol optical properties and related parameters at multiple sites worldwide. For measurement of aerosol light absorption, the AOS includes filter-based instruments (particle soot absorption photometer and tricolor absorption photometer) that infer particle-phase aerosol absorption coefficients at nominal red, green, and blue wavelength bands from the attenuation (ATN) of light passing through a particulate filter on which aerosols are deposited. Measurement of aerosol scattering is done in situ using nephelometers. By combining inferred absorption coefficients from filter-based ATN measurements and in situ scattering coefficients, value-added products (VAPs) such as SSA, AAE, and g are derived.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Moment expansion of polarized dust SED: A new path towards capturing the CMB B -modes with LiteBIRD

Accurate characterization of the polarized dust emission from our Galaxy will be decisive in the quest for the cosmic microwave background (CMB) primordial B-modes. An incomplete modeling of its potentially complex spectral properties could lead to biases in the CMB polarization analyses and to a spurious measurement of the tensor-to-scalar ratio r. It is particularly crucial for future surveys like the LiteBIRD satellite, the goal of which is to constrain the faint primordial signal leftover by inflation with an accuracy on the tensor-to-scalar ratio r of the order of 10 –3 . Variations of the dust properties along and between lines of sight lead to unavoidable distortions of the spectral energy distribution (SED) that cannot be easily anticipated by standard component-separation methods. This issue can be tackled using a moment expansion of the dust SED, an innovative parametrization method imposing minimal assumptions on the sky complexity. In the present paper, we apply this formalism to the B-mode cross-angular power spectra computed from simulated LiteBIRD polarization data at frequencies between 100 and 402 GHz that contain CMB, dust, and instrumental noise. The spatial variation of the dust spectral parameters (spectral index β and temperature T) in our simulations lead to significant biases on r (~21 σ r ) if not properly taken into account. Performing the moment expansion in β, as in previous studies, reduces the bias but does not lead to sufficiently reliable estimates of r. We introduce, for the first time, the expansion of the cross-angular power spectra SED in both β and T, showing that, at the sensitivity of LiteBIRD, the SED complexity due to temperature variations needs to be taken into account in order to prevent analysis biases on r. Thanks to this expansion, and despite the existing correlations between some of the dust moments and the CMB signal responsible for a rise in the error on r, we can measure an unbiased value of the tensor-to-scalar ratio with a dispersion as low as σ r = 8.8 × 10 –4 .

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Probabilistic Inference of Low-Surface-Brightness Galaxy Morphological Parameters Using Simulation-Based Inference

Low-surface-brightness galaxies (LSBGs) are diffuse, often dark-matter-dominated systems whose faintness makes their structural parameters difficult to measure reliably in wide-field imaging surveys. Robust parameter inference, including uncertainty quantification, is important for population studies and for comparisons with models of galaxy formation, as future surveys are expected to produce increasingly large samples of diffuse galaxies. In practice, LSBG profile modeling is sensitive to sky- background errors, masking choices, contaminating background sources, and the computational cost of obtaining posterior-level uncertainties for large samples. Motivated by these questions, we develop a simulation-based inference (SBI) framework for estimating posterior distributions of LSBG morphological parameters from simulated galaxy images. Using PyImfit, we generate DES-like single-Sersic profile LSBG images with known position angle, ellipticity, Sersic index, effective surface brightness, and effective radius. We then train a normalizing-flow-based neural posterior estimator using the sbi package to infer these parameters from the simulated images. For isolated simulated galaxies, the SBI posterior recovers the true input parameters, produces posterior predictive residuals consistent with the assumed noise model, and shows good empirical calibration in a DES-motivated test regime. We also compare SBI with PyImfit-based MCMC inference and find broadly comparable posterior constraints, while SBI enables substantially faster posterior sampling after training. Finally, we test robustness to compact background contaminants. A model trained only on isolated galaxies produces undercovered posteriors on contaminated images, whereas training on simulations with variable contaminant positions and fluxes improves calibration across contaminated test sets. These results demonstrate the promise of SBI for scalable, uncertainty-aware LSBG morphology inference, while emphasizing that posterior reliability strongly depends on whether training simulations include relevant observational complications.

Batbayar, Bilguun [U. Chicago (main)]↗
DOE OSTI2022

Using a surrogate-assisted Bayesian framework to calibrate the runoff-generation scheme in the Energy Exascale Earth System Model (E3SM) v1

Abstract. Runoff is a critical component of the terrestrial water cycle, and Earth system models (ESMs) are essential tools to study its spatiotemporal variability. Runoff schemes in ESMs typically include many parameters so that model calibration is necessary to improve the accuracy of simulated runoff. However, runoff calibration at a global scale is challenging because of the high computational cost and the lack of reliable observational datasets. In this study, we calibrated 11 runoff relevant parameters in the Energy Exascale Earth System Model (E3SM) Land Model (ELM) using a surrogate-assisted Bayesian framework. First, the polynomial chaos expansion machinery with Bayesian compressed sensing is used to construct computationally inexpensive surrogate models for ELM-simulated runoff at 0.5∘ × 0.5∘ for 1991–2010. The error metric between the ELM simulations and the benchmark data is selected to construct the surrogates, which facilitates efficient calibration and avoids the more conventional, but challenging, construction of high-dimensional surrogates for the ELM simulated runoff. Second, the Sobol' index sensitivity analysis is performed using the surrogate models to identify the most sensitive parameters, and our results show that, in most regions, ELM-simulated runoff is strongly sensitive to 3 of the 11 uncertain parameters. Third, a Bayesian method is used to infer the optimal values of the most sensitive parameters using an observation-based global runoff dataset as the benchmark. Our results show that model performance is significantly improved with the inferred parameter values. Although the parametric uncertainty of simulated runoff is reduced after the parameter inference, it remains comparable to the multimodel ensemble uncertainty represented by the global hydrological models in ISMIP2a. Additionally, the annual global runoff trend during the simulation period is not well constrained by the inferred parameter values, suggesting the importance of including parametric uncertainty in future runoff projections.

58 GEOSCIENCES↗
DOE OSTI2022

How to estimate soil organic carbon stocks of agricultural fields? perspectives using ex-ante evaluation

Estimating soil organic carbon (SOC) stocks of agricultural fields has a range of important applications from development of sustainable management practices to monitoring carbon stocks. There are many estimation strategies with the potential for more reliable estimates of SOC stock and more efficient use of soil sampling and analysis resources, especially by leveraging readily available auxiliary information such as remote sensing. However, concrete guidance for strategy selection is lacking. This study narrows this gap with a comparison of strategies for estimating deep SOC stock (0–60 cm) in a prototypical field. Using high density SOC stock measurements and simulation, we built on past studies by 1) ex-ante evaluating a large number of strategy options, 2) using a Bayesian approach to quantify the uncertainty of the comparison, and 3) considering multiple Bayesian models to assess sensitivity to this modeling choice. We found that, using readily available auxiliary information, both balanced and stratified sampling offer substantial improvements over simple random sampling. The auxiliary information most important for this improvement is a Sentinel-2 SOC index = blue / (green × red), followed by the topographic wetness index. We found that these results are robust to the choice of mapping method, but that there is uncertainty in the magnitude of improvement. Here, we recommend future studies implement this Bayesian approach for simulated ex-ante evaluation of SOC stock estimation strategies across more fields to investigate the generalizability of these findings.

54 ENVIRONMENTAL SCIENCES↗