Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “probability and statistical methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30

Climate Nowcasting

The climate is changing so rapidly that climatologies based on historical statistics cannot reliably capture the current risk of extreme weather events hazardous to society. Decision relevant projections of weather extreme probability over the next 10–15 years are needed to enable adaptation and resilience in the face of this evolving risk. Current weather forecasts/predictions and long-term climate projections for decades into the future are inadequate for providing this information to stakeholders that need it, targeting forecast horizons either too short or too far into the future. We argue that a new approach is needed: climate nowcasting. Climate nowcasting would focus on user-inspired extreme metrics over the next 10–15 year time frame, targeting specific impacts and locations down to a local scale, by engaging with stakeholders to understand their needs and provide information in a format relevant for decision making. Importantly, climate nowcasting will not consist of a single approach or data set, involving rather data fusion from different sources of information: simulations, observations and data driven methods, likely through different weights depending on the metric of interest. Predictions must be accompanied by serious engagement with stakeholders facing climate risks, and clearly present uncertainties and limitations of any prediction. Such a vision is very different from how typical climate or weather forecasts are applied today.

Gettelman, Andrew↗

Atacama Cosmology Telescope: DR6 gravitational lensing and SDSS BOSS cross-correlation measurement and constraints on gravity with the 𝐸 𝐺 statistic

We derive new constraints on the 𝐸 𝐺 statistic as a test of gravity, combining the cosmic microwave background (CMB) lensing map estimated from Data Release 6 (DR6) of the Atacama Cosmology Telescope with Sloan Digital Sky Survey III Baryon Oscillation Spectroscopic Survey (SDSS BOSS) CMASS and LOWZ galaxy data. We develop an analysis pipeline to measure the cross-correlation between CMB lensing maps and galaxy data, following a blinding policy and testing the approach through null and consistency checks. By testing the equivalence of the spatial and temporal gravitational potentials, the 𝐸 𝐺 statistic can distinguish Λ⁢ CDM from alternative models of gravity. We find 𝐸 𝐺 ⁡(𝑧 eff = 0.555) = 0.3⁢1$^{+0.06}_{−0.05}$ for Atacama Cosmology Telescope (ACT) and CMASS data at 68.28% confidence level, and 𝐸 𝐺 ⁡(𝑧 eff = 0.316) = 0.4⁢9$^{+0.14}_{−0.11}$ for the ACT and LOWZ. Systematic errors are estimated to be 3% and 4%, respectively. Including CMB lensing information from Planck PR4 results in 𝐸 𝐺 ⁡(𝑧 eff = 0.555) = 0.3⁢4$^{+0.05}_{−0.05}$ with CMASS and 𝐸 𝐺 ⁡(𝑧 eff = 0.316) = 0.4⁢3$^{+0.11}_{−0.09}$ with LOWZ. These are consistent with predictions for the Λ⁢ CDM model that best fits the Planck CMB anisotropy and SDSS BOSS baryon acoustic oscillations (BAO), where 𝐸$^{GR}_{𝐺⁡}$(𝑧 eff =0.555) =0.401 ± 0.005 for CMB lensing combined with CMASS and 𝐸$^{GR}_{𝐺}$⁡(𝑧 eff = 0.316) = 0.452 ± 0.005 combined with LOWZ. We also find 𝐸 𝐺 to be scale independent, with probability to exceed >5%, as predicted by general relativity. The methods developed in this work are also applicable to improved future analyses with upcoming spectroscopic galaxy samples and CMB lensing measurements.

79 ASTRONOMY AND ASTROPHYSICS↗

A polymer, random walk model for the size-distribution of large DNA fragments after high linear energy transfer radiation

DNA double-strand breaks (DSBs) produced by densely ionizing radiation are not located randomly in the genome: recent data indicate DSB clustering along chromosomes. Stochastic DSB clustering at large scales, from > 100 Mbp down to < 0.01 Mbp, is modeled using computer simulations and analytic equations. A random-walk, coarse-grained polymer model for chromatin is combined with a simple track structure model in Monte Carlo software called DNAbreak and is applied to data on alpha-particle irradiation of V-79 cells. The chromatin model neglects molecular details but systematically incorporates an increase in average spatial separation between two DNA loci as the number of base-pairs between the loci increases. Fragment-size distributions obtained using DNAbreak match data on large fragments about as well as distributions previously obtained with a less mechanistic approach. Dose-response relations, linear at small doses of high linear energy transfer (LET) radiation, are obtained. They are found to be non-linear when the dose becomes so large that there is a significant probability of overlapping or close juxtaposition, along one chromosome, for different DSB clusters from different tracks. The non-linearity is more evident for large fragments than for small. The DNAbreak results furnish an example of the RLC (randomly located clusters) analytic formalism, which generalizes the broken-stick fragment-size distribution of the random-breakage model that is often applied to low-LET data.

DNA/radiation effects↗

Ensemble approximate control variate estimators: Applications to multi-fidelity importance sampling.

The recent growth in multifidelity uncertainty quantification has given rise to a large set of variance reduction techniques that leverage information from model ensembles to provide variance reduction for estimates of the statistics of a high-fidelity model. In this paper we provide two contributions: (1) we utilize an ensemble estimator to account for uncertainties in the optimal weights of approximate control variate (ACV) approaches and derive lower bounds on the number of samples required to guarantee variance reduction; and (2) we extend an existing multifidelity importance sampling (MFIS) scheme to leverage control variates. Our approach directly addresses a limitation of many multifidelity sampling strategies that require the usage of pilot samples to estimate covariances. As such we make significant progress towards both increasing the practicality of approximate control variates—for instance, by accounting for the effect of pilot samples—and using multifidelity approaches more effectively for estimating low-probability events. The numerical results indicate our hybrid MFIS-ACV estimator achieves up to 50% improvement in variance reduction over the existing state-of-the-art MFIS estimator, which had already shown an outstanding convergence rate compared to the Monte Carlo method, on several problems of computational mechanics.

97 MATHEMATICS AND COMPUTING↗

Statistical Analysis of Factors Riving Surface Ozone Variability over Continental South Africa

Statistical relationships between surface ozone (O3) concentration, precursor species and meteorological conditions in continental South Africa were examined from data obtained from measurement stations in north-eastern South Africa. Three multivariate statistical methods were applied in the investigation, i.e. multiple linear regression (MLR), principal component analysis (PCA) and –regression (PCR), and generalised additive model (GAM) analysis. The daily maximum 8-h moving average O3 concentrations were considered in these statistical models (dependent variable). MLR models indicated that meteorology and precursor species concentrations are able to explain ~50% of the variability in daily maximum O3 levels. MLR analysis revealed that atmospheric carbon monoxide (CO), temperature and relative humidity were the strongest factors affecting the daily O3 variability. In summer, daily O3 variances were mostly associated with relative humidity, while winter O3 levels were mostly linked to temperature and CO. PCA indicated that CO, temperature and relative humidity were not strongly collinear. GAM also identified CO, temperature and relative humidity as the strongest factors affecting the daily variation of O3. Partial residual plots found that temperature, radiation and nitrogen oxides most likely have a non-linear relationship with O3,while the relationship with relative humidity and CO is probably linear. An inter-comparison between O3 levels modelled with the three statistical models compared to measured O3 concentrations showed that the GAM model offered a slight improvement over the MLR model. These findings emphasise the critical role of regional-scale O3 precursors coupled with meteorological conditions in daily variances of O3 levels in continental South Africa.

multiple linear regression (MLR)↗

Summary and Annotated Bibliography of Measurement Error Corrections with Potential Application in Future Quesst Mission Community Noise Studies

This document is motivated by likely needs of the Quesst mission community response tests, which will culminate in data collection and estimation of dose-response regression relationships for consideration by domestic and international aviation regulators. Furthermore, basic research questions evaluating interactions between rates of community annoyance, dose levels, and indicators of the presence of rattle, vibration, and startle hinge on hypothesis testing in the context of regression models. For a variety of reasons, noise doses may be known only imprecisely and may not reflect the actual level experienced by responding subjects. These differences between true dose and estimated dose, be they systematic or random, constitute covariate measurement error. Available statistics literature speaks to the impacts of measurement error on regression models, both in terms of bias in estimated coefficients and predicted values, and in terms of the loss of statistical power for hypothesis testing. Given the particulars of a categorical annoyance response variable and a continuous noise dose predictor variable subject to measurement error during testing, the emphasis of this report is on findings and methods pertinent to generalized linear (and mixed) models likely to be employed during the Quesst mission community tests. We reach the following conclusions: 1. Of four reviewed methods, structural Bayesian measurement error models and simulation extrapolation (SIMEX) may be the most readily applicable to Quesst mission community noise study objectives. 2. If warranted, a linear measurement model can help model systematic sources of measurement error that the classical measurement error does not. 3. For its ready implementation and small additional input requirements, simulation extrapolation may be ideally suited for addressing secondary research questions involving interactions between annoyance, noise dose, and other factors through hypothesis testing. 4. For their flexibility and ability to propagate uncertainty, structural Bayesian hierarchical models have great appeal for mission purposes; some care may be needed in developing appropriate probability models describing actual noise exposure during testing. An annotated bibliography logs additional papers and resources that may be of value to analysts in other projects and disciplines.

Dose-Response Model↗

Transported PDF Modeling of Compressible Turbulent Reactive Flows by using the Eulerian Monte Carlo Fields Method

Although the transported probability density function (PDF) method has been developed for decades, its application has been mainly focused on the low-Mach number flow problems. This work extends the transported PDF method to compressible flow problems. The Eulerian Monte Carlo fields (EMCF) solution method is employed to solve the transported PDF equation for compressible flow problems. A pseudo stagnation enthalpy is introduced and its stochastic partial differential equation is derived to ensure total energy conservation numerically. A new mixing model called interaction by partial exchange with mean (IPEM) is introduced to expand the available choices of mixing models for the EMCF method. The consistency of the EMCF method is examined for solving the transported PDF equation. Numerical implementation details are discussed, such as the density coupling between the compressible flow solver and the EMCF solver, discretization schemes for the mixing terms and the stochastic terms. The implemented compressible flow solver coupled with the EMCF solver is verified and validated in a series of test cases with increasing level of complexity, ranging from a statistically one-dimensional turbulent mixing layer to a self-excited resonance model rocket combustor. It is observed that in general with the increase of compressibility, there is an increase in the sensitivity of the modeling results to the different models and algorithms. This makes it necessary to develop a thorough understanding of the model sensitivity in order to develop a robust and accurate simulation solver for highly compressible turbulent reactive flows. The thermo-acoustic instability inside the model rocket combustor case is captured reasonably, which demonstrates the overall capability of the developed compressible turbulent combustion solver based on the transported PDF method.

42 ENGINEERING↗

Orbit-averaging and deposition accuracy for runaway electron beams in hybrid kinetic-MHD simulations of the runaway plateau

We develop a new procedure that combines the kinetic orbit runaway electron code (KORC) and the NIMROD extended-magnetohydrodynamic code to simulate runaway electrons (REs) in the post-disruption plateau. KORC integrates guiding-center orbits, with a barycentric-based binary search strategy providing initial guesses for the Newton–Raphson logical-to-physical coordinate inversion, ensuring reliable particle-to-mesh mapping in NIMROD, whose fields remain static for the present study. Samples are drawn in accord with experimental parallel current profiles of RE beams during the plateau phase. Deposition in NIMROD is verified through comparison with a Python-based finite-element code that ensures periodicity in the poloidal direction and continuity at the magnetic axis. Accurate representation of near-axis fields requires finer mesh resolution to prevent under- and overshoots in current density from orbit inaccuracies. Yet, at a fixed particle count, increasing mesh resolution amplifies statistical noise in the deposited fields. An orbit-averaging method accumulates partial current deposits over multiple kinetic steps and reduces the statistical noise with little added computational cost. By coupling kinetic routines from KORC directly into the NIMROD codebase, these developments lay essential groundwork for future self-consistent KORC–NIMROD coupling.

Algorithms and data structure↗

Analytical Assessment of Simultaneous Parallel Approach Feasibility from Total System Error

In a simultaneous paired approach to closely-spaced parallel runways, a pair of aircraft flies in close proximity on parallel approach paths. The aircraft pair must maintain a longitudinal separation within a range that avoids wake encounters and, if one of the aircraft blunders, avoids collision. Wake avoidance defines the rear gate of the longitudinal separation. The lead aircraft generates a wake vortex that, with the aid of crosswinds, can travel laterally onto the path of the trail aircraft. As runway separation decreases, the wake has less distance to traverse to reach the path of the trail aircraft. The total system error of each aircraft further reduces this distance. The total system error is often modeled as a probability distribution function. Therefore, Monte-Carlo simulations are a favored tool for assessing a "safe" rear-gate. However, safety for paired approaches typically requires that a catastrophic wake encounter be a rare one-in-a-billion event during normal operation. Using a Monte-Carlo simulation to assert this event rarity with confidence requires a massive number of runs. Such large runs do not lend themselves to rapid turn-around during the early stages of investigation when the goal is to eliminate the infeasible regions of the solution space and to perform trades among the independent variables in the operational concept. One can employ statistical analysis using simplified models more efficiently to narrow the solution space and identify promising trades for more in-depth investigation using Monte-Carlo simulations. These simple, analytical models not only have to address the uncertainty of the total system error but also the uncertainty in navigation sources used to alert an abort of the procedure. This paper presents a method for integrating total system error, procedure abort rates, avionics failures, and surveillance errors into a statistical analysis that identifies the likely feasible runway separations for simultaneous paired approaches.

Madden, Michael M.↗

Interpretation of Probabilistic Surface Ozone Forecasts: A Case Study for Philadelphia

The use of probabilistic forecasting has been growing in a variety of disciplines because of its potential to emphasize the degree of uncertainty inherent in a prediction. Interpretation of probabilistic forecasts, however, is oftentimes difficult, deterring users who may benefit from such forecasts. To encourage broader use of probabilistic forecasts in the field of air quality, a process for interpreting forecasts from a statistical probabilistic air quality surface ozone model [the Regression in Self Organizing Map (REGiS)] is demonstrated. Four procedures to convert probabilistic to deterministic forecasts are explored for the Philadelphia, Pennsylvania, metropolitan area. These procedures calibrate the predicted probability of daily maximum 8-h-average ozone exceeding a standard value by 1) estimating climatological relative frequency, 2) establishing a probability of an exceedance threshold as 50%, 3) maximizing the threat score, and 4) determining the unit bias ratio. REGiS is trained using 2000–11 ozone-season (1 May–30 September) data, calibrated using 2012–14 data, and evaluated using 2015–18 data. Assessment of the calibration data with the Pierce skill score suggests an exceedance threshold based on climatological relative frequency for the conversion from probabilistic to deterministic forecasts. Calibrated REGiS generally compares well to predictions from the U.S. national air quality model and operational “expert” forecasts over the evaluation period. For other probabilistic models and situations, different procedures of converting probabilistic to deterministic forecasts may be more beneficial. The methods presented in this paper represent an approach for operational air quality forecasters seeking to use probabilistic model output to support forecasts designed to protect public health.

Nikolay Balashov↗

Pioneer 10 and 11 Data Analysis

This report finishes the work of NASA Grant NAS2-153, which supported data analysis for the UCSD instruments on Pioneers 10 and 11. The data analyzed under this grant span 22 years of interplanetary measurements in the inner and outer heliosphere. The UCSD instruments made their mark in cosmic ray research based upon their high energy thresholds, directional responses, and reliable data streams. one of their primary scientific objectives concerns the size, configuration, and time behavior of the heliosphere. The size scale is inferred from the radial intensity gradient, which is measured between the two spacecraft and extrapolated to interstellar intensity levels at the cosmic ray modulation boundary. This boundary still eludes us, and its position, motion, and the best method of extrapolation are ongoing problems. Current projections place the boundary beyond 100 AU, which may be beyond the termination shock, and raises the question of possible modulation in the heliosheath. Probably our only hope of seeing this region in the immediate future rides on the possibility that the boundary will move inward. Our instruments have recorded many Forbush, or transient, decreases in the outer heliosphere. These observations led us to a model that attributes many of the decreases to solar wind stream-stream interactions, and relates the cosmic ray variations to the locally observed magnetic field magnitude. As the cosmic ray variations in this model result only from topological changes in the modulation integral, the model is a tool for studying the possibility that the 11 year cosmic ray modulation cycle can be accounted for by a superposition of Forbush decreases. The cosmic ray angular distribution function is measurable, given a good telemetry rate, by the UCSD Cerenkov detector which counts particles of energy greater than 500 MeV/n. We obtained statistically significant samples from 1 to 9 AU, at 13 AU, and at 34 AU. The anisotropy tends to be a few tenths of a per cent at all radial distances. A quasiperiodic variation in the east-west anisotropy with period of about 50 days remains unexplained.

Fillius, Walker↗

A combined ensemble-volume average homogenization method for lattice structures with defects under dynamic and static loading

In the study of lattices structures, both experiments and numerical simulations are often conducted with small samples. Using combined ensemble and volume averaging, this work introduces a method to extract a macroscopic constitutive response of a lattice material from numerical simulations performed in periodic domains. The domain size needed to obtain statistically accurate results is investigated. Similar to molecular dynamics, the concept of the virial stress is introduced after homogenized equations are derived using the ensemble averaging method. Under static conditions, the virial stress is shown to agree with the volume averaged solid stress. Using the homogenization method, constitutive relations for this stress can be obtained from systems with uniform strains. Application of such obtained constitutive relations to more general cases results in an error proportional to the square of the ratio between the lattice length scale and the macroscopic length scale. Taking advantage of this property, numerical simulations are performed in systems with a uniform gradient of the average velocity. The volume average method is then used to accelerate convergence when studying lattices with defects. To avoid the artificial numerical time scale from the size of a representative volume element divided by the wave speed, a numerical scheme is developed to enforce a spatially uniform velocity gradient within the computational domain while allowing fluctuations of the velocity or displacement to develop naturally. To account for probability distribution of lattice defects, the stress is calculated as the ensemble-volume averaged value. For dynamic systems, energy dissipation properties are also studied.

36 MATERIALS SCIENCE↗

Applications of a fast and efficient method for simulating orbital mission safety

A fast and efficient method for simulating potential interactions between space objects is presented. The specialized hazard analysis simulation is run at the Russian Space Surveillance Center. It simulates the motion of objects in space and determines close encounters between these objects. First, ephemerides are predicted for all space objects over the time interval of concern. Second, using the predicted ephemerides, pairs of satellites that would likely collide are grouped together. Throughout the process, the pairs initially chosen are refined until all pairs of satellites are found which come within a certain miss distance of each other. In addition to the miss distance, other characteristics of the encounter including angle of incidence, relative velocity, type of approaching object, and probability of collision come out of the simulation. There are many potential applications of this simulation and its results to missing planning and mission safety. Artificial objects can be introduced to the simulation to examine potential encounters between the new objects and current objects for mission design applications. The simulation can be run many times to create data for statistical analysis of encounter parameters. These as well as many other potential applications are presented and discussed.

Huth, Jeffrey↗

Collision lifetimes and impact statistics of near-Earth asteroids

We have examined the lifetimes of Near-Earth asteroids (NEA's) by directly computing the collision probabilities with other asteroids and with the terrestrial planets. We compare these to the dynamical lifetimes, and to collisional lifetimes assumed by other workers. We discuss the implications of the differences. The lifetimes of NEA's are important because, along with the statistics of craters on the Earth and Moon, they help us to compute the number of NEA's and the rate at which new NEA's are brought to the vicinity of the Earth. Assuming that the NEA population is in steady-state, the lifetimes determine the flux of new bodies needed to replenish the population. Earlier estimates of the lifetimes ignored (or incompletely accounted for) the differences in the velocities of asteroids as they move in their orbits, so our results differ from (for example) Greenberg and Chapman (1983, Icarus 55, 455) and Wetherill (1988, Icarus 76, 1) by factors of 2 to 10. We have computed the collision rates and relative velocities of NEA's with each other, the main-belt asteroids, and the terrestrial planets, using the corrected method described by Bottke et. al. (1992, GRL, in press). We find that NEA's typically have shorter collisional lifetimes than do main-belt asteroids of the same size, due to their high eccentricities, which typically give them aphelia in the main belt. Consequently, they spend a great deal of time in the main belt, and are moving much slower than the bodies around them, making them 'sitting ducks' for impacts with other asteroids. They cross the paths of many objects, and their typical collision velocities are much higher (10-15 km/s) than the collision velocities (5 km/s) among objects within the main belt. These factors combine to give them substantially shorter lifetimes than had been previously estimated.

Bottke, W. F., Jr.↗

A consistent, Bayesian, approach to the cross section probability distribution in the unresolved resonance region

The cross sections of neutron-induced reactions can be divided into three energy ranges: the resolved resonance region (RRR), the unresolved resonance region (URR), and the fast region. In general, the cross sections in the URR show significant fluctuations that cannot be predicted and cannot be experimentally resolved, thus, it is commonly assumed that the cross section at a specific energy is given by a probability distribution function (PDF) over a range of values that can span several orders of magnitude. The current methodology used to describe such behavior is to construct the PDF by stochastically generating resonance ladders and numerically measuring the PDF. The resonance ladders are sampled using known resonance statistical properties and average resonance widths and spacings extrapolated from the RRR. Although this is a standard and widely used technique, it is computationally very expensive, therefore, an alternative, analytical, approach would be preferable due to the considerable speed up of the computational time in real life applications. Moreover, the current methodology does not take into account existing experimental data, such for total and capture cross sections, that are available for many nuclei. Finally, this approach was developed to be used in reactor-scale applications and it is not suited for use in single-event applications. In this work we will rethink the entire approach to the PDF construction using a Bayesian mindset. This will allow us to provide a different definition of the PDF that allows a much faster calculation of the higher-temperature PDFs and a proper combination of theoretical and experimental PDFs following the probability theory. We will also show that our definition is well suited for single-event applications and we will make an explicit connection between our method and the standard approach. We do this by showing that the central limit theorem applies and our method leads to the same PDF obtained with the standard methodology, for a large number of events per history.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

More Data Needed for Failure Rate Estimation, Validation, and Uncertainty Reduction

The currently planned schedule for advanced Environmental Control and Life Support System (ECLSS) development and test activities to support human exploration missions is unlikely to generate sufficient data to enable statistically-supportable, precise Orbital Replacement Unit (ORU) failure rate estimates to meet existing crew safety expectations. Accurate and precise failure rate estimates are critical for missions beyond Low Earth Orbit (LEO) because current risk mitigation approaches –namely regular resupply and rapid abort capabilities –will not be available. Safe operations will depend on mission planners’ ability to accurately forecast spares demand and efficiently provide the necessary resources. However, even after more than a decade of International Space Station (ISS) ECLSS operations, a significant amount of uncertainty remains in failure rate estimates. Uncertain or inaccurate failure rates result in increased risk and spares mass. A Bayesian estimation approach, such as the one currently implemented by the ISS Program, can reduce uncertainty by incorporating engineering judgement into failure rate estimates. However, experience on the ISS and with other complex systems shows that these prior failure rate estimates are often inaccurate. In addition, prior estimates are typically point values; some level of uncertainty must be added to convert these into probability distributions for Bayesian updating, and there are several potential methods for doing so. Due to the low rate of data collection, any inaccuracy in theseprior estimates currently hasa strong influence on the end result. This paper examines the challenges associated with failure rate estimation, validation, and uncertainty reduction in the context of ECLSS development for beyond-LEO missions. A variety of techniques for generating and updating Bayesian priors are discussed and evaluated using both real-world and simulated data. Potential solutions for improving failure rate estimation, including testing additional units, are analyzed and discussed, and a set of recommendations are provided for next-generation system development activities.

Reliability↗

More Data Needed for Failure Rate Estimation, Validation, and Uncertainty Reduction

The currently planned schedule for advanced Environmental Control and Life Support System (ECLSS) development and test activities to support human exploration missions is unlikely to generate sufficient data to enable statistically-supportable, precise Orbital Replacement Unit (ORU) failure rate estimates to meet existing crew safety expectations. Accurate and precise failure rate estimates are critical for missions beyond Low Earth Orbit (LEO) because current risk mitigation approaches –namely regular resupply and rapid abort capabilities –will not be available. Safe operations will depend on mission planners’ ability to accurately forecast spares demand and efficiently provide the necessary resources. However, even after more than a decade of International Space Station (ISS) ECLSS operations, a significant amount of uncertainty remains in failure rate estimates. Uncertain or inaccurate failure rates result in increased risk and spares mass. A Bayesian estimation approach, such as the one currently implemented by the ISS Program, can reduce uncertainty by incorporating engineering judgement into failure rate estimates. However, experience on the ISS and with other complex systems shows that these prior failure rate estimates are often inaccurate. In addition, prior estimates are typically point values; some level of uncertainty must be added to convert these into probability distributions for Bayesian updating, and there are several potential methods for doing so. Due to the low rate of data collection, any inaccuracy in theseprior estimates currently hasa strong influence on the end result. This paper examines the challenges associated with failure rate estimation, validation, and uncertainty reduction in the context of ECLSS development for beyond-LEO missions. A variety of techniques for generating and updating Bayesian priors are discussed and evaluated using both real-world and simulated data. Potential solutions for improving failure rate estimation, including testing additional units, are analyzed and discussed, and a set of recommendations are provided for next-generation system development activities.

Reliability↗

Statistical Symbolic Execution with Informed Sampling

Symbolic execution techniques have been proposed recently for the probabilistic analysis of programs. These techniques seek to quantify the likelihood of reaching program events of interest, e.g., assert violations. They have many promising applications but have scalability issues due to high computational demand. To address this challenge, we propose a statistical symbolic execution technique that performs Monte Carlo sampling of the symbolic program paths and uses the obtained information for Bayesian estimation and hypothesis testing with respect to the probability of reaching the target events. To speed up the convergence of the statistical analysis, we propose Informed Sampling, an iterative symbolic execution that first explores the paths that have high statistical significance, prunes them from the state space and guides the execution towards less likely paths. The technique combines Bayesian estimation with a partial exact analysis for the pruned paths leading to provably improved convergence of the statistical analysis. We have implemented statistical symbolic execution with in- formed sampling in the Symbolic PathFinder tool. We show experimentally that the informed sampling obtains more precise results and converges faster than a purely statistical analysis and may also be more efficient than an exact symbolic analysis. When the latter does not terminate symbolic execution with informed sampling can give meaningful results under the same time and memory limits.

Reliability↗