Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,333 records · Page 74

Assessment of Satellite Radiometry in the Visible Domain

Marine reflectance and chlorophyll-a concentration are listed among the Essential Climate Variables by the Global Climate Observing System. To contribute to climate research, the satellite ocean color data records resulting from successive missions need to be consistent and well characterized in terms of uncertainties. This chapter reviews various approaches that can be used for the assessment of satellite ocean color data. Good practices for validating satellite products with in situ data and the current status of validation results are illustrated. Model-based approaches and inter-comparison techniques can also contribute to characterize some components of the uncertainty budget, while time series analysis can detect issues with the instrument radiometric characterization and calibration. Satellite data from different missions should also provide a consistent picture in scales of variability, including seasonal and interannual signals. Eventually, the various assessment approaches should be combined to create a fully characterized climate data record from satellite ocean color.

ocean color↗

Halpha Emitting Galaxies at Z ~ 0.6 in the Deep and Wide Narrow-Band Survey

We present new measurements of the Hα luminosity function (LF) and star formation rate (SFR) volume density for galaxies at z∼0.62 in the COSMOS field. Our results are part of the Deep And Wide Narrow-band Survey (DAWN), a unique infrared imaging program with large areal coverage (∼1.1 deg2 over five fields) and sensitivity (9.9 x 10(exp -18) erg cm(exp -2) s(exp -1) at 5σ). The present sample, based on a single DAWN field, contains 116 Hα emission line candidates at z∼0.62, 25% of which have spectroscopic confirmations. These candidates have been selected through the comparison of narrow and broad-band images in the infrared and through matching with existing catalogs in the COSMOS field. The dust-corrected LF is well described by a Schechter function with L* = 10 (exp 42.64 +/- 0.92) erg s (exp −1), Phi* = 10 (exp -3.320.93)Mpc(exp −3), L*Phi* = L 10(exp 39.40) 0.15 erg s(exp −1)Mpc(exp −3), and α=−1.75+/-0.09. From this LF, we calculate a SFR density of ρSFR=10(exp −1.37+/-0.08)solar mass yr(exp −1)Mpc(exp −3). We expect an additional cosmic variance uncertainty of ∼20%. Both the faint end slope and luminosity density that we derive are consistent with prior results at similar redshifts, with reduced uncertainties. We also present an analysis of these Hα emitters' sizes, which shows a direct correlation between the galaxies' sizes and their Hα emission.

Coughlin, Alicia↗

B-plane Evolution Under Highly Non-Keplerian Dynamics

Juno is the second of a series of New Frontiers missions and was launched in 2011. The spacecraft was set en route to Jupiter, and its Jupiter Orbit Insertion occurred on 2016-07-04 after a five-year cruise in deep space. The mission phase just prior to this large maneuver is called approach. As navigation team, we were responsible for precise orbit determination of the Juno spacecraft to ensure a successful orbit insertion. To evaluate the navigation performance we employed the B-plane mapping, where the incoming hyperbolic velocity defines the plane perpendicular to it, and the time to go to hit the plane will directly map into the uncertainties of the target point. The B-plane is a convenient tool when assessing the navigation performance as it is not affected by non-linearities due to the gravitational pull of the targeted body. However, as the Jupiter Orbit Insertion approached we started to realize that the B-plane mapping uncertainties were significantly larger than expected. We found that the B-plane mapping time had tremendous influence on the covariance inflation in the B-plane. Because of the close approach distance during the Jupiter Orbit Insertion and the strong interaction with J2 spherical harmonic coefficient, the Juno dynamics were too far from a Keplerian one assumed for the B-plane mapping. We first discuss the analytical approach of the B-plane mapping uncertainty and perform a numerical analysis to isolate the components of the Juno dynamics that cause the B-plane covariance inflation.

Bordi, John↗

Impacts of Dispatch Strategies and Forecast Errors on the Economics of Behind-the-Meter PV-Battery Systems

To assess the economic value of batteries in hybrid PV-battery systems, one must create a dispatch profile for the battery. Many analyses of battery value assume perfect forecasts of PV generation and load, determining an upper limit on the value of the battery. Prior work that accounts for forecast uncertainty often does so in the context of a single dispatch algorithm, which does not provide a baseline for comparison. Furthermore, when multiple dispatch algorithms are assessed with uncertainty, the benefits considered are for diesel generation in a microgrid, not retail rate savings. This work addresses the gaps in the literature by comparing the performance of both heuristic and optimal dispatch algorithms for retail rate savings under forecast uncertainty, and provides comparisons of the robustness of these algorithms and their associated estimates of economic value. We find that using a perfect forecast can overestimate the value of hybrid PV-battery systems between 1% and 8% compared to the reality of using a day-ahead forecast, depending on the dispatch algorithm used. Thus, accounting for forecast uncertainty in system design and analysis will significantly improve the accuracy of modeled system values.

batteries↗

Impacts of Dispatch Strategies and Forecast Errors on the Economics of Behind-the-Meter PV-Battery Systems: Preprint

To assess the economic value of batteries in hybrid PV-battery systems, one must create a dispatch profile for the battery. Many analyses of battery value assume perfect forecasts of PV generation and load, determining an upper limit on the value of the battery. Prior work that accounts for forecast uncertainty often does so in the context of a single dispatch algorithm, which does not provide a baseline for comparison. Furthermore, when multiple dispatch algorithms are assessed with uncertainty, the benefits considered are for diesel generation in a microgrid, not retail rate savings. This work addresses the gaps in the literature by comparing the performance of both heuristic and optimal dispatch algorithms for retail rate savings under forecast uncertainty, and provides comparisons of the robustness of these algorithms and their associated estimates of economic value. We find that using a perfect forecast can overestimate the value of hybrid PV-battery systems between 1% and 8% compared to the reality of using a day-ahead forecast, depending on the dispatch algorithm used. Thus, accounting for forecast uncertainty in system design and analysis will significantly improve the accuracy of modeled system values.

batteries↗

An Approach to Experimental Design for the Computer Analysis of Complex Phenomenon

The ability to make credible system assessments, predictions and design decisions related to engineered systems and other complex phenomenon is key to a successful program for many large-scale investigations in government and industry. Recently, many of these large-scale analyses have turned to computational simulation to provide much of the required information. Addressing specific goals in the computer analysis of these complex phenomenon is often accomplished through the use of performance measures that are based on system response models. The response models are constructed using computer-generated responses together with physical test results where possible. They are often based on probabilistically defined inputs and generally require estimation of a set of response modeling parameters. As a consequence, the performance measures are themselves distributed quantities reflecting these variabilities and uncertainties. Uncertainty in the values of the performance measures leads to uncertainties in predicted performance and can cloud the decisions required of the analysis. A specific goal of this research has been to develop methodology that will reduce this uncertainty in an analysis environment where limited resources and system complexity together restrict the number of simulations that can be performed. An approach has been developed that is based on evaluation of the potential information provided for each "intelligently selected" candidate set of computer runs. Each candidate is evaluated by partitioning the performance measure uncertainty into two components - one component that could be explained through the additional computational simulation runs and a second that would remain uncertain. The portion explained is estimated using a probabilistic evaluation of likely results for the additional computational analyses based on what is currently known about the system. The set of runs indicating the largest potential reduction in uncertainty is then selected and the computational simulations are performed. Examples are provided to demonstrate this approach on small scale problems. These examples give encouraging results. Directions for further research are indicated.

Rutherford, Brian↗

Uncertainties in predicting turbine blade metal temperatures

An analysis is presented of the effects of the hot-gas and coolant temperatures, the gas-to-blade and blade-to-coolant heat transfer coefficients, and the thermal conductances of a metal wall and a ceramic thermal-barrier coating on the prediction of local turbine-blade surface temperatures. The analysis was applied to the conditions of an advanced turbofan engine and a 1700 K, 40 atm turbine test rig, and to conditions that simulated the engine at 756 K and 15.6 atm. The results showed that with current information on boundary conditions, geometry, heat-transfer coefficients, and material thermal properties, the uncertainty in predicting and verifying local turbine-blade surface temperatures in an average engine is 98 kelvins or 7.6% of the reference metal absolute temperature for uncoated blades, and 62 kelvins or 5.7% for ceramic-thermal-barrier-coated blades.

Stepka, F. S.↗

16 O ⁡(𝑒,𝑒′⁢𝛼)⁢ 12 C measurements and the 12 C ⁡(𝛼,𝛾)⁢ 16 O astrophysical reaction rate

The 12 C ⁡(𝛼,𝛾)⁢ 16 O reaction, an important component of stellar helium burning, has a key role in nuclear astrophysics. It has significant impact on the evolution and final state of heavy to low mass stars, maximum mass of stellar formed black holes and also shapes the elemental abundances resulting from nucleosynthesis in such stars. Providing a reliable estimate for the energy dependence of this reaction at stellar helium burning temperatures has been a longstanding and important goal. In this work, we study the role of potential new 𝐸⁢1 and 𝐸⁢2 measurements of the 16 O ⁡(𝑒,𝑒′⁢𝛼)⁢ 12 C reaction in reducing the overall uncertainty in the astrophysical 𝑆 factor for the 12 C ⁡(𝛼,𝛾)⁢ 16 O 𝐸⁢1 and 𝐸⁢2 ground state capture extrapolated to a stellar energy of 300 keV. A multilevel 𝑅-matrix analysis is used to make extrapolations of the 𝑆 𝐸⁢1 (300 keV) and 𝑆 𝐸⁢2 (300 keV) factors for the 12 C ⁡(𝛼,𝛾)⁢ 16 O reaction from existing ground state capture data. Bayesian analysis is used to quantify the uncertainties in the extrapolations for both the existing data alone and also when possible new experimental data are included. In particular, we consider a new experiment that would make use of a high-intensity low-energy electron beam that impinges on a windowless oxygen gas target as a means to determine the total 𝐸⁢1 and 𝐸⁢2 ground state cross sections for this reaction. Here we find that the new data could significantly reduce the 𝑆⁡(300) uncertainties. Splitting the new data into high and low energy regions shows that both low and high energy data are effective in reducing the uncertainty.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

A Bayesian Multi-fidelity Neural Network to Predict Nonlinear Frequency Backbone Curves

The use of structural mechanics models during the design process often leads to the development of models of varying fidelity. Often low-fidelity models are efficient to simulate but lack accuracy, while the high-fidelity counterparts are accurate with less efficiency. Here, this paper presents a multi-fidelity surrogate modeling approach that combines the accuracy of a high-fidelity finite element model with the efficiency of a low-fidelity model to train an even faster surrogate model that parameterizes the design space of interest. The objective of these models is to predict the nonlinear frequency backbone curves of the Tribomechadynamics Research Challenge benchmark structure which exhibits simultaneous nonlinearities from frictional contact and geometric nonlinearity. The surrogate model consists of an ensemble of neural networks that learn the mapping between low and high-fidelity data through nonlinear transformations. Bayesian neural networks are used to assess the surrogate model's uncertainty. Once trained, the multi-fidelity neural network is used to perform sensitivity analysis to assess the influence of the design parameters on the predicted backbone curves. Additionally, Bayesian calibration is performed to update the input parameter distributions to correlate the model parameters to the collection of experimentally measured backbone curves.

42 ENGINEERING↗

The Micro-Pulse Lidar Network (MPLNET): A Federated Network of Micro-pulse Lidars and AERONET Sunphotometers

We present the formation of a new global-ground based eye-safe lidar network, the NASA Micro-Pulse Lidar Network (MPLNET). The aim of MPLNET is to acquire long- term observations of aerosol and cloud vertical profiles at unique geographic sites within the NASA Aerosol Robotic Network (AERONET). MPLNET utilizes standard instrumentation and data processing algorithms for efficient network operations and direct comparison of data between each site. The micro-pulse lidar is eye-safe, compact, and commercially available, and most easily allows growth of the network without sacrificing standardized instrumentation goals. Network growth follows a federated approach, pioneered by AERONET, wherein independent research groups may join MPLNET with their own instrument and site. MPLNET sites produce not only vertical profile data, but also column-averaged products already available from AERONET (aerosol optical depth, sky radiance, size distributions). Algorithms are presented for each MPLNET data product. Real-time Level 1 data products (next-day) include daily lidar signal images from the surface to -2Okm, and Level 1.5 aerosol extinction profiles at times co-incident with AERONET observations. Quality assured Level 2 aerosol extinction profiles are generated after screening the Level 1.5 results and removing bad data. Level 3 products include continuous day/night aerosol extinction profiles, and are produced using Level 2 calibration data. Rigorous uncertainty calculations are presented for all data products. Analysis of MPLNET data show the MPL and our analysis routines are capable of successfully retrieving aerosol profiles, with the strenuous accounting of uncertainty necessary for accurate interpretation of the results.

Welton, Ellsworth J.↗

Orbit Determination for the 2007 Mars Phoenix Lander

The Phoenix mission is designed to study the arctic region of Mars. To achieve this goal, the spacecraft must be delivered to a narrow corridor at the top of the Martian atmosphere, which is approximately 20 km wide. This paper will discuss the details of the Phoenix orbit determination process and the effort to reduce errors below the level necessary to achieve successful atmospheric entry at Mars. Emphasis will be placed on properly modeling forces that perturb the spacecraft trajectory and the errors and uncertainties associated with those forces. Orbit determination covariance analysis strongly influenced mission operations scenarios, which were chosen to minimize errors and associated uncertainties.

Ryne, Mark S.↗

Estimating the Rate of Occurrence of Renal Stones in Astronauts

Changes in urine chemistry, during and post flight, potentially increases the risk of renal stones in astronauts. Although much is known about the effects of space flight on urine chemistry, no inflight incidence of renal stones in US astronauts exists and the question "How much does this risk change with space flight?" remains difficult to accurately quantify. In this discussion, we tackle this question utilizing a combination of deterministic and probabilistic modeling that implements the physics behind free stone growth and agglomeration, speciation of urine chemistry and published observations of population renal stone incidences to estimate changes in the rate of renal stone presentation. The modeling process utilizes a Population Balance Equation based model developed in the companion IWS abstract by Kassemi et al. (2016) to evaluate the maximum growth and agglomeration potential from a specified set of urine chemistry values. Changes in renal stone occurrence rates are obtained from this model in a probabilistic simulation that interrogates the range of possible urine chemistries using Monte Carlo techniques. Subsequently, each randomly sampled urine chemistry undergoes speciation analysis using the well-established Joint Expert Speciation System (JESS) code to calculate critical values, such as ionic strength and relative supersaturation. The Kassemi model utilizes this information to predict the mean and maximum stone size. We close the assessment loop by using a transfer function that estimates the rate of stone formation from combining the relative supersaturation and both the mean and maximum free stone growth sizes. The transfer function is established by a simulation analysis which combines population stone formation rates and Poisson regression. Training this transfer function requires using the output of the aforementioned assessment steps with inputs from known non-stone-former and known stone-former urine chemistries. Established in a Monte Carlo system, the entire renal stone analysis model produces a probability distribution of the stone formation rate and an expected uncertainty in the estimate. The utility of this analysis will be demonstrated by showing the change in renal stone occurrence predicted by this method using urine chemistry distributions published in Whitson et al. 2009. A comparison to the model predictions to previous assessments of renal stone risk will be used to illustrate initial validation of the model.

gravitational physiology↗

Sensitivity Analysis of Genome-Scale Metabolic Flux Prediction

TRIMER, Transcription Regulation Integrated with MEtabolic Regulation, is a genome-scale modeling pipeline targeting at metabolic engineering applications. Using TRIMER, regulated metabolic reactions can be effectively predicted by integrative modeling of metabolic reactions with a Transcription Factor (TF)-gene regulatory network (TRN), which is modeled via a Bayesian network (BN). In this paper, we focus on sensitivity analysis of metabolic flux prediction for uncertainty quantification of BN structures for TRN modeling in TRIMER. We propose a computational strategy to construct the uncertainty class of TRN models based on the inferred regulatory order uncertainty given transcriptomic expression data. With that, we analyze the prediction sensitivity of the TRIMER pipeline for the metabolite yields of interest. The obtained sensitivity analyses can guide Optimal Experimental Design (OED) to help acquire new data that can enhance TRN modeling and achieve specific metabolic engineering objectives, including metabolite yield alterations. Here we have performed small- and large-scale simulated experiments, demonstrating the effectiveness of our developed sensitivity analysis strategy for BN structure learning to quantify the edge importance in terms of metabolic flux prediction uncertainty reduction and its potential to effectively guide OED.

59 BASIC BIOLOGICAL SCIENCES↗

Application of Neutron Multiplicity Counting Experiments to Optimal Cross-Section Adjustments

This paper presents the first application of model calibration to neutron multiplicity counting (NMC) experiments for cross-section optimization that is informed by adjoint-based sensitivity analysis (SA) and first-order uncertainty quantification (UQ). We summarize previous work on SA applied to NMC and describe notable modifications and additions. We give the procedure for first-order UQ and Bayesian-inference-based parameter estimation (PE). We then discuss model calibration applied to NMC of a 4.5-kg sphere of weapons-grade, alpha-phase plutonium metal (the BeRP ball) with the nPod neutron multiplicity counter. For the BeRP ball in bare and polyethylene-reflected configurations, we discuss the sensitivity of the first- and second-moment detector responses (i.e., first and second moments of the NMC distribution, respectively) to the cross sections. We describe the sources of uncertainty in the measured and simulated responses. Specifically, uncertainty in the measured responses is due to both random and systematic sources. Uncertainty in the simulated responses is due to the cross-section covariances. We describe in detail the adjustment to the cross sections and cross-section covariances due to the optimization. Due to the contribution of systematic uncertainties to the measured response uncertainties, the adjustment to the cross sections is similar in trend but larger in magnitude compared to that recommended by previous work. We compare the measured responses to responses simulated with nominal and optimized cross sections, demonstrating that the best-estimate cross sections produce simulations of NMC experiments that are more accurate with reduced uncertainty.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Ramp time synchronization

A new method of intercontinental clock synchronization has been developed and proposed for possible use by NASA's Deep Space Network (DSN), using a two-way/three-way radio link with a spacecraft. Analysis of preliminary data indicates that the real-time method has an uncertainty of 0.6 microsec, and it is very likely that further work will decrease the uncertainty. Also, the method is compatible with a variety of nonreal-time analysis techniques, which may reduce the uncertainty down to the tens of nanosecond range.

Hietzke, W.↗

Specifying design conservatism: Worst case versus probabilistic analysis

Design conservatism is the difference between specified and required performance, and is introduced when uncertainty is present. The classical approach of worst-case analysis for specifying design conservatism is presented, along with the modern approach of probabilistic analysis. The appropriate degree of design conservatism is a tradeoff between the required resources and the probability and consequences of a failure. A probabilistic analysis properly models this tradeoff, while a worst-case analysis reveals nothing about the probability of failure, and can significantly overstate the consequences of failure. Two aerospace examples will be presented that illustrate problems that can arise with a worst-case analysis.

Miles, Ralph F., Jr.↗

Measurement of the neutron cross section on argon between 95 and 720 MeV

We report an extended measurement of the neutron cross section on argon in the energy range of 95-720 MeV. The measurement was obtained with a 4.3-hour exposure of the Mini-CAPTAIN detector to the WNR/LANSCE beam at LANL. Compared to an earlier analysis of the same data, this extended analysis includes a reassessment of systematic uncertainties, in particular related to unused wires in the upstream part of the detector. Using this information we doubled the fiducial volume in the experiment and increased the statistics by a factor of 2.4. Here we also shifted the analysis from energy bins to time-of-flight bins. This change reduced the overall considered energy range, but improved the understanding of the energy spectrum of incoming neutrons in each bin. Overall, the new measurements are extracted from a fit to the attenuation of the neutron flux in five time-of-flight regions: 140ns-180ns, 120ns-140ns, 112ns-120ns, 104ns-112ns, 96ns-104ns. The final cross sections are given for the flux-averaged energy in each time-of-flight bin with statistical and systematic (syst) uncertainties: σ(146 MeV) = 0.60 $^{+0.14}_{-0.14}$ ±0.08(syst) b, σ(236 MeV) = 0.72 $^{+0.10}_{-0.10}$ ± 0.04(syst) b, σ(319 MeV) = 0.80 $^{+0.13}_{-0.12}$ ±0.040(syst) b, σ(404 MeV) = 0.74 $^{+0.14}_{-0.09}$ ±0.04(syst) b, σ(543 MeV) = 0.74 $^{±0.09}_{-0.09}$ ± 0.04(syst) b.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗