Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Uncertainties”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 847 records · Page 47
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

A Multistage Stochastic Transmission Expansion Algorithm for Wide-Area Planning under Uncertainty

The overall objective for this project was to develop and demonstrate a set of methods for solving the transmission investment problem for a large network considering many possible scenarios of future conditions and multiple decision points when investments can be made. Project sub-objectives achieved this goal through a succession of extending the methods to apply to problems with increasing complexity or additional features, including the number of decision points, whether generation and transmission are co-optimized, and whether AC or DC power flow is used. A transmission model was developed for the Western Electric Coordinating Council (WECC) region, the high-voltage transmission system that serves the western third of the continental U.S. Using a dataset provided by WECC and by researchers from John Hopkins University, we have validated and demonstrated the model and used it to compare the new method for solving multi-stage stochastic transmission planning to several state-of-the-art techniques. The project has resulted in several key outcomes and achievements: The covariance-based method for choosing a small set of hours to represent short-term variability has superior performance in terms of accuracy to existing methods, including K-means clustering and Importance Sampling; The combined partitioning method for long-term uncertainty with the nested clustering approach for choosing representative hours for each long-term group has superior accuracy for equivalent computational effort compared with existing methods; Using the partitioning/clustering method combined with Sample Average Approximation provides both statistical bounds on the quality of the solution and at the same time, a complete investment plan for all contingencies in the full uncertainty set; no existing methods can provide both at the same time; The method is demonstrated to work well for choosing both transmission and generation investments; A variant on the method allows for both scenario selection and simultaneous correction for the error from the DC power flow approximation to provide a tractable method for AC power flow-based transmission planning under uncertainty; The method applied to the WECC case study demonstrates the additional value to the system operator and the consumer of identifying flexible investment options in the near-term decisions. In particular, the case study exhibits significant option value in postponing some transmission additions that appear useful but in some long-term system states create new congestion problems.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Solar Uncertainty Management and Mitigation for Exceptional Reliability in Grid Operations (SUMMER-GO): Project Final Report

The Solar Uncertainty Management and Mitigation for Exceptional Reliability in Grid Operation (SUMMER-GO) project was recently completed through a collaboration among the National Renewable Energy Laboratory, Maxar, the Electric Reliability Council of Texas (ERCOT), the University of Texas at Dallas, the University of California Berkeley, and the University of Colorado Boulder. The project made significant advances in probabilistic solar power forecasting, both through the development of Bayesian model averaging methods for ensemble forecasting and in bringing these and other advancements into practice with Maxar's delivery of operational forecasts to ERCOT. In addition to creating more reliable solar power forecasts, the project developed methods for their utilization in power system operations. These include the development of risk-aware unit commitment and economic dispatch algorithms and methods to reformulate probabilistic forecasts to be used in these power system operational models. Dynamic power system reserve methods were also developed, which have been shown in silico to create economic savings and reliability improvements on an ERCOT-like system as well as financial savings in the ERCOT system through more granular consideration of the uncertainty associated with solar power forecasts. Finally, a situational awareness tool to help grid operators better understand solar power forecast uncertainty in daily operations was developed and extensively vetted.

14 SOLAR ENERGY↗
DOE OSTI2026

Advanced Semi-Supervised Learning with Uncertainty Estimation for Phase Identification in Distribution Systems

The integration of advanced metering infrastructure (AMI) into power distribution networks generates valuable data for tasks such as phase identification; however, the limited and unreliable availability of labeled data in the form of customer phase connectivity presents challenges. To address this issue, we propose a semi-supervised learning (SSL) framework that effectively leverages labeled and unlabeled data. Our approach incorporates self-training, label spreading, and Bayesian neural networks (BNNs) to enhance phase identification with AMI data. Our method uses an ensemble of multilayer perceptron classifiers in a self-training setup, iteratively adding high-confidence pseudo-labels to improve robustness. We also apply label spread to propagate labels based on data similarity, which enhances generalization across diverse distributions. In addition, we employ a BNNs with uncertainty estimation, boosting confidence in predictions and reducing phase identification errors. In our case study, we achieved approximately 98% +/- 0.08 accuracy with uncertainty using minimal and unreliable labeled data from a real U.S. utility, Duquesne Light Company. Our SSL approach, combined with uncertainty estimation, provides an efficient solution for phase identification in AMI data, ultimately improving the reliability of smart grid applications.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Advanced Semi-Supervised Learning With Uncertainty Estimation for Phase Identification in Distribution Systems

The integration of advanced metering infrastructure (AMI) into power distribution networks generates valuable data for tasks such as phase identification; however, the limited and unreliable availability of labeled data in the form of customer phase connectivity presents challenges. To address this issue, we propose a semi-supervised learning (SSL) framework that effectively leverages labeled and unlabeled data. Our approach incorporates self-training, label spreading, and Bayesian neural networks (BNNs) to enhance phase identification with AMI data. Our method uses an ensemble of multilayer perceptron classifiers in a self-training setup, iteratively adding high-confidence pseudo-labels to improve robustness. We also apply label spread to propagate labels based on data similarity, which enhances generalization across diverse distributions. In addition, we employ a BNNs with uncertainty estimation, boosting confidence in predictions and reducing phase identification errors. In our case study, we achieved approximately 98% +/- 0.08 accuracy with uncertainty using minimal and unreliable labeled data from a real U.S. utility, Duquesne Light Company. Our SSL approach, combined with uncertainty estimation, provides an efficient solution for phase identification in AMI data, ultimately improving the reliability of smart grid applications.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

General-Purpose Bayesian Tensor Learning With Automatic Rank Determination and Uncertainty Quantification

A major challenge in many machine learning tasks is that the model expressive power depends on model size. Low-rank tensor methods are an efficient tool for handling the curse of dimensionality in many large-scale machine learning models. The major challenges in training a tensor learning model include how to process the high-volume data, how to determine the tensor rank automatically, and how to estimate the uncertainty of the results. While existing tensor learning focuses on a specific task, this paper proposes a generic Bayesian framework that can be employed to solve a broad class of tensor learning problems such as tensor completion, tensor regression, and tensorized neural networks. We develop a low-rank tensor prior for automatic rank determination in nonlinear problems. Our method is implemented with both stochastic gradient Hamiltonian Monte Carlo (SGHMC) and Stein Variational Gradient Descent (SVGD). We compare the automatic rank determination and uncertainty quantification of these two solvers. We demonstrate that our proposed method can determine the tensor rank automatically and can quantify the uncertainty of the obtained results. We validate our framework on tensor completion tasks and tensorized neural network training tasks.

Bayesian inference↗
DOE OSTI2022

Uncertainties Induced by Processing Parameter Variation in Selective Laser Melting of Ti6Al4V Revealed by In-Situ X-ray Imaging

Selective laser melting (SLM) additive manufacturing (AM) exhibits uncertainties, where variations in build quality are present despite utilizing the same optimized processing parameters. In this work, we identify the sources of uncertainty in SLM process by in-situ characterization of SLM dynamics induced by small variations in processing parameters. We show that variations in the laser beam size, laser power, laser scan speed, and powder layer thickness result in significant variations in the depression zone, melt pool, and spatter behavior. On average, a small deviation of only ~5% from the optimized/reference laser processing parameter resulted in a ~10% or greater change in the depression zone and melt pool geometries. For spatter dynamics, small variation (10 μm, 11%) of the laser beam size could lead to over 40% change in the overall volume of the spatter generated. The responses of the SLM dynamics to small variations of processing parameters revealed in this work are useful for understanding the process uncertainties in the SLM process.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Improving Experimental Design through Uncertainty Analysis

In this paper, the development of a fission-gas collecting and physical-analysis-enabling instrument was proposed for small-volume determination. Analysis specifications require a design capable of accurately and repeatably determining volumes in the range of 0.07–2.5 mL. This system relies on a series of gas expansions originating from a cylinder with known internal volume. The combined gas law is used to derive the unknown volumes from these expansions. Initial system designs included one of two known volumes, 11.85 ± 0.34 mL and 5.807 ± 0.078 mL, with a manifold volume of 32 mL. Results obtained from modeling this system’s operation showed that 0.07 mL can be determined with a relative expanded uncertainty greater than 300% (k = 2) for a single replicate, which was unacceptable for the proposed experimental design. Initial modeling showed that the volume connecting the known volume and rodlet, i.e., the manifold volume, and the sensitivity of the pressure sensor were key contributors to the expanded uncertainty of the measured rodlet volume. The system’s design limited the available options for pressure sensors, so emphasis was placed on the design of the manifold volume. The final system design reduced the manifold volume to 17 mL. These changes in design, combined with replicate analysis, were able to reduce the relative expanded uncertainty by ±12% (k = 2) for the 0.07 mL volume.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2025

Beyond pinball loss: Quantile methods for calibrated uncertainty quantification

Amongthemanywaysofquantifying uncertainty in a regression setting, specifying the full quantile function is attractive, as quantiles are amenable to interpretation and evaluation. A model that predicts the true conditional quantiles for each input, at all quantile levels, presents a correct and efficient representation of the underlying uncertainty. To achieve this, many current quantile-based methods focus on optimizing the pinball loss. However, this loss restricts the scope of applicable regression models, limits the ability to target many desirable properties (e.g. calibration, sharpness, centered intervals), and may produce poor conditional quantiles. In this work, we develop new quantile methods that address these shortcomings. In particular, we propose methods that can apply to any class of regression model, select an explicit balance between calibration and sharpness, optimize for calibration of centered intervals, and produce more accurate conditional quantiles. We provide a thorough experimental evaluation of our methods, which includes a high dimensional uncertainty quantification task in nuclear fusion.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2003

Assessing model uncertainty in the conceptual design of a monopropellant propulsion system

An assessment of model uncertainty via probabilistic methods is described. An important question that arises in conceptual design is how accurate do models have to be to be useful? That is to say, when do other uncertainties in higher fidelity model counteract its accuracy when compared to a lower fidelity model faced with these same uncertainties?.

model uncertainty probabilistic methods conceptual↗
NASA NTRS2017

Wheels-Off Time Uncertainty Impact on Benefits of Early Call for Release Scheduling

Arrival traffic scenarios with 808 flights from 173 airports to Houston George Bush International airport are simulated to determine if Call For Release flights can receive a benefit in terms of less delay over other flights by scheduling prior to gate pushback (look-ahead in time) as opposed to at gate pushback. Call for Release flights are departures that require approval from Air Route Traffic Control Center prior to release. Realism is brought to the study by including gate departure delay and taxi-out delay uncertainties for the 77 major U. S. airports. Gate departure delay uncertainty is assumed to increase as a function of look-ahead time. Results show that Call For Release flights from an airport within the freeze horizon (a region surrounding the arrival airport) can get an advantage over other flights to a capacity constrained airport by scheduling prior to gate pushback, provided the wheels-off time uncertainty with respect to schedule is controlled to a small value, such as within a three-minute window. Another finding of the study is that system delay, measured as the sum of arrival delays, is smaller when flights are scheduled in the order of arrival compared to in the order of departure. Because flights from airports within the freeze horizon are scheduled in the order of departure, an increase in the number of internal airports with a larger freeze horizon increases system delay. Delay in the given scenario was found to increase by 126% (from 13.8 hours to 31.2 hours) as freeze horizon was increased from 30-minutes to 2-hours in the baseline scenario.

wheels-off time uncertainty↗
NASA NTRS2018

Required Time of Arrival as a Control Mechanism to Mitigate Uncertainty in Arrival Traffic Demand Management

The objective of this study is to explore the use of Required Time of Arrival (RTA) capability on the flight deck as a control mechanism on arrival traffic management to improve traffic delivery accuracy by mitigating the effect of traffic demand uncertainty. The uncertainties are caused by various factors, such as departure error due to the difference between scheduled departure and the actual take-off time. A simulation study was conducted using the Multi Aircraft Control System (MACS) software, a comprehensive research platform developed in the Airspace Operations Laboratory (AOL) at NASA Ames Research Center. The Crossing Time (CT) performance (i.e. the difference between target crossing time and actual crossing time) of the RTA for uncertainty mitigation during cruise phase was evaluated under the influence of varying two main factors: wind severity (heavy wind vs. mild wind), and wind error (1 hour, 2 hours, and 5 hours wind forecast errors). To examine the CT performance improvement made by the RTA, the comparison to the CT of the aircraft that were not assigned with RTA (Non-RTA) under the influence of the selected factors was also made. The Newark Liberty International Airport (EWR) was chosen for this study. A total 66 inbound traffic to the EWR (34 of them were airborne when the simulation was initiated, 32 were pre-departures at that time) was simulated, where the pre-scripted departure error was assigned to each pre-departure (61 conform to their Expected Departure Clearance Time, which is +-300 seconds of their scheduled departure time). The results of the study show that the delivery accuracy improvement can be achieved by assigning RTA, regardless of the influence of the selected two factors (the wind severity and the wind information inaccuracy). Across all wind variances, 66.9 (265 out of 396) of the CT performance of the RTA assigned aircraft was within +- 60 seconds (i.e. target tolerance range) and 88.9 (352 out of 396) aircraft met +-300 seconds marginal tolerance range, while only 33.6 (133 out of 396) of the Non-RTA assigned aircrafts CT performance achieved the target tolerance range and 75.5 (299 out of 396) stayed within the marginal. Examination of the impact of different error sources i.e. departure error, wind severity, and wind error suggest that although large departure errors can significantly impact the CT performance, the impacts of wind severity and errors were modest relative the targeted +- 60 second conformance range.

required time of arrival (RTA)↗
NASA NTRS2018

Updates of Moderate Resolution Imaging Spectroradiometer On-Orbit Calibration Uncertainty Assessments

The Moderate Resolution Imaging Spectroradiometer (MODIS) instruments have successfully operated for more than 18 and 16 years, respectively, on-board the NASA’s Earth Observing System Terra and Aqua spacecraft. Both Terra and Aqua MODIS have significantly contributed to the advance of global Earth remote sensing applications with a broad range of science products that have been continuously produced since the beginning of each mission and freely distributed to users worldwide. MODIS collects data in 20 reflective solar bands (RSB) and 16 thermal emissive bands (TEB), covering wavelengths from 0.41 to 14.4 μm. Its level 1B (L1B) data products, which provide the input for the MODIS high-level science products, include the top of the atmosphere reflectance factors for the RSB, radiances for both the RSB and TEB, and associated uncertainty indices (UI) at a pixel-by-pixel level. This paper provides a brief review of MODIS L1B calibration algorithms, including a number of improvements made in recent years. It presents an update of sensor calibration uncertainty assessments with a focus on several new contributors resulting from on-orbit changes in sensor characteristics, approaches developed to address these changes, and the impact due to on-orbit changes on the L1B data quality. Also discussed are remaining challenges and potential improvements to be made to continuously maintain sensor calibration and data quality, particularly those related to the quality of MODIS L1B uncertainty.

Spectroradiometer↗
NASA NTRSDate not supplied

Impact of Airborne Radar Uncertainties on Detect-and-Avoid Systems’ Performance

Impact of sensor uncertainty on Detect-and-Avoid (DAA) systems’ performance is investigated. Key metrics analyzed are the loss of DAA well clear ratio, the near-mid-air-collision risk ratio, the alert ratio, and the number of maneuvers per loss of DAA well clear. Sensitivity of these metrics to the magnitude of sensor uncertainty, pilots’ selection of maneuver, and surveillance range is investigated. Benefits of a dynamic buffer around the DAA well clear separation boundary, computed based on track accuracies, are also analyzed. These metrics are computed from open- and closed-loop simulations of a large number of representative encounters between an unmanned aircraft system and a manned aircraft. Results show that sensor uncertainty degrades safety metrics considerably but has only a minor effect on the number of maneuvers per loss of DAA well clear. The number of maneuvers, nonetheless, can be reduced by a 5◦ buffer away from the edge of the range of conflict-resulting heading in pilots’ selection of maneuver.

UAS↗
NASA NTRS2020

Pre-launch Radiometric Calibration and Uncertainty Analysis of Landsat Thermal Infrared Sensor 2

The Thermal Infrared Sensor-2 that will be on-board Landsat 9 has undergone a pre-launch testing campaign to characterize its radiometric, spectral, and spatial performance and demonstrate compliance to its requirements. This work reviews key elements of the instrument-level radiometric testing using an SI traceable source to derive its uncertainties. Those arising from on-orbit calibration using the TIRS-2 on-board blackbody are also discussed. We use a Monte Carlo approach to propagate the uncertainties through a non-linear calibration equation and address both random and systematic uncertainty terms. Achieving the required performance demonstrates the instrument’s potential for enhancing our understanding of the Earth’s environment.

Landsat↗
NASA NTRS2021

An Uncertainty Quantification Framework for Autonomous Flight System Tracking and Health Monitoring

This work proposes a perspective towards establishing a framework for uncertainty quantification of autonomous system tracking and health monitoring. The approach leverages the use of a predictive process structure, which maps uncertainty sources and their interaction according to the quantity of interest and the goal of the predictive estimation. It is systematic and uses basic elements that are system agnostic, and therefore needs to be tailored according to the specificity of the application. This work is motivated by the interest in low-altitude unmanned aerial vehicle operations, where awareness of vehicle and airspace state becomes more relevant as the density of autonomous operations grows rapidly. Predicted scenarios in the area of small vehicle operations and urban air mobility have no precedent, and holistic frameworks to perform prognostics and health management (PHM) at the system- and airspace-level are missing formal approaches to account for uncertainty. At the end of the paper, two case studies demonstrate implementation framework of trajectory tracking and health diagnosis for a small unmanned aerial vehicle. This work has been accepted for publication at the International Journal of Prognostics and Health Management Jan 2021. Minor edits have been incorporated to this original submission to incorporate complete overview and software integration.

Uncertainty Quantification↗
NASA NTRS2019

Uncertainties in the Geostationary Ocean Color Imager (GOCI) Remote Sensing Reflectance for Assessing Diurnal Variability of Biogeochemical Processes

Short-term (sub-diurnal) biological and biogeochemical processes cannot be fully captured by the current suite of polar-orbiting satellite ocean color sensors, as their temporal resolution is limited to potentially one clear image per day. Geostationary sensors, such as the Geostationary Ocean Color Imager (GOCI) from the Republic of Korea, allow the study of these short-term processes because their orbit permit the collection of multiple images throughout each day for any area within the sensor’s field of regard. Assessing the capability to detect sub-diurnal changes in in-water properties caused by physical and biogeochemical processes characteristic of open ocean and coastal ocean ecosystems, however, requires an understanding of the uncertainties introduced by the instrument and/or geophysical retrieval algorithms. This work presents a study of the uncertainties during the daytime period for an ocean region with characteristically low-productivity with the assumption that only small and undetectable changes occur in the in-water properties due to biogeochemical processes during the daytime period. The complete GOCI mission data were processed using NASA’s SeaDAS/l2gen package. The assumption of homogeneity of the study region was tested using three-day sequences and diurnal statistics. This assumption was found to hold based on the minimal diurnal and day-to-day variability in GOCI data products. Relative differences with respect to the midday value were calculated for each hourly observation of the day in order to investigate what time of the day the variability is greater. Also, the influence of the solar zenith angle in the retrieval of remote sensing reflectances and derived products was examined. Finally, we determined that the uncertainties in water-leaving “remote-sensing” reflectance (Rrs) for the 412, 443, 490, 555, 660 and 680 nm bands on GOCI are 8.05 × 10−4, 5.49 × 10−4, 4.48 × 10−4, 2.51 × 10−4, 8.83 × 10−5, and 1.36 × 10−4 sr−1, respectively, and 1.09 × 10−2 mg m−3 for the chlorophyll-a concentration (Chl-a), 2.09 × 10−3 m−1 for the absorption coefficient of chromophoric dissolved organic matter at 412 nm (ag (412)), and 3.7 mg m−3 for particulate organic carbon (POC). These Rrs values can be considered the threshold values for detectable changes of the in-water properties due to biological, physical or biogeochemical processes from GOCI.

Geostationary Ocean Color Imager (GOCI)↗
NASA NTRS2021

Development and Validation of an Empirical Ocean Color Algorithm with Uncertainties: A Case Study with the Particulate Backscattering Coefficient

We explored how algorithm (model) and in situ measurement (observation) uncertainties can effectively be incorporated into empirical ocean color model development and assessment. In this study we focused on methods for deriving the particulate backscattering coefficient at 555 nm, b(bp)(555)/(m). We developed a simple empirical algorithm for deriving b(bp)(555) as a function of a remote sensing reflectance line height (LH) metric. Model training was performed using a high-quality bio-optical dataset that contains coincident in situ measurements of the spectral remote sensing reflectances, R(rs)(λ)/(sr), and the spectral particulate backscattering coefficients, b(bp)(λ). The LH metric used is defined as the magnitude of Rrs(555) relative to a linear baseline drawn between R(rs)(490) and R(rs)(670). Using an independent validation dataset, we compared the skill of the LH-based model with two other models. We used contemporary validation metrics, including bias and mean absolute error (MAE), that were corrected for model and observation uncertainties. The results demonstrated that measurement uncertainties do indeed impact contemporary validation metrics such as mean bias and MAE. Zeta-scores and z-tests for overlapping confidence intervals were also explored as potential methods for assessing model skill.

ocean color↗
NASA NTRSDate not supplied

Applicability of a Framework for Estimating Performance and Associated Uncertainty for Modified Aircraft Configurations

As improvements are made to the accuracy and reliability of modeling and simulation techniques, certification by analysis becomes a more attractive alternative compared to traditional aircraft flight testing. Certification by analysis is especially cost-effective when one considers modifications to a previously certified aircraft. However, it is important that the models and methods used are applicable and accurate throughout the intended use domain. A framework for estimating the performance and associated uncertainty was introduced in an earlier paper. The factors and limitations of this framework for estimating the performance and associated model form uncertainty are explored to determine the range of applicability of the framework, particularly with respect to model form, process and sensor noise, and quality of available flight test data. This paper focuses on the general limitations and applicability of the framework and not the applicability of the individual methods to a range of modified configurations, which requires a large number of modified configurations and is an area for future work. The effects of these factors on the performance and uncertainty results are demonstrated using NASA’s Generic Transport Model aircraft.

uncertainty quantification↗