Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “prediction uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Active learning for SNAP interatomic potentials via Bayesian predictive uncertainty

Bayesian inference with a simple Gaussian error model is used to efficiently compute prediction variances for energies, forces, and stresses in the linear SNAP interatomic potential. Here, the prediction variance is shown to have a strong correlation with the absolute error over approximately 24 orders of magnitude. Using this prediction variance, an active learning algorithm is constructed to iteratively train a potential by selecting the structures with the most uncertain properties from a pool of candidate structures. The relative importance of the energy, force, and stress errors in the objective function is shown to have a strong impact upon the trajectory of their respective net error metrics when running the active learning algorithm. Batched training of different batch sizes is also tested against singular structure updates, and it is found that batches can be used to significantly reduce the number of retraining steps required with only minor impact on the active learning trajectory.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

A Decision Theoretic Approach To Optimizing Machine Learning Decisions with Prediction Uncertainty

While the use of machine learning (ML) classifiers is widespread, their output is often not part of any follow-on decision-making process. To illustrate, consider the scenario where we have developed and trained an ML classifier to find malicious URL links. In this scenario, network administrators must decide whether to allow a computer user to visit a particular website, or to instead block access because the site is deemed malicious. It would be very beneficial if decisions such as these could be made automatically using a trained ML classifier. Unfortunately, due to a variety of reasons discussed herein, the output from these classifiers can be uncertain, rendering downstream decisions difficult. Herein, we provide a framework for: (1) quantifying and propagating uncertainty in ML classifiers; (2) formally linking ML outputs with the decision-making process; and (3) making optimal decisions for classification under uncertainty with single or multiple objectives.

97 MATHEMATICS AND COMPUTING↗
NASA NTRSDate not supplied

Urban Air Mobility Noise: Current Practice, Gaps, and Recommendations

AN Air Mobility (UAM) is an opportunity for aviation to improve transportation systems across the world. Representative UAM vehicle attributes include electrical vertical takeoff and landing (eVTOL) vehicles that can accommodate up to 6 passengers (or equivalent cargo), are possibly autonomous, perform missions of up to 100 nautical miles at altitudes up to 3000 ft. above ground level, have flight speeds up to 200 knots, and weigh between 800 and 8000 pounds. Along with the many anticipated benefits, there will be noise issues that need to be addressed. In 2018, NASA formed an Urban Air Mobility Noise Working Group (UNWG) to assemble noise experts from industry, universities and government agencies to identify, discuss, and address UAM noise issues. This oral presentation summarizes technology gaps and goals associated with four areas of interest: Tools & Technologies, Ground & Flight Testing, Human Response & Metrics, and Regulation & Policy, and is drawn from a draft white paper [1] by the same title. Tools & Technologies include noise prediction tools and noise reduction technologies that have been developed for conventional rotorcraft and fixed-wing vehicles that may be applicable or need to be modified for UAM. Prediction tools need to be able to account for variable speed rotors and other temporal variation effects that impact community noise. A reprioritization of noise sources needs to be done since UAM vehicles include multiple rotors/propellers, often in proximity to one another and/or the airframe, with dynamic transition, and new noise sources such as electric motors or hybrid-electric propulsion. Scattering and propagation methods need to be developed that include the vehicle components and surfaces near a receiver such as buildings and vertiports. Validation databases are needed to quantify prediction uncertainties. Prediction tools used to evaluate community noise will need source models appropriate for a wide range of UAM vehicles. Existing noise reduction technologies need to be evaluated and new noise reduction technologies should be developed in anticipation of future noise requirements. Although the prediction and treatment of interior cabin noise is a secondary goal, it is recognized that new tools and methods may be needed due to the uniqueness of the vehicle design and the presence of both acoustic and structure-borne loads. Ground & Flight Testing has been a critical part of validating noise reduction technologies and verifying that an air vehicle is ready for certification. UAM vehicles introduce new challenges for test procedures such as different source noise directivity, unsteady sources due to maneuvers, and a variety of takeoff and approach trajectories. The operating environment will be more complex than current aircraft with the introduction of vertiports in populated areas with “urban canyons” making reflections an important part of noise prediction and annoyance. It is expected that new test procedures and measurement methods will be necessary. Consideration will need to be given for both piloted and autonomous operations. Human Response & Metrics may be very different for UAM noise compared to current experience with airport noise. Current metrics used to certify rotorcraft and fixed-wing aircraft may not be as useful for evaluating UAM noise. Operations at lower altitudes may influence annoyance. Psychoacoustic and community testing will be needed to quantify annoyance and assess appropriate metrics. In addition to conventional noise level metrics, considerations such as audibility and temporal variation of the sound may be required. Differences between indoor or outdoor exposure will have an impact with dependence on urban and residential flight paths. Aircraft noise is currently regulated at a national level and typically involves partnerships with the industry to establish regulations. Regulators realize that current policies and procedures may not be appropriate for some of the emerging air vehicles and new procedures may be needed to address UAM noise. Development of new policies and procedures are needed so that local communities do not hastily attempt to establish their own restrictions that will both limit growth of the market and create an inconsistent and confusing regulatory environment. To expedite this development, it is crucial early measurement data are shared through partnership arrangements to support both noise certification and noise modeling/noise assessment. At the same time, an effective engagement strategy should be developed to address local community noise issues associated with UAM vehicles and flight operations as they arise.

urban air mobility↗
NASA NTRS2014

Uncertainties in Predicting Rice Yield by Current Crop Models Under a Wide Range of Climatic Conditions

Predicting rice (Oryza sativa) productivity under future climates is important for global food security. Ecophysiological crop models in combination with climate model outputs are commonly used in yield prediction, but uncertainties associated with crop models remain largely unquantified. We evaluated 13 rice models against multi-year experimental yield data at four sites with diverse climatic conditions in Asia and examined whether different modeling approaches on major physiological processes attribute to the uncertainties of prediction to field measured yields and to the uncertainties of sensitivity to changes in temperature and CO2 concentration [CO2]. We also examined whether a use of an ensemble of crop models can reduce the uncertainties. Individual models did not consistently reproduce both experimental and regional yields well, and uncertainty was larger at the warmest and coolest sites. The variation in yield projections was larger among crop models than variation resulting from 16 global climate model-based scenarios. However, the mean of predictions of all crop models reproduced experimental data, with an uncertainty of less than 10 percent of measured yields. Using an ensemble of eight models calibrated only for phenology or five models calibrated in detail resulted in the uncertainty equivalent to that of the measured yield in well-controlled agronomic field experiments. Sensitivity analysis indicates the necessity to improve the accuracy in predicting both biomass and harvest index in response to increasing [CO2] and temperature.

crop-model ensembles↗
NASA NTRS1972

Study of Uncertainties of Predicting Space Shuttle Thermal Environment

Quantitative estimates of the uncertainty in predicting aerodynamic heating rates for a fully reusable space shuttle system are developed and the impact of these uncertainties on Thermal Protection System (TPS) weight are discussed. The study approach consisted of statistical evaluations of the scatter of heating data on shuttle configurations about state-of-the-art heating prediction methods to define the uncertainty in these heating predictions. The uncertainties were then applied as heating rate increments to the nominal predicted heating rate to define the uncertainty in TPS weight. Separate evaluations were made for the booster and orbiter, for trajectories which included boost through reentry and touchdown. For purposes of analysis, the vehicle configuration is divided into areas in which a given prediction method is expected to apply, and separate uncertainty factors and corresponding uncertainty in TPS weight derived for each area.

Fehrman, A. L.↗
NASA NTRS2001

Investigating Uncertainty in Predicting Carbon Dynamics in North American Biomes: Putting Support-Effect Bias in Perspective

A fundamental strategy in NASA's Earth Observing System's (EOS) monitoring of vegetation and its contribution to the global carbon cycle is to rely on deterministic, process-based ecosystem models to make predictions of carbon flux over large regions. These models are parameterized (that is, the input variables are derived) using remotely sensed images such as those from the Moderate Resolution Imaging Spectroradiometer (MODIS), ground measurements and interpolated maps. Since early applications of these models, investigators have noted that results depend partly on the spatial support of the input variables. In general, the larger the support of the input data, the greater the chance that the effects of important components of the ecosystem will be averaged out. A review of previous work shows that using large supports can cause either positive or negative bias in carbon flux predictions. To put the magnitude and direction of these biases in perspective, we must quantify the range of uncertainty on our best measurements of carbon-related variables made on equivalent areas. In other words, support-effect bias should be placed in the context of prediction uncertainty from other sources. If the range of uncertainty at the smallest support is less than the support-effect bias, more research emphasis should probably be placed on support sizes that are intermediate between those of field measurements and MODIS. If the uncertainty range at the smallest support is larger than the support-effect bias, the accuracy of MODIS-based predictions will be difficult to quantify and more emphasis should be placed on field-scale characterization and sampling. This talk will describe methods to address these issues using a field measurement campaign in North America and "upscaling" using geostatistical estimation and simulation.

Dungan, Jennifer L.↗
NASA NTRS2009

Performance of Trajectory Models with Wind Uncertainty

Typical aircraft trajectory predictors use wind forecasts but do not account for the forecast uncertainty. A method for generating estimates of wind prediction uncertainty is described and its effect on aircraft trajectory prediction uncertainty is investigated. The procedure for estimating the wind prediction uncertainty relies uses a time-lagged ensemble of weather model forecasts from the hourly updated Rapid Update Cycle (RUC) weather prediction system. Forecast uncertainty is estimated using measures of the spread amongst various RUC time-lagged ensemble forecasts. This proof of concept study illustrates the estimated uncertainty and the actual wind errors, and documents the validity of the assumed ensemble-forecast accuracy relationship. Aircraft trajectory predictions are made using RUC winds with provision for the estimated uncertainty. Results for a set of simulated flights indicate this simple approach effectively translates the wind uncertainty estimate into an aircraft trajectory uncertainty. A key strength of the method is the ability to relate uncertainty to specific weather phenomena (contained in the various ensemble members) allowing identification of regional variations in uncertainty.

Lee, Alan G.↗