Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty management”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

International Collaboration Activities in Geologic Disposal Research (FY24 Progress Report)

This report describes the FY24 status of international collaboration regarding geologic disposal research in the Office of Spent Fuel and Waste Science and Technology (SFWST) in the Department of Energy’s (DOE) Office of Nuclear Energy (NE). The mission of SFWST is to provide confidence in the safe long-term management of the nation’s spent nuclear fuel and high-level radioactive waste by reducing uncertainty and advancing technology for extended storage, transportation, and geologic disposal.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Integrating Land Cover Modeling and Adaptive Management to Conserve Endangered Species and Reduce Catastrophic Fire Risk

Land cover modeling is used to inform land management, but most often via a two-step process where science informs how management alternatives can influence resources and then decision makers can use this to make decisions. A more efficient process is to directly integrate science and decision making, where science allows us to learn to better accomplish management objectives and is developed to address specific decisions. Co-development of management and science is especially productive when decisions are complicated by multiple objectives and impeded by uncertainty. Multiple objectives can be met by specification of tradeoffs, and relevant uncertainty can be addressed through targeted science (i.e., models and monitoring). We describe how to integrate habitat and fuels monitoring with decision making focused on dual objectives of managing for endangered species and minimizing catastrophic fire risk. Under certain conditions, both objectives might be achieved by a similar management policy, but habitat trajectories suggest tradeoffs. Knowledge about system responses to actions can be informed by applying competing management actions to different land units in the same system state and by ideas about fire behavior. Monitoring and management integration is important to optimize state-specific management decisions and increase knowledge about system responses. We believe this approach has broad utility for and cover modeling programs intended to inform decision making.

adaptive management↗

The Roles of Verification, Validation and Uncertainty Quantification in the NASA Standard for Models and Simulations

The National Aeronautics and Space Administration (NASA) recently issued an interim version of the Standard for Models and Simulations (M&S Standard) [1]. The action to develop the M&S Standard was identified in an internal assessment [2] of agency-wide changes needed in the wake of the Columbia Accident [3]. The primary goal of this standard is to ensure that the credibility of M&S results is properly conveyed to those making decisions affecting human safety or mission success criteria. The secondary goal is to assure that the credibility of the results from models and simulations meets the project requirements (for credibility). This presentation explains the motivation and key aspects of the M&S Standard, with a special focus on the requirements for verification, validation and uncertainty quantification. Some pilot applications of this standard to computational fluid dynamics applications will be provided as illustrations. The authors of this paper are the members of the team that developed the initial three drafts of the standard, the last of which benefited from extensive comments from most of the NASA Centers. The current version (number 4) incorporates modifications made by a team representing 9 of the 10 NASA Centers. A permanent version of the M&S Standard is expected by December 2007. The scope of the M&S Standard is confined to those uses of M&S that support program and project decisions that may affect human safety or mission success criteria. Such decisions occur, in decreasing order of importance, in the operations, the test & evaluation, and the design & analysis phases. Requirements are placed on (1) program and project management, (2) models, (3) simulations and analyses, (4) verification, validation and uncertainty quantification (VV&UQ), (5) recommended practices, (6) training, (7) credibility assessment, and (8) reporting results to decision makers. A key component of (7) and (8) is the use of a Credibility Assessment Scale, some of the details of which were developed in consultation with William Oberkampf, David Peercy and Timothy Trocano of Sandia National Laboratories. The focus of most of the requirements, including those for VV&UQ, is on the documentation of what was done and the reporting, using the Credibility Assessment Scale, of the level of rigor that was followed. The aspects of one option for the Credibilty Assessment Scale are (1) code verification, (2) solution verification, (3) validation, (4) predictive capability, (5) technical review, (6) process control, and (7) operator and analyst qualification.

Zang, Thomas A.↗

Sierra/SD – Verification Test Manual – 5.22

Verification and validation (V&V) of scientific computing programs are important at Sandia National Labs due to the expanding role of computational simulation in managing the United States nuclear stockpile. The complexities of structural response calculations used to analyze physical problems, the varieties of codes applied to the calculations, and the importance of accurate predictions when assessing field conditions demand confidence in the consistency and accuracy of computer codes. Confidence in the accuracy of the predictions arising from computer simulations must ultimately be gained through verification and validation. The Sierra salinas structural dynamics analysis code, Sierra/SD, is used at the DOE Laboratories, and in several DOD projects. The roles of Sierra/SD in the qualification of weapon systems and components for normal and hostile environments throughout the Stockpile-to-Target Sequence include to, • Redesign weapon components. • Certify weapon components and systems for target environments such as hypersonic vehicles. • Certify that components will survive the thermal mechanical shock loads associated with hostile environments. • Evaluate current stockpile issues, including issues associated with uncertainty quantification. • Address many other problems that are encountered in stockpile management. The Sierra/SD verification plan is described, and an evolving set of key verification tests are described in detail. The verification tests ensure the correctness of the mathematics and numerical algorithms associated with functionality describing engineering phenomena. Development is in accordance with a set of tailored Software Quality Engineering (SQE) practices. SQE practices guide the overall verification and validation effort.

97 MATHEMATICS AND COMPUTING↗

Neglecting Model Parametric Uncertainty Can Drastically Underestimate Flood Risks

Abstract Floods drive dynamic and deeply uncertain risks for people and infrastructures. Uncertainty characterization is a crucial step in improving the predictive understanding of multi‐sector dynamics and the design of risk‐management strategies. Current approaches to estimate flood hazards often sample only a relatively small subset of the known unknowns, for example, the uncertainties surrounding the model parameters. This approach neglects the impacts of key uncertainties on hazards and system dynamics. Here we mainstream a recently developed method for Bayesian inference to calibrate a computationally expensive distributed hydrologic model. We compare three different calibration approaches: (a) stepwise line search, (b) precalibration or screening, and (c) the Fast Model Calibrations (FaMoS) approach. FaMoS deploys a particle‐based approach that takes advantage of the massive parallelization afforded by modern high‐performance computing systems. We quantify how neglecting parametric uncertainty and data discrepancy can drastically underestimate extreme flood events and risks. Precalibration improves prediction skill score over a stepwise line search. The Bayesian calibration improves the uncertainty characterization of model parameters and flood risk projections.

54 ENVIRONMENTAL SCIENCES↗

Goldsim Modeling of Vadose Zone Transport for E-Area Naval Reactor Component Disposal Areas: Model Description and Benchmarking

This report documents the development of a GoldSim® model of flow and radionuclide transport to the water table through the Naval Reactor Components Disposal Area (NRCDA) waste disposal sites and underlying vadose zones. The model is designed to be used for Monte Carlo uncertainty analysis in support of the E-Area Performance Assessment (PA). This report describes the model and shows results obtained from benchmarking the model to best-estimate deterministic results obtained using a PORFLOW model of NRCDA vadose zone transport. The PORFLOW model is three-dimensional while the GoldSim model is a simplified one-dimensional treatment. Nevertheless, the GoldSim model was able to accurately reproduce PORFLOW results with some adjustment to the nominal dispersion coefficient and vadose zone flow area used as “tuning” parameters. An example of the results obtained comparing GoldSim and PORFLOW calculation of releases of I-129, Tc-99, C-14 and Ni-59 from waste disposal containers at the 643-26E site is shown in Figure 1 below. For all of the test cases evaluated, GoldSim predicted peak concentrations within 6% of the PORFLOW values and peak times agreed within 8% with the majority of the results in better agreement. The close agreement between the two models provides confidence that GoldSim will give results accurately reflecting the behavior of releases from the NRCDA under off-normal operating conditions for sensitivity and uncertainty analysis

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Quantitative 14 N NMR with Monte Carlo Uncertainty Analysis of Nitrate/Nitrite in Alkaline Nuclear Waste

While monitoring of nitrate and nitrite concentrations is important for managing corrosion in nuclear waste systems, existing analytical methods are hindered by turbidity, spectral interference, and delays from sample handling. Here, we demonstrate quantitative 14 N nuclear magnetic resonance (qNMR) spectroscopy as a direct, matrix-tolerant approach for nitrate and nitrite detection at natural abundance. Monte Carlo resampling was integrated into the workflow to quantify random error, establish precision–time tradeoffs, and separate noise-limited uncertainty from systematic bias arising from shimming, transmitter offset, or excitation pulse conditions. Quantification of nitrate and nitrite were validated in controlled alkaline matrix challenges and in 18-component Hanford-type simulants. These results establish 14 N qNMR as a practical, uncertainty-bounded tool for monitoring redox-active nitrogen species in chemically complex environments and provide a generalizable framework for quantitative analysis of quadrupolar nuclei.

Graham, Trent R. [Pacific Northwest National Labor↗

Roadmap for the future of extreme wildfire events

Background Extreme wildfire events (EWEs) represent a growing threat globally, posing substantial risks to ecosystems, human communities, and infrastructure. Despite increased recognition of their ecological, social, and economic significance, current definitions of EWEs vary widely, reflecting disciplinary biases and regional contexts. This article emerges from an interdisciplinary workshop convened to reassess and refine the definition of EWEs, examine their impacts across ecological and social dimensions, and identify critical knowledge gaps impeding our understanding of these infrequent but important events. Results Our synthesis highlights significant limitations with existing definitions, particularly their reliance on subjective thresholds and their emphasis on extreme fire behavior alone. EWEs encompass a spectrum of complex, multi-dimensional phenomena that extend beyond immediate biophysical characteristics to include cumulative social, economic, and ecological impacts. These impacts often manifest over extended timeframes and include hazardous environmental contamination, severe geomorphic disturbances, ecosystem transformations, and unintended consequences of post-fire management actions. Current wildfire modeling frameworks inadequately capture these compounding factors, particularly the interactions among social systems, ecological conditions, and extreme fire behavior. To overcome these issues, we advocate for an interdisciplinary and context-sensitive approach to defining and studying EWEs. This revised definition emphasizes wildfires exhibiting anomalies in fire behavior, ecological outcomes, or social impacts relative to historically observed baselines, accommodating variability across different geographic regions and ecological settings. Conclusions Adopting an interdisciplinary framework that integrates biophysical and social sciences will enhance the predictive capability of wildfire models and improve resilience planning and response strategies. Filling identified knowledge gaps—such as limited high-quality empirical fire behavior data and insufficient integration of social dynamics into modeling—will better prepare communities and ecosystems to cope with and adapt to EWEs. This inclusive approach underscores the necessity for collaboration across disciplines and sectors, essential to managing extreme wildfires in an era of increasing climatic and ecological uncertainty.

54 ENVIRONMENTAL SCIENCES↗

Analysis of Strategic Conflict Management Approaches as Applied to Simulated UAM Operations

This report presents the results of a comparison analysis of candidate Strategic Conflict Management (SCM) strategies as applied to Urban Air Mobility (UAM) operations. The SCM strategies investigated included: no SCM, resource scheduling (RS), resource flow rates (FR), area-based flow rates (AR), and conflict detection and resolution (CR). The study evaluated each strategy against the same 3 levels of flight demand in a representative airspace construct for the Dallas/Fort Worth region. The study also accounted for different levels of uncertainty in operational planning and equivalent levels of trajectory following error. In the analysis, we compared the SCM strategies’ effectiveness in reducing the need for the tactical conflict management layer to act and looked at the metrics of unmitigated losses-of-separation (LOS), flight delays imposed by strategic planning, and throughput of the overall airspace. The study results indicated that the CR strategy was the most effective at reducing LOS and percentage of flights with LOS, even in the presence of trajectory error when uncertainty is accounted for in planning. Thus, if the objective is to reduce the number of actions that the tactical conflict management layer will have to take, in terms of conflicts that may need to be resolved, CR is the strategy to use. The FR strategy was found to be the worst at reducing LOS and percentage of flights with LOS. Thus, it is not very effective at reducing the actions required by a tactical conflict management layer. In the airspace tested, the demand was high enough to produce unacceptable levels of flight delay and reductions of throughput when the SCM strategies were implemented. This was especially evident at the higher levels of trajectory uncertainty and error. The need to account for expected levels of uncertainty becomes more and more important as the demand level increases and as the level of trajectory error increases. This is because the likelihood of flights with LOS increases as the density of operations increases and as the level of trajectory error increases. Accounting for uncertainty in the SCM strategies improves the strategy effectiveness with respect to LOS but increases delays and reduces throughput. Thus, there is a tradeoff between scalability and allowable levels of uncertainty. That is, we can implement an air traffic management construct that allows high levels of uncertainty, but we can expect that same system to have limits on scalability that may be evident even at small demand levels, such as those used in this study. Therefore, the results in this study indicate that an air traffic system should attempt to implement mechanisms appropriate for reducing uncertainty where possible in order to increase the chances for scalability. And this increased level of predictability of operations needs to be balanced with mechanisms for ensuring flexibility when operational conditions and plans need to change, even though those types of changes should be the exception rather than the rule under normal conditions. The study also introduced a trade space that could serve as a mechanism for selecting the appropriate SCM strategy in a trade-off between uncertainty and error, mean flight delay, and the LOS metrics (which this study equates to the potential for tactical conflict management actions). The optimal solution for a given airspace, demand level, and other factors, could likely be a combination of SCM strategies, although this study only compared the use of a single SCM strategy at a time. The CR strategy appeared to have the best opportunity for scalability by limiting the number of potential tactical actions to nearly zero.

Strategic Conflict Management↗

Managing Solar Photovoltaic Integration in the Western United States: Power System Flexibility Requirements and Supply

As penetrations of variable renewable energy generation technologies such as wind and solar photovoltaics (PV) continue to increase across the United States, greater uncertainty and variability in the net load often lead to a concern about how power systems may adapt. Managing the system net load (i.e., load minus contribution from variable generation technologies) may become more challenging with increasing variable generation, as the magnitude and frequency of net ramps increase. However, there is inherent flexibility in power systems through the conventional generator fleet (under least-cost unit commitment and economic dispatch), less-conventional generation sources (e.g., storage, demand response, concentrating solar power with thermal energy storage), and imports and exports with neighbors. In this analysis, we create an open-source tool to analyze the flexibility of the results of a specific commercial unit commitment and economic dispatch tool (PLEXOS), but the code can be applied generically as well. The tool assesses the flexibility requirements (or demand) of a system through a net load analysis. The constraints and limitations of each generator are then considered to determine the availability (or supply) of flexibility. Then, the supply and demand of flexibility are compared to gain a more complete picture of potential flexibility concerns. We apply this open-source tool to high-penetration PV scenarios constructed for three focus regions in the western United States defined using the Resource Planning Model (RPM) capacity expansion modeling tool: RPM-OR, RPM-CO, and RPM-AZ. Generally, we find few flexibility concerns, as the western United States represents a large and interconnected power system with significant inherent flexibility. In addition, the PV scenarios we analyzed are overbuilt on capacity, leaving plenty of ramping ability on the system. We do find that for each focus region, the impact of imports on meeting ramping needs is essential. This means the PV integration in each focus region impacts the entire rest of the system. Each system has different dominant sources of flexibility. The conventional generator fleet (especially coal and gas combined-cycle technologies) as well as less-conventional sources such as storage are all shown to be important sources of flexibility. The scenarios evaluated here were designed to study the planning and operations impact of high solar penetration in each of three focus regions. However, none of the three focus regions likely will deploy PV in isolation, meaning the ability of imports and exports to provide flexibility may be considerably different in scenarios with strong PV deployment in every region. Overall, we intend that the framework we present here will be useful in future analysis of other system evolutions to identify whether and how flexibility may constrain the successful deployment of variable generation technologies.

14 SOLAR ENERGY↗

Impact of Wildfires on Solar Generation, Reserves and Energy Prices

Wildfire seasons in the Western U.S. become more prolonged and intense in recent years bringing significant variability and uncertainty of solar generation. It greatly challenges the bulk power system and electricity market operation managed by California Independent System Operator (CAISO) as California leads both the wildfire records and the solar power integration. This study presents a screening-level analysis of the impact of wildfires on solar generation, operating reserve and energy prices applying historical real-world wildfire and market operation data. To the best of the authors knowledge, it is a first-of-its-kind study and will lay the foundation for market impact quantification and wildfire mitigation strategies design based on projected wildfire activities in future years.

electricity price↗

Energy Management of the Multi-Mission Space Exploration Vehicle Using a Goal-Oriented Control System

Safe human exploration in space missions requires careful management of limited resources such as breathable air and stored electrical energy. Daily activities for astronauts must be carefully planned with respect to such resources, and usage must be monitored as activities proceed to ensure that they can be completed while maintaining safe resource margins. Such planning and monitoring can be complex because they depend on models of resource usage, the activities being planned, and uncertainties. This paper describes a system - and the technology behind it - for energy management of the NASA-Johnson Space Center's Multi-Mission Space Exploration Vehicles (SEV), that provides, in an onboard advisory mode, situational awareness to astronauts and real-time guidance to mission operators. This new capability was evaluated during this year's Desert RATS (Research and Technology Studies) planetary exploration analog test in Arizona. This software aided ground operators and crew members in modifying the day s activities based on the real-time execution of the plan and on energy data received from the rovers.

Braman, Julia M. B.↗

An investigation of hard-disk drive circularity accounting for socio-technical dynamics and data uncertainty

The installed data storage capacity in the U.S. will reach 2.2 Zettabytes by 2025, generating about 50 million units of end-of-life (EOL) hard-disk drives (HDDs) per year. Due to data security concerns, most EOL HDDs are currently shredded (even when still functioning), representing an economic loss. Moreover, raw material extraction linked to the increased demand for storage causes environmental impacts. Besides mitigating the threat posed by sudden restrictions of raw materials, the circular economy (CE) offers to maximize value retention in the economy and reduce the environmental impacts of human activities. Common CE strategies are reusing and recycling products. However, the reuse of hard disk drives is currently burdened by the lack of trust HDD end-users have toward other non-physical means of data removal than shredding. Here, an agent-based modeling (ABM) approach is proposed to explore how techno-economic and social factors affect end-users' decisions to adopt EOL management practices other than shredding. The proposed method also accounts for data uncertainty by applying a semi-quantitative approach. Results demonstrate how increased green procurement and more robust standards could spur end-users' trust toward data-wiping technologies. Even when accounting for uncertainty, HDDs' reuse brings better environmental and economic benefits than HDD shredding followed by material recovery. The semi-quantitative approach proposed in this study could be more universally applied in future ABM, especially given the often-stochastic nature of such models. The developed ABM is also the first to represent several HDD industry stakeholders and demonstrate how the HDD shredding lock-in situation could be resolved.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Uncertainty Quantification for Dissimilar Material Joints Under Corrosion Environment

Abstract Self-Piercing Riveting (SPR) is one of the most commonly used methods for joining dissimilar materials in the automotive industry. These joints are popular due to their adaptability, high performance and short cycle time. However, since these joints involve two dissimilar materials, they are susceptible to galvanic corrosion in the presence of an electrolyte which is driven by the difference in the equilibrium potential of the metals. This can affect the safety and resilience of these joints. In this paper, we focus on galvanic corrosion in Al-Fe SPR joints. A Machine learning (ML) based surrogate model, which is based off of FE simulations, for statistical corrosion analysis is developed. This model enables the resilience and reliability analysis of SPR joints under corrosion environment. In this study, first a physics-based finite element (FE) corrosion model has been developed to simulate the galvanic corrosion between a Fe cathode and an Al anode of a SPR joint. This model takes into account the effect of the crystal microstructure of the Al anode and the precipitation of the corrosion product. Several geometric and environmental factors including crevice gap, roughness of anode, conductivity, pH and the temperature of the electrolyte that effect corrosion are investigated. A thorough Uncertainty Quantification (UQ) analysis is conducted for the overall corrosion behavior of the Fe-Al SPR joints using a novelistic Probabilistic Confidence-Based Adaptive Sampling (PCAS) technique. PCAS is used to train the surrogate model by identifying the critical sampling points and thus reducing the overall computational costs. It is found that the electrolyte temperature has the largest effects on the material loss and needs to be managed closely for better corrosion control. By understanding the corrosion performance and resultant uncertainty impact on SPR joints, the reliability and resilience of these joints can be improved.

36 MATERIALS SCIENCE↗

Multi-Agent Hierarchical Deep Reinforcement Learning for HVAC Control With Flexible DERs

As electricity consumption in commercial and residential buildings continues to rise, reducing energy costs presents an increasing challenge. Heating, ventilating, and air-conditioning (HVAC) systems, which typically account for 40%-50% of a building's energy use, are prime targets for energy savings. Intelligent control of HVAC temperature through the exploitation of HVAC load flexibility brings significant potential to reduce energy consumption and electricity expenses. The nonlinear models of HVAC systems challenge traditional control methods, while the uncertainty introduced by HVAC load flexibility complicates distributed energy resource (DER) management using conventional optimal dispatch techniques. In response to these challenges, we propose a hierarchical multi-agent deep reinforcement learning (DRL) approach. The lower-level agents focus on balancing comfort and energy conservation, while the upper-level DRL agents optimize the use of DERs to reduce peak demand based on the control outcomes of the HVAC by the lower-level agents. Here, in the upper-level agents, we incorporate a multi-agent structure based on ensemble learning, which acts based on historical and current data without relying on precise load forecasting to address the delayed rewarding issue in DRL. This allows for the effective reduction of energy costs. The proposed method is tested using a real-world microgrid comprising 413 buildings in Southern California, and the results demonstrate that our approach can significantly reduce overall electricity bills while ensuring the comfort of consumers and residents.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Atmospheric climate data: Problems and promises

The explosive growth in the quantity and diversity of weather and climate data, the growing handicap that the distinction between weather and climate in NOAA imposes on the efficient management and use of data is discussed. Also discussed is the uncertainty induced by the lack of clear commitment and consistent policies regarding federal roles and responsibilities in operating and maintaining the national weather and climate data system.

Source record↗

Estimating Model Prediction Error: Should You Treat Predictions as Fixed or Random?

Crop models are important tools for impact assessment of climate change, as well as for exploring management options under current climate. It is essential to evaluate the uncertainty associated with predictions of these models. We compare two criteria of prediction error; MSEP fixed, which evaluates mean squared error of prediction for a model with fixed structure, parameters and inputs, and MSEP uncertain( X), which evaluates mean squared error averaged over the distributions of model structure, inputs and parameters. Comparison of model outputs with data can be used to estimate the former. The latter has a squared bias term, which can be estimated using hindcasts, and a model variance term, which can be estimated from a simulation experiment. The separate contributions to MSEP uncertain (X) can be estimated using a random effects ANOVA. It is argued that MSEP uncertain (X) is the more informative uncertainty criterion, because it is specific to each prediction situation.

model structure uncertainty↗

Laboratory Evaluation of Dynamic Routing of Air Traffic in an En Route Arrival Metering Environment

Arrival air traffic operations in the presence of convective weather are subject to uncertainty in aircraft routing and subsequently in flight trajectory predictability. Current management of arrival operations in weather-impacted airspace results in significant flight delay and suspension of arrival metering operations. The Dynamic Routing for Arrivals in Weather (DRAW) concept provides flight route amendment advisories to Traffic Management Coordinators to mitigate the impacts of convective weather on arrival operations. DRAW provides both weather conflict and schedule information for proposed route amendments, allowing air traffic managers to simultaneously evaluate weather avoidance routing and potential schedule and delay impacts. Subject matter experts consisting of retired Traffic Management Coordinators and retired Sector Controllers with arrival metering experience participated in a simulation study of Fort Worth Air Route Traffic Control Center arrival operations. Data were collected for Traffic Management Coordinator and Sector Controller participants over three weeks of simulation activities in October, 2017. Traffic Management Coordinators reported acceptable workload levels, a positive impact on their ability to manage arrival traffic while using DRAW, and initiated weather mitigation reroutes earlier while using DRAW. Sector Controllers also reported acceptable workload levels while using DRAW.

Air Traffic Management↗