Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “uncertainty management”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Development of A Multidecadal Land Reanalysis Over High Mountain Asia

Anthropogenic and climatic changes affect the water and energy cycles in High Mountain Asia (HMA), home to over two billion people and the largest reservoirs of freshwater outside the polar zone. Despite their significant importance for water management, consistent and reliable estimates of water storage and fluxes over the region are lacking because of the high uncertainties associated with the estimates of atmospheric conditions and human management. Here, we relied on multivariate data assimilation (MVDA) to provide estimates of energy and water storage and fluxes that reflect the processes occurring in the region such as greening and irrigation-driven groundwater depletion. We developed and employed an ensemble precipitation estimate by blending different precipitation products thereby reducing the uncertainties and inconsistencies associated with precipitation in HMA. Then, we assimilated five variables that capture the changes in hydrology in response to climate change and anthropogenic activities. Overall, our results have shown that MVDA has allowed a better representation of the land surface processes including greening and irrigation-driven groundwater depletion in HMA.

Fadji Z. Maina↗

Uncertainty Analysis Framework for the Hospital Resource Supply Model for Covid-19

In March and April of 2020 there was widespread concern about availability of medical resources required to treat Covid-19 patients who become seriously ill. A simulation model of supply management was developed to aid understanding of how to best manage available supplies and channel new production. Forecasted demands for critical therapeutic resources have tremendous uncertainty, largely due to uncertainties about the number and timing of patient arrivals. It is therefore essential to evaluate any process for managing supplies in view of this uncertainty. To support such evaluations, we developed a modeling framework that would allow an integrated assessment in the context of uncertainty quantification. At the time of writing there has been no need to execute this framework because adaptations of the medical system have been able to respond effectively to the outbreak. This report documents the framework and its implemented components should need later arise for its application.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

An Integrated Paradigm for the Management of Delivery Risk in Electricity Markets: From Batteries to Insurance and Beyond [Slides]

In wholesale electricity markets today, flexibility from a limited number of distributed energy resources (DERs) is offered daily, and the value of flexibility is not yet recognized for economic hedging of delivery risk. Under a three-year project funded by the ARPA-E PERFORM program, a collaborative team is working towards developing an integrated risk management framework that will leverage flexibility from distributed and bulk resources to cost-effectively and reliably manage delivery risk of intermittent resources. Two concepts are at the core of the proposed integrated risk management framework: (A) flexibility options, which are a novel type of options and enable wholesale electricity market participants to hedge uncertainty by buying flexibility. (B) DER flexibility scores, which provide a way for utilities or aggregators to classify assets in groups with different likelihood of delivering contracted flexibility. This report presentation will focus on the proposed ISO-product "flexibility options," which is complementary to ramp and other products being introduced by ISOs/RTOs to manage net load uncertainties. Participating resources with imbalance risk can buy flexibility options to hedge their production, whereas grid-connected resources that can provide physical flexibility can offer flexibility options. We will present basics of the formulation for a day-ahead ISO market that matches buyers and sellers of this hedge in coordination with existing capabilities to schedule energy and ancillary services, and outline how their settlements mitigate the impact of imbalance risk.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Adapting Project Management Practices to Research-Based Projects

From dealing with the inherent uncertainties in outcomes of scientific research to the lack of applicability of current NASA Procedural Requirements guidance documentation, research-based projects present challenges that require unique application of classical project management techniques. If additionally challenged by the creation of a new program transitioning from basic to applied research in a technical environment often unfamiliar with the cost and schedule constraints addressed by project management practices, such projects can find themselves struggling throughout their life cycles. Finally, supplying deliverables to a prime vehicle customer, also in the formative stage, adds further complexity to the development and management of research-based projects. The Biomedical Research and Countermeasures Projects Branch at NASA Johnson Space Center encompasses several diverse applied research-based or research-enabling projects within the newly-formed Human Research Program. This presentation will provide a brief overview of the organizational structure and environment in which these projects operate and how the projects coordinate to address and manage technical requirements. We will identify several of the challenges (cost, technical, schedule, and personnel) encountered by projects across the Branch, present case reports of actions taken and techniques implemented to deal with these challenges, and then close the session with an open forum discussion of remaining challenges and potential mitigations.

Bahr, P.↗

Accounting for Point Estimate Uncertainty in Space Systems Reliability and Risk Analysis

Understanding and accounting for uncertainty in risk analysis is a critical step in the management and communication of risk in engineered systems. The component and system-level analysis to determine the probability of a negative outcome and its consequence is often quantified by a point estimate. Many Program and Enterprise decisions involving technical concerns and issues rely on reliability engineering activities to produce quantified risk analysis to inform the decision making process. At NASA, it is common to use a Probabilistic Risk Analysis (PRA) to inform the overall risk to Loss of Mission or Loss of Crew that involves integration across all spacecraft subsystem fault trees to produce an overall probability of mission failure. The point estimate is an estimate of this overall probability and is an immediate result of a fault tree model. It is the result of a model where the probability of each event is taken to be equal to its mean. The value provides an approximation of the overall mean without running any uncertainty calculations (e.g., no sampling). Using only the point estimate can lead to a false sense of precision and the point estimate may not match the resulting mean when uncertainty is taken into consideration. This paper will explore five conditions that can cause the PRA model mean to diverge from the point estimate and will provide engineers and managers insight into the importance of understanding uncertainty in the elements of PRA models.

Paul J Collier↗

Machine learning surrogate of physics-based building-stock simulator for end-use load forecasting

Building energy models are used to simulate heat and mass transfer and estimate end-use load in buildings. With the proliferation of solar photovoltaics on residential and commercial buildings, increasingly, buildings are expected to provide grid services, for which accurate and computationally efficient building energy simulations and end-use load prediction are imperative. Existing building energy simulation tools, however, have significant computational overhead that make them less practical in real-time deployment for optimization, design, uncertainty quantification and control in building energy management systems. Here this article presents a data-driven machine learning model based on light gradient boosting method (LightGBM) as a surrogate for a physics-based simulator for residential buildings to predict end-use load. The machine learning based surrogate model accounts for time-series related variables, seasonality and trend component of end-use load, and history of end-use load. The accuracy of the surrogate model is assessed on the prediction of the load profiles of 100 different houses in Cook County, Illinois, USA. The LightGBM surrogate model is shown to reduce the root-mean-squared error by 53% relative to a reference decision tree (DT) based model reported previously in the literature. Moreover, the model predicts the load spikes and high-ramp rate events throughout the year which are often the Achilles heel of other models in the literature. The machine learning based surrogate model is demonstrated to be computationally efficient, with a ten-fold reduction in the computational time compared to a physics-based building energy simulation, and suitable for uncertainty analysis and real-time control of building characteristics in response to uncertainty.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

A methodology for the evaluation of program cost and schedule risk for the SEASAT program

An interactive computerized project management software package (RISKNET) is designed to analyze the effect of the risk involved in each specific activity on the results of the total SEASAT-A program. Both the time and the cost of each distinct activity can be modeled with an uncertainty interval so as to provide the project manager with not only the expected time and cost for the completion of the total program, but also with the expected range of costs corresponding to any desired level of significance. The nature of the SEASAT-A program is described. The capabilities of RISKNET and the implementation plan of a RISKNET analysis for the development of SEASAT-A are presented.

Abram, P.↗

14 Steps to Creating Value in Cost and Schedule Resources for Nuclear Waste Management - 20188

While Waste Management budgets are shrinking, DOE required cost and schedule controls are becoming increasingly stringent. At the same time, there is a scarcity of adept, qualified, and competent projects controls staff who both understand nuclear waste management and are capable of addressing today's cost and schedule challenges. In response, we have developed a systematic approach to training and mentoring project controls staff. The approach is based on the observations and lessons learned on projects, both successful and unsuccessful, over the past 20 years. During that time, we evaluated staff development and used that experience to design a program that progresses the maturity, knowledge and experience of the individual. The program is based on the unique needs of cost and schedule specialists while incorporating the best leadership and managerial applications. The system is not limited to developing individual software skills, which is a primary focus of many project controls training programs. Instead, our system develops an individual's soft and hard skill sets. The system develops the user's skill, talent, attitude, and drive to do the best job possible. It focuses on all aspects of becoming a more productive technical team while accepting responsibility for individual growth. It also enhances the project controls team by setting up checks and balances that everyone is aware of and participates in. The system is based on 14 steps of increasing complexity in knowledge and application. The system clarifies roles, responsibilities and expectations. It helps eliminate uncertainty and reduces stress on staff and managers. It contains everyday routine actions and is simple to implement. It allows the development of a consistent rhythm to staff growth and development. Mastering the steps will allow the user to achieve excellence in cost and schedule control. The 14 steps are: 1 - Key Performance Objectives, 2 - Check Lists, 3 - Desktop Guides, 4 - System Description, 5 - Procedures, 6 - Software and On the Job Training (OTJ), 7 - Traceability Checks, 8 - Surveillances, 9 - 32 Criteria, 10 - The Contract, 11 - Customer/Government Guidance, 12 - Training and Mentoring Others, 13 - Master your weekly and daily schedules, 14 - Improving your interpersonal skills. Application and mastery of this system will produce better cost and schedule control results. Your project controls staff will write better reports, analyze data better, make better use of their time, and be more valuable to decision makers. If followed rigorously, our system will produce a great project controls team, which is invaluable to the success of each project. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Wind Information Uplink to Aircraft Performing Interval Management Operations

The accuracy of the wind information used to generate trajectories for aircraft performing Interval Management (IM) operations is critical to the success of an IM operation. There are two main forms of uncertainty in the wind information used by the Flight Deck Interval Management (FIM) equipment. The first is the accuracy of the forecast modeling done by the weather provider. The second is that only a small subset of the forecast data can be uplinked to the aircraft for use by the FIM equipment, resulting in loss of additional information. This study focuses on what subset of forecast data, such as the number and location of the points where the wind is sampled should be made available to uplink to the aircraft.

Ahmad, Nashat↗

Remote sensing-based vegetation and soil moisture constraints reduce irrigation estimation uncertainty

Understanding the human water footprint and its impact on the hydrological cycle is essential to inform water management under climate change. Despite efforts in estimating irrigation water withdrawals in earth system models, uncertainties and discrepancies exist within and across modeling systems conditioned by model structure, irrigation parameterization, and the choice of input datasets. Achieving model reliability could be much more challenging for data-sparse regions, given limited access to ground truth for parameterization and validation. Here, we demonstrate the potential of utilizing remotely sensed vegetation and soil moisture observations in constraining irrigation estimation in the Noah-MP land surface model. Results indicate that the two constraints together can effectively reduce model sensitivity to the choice of irrigation parameterization by 7%–43%. It also improves the characterization of the spatial patterns of irrigation and its impact on evapotranspiration and surface soil moisture by correcting for vegetation conditions and irrigation timing. This study highlights the importance of utilizing remotely sensed soil moisture and vegetation measurements in detecting irrigation signals and correcting for vegetation growth. Integrating the two remote sensing datasets into the model provides an effective and less feature engineered approach to constraining the uncertainty of irrigation modeling. Such strategies can be potentially transferred to other modeling systems and applied to regions across the globe.

Wanshu Nie↗

Ensemble‐Based Spatially Distributed CLM5 Hydrological Parameter Estimation for the Continental United States

Abstract One of the major challenges in large‐domain hydrological modeling efforts lies in the estimation of spatially distributed hydrological parameters while simultaneously accounting for their associated uncertainties. Addressing this challenge is particularly difficult in ungauged locations. With growing societal demands for large‐scale streamflow projections to inform water resource management and long‐term planning, evaluating and constraining hydrological parameter uncertainty is increasingly vital. This study introduces a hybrid regionalization approach to enhance hydrological predictions of the Community Land Model version 5 (CLM5) across the Continental United States (CONUS), with a total of 50,629 1/8° grid cells. This hybrid method combines the strengths of two existing techniques: parameter regionalization and streamflow signature regionalization. It identifies ensemble behavioral parameters for each 1/8° grid cell across the CONUS domain, tailored to three distinct streamflow signatures focused on low flows, high flows, and annual water balance. Evaluating this hybrid method for 464 CAMELS (Catchment Attributes and Meteorology for Large‐sample Studies) basins demonstrates a significant improvement in CLM5 hydrological predictions, even in challenging arid regions. In CONUS applications, the derived spatially distributed parameter sets capture both spatial continuity and variation of parameters, highlighting their heterogeneous nature within specific regions. Overall, this hybrid regionalization approach offers a promising solution to the complex task of improving hydrological modeling over large domains for important hydrological applications.

CLM5↗

Uncertainty characterization in a coupled human-natural system: Modeling agricultural adaptation in the Great Lakes Region

The Great Lakes Region's water quality and ecological health are threatened by the export of nutrients from agricultural lands, which causes eutrophication, hypoxia, and destructive algal blooms. The intensification of hydrologic cycles brought about by climate change is expected to exacerbate nutrient loading in the region, and, at the same time, agricultural adaptation to changing conditions is also expected to affect loading through shifting amounts and timing of fertilization. Quantifying these future effects and their interactions necessitates modeling both the human and natural processes as a coupled system, by pairing land use and agricultural management with hydrologic modeling. At the same time, compounding uncertainties arising from the complex interactions in both systems significantly limit our predictive understanding of the region's impacts. This study utilizes the Soil and Water Assessment Tool (SWAT), developed for simulating the impact of various farmer decisions on watershed functions in Western Lake Erie watersheds, and an under-development agent-based model (ABM) for agricultural management decisions. The aim of this study is to use global sensitivity analysis on the coupled ABM and SWAT models to quantify how uncertainty in both models interactively affects nutrient loading. To do so, we will conduct Sobol sensitivity analysis experiments at different levels of coupling assumptions to quantify how various uncertain factors (e.g., soil moisture and crop choice) and their interactions affect our estimates of nutrient loading. The results of this analysis will allow us to quantify how complex interactions and dependencies between both systems amplify the effect of uncertainties. Insights gained from this study will have broader implications for modeling the adaptive co-evolution of human and natural systems under climate change and can inform effective management of nutrient loading in the Great Lakes Region.

Climate Change↗

DUNE atmospheric neutrinos: Earth tomography

In this paper we show that the DUNE experiment can measure the Earth’s density profile by analyzing atmospheric neutrino oscillations. The crucial feature that enables such measurement is the detailed event reconstruction capability of liquid argon time projection chambers. This allows for studying the sub-GeV atmospheric neutrino component, which bears a rich oscillation phenomenology, strongly dependent on the matter potential sourced by the Earth. We provide a pedagogical discussion of the MSW and parametric resonances and their role in measuring the core and mantle densities. By performing a detailed simulation, accounting for particle reconstruction at DUNE, nuclear physics effects relevant to neutrino-argon interactions and several uncertainties on the atmospheric neutrino flux, we manage to obtain a robust estimate of DUNE’s sensitivity to the Earth matter profile. We find that DUNE can measure the total mass of the Earth at 9.3% precision with an exposure of 400 kton-year. By accounting for previous measurements of the total mass and moment of inertia of the Earth, the core, lower mantle and upper mantle densities can be determined with 9%, 14% and 22% precision, respectively, for the same exposure. Finally, for a low exposure run of 60 kton-year, which would correspond to two far detectors running for three years, we have found that the core density could be measured by DUNE at ∼ 30% precision.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Compound Continental Risk of Multiple Extreme Floods in the United States

Abstract Understanding spatially correlated floods and modeling joint hazard associated with threshold exceedances across multiple locations is crucial for accurate estimation of continental‐scale portfolio risk. This work uses a non‐parametric copula‐based spatial simulator to analyze peak floods across the United States to derive the first‐of‐its‐kind continental portfolio risk estimates at the 10‐ and 100‐year return levels. We find significant interdependence in floods across the nation, revealing the recurring pattern of extreme events affecting the Northeast, Central, West, and Northwest United States in the same year. The stochastic simulator effectively manages high‐dimensional data and offers reliable uncertainty estimates for both spatially dependent floods and the aggregated flood losses at the continental level. El Niño‐Southern Oscillation and Atlantic Multidecadal Oscillation are identified as statistically significant tele‐connectors of aggregate loss. This research aims to advance the understanding of compound continental flood hazard and the potential large‐scale climate teleconnections that lead to such compound floods.

Geology↗

Supportability Challenges, Metrics, and Key Decisions for Future Human Spaceflight

Future crewed missions beyond Low Earth Orbit (LEO) represent a logistical challenge that is unprecedented in human space flight. Astronauts will travel farther and stay in space for longer than any previous mission, far from timely abort or resupply from Earth. Under these conditions, supportability { defined as the set of system characteristics that influence the logistics and support required to enable safe and effective operations of systems { will be a much more significant driver of space system lifecycle properties than it has been in the past. This paper presents an overview of supportability for future human space flight. The particular challenges of future missions are discussed, with the differences between past, present, and future missions highlighted. The relationship between supportability metrics and mission cost, performance, schedule, and risk is also discussed. A set of pro- posed strategies for managing supportability is presented (including reliability growth, uncertainty reduction, level of repair, commonality, redundancy, In-Space Manufacturing (ISM) (including the use of material recycling and In-Situ Resource Utilization (ISRU) for spares and maintenance items), reduced complexity, and spares inventory decisions such as the use of predeployed or cached spares - along with a discussion of the potential impacts of each of those strategies. References are provided to various sources that describe these supportability metrics and strategies, as well as associated modeling and optimization techniques, in greater detail. Overall, supportability is an emergent system characteristic and a holistic challenge for future system development. System designers and mission planners must carefully consider and balance the supportability metrics and decisions described in this paper in order to enable safe and effective beyond-LEO human space flight.

Owens, Andrew C.↗

Controls for Electrified Aircraft Propulsion

Advanced electrified aircraft propulsion (EAP) concepts with integrated power, propulsion, and thermal systems require the development of equally sophisticated controllers to fly safe and efficient missions. Hybrid electric aircraft utilize electric machines mechanically coupled to the engine shafts to extract and insert power for a variety of purposes. Additionally, electric machines may drive propulsive fans pulling from a combination of on-board energy storage devices and engine extracted power. NASA’s investment in hybrid electric aircraft hardware-in-the-loop testing enables controls research on representative engine models using a novel emulation and scaling methodology. High-voltage, high-power electrical powertrain presents several technical risks at altitude. High-power requires high efficiency to minimize losses. Superconducting electric machines and power distribution research at NASA has identified key challenges with potential controls solutions. These risks necessitate the development of controllers robust to model uncertainty, disturbances, and fault conditions. System health management and fault detection schemes play an important role in a multi-layer controls approach that utilizes a supervisor which oversees inner loops for the highly coupled power, propulsion, and thermal systems. Such a supervisory controller enables coordinates energy transfer between engines, energy storage devices, electric machines, propulsors, and heat exchangers. Existing methods have shown an improvement in engine operability using the hybrid electric powertrain.

Halle E Buescher↗

Characterizing and communicating uncertainty: lessons from NASA’s Carbon Monitoring System

Navigating uncertainty is a critical challenge in all fields of science, especially when translating knowledge into real-world policies or management decisions. However, the wide variance in concepts and definitions of uncertainty across scientific fields hinders effective communication. As a microcosm of diverse fields within Earth Science, NASA’s Carbon Monitoring System (CMS) provides a useful crucible in which to identify cross-cutting concepts of uncertainty. The CMS convened the Uncertainty Working Group (UWG), a group of specialists across disciplines, to evaluate and synthesize efforts to characterize uncertainty in CMS projects. This paper represents efforts by the UWG to build a heuristic framework designed to evaluate data products and communicate uncertainty to both scientific and non-scientific end users. We consider four pillars of uncertainty: origins, severity, stochasticity versus incomplete knowledge, and spatial and temporal autocorrelation. Using a common vocabulary and a generalized workflow, the framework introduces a graphical heuristic accompanied by a narrative, exemplified through contrasting case studies. Envisioned as a versatile tool, this framework provides clarity in reporting uncertainty, guiding users and tempering expectations. Beyond CMS, it stands as a simple yet powerful means to communicate uncertainty across diverse scientific communities.

54 ENVIRONMENTAL SCIENCES↗