Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Weather uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Building thermal load prediction through shallow machine learning and deep learning

Building thermal load prediction informs the optimization of cooling plant and thermal energy storage. Physics-based prediction models of building thermal load are constrained by the model and input complexity. In this study, we developed 12 data-driven models (7 shallow learning, 2 deep learning, and 3 heuristic methods) to predict building thermal load and compared shallow machine learning and deep learning. The 12 prediction models were compared with the measured cooling demand. It was found XGBoost (Extreme Gradient Boost) and LSTM (Long Short Term Memory) provided the most accurate load prediction in the shallow and deep learning category, and both outperformed the best baseline model, which uses the previous day's data for prediction. Then, we discussed how the prediction horizon and input uncertainty would influence the load prediction accuracy. Major conclusions are twofold: first, LSTM performs well in short-term prediction (1 h ahead) but not in long term prediction (24 h ahead), because the sequential information becomes less relevant and accordingly not so useful when the prediction horizon is long. Second, the presence of weather forecast uncertainty deteriorates XGBoost's accuracy and favors LSTM, because the sequential information makes the model more robust to input uncertainty. Training the model with the uncertain rather than accurate weather data could enhance the model's robustness. Finally, our findings have two implications for practice. First, LSTM is recommended for short-term load prediction given that weather forecast uncertainty is unavoidable. Second, XGBoost is recommended for long term prediction, and the model should be trained with the presence of input uncertainty.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Structural Uncertainty in the Sensitivity of Urban Temperatures to Anthropogenic Heat Flux

One key source of uncertainty for weather and climate models is structural uncertainty arising from the fact that these models must simplify or approximate complex physical, chemical, and biological processes that occur in the real world. However, structural uncertainty is rarely examined in the context of simulated effects of anthropogenic heat flux in cities. Using the Weather Research and Forecasting (WRF) model coupled with a single-layer urban canopy model, it is found that the sensitivity of urban canopy air temperature to anthropogenic heat flux can differ by an order of magnitude depending on how anthropogenic heat flux is released to the urban environment. Moreover, varying model structures through changing the treatment of roof-air interaction and the parameterization of convective heat transfer between the canopy air and the atmosphere can affect the sensitivity of urban canopy air temperature by a factor of 4. Urban surface temperature and 2-m air temperature are less sensitive to the methods of anthropogenic heat flux release and the examined model structural variants than urban canopy air temperature, but their sensitivities to anthropogenic heat flux can still vary by as much as a factor of 4 for surface temperature and 2 for 2-m air temperature. Our study recommends using temperature sensitivity instead of temperature response to understand how various physical processes (and their representations in numerical models) modulate the simulated effects of anthropogenic heat flux.

54 ENVIRONMENTAL SCIENCES↗

Perspectives on Systematic Cloud Microphysics Scheme Development With Machine Learning

Cloud microphysics—the collection of processes that govern the small‐scale formation, evolution, and interactions of liquid droplets and ice crystals in clouds and precipitation—remains a major source of uncertainty in weather and climate models. Although too small in scale to be explicitly resolved in any large‐eddy simulation, weather, or climate model, the representation of cloud microphysical processes has significant impact at the climate scale. Current microphysical schemes are limited by both parametric uncertainty, linked to uncertainty in physical parameter values, and structural uncertainty, arising from incomplete physical understanding of the processes at play or approximations made for computational efficiency. Recent advances in the application of machine learning (ML) to the physical sciences show significant potential for minimizing these limitations by leveraging high‐fidelity simulations and observations. Here we outline the challenges that must be addressed to apply ML toward cloud microphysics scheme development. This perspectives paper synthesizes recent progress in using data‐driven methods, including ML, to improve cloud microphysics parameterizations and highlights opportunities to address key uncertainties. We discuss the roles of aleatoric (irreducible, or statistical) and epistemic (reducible, or systematic) errors in contributing to microphysics parameterization uncertainty. ML can leverage observations to improve microphysical schemes via bottom‐up and top‐down constraints. Methods such as differentiable programming and ML‐enhanced sampling strategies and the creation of large scale benchmark data sets promise to bridge the gap between observations and models and to improve the consistency of cloud microphysical representation across temporal and spatial scales.

Lamb, Kara D. [Columbia Univ., New York, NY (Unite↗

Home energy management under realistic and uncertain conditions: A comparison of heuristic, deterministic, and stochastic control methods

We report home energy management systems (HEMS) have been shown to reduce energy bills and to provide grid services including peak demand reduction and demand flexibility. However, uncertainty in residential energy systems is a significant issue and can reduce the benefits of a HEMS to the homeowner or grid operator. Sources of uncertainty include weather forecasts, predictions of energy-related occupant activities (e.g., hot water draws), and parameter estimation for the building envelope and energy-consuming equipment. This paper tackles the problem of uncertainty by developing a framework that simulates HEMS in uncertain conditions and evaluates the performance of multiple control strategies. A linear, reduced-order residential building model for model predictive control applications is derived and compared to a full-order model. Stochastic model predictive control is shown to perform better than deterministic and heuristic methods when considering realistic forecasts with uncertainty. The framework can evaluate the performance of HEMS in real-world applications, which can help de-risk HEMS deployment.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Dynamic Routing of Aircraft in the Presence of Adverse Weather Using a POMDP Framework

Each year weather-related airline delays result in hundreds of millions of dollars in additional fuel burn, maintenance, and lost revenue, not to mention passenger inconvenience. The current approaches for aircraft route planning in the presence of adverse weather still mainly rely on deterministic methods. In contrast, this work aims to deal with the problem using a Partially Observable Markov Decision Processes (POMDPs) framework, which allows for reasoning over uncertainty (including uncertainty in weather evolution over time) and results in solutions that are more robust to disruptions. The POMDP-based decision support system is demonstrated on several scenarios involving convective weather cells and is benchmarked against a deterministic planning system with functionality similar to those currently in use or under development.

Decision making↗

Modeling Weather Impact on Ground Delay Programs

Scheduled arriving aircraft demand may exceed airport arrival capacity when there is abnormal weather at an airport. In such situations, Federal Aviation Administration (FAA) institutes ground-delay programs (GDP) to delay flights before they depart from their originating airports. Efficient GDP planning depends on the accuracy of prediction of airport capacity and demand in the presence of uncertainties in weather forecast. This paper presents a study of the impact of dynamic airport surface weather on GDPs. Using the National Traffic Management Log, effect of weather conditions on the characteristics of GDP events at selected busy airports is investigated. Two machine learning methods are used to generate models that map the airport operational conditions and weather information to issued GDP parameters and results of validation tests are described.

Wang, Yao↗

Convective Weather Avoidance with Uncertain Weather Forecasts

Convective weather events have a disruptive impact on air traffic both in terminal area and in en-route airspaces. In order to make sure that the national air transportation system is safe and efficient, it is essential to respond to convective weather events effectively. Traffic flow control initiatives in response to convective weather include ground delay, airborne delay, miles-in-trail restrictions as well as tactical and strategic rerouting. The rerouting initiatives can potentially increase traffic density and complexity in regions neighboring the convective weather activity. There is a need to perform rerouting in an intelligent and efficient way such that the disruptive effects of rerouting are minimized. An important area of research is to study the interaction of in-flight rerouting with traffic congestion or complexity and developing methods that quantitatively measure this interaction. Furthermore, it is necessary to find rerouting solutions that account for uncertainties in weather forecasts. These are important steps toward managing complexity during rerouting operations, and the paper is motivated by these research questions. An automated system is developed for rerouting air traffic in order to avoid convective weather regions during the 20- minute - 2-hour time horizon. Such a system is envisioned to work in concert with separation assurance (0 - 20-minute time horizon), and longer term air traffic management (2-hours and beyond) to provide a more comprehensive solution to complexity and safety management. In this study, weather is dynamic and uncertain; it is represented as regions of airspace that pilots are likely to avoid. Algorithms are implemented in an air traffic simulation environment to support the research study. The algorithms used are deterministic but periodically revise reroutes to account for weather forecast updates. In contrast to previous studies, in this study convective weather is represented as regions of airspace that pilots are likely to avoid. The automated system periodically updates forecasts and reassesses rerouting decisions in order to account for changing weather predictions. The main objectives are to reroute flights to avoid convective weather regions and determine the resulting complexity due to rerouting. The eventual goal is to control and reduce complexity while rerouting flights during the 20 minute - 2 hour planning period. A three-hour simulation is conducted using 4800 flights in the national airspace. The study compares several metrics against a baseline scenario using the same traffic and weather but with rerouting disabled. The results show that rerouting can have a negative impact on congestion in some sectors, as expected. The rerouting system provides accurate measurements of the resulting complexity in the congested sectors. Furthermore, although rerouting is performed only in the 20-minute - 2-hour range, it results in a 30% reduction in encounters with nowcast weather polygons (100% being the ideal for perfectly predictable and accurate weather). In the simulations, rerouting was performed for the 20-minute - 2-hour flight time horizon, and for the en-route segment of air traffic. The implementation uses CWAM, a set of polygons that represent probabilities of pilot deviation around weather. The algorithms were implemented in a software-based air traffic simulation system. Initial results of the system's performance and effectiveness were encouraging. Simulation results showed that when flights were rerouted in the 20-minute - 2-hour flight time horizon of air traffic, there were fewer weather encounters in the first 20 minutes than for flights that were not rerouted. Some preliminary results were also obtained that showed that rerouting will also increase complexity. More simulations will be conducted in order to report conclusive results on the effects of rerouting on complexity. Thus, the use of the 20-minute - 2-hour flight time horizon weather avoidance teniques performed in the simulation is expected to provide benefits for short-term weather avoidance.

Karahan, Sinan↗

Risk aware net load balancing in micro grids with high DER penetration

The rapid transformation of micro grids due to the accelerated integration of renewables, storage systems and IoT enabled monitoring and control has opened up new opportunities as well as challenges. Future micro grids will be characterized by high DER penetration and will require sophisticated net load balancing frameworks which explicitly consider the errors in prediction of load and generation due to uncertainty in weather conditions while making decisions. Traditional techniques for grid net load management which rely on isolated shaping of load and supply curves are inadequate and inefficient. For micro grids with high PV penetration, the intermittent and unpredictable nature of PV based energy generation can lead to dramatic and sudden supply demand imbalances thus requiring a holistic framework for balancing net load over the entire horizon. In this paper, we develop a sequential decision making framework for net load management that optimally balances the usage of storage and energy market transactions as a mechanism for mitigating supply demand imbalances (net load imbalances) over the horizon. Our framework specifically accounts for prediction uncertainty of future net load imbalances and minimizes the tail end risk of storage shortfall at the end of the horizon. Using qualitative analysis, we show that our framework achieves its objective of minimum cost net load balancing while accounting for the tail end risk.

14 SOLAR ENERGY↗

Mixed-integer programming models for optimal constellation scheduling given cloud cover uncertainty

We introduce the problem of scheduling observations on a constellation of remote sensors, to maximize the aggregate quality of the collections obtained. While automated tools exist to schedule remote sensors, they are often based on heuristic scheduling techniques, which typically fail to provide bounds on the quality of the resultant schedules. To address this issue, we first introduce a novel deterministic mixed-integer programming (MIP) model for scheduling a constellation of one to n satellites, which relies on extensive pre-computations associated with orbital propagators and sensor collection simulators to mitigate model size and complexity. Our MIP model captures realistic and complex constellation-target geometries, with solutions providing optimality guarantees. We then extend our base deterministic MIP model to obtain two-stage and three-stage stochastic MIP models that proactively schedule to maximize expected collection quality across a set of scenarios representing cloud cover uncertainty. Our experimental conclusions on instances of one and two satellites demonstrate that our stochastic MIP models yield significantly improved collection quality relative to our base deterministic MIP model. We further demonstrate that commercial off-the-shelf MIP solvers can produce provably optimal or near-optimal schedules from these models in time frames suitable for sensor operations.

47 OTHER INSTRUMENTATION↗

Critical Zone Water Balance Over 13 Years in a Semiarid Savanna

Abstract Quantifying how much and when precipitation (P) becomes runoff (R), evapotranspiration (ET), and drainage from the root zone (D) is key to understanding how climate and land use impact hydrology of the critical zone. We quantify water balance dynamics of a semiarid savanna with a summer/winter rainfall pattern with 13 years of water fluxes and soil moisture. We find multiyear P is partitioned 96% to ET and 7% to R, while D (−3%) is negligible when considering measurement uncertainty. While weather regulates ET over diurnal time scales, soil water inputs control seasonal to annual ET amounts. Seasonal water availability, estimated by soil moisture inputs, is more closely tracked by ET rather than time‐averaged soil moisture or P. Surprisingly, we find significant, episodic carryover of soil moisture from the summer to spring growing season. Abundant late‐summer P can supply ET in the subsequent spring, even after multimonth dry periods. However, over an annual cycle beginning in early summer, nearly all soil moisture is used by ET. Likewise, D beyond the monitored root zone, assisted by downward hydraulic distribution in plant roots, occurs within a season, but this is counteracted by subsequent ET extraction of deep moisture over the year. Thus, negligible long‐term D occurs, though there is considerable uncertainty in estimation of this small flux as the residual of much larger ones. These comprehensive, long‐term measurements support expectations about the overriding importance of ET in the dryland critical zone water balance and reveal an unexpected degree of interseasonal water storage.

Scott, Russell L.↗

Soil thermal dynamics, snow cover, and frozen depth under five temperature treatments in an ombrotrophic bog: Constrained forecast with data assimilation: Forecast With Data Assimilation

We report that accurate simulation of soil thermal dynamics is essential for realistic prediction of soil biogeochemical responses to climate change. To facilitate ecological forecasting at the Spruce and Peatland Responses Under Climatic and Environmental change site, we incorporated a soil temperature module into a Terrestrial ECOsystem (TECO) model by accounting for surface energy budget, snow dynamics, and heat transfer among soil layers and during freeze-thaw events. We conditioned TECO with detailed soil temperature and snow depth observations through data assimilation before the model was used for forecasting. The constrained model reproduced variations in observed temperature from different soil layers, the magnitude of snow depth, the timing of snowfall and snowmelt, and the range of frozen depth. The conditioned TECO forecasted probabilistic distributions of soil temperature dynamics in six soil layers, snow, and frozen depths under temperature treatments of +0.0, +2.25, +4.5, +6.75, and +9.0°C. Air warming caused stronger elevation in soil temperature during summer than winter due to winter snow and ice. And soil temperature increased more in shallow soil layers in summer in response to air warming. Whole ecosystem warming (peat + air warmings) generally reduced snow and frozen depths. The accuracy of forecasted snow and frozen depths relied on the precision of weather forcing. Uncertainty is smaller for forecasting soil temperature but large for snow and frozen depths. Lastly, timely and effective soil thermal forecast, constrained through data assimilation that combines process-based understanding and detailed observations, provides boundary conditions for better predictions of future biogeochemical cycles.

54 ENVIRONMENTAL SCIENCES↗

A global stochastic programming approach for the optimal placement of gas detectors with nonuniform unavailabilities

Optimal design of a gas detection systems is challenging because of the numerous sources of uncertainty, including weather and environmental conditions, leak location and characteristics, and process conditions. Rigorous CFD simulations of dispersion scenarios combined with stochastic programming techniques have been successfully applied to the problem of optimal gas detector placement; however, rigorous treatment of sensor failure and nonuniform unavailability has received less attention. To improve reliability of the design, this paper proposes a problem formulation that explicitly considers nonuniform unavailabilities and all backup detection levels. The resulting sensor placement problem is a large-scale mixed-integer nonlinear programming (MINLP) problem that requires a tailored solution approach for efficient solution. We have developed a multitree method which depends on iteratively solving a sequence of upper-bounding master problems and lower-bounding subproblems. The tailored global solution strategy is tested on a real data problem and the encouraging numerical results indicate that our solution framework is promising in solving sensor placement problems. This study was selected for the special issue in JLPPI from the 2016 International Symposium of the MKO Process Safety Center.

47 OTHER INSTRUMENTATION↗

Managing weather- and market price-related financial risks in algal biofuel production

Large-scale algae production has garnered interest due to its potential as a biofuel feedstock. Previous research assessing the profitability of algae products has been mostly based on values averaged over time, but algae production and resulting financial returns exhibit significant variability due to weather and fluctuations in selling prices for algae-based products. In other sectors, producers often reduce weather- and market price-related financial risk with financial instruments such as insurance, but little research has been performed on the design of insurance products to protect algae producers. Furthermore, this study develops a novel index-based insurance instrument that pays-out during unfavorable weather and market conditions, then explores the instrument's effectiveness, combined with a cash reserve, in reducing revenue stream variability for an algae producer. Results indicate that a biophysically based index-insurance product tailored to the specific financial risks in algae production can reduce variability in net revenues and can do so at a lower cost than relying solely on cash reserves, the most common financial risk management tool. Assessing the performance of index-insurance in algae production is particularly timely given the passage of the 2018 Farm Bill, which newly opens opportunities for the USDA to provide crop insurance to algae producers.

09 BIOMASS FUELS↗

Fuzzy Linguistic Knowledge Based Behavior Extraction for Building Energy Management Systems

Significant portion of world energy production is consumed by building Heating, Ventilation and Air Conditioning (HVAC) units. Thus along with occupant comfort, energy efficiency is also an important factor in HVAC control. Modern buildings use advanced Multiple Input Multiple Output (MIMO) control schemes to realize these goals. However, since the performance of HVAC units is dependent on many criteria including uncertainties in weather, number of occupants, and thermal state, the performance of current state of the art systems are sub-optimal. Furthermore, because of the large number of sensors in buildings, and the high frequency of data collection, large amount of information is available. Therefore, important behavior of buildings that compromise energy efficiency or occupant comfort is difficult to identify. This paper presents an easy to use and understandable framework for identifying such behavior. The presented framework uses human understandable knowledge-base to extract important behavior of buildings and present it to users via a graphical user interface. The presented framework was tested on a building in the Pacific Northwest and was shown to be able to identify important behavior that relates to energy efficiency and occupant comfort.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

CalWater Field Studies Designed to Quantify the Roles of Atmospheric Rivers and Aerosols in Modulating U.S. West Coast Precipitation in a Changing Climate

The variability of precipitation and water supply along the U.S. West Coast creates major challenges to the region’s economy and environment, as evidenced by the recent California drought. This variability is strongly influenced by atmospheric rivers (AR), which deliver much of the precipitation along the U.S. West Coast and can cause flooding, and by aerosols (from local sources and transported from remote continents and oceans) that modulate clouds and precipitation. A better understanding of these processes is needed to reduce uncertainties in weather predictions and climate projections of droughts and floods, both now and under changing climate conditions.To address these gaps a group of meteorologists, hydrologists, climate scientists, atmospheric chemists, and oceanographers have created an interdisciplinary research effort, with support from multiple agencies. From 2009-2011 a series of field campaigns (CalWater 1) collected atmospheric chemistry, cloud microphysics and meteorological measurements in California and associated modeling and diagnostic studies were carried out. Based on remaining gaps, a vision was developed to extend these studies offshore over the Eastern North Pacific and to enhance land based measurements from 2014-2018 (CalWater 2). The data set and selected results from CalWater 1 are summarized here. The goals of CalWater-2, and measurements to date, are then described. Through this work, CalWater is producing new findings and exploring new technologies to evaluate and improve global climate models and their regional performance and to develop tools supporting water and hydropower management. These advances also have potential to enhance hazard mitigation by improving near-term weather prediction and subseasonal and seasonal outlooks.

54 ENVIRONMENTAL SCIENCES↗

Dynamic Transmission Line Switching Amid Wildfire-Prone Weather Under Decision-Dependent Uncertainty

During dry and windy seasons, environmental conditions significantly increase the risk of wildfires, exposing power grids to disruptions caused by transmission line failures. Wildfire propagation exacerbates grid vulnerability, potentially leading to prolonged power outages. To address this challenge, we propose a multistage optimization model that dynamically adjusts transmission grid topology in response to wildfire propagation, aiming to develop an optimal response policy. By accounting for decision-dependent uncertainty, where line survival probabilities depend on usage, we employ distributionally robust optimization to model uncertainty in line survival distributions. We adapt the stochastic nested decomposition algorithm and derive a deterministic upper bound for its finite convergence. To enhance computational efficiency, we exploit the Lagrangian dual problem structure for a faster generation of Lagrangian cuts. Using realistic data from the California transmission grid, we demonstrate the superior performance of dynamic response policies against two-stage alternatives through a comprehensive case study. In addition, after solving the multistage formulation, we construct easy-to-implement policies that significantly reduce computational burden while maintaining good performance in real-time deployment. History: Accepted by Russell Bent, Area Editor for Network Optimization: Algorithms and Applications. Funding: This work was supported by the U.S. Department of Energy, Office of Electricity [Grant DE-AC02-05CH11231]. The work of R. Jiang was supported in part by the U.S. National Science Foundation, Division of Electrical, Communications and Cyber Systems [Grant ECCS-1845980] and the U.S. Air Force Office of Scientific Research [Grant FA9550-23-1-0323]. Supplemental Material: The software that supports the findings of this study is available within the paper and its Supplemental Information ( https://pubsonline.informs.org/doi/suppl/10.1287/ijoc.2025.1210 ) as well as from the IJOC GitHub software repository ( https://github.com/INFORMSJoC/2025.1210 ). The complete IJOC Software and Data Repository is available at https://informsjoc.github.io/ .

Estrada-Garcia, Juan-Alberto↗