Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “WEATHER FORECASTING”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40

The 2023 terahertz science and technology roadmap

Abstract Terahertz (THz) radiation encompasses a wide spectral range within the electromagnetic spectrum that extends from microwaves to the far infrared (100 GHz–∼30 THz). Within its frequency boundaries exist a broad variety of scientific disciplines that have presented, and continue to present, technical challenges to researchers. During the past 50 years, for instance, the demands of the scientific community have substantially evolved and with a need for advanced instrumentation to support radio astronomy, Earth observation, weather forecasting, security imaging, telecommunications, non-destructive device testing and much more. Furthermore, applications have required an emergence of technology from the laboratory environment to production-scale supply and in-the-field deployments ranging from harsh ground-based locations to deep space. In addressing these requirements, the research and development community has advanced related technology and bridged the transition between electronics and photonics that high frequency operation demands. The multidisciplinary nature of THz work was our stimulus for creating the 2017 THz Science and Technology Roadmap (Dhillon et al 2017 J. Phys. D: Appl. Phys. 50 043001). As one might envisage, though, there remains much to explore both scientifically and technically and the field has continued to develop and expand rapidly. It is timely, therefore, to revise our previous roadmap and in this 2023 version we both provide an update on key developments in established technical areas that have important scientific and public benefit, and highlight new and emerging areas that show particular promise. The developments that we describe thus span from fundamental scientific research, such as THz astronomy and the emergent area of THz quantum optics, to highly applied and commercially and societally impactful subjects that include 6G THz communications, medical imaging, and climate monitoring and prediction. Our Roadmap vision draws upon the expertise and perspective of multiple international specialists that together provide an overview of past developments and the likely challenges facing the field of THz science and technology in future decades. The document is written in a form that is accessible to policy makers who wish to gain an overview of the current state of the THz art, and for the non-specialist and curious who wish to understand available technology and challenges. A such, our experts deliver a ‘snapshot’ introduction to the current status of the field and provide suggestions for exciting future technical development directions. Ultimately, we intend the Roadmap to portray the advantages and benefits of the THz domain and to stimulate further exploration of the field in support of scientific research and commercial realisation.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Diverging climate response of corn yield and carbon use efficiency across the U.S.

Abstract In this paper, we developed an open-source package to analyze the overall trend and responses of both carbon use efficiency (CUE) and corn yield to climate factors for the contiguous United States. Our algorithm enables automatic retrieval of remote sensing data through the Google Earth Engine (GEE) and U.S. Department of Agriculture (USDA) agricultural production data at the county level through application programming interface (API). Firstly, we integrated satellite products of net primary productivity and gross primary productivity based on the Moderate Resolution Imaging Spectroradiometer (MODIS) sensor, and climatic variables from the European Centre for Medium-Range Weather Forecasts. Secondly, we calculated CUE and commonly used climate metrics. Thirdly, we investigated the spatial heterogeneity of these variables. We applied a random forest algorithm to identify the key climate drivers of CUE and crop yield, and estimated the responses of CUE and yield to climate variability using the spatial moving window regression across the U.S. Our results show that growing degree days (GDD) has the highest predictive power for both CUE and yield, while extreme degree days (EDD) is the least important explanatory variable. Moreover, we observed that in most areas of the U.S., yield increases or stays the same with higher GDD and precipitation. However, CUE decreases with higher GDD in the north and shows more mixed and fragmented interactions in the south. Notably, there are some exceptions where yield is negatively correlated with precipitation in the Missouri and Mississippi River Valleys. As global warming continues, we anticipate a decrease in CUE throughout the vast northern part of the country, despite the possibility of yield remaining stable or increasing.

54 ENVIRONMENTAL SCIENCES↗

INTERACTIONS BETWEEN CORONAL MASS EJECTIONS VIEWED IN COORDINATED IMAGING AND IN SITU OBSERVATIONS

The successive coronal mass ejections (CMEs) from 2010 July 30 to August 1 present us the first opportunity to study CME-CME interactions with unprecedented heliospheric imaging and in situ observations from multiple vantage points. We describe two cases of CME interactions: merging of two CMEs launched close in time and overtaking of a preceding CME by a shock wave. The first two CMEs on August 1 interact close to the Sun and form a merged front, which then overtakes the July 30 CME near 1 AU, as revealed by wide-angle imaging observations. Connections between imaging observations and in situ signatures at 1 AU suggest that the merged front is a shock wave, followed by two ejecta observed at Wind which seem to have already merged. In situ measurements show that the CME from July 30 is being overtaken by the shock at 1 AU and is significantly compressed, accelerated, and heated. The interaction between the preceding ejecta and shock also results in variations in the shock strength and structure on a global scale, as shown by widely separated in situ measurements from Wind and STEREO B. These results indicate important implications of CME-CME interactions for shock propagation, particle acceleration, and space weather forecasting.

79 ASTRONOMY AND ASTROPHYSICS↗

Journey over Destination: Dynamic Sensor Placement Enhances Generalization

Reconstructing complex, high-dimensional global fields from limited data points is a challenge across various scientific and industrial domains. This is particularly important for recovering spatio-temporal fields using sensor data from, for example, laboratory-based scientific experiments, weather forecasting, or drone surveys. Given the prohibitive costs of specialized sensors and the inaccessibility of
certain regions of the domain, achieving full field coverage is typically not feasible. Therefore, the development of machine learning algorithms trained to reconstruct fields given a limited dataset is of critical importance. In this study, we introduce a general
approach that employs moving sensors to enhance data exploitation during the training of an attention based neural network, thereby improving field reconstruction. The training of sensor locations is accomplished using an end-to-end workflow, ensuring
differentiability in the interpolation of field values associated to the sensors, and is simple to implement using differentiable programming. Additionally, we have incorporated a correction mechanism to prevent sensors from entering invalid regions within the domain. We evaluated our method using two distinct datasets; the results show that our approach enhances learning, as evidenced by improved test scores.

54 ENVIRONMENTAL SCIENCES↗

From Optimization to Sampling Through Gradient Flows

Optimization and sampling algorithms play a central role in science and engineering as they enable finding optimal predictions, policies, and recommendations, as well as expected and equilibrium states of complex systems. The notion of “optimality” is formalized by the choice of an objective function, while the notion of an “expected” state is specified by a probabilistic model for the distribution of states. Optimizing rugged objective functions and sampling multimodal distributions is computationally challenging, especially in high-dimensional problems. Here, for this reason, many optimization and sampling methods have been developed by researchers working in disparate fields such as Bayesian statistics, molecular dynamics, genetics, quantum chemistry, machine learning, weather forecasting, econometrics, and medical imaging.

Trillos, N. García↗

A Privacy Preserving Model-Free Optimization and Control Framework for Demand Response from Residential Thermal Loads

We consider the problem of optimizing the cost of procuring electricity for a large collection of homes managed by a load serving entity, by pre-cooling or pre-heating the thermal inertial loads in the homes to avoid procuring power during periods of peak electricity pricing. We would like to accomplish this objective in a completely privacy-preserving and model-free manner, that is, without direct access to the state variables (temperatures or power consumption) or the dynamical models (thermal characteristics) of individual homes, while guaranteeing personal comfort constraints of the consumers. We propose a two-stage optimization and control framework to address this problem. In the first stage, we use a long short-term memory (LSTM) network to predict hourly electricity prices, based on historical pricing data and weather forecasts. Given the hourly price forecast and thermal models of the homes, the problem of designing an optimal power consumption trajectory that minimizes the total electricity procurement cost for the collection of thermal loads can be formulated as a large-scale integer program (with millions of variables) due to the on-off cyclical dynamics of such loads. We provide a simple heuristic relaxation to make this large-scale optimization problem model-free and computationally tractable. In the second stage, we translate the results of this optimization problem into distributed open-loop control laws that can be implemented at individual homes without measuring or estimating their state variables, while simultaneously ensuring consumer comfort constraints. We demonstrate the performance of this approach on a large-scale test case comprising of 500 homes in the Houston area and benchmark its performance against a direct model-based optimization and control solution.

Sivaranjani, S.↗

Semantic Information Modeling for Emerging Applications in Smart Grid

Smart Grid modernizes power grid by integrating digital and information technologies. Millions of smart meters, intelligent appliances and communication infrastructures are under deployment allowing advanced IT applications to be developed to secure and manage power grid operations. Demand response (DR) is one such emerging application to optimize electricity demand by curtailing/shifting power load when peak load occurs. Existing DR approaches are mostly based on static plans such as pricing policies and load shedding schedules. However, improvements to power management applications rely on data emanating from existing and new information sources with the growth of Smart Grid information space. In particular, dynamic DR algorithms depend on information from smart meters that report interval-based power consumption measurement, HVAC systems that monitor buildings heat and humidity, and even weather forecast services. In order for emerging Smart Grid applications to take advantage of the diverse data influx, extensible information integration is required. In this paper, we develop an integrated Smart Grid information model using Semantic Web techniques and present case studies of using semantic information for dynamic DR. We show the semantic model facilitates information integration and knowledge representation for developing the next generation Smart Grid applications.

complex event processing↗

An Open-Source Tool for Automated Power Grid Stress Level Prediction at Balancing Authorities

The behavior of modern power systems becomes more stochastic and dynamic, due to the increased penetration of variable generation, demand response, new power market structure, extreme weather conditions, contingencies, and unexpected events. It is critically important to predict potential system operational issues so that grid planners and operators can take preventive actions to mitigate the impact, e.g., lack of operational reserves. In this paper, an innovative software tool is presented to assist power grid operators in a balancing authority (BA) to predict the grid stress level over the next operating day. It periodically collects necessary information from public domain such as weather forecasts, electricity demand, and automatically estimates the stress levels on a daily basis. Advanced Neural Network and regression tree algorithms are developed as the prediction engines to achieve this goal. The tool has been tested on a few key balancing authorities that successfully predicates the growing system peak load and increased stress levels under extreme heat waves in the United States of America.

Berscheid, Alan P.↗

Examination of Humidity and Ice Supersaturation Profiles Over West Antarctica Using Ground-Based G-Band Radiometer Retrievals

Humidity profiles retrieved from a ground-based millimeter-wave radiometer located at McMurdo Station, Antarctica and the West Antarctica Ice Sheet Divide are presented and their suitability to study the humidity of the polar climate is assessed. The dry conditions of the Antarctic winter and spring are ideal for ground-based millimeter-wave measurements and the retrievals appear to realistically reproduce the spatial and temporal variability of humidity at both sites. Furthermore, the radiometer has the ability to capture daily variability of very low humidity (0.5 to 4 g/kg) in the low-to-mid troposphere with an uncertainty of 10-20% during the Antarctic winter, spring, and summer. Despite the coarse vertical resolution (200-600 m in the first 4 km), the retrievals provide additional information with respect to the European Centre for Medium Range Weather Forecasts (ECMWF) profiles used as background information. The radiometer is also able to realistically identify the location and frequency of supersaturated layers with respect to ice in the mid troposphere. The occurrence of supersaturated layers is correlated with the occurrence of ice clouds identified by a cloud mask. Overall, results show that ground-based microwave and millimeter-wave radiometry is a viable complement to satellite observations to provide continuous information on the thermodynamic state of the low-to-mid troposphere at high latitudes.

54 ENVIRONMENTAL SCIENCES↗

TROPHY: A Topologically Robust Physics-Informed Tracking Framework for Tropical Cyclones

Tropical cyclones (TCs) are among the most destructive weather systems. Realistically and efficiently detecting and tracking TCs are critical for assessing their impacts and risks. In particular, the eye is a signature feature of a mature TC. Therefore, knowing the eyes’ locations and movements is crucial for both operational weather forecasts and climate risk assessments. Recently, a multilevel robustness framework has been introduced to study the critical points of time-varying vector fields. The framework quantifies the robustness (i.e., structural stability) of critical points across varying neighborhoods. By relating the multilevel robustness with critical point tracking, the framework has demonstrated its potential in cyclone tracking. An advantage is that it identifies cyclonic features using only 2D wind vector fields, which is encouraging as most tracking algorithms require multiple dynamic and thermodynamic variables at different altitudes. A disadvantage is that the framework does not scale well computationally for datasets containing a large number of cyclones. Herein this paper introduces a topologically robust physics-informed tracking framework (TROPHY) for TC tracking. The main idea is to integrate physical knowledge of TC to drastically improve the computational efficiency of multilevel robustness framework for large-scale climate datasets. First, during preprocessing, we propose a physics-informed feature selection strategy to filter 90% of critical points that are short-lived and have low stability, thus preserving good candidates for TC tracking. Second, during in-processing, we impose constraints during the multilevel robustness computation to focus only on physics-informed neighborhoods of TCs. We apply TROPHY to 30 years of 2D wind fields from reanalysis data in ERA5 and generate a number of TC tracks. In comparison with the observed tracks, we demonstrate that TROPHY can capture TC characteristics (e.g., frequency, intensity, duration, latitudes with maximum intensity, and genesis) that are comparable to and sometimes even better than a well-validated TC tracking algorithm that requires multiple dynamic and thermodynamic scalar fields.

97 MATHEMATICS AND COMPUTING↗

Distributed Cross-Channel Hierarchical Aggregation for Foundation Models

Vision-based scientific foundation models hold significant promise for advancing scientific discovery and innovation. This potential stems from their ability to aggregate images from diverse sources—such as varying physical groundings or data acquisition systems—and to learn spatio-temporal correlations using transformer architectures. However, tokenizing and aggregating images can be compute-intensive, a challenge not fully addressed by current distributed methods. In this work, we introduce the Distributed Cross-Channel Hierarchical Aggregation (D-CHAG) approach designed for datasets with a large number of channels across image modalities. Our method is compatible with any model-parallel strategy and any type of vision transformer architecture, significantly improving computational efficiency. We evaluated D-CHAG on hyperspectral imaging and weather forecasting tasks. When integrated with tensor parallelism and model sharding, our approach achieved up to a 75% reduction in memory usage and more than doubled sustained throughput on up to 1,024 AMD GPUs on the Frontier Supercomputer.

Tsaris, Aristeidis (aris) [ORNL] (ORCID:0000000277↗

Framework for Multi Layer Control in Python (FMLC) v1.0

This package is developed as a backend for multi-layer and multi-time domain controller. One example are controller based on [Model Predictive Control] (MPC) where different modules with different time constants have to be coordinated to allow optimal control. In a simple example, the Weather Forecast must be acquired and processed, the MPC is computed, and finally the control is applied. All these modules typically run on the same time step (Time step: 5 minutes), but are different instances within the framework. The framework allows parallelization using the `multiprocessing` module. However, another real-time controller (Time step: 1 second) must be applied to react on instant system disturbances beyond the MPC time step. Last, a supervisory MPC controller (Time step: 1 hour) might be added to ensure global optimality.

Gehbauer, Christoph↗

COSP: Satellite simulation software for model assessment

Errors in the simulation of clouds in general circulation models (GCMs) remain a long-standing issue in climate projections, as discussed in the Intergovernmental Panel on Climate Change (IPCC) Fourth Assessment Report. This highlights the need for developing new analysis techniques to improve our knowledge of the physical processes at the root of these errors. The Cloud Feedback Model Intercomparison Project (CFMIP) pursues this objective, and under that framework the CFMIP Observation Simulator Package (COSP) has been developed. COSP is a flexible software tool that enables the simulation of several satellite-borne active and passive sensor observations from model variables. The flexibility of COSP and a common interface for all sensors facilitates its use in any type of numerical model, from high-resolution cloud-resolving models to the coarser-resolution GCMs assessed by the IPCC, and the scales in between used in weather forecast and regional models. The diversity of model parameterization techniques makes the comparison between model and observations difficult, as some parameterized variables (e.g., cloud fraction) do not have the same meaning in all models. The approach followed in COSP permits models to be evaluated against observations and compared against each other in a more consistent manner. This thus permits a more detailed diagnosis of the physical processes that govern the behavior of clouds and precipitation in numerical models. The World Climate Research Programme (WCRP) Working Group on Coupled Modelling has recommended the use of COSP in a subset of climate experiments that will be assessed by the next IPCC report. Here we describe COSP, present some results from its application to numerical models, and discuss future work that will expand its capabilities.

54 ENVIRONMENTAL SCIENCES↗

Deep Learning Parameterization of Vertical Wind Velocity Variability via Constrained Adversarial Training

Atmospheric models with typical resolution in the tenths of kilometers cannot resolve the dynamics of air parcel ascent, which varies on scales ranging from tens to hundreds of meters. Small-scale wind fluctuations are thus characterized by a subgrid distribution of vertical wind velocity W with standard deviation σ W . The parameterization of σ W is fundamental to the representation of aerosol–cloud interactions, yet it is poorly constrained. Using a novel deep learning technique, this work develops a new parameterization for σ W merging data from global storm-resolving model simulations, high-frequency retrievals of W , and climate reanalysis products. The parameterization reproduces the observed statistics of σ W and leverages learned physical relations from the model simulations to guide extrapolation beyond the observed domain. Incorporating observational data during the training phase was found to be critical for its performance. The parameterization can be applied online within large-scale atmospheric models, or offline using output from weather forecasting and reanalysis products.

54 ENVIRONMENTAL SCIENCES↗

A Bird’s Eye View: Development of an Operational ARM Unmanned Aerial Capability for Atmospheric Research in Arctic Alaska

Here, we present that unmanned aerial capabilities offer exciting new perspectives on the Arctic atmosphere and the US Department of Energy is working with partners to offer such perspectives to the research community. Thorough understanding of aerosols, clouds, boundary layer structure and radiation is required to improve representation of the Arctic atmosphere in weather forecasting and climate models. To develop such understanding, new perspectives are needed to provide details on the vertical structure and spatial variability of key atmospheric properties, along with information over difficult-to-reach surfaces such as newly-forming sea ice. Over the last three years, the US Department of Energy (DOE) has supported various flight campaigns using unmanned aircraft systems (UAS, also known as UAVs and drones) and tethered balloon systems (TBS) at Oliktok Point, Alaska. These activities have featured in-situ measurements of thermodynamic state, turbulence, radiation, aerosol properties, cloud microphysics and turbulent fluxes to provide a detailed characterization of the lower atmosphere. Alongside a suite of active and passive ground-based sensors and radiosondes deployed by the DOE Atmospheric Radiation Measurement (ARM) program through the third ARM Mobile Facility (AMF-3), these flight activities demonstrate the ability of such platforms to provide critically-needed information. In addition to providing new and unique datasets, lessons learned during initial campaigns have assisted toward the development of an exciting new community resource.

54 ENVIRONMENTAL SCIENCES↗

Aerosol-Cloud-Meteorology Interaction Airborne Field Investigations: Using Lessons Learned from the US West Coast in the Design of ACTIVATE off the US East Coast

We report on a multi-year set of airborne field campaigns (2005 – 2016) off the California coast to examine aerosols, clouds, and meteorology, and how lessons learned tie into the upcoming NASA Earth Venture Suborbital (EVS-3) campaign: Aerosol Cloud meTeorology Interactions oVer the western ATlantic Experiment (ACTIVATE) (2019–2023). The largest uncertainty in estimating global anthropogenic radiative forcing is associated with the interactions of aerosol particles with clouds, which stems from the variability of cloud systems and the multiple feedbacks that affect and hamper efforts to ascribe changes in cloud properties to aerosol perturbations. While past campaigns have been limited in flight hours and the ability to fly in and around clouds, efforts sponsored by the Office of Naval Research have resulted in 113 single aircraft flights (> 500 flight hours) in a fixed region with warm marine boundary layer clouds. All flights used nearly the same payload of instruments on a Twin Otter to fly below, in, and above clouds, producing an unprecedented dataset. We provide here (i) an overview of statistics of aerosol, cloud, and meteorological conditions encountered in those campaigns and (ii) quantification of model-relevant metrics associated with aerosol-cloud interactions leveraging the high data volume and statistics. Based on lessons learned from those flights, we describe the pragmatic innovation in sampling strategy (dual aircraft approach with combined in situ and remote sensing) that will be used in ACTIVATE to generate a dataset that can advance scientific understanding and improve physical parameterizations for Earth system and weather forecasting models, and for assessing next-generation remote sensing retrieval algorithms.

54 ENVIRONMENTAL SCIENCES↗

Climate Dynamics Preceding Summer Forest Fires in California and the Extreme Case of 2018

Recent record-breaking wildfire seasons in California prompt an investigation into the climate patterns that typically precede anomalous summer burned forest area. Using burned-area data from the U.S. Forest Service’s Monitoring Trends in Burn Severity (MTBS) product and climate data from the fifth major global reanalysis produced by the European Centre for Medium-Range Weather Forecasts (ERA5) over 1984–2018, relationships between the interannual variability of antecedent climate anomalies and July California burned area are spatially and temporally characterized. Lag correlations show that antecedent high vapor pressure deficit (VPD), high temperatures, frequent extreme high temperature days, low precipitation, high subsidence, high geopotential height, low soil moisture, and low snowpack and snowmelt anomalies all correlate significantly with July California burned area as far back as the January before the fire season. Seasonal regression maps indicate that a global midlatitude atmospheric wave train in late winter is associated with anomalous July California burned area. July 2018, a year with especially high burned area, was to some extent consistent with the general patterns revealed by the regressions: low winter precipitation and high spring VPD preceded the extreme burned area. However, geopotential height anomaly patterns were distinct from those in the regressions. Extreme July heat likely contributed to the extent of the fires ignited that month, even though extreme July temperatures do not historically significantly correlate with July burned area. While the 2018 antecedent climate conditions were typical of a high-burned-area year, they were not extreme, demonstrating the likely limits of statistical prediction of extreme fire seasons and the need for individual case studies of extreme years.

54 ENVIRONMENTAL SCIENCES↗

A Methodology for Estimating the Energy and Moisture Budget of the Convective Boundary Layer Using Continuous Ground-Based Infrared Spectrometer Observations

Abstract Land–atmosphere interactions play a critical role in both the atmospheric water and energy cycles. Changes in soil moisture and vegetation alter the partitioning of surface water and energy fluxes, influencing diurnal evolution of the planetary boundary layer (PBL). The mixing-diagram framework has proven useful in understanding the evolution of the heat and moisture budget within the convective boundary layer (CBL). We demonstrate that observations from the Department of Energy Atmospheric Radiation Measurement (ARM) Southern Great Plains site provide all of the needed inputs needed for the mixing-diagram framework, allowing us to quantify the impact from the surface fluxes, advection, radiative heating, encroachment, and entrainment on the evolution of the CBL. Profiles of temperature and humidity retrieved from the ground-based infrared spectrometer [Atmospheric Emitted Radiance Interferometer (AERI)] are a critical component in this analysis. Large-eddy simulation results demonstrate that mean mixed-layer values derived are shown to be critical to close the energy and moisture budgets. A novel approach demonstrated here is the use of network of AERIs and Doppler lidars to quantify the advective fluxes of heat and moisture. The framework enables the estimation of the entrainment fluxes as a residual, providing a way to observe the entrainment fluxes without using multiple lidar systems. The high temporal resolution of the AERI observations enables the morning, midday, and afternoon evolution of the CBL to be quantified. This work provides a new way to use observations in this framework to evaluate weather and climate models. Significance Statement The energy and moisture budget of the planetary boundary layer (PBL) is influenced by multiple sources, and accurately representing this evolution in numerical models is critical for weather forecasts and climate predictions. The mixing-diagram approach, driven by profiling observations as illustrated here, provides a powerful way to quantify the contributions from each of these sources. In particular, the energy and moisture mixed into the PBL from above the PBL can be determined accurately from ground-based remote sensors using this approach.

54 ENVIRONMENTAL SCIENCES↗