Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “performance forecasting”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

Incorrect computation of Madden-Julian oscillation prediction skill

The Madden–Julian oscillation (MJO) is a major tropical weather system and one of the largest sources of predictability for subseasonal-to-seasonal weather forecasts. Skillful prediction of the MJO has been a highly active area of research due to its large socio-economic impacts. Silini et al., herein S21, developed a machine learning model to predict the MJO, which they claimed to have an MJO prediction skill of 26–27 days over all seasons and 45 days for December–February (DJF) winter. If true, this would make the skill of their model competitive with that of the state-of-the-art dynamical MJO prediction systems at 20–35 days. However, here we show that the MJO prediction was calculated incorrectly in S21, which spuriously increased the performance of their model. Correctly computed skill of their model was substantially lower than that reported in S21; the skill for all seasons drops to 11–12 days and the skill for forecasts initialized during DJF drops to 15 days. Our findings clarify that the S21 machine learning model is not competitive with state-of-the-art numerical weather prediction models in predicting the MJO.

54 ENVIRONMENTAL SCIENCES↗

“Gray Zone” Simulations Using a Three-Dimensional Planetary Boundary Layer Parameterization in the Weather Research and Forecasting Model

Abstract Generating accurate weather forecasts of planetary boundary layer (PBL) properties is challenging in many geographical regions, oftentimes due to complex topography or horizontal variability in, for example, land characteristics. While recent advances in high-performance computing platforms have led to an increase in the spatial resolution of numerical weather prediction (NWP) models, the horizontal gridcell spacing (Δ x ) of many regional-scale NWP models currently fall within or are beginning to approach the gray zone (i.e., Δ x ≈ 100–1000 m). At these gridcell spacings, three-dimensional (3D) effects are important, as the most energetic turbulent eddies are neither fully parameterized (as in traditional mesoscale simulations) nor fully resolved [as in traditional large-eddy simulations (LES)]. In light of this modeling challenge, we have implemented a 3D PBL parameterization for high-resolution mesoscale simulations using the Weather Research and Forecasting Model. The PBL scheme, which is based on the algebraic model developed by Mellor and Yamada, accounts for the 3D effects of turbulence by calculating explicitly the momentum, heat, and moisture flux divergences in addition to the turbulent kinetic energy. In this study, we present results from idealized simulations in the gray zone that illustrate the benefit of using a fully consistent turbulence closure framework under convective conditions. While the 3D PBL scheme reproduces the evolution of convective features more appropriately than the traditional 1D PBL scheme, we highlight the need to improve the turbulent length scale formulation. Significance Statement The spatial resolution of weather models continues to increase at a rapid rate in accordance with the enhancement of computing power. As a result, smaller-scale atmospheric features become more explicitly resolved. However, most numerical models still ignore the impact of horizontal weather variations on boundary layer flows, which becomes more important at these smaller spatial scales. To address this issue, we have implemented a new modeling approach, using fundamental principles, which accounts for horizontal variability. Our results show that including three-dimensional effects of turbulence is necessary to achieve realistic boundary layer characteristics. This novel technique may be useful for many applications including complex terrain flows, pollutant dispersion, and surface–atmosphere interaction studies.

Juliano, Timothy W.↗

Performance evaluation of automated data-driven feature extraction and selection methods for practical and scalable building energy consumption prediction models

Here, this study quantifies the impact of automated feature engineering methods (feature extraction and selection) on the quality and accuracy of machine learning models that predict building energy consumption. The case study compares model performance for three main scenarios: baseline (no feature extraction and selection), feature extraction only, and feature extraction combined with feature selection (filter and/or wrapper methods) for fully trained machine learning models for 200 metered/sub-metered energy measurements across 118 real buildings. For consistency, the same machine learning model architecture (a black box deep learning neural network with probabilistic forecast output) was used for all scenarios. Based on results, all feature engineering methods provided noticeable prediction accuracy improvements (e.g., 29%-68% median prediction improvement) compared to baseline scenarios. However, in this application, feature selection methods provide little practical value due to their limited performance gains and high computational cost. Smarter algorithm development supported by better computational environments will be needed before feature selection methods can reliably and efficiently improve predictive model performance.

97 MATHEMATICS AND COMPUTING↗

Grey-box and ANN-based building models for multistep-ahead prediction of indoor temperature to implement model predictive control

Model-based predictive control (MPC) strategies for heating, ventilation, and air-conditioning (HVAC) systems present an opportunity to lower building energy consumption and operational costs. Such approaches rely on the development of a model to precisely forecast building thermal dynamics, such as room air temperature or heating/cooling rate, and make control-related decisions. The control-oriented modeling of building energy systems should be accurate in predicting indoor conditions and present low computational complexity. These features are the key challenge of implementing advanced control methods such as MPC. Extant studies on building modeling for MPC have focused on step-ahead forecasting techniques to forecast building thermal dynamics, while multistep-ahead forecasting is essential. Moreover, machine learning model suitable in case of the domain-based engineering expertise are also not available. To this aim, we perform a comparative analysis of the grey-box model based on a resistance-capacitance (RC) thermal network and a machine learning model composed of an artificial neural network (ANN) for multistep-ahead prediction of building thermal dynamics using current and historical data. Actual experimental data obtained from the Flexible Research Platform (FRP) in Oak Ridge National Laboratory (US) are used for estimation and validation purposes. The average root mean squared error (RMSE) of the grey-box and ANN models are 0.89 °C and 1.02°C, respectively. Finally, the results indicate that the grey-box model outperforms the ANN model in the considered validation periods in terms of accuracy and prediction stability.

42 ENGINEERING↗

Reliable statistics-based detection and investigation of anomalies in a SMART valve system

Reliable anomaly detection and diagnosis are critical for the safe operation of complex engineered systems. This study presents a unified framework that integrates statistical, model-based, and data-driven techniques for anomaly detection and investigation, demonstrated on SMART valve systems in hybrid energy applications. Four detection methods—mean deviation, seasonal extreme studentized deviate, ARIMA forecasting, and matrix profiling—were implemented and compared. Matrix profiling was particularly effective in revealing subtle deviations and hidden relationships among variables. Anomaly investigation was performed by analyzing variable-level and grouped signal profiles, with system topology incorporated to distinguish primary faults from propagated effects. Grouping signals by type enhanced interpretability, enabling accurate localization of anomalies across multi-dimensional datasets. Experimental results confirmed the framework's capability to consistently detect and isolate anomalies while providing actionable insights into system interdependencies. The proposed methodology offers a robust, interpretable, and scalable solution for condition monitoring, with potential applications in safety-critical domains such as nuclear energy, aerospace, and process industries.

ARIMA models↗

The Road Ahead for Metal–Organic Frameworks: Current Landscape, Challenges and Future Prospects

This perspective highlights the transformative potential of Metal–Organic Frameworks (MOFs) in environmental and healthcare sectors. It discusses work that has advanced beyond technology readiness levels of >4 including applications in capture, storage, and conversion of gases to value added products. This work showcases efforts in the most salient applications of MOFs which have been performed at a great cadence, enabled by the federal government, large companies, and startups to commercialize these technologies despite facing significant challenges. This article also forecasts the role of nanoscale MOFs in healthcare, including strides toward personalized medicine, advocating for their use in custom-tailored drug delivery systems. Lastly, we underscore the potential acceleration in MOF research and development through the integration of machine learning and AI, positioning MOFs as versatile tools poised to address global sustainability and health challenges.

atmospheric chemistry↗

Wind Fields in Category 1–3 Tropical Cyclones Are Not Fully Represented in Wind Turbine Design Standards

Abstract Offshore wind energy deployment in the U.S. is expected to increase in the years to come, with proposed wind farm sites located in regions with high risk for tropical cyclones. Yet, the wind turbine design criteria outlined by the International Electrotechnical Commission for extreme events may not account for wind field characteristics unique to tropical cyclones. To evaluate if current design standards capture the extreme conditions of these storms, we perform idealized large‐eddy simulations of three tropical cyclones (one Category 1, one Category 2, and one Category 3 storms) using the Weather Research and Forecasting model. Wind conditions near the eyewall of Cat‐1, Cat‐2, and Cat‐3 storms can exceed current design standards for offshore wind turbines. Winds at 90 m can be faster than outlined in the design criteria for Class I and Class T turbines for 50‐year recurrence periods. Wind speed shear across the turbine rotor layer is also larger than assumed in design specifications. Moreover, vertical variations in wind direction across the turbine rotor layer are large for tropical cyclones of all intensity levels, suggesting design standards should include veer, which can amplify loads in wind turbines. The existence of hurricane wind field characteristics that are not represented in design standards does not imply that damage or failure will certainly occur. Engineering safety factors incorporated in the design of the turbine's blades and structural components may prevent damage from occurring.

17 WIND ENERGY↗

Dissipation Scaled Internal Wave Drag in a Global Heterogeneously Coupled Internal/External Mode Total Water Level Model

This study showcases a global, heterogeneously coupled total water level system wherein salinity and temperature outputs from a coarser-resolution (~12 km) ocean general circulation model are used to calculate density-driven terms within a global, higher-resolution (~2.5 km) depth-averaged total water level model. We demonstrate that the inclusion of baroclinic forcing in the barotropic model requires modification of the internal wave drag term to prevent excess degradation of tidal results compared to the barotropic model. By scaling the internal tide dissipation by an easy to calculate dissipation ratio, the resulting heterogeneously coupled model has complex root mean square errors (RMSE) of 2.27 cm in the deep ocean and 12.16 cm in shallow waters for the M 2 tidal constituent. While this represents a 10%–20% deterioration as compared to the barotropic model, the improvements in total water level prediction more than offset this degradation. Global median RMSE compared to observations of total water levels, 30-day sea levels, and non-tidal residuals improve by 1.86 (18.5%), 2.55 (42.5%), and 0.36 (5.3%) cm respectively. The drastic improvement in model performance highlights the importance of including density-driven effects within global hydrodynamic models and will help to improve the results of both hindcasts and forecasts in modeling extreme and nuisance flooding. With only an 11% increase in model run time compared to the fully barotropic total water level model, this approach paves the way for high resolution coastal water level and flood models to be used alongside climate models, improving operational forecasting of total water levels.

Blakely, Coleman Peter [University of Notre Dame, ↗

Impact of Aerosol and Cloud on the Solar Energy Potential over the Central Gangetic Himalayan Region

We examine the impact of atmospheric aerosols and clouds on the surface solar radiation and solar energy at Nainital, a high-altitude remote location in the central Gangetic Himalayan region (CGHR). For this purpose, we exploited the synergy of remote-sensed data in terms of ground-based AERONET Sun Photometer and satellite observations from the MODerate Resolution Imaging Spectroradiometer (MODIS) and the Meteosat Second Generation (MSG), with radiative transfer model (RTM) simulations and 1 day forecasts from the Copernicus Atmosphere Monitoring Service (CAMS). Clouds and aerosols are one of the most common sources of solar irradiance attenuation and hence causing performance issues in the photovoltaic (PV) and concentrated solar power (CSP) plant installations. The outputs of RTM results presented with high accuracy under clear, cloudy sky and dust conditions for global horizontal (GHI) and beam horizontal irradiance (BHI). On an annual basis the total aerosol attenuation was found to be up to 105 kWh m –2 for the GHI and 266 kWh m –2 for BHI, respectively, while the cloud effect is much stronger with an attenuation of 245 and 271 kWh m –2 on GHI and BHI. The results of this study will support the Indian solar energy producers and electricity handling entities in order to quantify the energy and financial losses due to cloud and aerosol presence.

54 ENVIRONMENTAL SCIENCES↗

The ICON-A model for direct QBO simulations on GPUs (version icon-cscs:baf28a514)

Abstract. Classical numerical models for the global atmosphere, as used for numerical weather forecasting or climate research, have been developed for conventional central processing unit (CPU) architectures. This hinders the employment of such models on current top-performing supercomputers, which achieve their computing power with hybrid architectures, mostly using graphics processing units (GPUs). Thus also scientific applications of such models are restricted to the lesser computer power of CPUs. Here we present the development of a GPU-enabled version of the ICON atmosphere model (ICON-A), motivated by a research project on the quasi-biennial oscillation (QBO), a global-scale wind oscillation in the equatorial stratosphere that depends on a broad spectrum of atmospheric waves, which originates from tropical deep convection. Resolving the relevant scales, from a few kilometers to the size of the globe, is a formidable computational problem, which can only be realized now on top-performing supercomputers. This motivated porting ICON-A, in the specific configuration needed for the research project, in a first step to the GPU architecture of the Piz Daint computer at the Swiss National Supercomputing Centre and in a second step to the JUWELS Booster computer at the Forschungszentrum Jülich. On Piz Daint, the ported code achieves a single-node GPU vs. CPU speedup factor of 6.4 and allows for global experiments at a horizontal resolution of 5 km on 1024 computing nodes with 1 GPU per node with a turnover of 48 simulated days per day. On JUWELS Booster, the more modern hardware in combination with an upgraded code base allows for simulations at the same resolution on 128 computing nodes with 4 GPUs per node and a turnover of 133 simulated days per day. Additionally, the code still remains functional on CPUs, as is demonstrated by additional experiments on the Levante compute system at the German Climate Computing Center. While the application shows good weak scaling over the tested 16-fold increase in grid size and node count, making also higher resolved global simulations possible, the strong scaling on GPUs is relatively poor, which limits the options to increase turnover with more nodes. Initial experiments demonstrate that the ICON-A model can simulate downward-propagating QBO jets, which are driven by wave–mean flow interaction.

54 ENVIRONMENTAL SCIENCES↗

Performance of Convection-Permitting and Convection-Parameterized Models in Reproducing the Extreme Precipitation Intensity Relationship with Surface Conditions

Here, this study investigates the warm-season extreme precipitation–temperature scaling relationship in CONUS404, a convection-permitting (4 km) Weather Research and Forecasting (WRF) Model simulation over the conterminous United States for the past four decades, and compares it with the WRF-Thermodynamic Global Warming (WRF-TGW) historical simulation at a coarser resolution (12 km) using parameterized convection. We also analyze the NCEP stage IV and NASA Integrated Multi-satellitE Retrievals for the Global Precipitation Measurement (IMERG) datasets as observational benchmarks. We examine how extreme precipitation intensity (EPI) varies with temperature and saturation deficit over representative regions based on hourly data. The stage IV and IMERG data show a similar pattern of EPI variation with temperature and saturation deficit, except that the EPI peak is lower in IMERG than in stage IV. Under dry and hot conditions, EPI decreases too rapidly with elevated saturation deficit in both CONUS404 and WRF-TGW compared to observations, but the performance of CONUS404 is superior to WRF-TGW. When the near-surface atmosphere is saturated or close to saturated, both CONUS404 and WRF-TGW produce higher peak values of EPI relative to the observational references; IMERG exhibits scaling rates close to the Clausius–Clapeyron (C–C) relationship, while CONUS404, WRF-TGW, and stage IV all demonstrate super-C–C scaling behaviors. Despite marked warming over the past four decades, in both CONUS404 and WRF-TGW, the scaling relationship between EPI and temperature in a saturated atmosphere remains stable and robust. This indicates a strong potential for the EPI–temperature scaling rate under saturation to be used as an emergent constraint in reducing uncertainties of future extreme precipitation projection.

Atmosphere↗

Implementation of an Orographic Drag Scheme Considering Orographic Anisotropy in All Flow Directions in the Earth System Model CAS‐ESM 2.0

Abstract A reasonable representation of orographic anisotropy in earth system models is vital for improving weather and climate modeling. In this study, we implement the orographic drag scheme, including 3‐D orographic anisotropy (3D‐AFD), into the Chinese Academy of Sciences Earth System Model version 2 (CAS‐ESM 2.0). Three groups of simulations named sensitivity run, medium‐range forecast, and seasonal forecast respectively are conducted using the updated CAS‐ESM model and validated against station observation and reanalysis data. These simulations are run using the three schemes—3D‐AFD scheme, the 3D orographic anisotropy scheme for the eight‐direction (3D‐8x), and the 2D isotropic scheme (2D)—to compare their performance in CAS‐ESM 2.0. Sensitivity runs show that the 3D‐AFD provide more continuous transition of calculated drag as function of wind direction than the 3D‐8x, while the drag calculated using the 2D scheme show no variation with change of wind direction. Enhanced drag in the medium range and seasonal forecast using the updated CAS‐ESM alleviates part of the winter wind speed bias over the Tibetan Plateau (TP) and the cold bias over TP and the Siberian polar region. It is shown that the 3D‐AFD scheme alleviates more bias than that of the 3D‐8x scheme (by wind speed reduction of 1 ∼ 2 m/s and temperature of 1 ∼ 2 K) especially in the seasonal forecast. The results suggest that reasonable representation of the orographic anisotropy is important in climate modeling.

Xie, Jinbo↗

Online evolutionary neural architecture search for multivariate non-stationary time series forecasting

Time series forecasting (TSF) is one of the most important tasks in data science. TSF models are usually pre-trained with historical data and then applied on future unseen datapoints. However, real-world time series data is usually non-stationary and models trained offline usually face problems from data drift. Models trained and designed in an offline fashion can not quickly adapt to changes quickly or be deployed in real-time. To address these issues, this work presents the Online NeuroEvolution-based Neural Architecture Search (ONE-NAS) algorithm, which is a novel neural architecture search method capable of automatically designing and dynamically training recurrent neural networks (RNNs) for online forecasting tasks. Without any pre-training, ONE-NAS utilizes populations of RNNs that are continuously updated with new network structures and weights in response to new multivariate input data. ONE-NAS is tested on real-world, large-scale multivariate wind turbine data as well as the univariate Dow Jones Industrial Average (DJIA) dataset. These results demonstrate that ONE-NAS outperforms traditional statistical time series forecasting methods, including online linear regression, fixed long short-term memory (LSTM) and gated recurrent unit (GRU) models trained online, as well as state-of-the-art, online ARIMA strategies. Additionally, results show that utilizing multiple populations of RNNs which are periodically repopulated provide significant performance improvements, allowing this online neural network architecture design and training to be successful.

97 MATHEMATICS AND COMPUTING↗

Quantifying uncertainty for deep learning based forecasting and flow-reconstruction using neural architecture search ensembles

Classical problems in computational physics such as data-driven forecasting and signal reconstruction from sparse sensors have recently seen an explosion in deep neural network (DNN) based algorithmic approaches. However, most DNN models do not provide uncertainty estimates, which are crucial for establishing the trustworthiness of these techniques in downstream decision making tasks and scenarios. In recent years, ensemble-based methods have achieved significant success for the uncertainty quantification in DNNs on a number of benchmark problems. However, their performance on real-world applications remains under-explored. In this work, we present an automated approach to DNN discovery and demonstrate how this may also be utilized for ensemble-based uncertainty quantification. Specifically, we propose the use of a scalable neural and hyperparameter architecture search for discovering an ensemble of DNN models for complex dynamical systems. We highlight how the proposed method not only discovers high-performing neural network ensembles for our tasks, but also quantifies uncertainty seamlessly. This is achieved by using genetic algorithms and Bayesian optimization for sampling the search space of neural network architectures and hyperparameters. Subsequently, a model selection approach is used to identify candidate models for an ensemble set construction. Afterwards, a variance decomposition approach is used to estimate the uncertainty of the predictions from the ensemble. We demonstrate the feasibility of this framework for two tasks — forecasting from historical data and flow reconstruction from sparse sensors for the sea-surface temperature. In conclusion, we demonstrate superior performance from the ensemble in contrast with individual high-performing models and other benchmarks.

Deep ensembles↗

A Model for Evaluating the Configuration and Dispatch of PV Plus Battery Power Plants

An open-source model was developed to optimize energy storage operation for photovoltaic- (PV-) plus-battery systems with AC-coupled and DC-coupled configurations. It includes the ability to use forecast energy prices to optimize battery charge and discharge on a rolling time horizon. The model allows for exploration of different configurations, including capital costs, inverter performance, dispatch flexibility, and capturing otherwise clipped energy for the DC-coupled system. The model can run 20 full years of hourly data in approximately two seconds, allowing comparison of a large number of configurations. We applied the model in a test case demonstrating reduced inverter clipping for DC-coupled systems and yielded slightly higher overall value than AC-coupled systems, with an approximately 2 percent increase in internal rate of return or benefit/cost ratio. Our results show that at current estimated prices for lithium-ion battery systems, large-scale PV-plus-battery plants are economically viable under the right conditions, with the configuration playing a role in system flexibility and performance. This model provides the ability for project developers, industry professionals, and researchers to use readily available software to quickly evaluate and design these systems.

41 EE - Solar Energy Technologies Office (EE-4S)↗

Enhancing Risk Analysis of Accidental Release Using CFD Modeling and Machine Learning

This project report presents the results from the AU31 project that is entitled “Enhancing Risk Analysis of Accidental Release Using CFD Modeling and Machine Learning” performed between FY2021 and FY2022. The technical objective of this project is to enhance risk analysis of accidental release of radioactive materials and provide novel risk forecasting and capabilities for assessing unplanned hazardous chemical releases for the U.S. Department of Energy (DOE). The approach includes a cross-platform finite element analysis of airborne chemical release, machine learning (ML) for simulation and forecasting, and a big data approach to data management, transformation and analysis capable of handling petabyte-scale unstructured and structured data. The outcome of these findings were assembled and accessible as a final output via an intuitive web hosted geospatial-based user interface for demonstration and general dissemination. These new results also provide a mechanism of combining this knowledge in a risk analysis framework tool. The geospatial analysis and output can utilize 5 years of qualified meteorological data to illustrate projected plume footprints that are generated from computational aspects of this study. Specifically, we show the development of a geospatial risk analysis capabilities to respond to and plan for accidental release of radioactive materials and to provide a risk forecasting tool for assessing hazardous chemical releases for the DOE. The focus of this effort is germane to common practices in risk analysis; and it is highly relevant to the timely and transparent release of information related to materials at risk including hazardous materials and chemical vapors and rapid assessment of the potential impacts on the workforce at active sites across the DOE complex.

42 ENGINEERING↗

A Scalable Real-Time Data Assimilation Framework for Predicting Turbulent Atmosphere Dynamics

AI-based foundation models like FourCastNet, GraphCast are revolutionizing weather and climate predictions but are not yet ready for operational use. Their limitation lies in the absence of a data assimilation system to incorporate real-time Earth system observations, crucial for accurately forecasting events like tropical cyclones. To overcome these obstacles, we introduce a generic real-time data assimilation framework and demonstrate its end-to-end performance on the Frontier supercomputer. This framework comprises two primary modules: an ensemble score filter (EnSF), which significantly outperforms the state-of-the-art data assimilation method, and a vision transformer-based surrogate capable of real-time adaptation through the integration of observational data. We demonstrate both the strong and weak scaling of our framework up to 1024 GPUs on the Exascale supercomputer, Frontier. Our results not only illustrate the framework's exceptional scalability on high-performance computing systems, but also demonstrate the importance of supercomputers in real-time data assimilation for weather and climate predictions.

Lu, Dan↗