Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Forecasting techniques”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Collaborative Distribution System Restoration Planning and Real-Time Dispatch Considering Behind-the-Meter DERs

Modern distribution systems are becoming more resilient against power outages thanks to the flexible generation capacity provided by the increasing integration of distributed energy resources (DERs). Compared to utility-scale DERs, which can be directly controlled by system operators, small-scale, behind-the-meter DERs are much more difficult to coordinate despite being the vast majority. Two major obstacles to the implementation of DERs for service restoration are the coordination of behind-the-meter DERs and the management of uncertainty. In this paper, a novel distribution system restoration strategy is proposed to overcome these two obstacles. The flexibility of be-hind-the-meter DERs is quantified and integrated into the restoration planning models within a hierarchical structure. The model predictive control technique is employed to enable adaptive restoration planning solution adjustments to accommodate fault scenarios and forecast errors. Besides, real-time power dispatch models are proposed to maintain power balance using available DER capability. Comprehensive integration of adaptive restoration planning schemes and real-time dispatch results are achieved through a collaborative restoration framework. Finally, the effectiveness of the proposed restoration strategy is verified through a modified IEEE 123-bus system and a real-world utility system.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Short-term load demand forecasting through rich features based on recurrent neural networks

With the emerging penetration of renewables and dynamic loads, the understanding of grid edge loading conditions becomes increasingly substantial. Load modelling researches commonly consist of explicitly expressed load models and non-explicitly expressed techniques, of which artificial intelligence approaches turn out to be the major path. This paper reveals the artificial intelligence-based load modelling technique to enhance the knowledge of current and future load information considering geographical and weather dependencies. This paper presents a recurrent neural network based sequence to sequence (Seq2Seq) model to forecast the short-term power loads. Also, a feature attention mechanism, which is along channel and time directions, is developed to improve the efficiency of feature learning. The experiments over three publicly available datasets demonstrate the accuracy and effectiveness of the proposed model.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2022

Analysis of Integrated Vapor Transport Biases

Abstract High-fidelity analyses and forecasts of integrated vapor transport (VT) are central to the study of Earth’s hydrological cycle as well as high-impact phenomena such as monsoons and atmospheric rivers. The impact of the in-line analysis correction-based additive inflation (ACAI) on IVT biases and forecast errors is examined within the Navy Earth System Prediction Capability (Navy ESPC) global coupled system. The ACAI technique uses atmospheric analysis corrections from the data assimilation system to approximate model bias and as a representation of stochastic model error to simultaneously reduce systematic and random errors and improve ensemble performance. ACAI reduces the global average magnitude of the 7- and 14-day IVT bias by 16%–17% during Northern Hemisphere summer, reaching 70% reductions in some tropical regions. The global average IVT bias reduction is similar to the bias reduction for low-level wind speed bias and considerably smaller than the bias reduction in total precipitable water. The localized regions where ACAI increases IVT bias occur where the control IVT biases change sign and structure with increasing forecast lead time, such as the South Asian monsoon region. Substituting analyzed wind or moisture fields for the forecast fields when calculating the forecast IVT confirms that, on average, wind errors dominate the IVT error calculation in the tropics, although wind and moisture error contributions are comparable in the extratropics. The existence of regions where using either analyzed winds or analyzed moisture increases IVT bias or mean absolute error reveals areas with compensating errors.

Reynolds, Carolyn A.↗
DOE OSTI2022

Toward Forecasting Geomagnetic Storms

We present a selection of attempts to infer geomagnetic storm properties from time series data. Initially, we unsuccessfully attempt to predict the duration of a geomagnetic storm based on data preceding the onset of a geomagnetic storm. Similar techniques are also used to attempt to predict the maximum depth of a geomagnetic storm. Additionally, we present a case study in Gaussian Process regression, where we are able to accurately interpolate between geomagnetic storm parameters, but are unable to predict future storm behavior. Lastly, we describe attempts at using random forest regression with sliding windows to infer geomagnetic storm behavior at future times. These results did not provide robust forecasts of geomagnetic storm behavior, but did occasionally correctly predict a storm within the margin of error. Techniques presented in this paper include machine learning classification and regression, Gaussian Process regression, and machine learning regression with sliding windows. Many of the attempts presented in this document did not result in meaningful predictions of geomagnetic storm behavior. We hope this document can be used as a guide for future readers attempting to predict geomagnetic storm properties.

58 GEOSCIENCES↗
DOE OSTI2025

Attention-based functional-group coarse-graining: a deep learning framework for molecular prediction and design

Machine learning (ML) offers considerable promise for the design of new molecules and materials. In real-world applications, the design problem is often domain-specific, and suffers from insufficient data, particularly labeled data, for ML training. In this study, we report a data-efficient, deep-learning framework for molecular discovery that integrates a coarse-grained functional-group representation with a self-attention mechanism to capture intricate chemical interactions. Our approach exploits group-contribution concepts to create a graph-based intermediate representation of molecules, serving as a low-dimensional embedding that substantially reduces the data demands typically required for training. Using a self-attention mechanism to learn the subtle but highly relevant chemical context of functional groups, the method proposed here consistently outperforms existing approaches for predictions of multiple thermophysical properties. In a case study focused on adhesive polymer monomers, we train on a limited dataset comprising only 6,000 unlabeled and 600 labeled monomers. The resulting chemistry prediction model achieves over 92% accuracy in forecasting properties directly from SMILES strings, exceeding the performance of current state-of-the-art techniques. Furthermore, the latent molecular embedding is invertible, enabling the design pipeline to automatically generate new monomers from the learned chemical subspace. We illustrate this functionality by targeting several properties, including high and low glass transition temperatures (Tg), and demonstrate that our model can identify new candidates with values that surpass those in the training set. The ease with which the proposed framework navigates both chemical diversity and data scarcity offers a promising route to accelerate and broaden the search for functional materials.

Han, Ming [Univ. of Chicago, IL (United States)]↗
DOE OSTI2024

xesn: Echo state networks powered by Xarray and Dask

Xesn is a Python package that allows scientists to easily design Echo State Networks (ESNs) for forecasting problems. ESNs are a Recurrent Neural Network architecture introduced by Jaeger (2001) that are part of a class of techniques termed Reservoir Computing. One defining characteristic of these techniques is that all internal weights are determined by a handful of global, scalar parameters, thereby avoiding problems during backpropagation and reducing training time significantly. Because this architecture is conceptually simple, many scientists implement ESNs from scratch, leading to questions about computational performance. Xesn offers a straightforward, standard implementation of ESNs that operates efficiently on CPU and GPU hardware. The package leverages optimization tools to automate the parameter selection process, so that scientists can reduce the time finding a good architecture and focus on using ESNs for their domain application. Importantly, the package flexibly handles forecasting tasks for out-of-core, multi-dimensional datasets, eliminating the need to write parallel programming code. Xesn was initially developed to handle the problem of forecasting weather dynamics, and so it integrates naturally with Python packages that have become familiar to weather and climate scientists such as Xarray (Hoyer & Hamman, 2017). However, the software is ultimately general enough to be utilized in other domains where ESNs have been useful, such as in signal processing (Jaeger & Haas, 2004).

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

AI/ML-Enhanced Wind Forecasts for Reducing Uncertainty in Prescribed Fire Planning

Prescribed fire is a vital tool for ecosystem management and wildfire risk reduction but its escalation is constrained by overly conservative burn windows because of uncertainties, for instance, in wind forecasts. This review describes the state of the art in weather product use by fire/smoke models and identifies three priority research gaps that artificial intelligence/machine learning (AI/ML) is well positioned to address: (1) spatial and temporal downscaling to meter-scale, sub-hourly wind fields; (2) bias correction for systematic model errors in complex terrain; and (3) robust uncertainty quantification to inform ensemble-based simulations. Emerging AI/ML techniques offer promising frameworks to address all three challenges. By providing high-resolution, bias-corrected, and probabilistic wind fields, AI/ML-enhanced forecasts will allow for expanded burn windows, improved ignition strategy design and a reduced reliance on expert intuition, especially when a prescribed fire is introduced into new areas.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Accurate and Rapid Forecasts for Geologic Carbon Storage via Learning-Based Inversion-Free Prediction

Carbon capture and storage (CCS) is one approach being studied by the U.S. Department of Energy to help mitigate global warming. The process involves capturing CO 2 emissions from industrial sources and permanently storing them in deep geologic formations (storage reservoirs). However, CCS projects generally target “green field sites,” where there is often little characterization data and therefore large uncertainty about the petrophysical properties and other geologic attributes of the storage reservoir. Consequently, ensemble-based approaches are often used to forecast multiple realizations prior to CO 2 injection to visualize a range of potential outcomes. In addition, monitoring data during injection operations are used to update the pre-injection forecasts and thereby improve agreement between forecasted and observed behavior. Thus, a system for generating accurate, timely forecasts of pressure buildup and CO 2 movement and distribution within the storage reservoir and for updating those forecasts via monitoring measurements becomes crucial. This study proposes a learning-based prediction method that can accurately and rapidly forecast spatial distribution of CO 2 concentration and pressure with uncertainty quantification without relying on traditional inverse modeling. The machine learning techniques include dimension reduction, multivariate data analysis, and Bayesian learning. The outcome is expected to provide CO 2 storage site operators with an effective tool for timely and informative decision making based on limited simulation and monitoring data.

58 GEOSCIENCES↗
DOE OSTI2021

Enhancing Distribution Grid Resilience Through Model Predictive Controller Enabled Prioritized Load Restoration Strategy

Effective resilience improvement strategies enable the power grid to cope with disruptive extreme events. Most power grid outages are caused by disruptions in distribution grids. Motivated by the urgent need for power system resilience research, this paper proposes a priority-weighted optimal load restoration technique to enhance the resilience of distribution grids against extreme events. The proposed technique is based on smart distribution technology and framed as sequential multi-step decision process (MDP) and mixed integer linear program (MILP). It is formulated as optimal control problem with a model predictive control (MPC) approach. We applied the devised MILP-MPC-based load restoration technique to a simplified single-bus version of the IEEE 13-bus distribution system with integrated distributed energy resources (DERs) such as wind turbine, photovoitaic array, microturbine, and energy storage device. The technique executes a reducing and rolling horizon optimization in each control step in real-time using the forecasted information of the renewables, the fuel status of the microturbine and the state of charge of the energy storage device. We consider an extreme event which triggered outage of the upstream utility grid and caused islanded operation of the distribution grid. We demonstrated the effectiveness of the proposed MPC approach in restoring the distribution grid loads based on their priority during the main grid outage-caused islanded operation.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2020

PyDA: A Hands-On Introduction to Dynamical Data Assimilation with Python

Dynamic data assimilation offers a suite of algorithms that merge measurement data with numerical simulations to predict accurate state trajectories. Meteorological centers rely heavily on data assimilation to achieve trustworthy weather forecast. With the advance in measurement systems, as well as the reduction in sensor prices, data assimilation (DA) techniques are applicable to various fields, other than meteorology. However, beginners usually face hardships digesting the core ideas from the available sophisticated resources requiring a steep learning curve. In this tutorial, we lay out the mathematical principles behind DA with easy-to-follow Python module implementations so that this group of newcomers can quickly feel the essence of DA algorithms. We explore a series of common variational, and sequential techniques, and highlight major differences and potential extensions. We demonstrate the presented approaches using an array of fluid flow applications with varying levels of complexity.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Enhancing Distribution Grid Resilience Through Model Predictive Controller Enabled Prioritized Load Restoration Strategy: Preprint

Effective resilience improvement strategies enable the power grid to cope with disruptive extreme events. Most power grid outages are caused by disruptions in distribution grids. Motivated by the urgent need for power system resilience research, this paper proposes a priority-weighted optimal load restoration technique to enhance the resilience of distribution grids against extreme events. The proposed technique is based on smart distribution technology and framed as sequential multi-step decision process (MDP) and mixed integer linear program (MILP). It is formulated as optimal control problem with a model predictive control (MPC) approach. We applied the devised MILP-MPC-based load restoration technique to a simplified single-bus version of the IEEE 13-bus distribution system with integrated distributed energy resources (DERs) such as wind turbine, photovoltaic array, microturbine, and energy storage device. The technique executes a reducing and rolling horizon optimization in each control step in real-time using the forecasted information of the renewables, the fuel status of the microturbine and the state of charge of the energy storage device. We consider an extreme event which triggered outage of the upstream utility grid and caused islanded operation of the distribution grid. We demonstrated the effectiveness of the proposed MPC approach in restoring the distribution grid loads based on their priority during the main grid outage-caused islanded operation.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2021

Enhancing Distribution Grid Resilience Through Model Predictive Controller Enabled Prioritized Load Restoration Strategy

Effective resilience improvement strategies enable the power grid to cope with disruptive extreme events. Most power grid outages are caused by disruptions in distribution grids. Motivated by the urgent need for power system resilience research, this paper proposes a priority-weighted optimal load restoration technique to enhance the resilience of distribution grids against extreme events. The proposed technique is based on smart distribution technology and framed as sequential multi-step decision process (MDP) and mixed integer linear program (MILP). It is formulated as optimal control problem with a model predictive control (MPC) approach. We applied the devised MILP-MPC-based load restoration technique to a simplified single-bus version of the IEEE 13-bus distribution system with integrated distributed energy resources (DERs) such as wind turbine, photovoltaic array, microturbine, and energy storage device. The technique executes a reducing and rolling horizon optimization in each control step in real-time using the forecasted information of the renewables, the fuel status of the microturbine and the state of charge of the energy storage device. We consider an extreme event which triggered outage of the upstream utility grid and caused islanded operation of the distribution grid. We demonstrated the effectiveness of the proposed MPC approach in restoring the distribution grid loads based on their priority during the main grid outage-caused islanded operation.

61 RADIATION PROTECTION AND DOSIMETRY↗
DOE OSTI2022

Accurate and Timely Forecasts of Geologic Carbon Storage using Machine Learning Methods

Carbon capture and storage is one strategy to reduce greenhouse gas emissions. One approach to storing the captured CO2 is to inject it into deep saline aquifers. However, dynamics of the injected CO2 plume is uncertain and the potential for leakage back to the atmosphere must be assessed. Thus, accurate and timely forecasts of CO2 storage via real-time measurements integration becomes very crucial. This study proposes a learning-based, inverse-free prediction method that can accurately and rapidly forecast CO2 movement and distribution with uncertainty quantification based on limited simulation and observation data. The machine learning techniques include dimension reduction, multivariate data analysis, and Bayesian learning. The outcome is expected to provide CO2 storage site operators with an effective tool for real-time decision making.

Lu, Dan↗
DOE OSTI2022

Projected U.S. drought extremes through the twenty-first century with vapor pressure deficit

Global warming is expected to enhance drought extremes in the United States throughout the twenty-first century. Projecting these changes can be complex in regions with large variability in atmospheric and soil moisture on small spatial scales. Vapor Pressure Deficit (VPD) is a valuable measure of evaporative demand as moisture moves from the surface into the atmosphere and a dynamic measure of drought. Here, VPD is used to identify short-term drought with the Standardized VPD Drought Index (SVDI); and used to characterize future extreme droughts using grid dependent stationary and non-stationary generalized extreme value (GEV) models, and a random sampling technique is developed to quantify multimodel uncertainties. The GEV analysis was performed with projections using the Weather Research and Forecasting model, downscaled from three Global Climate Models based on the Representative Concentration Pathway 8.5 for present, mid-century and late-century. Results show the VPD based index (SVDI) accurately identifies the timing and magnitude short-term droughts, and extreme VPD is increasing across the United States and by the end of the twenty-first century. The number of days VPD is above 9 kPa increases by 10 days along California’s coastline, 30–40 days in the northwest and Midwest, and 100 days in California’s Central Valley.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

A composite likelihood approach for inference under photometric redshift uncertainty

ABSTRACT Obtaining accurately calibrated redshift distributions of photometric samples is one of the great challenges in photometric surveys like LSST, Euclid, HSC, KiDS, and DES. We present an inference methodology that combines the redshift information from the galaxy photometry with constraints from two-point functions, utilizing cross-correlations with spatially overlapping spectroscopic samples, and illustrate the approach on CosmoDC2 simulations. Our likelihood framework is designed to integrate directly into a typical large-scale structure and weak lensing analysis based on two-point functions. We discuss efficient and accurate inference techniques that allow us to scale the method to the large samples of galaxies to be expected in LSST. We consider statistical challenges like the parametrization of redshift systematics, discuss and evaluate techniques to regularize the sample redshift distributions, and investigate techniques that can help to detect and calibrate sources of systematic error using posterior predictive checks. We evaluate and forecast photometric redshift performance using data from the CosmoDC2 simulations, within which we mimic a DESI-like spectroscopic calibration sample for cross-correlations. Using a combination of spatial cross-correlations and photometry, we show that we can provide calibration of the mean of the sample redshift distribution to an accuracy of at least 0.002(1 + z), consistent with the LSST-Y1 science requirements for weak lensing and large-scale structure probes.

(cosmology:) large-scale structure of Universe↗
DOE OSTI2025

Machine learning-driven predictive resource management in complex science workflows

Here, the collaborative efforts of large communities in science experiments, often comprising thousands of global members, reflect a monumental commitment to exploration and discovery. Recently, advanced and complex data processing has gained increasing importance in science experiments. Data processing workflows typically consist of multiple intricate steps, and the precise specification of resource requirements is crucial for each step to allocate optimal resources for effective processing. Estimating resource requirements in advance is challenging due to a wide range of analysis scenarios, varying skill levels among community members, and the continuously increasing spectrum of computing options. One practical approach to mitigate these challenges involves initially processing a subset of each step to measure precise resource utilization from actual processing profiles before completing the entire step. While this two-staged approach enables processing on optimal resources for most of the workflow, it has drawbacks such as initial inaccuracies leading to potential failures and suboptimal resource usage, along with overhead from waiting for initial processing completion, which is critical for fast-turnaround analyses. In this context, our study introduces a novel pipeline of machine learning models within a comprehensive workflow management system, the Production and Distributed Analysis (PanDA) system. These models employ advanced machine learning techniques to predict key resource requirements, overcoming challenges posed by limited upfront knowledge of characteristics at each step. Accurate forecasts of resource requirements enable informed and proactive decision-making in workflow management, enhancing the efficiency of handling diverse, complex workflows across heterogeneous resources.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Forecasting Dark Matter Subhalo Constraints from Stellar Streams using Implicit Likelihood Inference

The evidence for dark matter (DM) remains compelling, although attempts to understand its particle nature remain inconclusive. One promising method to study DM is detecting DM subhalos through their gravitational interactions with stellar streams. In this study, we apply Neural Posterior Estimation (NPE) to constrain subhalo interaction parameters, including mass, scale radius, velocity, and encounter geometry, from stellar stream kinematics. We generate particle spray simulations based on the Lagrange Cloud stripping technique, focusing on the ATLAS-Aliqa Uma stream as a test case. We train multiple NPE models across multiple observational scenarios, quantifying how kinematic completeness affects inference and forecasting constraints from upcoming surveys including LSST, 4MOST, and 10-year Gaia data. Our results demonstrate that NPE can produce accurate and well-calibrated posteriors. In the idealized case with full 6D coordinates, we achieve subhalo mass uncertainties of 15-20% for a $10^7 \, \mathrm{M_\odot}$ subhalo, with 5D coordinates (excluding radial velocities) achieving similar performance. Under realistic observational conditions, mass uncertainties range from 50% (present-day) to 20-40% (future scenarios), with comparable performance between the photometric-only LSST sample and a smaller sample that includes Gaia proper motions and 4MOST radial velocities. Most notably, we find that velocity bimodality emerges when phase space is poorly sampled, whether due to missing kinematic information or limited stellar tracers. Combining large photometric samples with targeted spectroscopic follow-up can effectively resolves this degeneracy. These results demonstrate the power of implicit likelihood inference for optimizing stellar stream observational strategies and forecasting DM subhalo constraints from upcoming surveys.

Nguyen, Tri [Northwestern U. (main); SkAI, Chicago↗
DOE OSTI2021

A Spatiotemporal Sequence Forecasting Platform to Advance the Prediction of Changing Spatiotemporal Patterns of CO 2 Concentration by Incorporating Human Activity and Hydrological Extremes

Focal Areas (2): Predictive modeling using AI techniques and AI-derived model components. It describes the use of AI and other tools to design a prediction system comprising a hierarchy of models. Specifically, this white paper focuses on the development of a collaborative deep learning platform for evaluating and predicting spatiotemporal relationships between the hydrological and carbon cycles and includes capabilities for considering biogenic and anthropogenic inputs to these systems.

54 ENVIRONMENTAL SCIENCES↗