Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “performance forecasting”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

Machine learning models inaccurately predict current and future high-latitude C balances

The high-latitude carbon (C) cycle is a key feedback to the global climate system, yet because of system complexity and data limitations, there is currently disagreement over whether the region is a source or sink of C. Recent advances in big data analytics and computing power have popularized the use of machine learning (ML) algorithms to upscale site measurements of ecosystem processes, and in some cases forecast the response of these processes to climate change. Due to data limitations, however, ML model predictions of these processes are almost never validated with independent datasets. To better understand and characterize the limitations of these methods, we develop an approach to independently evaluate ML upscaling and forecasting. We mimic data-driven upscaling and forecasting efforts by applying ML algorithms to different subsets of regional process-model simulation gridcells, and then test ML performance using the remaining gridcells. In this study, we simulate C fluxes and environmental data across Alaska using ecosys, a process-rich terrestrial ecosystem model, and then apply boosted regression tree ML algorithms to training data configurations that mirror and expand upon existing AmeriFLUX eddy-covariance data availability. We first show that a ML model trained using ecosys outputs from currently-available Alaska AmeriFLUX sites incorrectly predicts that Alaska is presently a modeled net C source. Increased spatial coverage of the training dataset improves ML predictions, halving the bias when 240 modeled sites are used instead of 15. However, even this more accurate ML model incorrectly predicts Alaska C fluxes under 21st century climate change because of changes in atmospheric CO 2 , litter inputs, and vegetation composition that have impacts on C fluxes which cannot be inferred from the training data. Our results provide key insights to future C flux upscaling efforts and expose the potential for inaccurate ML upscaling and forecasting of high-latitude C cycle dynamics.

54 ENVIRONMENTAL SCIENCES↗

Temporal Convolutional Network Using Empirical Mode Decomposition to Detect Faults in Grid Connected Systems

Grid-connected power electronic systems require timely and reliable fault detection to prevent equipment damage and reduce downtime. This paper presents a forecasting-based anomaly detection pipeline that decomposes voltage and current measurements into intrinsic mode functions (IMFs) using empirical mode decomposition (EMD), then trains a causal temporal convolutional network (TCN) on normal-operation IMF data to predict short-horizon future dynamics. Deviations between forecasts and observations are summarized as reliability-weighted residual scores and thresholded per sensor using robust statistics with temporal persistence constraints to suppress false positives. To reduce runtime, EMD is performed on downsampled signals for detection, while raw-rate EMD is applied only within a short region of interest for high-frequency interpretability near detected events. Results on a simulated grid-connected converter system demonstrate that IMF-domain forecasting improves anomaly separability relative to raw-signal forecasting and provides interpretable evidence of faults across decomposition channels.

Sutton, Elizabeth [ORNL] (ORCID:0009000078885935)↗

Does Bayesian model averaging improve polynomial extrapolations? Two toy problems as tests

We assess the accuracy of Bayesian polynomial extrapolations from small parameter values, x, to large values of x. We consider a set of polynomials of fixed order, intended as a proxy for a fixed-order effective field theory (EFT) description of data. We employ Bayesian model averaging (BMA) to combine results from different order polynomials (EFT orders). Our study considers two 'toy problems' where the underlying function used to generate data sets is known. We use Bayesian parameter estimation to extract the polynomial coefficients that describe these data at low x. A 'naturalness' prior is imposed on the coefficients, so that they are $\mathcal{O}(1)$. We BMA different polynomial degrees by weighting each according to its Bayesian evidence and compare the predictive performance of this BMA with that of the individual polynomials. In conclusion, the credibility intervals on the BMA forecast have the stated coverage properties more consistently than does the highest evidence polynomial, though BMA does not necessarily outperform every polynomial.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Meta-uncertainty for particle image velocimetry

Uncertainty quantification for Particle Image Velocimetry (PIV) is critical for comparing experimentally measured flow fields with Computational Fluid Dynamics (CFD) results, and model design and validation. However, PIV features a complex measurement chain with coupled, non-linear error sources, and quantifying the uncertainty is challenging. Multiple assessments show that none of the current methods can reliably measure the actual uncertainty across a wide range of experiments, and estimates can vary. Because the current methods differ in assumptions regarding the measurement process and calculation procedures, it is not clear which method is best to use for an experiment where the error distribution is unknown. To address this issue, we propose a method to estimate an uncertainty method's sensitivity and reliability, termed the Meta-Uncertainty. The novel approach is automated, local, and instantaneous, and based on perturbation of the recorded particle images. We developed an image perturbation scheme based on adding random unmatched particles to the interrogation window pair considering the signal-to-noise (SNR) of the correlation plane. Each uncertainty scheme's response to several trials of random particle addition is used to estimate a reliability metric, defined as the rate of change of the inter-quartile range (IQR) of the uncertainties with increasing levels of particle addition. We also propose applying the meta-uncertainty as a weighting metric to combine uncertainty estimates from individual schemes, based on ideas from the consensus forecasting literature. We use planar and stereo PIV measurements across a range of canonical flows to assess the performance of the uncertainty schemes. Further, a novel method is introduced to assess an uncertainty scheme's performance based on a quantile comparison of the error and uncertainty distributions, generalizing the current method of comparing the RMS of the two distributions. Here, the results show that the combined uncertainty method outperforms the individual methods, and this work establishes the meta-uncertainty as a useful reliability assessment tool for PIV uncertainty quantification.

47 OTHER INSTRUMENTATION↗

Simons Observatory: Constraining inflationary gravitational waves with multitracer B-mode delensing

We introduce and validate a delensing framework for the Simons Observatory (SO), which will be used to improve constraints on inflationary gravitational waves by reducing the lensing noise in measurements of the B modes in CMB polarization. SO will initially observe CMB by using three small aperture telescopes and one large-aperture telescope. While polarization maps from small-aperture telescopes will be used to constrain inflationary gravitational waves, the internal CMB lensing maps used to delens will be reconstructed from data from the large-aperture telescope. Since lensing maps obtained from the SO data will be noise dominated on subdegree scales, the SO lensing framework constructs a template for lensing-induced B modes by combining internal CMB lensing maps with maps of the cosmic infrared background from Planck as well as galaxy density maps from the LSST survey. We construct a likelihood for constraining the tensor-to-scalar ratio r that contains auto and cross spectra between observed B modes and the lensing B-mode template. We test our delensing analysis pipeline on map-based simulations containing survey nonidealities, but that, for this initial exploration, does not include contamination from Galactic and extragalactic foregrounds. We find that the SO survey masking and inhomogeneous and atmospheric noise have very little impact on the delensing performance, and the r constraint becomes σ(r)≈0.0015 which is close to that obtained from the idealized forecasts in the absence of the Galactic foreground and is nearly a factor of 2 tighter than without delensing. We also find that uncertainties in the external large-scale structure tracers used in our multitracer delensing pipeline lead to bias much smaller than the 1σ statistical uncertainties.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Multi-Fidelity Stochastic Economic Dispatch for Operating Low Carbon Power Grids

Grid operators can address the inherently stochastic nature of renewables by solving a two-stage stochastic programming model that minimizes the cost of dispatch decisions while accounting for the complex grid dynamics. It is common to use a sample average approximation to estimate the expectation of the second stage costs in this model. However, the large sample count needed for numerical accuracy makes effective modeling large-scale electric grids computationally intractable. We introduce a control variate multi-fidelity estimator for the second-stage recourse that enables high quality dispatch decisions in real-time with a reduced computational burden. We obtain a hierarchy of model fidelities by linearizing the AC power flow system representation to DC power flow, and by relaxing transmission and voltage network constraints. We evaluate the performance of our proposed method on a synthetic grid with 73 buses against a deterministic baseline with persistence forecast and a high-fidelity reference. Our analysis shows a computational speed-up of 7.62x with a minimal loss in accuracy. The multi-fidelity method is well suited to fidelity combinations that use a simplified network topology in their lower fidelity model and is an attractive option for applications where accurate grid modeling needed on a limited computational budget.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Scientific challenges to characterizing the wind resource in the marine atmospheric boundary layer

Abstract. With the increasing level of offshore wind energy investment, it is correspondingly important to be able to accurately characterize the wind resource in terms of energy potential as well as operating conditions affecting wind plant performance, maintenance, and lifespan. Accurate resource assessment at a particular site supports investment decisions. Following construction, accurate wind forecasts are needed to support efficient power markets and integration of wind power with the electrical grid. To optimize the design of wind turbines, it is necessary to accurately describe the environmental characteristics, such as precipitation and waves, that erode turbine surfaces and generate structural loads as a complicated response to the combined impact of shear, atmospheric turbulence, and wave stresses. Despite recent considerable progress both in improvements to numerical weather prediction models and in coupling these models to turbulent flows within wind plants, major challenges remain, especially in the offshore environment. Accurately simulating the interactions among winds, waves, wakes, and their structural interactions with offshore wind turbines requires accounting for spatial (and associated temporal) scales from O(1 m) to O(100 km). Computing capabilities for the foreseeable future will not be able to resolve all of these scales simultaneously, necessitating continuing improvement in subgrid-scale parameterizations within highly nonlinear models. In addition, observations to constrain and validate these models, especially in the rotor-swept area of turbines over the ocean, remains largely absent. Thus, gaining sufficient understanding of the physics of atmospheric flow within and around wind plants remains one of the grand challenges of wind energy, particularly in the offshore environment. This paper provides a review of prominent scientific challenges to characterizing the offshore wind resource using as examples phenomena that occur in the rapidly developing wind energy areas off the United States. Such phenomena include horizontal temperature gradients that lead to strong vertical stratification; consequent features such as low-level jets and internal boundary layers; highly nonstationary conditions, which occur with both extratropical storms (e.g., nor'easters) and tropical storms; air–sea interaction, including deformation of conventional wind profiles by the wave boundary layer; and precipitation with its contributions to leading-edge erosion of wind turbine blades. The paper also describes the current state of modeling and observations in the marine atmospheric boundary layer and provides specific recommendations for filling key current knowledge gaps.

17 WIND ENERGY↗

How Generalizable is a Machine-Learning Approach for Modeling Hub-Height Turbulence Intensity?

Hub-height turbulence intensity is essential for a variety of wind energy applications. However, simulating it is a challenging task. Simple analytical models have been proposed in the literature, but they all come with significant limitations. Even state-of-the-art numerical weather prediction models, such as the Weather Research and Forecasting model, currently struggle to predict hub-height turbulence intensity. Here, we propose a machine-learning-based approach to predict hub-height turbulence intensity from other hub-height and ground-level atmospheric measurements, using observations from the Perdigao field campaign and the Southern Great Plains atmospheric observatory. We consider a random forest regression model, which we validate first at the site used for training and then under a more robust round-robin approach, and compare its performance to a multivariate linear regression. The random forest successfully outperforms the linear regression in modeling hub-height turbulence intensity, with a normalized root-mean-square error as low as 0.014 when using 30-minute average data. In order to achieve such low root-mean-square error values, the knowledge of hub-height turbulence kinetic energy (which can instead be modeled in the Weather Research and Forecasting model) is needed. Interestingly, we find that the performance of the random forest generalizes well when considering a round-robin validation (i.e., when the algorithm is trained at one site such as Perdigao or Southern Great Plains) and then applied to model hub-height turbulence intensity at the other location.

17 WIND ENERGY↗

Optimizing resource allocation in Miscanthus breeding via sparse testing designs for genomic prediction

Phenotyping high-biomass perennial crops is laborious and the rate of genetic gain in conventional perennial crop breeding programs is typically low. So, it is especially important to identify methods that produce efficiency gains in the breeding process. Miscanthus is a C4 perennial grass with favorable characteristics for producing biomass as a feedstock for biofuels and diverse bio-based products. Increasing biomass yield will increase profitability and environmental benefits, so it is a key target for Miscanthus breeding. In addition, the identification of well-adapted genotypes across a wide range of environmental conditions requires the establishment of multi-environment trials (METs). Sparse testing is a genomic prediction-based strategy that reduces the phenotyping costs in METs by selecting a subset of genotypes to evaluate in a subset of environments and then predicts the performance of the unobserved genotype-environment combinations. A Miscanthus sacchariflorus (MSA) population comprising 336 genotypes observed across three environments was analyzed implementing sparse testing designs. Three prediction models considering main effects (environments, genotypes, genomic) and interaction effects (genotype-by-environment; G×E interaction) were implemented for forecasting dry biomass yield (YDY), total culm (TCM), average internode length (AIL), and culm node number (CNN). Multiple calibration sets based on different compositions and sizes were considered to evaluate performance in terms of the predictive ability (PA) and the mean square error (MSE) for a fixed testing set size. The training set size ranged from 52 to 112 to predict a fixed set of 224 unobserved genotypes across all three environments. The results showed that the model accounting for G×E interaction consistently presented the highest PA and the lowest MSE: for CNN (PA: ~0.77, MSE: ~0.5) and YDY (PA: ~0.70, MSE: ~1.3) while for TCM and AIL these ranged from ~0.28 to 0.41 and ~1.3 to 4.3, respectively. Overall, varying training sets and allocation strategies did not affect PA and MSE, with 52 non-overlapping and 0 overlapping genotypes per environment as the optimal cost-effective allocation framework. This suggests that implementing sparse testing designs could significantly reduce phenotyping costs by fivefold, without compromising PA in breeding programs for perennial crops such as Miscanthus.

Miscanthus sacchariflorus (MSA)↗

Recommended vs. Actual Escalation Rates For ESPCs: Is the Guidance Good?

Escalation rates applied to the savings from energy savings performance contracts (ESPCs) and related financed energy projects play a large role in their scope and costs. The U.S. Department of Energy’sFederal Energy Management Program (FEMP) employs the National Institute of Standards and Technology (NIST) to package projections of real (uninflated) energy prices and general inflation forecasts developed by two other federal government entities. The main output from this exercise is NIST’s Energy Escalation Rate Calculator (EERC), which is strongly recommended by FEMP for use in performance contracts and relied on by federal agencies and others conducting performance contracts as an objective source for their projects’ escalation rates. This study investigated whether the rates prescribed by EERC (and a coarser NIST tool that preceded it) have provided users with estimates that approximate actual changes in energy prices over the years. The results are encouraging: the NIST tools slightly under-estimated actual electricity prices and somewhat over-estimated those for natural gas. Concern regarding the latter is mitigated, however, because a) it is seen as due primarily to the increasing surplus of natural gas from the “fracking revolution” in the 2010s, and b) natural gas savings were found to account for only 14.4% of the total savings from the largest population of federal ESPCs (FEMP’s indefinite quantity ESPC contract, representing roughly 430 projects), compared to almost four times that (56.8%) for electricity savings. Consequently, reliance on EERC appears to be a sound policy.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Observations of Offshore Low‐Level Jets Off the U.S. East Coast Reveal Systematic Biases in ERA5 and HRRR

Low-level jets (LLJs)—wind speed maxima typically occurring a few hundred meters above the surface—are common off the U.S. East Coast and influence many atmospheric processes with societal importance, including cloud formation, aviation safety, and search-and-rescue. However, their vertical structure and frequency remain poorly quantified due to limited offshore observations. This study presents new scanning Doppler LiDAR and infrared spectroradiometer data from the 2024 summer deployment of an offshore barge during the Wind Forecast Improvement Project 3. These coupled wind and temperature profiles provide unprecedented resolution to assess LLJ behavior and model performance. LLJs occurred in over 21% of observed profiles, with a weak diurnal preference for nighttime and early morning hours and maximum winds typically near 300 m. Both ERA5 and High-Resolution Rapid Refresh analysis underestimate jet wind speeds and misrepresent the boundary layer thermal structure. These results highlight persistent model biases and the critical need for high-resolution offshore observations.

17 WIND ENERGY↗

Reconfigurable training and reservoir computing in an artificial spin-vortex ice via spin-wave fingerprinting

Strongly interacting artificial spin systems are moving beyond mimicking naturally occurring materials to emerge as versatile functional platforms, from reconfigurable magnonics to neuromorphic computing. Typically, artificial spin systems comprise nanomagnets with a single magnetization texture: collinear macrospins or chiral vortices. Here, by tuning nanoarray dimensions we have achieved macrospin–vortex bistability and demonstrated a four-state metamaterial spin system, the ‘artificial spin-vortex ice’ (ASVI). ASVI can host Ising-like macrospins with strong ice-like vertex interactions and weakly coupled vortices with low stray dipolar field. Vortices and macrospins exhibit starkly differing spin-wave spectra with analogue mode amplitude control and mode frequency shifts of Δf = 3.8 GHz. The enhanced bitextural microstate space gives rise to emergent physical memory phenomena, with ratchet-like vortex injection and history-dependent non-linear fading memory when driven through global magnetic field cycles. We employed spin-wave microstate fingerprinting for rapid, scalable readout of vortex and macrospin populations, and leveraged this for spin-wave reservoir computation. ASVI performs non-linear mapping transformations of diverse input and target signals in addition to chaotic time-series forecasting.

97 MATHEMATICS AND COMPUTING↗

Graph-Based Prediction of Spatio-Temporal Vaccine Hesitancy From Insurance Claims Data

Growing vaccine hesitancy is contributing to the decline in immunization rates for highly contagious, vaccine-preventable childhood diseases. Therefore, there has been a significant interest in understanding how hesitancy is spreading at higher spatio-temporal resolutions, enabling more targeted interventions. Motivated by this, we study the problem of prediction of vaccine hesitancy at the ZIP Code level, referred to as the VaxHesitancy problem. A significant challenge for this problem is the lack of high-resolution data that indicates hesitancy. Here, we develop a hybrid VaxHesSTL framework that combines a Graph Neural Network (GNN) and a Recurrent Neural Network (RNN) to address the VaxHesitancy problem. The GNN uses a ZIP Code-level network to capture spatial signals from neighboring areas, while the RNN models the temporal dynamics present in the data. We train and evaluate VaxHesSTL using a large dataset, namely the All-Payer Claims Databases (APCD), for Virginia, consisting of insurance claims from over five million individuals for six years. We find that an aggregated contact network or graph, developed from a detailed activity-based population network, plays an important role in the performance of VaxHesSTL, compared to graph models based solely on spatial proximity. Experiments demonstrate that VaxHesSTL outperforms a range of state-of-the-art baselines, which rely solely on historical time series data without accounting for spatial relationships. Since hesitancy data at higher spatial resolution is often unavailable or hard to get, we incorporate an active learning approach with our VaxHesSTL framework to optimize the training set without compromising the prediction performance. We find that hesitancy data for only 18% of ZIP Codes selected by active learning allows us to forecast hesitancy for all the ZIP Codes in the Virginia.

60 APPLIED LIFE SCIENCES↗

Deep Learning Parameterization of Vertical Wind Velocity Variability via Constrained Adversarial Training

Atmospheric models with typical resolution in the tenths of kilometers cannot resolve the dynamics of air parcel ascent, which varies on scales ranging from tens to hundreds of meters. Small-scale wind fluctuations are thus characterized by a subgrid distribution of vertical wind velocity W with standard deviation σ W . The parameterization of σ W is fundamental to the representation of aerosol–cloud interactions, yet it is poorly constrained. Using a novel deep learning technique, this work develops a new parameterization for σ W merging data from global storm-resolving model simulations, high-frequency retrievals of W , and climate reanalysis products. The parameterization reproduces the observed statistics of σ W and leverages learned physical relations from the model simulations to guide extrapolation beyond the observed domain. Incorporating observational data during the training phase was found to be critical for its performance. The parameterization can be applied online within large-scale atmospheric models, or offline using output from weather forecasting and reanalysis products.

54 ENVIRONMENTAL SCIENCES↗

PVInsight (Final Technical Report)

Data generated from real-world photovoltaic (PV) systems represent significant opportunities for the industry–from digital operations and maintenance to real-time planning and forecasting. However, these data also come with substantial, unique challenges. A particular challenge is the analysis of unlabeled PV performance data, which we define as time-series measurements of real power production (or sometimes current or voltage) that do not have corresponding meteorological measurements (irradiance, temperature, etc.) or system configuration information (sometimes called system metadata). These challenges are amplified in the distributed rooftop sector, in which data quality, completeness, and metadata can be very poor.

14 SOLAR ENERGY↗

Series FACTS Devices for Increasing Resiliency in Severe Weather Conditions

Severe weather conditions are low-probability, high-impact events that affect grid operations. The majority of power outages are caused by severe weather conditions. Grid resiliency to weather events can be enhanced by decreasing the reliance on its affected sections. One way to do this is to reduce the power flow through lines vulnerable to severe weather. If a line is disconnected, its initial power flow is distributed through the neighbor lines, which may cause congestion in the grid. FACTS devices can be used to control the power flow of lines that have a higher chance of power outages. Most previous works do not consider weather events in power flow control. In this work, a linearized optimal power flow (OPF)–based algorithm is developed to minimize the real power flow of vulnerable lines considering the thermal limits of lines to prevent infeasible solutions; the simulation is fast, making it suitable for large-scale systems. The proposed optimization problem is presented as a mixed-integer linear program (MILP), making it capable of using short-term load forecasting due to its high solution speed. The proposed optimization problem considers multiple lines with different outage probabilities and the uncertainties of the weather forecast. Moreover, it estimates the power reduction in vulnerable lines due to changes in the series FACTS devices. The performance of the proposed optimization problem is tested on IEEE 14-, 30-, and 118-bus systems for several scenarios. The results are validated with the AC power flow results from MATPOWER.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Integrating Deep Learning and Hydrodynamic Modeling to Improve the Great Lakes Forecast

The Laurentian Great Lakes, one of the world’s largest surface freshwater systems, pose a modeling challenge in seasonal forecast and climate projection. While physics-based hydrodynamic modeling is a fundamental approach, improving the forecast accuracy remains critical. In recent years, machine learning (ML) has quickly emerged in geoscience applications, but its application to the Great Lakes hydrodynamic prediction is still in its early stages. This work is the first one to explore a deep learning approach to predicting spatiotemporal distributions of the lake surface temperature (LST) in the Great Lakes. Our study shows that the Long Short-Term Memory (LSTM) neural network, trained with the limited data from hypothetical monitoring networks, can provide consistent and robust performance. The LSTM prediction captured the LST spatiotemporal variabilities across the five Great Lakes well, suggesting an effective and efficient way for monitoring network design in assisting the ML-based forecast. Furthermore, we employed an explainable artificial intelligence (XAI) technique named SHapley Additive exPlanations (SHAP) to uncover how the features impact the LSTM prediction. Our XAI analysis shows air temperature is the most influential feature for predicting LST in the trained LSTM. The relatively large bias in the LSTM prediction during the spring and fall was associated with substantial heterogeneity of air temperature during the two seasons. In contrast, the physics-based hydrodynamic model performed better in spring and fall yet exhibited relatively large biases during the summer stratification period. Finally, we developed a statistical integration of the hydrodynamic modeling and deep learning results based on the Best Linear Unbiased Estimator (BLUE). The integration further enhanced prediction accuracy, suggesting its potential for next-generation Great Lakes forecast systems.

Xue, Pengfei (ORCID:000000025702421X)↗

Outage Forecast-Based Preventative Scheduling Model for Distribution System Resilience Enhancement: Preprint

Distribution system resilience enhancement is an important topic to ensure customers have access to the power supply during extreme events. In fact, certain weather-related extreme events can be predicted ahead of time. Therefore, it is important to investigate how to predict grid outages using extreme weather forecasts, and how outage predictions can be incorporated into distribution system resilience enhancement. In this paper, a preventative scheduling model for distribution systems is proposed. The model targets at allocating resources, especially mobile responsive resources such as mobile backup generators and mobile energy storage systems, to prepare for an extreme event in the day-ahead context. To achieve efficient resource allocation and scheduling, a machine learning-based outage prediction module is developed to predict vulnerable or risky segments of the distribution system based on historical operating records and extreme weather event forecasts. By integrating the outage prediction results into the scheduling model, optimal resource allocation can be derived to help distribution systems prepare for an upcoming event and improve resilience performance. A real distribution feeder in North Carolina, U.S. is used in the case study to validate the proposed approach.

distributed energy resources↗