Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “forecast error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

A novel conditional generative model for efficient ensemble forecasts of state variables in large-scale geological carbon storage

Integrating monitoring data to efficiently update reservoir pressure and CO 2 plume distribution forecasts presents a significant challenge in geological carbon storage (GCS) applications. Inverse modeling techniques are commonly used to fuse observational data and refine reservoir model parameters, thereby improving state variable forecasts. However, these techniques often rely on linear or Gaussian assumptions, which can limit their effectiveness in accurately predicting state variables. Moreover, simulating large-scale three-dimensional (3D) GCS problems is computationally expensive, making iterative runs in inverse problems prohibitive. To address these challenges, we propose a conditional generative model utilizing the score-based diffusion method for real-time 3D pressure and saturation field distribution predictions. Our approach involves solving the score function with a mini-batch-based Monte Carlo estimator to generate labeled data. This data is subsequently employed to train a fully connected neural network, enabling it to learn the conditional sample generator within a supervised learning framework. This method enables the rapid generation of a large ensemble of predictions, facilitating comprehensive uncertainty quantification of state variables. Here we applied our method to forecast the dynamic 3D distributions of pressure and saturation fields over a 30-year injection period. The statistical assessment with low root mean square error (RMSE) values demonstrates that our method can accurately predict the spatiotemporal distributions of both pressure and saturation fields. Moreover, the developed conditional generative model shows high computational efficiency by generating 100 ensemble forecasts of 3D state variables in less than 10 min. The consistency between ensemble averages and ground truth values further illustrates the model’s capability to capture state variable dynamics during the CO 2 plume injection process. Notably, the ground truth values fall within the ensemble forecasts, indicating that our uncertainty quantification effectively captures variability and potential noise in the observations. Thus, the developed conditional generative model proves to be a more efficient, accurate, and practical tool for GCS applications, facilitating timely risk analysis and informed decision-making.

58 GEOSCIENCES↗

The Evaluation of the Regional Atmospheric Modeling System in the Eastern Range Dispersion Assessment System

The Applied Meteorology Unit (AMU) evaluated the Regional Atmospheric Modeling System (RAMS) contained within the Eastern Range Dispersion Assessment System (ERDAS). ERDAS provides emergency response guidance for Cape Canaveral Air Force Station and Kennedy Space Center operations in the event of an accidental hazardous material release or aborted vehicle launch. The RAMS prognostic data are available to ERDAS for display and are used to initialize the 45th Space Wing/Range Safety dispersion model. Thus, the accuracy of the dispersion predictions is dependent upon the accuracy of RAMS forecasts. The RAMS evaluation consisted of an objective and subjective component for the 1999 and 2000 Florida warm seasons, and the 1999-2000 cool season. In the objective evaluation, the AMU generated model error statistics at surface and upper-level observational sites, compared RAMS errors to a coarser RAMS grid configuration, and benchmarked RAMS against the nationally-used Eta model. In the subjective evaluation, the AMU compared forecast cold fronts, low-level temperature inversions, and precipitation to observations during the 1999-2000 cool season, verified the development of the RAMS forecast east coast sea breeze during both warm seasons, and examined the RAMS daily thunderstorm initiation and precipitation patterns during the 2000 warm season. This report summarizes the objective and subjective verification for all three seasons.

Case, Jonathan↗

How Improved Forecasting Can Increase the Bulk Power System Value of Price-Responsive Electric Vehicle Managed Charging

Personal light-duty vehicle (LDV) electric vehicle managed charging (EVMC) can reduce power system costs by better aligning electric vehicle (EV) charging with locations and times of low energy cost or infrastructure use. The need to coordinate charging demand across thousands to millions of vehicles while preserving mobility service is a barrier to realizing the value of EVMC. Price-responsive dispatch mechanisms like time-of-use rates (TOU) and hourly real-time prices (RTP) are attractive compared to direct load control (DLC) because they only require one-way communications and local controls. However, increasing participation in price responsive mechanisms can induce costly-to-serve spikes in load and otherwise increase, rather than decrease, production costs. We quantify the ability of improved EVMC forecasting to sustain savings from price responsive mechanisms beyond the limit of 14% of LDVs actively participating observed in previous work. Perfect forecasting of price-responsive EV load makes TOU and RTP value-competitive with a low-error DLC formulation with up to 27% (within-week flexibility) to 45% or more (within-session flexibility) of LDVs participating in EVMC in an envisioned New England power system with 84% clean energy. Additional costs of implementing DLC should be no more than tens of dollars per vehicle-year if DLC is to be value-competitive with accurately forecast price-responsive EVMC for double-digit percentage shares of LDVs participating.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

The influence of actual and apparent geoid error on ocean analysis and prediction

The radar altimeter is the only satellite remote sensor with a proven capability for synoptically measuring an integral property of the dynamic ocean on a near global, all weather basis. Because acquisition of global, in situ ocean data with space/time resolution adequate to describe dynamically important ocean features is practically impossible, any attempt to develop a global ocean monitoring and forecasting system will rely heavily on altimetric data for initialization and updating. Maximizing useful information from the altimeter while minimizing error sources and developing methods for assimilating altimeter data into dynamical models are, therefore, vital areas for research and development. The limits imposed on ocean prediction by errors in the geoid or apparent errors associated with ground track variations near strong geopotential gradients are examined.

Thompson, J. D.↗

Angular momentum exchange among the solid Earth, atmosphere, and oceans: A case study of the 1982-1983 El Nino event

The 1982-1983 El Nino/Southern Oscillation (ENSO) event was accompanied by the largest interannual variation in the Earth's rotation rate on record. In this study we demonstrate that atmospheric forcing was the dominant cause for this rotational anomaly, with atmospheric angular momentum (AAM) integrated from 1000 to 1 mbar (troposphere plus stratosphere) accounting for up to 92% of the interannual variance in the length of day (LOD). Winds between 100 and 1 mbar contributed nearly 20% of the variance explained, indicating that the stratosphere can play a significant role in the Earth's angular momentum budget on interannual time scales. Examination of LOD, AAM, and Southern Oscillation Index (SOI) data for a 15-year span surrounding the 1982-1983 event suggests that the strong rotational response resulted from constructive interference between the low-frequency (approximately 4-6 year) and quasi-biennial (approximately 2-3 year) components of the ENSO phenomenon, as well as the stratospheric Quasi-Biennial Oscillation (QBO). Sources of the remaining LOD discrepancy (approximately 55 and 64 microseconds rms residual for the European Centre for Medium-Range Forecasting (EC) and U.S. National Meteorological Center (NMC) analyses) are explored; noise and systematic errors in the AAM data are estimated to contribute 18 and 33 microseconds, respectively, leaving a residual (rms) of 40 (52) microseconds unaccounted for by the EC (NMC) analysis. Oceanic angular momentum contributions (both moment of inertia changes associated with baroclinic waves and motion terms) are shown to be candidates in closing the interannual axial angular momentum budget.

Dickey, J. O.↗

Data Assimilation Experiments using Quality Controlled AIRS Version 5 Temperature Soundings

The AIRS Science Team Version 5 retrieval algorithm has been finalized and is now operational at the Goddard DAAC in the processing (and reprocessing) of all AIRS data. The AIRS Science Team Version 5 retrieval algorithm contains two significant improvements over Version 4: 1) Improved physics allows for use of AIRS observations in the entire 4.3 pm C02 absorption band in the retrieval of temperature profile T(p) during both day and night. Tropospheric sounding 15 pm C02 observations are now used primarily in the generation of cloud cleared radiances Ri. This approach allows for the generation of accurate values of Ri and T(p) under most cloud conditions. 2) Another very significant improvement in Version 5 is the ability to generate accurate case-by-case, level-by-level error estimates for the atmospheric temperature profile, as well as for channel-by- channel error estimates for Ri. These error estimates are used for quality control of the retrieved products. We have conducted forecast impact experiments assimilating AIRS temperature profiles with different levels of quality control using the NASA GEOS-5 data assimilation system. Assimilation of quality controlled T(p) resulted in significantly improved forecast skill compared to that obtained from analyses obtained when all data used operationally by NCEP, except for AIRS data, is assimilated. We also conducted an experiment assimilating AIRS radiances uncontaminated by clouds, as done Operationally by ECMWF and NCEP. Forecasts resulting from assimilated AIRS radiances were of poorer quality than those obtained assimilating AIRS temperatures.

SUsskind, Joel↗

Comparative analysis of operational forecasts versus actual weather conditions in airline flight planning: Summary report

The impact of more timely and accurate weather data on airline flight planning with the emphasis on fuel savings is studied. This summary report discusses the results of each of the four major tasks of the study. Task 1 compared airline flight plans based on operational forecasts to plans based on the verifying analyses and found that average fuel savings of 1.2 to 2.5 percent are possible with improved forecasts. Task 2 consisted of similar comparisons but used a model developed for the FAA by SRI International that simulated the impact of ATc diversions on the flight plans. While parts of Task 2 confirm the Task I findings, inconsistency with other data and the known impact of ATC suggests that other Task 2 findings are the result of errors in the model. Task 3 compares segment weather data from operational flight plans with the weather actually observed by the aircraft and finds the average error could result in fuel burn penalties (or savings) of up to 3.6 percent for the average 8747 flight. In Task 4 an in-depth analysis of the weather forecast for the 33 days included in the study finds that significant errors exist on 15 days. Wind speeds in the area of maximum winds are underestimated by 20 to 50 kts., a finding confirmed in the other three tasks.

Keitz, J. F.↗

Forecasting battery capacity and power degradation with multi-task learning

Lithium-ion batteries degrade due to usage and exposure to environmental conditions, which affects their capability to store energy and supply power. Accurately predicting the capacity and power fade of lithium-ion battery cells is challenging due to intrinsic manufacturing variances and coupled nonlinear ageing mechanisms. In this paper, we propose a data-driven prognostics framework to predict both capacity and power fade simultaneously with multi-task learning. The model is able to predict the degradation trajectory of both capacity and internal resistance together with knee-points and end-of-life points accurately at early-life stage. The validation shows an average percentage error of 2.37% and 1.24% for the prediction of capacity fade and resistance rise, respectively. The model's ability to accurately predict the degradation, facing capacity and resistance estimation errors, further demonstrates the model's robustness and generalizability. Compared with single-task learning models for forecasting capacity and power degradation, the model shows a significant prediction accuracy improvement and computational cost reduction. This work presents the highlights of multi-task learning in the degradation prognostics for lithium-ion batteries.

25 ENERGY STORAGE↗

Enabling Pinpoint Landing (PPL) on Mars

Pinpoint landing (PPL) missions will deliver about 1000 kg of useful payload to the surface of Mars. Mid-to-high latitude landing site compatibility is sought which should provide the means to land at sites up to 2.5 km above Mars mean surface altitude. A dispersion and control analysis process is presented which helps to identify the effects of PPL error drivers, quantify the effect of dispersions on landing error and quantify the landing position control capability/authority along the entry path. An entry/descent/landing (EDL) profile is provided. Guided aeroshell is the baseline for all candidate Mars atmospheric entry architectures. A two-stage architecture is considered for the aerodynamic decelerator descent phase: supersonic parachute plus guided subsonic parachute or high-Mach inflatable decelerator plus guided subsonic parachute. The powered descent phase uses propulsive descent stage for soft landing and final error reduction maneuvers. Studies have found that the aeroshell entry face dispersions can be large, but closed-loop guidance can null out resulting errors to within about 2 km. Additionally, projected parachute control is inadequate to correct worst case dispersions without wind forecast data. To mitigate the problems dispersions due to atmospheric uncertainty can be reduced by providing on-board external means to measure density and winds ahead of the vehicle, higher L/D control authority options for the subsonic parachute phase can be investigated, and decelerators with control authority options for the supersonic descent phase can be examined. A navigation error analysis and wind effects summary are included.

aerodynamic↗

Air compressor load forecasting using artificial neural network

Air compressor systems are responsible for approximately 10% of the electricity consumed in United States and European Union industry. As many researches have proven the effectiveness of using Artificial Neural Network inair compressor performance prediction, there is still a need to forecast the air compressor electrical load profile. The objective of this study is to predict compressed air systems’ electrical load profile, which is valuable to industry practitioners as well as software providers in developing better practice and tools for load managementand look-ahead scheduling programs. Two artificial neural networks, Two-Layer Feed-Forward Neural Networkand Long Short-Term Memory were used to predict an air compressors electrical load. Compressors with three different control mechanisms are evaluated with a total number of 11,874 observations. Here, the forecasts were validated using out-of-sample datasets with 5-fold cross-validation. Models produced average coefficient ofdetermination values from 0.24 to 0.94, average root-mean-square errors from 0.05 kW - 5.83 kW, and meanabsolute scaled errors from 0.20 to 1.33. The results indicate that both artificial neural networks yield goodresults for compressors using variable speed drive (average R 2 = 0.8 and no naïve forecasting), only the longshort-term memory model gives acceptable results for compressors using on/off control (average R 2 = 0.82 and no naïve forecasting), and no satisfactory results are obtained for load/unload type air compressors (models constituting active forecasting).

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Temporal Forecasting of Distributed Temperature Sensing in a Thermal Hydraulic System With Machine Learning and Statistical Models

We benchmark performance of long-short term memory (LSTM) network machine learning model and autoregressive integrated moving average (ARIMA) statistical model in temporal forecasting of distributed temperature sensing (DTS). Data in this study consists of fluid temperature transient measured with two co-located Rayleigh scattering fiber optic sensors (FOS) in a forced convection mixing zone of a thermal tee. We treat each gauge of a FOS as an independent temperature sensor. We first study prediction of DTS time series using Vanilla LSTM and ARIMA models trained on prior history of the same FOS that is used for testing. The results yield maximum absolute percentage error (MaxAPE) and root mean squared percentage error (RMSPE) of 1.58% and 0.06% for ARIMA, and 3.14% and 0.44% for LSTM, respectively. Next, we investigate zero-shot forecasting (ZSF) with LSTM and ARIMA trained on history of the co-located FOS only, which is advantageous when limited training data is available. The ZSF MaxAPE and RMSPE values for ARIMA are comparable to those of the Vanilla use case, while the error values for LSTM increase. We show that in ZSF, performance of LSTM network can be improved by training on most correlated gauges between the two FOS, which are identified by calculating the Pearson correlation coefficient. The improved ZSF MaxAPE and RMSPE for LSTM are 4.4% and 0.33%, respectively. Performance of ZSF LSTM can be further enhanced through transfer learning (TL), where LSTM is re-trained on a subset of the FOS that is the target of forecasting. We show that LSTM pre-trained on correlated dataset and re-trained on 30% of testing target dataset achieves MaxAPE and RMSPE values of 2.32% and 0.28%, respectively.

ARIMA↗

Evaluating Model Performance of an Ensemble-based Chemical Data Assimilation System During INTEX-B Field Mission

We present a global chemical data assimilation system using a global atmosphere model, the Community Atmosphere Model (CAM3) with simplified chemistry and the Data Assimilation Research Testbed (DART) assimilation package. DART is a community software facility for assimilation studies using the ensemble Kalman filter approach. Here, we apply the assimilation system to constrain global tropospheric carbon monoxide (CO) by assimilating meteorological observations of temperature and horizontal wind velocity and satellite CO retrievals from the Measurement of Pollution in the Troposphere (MOPITT) satellite instrument. We verify the system performance using independent CO observations taken on board the NSFINCAR C-130 and NASA DC-8 aircrafts during the April 2006 part of the Intercontinental Chemical Transport Experiment (INTEX-B). Our evaluations show that MOPITT data assimilation provides significant improvements in terms of capturing the observed CO variability relative to no MOPITT assimilation (i.e. the correlation improves from 0.62 to 0.71, significant at 99% confidence). The assimilation provides evidence of median CO loading of about 150 ppbv at 700 hPa over the NE Pacific during April 2006. This is marginally higher than the modeled CO with no MOPITT assimilation (-140 ppbv). Our ensemble-based estimates of model uncertainty also show model overprediction over the source region (i.e. China) and underprediction over the NE Pacific, suggesting model errors that cannot be readily explained by emissions alone. These results have important implications for improving regional chemical forecasts and for inverse modeling of CO sources and further demonstrate the utility of the assimilation system in comparing non-coincident measurements, e.g. comparing satellite retrievals of CO with in-situ aircraft measurements. The work described above also brought to light several short-comings of the data assimilation approach for CO profiles. Because of the limited vertical resolution of the measurement, the retrievals at different altitudes are correlated which can lead to problems with numerical error and overall efficiency. This has resulted in a manuscript that is about to be submitted to JGR:

Arellano, A. F., Jr.↗

Validation of Weather Forecasting Products

Meteorological modeling plays a pivotal role in operational safety and emergency response at the Savannah River Site (SRS). This study focuses on verifying the Regional Atmospheric Modelling System (RAMS) Version 4.3 through Mean Bias Error (MBE) and Root Mean Square Error (RMSE) analyses of temperature, dew point, and wind speed over a decade. Using observed data from SRS, we assessed RAMS' accuracy, revealing seasonal biases and error trends. Results indicate RAMS' strengths in mild weather conditions but challenges during seasonal extremes and wind speed predictions due to measurement disparities. Future research aims to expand verification to other models and parameters, advocating for enhanced forecasting accuracy crucial for safeguarding personnel and community well-being.

42 ENGINEERING↗

Prediction of carbon nanostructure mechanical properties and the role of defects using machine learning

Graphene-based nanostructures hold immense potential as strong and lightweight materials, however, their mechanical properties such as modulus and strength are difficult to fully exploit due to challenges in atomic-scale engineering. This study presents a database of over 2,000 pristine and defective nanoscale CNT bundles and other graphitic assemblies, inspired by microscopy, with associated stress–strain curves from reactive molecular dynamics (MD) simulations using the reactive INTERFACE force field (IFF-R). These 3D structures, containing up to 80,000 atoms, enable detailed analyses of structure-stiffness-failure relationships. By leveraging the database and physics- and chemistry-informed machine learning (ML), accurate predictions of elastic moduli and tensile strength are demonstrated at speeds 1,000 to 10,000 times faster than efficient MD simulations. Hierarchical Graph Neural Networks with Spatial Information (HS-GNNs) are introduced, which integrate chemistry knowledge. HS-GNNs as well as extreme gradient boosted trees (XGBoost) achieve forecasts of mechanical properties of arbitrary carbon nanostructures with only 3 to 6% mean relative error. The reliability equals experimental accuracy and is up to 20 times higher than other ML methods. Predictions maintain 8 to 18% accuracy for large CNT bundles, CNT junctions, and carbon fiber cross-sections outside the training distribution. The physics- and chemistry-informed HS-GNN works remarkably well for data outside the training range while XGBoost works well with limited training data inside the training range. The carbon nanostructure database is designed for integration with multimodal experimental and simulation data, scalable beyond 100 nm size, and extendable to chemically similar compounds and broader property ranges. The ML approaches have potential for applications in structural materials, nanoelectronics, and carbon-based catalysts.

Winetrout, Jordan J.↗

Chemical Source Inversion using Assimilated Constituent Observations in an Idealized Two-dimensional System

We present a source inversion technique for chemical constituents that uses assimilated constituent observations rather than directly using the observations. The method is tested with a simple model problem, which is a two-dimensional Fourier-Galerkin transport model combined with a Kalman filter for data assimilation. Inversion is carried out using a Green's function method and observations are simulated from a true state with added Gaussian noise. The forecast state uses the same spectral spectral model, but differs by an unbiased Gaussian model error, and emissions models with constant errors. The numerical experiments employ both simulated in situ and satellite observation networks. Source inversion was carried out by either direct use of synthetically generated observations with added noise, or by first assimilating the observations and using the analyses to extract observations. We have conducted 20 identical twin experiments for each set of source and observation configurations, and find that in the limiting cases of a very few localized observations, or an extremely large observation network there is little advantage to carrying out assimilation first. However, in intermediate observation densities, there decreases in source inversion error standard deviation using the Kalman filter algorithm followed by Green's function inversion by 50% to 95%.

Tangborn, Andrew↗

Data Assimilation Into a Coupled Ocean Atmosphere Model: Application to the 1997-1998 El Nino

As part of JPL's ocean data assimilation effort to study ocean circulation and seasonal-interannual climate variability, sea level anomaly observed by TOPEX altimeter, together with sea surface temperature and wind stress data, are assimilated into a simple coupled ocean atmosphere model of the tropical Pacific. Model-data consistency is examined. Impact of the assimilation (as initialization) on El Nino Southern Oscillation (ENSO) forecasts is evaluated. The coupled model consists of a shallow water component with two baroclinic modes, an Ekman shear layer, a simplified mixed-layer temperature equation, and a statistical atmosphere based on dominant correlations between historical surface temperature and wind stress anomaly data. The adjoins method is used to fit the coupled model to the data over various six-month periods from late 1996 to early 1998 by optimally adjusting the initial state, model parameters, and basis functions of the statistical atmosphere. On average, the coupled model can be fitted to the data to approximately within the data and representation errors (5 cm, 0.5 C, and 10 sq m/sq m for sea level, surface temperature, and pseudo wind stress anomalies, respectively). The estimated fields resemble observed spatio-temporal structure reasonably well. Hindcasts/forecasts of the 1997/1998 El Nino initialized from forced estimated ocean states and parameters are much more realistic than those simply initialized from ocean states (see figure below). In particular, the ability of the model to produce significant warming beyond the initial state is dramatically improved. Parameter estimation, which compensates for some model errors, is found to be important to obtaining better fits of the model to data and to improving forecasts.

Lee, Tong↗

Unraveling the 2021 Central Tennessee flood event using a hierarchical multi-model inundation modeling framework

Flood prediction systems need hierarchical atmospheric, hydrologic, and hydraulic models to predict rainfall, runoff, streamflow, and floodplain inundation. The accuracy of such systems depends on the error propagation through the modeling chain, sensitivity to input data, and choice of models. In this study, we used multiple precipitation forcings (hindcast and forecast) to drive hydrologic and hydrodynamic models to analyze the impacts of various drivers on the estimates of flood inundation depth and extent. We implement this framework to unravel the August 2021 extreme flooding event that occurred in Central Tennessee, USA. We used two radar-based quantitative precipitation estimates (STAGE4 and MRMS) as well as quantitative precipitation forecasts (QPF) from the National Weather Service Weather Prediction Center (WPC) to drive a series of models in the hierarchical framework, including the Variable Infiltration Capacity (VIC) land surface model, the Routing Application for Parallel Computation of Discharge (RAPID) river routing model, and the AutoRoute and TRITON inundation models. An evaluation with observed high-water marks demonstrates that the framework can reasonably simulate flood inundation. Despite the complex error propagation mechanism of the modeling chain, we show that inundation estimates are most sensitive to rainfall estimates. Most notably, QPF significantly underestimates flood magnitudes and inundations leading to unanticipated severe flooding for all stakeholders involved in the event. Finally, we discuss the implications of the hydrodynamic modeling framework for real-time flood forecasting.

54 ENVIRONMENTAL SCIENCES↗

Short-lead seasonal precipitation forecast in northeastern Brazil using an ensemble of artificial neural networks

This study assesses the deterministic and probabilistic forecasting skill of a 1-month-lead ensemble of Artificial Neural Networks (EANN) based on low-frequency climate oscillation indices. The predictand is the February-April (FMA) rainfall in the Brazilian state of Ceará, which is a prominent subject in climate forecasting studies due to its high seasonal predictability. Additionally, the study proposes combining the EANN with dynamical models into a hybrid multi-model ensemble (MME). The forecast verification is carried out through a leave-one-out cross-validation based on 40 years of data. The EANN forecasting skill is compared with traditional statistical models and the dynamical models that compose Ceará’s operational seasonal forecasting system. A spatial comparison showed that the EANN was among the models with the smallest Root Mean Squared Error (RMSE) and Ranked Probability Score (RPS) in most regions. Moreover, the analysis of the area-aggregated reliability showed that the EANN is better calibrated than the individual dynamical models and has better resolution than Multinomial Logistic Regression for above-normal (AN) and below-normal (BN) categories. It is also shown that combining the EANN and dynamical models into a hybrid MME reduces the overconfidence of the extreme categories observed in a dynamically-based MME, improving the reliability of the forecasting system.

54 ENVIRONMENTAL SCIENCES↗