Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Forecasting techniques”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35

Scenario Creation and Power-Conditioning Strategies for Operating Power Grids with Two-Stage Stochastic Economic Dispatch: Preprint

A significant difficultly associated with the use of stochastic programming to solve optimal power flow problems on a 5-minute timescale is the quality of renewable energy scenarios input by the user. This is especially true when considering power systems with high penetrations of renewable energy, e.g. wind power. This paper introduces the use of stochastic programming to solve the DCOPF problem with scenarios drawn directly from high-fidelity data sets. Hence, the proposed method avoids the problem of lost physics by finding high-fidelity analogs that can describe future states of the system. Furthermore, this method can be simply extended to output multi-period scenarios to the stochastic program. We demonstrate the effectiveness of this technique on simulated dispatch operations of the RTS-GMLC over a week.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Toward Drilling the Perfect Geothermal Well: An International Research Coordination Network for Geothermal Drilling Optimization Supported by Deep Machine Learning and Cloud Based Data Aggregation

The EDGE project, supported by the U.S. Department of Energy Geothermal Technologies Office under award DE-EE0008793, established a data-driven framework for improving the efficiency, cost-effectiveness, and reliability of geothermal well drilling. The project focused on developing scalable data infrastructure, advanced machine learning and probabilistic models, and integrated analytics tools to support continuous drilling optimization. A central objective was to reduce geothermal drilling costs by up to seventy percent while minimizing the risk of well failure through predictive diagnostics and adaptive planning. Over the project period, a comprehensive data repository was designed and deployed, incorporating records from over one hundred geothermal wells across varied geological settings. This repository supported both structured and unstructured data and adhered to FAIR data principles, enabling provenance tracking, quality control, and standardized metadata. The project introduced automated ingestion pipelines and a cloud-hosted platform that facilitated access to raw, processed, and derived datasets. This infrastructure served as the foundation for model development and analysis. Machine learning workflows were developed to predict key drilling metrics including rate of penetration, non-productive time, and total drilling costs. Self-organizing maps and dimensionality reduction methods were used to uncover operational patterns and outliers, while supervised learning algorithms such as random forests and deep neural networks were applied to forecast performance outcomes. The models were validated on heterogeneous datasets from both U.S. and Icelandic fields, demonstrating variable but significant predictive accuracy. The results indicated that finer temporal resolution, inclusion of lithological data, and consistency in operational annotations could substantially improve model performance. The project also implemented process mining techniques to reconstruct state-transition models from drilling event logs. These models enabled the identification of deviations from optimal workflows and provided insights into recurring failure modes. Analysis of non-productive time highlighted the impact of equipment failures, geological challenges, and human factors, offering opportunities for targeted mitigation strategies. The EDGE Dashboard was developed as a web-based expert system integrating data visualization, model outputs, and user-driven queries. It provided an accessible interface for operators to explore historical data, evaluate predicted outcomes, and compare drilling scenarios. Initial feedback from project partners suggested that the dashboard could serve as a foundation for more advanced advisory and optimization tools. Overall, the EDGE project demonstrated the feasibility and value of applying modern data science techniques to geothermal drilling. It delivered a set of interoperable tools and models that can support more efficient, lower-risk well development. The findings point toward a viable path for transitioning from advisory analytics to semi-autonomous drilling systems, contingent on continued collaboration, expanded datasets, and field validation. The project results have immediate relevance for drilling operations, data management practices, and future geothermal R&D efforts aimed at achieving reliable, cost-competitive geothermal energy at scale.

15 GEOTHERMAL ENERGY↗

Wheat yield forecasts using Landsat data

Leaf area index and percentage of vegetative cover, two indices of crop yield developed from Landsat multispectral scanning data, are discussed. Studies demonstrate that the Landsat indicators may be as highly correlated with winter wheat yield as estimates based on traditional field sampling methods; in addition, the Landsat indicators may account for variations in individual field yield which are not explainable by meteorological data. A simple technique employing early-season Landsat data to make wheat yield predictions is also considered.

Colwell, J. E.↗

A proposed microburst nowcasting procedure using single-Doppler radar

Thirty-one microburst-producing storms from northweast Colorado were studied using single and multiple Doppler radar for the purpose of identifying radar signatures that indicated the development of a downdraft capable of producing a microburst. Descending reflectivity cores, increasing radial convergence within cloud, rotation, and reflectivity notches, were found to be microburst precursors, appearing typically 2-6 min prior to initial surface outflow. Three conceptual models have been drawn, based on the 31 events, to summarize the radar signatures of importance in low, moderate, and high-reflectivity microburst-producing storms. A forecaster-computer environment is proposed to allow the forecaster to readily view radar reflectivity and Doppler velocity information in both unprocessed and analyzed form. Use of multiimage radar displays and time-height profiles of quantitative radar estimates of reflectivity and radial shear are suggested to provide an environment where rapid progress can be made in developing techniques to nowcast microbursts.

Roberts, Rita D.↗

COVID-19: Spatiotemporal social data analytics and machine learning for pandemic exploration and forecasting

This task focused on developing a preliminary approach to use machine learning (ML) to explore the relationship between county-level societal variables and COVID-19 parameters, including COVID-19 cases rates and counts and COVID-19 death rates and counts. The objective was to develop and test a prototype approach for linking COVID-19 and county-level data. The task focused on enhancing and applying existing LANL ML techniques to COVID-19. Our novel ML methods have been a subject of a recently approved U.S. patent. The codes based on these methods are already open-source released. Our ML tools (NMFk/NTFk) are applied to extract hidden features (signals, waves) in the analyzed datasets and automatically identify their optimal number. The features are extracted by identifying counties that have similarities between the county-level societal variables and the COVID-19 parameters. These demonstration analyses will facilitate the ongoing pandemic simulations and predictions performed by Los Alamos other institutions, as well as lay the groundwork for future work.

60 APPLIED LIFE SCIENCES↗

NASA's aircraft icing technology program

NASA' Aircraft Icing Technology program is aimed at developing innovative technologies for safe and efficient flight into forecasted icing. The program addresses the needs of all aircraft classes and supports both commercial and military applications. The program is guided by three key strategic objectives: (1) numerically simulate an aircraft's response to an in-flight icing encounter, (2) provide improved experimental icing simulation facilities and testing techniques, and (3) offer innovative approaches to ice protection. Our research focuses on topics that directly support stated industry needs, and we work closely with industry to assure a rapid and smooth transfer of technology. This paper presents selected results that illustrate progress towards the three strategic objectives, and it provides a comprehensive list of references on the NASA icing program.

Reinmann, John J.↗

EPIsembleVis: A geo-visual analysis and comparison of the prediction ensembles of multiple COVID-19 models

In this work, we present EPIsembleVis, a web-based comparative visual analysis tool for evaluating the consistency of multiple COVID-19 prediction models. Our approach analyzes a collection of COVID-19 predictions from different epidemiological models as an ensemble and utilizes two metrics to quantify model performance. These metrics include (a) prediction uncertainty (represented as the dispersion of predictions in each ensemble) and (b) prediction error (calculated by comparing individual model predictions with the recorded data). Through an interactive visual interface, our approach provides a data-driven workflow for (a) selecting and constructing the COVID-19 model prediction ensemble based on the spatiotemporal overlap of available predictions of multiple epidemiological models, (b) quantifying the model performance using both the uncertainty of each model prediction ensemble, and the error of each ensemble member that represents individual model predictions, and (c) visualizing the spatiotemporal variability in the projection performance of individual models using a suite of novel ensemble visualization techniques, such as the data availability map, a spatiotemporal textured-tile calendar, multivariate rose chart, and time-series leaflet glyph. We demonstrate the capability of our ensemble visual interface through a case study that investigates the performance of weekly COVID-19 predictions, which are provided through the COVID-19 Forecast Hub UMass-Amherst Influenza Forecasting Center of Excellence [47] for the United States and United States Territories. The EPIsembleVis tool is implemented using open-source web technologies and adaptive system design, rendering it interoperable with Elasticsearch and Kibana for automatically ingesting COVID-19 predictions from online repositories, and it is generalizable for analyzing worldwide projections from more epidemiological models.

60 APPLIED LIFE SCIENCES↗

Research on diabatic initialization

The objective of this research is to contribute to the improvement of the analyses of irrotational wind and moisture fields in the tropics through advancement in the technique of initialization, incorporating diabatic effects and use of satellite-derived, radiometric imagery data that are not used currently by operational centers. Significant accomplishments during the period of May 1991 - April 1992 in research involving the following are presented: impact of tropical initialization upon the spin-up of precipitation forecasts; and a unified approach to diabatic initialization for improvement in the analysis of divergence and water vapor fields in the tropics. Focus of current research and plans for next year are discussed with respect to the topics of controlling the precipitation over shoot during the early part of a numerical forecast and the use of satellite imagery data for improvement of the tropical analysis.

Kashara, Akira↗

The Processing of Airspace Concept Evaluations Using FASTE-CNS as a Pre- or Post-Simulation CNS Analysis Tool

As NASA speculates on and explores the future of aviation, the technological and physical aspects of our environment increasing become hurdles that must be overcome for success. Research into methods for overcoming some of these selected hurdles have been purposed by several NASA research partners as concepts. The task of establishing a common evaluation environment was placed on NASA's Virtual Airspace Simulation Technologies (VAST) project (sub-project of VAMS), and they responded with the development of the Airspace Concept Evaluation System (ACES). As one examines the ACES environment from a communication, navigation or surveillance (CNS) perspective, the simulation parameters are built with assumed perfection in the transactions associated with CNS. To truly evaluate these concepts in a realistic sense, the contributions/effects of CNS must be part of the ACES. NASA Glenn Research Center (GRC) has supported the Virtual Airspace Modeling and Simulation (VAMS) project through the continued development of CNS models and analysis capabilities which supports the ACES environment. NASA GRC initiated the development a communications traffic loading analysis tool, called the Future Aeronautical Sub-network Traffic Emulator for Communications, Navigation and Surveillance (FASTE-CNS), as part of this support. This tool allows for forecasting of communications load with the understanding that, there is no single, common source for loading models used to evaluate the existing and planned communications channels; and that, consensus and accuracy in the traffic load models is a very important input to the decisions being made on the acceptability of communication techniques used to fulfill the aeronautical requirements. Leveraging off the existing capabilities of the FASTE-CNS tool, GRC has called for FASTE-CNS to have the functionality to pre- and post-process the simulation runs of ACES to report on instances when traffic density, frequency congestion or aircraft spacing/distance violations have occurred. The integration of these functions require that the CNS models used to characterize these avionic system be of higher fidelity and better consistency then is present in FASTE-CNS system. This presentation will explore the capabilities of FASTE-CNS with renewed emphasis on the enhancements being added to perform these processing functions; the fidelity and reliability of CNS models necessary to make the enhancements work; and the benchmarking of FASTE-CNS results to improve confidence for the results of the new processing capabilities.

Mainger, Steve↗

A Comparison of Wind Speed Data from Mechanical and Ultrasonic Anemometers

This study compared the performance of mechanical and ultrasonic anemometers at the Eastern Range (ER; Kennedy Space Center and Cape Canaveral Air Force Station on Florida's Atlantic coast) and the Western Range (WR; Vandenberg Air Force Base on California's Pacific coast). Launch Weather Officers, forecasters, and Range Safety analysts need to understand the performance of wind sensors at the ER and WR for weather warnings, watches, advisories, special ground processing operations, launch pad exposure forecasts, user Launch Commit Criteria (LCC) forecasts and evaluations, and toxic dispersion support. The current ER and WR weather tower wind instruments are being changed from the current propeller-and-vane (ER) and cup-and-vane (WR) sensors to ultrasonic sensors through the Range Standardization and Automation (RSA) program. The differences between mechanical and ultrasonic techniques have been found to cause differences in the statistics of peak wind speed in previous studies. The 45th Weather Squadron (45 WS) and the 30th Weather Squadron (30 WS) requested the Applied Meteorology Unit (AMU) to compare data between RSA and current sensors to determine if there are significant differences. Approximately 3 weeks of Legacy and RSA wind data from each range were used in the study, archived during May and June 2005. The ER data spanned the full diurnal cycle, while the WR data was confined to 1000-1600 local time. The sample of 1-minute data from numerous levels on 5 different towers on each range totaled more than 500,000 minutes of data (482,979 minutes of data after quality control). The 10 towers were instrumented at several levels, ranging from 12 ft to 492 ft above ground level. The RSA sensors were collocated at the same vertical levels as the present sensors and typically within 15 ft horizontally of each another. Data from a total of 53 RSA ultrasonic sensors, collocated with present sensors were compared. The 1-minute average wind speed/direction and the 1-second peak wind speed/direction were compared.

Short, D.↗

Quantifying the Importance of Selected Drought Indicators for the United States Drought Monitor

Using information theory, our study quantifies the importance of selected indicators for the U.S. Drought Monitor (USDM) maps. We use the technique of mutual information (MI) to measure the importance of any indicator to the USDM, and because MI is derived solely from the data, our findings are independent of any model structure (conceptual, physically-based, or empirical). We also compare these MIs against the drought representation effectiveness ratings in the North America Drought Indices and Indicators Assessment (NADIIA) survey for Koeppen climate zones. This reveals: [1] agreement between some ratings and our MI values (high for example indicators like Standardized Precipitation-Evapotranspiration Index or SPEI); [2] some divergences (for example, soil moisture has high ratings but near-zero MIs for ESA-CCI soil moisture in the Western U.S., indicating the need of another remotely sensed soil moisture source); and [3] new insights into the importance of variables such as Snow Water Equivalent (SWE) that are not included in sources like NADIIA. Further analysis of the MI results yields findings related to: [1] hydrological mechanisms (summertime SWE domination during individual drought events through snowmelt into the water-scarce soil); [2] hydroclimatic types (the top pair of inputs in the Western and non-Western regions are SPEIs and soil moistures respectively); and [3] predictability (high for the California 2012-2017 event, with longer-timescale indicators dominating). Finally, the high MIs between multiple indicators jointly and the USDM indicate potentially high drought forecasting accuracies achievable using only model-based inputs, and the potential for global drought monitoring using only remotely sensed inputs, especially for locations having insufficient in situ observations.

Drought↗

Minimum Energy Routing through Interactive Techniques (MERIT) modeling

The MERIT program is designed to demonstrate the feasibility of fuel savings by airlines through improved route selection using wind observations from their own fleet. After a discussion of weather and aircraft data, manually correcting wind fields, automatic corrections to wind fields, and short-range prediction models, it is concluded that improvements in wind information are possible if a system is developed for analyzing wind observations and correcting the forecasts made by the major models. One data handling system, McIDAS, can easily collect and display wind observations and model forecasts. Changing the wind forecasts beyond the time of the most recent observations is more difficult; an Australian Mesoscale Model was tested with promising but not definitive results.

Wylie, Donald P.↗

Raman Lidar Measurements during the International HZO Project: Instrumentation and Analysis Techniques, Popular Summary - 1

The amount of water vapor in the atmosphere helps to determine the likelihood that severe storms may develop. The concentration of water vapor, though, is highly variable in space and time. And yet small changes in water vapor concentration over a short period of time or over a short spatial distance can determine whether a storm may or may not develop. Therefore, in order to improve the ability to forecast severe weather such as thunderstorms it is important to measure water vapor in the atmosphere with high spatial and temporal resolution. One of the most attractive research tools for measuring water vapor in the atmosphere with high spatial and temporal resolution is a Raman lidar. A Raman lidar consists of a laser transmitter, a telescope receiver and optics and electronics for processing opticand electronic signals. A laser pulse is emitted into the atmosphere and it interacts with molecules in the atmosphere causing them to become excited and to emit, through the Raman process, photons of different wavelength than emitted by the laser. The molecule that emitted these emitted. This is the way that a Raman lidar identifies water vapor molecules in the atmosphere. can be identified based on the wavelength of the photons One of the great challenges in Raman lidar measurements has been to make useful daytime measurements of the water vapor profile under bright daytime conditions. In this first of two papers, we describe the instrumentation and analysis of the first documented Raman lidar that is able to measure water vapor in the daytime with sufficient quality to permit the study of developing storm systems.

Whiteman, D. N.↗

Modular performance prediction for scientific workflows using Machine Learning

Scientific workflows provide an opportunity for declarative computational experiment design in an intuitive and efficient way. A distributed workflow is typically executed on a variety of resources, and it uses a variety of computational algorithms or tools to achieve the desired outcomes. Such a variety imposes additional complexity in scheduling these workflows on large scale computers. As computation becomes more distributed, insights into expected workload that a workflow presents become critical for effective resource allocation. In this paper, we present a modular framework that leverages Machine Learning for creating precise performance predictions of a workflow. The central idea is to partition a workflow in such a way that makes the task of forecasting each atomic unit manageable and gives us a way to combine the individual predictions efficiently. We recognize a combination of an executable and a specific physical resource as a single module. This gives us a handle to characterize workload and machine power as a single unit of prediction. Overall, our modular technique of creating atomic modules and deployment of longest-path approach to estimate workflow performance, allows the framework to adapt to highly complex nested directed acyclic workflows and scale to new scenarios, since it does not make assumptions of underlying workflow structure. We present performance estimation results of independent workflow modules executed on the XSEDE SDSC Comet cluster using various Machine Learning algorithms. The results provide insights into the behavior and effectiveness of different algorithms in the context of scientific workflow performance prediction.

97 MATHEMATICS AND COMPUTING↗

Machine Learning Predicts the Timing and Shear Stress Evolution of Lab Earthquakes Using Active Seismic Monitoring of Fault Zone Processes

Abstract Machine learning (ML) techniques have become increasingly important in seismology and earthquake science. Lab‐based studies have used acoustic emission data to predict time‐to‐failure and stress state, and in a few cases, the same approach has been used for field data. However, the underlying physical mechanisms that allow lab earthquake prediction and seismic forecasting remain poorly resolved. Here, we address this knowledge gap by coupling active‐source seismic data, which probe asperity‐scale processes, with ML methods. We show that elastic waves passing through the lab fault zone contain information that can predict the full spectrum of labquakes from slow slip instabilities to highly aperiodic events. The ML methods utilize systematic changes in P‐wave amplitude and velocity to accurately predict the timing and shear stress during labquakes. The ML predictions improve in accuracy closer to fault failure, demonstrating that the predictive power of the ultrasonic signals improves as the fault approaches failure. Our results demonstrate that the relationship between the ultrasonic parameters and fault slip rate, and in turn, the systematically evolving real area of contact and asperity stiffness allow the gradient boosting algorithm to “learn” about the state of the fault and its proximity to failure. Broadly, our results demonstrate the utility of physics‐informed ML in forecasting the imminence of fault slip at the laboratory scale, which may have important implications for earthquake mechanics in nature.

58 GEOSCIENCES↗

Curriculum-based Reinforcement Learning for Distribution System Critical Load Restoration

This paper focuses on the critical load restoration problem in distribution systems following major outages. To provide fast online response and optimal sequential decision-making support, a reinforcement learning (RL) based approach is proposed to optimize the restoration. Due to the complexities stemming from the large policy search space, renewable uncertainty, and nonlinearity in a complex grid control problem, directly applying RL algorithms to train a satisfactory policy requires extensive tuning to be successful. To address this challenge, this paper leverages the curriculum learning (CL) technique to design a training curriculum involving a simpler steppingstone problem that guides the RL agent to learn to solve the original hard problem in a progressive and more effective manner. We demonstrate that compared with direct learning, CL facilitates controller training to achieve better performance. To study realistic scenarios where renewable forecasts used for decision-making are in general imperfect, the experiments compare the trained RL controllers against two model predictive controllers (MPCs) using renewable forecasts with different error levels and observe how these controllers can hedge against the uncertainty. Results show that RL controllers are less susceptible to forecast errors than the baseline MPCs and can provide a more reliable restoration process.

24 POWER TRANSMISSION AND DISTRIBUTION↗

The Status of the Tropical Rainfall Measuring Mission (TRMM) after 2 Years in Orbit

The Tropical Rainfall Measuring Mission (TRMM) satellite was launched on November 27, 1997, and data from all the instruments first became available approximately 30 days after launch. Since then, much progress has been made in the calibration of the sensors, the improvement of the rainfall algorithms, in related modeling applications and in new datasets tailored specifically for these applications. This paper reports the latest results regarding the calibration of the TRMM Microwave Imager, (TMI), Precipitation Radar (PR) and Visible and Infrared Sensor (VIRS). For the TMI, a new product is in place that corrects for a still unknown source of radiation leaking in to the TMI receiver. The PR calibration has been adjusted upward slightly (by 0.6 dBZ) to better match ground reference targets, while the VIRS calibration remains largely unchanged. In addition to the instrument calibration, great strides have been made with the rainfall algorithms as well, with the new rainfall products agreeing with each other to within less than 20% over monthly zonally averaged statistics. The TRMM Science Data and Information System (TSDIS) has responded equally well by making a number of new products, including real-time and fine resolution gridded rainfall fields available to the modeling community. The TRMM Ground Validation (GV) program is also responding with improved radar calibration techniques and rainfall algorithms to provide more accurate GV products which will be further enhanced with the new multiparameter 10 cm radar being developed for TRMM validation and precipitation studies. Progress in these various areas has, in turn, led to exciting new developments in the modeling area where Data Assimilation, and Weather Forecast models are showing dramatic improvements after the assimilation of observed rainfall fields.

Kummerow, C.↗

State of the Art in Large-Scale Soil Moisture Monitoring

Soil moisture is an essential climate variable influencing land atmosphere interactions, an essential hydrologic variable impacting rainfall runoff processes, an essential ecological variable regulating net ecosystem exchange, and an essential agricultural variable constraining food security. Large-scale soil moisture monitoring has advanced in recent years creating opportunities to transform scientific understanding of soil moisture and related processes. These advances are being driven by researchers from a broad range of disciplines, but this complicates collaboration and communication. For some applications, the science required to utilize large-scale soil moisture data is poorly developed. In this review, we describe the state of the art in large-scale soil moisture monitoring and identify some critical needs for research to optimize the use of increasingly available soil moisture data. We review representative examples of 1) emerging in situ and proximal sensing techniques, 2) dedicated soil moisture remote sensing missions, 3) soil moisture monitoring networks, and 4) applications of large-scale soil moisture measurements. Significant near-term progress seems possible in the use of large-scale soil moisture data for drought monitoring. Assimilation of soil moisture data for meteorological or hydrologic forecasting also shows promise, but significant challenges related to model structures and model errors remain. Little progress has been made yet in the use of large-scale soil moisture observations within the context of ecological or agricultural modeling. Opportunities abound to advance the science and practice of large-scale soil moisture monitoring for the sake of improved Earth system monitoring, modeling, and forecasting.

Review↗