Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Prediction Accuracy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Pretest Simulations of a Supersonic Mixing and Combustion Validation Experiment to Assess Sensitivities

The reliance on CFD simulations to develop, design, and optimize scramjet systems (or components) has become commonplace. This reliance inevitably hinges on the ability of the computational analyst to quantify the level of confidence in their computational results. Unfortunately, nearly all the measured data available for this assessment comes from antiquated experimental datasets, or from tests that focused on the extraction of scramjet system (or component) performance. The objective of a CFD validation experiment is to quantify the predictive accuracy of one or more of the CFD physics submodels, implying that other uncertainties related to replicating the facility flow environment (e.g., knowledge of boundary conditions) must be minimized to the extent possible. This inevitably places stringent requirements on the quality and quantity of measurements taken to accurately specify inflow, outflow, and surface conditions for the CFD simulations; in addition to the measurements taken for the validation of physics submodels. This places additional demands on the experimental process above and beyond those for test article performance assessment. A recent high speed code credibility workshop series sponsored by AFRL identified a gap in existing validation data for fundamental assessments of turbulent mixing and combustion CFD closure models at scramjet engine relevant conditions. To address this gap, engineers at AFRL have designed a coaxial jet flame configuration that will be tested at two facilities (Research Cell 19 at the Air Force Research Lab, and at Purdue University). The effort described here documents pretest simulations of this validation experiment with the goal of fleshing out the extent of the facility flowpath that must be included to adequately reproduce the facility test section flow environment. The findings indicate that the flow around the support structure for the fuel injection centerbody upstream of the facility nozzle generates disturbances that persist throughout the nozzle expansion process; corrupting the azimuthal symmetry that was desired in the fuel/air mixing region of the test section. Simulations without this support structure maintained a high degree of azimuthal symmetry up until the fuel injection plane. However, even in this scenario the azimuthal symmetry was not maintained once the centerbody boundary layer transitioned to a wake flow downstream of the fuel injection plane.

CFD↗
NASA NTRSDate not supplied

Pretest Simulations of a Supersonic Mixing and Combustion Validation Experiment to Assess Sensitivities

The reliance on CFD simulations to develop, design, and optimize scramjet systems (or components) has become commonplace. This reliance inevitably hinges on the ability of the computational analyst to quantify the level of confidence in their computational results. Unfortunately, nearly all the measured data available for this assessment comes from antiquated experimental datasets, or from tests that focused on the extraction of scramjet system (or component) performance. The objective of a CFD validation experiment is to quantify the predictive accuracy of one or more of the CFD physics submodels, implying that other uncertainties related to replicating the facility flow environment (e.g., knowledge of boundary conditions) must be minimized to the extent possible. This inevitably places stringent requirements on the quality and quantity of measurements taken to accurately specify inflow, outflow, and surface conditions for the CFD simulations; in addition to the measurements taken for the validation of physics submodels. This places additional demands on the experimental process above and beyond those for test article performance assessment. A recent high speed code credibility workshop series sponsored by AFRL identified a gap in existing validation data for fundamental assessments of turbulent mixing and combustion CFD closure models at scramjet engine relevant conditions. To address this gap, engineers at AFRL have designed a coaxial jet flame configuration that will be tested at two facilities (Research Cell 19 at the Air Force Research Lab, and at Purdue University). The effort described here documents pretest simulations of this validation experiment with the goal of fleshing out the extent of the facility flowpath that must be included to adequately reproduce the facility test section flow environment. The findings indicate that the flow around the support structure for the fuel injection centerbody upstream of the facility nozzle generates disturbances that persist throughout the nozzle expansion process; corrupting the azimuthal symmetry that was desired in the fuel/air mixing region of the test section. Simulations without this support structure maintained a high degree of azimuthal symmetry up until the fuel injection plane. However, even in this scenario the azimuthal symmetry was not maintained once the centerbody boundary layer transitioned to a wake flow downstream of the fuel injection plane.

CFD↗
NASA NTRSDate not supplied

James Webb Space Telescope Navigation Optimization Challenges

The James Webb Space Telescope (JWST) is a NASA flagship mission launched on December 25, 2021. The early orbit phase was highlighted by three midcourse correction burns that were performed to maneuver the vehicle into a libration orbit at the second Sun-Earth-Moon (SEM) libration point (L2). During the coast to L2, the vehicle’s primary observatory and sunshield were deployed. Once the tennis-court-sized sunshield was unfurled and tensioned into place, the large area exposed to solar radiation pressure (SRP) dictated that the SRP force model would need to account for the vehicle’s geometry, reflective properties, and orientation relative to the Sun. Following the insertion of JWST into its L2 libration orbit on January 24, 2022, the commissioning phase for the vehicle’s observatory commenced along with the first cycle of routine station-keeping maneuvers. The NASA Goddard Space Flight Center’s Flight Dynamics Facility (FDF) provides navigation services for the JWST mission. The FDF serves as the prime or backup navigation operations center for more than 30 active missions spanning a wide array of flight regimes performing orbit determination, maneuver planning, trajectory optimization, and tracking data evaluation. Definitive orbit determination for JWST is performed by the FDF using an Extended Kalman Filter (EKF) to estimate the vehicle’s trajectory and reflective properties using Deep Space Network (DSN) TRK-2-34 tracking data and spacecraft attitude telemetry. For the purposes of orbit prediction and station-keeping maneuver targeting, the sensitivity of the SRP force to the vehicle’s orientation requires that predictive attitude information must be incorporated to generate accurate orbit predictions and maneuver plans. Predictive attitude plans are provided to the FDF by the JWST Spacecraft Operations Center (SOC). Short-term (28 day) orbit predictions are propagated using a Short Range Attitude Plan (SRAP) to model the vehicle’s future attitude states for up to a week. SRAP attitude data is highly reliable, as it reflects finalized planned attitude states that the vehicle will be commanded to attain during the ensuing week. A Long Range Attitude Plan (LRAP) can be implemented to model predicted attitude states beyond one week, but these predictions are tentative and subject to revision due to changes in science operations plans. Instead, a conservative approach of applying a Sun-Pointing Neutral (SPN) attitude configuration is utilized for long-term (2 year) orbit predictions where reliable planned attitude data is not available. SPN attitude mode aligns the net SRP force along the JWST-to-Sun vector where it becomes independent of the vehicle’s angle of rotation about this vector, defined as the Sun yaw. Given the dynamic instability of the libration orbit, station-keeping thrust must be applied in either the sunward or anti-sunward direction to balance the resulting orbit. The attitude constraints of the vehicle also impose limits on the available pointing directions for station-keeping thrusters. The thrusters cannot be aligned with the optimal pointing direction for sunward maneuvers, rendering sunward maneuvers to be significantly less fuel efficient than anti-sunward maneuvers. Consequently, station-keeping maneuvers must be targeted to balance the orbit while ensuring that the next maneuver will also be performed in the anti-sunward direction to optimize propellant usage. When targeting a station-keeping maneuver, the attitude and SRP modeling configuration which is applied to the predicted post-maneuver trajectory will dictate the direction of the subsequent station-keeping maneuver, assuming nominal propulsion system performance. If the predicted post-maneuver attitude states result in an SRP model which under-predicts the cumulative SRP impact on the post-maneuver orbit, a targeted anti-sunward maneuver will be larger than necessary and the next maneuver will need to be executed sunward in order to compensate. In contrast, an anti-sunward maneuver which is targeted using an SRP model which over-predicts the cumulative SRP impact will achieve station-keeping while ensuring that the next maneuver will likewise be performed anti-sunward. For this reason, station-keeping maneuvers are targeted while applying the SPN attitude mode, as this mode entails the largest possible SRP area cross-section and therefore a larger modeled cumulative SRP impact. This paper documents the NASA Goddard Space Flight Center’s FDF support for JWST on-orbit operations and the analysis projects undertaken utilizing the experiences and data accumulated throughout the first full year of routine science operations. The results of these analysis efforts have been used to implement improvements to orbit prediction accuracy and maneuver efficiency which have the potential to prolong the lifespan of JWST to continue to conduct ground-breaking infrared astronomy for decades to come.

Flight Dynamics↗
NASA NTRSDate not supplied

Mastering the Cryogenic Frontier: Predicting Sloshing in Cryogenic Propellant Tanks

In recent years, NASA has undertaken the development and validation of computation fluid dynamic (CFD) models for predicting cryogenic two-phase sloshing within propellant tanks. These models have been rigorously anchored against cryogenic ground tests that induce sloshing, as well as limited microgravity tests. The primary focus of these models is to accurately predict the two-phase condensation and, at times, evaporation within the cryogenic propellant. This approach is important for estimating the required autogenous and/or helium pressurant for completing propulsion system burns or ensuring adequate pressure for in-space propellant transfers. Unlike in hypergolic propulsion systems, where the propellant is stored at room temperature, cryogenic propellant is highly volatile. Therefore, ensuring the accurate estimation of pressurant necessitates the precise modeling of two-phase interfacial heat and mass transfer processes. This paper aims to provide an overview of NASA’s continuing efforts in developing and validating these CFD models, with particular emphasis on benchmark cases with sloshing that enhances phase change, tracing their historical development, and demonstrating their predictive accuracy when compared to test results.

low-gravity fluid modeling↗
NASA NTRSDate not supplied

Low-Speed Testing of the 5.2% Semispan CRM-HL in the DNW-NWB Wind Tunnel

In this paper the wind tunnel test of the 5.2% CRM-HL in the DNW-NWB low speed wind tunnel is described. The tunnel test campaign is settled in the DLR project ADaMant, in which it is of interest to generate qualitative data for CFD validation to improve the predictive accuracy, efficiency, and usability of physical modeling in CFD codes at the borders of the flight envelope. Different configurations of the CRM-HL were tested in a closed as well as in an open test section of the wind tunnel. Several measurement techniques were used to generate validation data including forces and moments, pressures, flow visualization with tufts and oil painting, and infrared thermography for boundary layer transition detection. The evaluation of the results focuses on these techniques in the closed test section. The test comprises Mach numbers from 0.15 to 0.23 and Reynolds numbers from 1.2x10 6 to 1.2x10 6 . Some results are also compared to data from the NASA Langley Research Center 14x22 Foot wind tunnel to assess the repeatability of measurements of the same model in different wind tunnels.

DLR↗
NASA NTRS2024

A High-Performance Computing Predictive GNSS Performance Monitor for Autonomous Air Vehicles in Urban Environments

This report offers analysis and design insights for leveraging High-Performance Computing (HPC) to predict line-of-sight (LOS) Global Navigation Satellite System (GNSS) availability in a city. This work is motivated by the emerging fields of Advanced and Urban Air Mobility (AAM/UAM), where regulatory authorities are seeking city-scale, meter-resolution risk forecasting in order to safely integrate new flight missions with existing urban life and infrastructure. This work addresses the technical challenge of efficiently computing urban GNSS satellite visibility to predict GNSS performance metrics under these requirements. We present a new HPC-optimized shadow casting algorithm variant as a ray-based approach to forecasting satellite visibility. We apply this algorithm variant in a software-defined prognostic service which generates a GNSS navigation risk-correlated map as a path planning-style potential field. We detail dominant computational burdens, viable simplifying assumptions, and different algorithmic implementations, intending to demonstrate a baseline of computation time needed by each stage in such a service. We conclude by analyzing the prototype service’s prediction accuracy compared to receiver data from Corpus Christi, Texas. This informs design trade-offs along the dimensions of hardware, computation time, and tolerable forecasting error (including proportions of false positives and false negatives).

GNSS↗
NASA NTRSDate not supplied

A Novel Framework for Multi-Path Data Fusion in Earth Observation and New Observing Strategies: Applications to Predicting Forest Canopy Height

Exponential growth of data from Earth Observation (EO) assets has necessitated the development of sophisticated methods for data interpretation and management. NASA’s New Observing Strategy (NOS) approach aims to coordinate operations among complex heterogenous systems of constellations, requiring advanced Artificial Intelligence and Machine Learning (AI/ML) techniques. Despite significant advancements in AI/ML across various domains, the EO and machine learning for satellite (SatML) fields remain fragmented, often relying on adapted techniques rather than domain-specific solutions. We present a novel end-to-end data fusion framework tailored specifically for EO and SatML, addressing this gap by facilitating rapid development of AI/ML applications. This framework, called, Multimodal Earth Observation Workflow for Machine Learning (MEOW-ML), sup- ports the entire AI/ML lifecycle, from dataset manipulation, to model training, evaluation, and logging, and is designed to expedite the development of next-generation NOS deployments and SOTA in EO. We apply our framework to predict canopy height model (CHM) derived from lidar data. We integrate multiple data modalities through a hierarchical, multi-path model architecture, effectively identifying and leveraging the unique strengths of each data source to enhance predictive accuracy. Our experiments demonstrate that the multi-path architecture outperforms traditional single-path models and provides significant advantages in both accuracy and computational efficiency.

Mark Moussa↗
NASA NTRS2024

Evaluation of Machine Learning and Deep Learning Algorithms for Fire Prediction in Southeast Asia

Vegetation fires are prevalent in South/Southeast Asian countries, making fire prediction crucial due to their potential environmental, economic, and social impacts. Accurate predictions of fires facilitate timely interventions, helping to mitigate uncontrolled fires that can lead to biodiversity loss and air quality issues. In this study, we utilize VIIRS satellite-derived fire data alongside six machine learning and deep learning models—Simple Persistence, Multi-Layer Perceptron (MLP), Convolutional Neural Network (CNN), Long Short-Term Memory (LSTM), CNN-LSTM, and ConvLSTM—to determine the most effective fire prediction model, using Root Mean Square Error (RMSE) as the metric. Our results indicate that the CNN model is the most reliable in regions with spatial dependencies, such as Brunei, Indonesia, Malaysia, the Philippines, Timor-Leste, and Thailand. Conversely, the ConvLSTM model excels in countries with complex spatiotemporal dynamics like Laos, Myanmar, and Vietnam. The CNN-LSTM hybrid model also performed well in Cambodia, suggesting a need for a balanced approach in areas requiring both spatial and temporal feature extraction. Furthermore, simpler models like Persistence and MLP showed limitations in capturing dynamic patterns and temporal dependencies. Our findings highlight the importance of evaluating models before implementing any decision support systems (DSS) in fire management. By tailoring models to specific regional fire data, we can enhance prediction accuracy and responsiveness, ultimately improving fire risk management in Southeast Asia and beyond.

Deep learning↗
NASA NTRSDate not supplied

Ground Stop Adjuster: A Machine Learning Approach to Improve Air Traffic Management Initiatives

Traffic Management Initiatives (TMIs) play a crucial role in balancing demand and capacity within the U.S. National Airspace System (NAS). In current practice, traffic management coordinators (TMCs) determine and issue TMIs and recent research has explored the use of machine learning tools to aid the TMCs. However, most studies have primarily focused on a particular type of TMI, i.e., Ground Delay Programs (GDPs) due to their higher rate of occurrence and longer duration. This study investigates a machine learning approach for monitoring and adjusting a different type of TMI, i.e., Ground Stop (GS), aiming to assist human decision-makers with accurate, consistent, and timely recommendations. Using data from three major airports in the New York metroplex, we evaluated models that predict GS parameters, such as duration and scope. Our results demonstrate that using data from all airports in the NY metroplex and increasing feature granularity improve the prediction accuracy of the ML models.

Farzan Masrour Shalmani↗
NASA NTRS2012

Integrated CFD and Controls Analysis Interface for High Accuracy Liquid Propellant Slosh Predictions

Coupling computational fluid dynamics (CFD) with a controls analysis tool elegantly allows for high accuracy predictions of the interaction between sloshing liquid propellants and the control system of a launch vehicle. Instead of relying on mechanical analogs which are n0t va lid during all stages of flight, this method allows for a direct link between the vehicle dynamic environments calculated by the solver in the controls analysis tool to the fluid now equations solved by the CFD code. This paper describes such a coupling methodology, presents the results of a series of test cases, and compares said results against equivalent results from extensively validated tools. The coupling methodology, described herein, has proven to be highly accurate in a variety of different cases.

Marsell, Brandon↗
NASA NTRS2012

High Accuracy Liquid Propellant Slosh Predictions Using an Integrated CFD and Controls Analysis Interface

Coupling computational fluid dynamics (CFD) with a controls analysis tool elegantly allows for high accuracy predictions of the interaction between sloshing liquid propellants and th e control system of a launch vehicle. Instead of relying on mechanical analogs which are not valid during aU stages of flight, this method allows for a direct link between the vehicle dynamic environments calculated by the solver in the controls analysis tool to the fluid flow equations solved by the CFD code. This paper describes such a coupling methodology, presents the results of a series of test cases, and compares said results against equivalent results from extensively validated tools. The coupling methodology, described herein, has proven to be highly accurate in a variety of different cases.

Marsell, Brandon↗
NASA NTRS1983

Slant path attenuation and cross-polarization prediction

The accuracy with which slant-path attenuation and cross-polarization are predicted using differential reflectivity (ZDR) radar data is discussed. Consideration is given to the use of generalized relationships between radar reflectivity (Z), ZDR, and rainfall rate (R); and between R, attenuation, and cross-polarization (XPD) on a slant path. The forward-scatter matrix which is used to calculate the slant path attenuation and XPD is described. It is shown that the use of a double exponential drop size distribution and forward-scatter matrices improves the accuracy of the prediction of slant-path attenuation and XPD. Data obtained with the VPI & SU S-band radar, using slow switching between orthorzonal polarizations is presented. The results are illustrated in graphs.

Pratt, T.↗
NASA NTRS1983

Orbit determination and prediction study for Dynamic Explorer 2

Definitive orbit determination accuracy and orbit prediction accuracy for the Dynamic Explorer-2 (DE-2) are studied using the trajectory determination system for the period within six weeks of spacecraft reentry. Baseline accuracies using standard orbit determination models and methods are established. A promising general technique for improving the orbit determination accuracy of high drag orbits, estimation of random drag variations at perigee passages, is investigated. This technique improved the fit to the tracking data by a factor of five and improved the solution overlap consistency by a factor of two during a period in which the spacecraft perigee altitude was below 200 kilometers. The results of the DE-2 orbit predictions showed that improvement in short term prediction accuracy reduces to the problem of predicting future drag scale factors: the smoothness of the solar 10.7 centimeter flux density suggests that this may be feasible.

Smith, R. L.↗
NASA NTRSDate not supplied

Improving Computational Efficiency of Prognostics Algorithms in Resource-Constrained Settings

The field of prognostics and health management provides quantitative methods for monitoring and predicting the health of physical systems. Prognostics algorithms are useful in that they can be employed to assess the current state of a system, propagate the system state throughout time, and predict potential anomalies or failures that may occur. However, effective prognosis can be challenging to achieve in resource-constrained settings due to computational limitations and high computational latency, leading to obsolete predictions. Thus, computationally efficient and accurate algorithms are necessary for some prognostics applications. In this work, we implement three new algorithmic approaches to prediction (sampling methods, variable prediction time step, variable prediction sample size) with the goal of improving computational efficiency while minimizing decrease in model accuracy. To quantitatively analyze our results, we examine a use-case of degradation of a Lithium-ion battery. Notably, through this work it was found that none of the sampling approaches had a significant impact on computational efficiency or model accuracy in predicting EOD of the battery. However, our results show that prediction accuracy is highly dependent on the time step used, and that an appropriate time step can optimize both model accuracy and simulation efficiency. Finally, implementing a variable sample size also affected prediction, and our results show that tuning both the magnitude and timing of the sample size adjustment in an application-specific manner may prove useful in some applications. Taken together, our findings highlight the challenge of performing prognostics in resource-constrained settings, and illustrate the potential of developing new prediction algorithms to improve computational efficiency of prognosis.

Prognostics↗
NASA NTRS1994

Software reliability studies

There are many software reliability models which try to predict future performance of software based on data generated by the debugging process. Our research has shown that by improving the quality of the data one can greatly improve the predictions. We are working on methodologies which control some of the randomness inherent in the standard data generation processes in order to improve the accuracy of predictions. Our contribution is twofold in that we describe an experimental methodology using a data structure called the debugging graph and apply this methodology to assess the robustness of existing models. The debugging graph is used to analyze the effects of various fault recovery orders on the predictive accuracy of several well-known software reliability algorithms. We found that, along a particular debugging path in the graph, the predictive performance of different models can vary greatly. Similarly, just because a model 'fits' a given path's data well does not guarantee that the model would perform well on a different path. Further we observed bug interactions and noted their potential effects on the predictive process. We saw that not only do different faults fail at different rates, but that those rates can be affected by the particular debugging stage at which the rates are evaluated. Based on our experiment, we conjecture that the accuracy of a reliability prediction is affected by the fault recovery order as well as by fault interaction.

Hoppa, Mary Ann↗
NASA NTRS1985

An evaluation of fracture analysis methods

The results of an experimental and predictive round robin on the applications of fracture analysis methods are presented. The objective of the round robin was to verify whether fracture analysis methods currently in use can or cannot predict failure loads on complex structural components containing cracks. Fracture results from tests on a number of compact specimens were used to make the predictions. The accuracy of the prediction methods was evaluated in terms of the variation in the ratio of predicted to experimental failure loads, and the predictions methods are ranked in order of minimum standard error. A range of applicability of the different methods was also considered in assessing their usefulness. For 7075-T651 aluminum alloy, the best methods were: the effective K sub R curve; the critical crack-tip opening displacement (CTOD) criterion using a finite element analysis; and the K sub R curve with the Dugdale model. For the 2024-T351 aluminum alloy, the best methods included: the two-parameter fracture criterion (TPFC); the CTOD parameter using finite element analysis; the K-curve with the Dugdale model; the deformation plasticity failure assessment diagram (DPFAD); and the effective K sub R curve with a limit load condition. For 304 stainless steel, the best methods were the limit load analysis; the CTOD criterion using finite-element analysis TPFC and DPFAD. Some sample experimental results are given in an appendix.

Newman, J. C., Jr.↗