Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Prediction Accuracy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Evaluating model accuracy for model-based reasoning

Described here is an approach to automatically assessing the accuracy of various components of a model. In this approach, actual data from the operation of a target system is used to drive statistical measures to evaluate the prediction accuracy of various portions of the model. We describe how these statistical measures of model accuracy can be used in model-based reasoning for monitoring and design. We then describe the application of these techniques to the monitoring and design of the water recovery system of the Environmental Control and Life Support System (ECLSS) of Space Station Freedom.

Chien, Steve↗

Navigation Design and Operations of Maven Aerobraking

This paper describes the operational design and execution of the MAVEN aerobraking phase at Mars from a Navigation Team perspective. MAVEN was designed to perform atmospheric science in a ~150x6200 km altitude elliptical orbit. After the primary science mission, it was decided that MAVEN should circularize its orbit, as much as feasible from a spacecraft and mission standpoint, to better support relay operations with the landers. As a result, MAVEN performed aerobraking in the first half of 2019 to reduce its orbit to ~150x4500 km altitude. Although MAVEN did not decrease its altitude as low as previous aerobraking missions, it had several unique challenges. Science observations continued to be taken during aerobraking, requiring dramatically better Navigation accuracies than typical for such phases. Furthermore, continuous DSN coverage with 2-way Doppler data was not available. So, with 40% less Doppler data, Navigation had to meet prediction accuracies which were an order of magnitude smaller than in previous aerobraking operations. Spacecraft accelerometer data was included in Navigation analyses in order to meet these requirements.

Jakosky, Bruce↗

Turbofan forced mixer lobe flow modeling. 1: Experimental and analytical assessment

A joint analytical and experimental investigation of three-dimensional flowfield development within the lobe region of turbofan forced mixer nozzles is described. The objective was to develop a method for predicting the lobe exit flowfield. In the analytical approach, a linearized inviscid aerodynamical theory was used for representing the axial and secondary flows within the three-dimensional convoluted mixer lobes and three-dimensional boundary layer analysis was applied thereafter to account for viscous effects. The experimental phase of the program employed three planar mixer lobe models having different waveform shapes and lobe heights for which detailed measurements were made of the three-dimensional velocity field and total pressure field at the lobe exit plane. Velocity data was obtained using Laser Doppler Velocimetry (LDV) and total pressure probing and hot wire anemometry were employed to define exit plane total pressure and boundary layer development. Comparison of data and analysis was performed to assess analytical model prediction accuracy. As a result of this study a planar mixed geometry analysis was developed. A principal conclusion is that the global mixer lobe flowfield is inviscid and can be predicted from an inviscid analysis and Kutta condition.

Barber, T.↗

Evaluation of the Linear Aerospike SR-71 Experiment (LASRE) Oxygen Sensor

The Linear Aerospike SR-71 Experiment (LASRE) was a propulsion flight experiment for advanced space vehicles such as the X-33 and reusable launch vehicle. A linear aerospike rocket engine was integrated into a semi-span of an X-33-like lifting body shape (model), and carried on top of an SR-71 aircraft at NASA Dryden Flight Research Center. Because no flight data existed for aerospike nozzles, the primary objective of the LASRE flight experiment was to evaluate flight effects on the engine performance over a range of altitudes and Mach numbers. Because it contained a large quantity of energy in the form of fuel, oxidizer, hypergolics, and gases at very high pressures, the LASRE propulsion system posed a major hazard for fire or explosion. Therefore, a propulsion-hazard mitigation system was created for LASRE that included a nitrogen purge system. Oxygen sensors were a critical part of the nitrogen purge system because they measured purge operation and effectiveness. Because the available oxygen sensors were not designed for flight testing, a laboratory study investigated oxygen-sensor characteristics and accuracy over a range of altitudes and oxygen concentrations. Laboratory test data made it possible to properly calibrate the sensors for flight. Such data also provided a more accurate error prediction than the manufacturer's specification. This predictive accuracy increased confidence in the sensor output during critical phases of the flight. This paper presents the findings of this laboratory test.

Ennix, Kimberly A.↗

Evaluation of the Linear Aerospike SR-71 Experiment (LASRE) Oxygen Sensor

The Linear Aerospike SR-71 Experiment (LASRE) was a propulsion flight experiment for advanced space vehicles such as the X-33 and reusable launch vehicle. A linear aerospike rocket engine was integrated into a semi-span of an X-33-like lifting body shape (model), and carried on top of an SR-71 aircraft at NASA Dryden Flight Research Center. Because no flight data existed for aerospike nozzles, the primary objective of the LASRE flight experiment was to evaluate flight effects on the engine performance over a range of altitudes and Mach numbers. Because it contained a large quantity of energy in the form of fuel, oxidizer, hypergolics, and gases at very high pressures, the LASRE propulsion system posed a major hazard for fire or explosion. Therefore, a propulsion-hazard mitigation system was created for LASRE that included a nitrogen purge system. Oxygen sensors were a critical part of the nitrogen purge system because they measured purge operation and effectiveness. Because the available oxygen sensors were not designed for flight testing, a laboratory study investigated oxygen-sensor characteristics and accuracy over a range of altitudes and oxygen concentrations. Laboratory test data made it possible to properly calibrate the sensors for flight. Such data also provided a more accurate error prediction than the manufacturer's specification. This predictive accuracy increased confidence in the sensor output during critical phases of the flight. This paper presents the findings of this laboratory test.

Ennix, Kimberly A.↗

Curved Displacement Transfer Functions for Geometric Nonlinear Large Deformation Structure Shape Predictions

For shape predictions of structures under large geometrically nonlinear deformations, Curved Displacement Transfer Functions were formulated based on a curved displacement, traced by a material point from the undeformed position to deformed position. The embedded beam (depth-wise cross section of a structure along a surface strain-sensing line) was discretized into multiple small domains, with domain junctures matching the strain-sensing stations. Thus, the surface strain distribution could be described with a piecewise linear or a piecewise nonlinear function. The discretization approach enabled piecewise integrations of the embedded-beam curvature equations to yield the Curved Displacement Transfer Functions, expressed in terms of embedded beam geometrical parameters and surface strains. By entering the surface strain data into the Displacement Transfer Functions, deflections along each embedded beam can be calculated at multiple points for mapping the overall structural deformed shapes. Finite-element linear and nonlinear analyses of a tapered cantilever tubular beam were performed to generate linear and nonlinear surface strains and the associated deflections to be used for validation. The shape prediction accuracies were then determined by comparing the theoretical deflections with the finiteelement- generated deflections. The results show that the newly developed Curved Displacement Transfer Functions are very accurate for shape predictions of structures under large geometrically nonlinear deformations.

displacement theory↗

Analysis and Evaluation of NASA's MK40B Six-Component Task Balance

The MK40B balance is NASA's newest balance of Task design. Its load range was optimized for use in the NASA Ames 11-ft Transonic Wind Tunnel. The balance was calibrated in 2019 in Calspan's Automatic Balance Calibration System. The data analysis was performed at the Ames Balance Calibration Laboratory. First, bi-directional characteristics of the six gage outputs of the balance were assessed by applying a semi-empirical test to the calibration data. These tests indicated that four of the six gages have bi-directional characteristics. Therefore, the use of absolute value terms in the regression models of the calibration data is justified. Then, the machine calibration data was analyzed using both the Non-Iterative and the Iterative Method. Analysis results for the two methods were compared using the percent contributions, the calibration load residuals, the primary sensitivities, and the principle linear terms. These results confirmed that the two methods describe bi-directional characteristics of the balance gages correctly. In addition, it was concluded that the load prediction accuracies of the two methods are the same for all practical purposes.

wind tunnel balance↗

On extracting brightness temperature maps from scanning radiometer data

The extraction of brightness temperature maps from scanning radiometer data is described as a typical linear inverse problem. Spatial quantization and parameter estimation is described and is suggested as an advantageous approach to a solution. Since this approach takes into explicit account the multivariate nature of the problem, it permits an accurate determination of the most detailed resolution extractable from the data as well as explicitly defining the possible compromises between accuracy and resolution. To illustrate the usefulness of the method described for algorithm design and accuracy prediction, it was applied to the problem of providing brightness temperature maps during the NOSS flight segment. The most detained possible resolution was determined and a curve which displays the possible compromises between accuracy and resolution was provided.

Argentiero, P.↗

Variational Coupled Loads Analysis using the Hybrid Parametric Variation Method

Time-domain coupled loads analysis (CLA)is used to determine the response of a launch vehicle and payload system to transient forces, such as liftoff, engine ignitions and shutdowns, jettison events, and atmospheric flight loads, such as buffet. CLA, using Hurty/Craig-Bampton (HCB)component models, is the accepted method for the establishment of design-level loads for launch systems. However, uncertainty in the component models flows into uncertainty in predicted system results. Uncertainty in the structural responses during launch is a significant concern because small variations in launch vehicle and payload mode shapes and their interactions can result in significant variations in system loads. Uncertainty quantification (UQ)is used to determine statistical bounds on prediction accuracy based on model uncertainty. In this paper uncertainty is treated at the HCB component-model level. In an effort to account for model uncertainties and statistically bound their effect on CLA predictions, this work combines CLA with UQ in a process termed variational coupled loads analysis (VCLA). The modeling of uncertainty using a parametric approach, in which input parameters are represented by random variables, is common, but its major drawback is the resulting uncertainty is limited to the form of the nominal model. Uncertainty in model form is one of the biggest contributors to uncertainty in complex built-up structures. Model-form uncertainty can be represented using a nonparametric approach based on random matrix theory (RMT). In this work, UQ is performed using the hybrid parametric variation (HPV)method, which combines parametric with nonparametric uncertainty at the HCB component model level. The HPV method requires the selection of dispersion values for the HCB fixed-interface (FI)eigenvalues, and the HCB mass and stiffness matrices. The dispersions are based upon component test-analysis modal correlation results. During VCLA, random component models are assembled into an ensemble of random systems using a Monte Carlo (MC)approach. CLA is applied to each of the ensemble members to produce an ensemble of system-level responses for statistical analysis. The proposed methodology is demonstrated through its application to a buffet loads analysis of NASA’s Space Launch System (SLS)during the transonic regime fifty seconds after liftoff. Core stage (CS)section shears and moments are recovered, and statistics are computed.

Uncertainty Quantification↗

A Generalized Approach to Aircraft Trajectory Prediction via Supervised Deep Learning

As research advances diverse forms and missions of aircraft, the National Airspace System (NAS) will become increasingly crowded, limiting current communications resources to accommodate aviation operations. Ongoing research proposes a paradigm of airspace communications, such that resources are autonomously and dynamically allocated via intelligent agents; this allocation requires accurate representations of the NAS, including the predicted positions of aircraft. State-of-the-art research emphasizes the importance of a hybrid-recurrent framework for trajectory prediction and compares the impact of commonly considered weather data on prediction accuracy. However, current research has been limited in its scope of efforts, frequently utilizing a unique flight route, architecture, set of weather data, and date range. This article considers the challenges of generalizing hybrid-recurrent predictive models for flight trajectories. Results illustrate an increase in error variance when identical models are trained over a generalized set of flights; this may be mitigated with careful tuning of hyperparameters, both in the network structure and optimization algorithms. Even so, an irreducible vertical error was identified, resulting from the complex takeoff and landing procedures which can not be correlated to functions of weather or additional assumptions of aircraft behavior. Finally, the use of a test route indicates that generalized models still do not possess sufficient knowledge for general aircraft predictions, with mean error increases ranging from 70-500%. These results illustrate the need for continued efforts on improving model versatility, as well as potential limitations for spectrum allocation near airports and other centers.

Nathan Schimpf↗

Center-TRACON Automation System (CTAS) En Route Trajectory Predictor Requirements and Capabilities

This requirements framework document is designed to support the capture of requirements and capabilities for state-of-the-art trajectory predictors (TPs). This framework has been developed to assist TP experts in capturing a clear, consistent, and cross-comparable set of requirements and capabilities. The goal is to capture capabilities (types of trajectories that can be built), functional requirements (including inputs and outputs), non-functional requirements (including prediction accuracy and computational performance), approaches for constraint relaxation, and input uncertainties. The sections of this framework are based on the Common Trajectory Predictor structure developed by the FAA/Eurocontrol Cooperative R&D Action Plan 16 Committee on Common Trajectory Prediction. It is assumed that the reader is familiar with the Common TP Structure.1 This initial draft is intended as a first cut capture of the En Route TS Capabilities and Requirements. As such, it contains many annotations indicating possible logic errors in the CTAS code or in the description provided. It is intended to work out the details of the annotations with NASA and to update this document at a later time.

framework↗

Blade-Wake Interaction Noise for Small Hovering Rotors, Part I: Characterization Study

This work illustrates the use of artificial neural network modeling to study and characterize broadband blade-wake interaction noise from hovering small unmanned aerial systems rotors subject to varying airfoil geometries, rotor geometries, and operating conditions. Design of experiments was used to create input feature spaces, and a high-fidelity strategy was implemented at the discrete data points defined by the input feature spaces to design airfoils and rotor blades, predict the unsteady rotor aerodynamics and aeroacoustics, and isolate the blade-wake interaction noise from the acoustic broadband noise. A metric for the blade-wake interaction noise was developed, and the ANOPP2 Artificial Neural Network Tool was used to identify an optimal prediction model for the nonlinear relationship between the input features and the metric for blade-wake interaction noise. This optimal artificial neural network was then validated over training/test data and exhibited prediction accuracy over 91% for data previously unseen by the model. A sensitivity analysis was conducted, which showed that input features that directly modify the thrust coefficient had a dominant effect over blade-wake interaction noise. The optimal prediction model along with aerodynamic simulations were used to further study the effect of varying input features on blade-wake interaction noise, and three types of blade-wake interaction noise were identified

Christopher S. Thurman↗

Curvilinear Displacement Transfer Functions for Deformed Shape Predictions of Curved Structures Using Distributed Surface Strains

Curvilinear Displacement Transfer Functions were formulated for deformed shape predictions of different curved structures using surface strains. The embedded curved beam (depth-wise cross section of a curved structure along a surface strain-sensing line) was discretized into multiple small domains, with domain junctures matching the strain-sensing stations. Thus, the surface strain distribution can be described with a piecewise linear or a piecewise nonlinear function. The discrete approach enabled piecewise integrations of a curvature-strain differential equation for the embedded curved beam to yield closed-form Curvilinear Displacement Transfer Functions, which are written in terms of embedded curved-beam geometrical parameters and surface strains. By inputting the surface strain data, the Curvilinear Displacement Transfer Functions can transform surface strains into deflections along each embedded curved beam for mapping out the overall structural deformed shapes. The finite-element method was used to analytically generate the surface strains of the curved beams. The deformed shape prediction accuracies were then determined by comparing the theoretical deflections with the finite-element-generated deflections, which were used as yardsticks. By introducing the correction factors in simple mathematical forms, the Curvilinear Displacement Transfer Functions can be quite accurate for shape predictions of different curved-beam structures ranging from limit case of straight beam up to semicircular curved beam.

Ko, William L.↗

Estimation of the accuracy of dynamic flight-determined coefficients

This paper discusses means of assessing the accuracy of maximum likelihood parameter estimates obtained from dynamic flight data. The commonly used analytical predictors of accuracy are compared from both statistical and simplified geometric standpoints. Emphasizing practical considerations, such as modeling error, the accuracy predictions are evaluated with real and simulated data. Improved computations of the Cramer-Rao bound to correct large discrepancies caused by colored noise and modeling error are presented. This corrected Cramer-Rao bound is the best available analytical predictor of accuracy. Engineering judgement, aided by such analytical tools, is the final arbiter of accuracy estimation.

Maine, R. E.↗

Occupant Response Analysis of a Full-Scale Crash Test of a Fokker F28 Fellowship Aircraft

In this report, the capability of component fuselage testing and finite element models (FEMs) to predict occupant injury risk when applied to full-scale aircraft crash testing was evaluated. Component level and full-scale crash tests of a Fokker-F28 aircraft were performed in conjunction with representative FEM simulations. Lumbar spine injury risk, calculated through Anthropomorphic Test Device (ATD) outputs measured in the full-scale test, was compared with predictions made by component level testing and simulations. A quantitative assessment of FEM prediction accuracy was made using the International Organization for Standardization (ISO) Technical Report (TR) 16250 curve comparison methodology. Lumbar load injury risk measured in the full-scale test configuration was found to be significantly higher than in the component tests performed. The FEM provided a closer prediction of occupant injury risk than component testing but exhibited limitations in the multi-axis load environment. This work will help inform the application of component testing and FEM simulation when used to evaluate aircraft crashworthiness.

Jacob B Putnam↗

Characterizing DebriSat Fragments: So Many Fragments, So Much Data, and So Little Time

To improve prediction accuracy, the DebriSat project was conceived by NASA and DoD to update existing standard break-up models. Updating standard break-up models require detailed fragment characteristics such as physical size, material properties, bulk density, and ballistic coefficient. For the DebriSat project, a representative modern LEO spacecraft was developed and subjected to a laboratory hypervelocity impact test and all generated fragments with at least one dimension greater than 2 mm are collected, characterized and archived. Since the beginning of the characterization phase of the DebriSat project, over 130,000 fragments have been collected and approximately 250,000 fragments are expected to be collected in total, a three-fold increase over the 85,000 fragments predicted by the current break-up model. The challenge throughout the project has been to ensure the integrity and accuracy of the characteristics of each fragment. To this end, the post hypervelocity-impact test activities, which include fragment collection, extraction, and characterization, have been designed to minimize handling of the fragments. The procedures for fragment collection, extraction, and characterization were painstakingly designed and implemented to maintain the post-impact state of the fragments, thus ensuring the integrity and accuracy of the characterization data. Each process is designed to expedite the accumulation of data, however, the need for speed is restrained by the need to protect the fragments. Methods to expedite the process such as parallel processing have been explored and implemented while continuing to maintain the highest integrity and value of the data. To minimize fragment handling, automated systems have been developed and implemented. Errors due to human inputs are also minimized by the use of these automated systems. This paper discusses the processes and challenges involved in the collection, extraction, and characterization of the fragments as well as the time required to complete the processes. The objective is to provide the orbital debris community an understanding of the scale of the effort required to generate and archive high quality data and metadata for each debris fragment 2 mm or larger generated by the DebriSat project.

Shiotani, B.↗

Application of Lattice Boltzmann and Navier-Stokes Methods to NASA's Wall Mounted Hump

Lattice Boltzmann (LB) based Large Eddy Simulation (LES), Reynolds-averaged Navier-Stokes (RANS) as well as hybrid RANS/LES methods within the Launch Ascent and Vehicle Aerodynamics (LAVA) solver framework are applied to NASA's wall-mounted hump. Computational results are compared with experiments performed by Greenblatt et al. A detailed comparison between the accuracy and resolution requirements of the two approaches for turbulence resolving simulations, as well as the suitability of different grid paradigms (body-fitted curvilinear and block structured Cartesian) are presented. This test case is part of NASA's Revolutionary Computational Aerosciences (RCA) sub-project which addresses the technical challenge of predicting flow separation and reattachment accurately. Improvements in predictive accuracy by as much as 90% are demonstrated using LB as well as hybrid RANS/LES approaches compared to state-of-the-art steady state RANS simulations.

Lattice Boltzmann↗

Experiments to Determine Whether Recursive Partitioning (CART) or an Artificial Neural Network Overcomes Theoretical Limitations of Cox Proportional Hazards Regression

New computationally intensive tools for medical survival analyses include recursive partitioning (also called CART) and artificial neural networks. A challenge that remains is to better understand the behavior of these techniques in effort to know when they will be effective tools. Theoretically they may overcome limitations of the traditional multivariable survival technique, the Cox proportional hazards regression model. Experiments were designed to test whether the new tools would, in practice, overcome these limitations. Two datasets in which theory suggests CART and the neural network should outperform the Cox model were selected. The first was a published leukemia dataset manipulated to have a strong interaction that CART should detect. The second was a published cirrhosis dataset with pronounced nonlinear effects that a neural network should fit. Repeated sampling of 50 training and testing subsets was applied to each technique. The concordance index C was calculated as a measure of predictive accuracy by each technique on the testing dataset. In the interaction dataset, CART outperformed Cox (P less than 0.05) with a C improvement of 0.1 (95% Cl, 0.08 to 0.12). In the nonlinear dataset, the neural network outperformed the Cox model (P less than 0.05), but by a very slight amount (0.015). As predicted by theory, CART and the neural network were able to overcome limitations of the Cox model. Experiments like these are important to increase our understanding of when one of these new techniques will outperform the standard Cox model. Further research is necessary to predict which technique will do best a priori and to assess the magnitude of superiority.

Kattan, Michael W.↗