Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “performance modeling and prediction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Predicting near-saturated hydraulic conductivity in urban soils

Pedotransfer functions (PTFs) provide point predictions of soil hydraulic properties from more readily measured soil characteristics, yet uncertainties and biases in measurement methods, sampling distributions, and boundary conditions can limit accuracy when estimating near-saturated hydraulic conductivity (K(n)). These limitations may be particularly problematic in understudied urban landscapes that often contain altered hydraulic properties. To better treat deficiencies in PTF performance, we addressed three objectives, which were to: 1) develop PTFs to predict urban K(n), 2) assess bulk density and coarse fragments as explanatory variables; and 3) evaluate the predictive capability of these PTFs by comparing their output to measured hydraulic conductivity values from three other studies of urban soil hydraulics. We used artificial neural networks (ANN) and random forest (RF) approaches to predict urban K(n), with the training dataset including 307 tension infiltrometer tests and other measurements drawn from urban soil assessments in 11 U.S. cities. The PTFs utilized a hierarchy of inputs, starting with percentage sand, silt, clay, and then adding percentage coarse fragments and bulk density. The ANN models performed similar to the RF models, and all models exhibited similar or better predictive performance as models results collected from published articles. The inclusion of bulk density or coarse fragments did not improve accuracy over soil texture alone. Possible reasons for this result include low correlation between K(n) and bulk density and the exclusion of large voids during flow measurements with tension infiltrometers. The models have been made available as an open-source software package to encourage adoption by users working in urban systems.

Jinshi Jian↗

X-57 “Maxwell” High-Lift Propeller Testing and Model Development

NASA’s X-57 “Maxwell” distributed electric propulsion flight demonstrator has a high-lift system that includes 12 fixed-pitch high-lift propellers located upstream of the wing leading edge for lift augmentation at low speeds. These high-lift propellers are not required at higher speeds and are folded conformally along the nacelles to reduce drag when not in operation. Aircraft performance models and flight simulations incorporate propeller performance to predict thrust, moments, and power consumption and propeller model accuracy is important in identifying safe operating regimes for this aircraft. Current high-lift propeller performance models have been verified and calibrated against numerous computational fluid dynamics analyses under a variety of flight conditions. We performed a series of full-scale wind tunnel tests at the NASA Langley Research Center Low Speed Aeroacoustic Wind Tunnel to further validate these models, to identify any adverse operating conditions for these propellers, and to assess the accuracy of the facility’s new Propeller Test Stand. The results indicate that the models accurately predicted performance and that the right-handed propeller showed lower torque and thrust for a given propeller speed compared to the left-handed version. Acoustic data support these measurements, showing higher tonal noise for the left versus right propeller. We suspect this is due to slight differences in the material properties between the early production (right) and more recent (left) blade sets leading to greater detwisting in the right-handed blades under load. Both propellers demonstrated very stable operation throughout the test including during deployment, stowing, and windmilling. Furthermore, high-speed imagery of the spinning propeller indicated no blade oscillations or instabilities for any test case. We also leveraged these images to analyze the effects of propeller loading on blade detwisting and tip position. Unfortunately, the thrust measurements varied significantly during the test due to cross-loading of the Propeller Test Stand load cell, though trends in the thrust data were still observable. The torque measurement, however, remained very precise for all test points and was used for performance comparisons. As a result of this test, we validated and improved the X-57 high-lift propeller performance models, obtained detailed propeller acoustic data and high-speed imagery, observed the propeller operating safely during a variety of dynamic events, and identified two potentially adverse, low-propeller-speed conditions which will be avoided during normal aircraft operation.

X-57↗

Machine Learning based Aircraft Performance Model Estimation for Trajectory Prediction

The accurate prediction of aircraft trajectory by ground-based decision support tools is a critical component of air traffic management in the US National Airspace System (NAS). Accurate predictions of where the aircraft will be in the future or when they will arrive at specific locations (e.g., fixes) is a key enabler for sequencing and efficient arrival management of flights. Traditional physics based aircraft trajectory prediction relies on a simplified point-mass total energy model whose parameters are referred to as Aircraft Performance Model (APM) parameters. Even though the performance coefficients and weight of an aircraft are a vital part of the aircraft performance model’s predictions and accuracy, these coefficients are proprietary in nature and therefore, unavailable to decision-support tools. Current approaches freeze some coefficients to default base of aircraft data (BADA) values and optimize others. However, the APM parameters are highly coupled by the flight dynamics and prioritizing one parameter over others leads to bias and skewed predictions. To alleviate this problem, we provide a combined optimization framework to predict all the critical (thrust, drag and weight) APM parameters. This paper is focused on training Machine Learning (ML) models that map historical flights to optimized APM parameters that provide the best fit (in terms of prediction error). Our dataset obtained from NASA’s Sherlock data warehouse is comprised of thousands of historical flights and includes weather and track data collected from 2019. Using different subsets of relevant features (e.g., aircraft type), we trained several ML models to estimate the aircraft’s take off weight, drag polar coefficients (both parasitic and lift induced), and thrust settings (multiplier applied to the maximum engine thrust). The chosen flights are from three of the most common aircraft types (B738, B737, and A320) arriving at four airports (LAX, DEN, MSP, and DFW). Our ML approach is comprised of two different solutions: 1- using a subset of features that are known prior to the flight departure and do not change during flight (such as engine type, current temperature at departure & destination airports, aircraft type) and 2 - using a subset of temporal features of the flight trajectory (such as cruise altitude, Mach, airspeed, and rate of climb) in addition to the pre-departure features from the first solution. The labels or target variables are the APM parameters that were obtained by an optimized ordinary differential equations (ODE) fitting process (applied to individual flights). The ODE-fitting is very time intensive and is therefore performed offline. Thus, training an ML model to learn the relationship between the flight features and ODE-generated labels enables faster estimation of the APM parameters and is therefore amenable to real-time prediction. Various ML models including linear regression, random forest, XGBoost, and neural network were trained, and the results are compared. After model validation and hyperparameter-tuning, we observed that the Random Forest model outperformed the other three models by the overall mean square error (MSE) of 2% for the first solution and 1.5% for the second solution. Finally, the ML-derived parameters are compared against default BADA APM parameters using NASA’s Autonomy Development toolkit (ADK) simulation software. The simulation results for one of each aircraft type is shown and discussed.

Aida Sharif Rohani↗

Planetary Suit Hip Bearing Model for Predicting Design vs. Performance

Designing a planetary suit is very complex and often requires difficult trade-offs between performance, cost, mass, and system complexity. In order to verifying that new suit designs meet requirements, full prototypes must eventually be built and tested with human subjects. Using computer models early in the design phase of new hardware development can be advantageous, allowing virtual prototyping to take place. Having easily modifiable models of the suit hard sections may reduce the time it takes to make changes to the hardware designs and then to understand their impact on suit and human performance. A virtual design environment gives designers the ability to think outside the box and exhaust design possibilities before building and testing physical prototypes with human subjects. Reductions in prototyping and testing may eventually reduce development costs. This study is an attempt to develop computer models of the hard components of the suit with known physical characteristics, supplemented with human subject performance data. Objectives: The primary objective was to develop an articulating solid model of the Mark III hip bearings to be used for evaluating suit design performance of the hip joint. Methods: Solid models of a planetary prototype (Mark III) suit s hip bearings and brief section were reverse-engineered from the prototype. The performance of the models was then compared by evaluating the mobility performance differences between the nominal hardware configuration and hardware modifications. This was accomplished by gathering data from specific suited tasks. Subjects performed maximum flexion and abduction tasks while in a nominal suit bearing configuration and in three off-nominal configurations. Performance data for the hip were recorded using state-of-the-art motion capture technology. Results: The results demonstrate that solid models of planetary suit hard segments for use as a performance design tool is feasible. From a general trend perspective, the suited performance trends were comparable between the model and the suited subjects. With the three off-nominal bearing configurations compared to the nominal bearing configurations, human subjects showed decreases in hip flexion of 64%, 6%, and 13% and in hip abduction of 59%, 2%, and 20%. Likewise the solid model showed decreases in hip flexion of 58%, 1%, and 25% and in hip abduction of 56%, 0%, and 30%, under the same condition changes from the nominal configuration. Differences seen between the model predictions and the human subject performance data could be attributed to the model lacking dynamic elements and performing kinematic analysis only, the level of fit of the subjects with the suit, the levels of the subject s suit experience.

Cowley, Matthew S.↗

Navigation Prediction Performance During OSIRIS-REx Proximity Operations at (101955) Bennu

The OSIRIS-REx (Origins, Spectral Interpretation, Resource Identification and Security–Regolith Explorer) Orbit Determination team performed covariance analyses prior to the commencement of proximity operations (ProxOps) at (101955) Bennu to determine the expected predicted trajectory performance in order to meet trajectory knowledge requirements throughout each phase of the mission. One of the primary requirements placed on the predicted trajectory performance was based on the performance during orbital phases leading up to the maneuver to initiate the Touch-and-Go (TAG) trajectory descent. Throughout ProxOps the nominal force models being used to predict the spacecraft trajectory were updated in an effort to improve the prediction performance. The most significant models that contributed to prediction performance were of solar radiation pressure, thermal reradiation of the spacecraft, predicted attitude errors, and desaturation maneuvers. Efforts were made throughout all of ProxOps to monitor, trend, predict, and update spacecraft modeling to improve the prediction performance. These efforts were vital to reduce the spacecraft knowledge errors necessary to achieve a TAG target smaller than pre-launch analysis allowed due to the rough terrain of Bennu. Increased precision in predicted trajectory errors allowed for refined uncertainties to be used for future phase planning throughout the mission. The navigation team successfully predicted the spacecraft trajectory throughout all of ProxOps achieving predicted trajectories errors less than originally analyzed.

Jason M. Leonard↗

Assessing time-dependent temperature profile predictions using reduced transport models for high performing NSTX plasmas

Time-dependent, predictive simulations were performed with the 1.5D tokamak integrated modeling code TRANSP on a large set of well-analyzed, high performing discharges from the National Spherical Torus Experiment (NSTX) in order to evaluate how well modern reduced transport models can reproduce experimentally observed temperature profiles in spherical tokamaks. Overall, it is found that simulations using the Multi-Mode Model (MMM) more consistently agree with the NSTX observations than those using the Trapped Gyro-Landau Fluid (TGLF) model, despite TGLF requiring orders of magnitude greater computational cost. When considering all examined discharges, MMM has median overpredictions of electron temperature (T e ) and ion temperature (T i ) profiles of 28% and 27%, respectively, relative to the experiment. TGLF overpredicts T e by 46%, with much larger variance than MMM, and underpredicts T i by 25%. As the ratio of kinetic to magnetic field pressure (β) is increased across NSTX discharges, TGLF predicts lower T e and significant flattening of the T i profile, conflicting with NSTX observations. When using an electrostatic version of TGLF, both T e and T i are substantially overpredicted, underscoring the importance of electromagnetic turbulence in the high β spherical tokamak regime. Additionally, calculations with neural net surrogate models for TGLF were performed outside of TRANSP with a time slice flux matching transport solver, finding better agreement with experiment than the TRANSP simulations, highlighting the impact of different transport solvers and simulation techniques. Furthermore, the reasonable agreement with experiment of temperature profiles predicted by MMM motivates a more detailed examination of the sensitivities of the TRANSP simulations with MMM to different NSTX plasma regimes in a companion paper (Lestz et al Plasma Phys. Control. Fusion 67 105030), in preparation for self-consistent, time-dependent predictive modeling of NSTX-U scenarios.

Lestz, J. B. [General Atomics, San Diego, CA (Unit↗

An Ensemble Investigation of the Causes for Regional Air-Quality Model Critical Load Exceedances Prediction Variability in European and North American Domains Using Diagnostics From Phase 4 of the Air Quality Model Evaluation International Initiative

We summarize tentative findings from multi air quality model ensembles for the years 2009 and 2010 in Europe (EU), and 2010 and 2016 in North America (NA), under AQMEII-4. The model predictions of sulphur and nitrogen deposition were used to estimate exceedances of critical loads for acidification and eutrophication, to show the extent to which the ensemble members agree in the magnitude and the trend of ecologically meaningful impacts. Model exceedance variability was analyzed using AQMEII-4 diagnostics. Evaluation against concentration and wet deposition observations, coupled with these diagnostics, identified specific process representations as the causes for variability between model predictions and for reduced model performance. All models predicted reductions in ecosystem acidification impacts in North America between the years 2010 and 2016, in accord with SO2 emissions reduction legislation which started in 2010 (SO2 SIP) However, all models in EU and NA domains had net negative biases for wet deposition of sulphur and nitrogen relative to observations. The wet S deposition average mean bias for the NA ensemble was -0.17 eq ha-1 d-1, and for the EU ensemble -1.15 eq ha-1 d-1. The NA daily wet deposition average mean bias for NH4+ was -0.37 eq ha-1d-1; EU -1.19 eq ha-1 d-1. The daily NA wet NO3- deposition average mean bias was -0.24 eq ha-1d-1; EU -0.69 eq ha-1 d-1. The members of the ensemble diverged (factor of 10) in their North American predictions for Ndep and consequently their eutrophication exceedances. The models with the highest eutrophication predictions also predicted the highest levels of gas-phase ammonia dry deposition (standard deviation of ammonia dry deposition flux across ensemble members was larger than the ensemble average). These models also had negative biases of predicted ammonia concentrations; average mean biases of -0.63 (satellite NH3) and -0.85 ppbv (surface NH3) compared to ensemble averages of -0.30 and -0.34 ppbv. Diagnostics showed that these differences resulted from the manner in which bidirectional ammonia fluxes were parameterized within these models. The second largest source of NA eutrophication prediction variability were models with positive biases in particulate ammonium and nitrate concentrations, and higher particle nitrogen deposition levels ( particle ammonium concentration bias +0.35 ug m-3; ensemble bias +0.15 ug m-3). We believe two factors may have led to these latter overestimates: higher levels of fine mode particle nitrate formation compared to other models (due to the use of an inorganic heterogeneous chemistry algorithm which did not take base cation chemistry into account), and updates to particle dry deposition velocities carried out in the absence of concurrent updates to wet scavenging algorithms. The relative importance of dry gas, dry particulate, and wet deposition towards total sulphur and nitrogen deposition totals differed between EU and North American domains, though all models had negative biases in wet deposition as noted above. Parallel and subsequent work suggests that multiphase hydrometeor scavenging may improve model wet deposition performance. An increased research focus is recommended for four model processes: multiphase hydrometeor scavenging, ammonia bidirectional fluxes, base cation chemistry and emissions, and particle dry deposition.

regional air-quality model↗

Experiments on a vapor compression air conditioner with liquid desiccants for efficient dehumidification

Buildings require air conditioning systems that not only cool and dehumidify supply air but also provide sufficient ventilation to ensure indoor air quality and occupant comfort. However, standard recirculation systems-which introduce about a 10 % to 20 % fraction of outdoor air-often fail to deliver air that is precisely cooled and dry, particularly because 80-90 % of the ventilation cooling load is latent. Mixing humid ventilation air with recirculated indoor air increases the energy and costs required to condition the air to comfortable levels. Dedicated outdoor air systems (DOASs) are designed to handle this latent dominated ventilation load and thus need to have efficient humidity removal. Many cooling cycles can perform this task. Here we describe a liquid desiccant DOAS, which combines a vapor compression cycle and a liquid desiccant absorber and desorber pair. We present its performance at 26 operating conditions and a thermodynamic model which can accurately predict the moisture removal efficiency. The model's performance predictions have a mean percentage error of 2.5 % and a coefficient of variation of the root mean square error of 7.5 %. We also compare the performance of this vapor-compression-coupled liquid desiccant system with a standard vapor compression system with the same components but no liquid desiccant. For the 26 conditions tested in this study, this comparison shows that adding liquid desiccants lowers the required evaporator cooling load by 21 %, allows for 25 % lower compressor volumetric capacity, and 25 % lower electricity use. Future work will leverage this model to quantify the reduction in annual electricity use across different climates, including the need for a standard vapor compression system to reheat the air during some of the year.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Sensor fusion display evaluation using information integration models in enhanced/synthetic vision applications

Based on existing integration models in the psychological literature, an evaluation framework is developed to assess sensor fusion displays as might be implemented in an enhanced/synthetic vision system. The proposed evaluation framework for evaluating the operator's ability to use such systems is a normative approach: The pilot's performance with the sensor fusion image is compared to models' predictions based on the pilot's performance when viewing the original component sensor images prior to fusion. This allows for the determination as to when a sensor fusion system leads to: poorer performance than one of the original sensor displays, clearly an undesirable system in which the fused sensor system causes some distortion or interference; better performance than with either single sensor system alone, but at a sub-optimal level compared to model predictions; optimal performance compared to model predictions; or, super-optimal performance, which may occur if the operator were able to use some highly diagnostic 'emergent features' in the sensor fusion display, which were unavailable in the original sensor displays.

Foyle, David C.↗

Modeling of airplane performance from flight-test results and validation with an F-104G airplane

A technique of defining an accurate performance model of an airplane from limited flight-test data and predicted aerodynamic and propulsion system characteristics is developed. With the modeling technique, flight-test data from level accelerations are used to define a 1g performance model for the entire flight envelope of an F-104G airplane. The performance model is defined in terms of the thrust and drag of the airplane and can be varied with changes in ambient temperature or airplane weight. The model predicts the performance of the airplane within 5 percent of the measured flight-test data. The modeling technique could substantially reduce the time required for performance flight testing and produce a clear definition of the thrust and drag characteristics of an airplane.

Marshall, R. T.↗

An improved computer model for prediction of axial gas turbine performance losses

The calculation model performs a rapid preliminary pitchline optimization of axial gas turbine annular flowpath geometry, as well as an initial estimate of blade profile shapes, given only a minimum of thermodynamic cycle requirements. No geometric parameters need be specified. The following preliminary design data are determined: (1) the optimum flowpath geometry, within mechanical stress limits; (2) initial estimates of cascade blade shapes; and (3) predictions of expected turbine performance. The model uses an inverse calculation technique whereby blade profiles are generated by designing channels to yield a specified velocity distribution on the two walls. Velocity distributions are then used to calculate the cascade loss parameters. Calculated blade shapes are used primarily to determine whether the assumed velocity loadings are physically realistic. Model verification is accomplished by comparison of predicted turbine geometry and performance with an array of seven NASA single-stage axial gas turbine configurations.

Jenkins, R. M.↗

Interpreting Write Performance of Supercomputer I/O Systems with Regression Models

This work seeks to advance the state of the art in HPC I/O performance analysis and interpretation. In particular, we demonstrate effective techniques to: (1) model output performance in the presence of I/O interference from production loads; (2) build features from write patterns and key parameters of the system architecture and configurations; (3) employ suitable machine learning algorithms to improve model accuracy. We train models with five popular regression algorithms and conduct experiments on two distinct production HPC platforms. We find that the lasso and random forest models predict output performance with high accuracy on both of the target systems. We also explore use of the models to guide adaptation in I/O middleware systems, and show potential for improvements of at least 15% from model-guided adaptation on 70% of samples, and improvements up to 10× on some samples for both of the target systems.

Xie, Bing↗

Dynamic Modeling, Controls, and Testing for Electrified Aircraft

Electrified aircraft have the potential to provide significant benefits for efficiency and emissions reductions. To assess these potential benefits, modeling tools are needed to provide rapid evaluation of diverse concepts and to ensure safe operability and peak performance over the mission. The modeling challenge for these vehicles is the ability to show significant benefits over the current highly refined aircraft systems. The STARC-ABL (single-aisle turbo-electric aircraft with an aft boundary layer propulsor) is a new test proposal that builds upon previous N3-X team hybrid designs. This presentation describes the STARC-ABL concept, the NASA Electric Aircraft Testbed (NEAT) which will allow testing of the STARC-ABL powertrain, and the related modeling and simulation efforts to date. Modeling and simulation includes a turbofan simulation, Numeric Propulsion System Simulation (NPSS), which has been integrated with NEAT; and a power systems and control model for predicting testbed performance and evaluating control schemes. Model predictions provide good comparisons with testbed data for an NPSS-integrated test of the single-string configuration of NEAT.

Connolly, Joseph↗

EPIsembleVis: A geo-visual analysis and comparison of the prediction ensembles of multiple COVID-19 models

In this work, we present EPIsembleVis, a web-based comparative visual analysis tool for evaluating the consistency of multiple COVID-19 prediction models. Our approach analyzes a collection of COVID-19 predictions from different epidemiological models as an ensemble and utilizes two metrics to quantify model performance. These metrics include (a) prediction uncertainty (represented as the dispersion of predictions in each ensemble) and (b) prediction error (calculated by comparing individual model predictions with the recorded data). Through an interactive visual interface, our approach provides a data-driven workflow for (a) selecting and constructing the COVID-19 model prediction ensemble based on the spatiotemporal overlap of available predictions of multiple epidemiological models, (b) quantifying the model performance using both the uncertainty of each model prediction ensemble, and the error of each ensemble member that represents individual model predictions, and (c) visualizing the spatiotemporal variability in the projection performance of individual models using a suite of novel ensemble visualization techniques, such as the data availability map, a spatiotemporal textured-tile calendar, multivariate rose chart, and time-series leaflet glyph. We demonstrate the capability of our ensemble visual interface through a case study that investigates the performance of weekly COVID-19 predictions, which are provided through the COVID-19 Forecast Hub UMass-Amherst Influenza Forecasting Center of Excellence [47] for the United States and United States Territories. The EPIsembleVis tool is implemented using open-source web technologies and adaptive system design, rendering it interoperable with Elasticsearch and Kibana for automatically ingesting COVID-19 predictions from online repositories, and it is generalizable for analyzing worldwide projections from more epidemiological models.

60 APPLIED LIFE SCIENCES↗

Simultaneously improving accuracy and computational cost under parametric constraints in materials property prediction tasks

Abstract Modern data mining techniques using machine learning (ML) and deep learning (DL) algorithms have been shown to excel in the regression-based task of materials property prediction using various materials representations. In an attempt to improve the predictive performance of the deep neural network model, researchers have tried to add more layers as well as develop new architectural components to create sophisticated and deep neural network models that can aid in the training process and improve the predictive ability of the final model. However, usually, these modifications require a lot of computational resources, thereby further increasing the already large model training time, which is often not feasible, thereby limiting usage for most researchers. In this paper, we study and propose a deep neural network framework for regression-based problems comprising of fully connected layers that can work with any numerical vector-based materials representations as model input. We present a novel deep regression neural network, iBRNet, with branched skip connections and multiple schedulers, which can reduce the number of parameters used to construct the model, improve the accuracy, and decrease the training time of the predictive model. We perform the model training using composition-based numerical vectors representing the elemental fractions of the respective materials and compare their performance against other traditional ML and several known DL architectures. Using multiple datasets with varying data sizes for training and testing, We show that the proposed iBRNet models outperform the state-of-the-art ML and DL models for all data sizes. We also show that the branched structure and usage of multiple schedulers lead to fewer parameters and faster model training time with better convergence than other neural networks. Scientific contribution: The combination of multiple callback functions in deep neural networks minimizes training time and maximizes accuracy in a controlled computational environment with parametric constraints for the task of materials property prediction.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗