Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Performance Modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27

Measured Boundary Layer Transition and Rotor Hover Performance at Model Scale

An experiment involving a Mach-scaled, 11:08 f t: diameter rotor was performed in hover during the summer of 2016 at NASA Langley Research Center. The experiment investigated the hover performance as a function of the laminar to turbulent transition state of the boundary layer, including both natural and fixed transition cases. The boundary layer transition locations were measured on both the upper and lower aerodynamic surfaces simultaneously. The measurements were enabled by recent advances in infrared sensor sensitivity and stability. The infrared thermography measurement technique was enhanced by a paintable blade surface heater, as well as a new high-sensitivity long wave infrared camera. The measured transition locations showed extensive amounts, x=c>0:90, of laminar flow on the lower surface at moderate to high thrust (CT=s > 0:068) for the full blade radius. The upper surface showed large amounts, x=c > 0:50, of laminar flow at the blade tip for low thrust (CT=s < 0:045). The objective of this paper is to provide an experimental data set for comparisons to newly developed and implemented rotor boundary layer transition models in CFD and rotor design tools. The data is expected to be used as part of the AIAA Rotorcraft SimulationWorking Group

Overmeyer, Austin D.↗

MSL MMRTG Power Modeling for Lifetime Performance Predictions

The Multi-Mission Radioisotope Thermoelectric Generator (MMRTG) has been providing power to the Mars Science Laboratory (MSL) rover, Curiosity, for surface operations since 2012. The Jet Propulsion Laboratory (JPL) has employed the Life Performance Prediction Model (LPPM) to generate predictions and outputs based upon flight data from the rover and experimental data from the thermoelectric (TE) couples. In order to make these predictions, LPPM requires various spacecraft inputs relevant to RTG performance such as fin root temperature, load voltage, general purpose heat source (GPHS) inventory, etc., combined with couple data such as thermoelectric properties, interface degradation, and sublimation properties. With tens of thousands of hours of flight data to date, LPPM can not only track performance to date, but also make predictions on the power output of the MMRTG through the 17-year end-of-design-life (EODL). These predictions are useful for mission planners and surface operators who rely on the MMRTG for power in order to perform the critical science necessary during the mission. This paper will showcase the power data extracted from the flight electronics, comparing it to the predictions and outputs generated from LPPM.

Pinkowski, Stanley↗

Modelling and performance of Nb SIS mixers in the 1.3 mm and 0.8 mm bands

We describe the modeling and subsequent improvements of SIS waveguide mixers for the 200-270 and 330-370 GHz bands (Blundell, Carter, and Gundlach 1988, Carter et al 1991). These mixers are constructed for use in receivers on IRAM radiotelescopes on Pico Veleta (Spain, Sierra Nevada) and Plateau de Bure (French Alps), and must meet specific requirements. The standard reduced height waveguide structure with suspended stripline is first analyzed and a model is validated through comparison with scale model and working scale measurements. In the first step, the intrinsic limitations of the standard mixer structure are identified, and the parameters are optimized bearing in mind the radioastronomical applications. In the second step, inductive tuning of the junctions is introduced and optimized for minimum noise and maximum bandwidth. In the 1.3 mm band, a DSB receiver temperature of less than 110 K (minimum 80 K) is measured from 180 through 260 GHz. In the 0.8 mm band, a DSB receiver temperature of less than 250 K (minimum 175 K) is obtained between 325 and 355 GHz. All these results are obtained with room-temperature optics and a 4 GHz IF chain having a 500 MHz bandwidth and a noise temperature of 14 K.

Karpov, A.↗

Forte: An Interactive Visual Analytic Tool for Trust-Augmented Net-Load Forecasting

Accurate net-load forecasting is vital for energy planning, aiding decisions on trade and load distribution. However, assessing the performance of forecasting models across diverse input variables, like temperature and humidity, remains challenging, particularly for eliciting a high degree of trust in the model outcomes. In this context, there is a growing need for data-driven technological interventions to aid scientists in comprehending how models react to both noisy and clean input variables, thus shedding light on complex behaviors and fostering confidence in the outcomes. In this paper, we present Forte, a visual analytics-based application to explore deep probabilistic net-load forecasting models across various input variables and understand the error rates for different scenarios. With carefully designed visual interventions, this web-based interface empowers scientists to derive insights about model performance by simulating diverse scenarios, facilitating an informed decision-making process. We discuss observations made using Forte and demonstrate the effectiveness of visualization techniques to provide valuable insights into the correlation between weather inputs and net-load forecasts, ultimately advancing grid capabilities by improving trust in forecasting models.

Bhattacharjee, Kaustav↗

Models for Facilitating Government-Funded Activities in the Post-ISS LEO Ecosystem

NASA is preparing for the retirement of the ISS and transition of LEO activities to one or more Commercial LEO Destinations (CLDs) by 2030. This transition necessitates new models for connecting NASA and other government-funded users of the LEO environment to platforms and opportunities. This paper describes for consideration six models for facilitating government-funded activities in the post-ISS LEO ecosystem. These six models are illustrative and represent a wide trade space of potential options, each relying on unique mechanisms for facilitating activities on one or more commercial LEO platforms or vehicles. We assessed each model across three possible future scenarios varying in number and diversity of LEO activities and commercial offerings, and across five stakeholder-driven model evaluation criteria. We present the highlights of the analysis, including ways to modify and strengthen each model. The Government Research Broker model performs best across all future scenarios, followed by Innovation Campus, Anchor Tenant, and Fee for Service. While Matchmaker and Institute Network exhibit positive aspects, these models perform most favorably in future scenarios with well-established communities and markets. While each model has strengths and weaknesses, no single model in its current form performs well across all criteria in all three future scenarios. NASA leadership can adjust models as desired to align closer to their priorities using combinations of unique model mechanisms. A model that meets leadership priorities is likely a combination of features from multiple models.

Erica Rodgers↗

Models for Facilitating Government-Funded Activities in the Post-ISS LEO Ecosystem

NASA is preparing for the retirement of the ISS and transition of LEO activities to one or more Commercial LEO Destinations (CLDs) by 2030. This transition necessitates new models for connecting NASA and other government-funded users of the LEO environment to platforms and opportunities. This paper describes for consideration six models for facilitating government-funded activities in the post-ISS LEO ecosystem. These six models are illustrative and represent a wide trade space of potential options, each relying on unique mechanisms for facilitating activities on one or more commercial LEO platforms or vehicles. We assessed each model across three possible future scenarios varying in number and diversity of LEO activities and commercial offerings, and across five stakeholder-driven model evaluation criteria. We present the highlights of the analysis, including ways to modify and strengthen each model. The Government Research Broker model performs best across all future scenarios, followed by Innovation Campus, Anchor Tenant, and Fee for Service. While Matchmaker and Institute Network exhibit positive aspects, these models perform most favorably in future scenarios with well-established communities and markets. While each model has strengths and weaknesses, no single model in its current form performs well across all criteria in all three future scenarios. NASA leadership can adjust models as desired to align closer to their priorities using combinations of unique model mechanisms. A model that meets leadership priorities is likely a combination of features from multiple models.

Erica Rodgers↗

Models for Facilitating Government-Funded Activities in the Post-ISS LEO Ecosystem

NASA is preparing for the retirement of the ISS and transition of LEO activities to one or more Commercial LEO Destinations (CLDs) by 2030. This transition necessitates new models for connecting NASA and other government-funded users of the LEO environment to platforms and opportunities. This paper describes for consideration six models for facilitating government-funded activities in the post-ISS LEO ecosystem. These six models are illustrative and represent a wide trade space of potential options, each relying on unique mechanisms for facilitating activities on one or more commercial LEO platforms or vehicles. We assessed each model across three possible future scenarios varying in number and diversity of LEO activities and commercial offerings, and across five stakeholder-driven model evaluation criteria. We present the highlights of the analysis, including ways to modify and strengthen each model. The Government Research Broker model performs best across all future scenarios, followed by Innovation Campus, Anchor Tenant, and Fee for Service. While Matchmaker and Institute Network exhibit positive aspects, these models perform most favorably in future scenarios with well-established communities and markets. While each model has strengths and weaknesses, no single model in its current form performs well across all criteria in all three future scenarios. NASA leadership can adjust models as desired to align closer to their priorities using combinations of unique model mechanisms. A model that meets leadership priorities is likely a combination of features from multiple models.

Erica Rodgers↗

The response of stomatal conductance to seasonal drought in tropical forests

Stomata regulate CO2 uptake for photosynthesis and water loss through transpiration. The approaches used to represent stomatal conductance (gs) in models vary. In particular, current understanding of drivers of the variation in a key parameter in those models, the slope parameter (i.e. a measure of intrinsic plant water-use-efficiency), is still limited, particularly in the tropics. Here we collected diurnal measurements of leaf gas exchange and water potential (?leaf), and a suite of plant traits from the upper canopy of 15 tropical trees in two contrasting Panamanian forests throughout the dry season of the 2016 El Niño. The plant traits included wood density, leaf-mass-per-area (LMA), leaf carboxylation capacity (Vc,max25), leaf water content, the degree of isohydry, and predawn ?leaf. We first investigated how the choice of four commonly used leaf-level gs models with and without the inclusion of ?leaf as an additional predictor variable influence the ability to predict gs, and then explored the abiotic (i.e. month, site-month interaction) and biotic (i.e. tree-species-specific characteristics) drivers of slope parameter variation. Our results show that the inclusion of ?leaf did not improve model performance and that the models that represent the response of gs to vapor pressure deficit performed better than corresponding models that respond to relative humidity. Within each gs model, we found large variation in the slope parameter, and this variation was attributable to the biotic driver, rather than abiotic drivers. We further investigated potential relationships between the slope parameter and the six available plant traits mentioned above, and found that only one trait, LMA, had a significant correlation with the slope parameter (R2=0.66, n=15), highlighting a potential path towards improved model parameterization. This study advances understanding of gs dynamics over seasonal drought, and identifies a practical, trait-based approach to improve modeling of carbon and water exchange in tropical forests.

carbon and water exchange, stomatal conductance mo↗

Quantifying Uncertainty in PV Energy Estimates Final Report

Uncertainty in PV energy estimates is "one of the most critical areas of lack of understanding" according to independent engineers, financiers, PV model developers, and other industry stakeholders. The primary problem is a lack of rigorous, transparent, widely accepted methods for quantifying uncertainty in energy production estimates. Uncertainty in energy production estimates arises from variability of the solar resource, inexact PV performance models and their parameters, and system reliability considerations. Uncertainty in annual energy production is frequently calculated for larger projects in order to quantify financial risk. Key statistics for energy, such as the P-values "P50" and "P90" (the annual energy values that are exceeded in future years with 50\% and 90\% probability, respectively) are used by financing institutions to calculate the repayment risk for the project. The current methods to estimate these statistics are typically proprietary, specialized, and involve significant post-processing of commercial performance model results. This black-box approach leads to inconsistent P-value estimates from different parties, which reduces investors' confidence in the results. Since the financial community bases its risk assessment on these estimates, reduced confidence increases perceived project risk, and consequently financing costs. The goal of this project was to establish a set of best practices for quantifying uncertainty in energy production estimates, including identifying what sources of uncertainty must be considered with clear definitions and metrics, determining which sources are the biggest drivers of uncertainty, and providing a computationally efficient framework for combining different sources of uncertainty that is flexible enough to accommodate substitutions of data or methods when better information is available. We engaged a wide set of stakeholders to ensure industry endorsement and adoption, and leveraged complementary projects investigating individual sources of uncertainty in great detail, as well as others' work that started down this path.

ENERGY PLANNING, POLICY, AND ECONOMY,SOLAR ENERGY↗

Causality guided machine learning model on wetland CH 4 emissions across global wetlands

Wetland CH 4 emissions are among the most uncertain components of the global CH 4 budget. The complex nature of wetland CH 4 processes makes it challenging to identify causal relationships for improving our understanding and predictability of CH 4 emissions. In this study, we used the flux measurements of CH 4 from eddy covariance towers (30 sites from 4 wetlands types: bog, fen, marsh, and wet tundra) to construct a causality-constrained machine learning (ML) framework to explain the regulative factors and to capture CH 4 emissions at sub-seasonal scale. We found that soil temperature is the dominant factor for CH 4 emissions in all studied wetland types. Ecosystem respiration (CO 2 ) and gross primary productivity exert controls at bog, fen, and marsh sites with lagged responses of days to weeks. Integrating these asynchronous environmental and biological causal relationships in predictive models significantly improved model performance. More importantly, modeled CH 4 emissions differed by up to a factor of 4 under a +1°C warming scenario when causality constraints were considered. These results highlight the significant role of causality in modeling wetland CH 4 emissions especially under future warming conditions, while traditional data-driven ML models may reproduce observations for the wrong reasons. Our proposed causality-guided model could benefit predictive modeling, large-scale upscaling, data gap-filling, and surrogate modeling of wetland CH 4 emissions within earth system land models.

54 ENVIRONMENTAL SCIENCES↗

Comparative investigations of multi-fidelity modeling on performance of electrostatically-actuated cracked micro-beams

Silicon is a commonly used material for the fabrication of beams for use in micro-electrical-mechanical systems (MEMS). Although silicon is a brittle material, it has been shown to accumulate fatigue damage at the micro-scale. Understanding the effect this has on the overall device performance is critical to the design of reliable devices. Analytical methods for modeling damage provide expedient results but are limited by broad modeling assumptions. Numerical models account for more detailed physical phenomena but can be computationally intensive. In this work, two different crack scenarios are modeled using both analytical techniques and 3D computational simulations. First, the effects of a single surface crack on the static deflection and natural frequency of an electrostatically actuated micro-beam are formulated and compared. Then, a new method for approximating damage associated with realistic distributed crack networks is formulated for use in an analytical model and numerical simulations. A method for utilizing experimentally derived crack statistics to inform the analytical and numerical distributed crack models is developed. Good agreement between the analytical and numerical models is obtained for both crack scenarios. Altogether, these models can be used to effectively simulate a variety of damage and fatigue behaviors in silicon-based MEMS devices.

42 ENGINEERING↗

Intensified Soil Moisture Extremes Decrease Soil Organic Carbon Decomposition: A Mechanistic Modeling Analysis

Earth system models have predicted that there will be more frequent and severe precipitation and drought events in terrestrial ecosystems. Microbially mediated decomposition of soil organic carbon (SOC) tends to increase as soils wet and decrease as soils dry. However, the long-term SOC change under intensified moisture extremes remains poorly known as it depends on the frequency and intensity of soil drying and wetting. In this study, we explored long-term SOC dynamics under scenarios of alternating drying-wetting cycles using the Microbial-ENzyme Decomposition model, a mechanistic microbial model. The model was parameterized with 11 years of observations from a temperate deciduous broadleaf forest site, showing satisfactory model performance in both model calibration (R 2 = 0.67) and validation (R 2 = 0.69) against heterotrophic respiration. We then used the model to simulate the long-term SOC dynamics under five scenarios of alternating drying-wetting cycles with different frequencies and severities over a period of 100 years. Results showed that the changes in active microbial biomass C and the corresponding turnover rates of SOC pools were more sensitive to soil drying than soil wetting. As a result, the cumulative soil carbon emission from microbial respiration decreased by 433.7 g C m -2 after the 100-year simulation in the highest frequency and intensity moisture scenario, but was not significantly affected by the lowest frequency and intensity scenario. This study emphasizes the nonlinear response of SOC decomposition to soil moisture changes, which causes decreased decomposition by microbes under drying that is, not compensated by increased decomposition under wetting conditions.

58 GEOSCIENCES↗

Image-based novel fault detection with deep learning classifiers using hierarchical labels

One important characteristic of modern fault classification systems is the ability to flag the system when faced with previously unseen fault types. This work considers the unknown fault detection capabilities of deep neural network-based fault classifiers. Specifically, we propose a methodology on how, when available, labels regarding the fault taxonomy can be used to increase unknown fault detection performance without sacrificing model performance. To achieve this, we propose to utilize soft label techniques to improve the state-of-the-art deep novel fault detection techniques during the training process and novel hierarchically consistent detection statistics for online novel fault detection. Lastly, we demonstrated increased detection performance on novel fault detection in inspection images from the hot steel rolling process, with results well replicated across multiple scenarios and baseline detection methods.

42 ENGINEERING↗

TX$^2$: Transformer eXplainability and eXploration

The Transformer eXplainability and eXploration (Martindale & Stewart, 2021), or TX 2 software package, is a library designed for artificial intelligence researchers to better understand the performance of transformer models (Vaswani et al., 2017) used for sequence classification. The tool is capable of integrating with a trained transformer model and a dataset split into training and testing populations to produce an ipywidget (Project Jupyter Contributors, 2021) dashboard with a number of visualizations to understand model performance with an emphasis on explainability and interpretability. The TX 2 package is primarily intended to integrate into a workflow centered around Jupyter Notebooks (Kluyver et al., 2016), and currently assumes the use of PyTorch (Paszke et al., 2019) and Hugging Face transformers library (Wolf et al., 2020). The dashboard includes visualization and data exploration features to aid researchers, including an interactive UMAP embedding graph (McInnes et al., 2018) to understand classification clusters, a word salience map that can be updated as researchers alter textual entries in near real time, a set of tools to understand word frequency and importance based on the clusters in the UMAP embedding graph, and a set of traditional confusion matrix analysis tools.

97 MATHEMATICS AND COMPUTING↗

Leveraging design of experiments to build chemometric models for the quantification of uranium (VI) and HNO3 by Raman spectroscopy

Partial least squares regression (PLSR) and support vector regression (SVR) models were optimized for the quantification of U(VI) (10–320 g L −1 ) and HNO 3 (0.6–6 M) by Raman spectroscopy with optimized calibration sets chosen by optimal design of experiments. The designed approach effectively minimized the number of samples in the calibration set for PLSR and SVR by selecting sample concentrations with a quadratic process model, despite complex confounding and covarying spectral features in the spectra. The top PLS2 model resulted in percent root mean square errors of prediction for U(VI), HNO 3 , and NO 3 − of 3.7%, 3.6%, and 2.9%, respectively. PLS1 models performed similarly despite modeling an analyte with a majority linear response (i.e., uranyl symmetric stretch) and another with more covarying vibrational modes (i.e., HNO 3 ). Partial least squares (PLS) model loadings and regression coefficients were evaluated to better understand the relationship between weaker Raman bands and covarying spectral features. Support vector machine models outperformed PLS1 models, resulting in percent root mean square error of prediction values for U(VI) and HNO 3 of 1.5% and 3.1%, respectively. The optimal nonlinear SVR model was trained using a similar number of samples (11) compared with the PLSR model, even though PLS is a linear modeling approach. The generic D-optimal design presented in this work provides a robust statistical framework for selecting training set samples in disparate two-factor systems. This approach reinforces Raman spectroscopy for the quantification of species relevant to the nuclear fuel cycle and provides a robust chemometric modeling approach to bolster online monitoring in challenging process environments.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Active Learning for Rapid Targeted Synthesis of Compositionally Complex Alloys

The next generation of advanced materials is tending toward increasingly complex compositions. Synthesizing precise composition is time-consuming and becomes exponentially demanding with increasing compositional complexity. An experienced human operator does significantly better than a novice but still struggles to consistently achieve precision when synthesis parameters are coupled. The time to optimize synthesis becomes a barrier to exploring scientifically and technologically exciting compositionally complex materials. This investigation demonstrates an active learning (AL) approach for optimizing physical vapor deposition synthesis of thin-film alloys with up to five principal elements. We compared AL-based on Gaussian process (GP) and random forest (RF) models. The best performing models were able to discover synthesis parameters for a target quinary alloy in 14 iterations. We also demonstrate the capability of these models to be used in transfer learning tasks. RF and GP models trained on lower dimensional systems (i.e., ternary, quarternary) show an immediate improvement in prediction accuracy compared to models trained only on quinary samples. Furthermore, samples that only share a few elements in common with the target composition can be used for model pre-training. We believe that such AL approaches can be widely adapted to significantly accelerate the exploration of compositionally complex materials.

Chemistry↗

Program management model study

Two models, a system performance model and a program assessment model, have been developed to assist NASA management in the evaluation of development alternatives for the Earth Observations Program. Two computer models were developed and demonstrated on the Goddard Space Flight Center Computer Facility. Procedures have been outlined to guide the user of the models through specific evaluation processes, and the preparation of inputs describing earth observation needs and earth observation technology. These models are intended to assist NASA in increasing the effectiveness of the overall Earth Observation Program by providing a broader view of system and program development alternatives.

Connelly, J. J.↗

Systems Analysis Of Advanced Coal-Based Power Plants

Report presents appraisal of integrated coal-gasification/fuel-cell power plants. Based on study comparing fuel-cell technologies with each other and with coal-based alternatives and recommends most promising ones for research and development. Evaluates capital cost, cost of electricity, fuel consumption, and conformance with environmental standards. Analyzes sensitivity of cost of electricity to changes in fuel cost, to economic assumptions, and to level of technology. Recommends further evaluation of integrated coal-gasification/fuel-cell integrated coal-gasification/combined-cycle, and pulverized-coal-fired plants. Concludes with appendixes detailing plant-performance models, subsystem-performance parameters, performance goals, cost bases, plant-cost data sheets, and plant sensitivity to fuel-cell performance.

Ferrall, Joseph F.↗