Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “performance model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 955 records · Page 53

Systematic Benchmarking of Climate Models: Methodologies, Applications, and New Directions

As climate models become increasingly complex, there is a growing need to comprehensively and systematically assess model performance with respect to observations. Given the increasing number and diversity of climate model simulations in use, the community has moved beyond simple model intercomparison and toward developing methods capable of benchmarking a large number of simulations against a suite of climate metrics. Here, we present a detailed review of evaluation and benchmarking methods and approaches developed in the last decade, focusing primarily on scientific implications for Coupled Model Intercomparison Project (CMIP) simulations and CMIP6 results that contributed to the Intergovernmental Panel on Climate Change (IPCC) Sixth Assessment Report (AR6). Based on this review, we explain the resulting contemporary philosophy of model benchmarking, and provide clear distinctions and definitions of the terms model verification, process validation, evaluation, and benchmarking. While significant progress has been made in model development based on systematic evaluation and benchmarking efforts, some climate system biases still remain. The development of open‐source community software packages has played a fundamental role in identifying areas of significant model improvement and bias reduction. We review the key features of several software packages that have been commonly used over the past decade to evaluate and benchmark global and regional climate models. Additionally, we discuss best practices for the selection of evaluation and benchmarking metrics and for interpreting the obtained results, the importance of selecting suitable sources of reference data and accurate uncertainty quantification.

Environmental sciences↗

Transfer learning for analysis of collective and non-collective Thomson scattering spectra

Thomson scattering (TS) diagnostics provide reliable, minimally perturbative measurements of fundamental plasma parameters, such as electron density (⁠n e ) and electron temperature (⁠T e ⁠). Deep neural networks can provide accurate estimates of ⁠n e and T e when conventional fitting algorithms may fail, such as when TS spectra are dominated by noise, or when fast analysis is required for real-time operation. Although deep neural networks typically require large training sets, transfer learning can improve model performance on a target task with limited data by leveraging pre-trained models from related source tasks, where select hidden layers are further trained using target data. We present five architecturally diverse deep neural networks, pre-trained on synthetic TS data and adapted for experimentally measured TS data, to evaluate the efficacy of transfer learning in estimating n e and T e in both the collective and non-collective scattering regimes. We evaluate errors in n e and T e estimates as a function of training set size for models trained with and without transfer learning, and we observe decreases in model error from transfer learning when the training set contains ≲ 200 experimentally measured spectra.

Artificial neural networks↗

Understanding water and energy fluxes in the Amazonia: Lessons from an observation‐model intercomparison

Abstract Tropical forests are an important part of global water and energy cycles, but the mechanisms that drive seasonality of their land‐atmosphere exchanges have proven challenging to capture in models. Here, we (1) report the seasonality of fluxes of latent heat (LE), sensible heat ( H ), and outgoing short and longwave radiation at four diverse tropical forest sites across Amazonia—along the equator from the Caxiuanã and Tapajós National Forests in the eastern Amazon to a forest near Manaus, and from the equatorial zone to the southern forest in Reserva Jaru; (2) investigate how vegetation and climate influence these fluxes; and (3) evaluate land surface model performance by comparing simulations to observations. We found that previously identified failure of models to capture observed dry‐season increases in evapotranspiration (ET) was associated with model overestimations of (1) magnitude and seasonality of Bowen ratios (relative to aseasonal observations in which sensible was only 20%–30% of the latent heat flux) indicating model exaggerated water limitation, (2) canopy emissivity and reflectance (albedo was only 10%–15% of incoming solar radiation, compared to 0.15%–0.22% simulated), and (3) vegetation temperatures (due to underestimation of dry‐season ET and associated cooling). These partially compensating model‐observation discrepancies (e.g., higher temperatures expected from excess Bowen ratios were partially ameliorated by brighter leaves and more interception/evaporation) significantly biased seasonal model estimates of net radiation ( R n ), the key driver of water and energy fluxes (LE ~ 0.6 R n and H ~ 0.15 R n ), though these biases varied among sites and models. A better representation of energy‐related parameters associated with dynamic phenology (e.g., leaf optical properties, canopy interception, and skin temperature) could improve simulations and benchmarking of current vegetation–atmosphere exchange and reduce uncertainty of regional and global biogeochemical models.

Restrepo‐Coupe, Natalia↗

Summary Report on the Refined User Requirements for U.S. Fusion Prototypic Neutron Source

The Fusion Prototypic Neutron Source (FPNS) is proposed as an urgent near-term facility necessary for understanding D-T fusion neutron degradation processes in materials and for the development of high-performance radiation tolerant materials for fusion power reactors. This facility is central to our goal of predicting the behavior of materials in the harsh D-T neutron environment and calibrating and verifying the materials performance models necessary to support design of next-generation fusion reactors. Key FPNS performance metrics were previously defined for the cost-efficient facility necessary to adequately and expediently resolve key materials science knowledge gaps required to move to next-step fusion devices. This brief report is intended to expand upon this previous metrics discussion as an aid to selecting the most desirable FPNS concept and enabling a facility that meets the program needs.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Defect Thermodynamics and Transport Properties of Proton Conducting Perovskite Electrode and Electrolyte Materials Evaluated Based on Density Functional Theory Modeling

Both electron-rich and electron-poor perovskite oxides have been used in solid oxide cell applications as electrode and electrolyte materials. The rich oxygen defect chemistry and its coupling to temperature, hydrogen-steam or oxygen-steam gas pressure, or to the applied potentials creates enormous complexities for modeling performance and degradation of the materials. Herein, density functional theory-based thermodynamic modeling was carried out to describe the defect chemistry and transport properties of the proton-conducting electrolyte BaZr1-xYxO3-δ (x≤0.1) and of the triple-conducting perovskite (La,Ba)(Fe,M)O3-δ (M=Y and Zr). The defect thermodynamics of intrinsic point defects and the hydrogen-related defect reactions were solved in integrated defect models and further used to predict the Brouwer diagram and the transport properties of the functional perovskites. For the electron-poor electrolytes BaZr0.9Y0.1O3-δ, the developed model has been used to describe the experimental transport properties in the SOC operating conditions. Specifically, the roles played by the acceptor-bound holes and the intrinsic and hydrogen point defects upon the conductivities of holes, protons, and oxygen vacancies under the hydrogen-rich and oxygen-rich conditions at various humidity levels were demonstrated. A defect modeling tool was also developed for the triple-conducting perovskite (La,Ba)(Fe,M)O3-δ (M=Y and Zr) to examine magnetic effects and hydride defects in defect equilibria.

defect thermodynamics↗

Technoeconomic Opportunity Analysis for Local Power Generation in Falls City, Nebraska

Falls City is a small community in Nebraska interested in understanding how energy from local energy systems could support the community's economic development planning. To address the current community needs and address the future energy demand technical assistance conducted through the Communities Local Energy Action Program (Communities LEAP) assessed the technical and economic opportunities of adding energy technologies to Falls City's municipally owned and operated electric utility system. The modeling performed considered the technical and economic feasibility of technologies using the System Advisor Model (SAM). The modeling explored three technology configurations using multiple years of historical weather and wholesale cost data (2015-2022 & a typical meteorological year), and two different wholesale escalation rates (0.3% and 2.5%). Wholesale energy prices were based on the Southwest Power Pool's (SPP) real-time energy market and the annual escalation rates of these rates based on historical SPP wholesale and national retail electricity price trends. Results from the modeling showed that at current CAPEX costs and SPP wholesale electricity costs no technology combination averaged across the scenarios run provide a positive net present value (NPV). External financial support, changes in market conditions, and additional revenue streams would help create more economically favorable projects. As conditions change re-evaluation may be necessary.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Models and techniques for evaluating the effectiveness of aircraft computing systems

The development of system models that can provide a basis for the formulation and evaluation of aircraft computer system effectiveness, the formulation of quantitative measures of system effectiveness, and the development of analytic and simulation techniques for evaluating the effectiveness of a proposed or existing aircraft computer are described. Specific topics covered include: system models; performability evaluation; capability and functional dependence; computation of trajectory set probabilities; and hierarchical modeling of an air transport mission.

Meyer, J. F.↗

3D inelastic analysis methods for hot section components

The objective is to develop analytical tools capable of economically evaluating the cyclic time dependent plasticity which occurs in hot section engine components in areas of strain concentration resulting from the combination of both mechanical and thermal stresses. Three models were developed. A simple model performs time dependent inelastic analysis using the power law creep equation. The second model is the classical model of Professors Walter Haisler and David Allen of Texas A and M University. The third model is the unified model of Bodner, Partom, et al. All models were customized for linear variation of loads and temperatures with all material properties and constitutive models being temperature dependent.

Dame, L. T.↗

HPF Implementation of NPB2.3

We present the HPF implementation of BT, SP, LU, FT, and MG of NPB2.3-serial benchmark set, The implementation is based on HPF performance model of the benchmark specific operations with distributed arrays. We present profiling and performance data on SGI origin 2000 and compare the results with NPB2.3. We discuss advantages and limitations of HPF and pghpf compiler.

Frumkin, Michael↗

Satellite-Based Spatiotemporal Trends in PM2.5 Concentrations: China 2004-2013

Three decades of rapid economic development is causing severe and widespread PM2.5(particulate matter (is) less than 2.5 ) pollution in China. However, research on the health impacts of PM2.5 exposure has been hindered by limited historical PM2.5 concentration data. We estimated ambient PM2.5 concentrations from 2004 to 2013 in China at 0.1 deg resolution using the most recent satellite data and evaluated model performance with available ground observations. We developed a two-stage spatial statistical model using the Moderate Resolution Imaging Spectroradiometer (MODIS) Collection 6 aerosol optical depth (AOD) and assimilated meteorology, land use data, and PM2.5 concentrations from China's recently established ground monitoring network. An inverse variance weighting (IVW) approach was developed to combine MODIS Dark Target and Deep Blue AOD to optimize data coverage. We evaluated model predicted PM2.5 concentrations from 2004 to early 2014 using ground observations. The overall model cross-validation R(sup 2) and relative prediction error were 0.79 and 35.6%, respectively. Validation beyond the model year (2013) indicated that it accurately predicted PM(sub 2.5) concentrations with little bias at the monthly (R(sup 2) = 0.73), regression slope = 0.91) and seasonal (R(sup 2) = 0.79), regression slope = 0.92) levels. Seasonal variations revealed that winter was the most polluted season and that summer was the cleanest season. Analysis of predicted PM2.5 levels showed a mean annual increase of 1.97 micro-g/cu cm between 2004 and 2007 and a decrease of 0.46 micro-g/cu cm between 2008 and 2013. Our satellite-driven model can provide reliable historical PM2.5 estimates in China at a resolution comparable to those used in epidemiologic studies on the health effects of long-term PM2.5 exposure in North America. This data source can potentially advance research on PM2.5 health effects in China.

satellite remote sensing↗

Regional Replay: A Unique Reanalysis-Based Tool for Addressing Model Error

Understanding and correcting errors in general circulation and climate models has long been part intuition and part trial and error. Efforts to diagnose the errors and provide some guidance to developers have been of some value, though such efforts, with few exceptions, have been more successful in identifying and documenting the errors in the model simulations rather than the model deficiencies that produced them. Modern atmospheric reanalyses such as MERRA-2 provide much-improved estimates of our climate system at hourly to interannual and longer time scales and have become an important tool for assessing model performance. Here we use MERRA-2 to address biases in the NASA/GMAO GEOS model by employing a "regional replay" approach developed in the GMAO. The regional replay approach constrains the model to remain close to the reanalysis over arbitrary regions and selected model variables, thus allowing us to examine how model error generated over one area is spatially translated across the globe. Several examples are given including an assessment of the global impact of errors produced over the Tibet region.

Tibet Region↗

Creating Systems Engineering Products with Executable Models in a Model-Based Engineering Environment

Applying systems engineering across the life-cycle results in a number of products built from interdependent sources of information using different kinds of system level analysis. This paper focuses on leveraging the Executable System Engineering Method (ESEM) which automates requirements verification (e.g. power and mass budget margins and duration analysis of operational modes) using executable SysML models. The particular value proposition is to integrate requirements, and executable behavior and performance models for certain types of system level analysis. The models are created with modeling patterns that involve structural, behavioral and parametric diagrams, and are managed by an open source Model Based Engineering Environment (named OpenMBEE). This paper demonstrates how the ESEM is applied in conjunction with OpenMBEE to create key engineering products (e.g. operational concept document) for the Alignment and Phasing System (APS) within the Thirty Meter Telescope (TMT) project, which is under development by the TMT International Observatory (TIO).

MBSE↗

Modeling Phenological Controls on Carbon Dynamics in Dryland Sagebrush Ecosystems

Dryland ecosystems play an important role in determining how precipitation anomalies affect terrestrial carbonfluxes at regional to global scales. Thus, to understand how climate change may affect the global carbon cycle,we must also be able to understand and model its effects on dryland vegetation. Dynamic Global VegetationModels (DGVMs) are an important tool for modeling ecosystem dynamics, but they often struggle to reproduceseasonal patterns of plant productivity. Because the phenological niche of many plant species is linked to bothtotal productivity and competitive interactions with other plants, errors in how process-based models representphenology hinder our ability to predict climate change impacts. This may be particularly problematic in drylandecosystems where many species have developed a complex phenology in response to seasonal variability in bothmoisture and temperature. Here, we examine how uncertainty in key parameters as well as the structure ofexisting phenology routines affect the ability of a DGVM to match seasonal patterns of leaf area index (LAI) andgross primary productivity (GPP) across a temperature and precipitation gradient. First, we optimized modelparameters using a combination of site-level eddy covariance data and remotely-sensed LAI data. Second, wemodified the model to include a semi-deciduous phenology type and added flexibility to the representation ofgrass phenology. While optimizing parameters reduced model bias, the largest gains in model performance wereassociated with the development of our new representation of phenology. This modified model was able to bettercapture seasonal patterns of both leaf area index (R2=0.75) and gross primary productivity (R2=0.84), thoughits ability to estimate total annual GPP depended on using eddy covariance data for optimization. The new modelalso resulted in a more realistic outcome of modeled competition between grass and shrubs. These findingsdemonstrate the importance of improving how DGVMs represent phenology in order to accurately forecastclimate change impacts in dryland ecosystems.

Ecosystem model Phenology Parameter optimization E↗

Instrumentation for Measuring Entry Radiative Heating - Past, Present, and Future

Radiative heating can be a significant contributor to the total heat load during atmospheric entry, especially for large vehicles with high entry velocties. For example, the stagnation region heat load derived from thermocouples embedded in the thermal protection system (TPS)of the Mars Science Laboratory (MSL) heatshield did not match the unmargined pre-flight predictions. This was at least partially attributed to the fact that radiative heating was not accounted for in the unmargined pre-flight predictions [2].Since MSL, significant work has been done to update radiative heating models and test how the models perform compared to ground-based test facilities such as shock tubes. The models and ground-based tests have shown that radiative heating can be significant for entry into the atmospheres of Venus, Earth, Mars, and Titan, among other planetary bodies. However, there are still discrepancies between the models and the test data, which is where the desire for flight data comes in to play. Missions that have had or are currently planned to have instrumentation to measure radiative heating during atmospheric entry are listed in Table 1.

R A Miller↗

Planned Investigations to Address Acute Central Nervous System Effects of Space Radiation Exposure with Human Performance Data

This work intends to generate evidence of acute, incremental human performance decrement similar to that due to space radiation andits impacts on the brain, to accompany ongoing human performance modeling work. The planned work will explore the boundaries of human behavioral and performance decrement after exposure to stress, which may be expected based in part on rodent responses found afterexposure to ionizing radiation. The collection of evidence via simulation studies can characterize real human errors toward determining what stress levels lead to significantly-low levels of performance (below permissible outcome limits) which would imperilmission accomplishment. If mission-relevant animal-study-linked tasks are used, human and animal performance levels may be aligned to enable quantitative assignment of permissible exposure limits based on animal exposure studies. Ultimately, a transfer function between the performances of exposed rodents and humans under stress can be developed using shared impairment mechanisms.

human performance↗

Planned Investigations to Address Acute Central Nervous System Effects of Space Radiation Exposure with Human Performance Data

This work intends to generate evidence of acute, incremental human performance decrement similar to that due to space radiation and its impacts on the brain, to accompany ongoing human performance modeling work. The planned work will explore the boundaries of human behavioral and performance decrement after expo-sure to stress, which may be expected based in part on rodent responses found after exposure to ionizing radiation. The collection of evidence via simulation studies can characterize real human errors toward determining what stress levels lead to significantly-low levels of performance (below permissible outcome limits) which would imperil mission accomplishment. If mission-relevant yet animal-study-linked tasks are used, human and animal performance levels may be aligned to enable quantitative assignment of permissible exposure limits based on animal exposure studies. Ultimately, a transfer function between the performances of exposed rodents and humans under stress can be developed using shared impairment mechanisms.

human performance↗

Semantic Search with Sentence-BERT for Design Information Retrieval

Managing and referencing design knowledge is a critical activity in the design process. However, reliably retrieving useful knowledge can be a frustrating experience for users of knowledge management systems due to inherent limitations of standard keyword-based searches. In this research, we consider the task of retrieving relevant lessons learned from the NASA Lessons Learned Information System (LLIS). To this end, we apply a state-of-the-art natural language processing (NLP) technique for information retrieval (IR): semantic search with sentence-BERT, which is a modification of a Bidirectional Encoder Representations from Transformers (BERT) model that uses siamese and triplet network architectures to obtain semantically meaningful sentence embeddings. While the pre-trained sBERT model performs well out-of-the-box, we further fine-tune the model on data from the LLIS so that it learns on design engineering-relevant vocabulary. We quantify the improvement in query results using both standard sBERT and fine-tuned sBERT over a keyword search. Our use case throughout the paper is to use queries related to specific requirements from a NASA project. Fine tuning the sBERT model on LLIS data yields a mean average precision (MAP) of 0.807 on queries based on information needs from a real NASA project. Results indicate that applying state-of-the-art natural language processing techniques, especially when finetuned using engineering data, to design information retrieval tasks shows significant promise in modernizing design knowledge management systems.

Hannah S. Walsh↗

The Case for a 50+ Year Radioisotope Power System

The Johns Hopkins University Applied Physics Laboratory (JHU/APL) is leading the NASA funded Interstellar Probe study to explore the “Very Local” interstellar medium. To perform this exploration the mission will be required to last at least 50 years in regions of space where solar power is no longer practical. Additionally, several new studies for the National Academies’ Planetary Science and Astrobiology Decadal Survey are planning missions lasting 20-35 years. The Decadal Survey is used to build consensus on priority of national science goals. These proposed missions are inconsistent with the NASA’s current Radioisotope Power Systems (RPS) life requirement of 14 years (flight). Paramount to these proposed long-duration missions are questions about the longevity of such a mission. Evidence exists that space-borne Radioisotope Power Systems can indeed last a long time. LES-9, Voyager I, and Voyager II are over 40 years old, LES-8, Pioneer 10, and Pioneer 11 lasted 28, 30, and 22 years, respectively, and New Horizons is still active 15 years after launch. This paper explores the need for RPS designs that are intended to last much longer than the current requirement of 14 years (17 years after fueling) and explores the historical record for actual vs design lifetimes to show the feasibility of building long lasting RPS. We also exercise a current RTG performance model of the General-Purpose Heat Source RTG using the JPL Lifetime Performance Prediction (LPP) tool to make top-level inferences about power output at end-of-mission, and discusses how reliability engineering and testing methods can be brought to bear to increase confidence in delivering sufficient power at end-of-mission.

Phan, Brian↗