Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “performance modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,153 records · Page 64

Stanford/NASA-Ames Center of Excellence in model-based human performance

The human operator plays a critical role in many aeronautic and astronautic missions. The Stanford/NASA-Ames Center of Excellence in Model-Based Human Performance (COE) was initiated in 1985 to further our understanding of the performance capabilities and performance limits of the human component of aeronautic and astronautic projects. Support from the COE is devoted to those areas of experimental and theoretical work designed to summarize and explain human performance by developing computable performance models. The ultimate goal is to make these computable models available to other scientists for use in design and evaluation of aeronautic and astronautic instrumentation. Within vision science, two topics have received particular attention. First, researchers did extensive work analyzing the human ability to recognize object color relatively independent of the spectral power distribution of the ambient lighting (color constancy). The COE has supported a number of research papers in this area, as well as the development of a substantial data base of surface reflectance functions, ambient illumination functions, and an associated software package for rendering and analyzing image data with respect to these spectral functions. Second, the COE supported new empirical studies on the problem of selecting colors for visual display equipment to enhance human performance in discrimination and recognition tasks.

Wandell, Brian A.↗

KU-Band rendezvous radar performance computer simulation model

The preparation of a real time computer simulation model of the KU band rendezvous radar to be integrated into the shuttle mission simulator (SMS), the shuttle engineering simulator (SES), and the shuttle avionics integration laboratory (SAIL) simulator is described. To meet crew training requirements a radar tracking performance model, and a target modeling method were developed. The parent simulation/radar simulation interface requirements, and the method selected to model target scattering properties, including an application of this method to the SPAS spacecraft are described. The radar search and acquisition mode performance model and the radar track mode signal processor model are examined and analyzed. The angle, angle rate, range, and range rate tracking loops are also discussed.

Griffin, J. W.↗

Mapping canopy defoliation by herbivorous insects at the individual tree level using bi-temporal airborne imaging spectroscopy and LiDAR measurements

Defoliation by herbivorous insects is a widespread forest disturbance driver, affecting global forest health and ecosystem dynamics. Additionally, compared with time- and labor-intensive field surveys, remote sensing provides the only realistic approach to mapping canopy defoliation by herbivorous insects over large spatial and temporal scales. However, the spectral and structural signatures of defoliation by insects at the individual tree level have not been well studied. Additionally, the predictive power of spectral and structural metrics for mapping canopy defoliation has seldom been compared. These critical knowledge gaps prevent us from consistently detecting and mapping canopy defoliation by herbivorous insects across multiple scales. During the peak of a gypsy moth outbreak in Long Island, New York in summer 2016, we leveraged bi-temporal airborne imaging spectroscopy (IS, i.e., hyperspectral imaging) and LiDAR measurements at 1m spatial resolution to explore the spectral and structural signatures of canopy defoliation in a mixed oak-pine forest. We determined that red edge and near-infrared spectral regions within the IS data were most sensitive to crown-scale defoliation severity. LiDAR measurements including B70 (i.e., 70th bincentile height), intensity skewness, and kurtosis were effectively able to detect structural changes caused by herbivorous insects. In addition to canopy leaf loss, increased exposure of understory and non-photosynthetic materials contributed to the detected spectral and structural signatures. Comparing the ability of individual sensors to map canopy defoliation, the LiDAR-only Ordinary Least-Square (OLS) model performed better than the IS-only model (Adj. R-squared = 0.77, RMSE = 15.37% vs. Adj. R- squared = 0.63, RMSE = 19.11%). The IS+LiDAR model improved on performance of the individual sensors (Adj. R-squared = 0.81, RMSE = 14.46%). Our study improves our understanding of spectral and structural signatures of defoliation by herbivorous insects and presents a novel approach for mapping insect defoliation at the individual tree level. Furthermore, with the current and next generation of spaceborne sensors (e.g., WorldView-3, Landsat, Sentinel-2, HyspIRI, and GEDI), higher accuracy and frequent monitoring of insect defoliation may become more feasible across a range of spatial scales, which are critical for ecological research and management of forest resources including the economic consequences of forest insect infestations (e.g., reduced growth and increased mortality), as well as for informing and testing of carbon cycle models.

54 ENVIRONMENTAL SCIENCES↗

An automated and portable method for selecting an optimal GPU frequency

Power consumption poses a significant challenge in current and emerging graphics processing unit (GPU) enabled high-performance computing systems. In modern GPUs, dynamic voltage frequency scaling (DVFS) appears to be a reliable control to regulate power consumption and performance. However, the DVFS design space is large - hence, brute-force approaches are infeasible to select the optimal frequency. Furthermore, no single frequency can be universally optimal for applications with varying computational intensities. Thus, the application's complexity and the availability of a wide range of frequency settings are a challenge in selecting the optimal frequency configuration for a given GPU workload. To that end, this paper proposes a systematic approach that consists of three steps. The feature characterization study identifies the fine-grain GPU utilization metrics that influence the power consumption and execution time of a given workload. To understand the performance, power, and energy consumption behaviors of a workload across GPU's DVFS design space, we derived analytical power and performance models using the identified fine-grain features. Here, it is shown that the same set of GPU utilization metrics can estimate both the power consumption and execution time while being agnostic of changes to frequency and input sizes. Applying a power control with the single objective of reducing power may cause performance degradation, leading to more energy consumption. A multi-objective approach is proposed to select the optimal GPU DVFS configuration for a workload that reduces power consumption with negligible degradation in performance. The evaluation was conducted using SPEC ACCEL benchmarks and three real applications - NAMD LAMMPS, and LSTM on NVIDIA GV100, GA100, and AMD MI210 GPUs. On average, real applications showed 29.6% energy savings with a performance loss of 5.2% on GA100 and 22.6% energy savings with a performance loss of 4.7% on GV100. Moreover, the proposed models are portable to real applications, GPU architectures, and vendors, and require metric collection at only the default frequency rather than all supported DVFS configurations. Additionally, we conducted a comparison between our models and the GPU assembly instructions (PTX)-based static models. The results revealed a significant reduction in the average error rates, with a decrease from 19.7% to 3.1% for power models and from 29.4% to 5.2% for performance models.

97 MATHEMATICS AND COMPUTING↗

Quantifying the robustness of deep multispectral segmentation models against natural perturbations and data poisoning

In overhead image segmentation tasks, including additional spectral bands beyond the traditional RGB channels can improve model performance. However, it is still unclear how incorporating this additional data impacts model robustness to adversarial attacks and natural perturbations. For adversarial robustness, the additional in-formation could improve the model’s ability to distinguish malicious inputs, or simply provide new attack avenues and vulnerabilities. For natural perturbations, the additional information could better inform model decisions and weaken perturbation effects or have no significant influence at all. In this work, we seek to characterize the performance and robustness of a multispectral (RGB and near infrared) image segmentation model subjected to adversarial attacks and natural perturbations. While existing adversarial and natural robustness research has focused primarily on digital perturbations, we prioritize on creating realistic perturbations designed with physical world conditions in mind. For adversarial robustness, we focus on data poisoning attacks whereas for natural robustness, we focus on extending ImageNet-C common corruptions for fog and snow that coherently and self-consistently perturbs the input data. Overall, we find both RGB and multispectral models are vulnerable to data poisoning attacks regardless of input or fusion architectures and that while physically-realizable natural perturbations still degrade model performance, the impact differs based on fusion architecture and input data.

Deep learning, multispectral images, multimodal fu↗

Modeled Retrofit Package Performance for Schools

This report details modeled energy performance and savings from retrofit packages in prototypical school buildings in climate zones throughout the U.S. The information herein serves as a reference for elementary and secondary schools interested in implementing retrofit packages in their facilities for energy savings as well as health and safety benefits. School models developed for simulating package performance differentiated between rural and urban environments. Simulations were run for 10 distinct climate zones covering a range of climate conditions throughout the U.S. Results include savings estimates for electricity, natural gas, CO 2 emissions, and annual utility costs for nine different retrofit packages that combine energy conservation measures, including HVAC controls and equipment upgrades, lighting efficiency upgrades, and electrification technologies such as heat pumps for space conditioning and domestic hot water. Nine additional retrofit packages were also developed for elementary schools and modeled in two climate zones. Appendix B describes the additional retrofit packages and presents savings estimates.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Single Model Characterization

A characterization framework has been developed, demonstrated and deployed for the quantification and categorization of all losses from Nominal Energy to Energy Delivered for operational photovoltaic power plants. Of equal importance is that the same characterization methods can be applied to a priori model outputs. Placing measured and modeled performance data in a single model framework allows a full quantitative, apples to apples, comparison of actual and expected performance.

14 SOLAR ENERGY↗

Inductive Pulsed Plasma Thruster Model with Time-Evolution of Energy and State Properties

A model for pulsed inductive plasma acceleration is presented that consists of a set of circuit equations coupled to both a one-dimensional equation of motion and an equation governing the partitioning of energy. The latter two equations are obtained for the plasma current sheet by treating it as a single element of finite volume and integrating the governing equations over that volume. The integrated terms are replaced where necessary by physically-equivalent quantities that are calculated through the solution of other parts of the governing equation set. The model improves upon previous one-dimensional performance models by permitting the time-evolution of the energy and state properties of the plasma, the latter allowing for the tailoring of the model to different gases that may be chosen as propellants. The time evolution of the various energy modes in the system and the associated plasma properties, calculated for argon propellant, are presented to demonstrate the efficacy of the model. The model produces a result where efficiency is maximized at a given value of the electrodynamic scaling term known as the dynamic impedance parameter. Qualitatively and quantitatively, the model compares favorably with performance measured for two separate inductive pulsed plasma thrusters, with disagreements attributable to simplifying assumptions employed in the generation of the model solution.

Polzin, Kurt A.↗

Using SMAP Level-4 Soil Moisture to Constrain MOD16 Evapotranspiration over the Contiguous USA

Evapotranspiration (ET) is a key hydrologic variable linking the Earth’s water, carbon and energy cycles. At large spatial scales, remote sensing-based (RS) models are often used to quantify ET. Despite the large number of RS ET models available, few include soil moisture as a key environmental input, which can degrade model accuracy and utility. Here, we use model assimilation enhanced soil moisture estimates from the NASA SMAP (Soil Moisture Active Passive) mission as a water supply control in the MOD16 ET algorithm framework. SMAP-derived daily surface (0-5cm depth) and root zone (0-1m depth) soil moisture are used with MODIS (Moderate Resolution Imaging Spectroradiometer) vegetation observations, and 4km gridded regional surface meteorology (Gridmet) as primary inputs for estimating daily ET and underlying model soil and stomatal conductance terms. We calibrated the model environmental response parameters using tower eddy covariance ET observations representing major North American biomes. The model ET results were validated using a holdout set of tower observations spanning a large regional climate gradient. The updated ET estimates outperform the baseline MOD16 product across all tower validation sites (RMSE = 0.758 vs 1.108 mm day-1; R2 = 0.68 vs0.45, respectively). Smaller relative improvements were obtained using a recalibrated model with 4km Gridmet meteorology, but no soil moisture control (RMSE = 0.813 mm day-1; R2 = 0.66), indicating that these changes are essential for the improved model performance. The soil moisture-constrained model improvements and relative benefits from the SMAP observations are greater in arid climates, consistent with stronger soil moisture control on ET in water-limited regions. The use of SMAP soil moisture as an additional model constraint improves MOD16 regional performance and provides a new framework for investigating both soil and atmosphere controls on ET.

SMAP↗

The WACMOS-ET project – Part 1: Tower-scale evaluation of four remote-sensing-based evapotranspiration algorithms

The WAter Cycle Multi-mission Observation Strategy – EvapoTranspiration (WACMOS-ET) project has compiled a forcing data set covering the period 2005–2007 that aims to maximize the exploitation of European Earth Observations data sets for evapotranspiration (ET) estimation. The data set was used to run four established ET algorithms: the Priestley–Taylor Jet Propulsion Laboratory model (PT-JPL), the Penman–Monteith algorithm from the MODerate resolution Imaging Spectroradiometer (MODIS) evaporation product (PM-MOD), the Surface Energy Balance System (SEBS) and the Global Land Evaporation Amsterdam Model (GLEAM). In addition, in situ meteorological data from 24 FLUXNET towers were used to force the models, with results from both forcing sets compared to tower-based flux observations. Model performance was assessed on several timescales using both sub-daily and daily forcings. The PT-JPL model and GLEAM provide the best performance for both satellite- and tower-based forcing as well as for the considered temporal resolutions. Simulations using the PM-MOD were mostly underestimated, while the SEBS performance was characterized by a systematic overestimation. In general, all four algorithms produce the best results in wet and moderately wet climate regimes. In dry regimes, the correlation and the absolute agreement with the reference tower ET observations were consistently lower. While ET derived with in situ forcing data agrees best with the tower measurements ( R 2 = 0.67), the agreement of the satellite-based ET estimates is only marginally lower ( R 2 = 0.58). Results also show similar model performance at daily and sub-daily (3-hourly) resolutions. Overall, our validation experiments against in situ measurements indicate that there is no single best-performing algorithm across all biome and forcing types. In conclusion, an extension of the evaluation to a larger selection of 85 towers (model inputs resampled to a common grid to facilitate global estimates) confirmed the original findings.

54 ENVIRONMENTAL SCIENCES↗

Fishing for Clickbaits in Social Images and Texts with Linguistically-Infused Neural Network Models

This paper presents the results and conclusions of our participation in the Clickbait Challenge 2017 on automatic clickbait detection in social media. We first describe linguistically-infused neural network models and identify informative representations to predict the level of clickbaiting present in Twitter posts. Our models allow to answer the question not only whether a post is a clickbait or not, but to what extent it is a clickbait post e.g., not at all, slightly, considerably, or heavily clickbaity using a score ranging from 0 to 1. We evaluate the predictive power of models trained on varied text and image representations extracted from tweets. Our best performing model that relies on the tweet text and linguistic markers of biased language extracted from the tweet and the corresponding page yields mean squared error (MSE) of 0.04, mean absolute error (MAE) of 0.16 and R2 of 0.43 on the held-out test data. For the binary classification setup (clickbait vs. non-clickbait), our model achieved F1 score of 0.69. We have not found that image representations combined with text yield significant performance improvement yet. Nevertheless, this work is the first to present preliminary analysis of objects extracted using Google Tensorflow object detection API from images in clickbait vs. non-clickbait Twitter posts. Finally, we outline several steps to improve model performance as a part of the future work.

dlickbait challenge, Twitter, neural networks, mac↗

Uncertainty-Guided Prediction Horizon of Phase-Resolved Ocean Wave Forecasting Under Data Sparsity: Experimental and Numerical Evaluation

Accurate short-term wave forecasting is critical for the safe and efficient operation of marine structures that rely on real-time, phase-resolved ocean wave information for control and monitoring purposes (e.g., digital twins). These systems often depend on environmental sensors (e.g., waverider buoys, wave-sensing LIDAR). Challenges arise when upstream sensor data are missing, sparse, or phase-shifted due to drift. This study investigates the performance of two machine learning models, time-series dense encoder (TiDE) and long short-term memory (LSTM), for forecasting phase-resolved ocean surface elevations under varying degrees of data degradation. We introduce the τ-trimming algorithm, which adapts the prediction horizon based on uncertainty thresholds derived from historical forecasts. Numerical wave tank (NWT) and wave basin experiments are used to benchmark model performance under short- and long-term data masking, spatially coarse sensor grids, and upstream phase shifts. Results show under a 50% probability of upstream data loss, the τ-trimmed TiDE model achieves a 46% reduction in error at the most upstream target, compared to 22% for LSTM. Furthermore, phase misalignment in upstream data introduces a near-linear increase in forecast error. Under moderate model settings, a ±3 s misalignment increases the mean absolute error by approximately 0.5 m, while the same error is accumulated at ±4 s using the more conservative approach. These findings inform the design of resilient, uncertainty-aware wave forecasting systems suited for realistic offshore sensing environments.

42 ENGINEERING↗

Performance Efficient Multiresilience Using Checkpoint Recovery in Iterative Algorithms

In this paper, we address the design challenge of building multiresilient iterative high-performance computing (HPC) applications. Multiresilience in HPC applications is the ability to tolerate and maintain forward progress in the presence of both soft errors and process failures. We address the challenge by proposing performance models which are useful to design performance efficient and resilient iterative applications. The models consider the interaction between soft error and process failure resilience solutions. We experimented with a linear solver application with two distinct kinds of soft error detectors: one detector has high overhead and high accuracy, whereas the second has low overhead and low accuracy. We show how both can be leveraged for verifying the integrity of checkpointed state used to recover from both soft errors and process failures. Our results show the performance efficiency and resiliency benefit of employing the low overhead detector with high frequency within the checkpoint interval, so that timely soft error recovery can take place, resulting in less re-computed work.

Ashraf, Rizwan↗

Cold flow testing of the Space Shuttle Main Engine high pressure fuel turbine model

In order to experimentally determine the performance of the Space Shuttle Main Engine (SSME) High Pressure Fuel Turbopump (HPFTP) turbine, a 'cold' air flow turbine test program was established at NASA's Marshall Space Flight Center. As part of this test program, a baseline test of Rocketdyne's HPFTP turbine has been completed. The turbine performance and turbine diagnostics such as airfoil surface static pressure distributions, static pressure drops through the turbine, and exit swirl angles were investigated at the turbine design point, over its operating range, and at extreme off-design points. The data was compared to pretest predictions with good results. The test data has been used to improve meanline prediction codes and is now being used to validate various three-dimensional codes. The data will also be scaled to engine conditions and used to improve the SSME steady-state performance model.

Hudson, Susan T.↗

Effects On Beam Alignment Due To Neutron-Irradiated CCD Images At The National Ignition Facility

The 192 laser beams in the National Ignition Facility (NIF) are automatically aligned to the target-chamber center using images obtained through charged coupled device (CCD) cameras. Several of these cameras are in and around the target chamber during an experiment. Current experiments for the National Ignition Campaign are attempting to achieve nuclear fusion. Neutron yields from these high energy fusion shots expose the alignment cameras to neutron radiation. The present work explores modeling and predicting laser alignment performance degradation due to neutron radiation effects, and demonstrates techniques to mitigate performance degradation. Camera performance models have been created based on the measured camera noise from the cumulative single-shot fluence at the camera location. We have found that the effect of the neutron-generated noise for all shots to date have been well within the alignment tolerance of half a pixel, and image processing techniques can be utilized to reduce the effect even further on the beam alignment.

42 ENGINEERING↗

Assessment of Machine Learning for Ultrasonic Nondestructive Evaluation of Alkali–Silica Reaction in Concrete

Alkali–silica reaction (ASR) is a type of material degradation in concrete structures that leads to concrete cracking and rebar corrosion, thereby reducing the material’s structural integrity and the overall structure’s lifetime and raising safety concerns. Ultrasonic nondestructive evaluation (NDE) has been proven to be a valuable technique for assessing concrete properties and monitoring ASR progression in concrete. However, the deployment and analysis of ultrasonic NDE and its data requires specialized expertise, often relying on the engineer’s subjective interpretation. With the surge in computational power, artificial intelligence (AI) and machine learning (ML) algorithms have become popular in automating NDE data analysis. Various industrial sectors are increasingly adopting ML algorithms for NDE data analysis with a growing emphasis on AI–assisted automation. Regulatory agencies are also preparing for this technological shift, anticipating corresponding revisions in standards. Thus, there is an urgent need to identify the capabilities and limitations of current ML technologies for the evaluation of concrete material properties and damage status. Furthermore, the effects of various factors on ML model performance must be thoroughly investigated. The study summarized herein evaluated the effectiveness of two ML models (i.e., support vector regression (SVR) and deep neural network (DNN)) in predicting concrete material damage induced by ASR based on the long-term ultrasonic monitoring data. Four distinct concrete specimens were cast with artificially induced ASR, and over a period exceeding 500 days, ultrasonic signals and expansion data were continuously collected. For the SVR model, wave velocity and 12 other wave features were extracted from the ultrasonic signals, with 6 out of 13 features selected as input for the model. Different combinations of training and testing datasets were designed to explore factors influencing prediction performance, including the range of data within training and testing sets, in addition to various signal preprocessing methodologies. These findings suggest the importance of using a training dataset with a broader data range compared with testing datasets for improved model performance alongside consistent signal preprocessing across datasets.

36 MATERIALS SCIENCE↗

Simultaneous Dependence of the Earthquake-Size Distribution on Faulting Style and Depth

We analyze two high-quality Southern Californian earthquake catalogues, one with focal mechanisms, to statistically model and test for dependencies of the earthquake-size distribution, the b values, on both faulting style and depth. In our null hypothesis, b is assumed constant. We then develop and calibrate one model based only on faulting style, another based only on depth dependence and two models that assume a simultaneous dependence on both parameters. We develop a new maximum-likelihood estimator corrected for the degrees of freedom to assess models' performances. Our results show that all models significantly reject the null hypothesis. The best performing is the one that simultaneously takes account of depth and faulting style. Our results suggest that differential stress variations in the Earth's crust systematically influence b values and that this variability should be considered for contemporary seismic hazard studies.

54 ENVIRONMENTAL SCIENCES↗