Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “performance modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,423 records · Page 79

ZeoNet: 3D convolutional neural networks for predicting adsorption in nanoporous zeolites

Zeolites are one of the most widely used materials in the chemical industry due to their nanometer-sized pores that can adsorb and react upon molecules selectively. With hundreds of known framework topologies and hundreds of thousands of computationally predicted structures, the ability to rapidly predict zeolite performance allows researchers to prioritize their efforts on the most promising structures for a given application. Although the accuracy of forcefield-based atomistic simulations has advanced significantly in the past two decades, these simulations can be computationally expensive, especially for long-chain, complex molecules. Here, we present ZeoNet, a representation learning framework using convolutional neural networks (ConvNets) and 3D volumetric representations for predicting adsorption in zeolites. ZeoNet was trained on the task of predicting Henry's constants for adsorption, k H , of n-octadecane in more than 330 000 known and predicted zeolite materials. Employing a 3D grid based on the distances to solvent-accessible surfaces, a volumetric representation that can be generated efficiently, the best-performing ZeoNet achieved a correlation coefficient r 2 = 0.977 and a mean-squared error MSE = 3.8 in ln k H , which corresponds to an error of 9.3 kJ mol -1 in adsorption free energy. In comparison, a model based on hand-designed geometric features has values of r 2 = 0.783 and MSE = 35.7. ZeoNet is also relatively efficient and can process ≈8 structures per second on an Nvidia RTX 2080TI GPU, orders of magnitude faster than forcefield-based simulations. A systematic analysis was conducted to investigate how the choice of ConvNet architectures, the linear dimension (L) and spatial resolution (Δd) of the distance grids, batch size, optimizer, and learning rate impact the model performance. We found that ConvNets based on the ResNet architecture offer the best tradeoff between expressiveness and efficiency. The performance for all models reaches a plateau at L = 30–45 Å and depends less sensitively on grid resolution, with a small benefit around Δd = 0.30–0.45 Å. Finally, saliency maps were visualized to identify which regions of the materials contributed the most to model predictions. It was found, interestingly, that the predictions are driven primarily by the accessible pore volume rather than the region occupied by the framework atoms.

36 MATERIALS SCIENCE↗

In Quest of Calibration Density and Consistency in Hydrologic Modeling: Distributed Parameter Calibration against Streamflow Characteristics

Conventional basin-by-basin approaches to calibrate hydrologic models are limited to gauged basins and typically result in spatially discontinuous parameter fields. Moreover, the consequent low calibration density in space falls seriously behind the need from present-day applications like high resolution river hydrodynamic modeling. In this study we calibrated three key parameters of the Variable Infiltration Capacity (VIC) model at every 1/8° grid-cell using machine learning-based maps of four streamflow characteristics for the conterminous United States (CONUS), with a total of 52,663 grid-cells. This new calibration approach, as an alternative to parameter regionalization, applied to ungauged regions too. A key difference made here is that we tried to regionalize physical variables (streamflow characteristics) instead of model parameters whose behavior may often be less well understood. The resulting parameter fields no longer presented any spatial discontinuities and the patterns corresponded well with climate characteristics, such as aridity and runoff ratio. The calibrated parameters were evaluated against observed streamflow from 704/648 (calibration/validation period) small-to-medium-sized catchments used to derive the streamflow characteristics, 3941/3809 (calibration/validation period) small-to-medium-sized catchments not used to derive the streamflow characteristics as well as five large basins. Comparisons indicated marked improvements in bias and Nash-Sutcliffe efficiency. Model performance was still poor in arid and semiarid regions, which is mostly due to both model structural and forcing deficiencies. Although the performance gain was limited by the relative small number of parameters to calibrate, the study and results here served as a proof-of-concept for a new promising approach for fine-scale hydrologic model calibrations.

54 ENVIRONMENTAL SCIENCES↗

Validation of Artemis I Aerothermal Design Models Using Developmental Flight Instrumentation

The inaugural flight of the Space Launch System (SLS) Block 1 launch vehicle, Artemis I, occurred on November 16, 2022, and featured a full suite of Developmental Flight Instrumentation (DFI) that provided aerothermodynamic measurements to assess thermal design and substantiate aerothermodynamic models. The Block 1 launch vehicle aerothermal instrumentation consisted of approximately 277 aerothermal gauges mounted throughout the Orion Multi-Purpose Crew Vehicle (MPCV), Integrated Spacecraft and Payload Element (ISPE), Core Stage (CS) and Solid Rocket Boosters (SRB) and an additional 179 thermal gauges on the Orion Crew Module (CM). Instrumentation included calorimeters, radiometers, pressure transducers, gas temperature probes, and thermocouples. Data was collected from lift-off through CS Main Engine Cut-Off (MECO). The flight data was invaluable for determining aerothermal model performance and developing flight-derived aerothermal environments for flight reconstruction thermal analysis and future SLS aerothermal models. The data offered critical insights into the aerothermodynamic conditions experienced during the launch and ascent of the SLS vehicle. This study compares the flight derived environments to pre-existing design models. The aerothermal models were constructed using MINIVER, the aerothermal engineering code which predicts aerodynamic heating and acts as an integration tool for incorporating databases from computational fluid dynamics (CFD) simulations and wind tunnel test data. The comparisons reveal the fidelity of the design models, highlighting areas where the design models accurately predicted flight conditions and instances where deviations were observed. Preliminary results suggest that while the design models largely aligned with the observed flight data, there were unique observations that reflected needed areas of model refinement. Aerothermal flight data from Artemis I for the SLS Block 1 vehicle will be further utilized to enhance the accuracy of Block 1B and Block 2 aerothermal models, ensuring improved safety and performance for subsequent Artemis missions.

aerothermodynamics↗

Validation of Artemis I Aerothermal Design Models Using Developmental Flight Instrumentation

The inaugural flight of the Space Launch System (SLS) Block 1 launch vehicle, Artemis I, occurred on November 16, 2022, and featured a full suite of Developmental Flight Instrumentation (DFI) that provided aerothermodynamic measurements to assess thermal design and substantiate aerothermodynamic models. The Block 1 launch vehicle aerothermal instrumentation consisted of approximately 277 aerothermal gauges mounted throughout the Orion Multi-Purpose Crew Vehicle (MPCV), Integrated Spacecraft and Payload Element (ISPE), Core Stage (CS) and Solid Rocket Boosters (SRB) and an additional 179 thermal gauges on the Orion Crew Module (CM). Instrumentation included calorimeters, radiometers, pressure transducers, gas temperature probes, and thermocouples. Data was collected from lift-off through CS Main Engine Cut-Off (MECO). The flight data was invaluable for determining aerothermal model performance and developing flight-derived aerothermal environments for flight reconstruction thermal analysis and future SLS aerothermal models. The data offered critical insights into the aerothermodynamic conditions experienced during the launch and ascent of the SLS vehicle. This study compares the flight derived environments to pre-existing design models. The aerothermal models were constructed using MINIVER, the aerothermal engineering code which predicts aerodynamic heating and acts as an integration tool for incorporating databases from computational fluid dynamics (CFD) simulations and wind tunnel test data. The comparisons reveal the fidelity of the design models, highlighting areas where the design models accurately predicted flight conditions and instances where deviations were observed. Preliminary results suggest that while the design models largely aligned with the observed flight data, there were unique observations that reflected needed areas of model refinement. Aerothermal flight data from Artemis I for the SLS Block 1 vehicle will be further utilized to enhance the accuracy of Block 1B and Block 2 aerothermal models, ensuring improved safety and performance for subsequent Artemis missions.

aerothermodynamics↗

A framework for benchmarking land models

Land models, which have been developed by the modeling community in the past few decades to predict future states of ecosystems and climate, have to be critically evaluated for their performance skills of simulating ecosystem responses and feedback to climate change. Benchmarking is an emerging procedure to measure performance of models against a set of defined standards. This paper proposes a benchmarking framework for evaluation of land model performances and, meanwhile, highlights major challenges at this infant stage of benchmark analysis. The framework includes (1) targeted aspects of model performance to be evaluated, (2) a set of benchmarks as defined references to test model performance, (3) metrics to measure and compare performance skills among models so as to identify model strengths and deficiencies, and (4) model improvement. Land models are required to simulate exchange of water, energy, carbon and sometimes other trace gases between the atmosphere and land surface, and should be evaluated for their simulations of biophysical processes, biogeochemical cycles, and vegetation dynamics in response to climate change across broad temporal and spatial scales. Thus, one major challenge is to select and define a limited number of benchmarks to effectively evaluate land model performance. The second challenge is to develop metrics of measuring mismatches between models and benchmarks. The metrics may include (1) a priori thresholds of acceptable model performance and (2) a scoring system to combine data–model mismatches for various processes at different temporal and spatial scales. The benchmark analyses should identify clues of weak model performance to guide future development, thus enabling improved predictions of future states of ecosystems and climate. The near-future research effort should be on development of a set of widely acceptable benchmarks that can be used to objectively, effectively, and reliably evaluate fundamental properties of land models to improve their prediction performance skills.

Biophysical Processes↗

Bayesian performance evaluation of evapotranspiration models based on eddy covariance systems in an arid region

Abstract. Evapotranspiration (ET) is a major component of the land surface processinvolved in energy fluxes and energy balance, especially in the hydrologicalcycle of agricultural ecosystems. While many models have been developed aspowerful tools to simulate ET, there is no agreement on which model bestdescribes the loss of water to the atmosphere. This study focuses on twoaspects, evaluating the performance of four widely used ET models andidentifying parameters, and the physical mechanisms that havesignificant impacts on the model performance. The four tested models arethe Shuttleworth–Wallace (SW) model, Penman–Monteith (PM) model,Priestley–Taylor and Flint–Childs (PT–FC) model, and advection–aridity (AA)model. By incorporating the mathematically rigorous thermodynamicintegration algorithm, the Bayesian model evidence (BME) approach is adoptedto select the optimal model with half-hourly ET observations obtained at aspring maize field in an arid region. Our results reveal that the SW model has thebest performance, and the extinction coefficient is not merely partitioningthe total available energy into the canopy and surface but also includingthe energy imbalance correction. The extinction coefficient is wellconstrained in the SW model and poorly constrained in the PM model but notconsidered in PT–FC and AA models. This is one of the main reasons that theSW model outperforms the other models. Meanwhile, the good fitting of SWmodel to observations can counterbalance its higher complexity. In addition,the detailed analysis of the discrepancies between observations and modelsimulations during the crop growth season indicate that explicit treatmentof energy imbalance and energy interaction will be the primary way offurther improving ET model performance.

54 ENVIRONMENTAL SCIENCES↗

Performance and power modeling and prediction using MuMMI and 10 machine learning methods

Energy-efficient scientific applications require insight into how high performance computing system features impact the applications' power and performance. This insight can result from the development of performance and power models. Here, in this article, we use the modeling and prediction tool MuMMI (Multiple Metrics Modeling Infrastructure) and 10 machine learning methods to model and predict performance and power consumption and compare their prediction error rates. We use an algorithm-based fault-tolerant linear algebra code and a multilevel checkpointing fault-tolerant heat distribution code to conduct our modeling and prediction study on the Cray XC40 Theta and IBM BG/Q Mira at Argonne National Laboratory and the Intel Haswell cluster Shepard at Sandia National Laboratories. Our experimental results show that the prediction error rates in performance and power using MuMMI are less than 10% for most cases. By utilizing the models for runtime, node power, CPU power, and memory power, we identify the most significant performance counters for potential application optimizations, and we predict theoretical outcomes of the optimizations. Based on two collected datasets, we analyze and compare the prediction accuracy in performance and power consumption using MuMMI and 10 machine learning methods.

97 MATHEMATICS AND COMPUTING↗

Anomaly Detection in Seismic Data with Deep Learning: Application for Instrument Failure Detection and Forecasting

Seismic data quality assessment (QA) is the first and one of the most important steps before conducting any further data analysis. Traditional methods involve checking various metrics, such as spike detection and power spectral density, by setting strict thresholds or comparing data against synthetic benchmarks. However, these approaches often rely on pre-existing knowledge and assumptions about data anomalies, leading to potential misclassification of unusual cases. Here, in this study, we propose a deep autoencoder model, an unsupervised learning approach that evaluates data quality without making assumptions about normal and anomalous data, which can be used to identify deviations in recorded data that may indicate nascent instrument failure. We test the model with the U.S. International Monitoring System (IMS) seismic stations and demonstrate the capability of detecting anomalies on a monthly scale. This could prompt station operators to examine potential problems early, allowing sufficient time for instrument maintenance to prevent data outages. In addition, we use a new manually selected testing dataset to compare our model performance against two supervised machine learning (ML) approaches and a standard QA package, as baseline models. When applied to the dataset containing known data anomalies, performance of the supervised and unsupervised ML approaches is similar, with an accuracy of 88.1% for our model compared to ∼90% for the supervised ML approach and 78.2% for the standard QA package. Our model outperforms the baseline models when applied to new stations, where new types of data anomalies can be station-specific and not included in the training dataset. Finally, we show model transferability by training the model with data from the Global Seismograph Network only and applying it to the IMS network data. The results suggest that our model is generalizable and can be applied to new stations with good accuracy.

Lin, Jiun-Ting [Lawrence Livermore National Labora↗

Model-Scale Aerodynamic Performance Testing of Proposed Modifications to the NASA Langley Low Speed Aeroacoustic Wind Tunnel

Tests were performed on a 1/20th-scale model of the Low Speed Aeroacoustic Wind Tunnel to determine the performance effects of insertion of acoustic baffles in the tunnel inlet, replacement of the existing collector with a new collector design in the open jet test section, and addition of flow splitters to the acoustic baffle section downstream of the test section. As expected, the inlet baffles caused a reduction in facility performance. About half of the performance loss was recovered by addition the flow splitters to the downstream baffles. All collectors tested reduced facility performance. However, test chamber recirculation flow was reduced by the new collector designs and shielding of some of the microphones was reduced owing to the smaller size of the new collector. Overall performance loss in the facility is expected to be a 5 percent top flow speed reduction, but the facility will meet OSHA limits for external noise levels and recirculation in the test section will be reduced.

Booth, Earl R., Jr.↗

Prediction of Potential and Actual Evapotranspiration Fluxes Using Six Meteorological Data-Based Approaches for a Range of Climate and Land Cover Types

Evapotranspiration is the major component of the water cycle, so a correct estimate of this variable is fundamental. The purpose of the present research is to assess the monthly scale accuracy of six meteorological data-based models in the prediction of evapotranspiration (ET) losses by comparing the modelled fluxes with the observed ones from eight sites equipped with eddy covariance stations which differ in terms of vegetation and climate type. Three potential ET methods (Penman-Monteith, Priestley-Taylor, and Blaney-Criddle models) and three actual ET models (the Advection-Aridity, the Granger and Gray, and the Antecedent Precipitation Index method) have been proposed. The findings show that the models performances differ from site to site and they depend on the vegetation and climate characteristics. Indeed, they show a wide range of error values ranging from 0.18 to 2.78. It has been not possible to identify a single model able to outperform the others in each biome, but in general, the Advection-Aridity approach seems to be the most accurate, especially when the model calibration in not carried out. It returns very low error values close to 0.38. When the calibration procedure is performed, the most accurate model is the Granger and Gray approach with minimum error of 0.13 but, at the same time, it is the most impacted by this process, and therefore, in a context of data scarcity, it results the less recommended for ET prediction. The performances of the investigated ET approaches have been furthermore tested in case of lack of measured data of soil heat fluxes and net radiation considering using empirical relationships based on meteorological data to derive these variables. Results show that, the use of empirical formulas to derive ET estimates increases the errors up to 200% with the consequent loss of model accuracy.

net radiation↗

Performance of Allison Model 400-C6 Turbojet-Engine Compressor: Over-All Performance Characteristics of Compressor at Equivalent Impeller Speeds of 6000, 7000, and 8500 RPM - I

The Allison model 400-C6 compressor was operated at an inlet pressure of 12 inches of mercury absolute ana ambient inlet temperature at equivalent impeller speeds of 6000, 7000, and 8500 rpm. Additional runs at an equivalent speed of 7000 rpm and ambient inlet temperature were made at inlet pressures from 7 to 22 inches of mercury absolute. The results of this investigation are compared with those of the 533-A-23 compressors. For the speeds investigated, the Allison model 400-C6 compressor had a maximum adiabatic temperature-rise efficiency of 0.768 at an equivalent speed of 7000 rpm; the corresponding equivalent weight flow was 45.0 pounds per second and the pressure ratio was 1.83. At an equivalent impeller speed of 8500 rpm, the maximum equivalent weight flow was 61.6 pounds per second and the peak pressure ratio of 2.38 occurred at an equivalent weight flow of 52.2 pounds per 1 second and an adiabatic temperature-rise efficiency of 0.714. At an equivalent speed of 7000 rpm, increasing the compressor- inlet pressure increased the maximum equivalent weight flow and the pressure ratio.

Kovach, Karl↗

Queuing Models of Tertiary Storage

Large scale scientific projects generate and use large amounts of data. For example, the NASA Earth Observation System Data and Information System (EOSDIS) project is expected to archive one petabyte per year of raw satellite data. This data is made automatically available for processing into higher level data products and for dissemination to the scientific community. Such large volumes of data can only be stored in robotic storage libraries (RSL's) for near-line access. A characteristic of RSL's is the use of a robot arm that transfers media between a storage rack and the read/write drives, thus multiplying the capacity of the system. The performance of the RSL's can be a critical limiting factor for the performance of the archive system. However, the many interacting components of an RSL make a performance analysis difficult. In addition, different RSL components can have widely varying performance characteristics. This paper describes our work to develop performance models of an RSL in isolation. Next we show how the RSL model can be incorporated into a queuing network model. We use the models to make some example performance studies of archive systems. The models described in this paper, developed for the NASA EODIS project, are implemented in C with a well defined interface. The source code, accompanying documentation, and also sample JAVA applets are available at: http://www.cis.ufl.edu/~ted/

Johnson, Theodore↗

A Service Oriented Architecture for Exploring High Performance Distributed Power Models

Power grids are increasingly incorporating high quality, high throughput sensor devices inside power distribution networks. These devices are driving an unprecedented increase in the volume and rate of available information. The real-time requirements for handling this data are beyond the capacity of conventional power models running in central utilities. Hence, we are exploring distributed power models deployed at the regional scale. The connection of these models for a larger geographic region is supported by a distributed system architecture. This architecture is built in a service oriented style, whereby distributed power models running on high performance clusters are exposed as services. Each service is semantically annotated and therefore can be discovered through a service catalog and composed into workflows. The overall architecture has been implemented as an integrated workflow environment useful for power researchers to explore newly developed distributed power models.

Service oriented architecture, high performance co↗

Humans to Mars, but How Many? Using Training Requirements Modeling to Inform Crew Size

Missions to Mars will differ from previous human spaceflight missions in that the onboard crew of astronauts will be required to operate in an Earth-independent manner due to the long communication delays. Without a systematic, repeatable process to determine the number and composition of crew necessary to successfully accomplish these missions, NASA increases the risk that crew sizes may be too small to meet primary mission objectives under nominal conditions and, more consequentially, that crewmembers may not have the expertise needed to successfully respond to unforeseen failures without the real-time expertise of the Mission Control Central (MCC) team NASA currently relies upon. The NASA Engineering and Safety Center (NESC) is developing a methodology for assessing the trade space of factors that affect the number of crew for future missions. This methodology includes the consideration of results from three human performance models developed using the Improved Performance Research and Integration Tool (IMPRINT) modeling platform as well as a custom-built model on expertise trained within the crew. The IMPRINT results will be presented in the modeling and simulation sub-tag. Here we present results of a model based on NASA’s crew qualification and responsibility matrix (CQRM), a tool used to identify the crew qualifications for each area of responsibility (operation, system, and payload) for a mission. The model outputs an optimized allocation of training assignments along with a flight-assigned CQRM that can be used to consider the expertise that can be trained within a crew of a given size. We discuss the CQRM model result implications on the trade space for Mars mission crew size.

Mars↗

Humans to Mars, but How Many? Using Training Requirements Modeling to Inform Crew Size

Missions to Mars will differ from previous human spaceflight missions in that the onboard crew of astronauts will be required to operate in an Earth-independent manner due to the long communication delays. Without a systematic, repeatable process to determine the number and composition of crew necessary to successfully accomplish these missions, NASA increases the risk that crew sizes may be too small to meet primary mission objectives under nominal conditions and, more consequentially, that crewmembers may not have the expertise needed to successfully respond to unforeseen failures without the real-time expertise of the Mission Control Central (MCC) team NASA currently relies upon. The NASA Engineering and Safety Center (NESC) is developing a methodology for assessing the trade space of factors that affect the number of crew for future missions. This methodology includes the consideration of results from three human performance models developed using the Improved Performance Research and Integration Tool (IMPRINT) modeling platform as well as a custom-built model on expertise trained within the crew. The IMPRINT results will be presented in the modeling and simulation sub-tag. Here we present results of a model based on NASA’s crew qualification and responsibility matrix (CQRM), a tool used to identify the crew qualifications for each area of responsibility (operation, system, and payload) for a mission. The model outputs an optimized allocation of training assignments along with a flight-assigned CQRM that can be used to consider the expertise that can be trained within a crew of a given size. We discuss the CQRM model result implications on the trade space for Mars mission crew size.

Mars↗

Quantifying spectral albedo effects on bifacial photovoltaic module measurements and system model predictions

We provide a comprehensive analysis of the effect of spectral albedo on photovoltaic (PV) module measurements and system model predictions. We demonstrate how to account for albedo in indoor bifacial device measurements by adjusting the applied irradiance using the scaled rear irradiance method, exemplified on fabricated silicon heterojunction (SHJ) modules. System model performance is studied using a detailed 3D finite-element model, DUET, for fixed-tilt and horizontal single-axis tracked (SAT) arrays between 15 and 75°N. Spectral effects cause variations in measured SHJ module short-circuit current up to 2% and efficiency variation up to 0.3% abs. We further demonstrate that rear-side spectral mismatch factors (SMMs) resulting from including or omitting spectral albedo in PV system modeling vary between ±13%, while total (front+rear) SMMs vary up to 3%, depending on the deployment configuration and latitude. SAT array SMMs are weakly correlated with latitude, while fixed-tilt array SMMs increase with latitude, driven by an increasing proportion of ground-reflected light on the front-side of modules. Ground-reflections can constitute between 2% and 32% of total incident module irradiance, with notably high (>10%) contributions for fixed-tilt arrays at high latitude. Effects of spectral albedo are most significant for: (1) fixed-tilt deployments at high latitudes, (2) wide bandgap technologies such as perovskite and cadmium telluride cells, (3) albedos which vary steeply over the technology's absorption range, and (4) high albedo ground covers. Overall, we demonstrate that omitting spectral albedo effects can result in PV measurement and system-level modeling uncertainties on the order of several percent in these cases.

14 SOLAR ENERGY↗

Steady-state fuel performance analyses for the preliminary fuel concept of general atomics fast modular reactor

Here this manuscript presents the fuel performance analysis results of the General Atomics Fast Modular Reactor (FMR) based on an axi-symmetric (2D-RZ) geometry. Three fuel performance model sets that fit the FMR fuel specifications best, i.e., a BISON baseline model set, a BISON diffusion enhancement model set, and a BISON-FASTGRASS model set, were identified and evaluated against a series of relevant experimental cases featuring high burnup and low irradiation temperature conditions. The three BISON-based model sets were then utilized to conduct a comprehensive fuel performance analysis of the FMR fuel under normal operation including the shutdown/restarting periods for refueling. The evaluation of the fuel performance parameters, represented by temperature, internal pressure, stress, and strain, shows that the FMR fuel maintains its thermal and mechanical integrity during normal operation. Technology gaps and limitations are also discussed to guide future efforts for extending the performance analysis to transient scenarios as well as improving the fuel performance evaluation through experiments.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗