Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “performance modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 613 records · Page 34

Human Engineering Modeling and Performance Lab Study Project

The HEMAP (Human Engineering Modeling and Performance) Lab is a joint effort between the Industrial and Human Engineering group and the KAVE (Kennedy Advanced Visualiations Environment) group. The lab consists of sixteen camera system that is used to capture human motions and operational tasks, through te use of a Velcro suit equipped with sensors, and then simulate these tasks in an ergonomic software package know as Jac, The Jack software is able to identify the potential risk hazards.

Technology Portfolio System↗

Exploring Randomly Wired Neural Networks for Climate Model Emulation

Exploring the climate impacts of various anthropogenic emissions scenarios is key to making informed decisions for climate change mitigation and adaptation. State-of-the-art Earth system models can provide detailed insight into these impacts but have a large associated computational cost on a per-scenario basis. This large computational burden has driven recent interest in developing cheap machine learning models for the task of climate model emulation. In this paper, we explore the efficacy of randomly wired neural networks for this task. We describe how they can be constructed and compare them with their standard feedforward counterparts using the ClimateBench dataset. Specifically, we replace the serially connected dense layers in multilayer perceptrons, convolutional neural networks, and convolutional long short-term memory networks with randomly wired dense layers and assess the impact on model performance for models with 1 million and 10 million parameters. We find that models with less-complex architectures see the greatest performance improvement with the addition of random wiring (up to 30.4% for multilayer perceptrons). Furthermore, of 24 different model architecture, parameter count, and prediction task combinations, only one had a statistically significant performance deficit in randomly wired networks relative to their standard counterparts, with 14 cases showing statistically significant improvement. We also find no significant difference in prediction speed between networks with standard feedforward dense layers and those with randomly wired layers. These findings indicate that randomly wired neural networks may be suitable direct replacements for traditional dense layers in many standard models.

54 ENVIRONMENTAL SCIENCES↗

Performance Risk Model Validation with Operationally Relevant Tasks

Human Research Program aims to develop methods to support astronauts’ health and productivity during spaceflight. The Crew Health and Performance Probabilistic Risk Assessment (CHP-PRA) team uses powerful computational methods to predict mission risk in both domains: medical and performance. Here, we show how CHP-PRA uses the Performance Risk Model (PRisM) to quantify the performance risk and show an application of the model on operationally relevant tasks. There are various metrics adopted across performance researchers that PRisM can accommodate. For data analysis, interpretation, and integration, we use a method of unifying data from multiple sources by converting each to a single metric. We consult subject matter experts prior to integrating the converted data into PRisM. The method we use is inspired by the Cooper-Harper rating scale [1]. Using this unified metric, we can easily combine data from various tests and lab groups. We explain our conversion method in detail and show how it pertains to the process of testing and validation of PRisM on operational tasks. We conducted an initial validation in collaboration with the Behavioral Health and Performance (BHP) lab. We test PRisM using data on their operationally relevant task ROBoT-r, a track-and-capture task for grappling incoming resupply vehicles [2]. Several other labs at NASA Johnson Space Center worked together to design 7 Functional Task Tests (FTTs) in pursuit of simulating the tasks required after landing on a planetary surface and after return to Earth [3]. Here we use the results from both ROBoT-r and the 7 FTTs and compare their experiment data to PRisM’s computational output to demonstrate how PRisM can support operations by predicting crew performance on future missions.

performance modeling↗

Coated Particle Fuel and Deep Burn Program Monthly Highlights June 2011

During FY 2011 the CP & DB Program will report Highlights on a monthly basis, but will no longer produce Quarterly Progress Reports. Technical details that were previously included in the quarterly reports will be included in the appropriate Milestone Reports that are submitted to FCRD Program Management. These reports will also be uploaded to the Deep Burn website. The Monthly Highlights report for May 2011, ORNL/TM-2011/126, was distributed to program participants on June 9, 2011. As reported previously, the final Quarterly for FY 2010, Deep Burn Program Quarterly Report for July - September 2010, ORNL/TM-2010/301, was announced to program participants and posted to the website on December 28, 2010. This report discusses the following: (1) Fuel Performance Modeling - Fuel Performance Analysis; (2) Thermochemical Data and Model Development - (a) Thermochemical Behavior, (b) Thermomechanical Modeling, (c) Actinide and Fission Product Transport; (3) TRU (transuranic elements) TRISO (tri-structural isotropic) Development - (a) TRU Kernel Development, (b) Coating Development; and (4) LWR Fully Ceramic Fuel - (a) FCM Fabrication Development, (b) FCM Irradiation Testing.

Snead, Lance Lewis↗

Solid rocket booster performance evaluation model. Volume 3: Sample case

The solid rocket booster performance evaluation model (SRB-11) is used to predict internal ballistics in a sample motor. This motor contains a five segmented grain. The first segment has a 14 pointed star configuration with a web which wraps partially around the forward dome. The other segments are circular in cross-section and are tapered along the interior burning surface. Two of the segments are inhibited on the forward face. The nozzle is not assumed to be submerged. The performance prediction is broken into two simulation parts: the delivered end item specific impulse and the propellant properties which are required as inputs for the internal ballistics module are determined; and the internal ballistics for the entire burn duration of the motor are simulated.

Source record↗

PRIMA-X - Performance Retargeting of Instrumentation, Measurement, and Analysis Technologies for Exascale Computing

The PRIMA-X (Performance Retargeting of Instrumentation, Measurement, and Analysis Technologies for Exascale Computing) project is the successor of the DOE PRIMA (Performance Refactoring of Instrumentation, Measurement, and Analysis Technologies for Petascale Computing) project, which addressed the challenge of creating a core measurement infrastructure that would serve as a common platform for both integrating leading parallel performance systems (notably TAU and Scalasca) and developing next-generation scalable performance tools. The PRIMA-X project shifts the focus away from refactorization of robust performance tools towards a re-targeting of the parallel performance measurement and analysis architecture for extreme scales. The massive concurrency, asynchronous execution dynamics, hardware heterogeneity, and multi-objective prerequisites (performance, power, resilience) that identify exascale systems introduce fundamental constraints on the ability to carry forward existing performance methodologies. In particular, there must be a deemphasis of per-thread observation techniques to significantly reduce the otherwise unsustainable flood of redundant performance data. Instead, it will be necessary to assimilate multi-level resource observations into macroscopic performance views, from which resilient performance metrics can be attributed to the computational features of the application. This requires a scalable framework for node-level and system-wide monitoring and runtime analyses of dynamic performance information. Also, the interest in optimizing parallelism parameters with respect to performance and energy drives the integration of tool capabilities in the exascale environment further. Initially, PRIMA-X was a collaborative project between the University of Oregon (lead institution) and the German Research School for Simulation Sciences (GRS). Because Prof. Wolf, the PI at GRS, accepted a position as full professor at Technische Universitaet Darmstadt (TU Darmstadt) starting February 1st, 2015, the work of GRS was continued at TU Darmstadt. This report covers the work at TU Darmstadt after the transition. The first main accomplishment of TU Darmstadt is the development of different techniques to aggregate performance data on the level of threads. TU Darmstadt evaluated different schemes designed at GRS during the first phase of this project and integrated them into Score-P, a widely used performance measurement framework for HPC applications. The second main accomplishment is a substantial increase of Score-P’s scalability, achieved by improving its internal representation of the underlying system. Third, we extended our performance-modeling tool Extra-P to automatically create models with more than one input parameter (e.g., process count and input size), which was previously impossible. These models allow the performance behavior of an application to be extrapolated to larger machines. Specific applications of the new multi-parameter capability realized in this project include modeling the isoefficiency function of task-based applications and a novel co-design methodology. Further extensions of Extra-P comprise online modeling functionality, automatic refinement of the model search space, and segmented performance modeling. Further contributions include new locality metrics for both shared- and distributed-memory applications, a new way of measuring the impact of inter-application inference on the execution time of an application, and finally an automatic method that selects appropriate OpenMP constructs for the parallelization of sequential code and classifies the affected variables based on their sharing semantics.

97 MATHEMATICS AND COMPUTING↗

Global Gridded Crop Model Evaluation: Benchmarking, Skills, Deficiencies and Implications.

Crop models are increasingly used to simulate crop yields at the global scale, but so far there is no general framework on how to assess model performance. Here we evaluate the simulation results of 14 global gridded crop modeling groups that have contributed historic crop yield simulations for maize, wheat, rice and soybean to the Global Gridded Crop Model Intercomparison (GGCMI) of the Agricultural Model Intercomparison and Improvement Project (AgMIP). Simulation results are compared to reference data at global, national and grid cell scales and we evaluate model performance with respect to time series correlation, spatial correlation and mean bias. We find that global gridded crop models (GGCMs) show mixed skill in reproducing time series correlations or spatial patterns at the different spatial scales. Generally, maize, wheat and soybean simulations of many GGCMs are capable of reproducing larger parts of observed temporal variability (time series correlation coefficients (r) of up to 0.888 for maize, 0.673 for wheat and 0.643 for soybean at the global scale) but rice yield variability cannot be well reproduced by most models. Yield variability can be well reproduced for most major producing countries by many GGCMs and for all countries by at least some. A comparison with gridded yield data and a statistical analysis of the effects of weather variability on yield variability shows that the ensemble of GGCMs can explain more of the yield variability than an ensemble of regression models for maize and soybean, but not for wheat and rice. We identify future research needs in global gridded crop modeling and for all individual crop modeling groups. In the absence of a purely observation-based benchmark for model evaluation, we propose that the best performing crop model per crop and region establishes the benchmark for all others, and modelers are encouraged to investigate how crop model performance can be increased. We make our evaluation system accessible to all crop modelers so that other modeling groups can also test their model performance against the reference data and the GGCMI benchmark.

wheat↗

Modeling the Performance of Direct-Detection Doppler Lidar Systems in Real Atmospheres

Previous modeling of the performance of spaceborne direct-detection Doppler lidar systems has assumed extremely idealized atmospheric models. Here we develop a technique for modeling the performance of these systems in a more realistic atmosphere, based on actual airborne lidar observations. The resulting atmospheric model contains cloud and aerosol variability that is absent in other simulations of spaceborne Doppler lidar instruments. To produce a realistic simulation of daytime performance, we include solar radiance values that are based on actual measurements and are allowed to vary as the viewing scene changes. Simulations are performed for two types of direct-detection Doppler lidar systems: the double-edge and the multi-channel techniques. Both systems were optimized to measure winds from Rayleigh backscatter at 355 nm. Simulations show that the measurement uncertainty during daytime is degraded by only about 10-20% compared to nighttime performance, provided a proper solar filter is included in the instrument design.

McGill, Matthew J.↗

A machine learning approach for identifying variables associated with risk of developing neutralizing antidrug antibodies to factor VIII

A key unmet need in the management of hemophilia A (HA) is the lack of clinically validated markers that are associated with the development of neutralizing antibodies to Factor VIII (FVIII) (commonly referred to as inhibitors). This study aimed to identify relevant biomarkers for FVIII inhibition using Machine Learning (ML) and Explainable AI (XAI) using the My Life Our Future (MLOF) research repository. The dataset includes biologically relevant variables such as age, race, sex, ethnicity, and the variants in the F8 gene. In addition, we previously carried out Human Leukocyte Antigen Class II (HLA-II) typing on samples obtained from the MLOF repository. Using this information, we derived other patient-specific biologically and genetically important variables. These included identifying the number of foreign FVIII derived peptides, based on the alignment of the endogenous FVIII and infused drug sequences, and the foreign-peptide HLA-II molecule binding affinity calculated using NetMHCIIpan. The data were processed and trained with multiple ML classification models to identify the top performing models. The top performing model was then chosen to apply XAI via SHAP, (SHapley Additive exPlanations) to identify the variables critical for the prediction of FVIII inhibitor development in a hemophilia A patient. Using XAI we provide a robust and ranked identification of variables that could be predictive for developing inhibitors to FVIII drugs in hemophilia A patients. These variables could be validated as biomarkers and used in making clinical decisions and during drug development. The top five variables for predicting inhibitor development based on SHAP values are: (i) the baseline activity of the FVIII protein, (ii) mean affinity of all foreign peptides for HLA DRB 3, 4, & 5 alleles, (iii) mean affinity of all foreign peptides for HLA DRB1 alleles), (iv) the minimum affinity among all foreign peptides for HLA DRB1 alleles, and (v) F8 mutation type.

60 APPLIED LIFE SCIENCES↗

Pointing system modeling for performance prediction

The paper considers the modeling and analysis of the JPL Precision Pointing and Tracking System, a gyro stabilized platform pointing system using optical target tracking. Sensor and actuator models are described which realistically represent actual hardware, and a practical controller and state estimator is developed through modern control techniques. The effect of the actuator nonlinearities on the system performance evaluation is discussed along with the modeling of the noise sources in the gyro. Finally, the limitations of implementing the control algorithms on the spacecraft computer, and the resulting tradeoffs are presented.

Boussalis, D.↗

Proof-of-Concept Demonstrations for Computation-Based Human Reliability Analysis. Modeling Operator Performance During Flooding Scenarios

The United States (U.S.) Department of Energy (DOE) Light Water Reactor Sustainability (LWRS) program has the overall objective to help sustain the existing commercial nuclear power plants (NPPs). To accomplish this program objective, there are multiple LWRS “pathways,” or research and development (R&D) focus areas. One LWRS focus area is called the Risk-Informed Safety Margin and Characterization (RISMC) pathway. Initial efforts under this pathway to combine probabilistic and plant multi-physics models to quantify safety margins and support business decisions also included HRA, but in a somewhat simplified manner. HRA experts at Idaho National Laboratory (INL) have been collaborating with other experts to develop a computational HRA approach, called the Human Unimodel for Nuclear Technology to Enhance Reliability (HUNTER), for inclusion into the RISMC framework. The basic premise of this research is to leverage applicable computational techniques, namely simulation and modeling, to develop and then, using RAVEN as a controller, seamlessly integrate virtual operator models (HUNTER) with 1) the dynamic computational MOOSE runtime environment that includes a full-scope plant model, and 2) the RISMC framework PRA models already in use. The HUNTER computational HRA approach is a hybrid approach that leverages past work from cognitive psychology, human performance modeling, and HRA, but it is also a significant departure from existing static and even dynamic HRA methods. This report is divided into five chapters that cover the development of an external flooding event test case and associated statistical modeling considerations.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Performance optimization, modeling and analysis of sparse matrix-matrix products on multi-core and many-core processors

Sparse matrix-matrix multiplication (SpGEMM) is a computational primitive that is widely used in areas ranging from traditional numerical applications to recent big data analysis and machine learning. Although many SpGEMM algorithms have been proposed, hardware specific optimizations for multi- and many-core processors are lacking and a detailed analysis of their performance under various use cases and matrices is not available. In this work, we firstly identify and mitigate multiple bottlenecks with memory management and thread scheduling on Intel Xeon Phi (Knights Landing or KNL). Specifically targeting many-core processors, we develop a hash-table-based algorithm and optimize a heap-based shared-memory SpGEMM algorithm. We examine their performance together with other publicly available codes. Different from the literature, our evaluation also includes use cases that are representative of real graph algorithms, such as multi-source breadth-first search or triangle counting. Our hash-table and heap-based algorithms are showing significant speedups from libraries in the majority of the cases while different algorithms dominate the other scenarios with different matrix size, sparsity, compression factor and operation type. We wrap up in-depth evaluation results and make a recipe to give the best SpGEMM algorithm for target scenario. We build the performance model for hash-table and heap-based algorithms, which supports the recipe. A critical finding is that hash-table-based SpGEMM gets a significant performance boost if the nonzeros are not required to be sorted within each row of the output matrix. Finally, we integrate our implementations into a large-scale protein clustering code named HipMCL, accelerating its SpGEMM kernel by up to 10X and achieving an overall performance boost for the whole HipMCL application by 2.6X.

97 MATHEMATICS AND COMPUTING↗

Momentary Cessation: Improving Dynamic Performance and Modeling of Utility-Scale Inverter Based Resources During Grid Disturbances

Sandia National Laboratories worked with NERC staff to provide stakeholder guidance in responding to a May 2018 NERC alert regarding dynamic performance and modeling issues for utility-scale inverter-based resources. The NERC alert resulted from event analyses for grid disturbances that occurred in southern California in August 2016 and October 2017. Those disturbances revealed the use of momentary cessation of transmission connected inverter-based generation- a short time period when they ceased to inject current into the grid, counter to desired transmission operation. The event analyses concluded that, in many cases, the Western Interconnection system models used to determine planning and operating criteria do not reflect the actual behavior of solar plants, resulting in overly optimistic planning assessments and substandard operational responses. This technical report summarizes the gaps between the models and actual performance that were observed at those times, and the guidance that Sandia and NERC provided to owners of solar PV power plants, transmission planners, transmission operators and planning/reliability coordinators to modify existing models to reflect that actual performance

24 POWER TRANSMISSION AND DISTRIBUTION↗

Quasi-coherent fluctuations limiting the pedestal growth on Alcator C-Mod: Experiment and modelling

Performance predictions for future fusion devices rely on an accurate model of the pedestal structure. The candidate for predictive pedestal structure is EPED, and it is imperative to test the underlying hypotheses to further gain confidence for ITER projections. Here, we present experimental work testing one of the EPED hypotheses, namely the existence of a soft limit set by microinstabilities such as the kinetic ballooning mode. Furthermore, this work extends recent work on Alactor C-Mod (Diallo et al 2014 Phys. Rev. Lett. 112 115001), to include detailed measurements of the edge fluctuations and comparisons of edge simulation codes and experimental observations.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Quasi-Coherent Fluctuations Limiting the Pedestal Growth on Alcator C-Mod: Experiment and Modeling

Performance predictions for future fusion devices rely on an accurate model of the pedestal structure. The leading candidate for predictive pedestal structure is EPED, and it is imperative to test the underlying hypotheses to further gain confidence for ITER projections. Here, we present experimental work testing one of the EPED hypotheses, namely the existence of a soft limit set by microinstabilities such as the kinetic ballooning mode (KBM). This work extends recent work on Alcator C-Mod [Diallo, et al., Phys. Rev. Lett., , (2014), 115001], to include detailed measurements of the edge fluctuations and comparisons of edge simulation codes and experimental observations.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Ku-Band rendezvous radar performance computer simulation model

All work performed on the Ku-band rendezvous radar performance computer simulation model program since the release of the preliminary final report is summarized. Developments on the program fall into three distinct categories: (1) modifications to the existing Ku-band radar tracking performance computer model; (2) the addition of a highly accurate, nonrealtime search and acquisition performance computer model to the total software package developed on this program; and (3) development of radar cross section (RCS) computation models for three additional satellites. All changes in the tracking model involved improvements in the automatic gain control (AGC) and the radar signal strength (RSS) computer models. Although the search and acquisition computer models were developed under the auspices of the Hughes Aircraft Company Ku-Band Integrated Radar and Communications Subsystem program office, they have been supplied to NASA as part of the Ku-band radar performance comuter model package. Their purpose is to predict Ku-band acquisition performance for specific satellite targets on specific missions. The RCS models were developed for three satellites: the Long Duration Exposure Facility (LDEF) spacecraft, the Solar Maximum Mission (SMM) spacecraft, and the Space Telescopes.

Magnusson, H. G.↗

Developing Information Power Grid Based Algorithms and Software

This exploratory study initiated our effort to understand performance modeling on parallel systems. The basic goal of performance modeling is to understand and predict the performance of a computer program or set of programs on a computer system. Performance modeling has numerous applications, including evaluation of algorithms, optimization of code implementations, parallel library development, comparison of system architectures, parallel system design, and procurement of new systems. Our work lays the basis for the construction of parallel libraries that allow for the reconstruction of application codes on several distinct architectures so as to assure performance portability. Following our strategy, once the requirements of applications are well understood, one can then construct a library in a layered fashion. The top level of this library will consist of architecture-independent geometric, numerical, and symbolic algorithms that are needed by the sample of applications. These routines should be written in a language that is portable across the targeted architectures.

Dongarra, Jack↗