Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “performance model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21

Models for Resilience Design Patterns

Resilience plays an important role in supercomputers by providing correct and efficient operation in case of faults, errors, and failures. Resilience design patterns offer blueprints for effectively applying resilience technologies. Prior work focused on developing initial efficiency and performance models for resilience design patterns. This paper extends it by (1) describing performance, reliability, and availability models for all structural resilience design patterns, (2) providing more detailed models that include flowcharts and state diagrams, and (3) introducing the Resilience Design Pattern Modeling (RDPM) tool that calculates and plots the performance, reliability, and availability metrics of individual patterns and pattern combinations.

Kumar, Mohit↗

The Role of Deep Convection and Large-scale Circulation in Driving Model Spread in Low Cloud Feedback and Equilibrium Climate Sensitivity

This project aims to advance the understanding of the processes that drive the large uncertainties in climate change projections, use observations to constrain model physics and reduce the inter-model spread in equilibrium climate sensitivity (ECS). There are three major goals: 1) Characterize the representation of the physical pathways that link deep convection, large-scale circulation and low cloud feedback in CMIP6 model simulations and determine the relative contribution of each pathway to the CMIP6 model spread in low cloud feedback and ECS; 2) Use process-oriented diagnostics and multiple observations to evaluate CMIP6 model performance in capturing the observed cloud-circulation relation and deep convection characteristics including convective transition statistics and the bulk properties of mesoscale convective systems (MCSs). Error decomposition in CMIP6 models will be performed. 3) Conduct E3SM short-range hindcasts following the DOE Cloud-Associated Parameterizations Testbed (CAPT) protocol to pinpoint specific model parameters/processes that are crucial to the representation of deep convection, circulation, clouds and the pathways that connect them. We will modify convective parameters in E3SM and analyze the perturbed physics experiments (PPEs) to isolate model parameters that are critical to the uncertainty of ECS.

54 ENVIRONMENTAL SCIENCES↗

Understanding Solar Photovoltaic System Performance: An Assessment of 75 Federal Photovoltaic Systems

This report presents a performance analysis of 75 photovoltaic systems based on PV system production data collected as part of a FEMP Federal PV Performance Assessment project combined with co-incident insolation, and ambient temperature to analyze how actual performance compares with a performance model. FEMP collaborated with 17 Federal agencies and sub-agencies to collect the information required to analyze the performance of each system. The systems represent a total capacity of 30,714 kW and range in size from 1 kW to 4,043 kW, with an average size of 410 kW, and were installed between 2011 and 2020. The data is analyzed for Key Performance Indicators, Availability, Performance Ratio and Energy Ratio by comparing the measured production data to model production data. The System Advisor Model (SAM) combines a description of the system (such as inverter capacity, de-rating for temperature, balance-of-system efficiency) with environmental parameters (coincident solar and temperature data) to calculate predicted performance. The performance metrics are calculated by lining up the measured production data with the model estimate on an hour-by-hour, day-by-day, or month-by-month basis (depending on the interval resolution of the production data). A report with system description, photo of the system, special assumptions made for the site, graph of measured production and model production, table of key performance indicators, and links to O&M resources that might improve performance was produced and delivered to site and agency staff with a short on-line briefing.

14 SOLAR ENERGY↗

AGR-2 Compact 6-4-1 Post-Irradiation Examination Results

The Advanced Gas Reactor (AGR) Fuel Development and Qualification Program was established to perform research and development on tristructural isotropic (TRISO)-coated particle fuel to support deployment of a high-temperature gas-cooled reactor (HTGR). The work continues as part of the Advanced Reactor Technologies (ART) TRISO Fuel Program. The overarching goal of the program is to provide a baseline fuel qualification data set to support licensing and operation of an HTGR. To achieve these goals, the program includes the elements of fuel fabrication, irradiation, post-irradiation examination (PIE) and safety/heating testing, fuel performance modeling, and fission product transport (INL 2017). Several fuel irradiation experiments have been performed at the Advanced Test Reactor (ATR) at Idaho National Laboratory (INL), and additional irradiations are planned. These experiments are intended to provide data on fuel performance under irradiation, support fuel fabrication process development, qualify fuel for operating and accident conditions, provide irradiated fuel for accident testing, and support development of fuel performance and fission product transport models.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Characterizing the performance of node-aware strategies for irregular point-to-point communication on heterogeneous architectures

Supercomputer architectures are trending toward higher computational throughput due to the inclusion of heterogeneous compute nodes. These multi-GPU nodes increase on-node computational efficiency, while also increasing the amount of data to be communicated and the number of potential data flow paths. In this work, we characterize the performance of irregular point-to-point communication with MPI on heterogeneous compute environments through performance modeling, demonstrating the limitations of standard communication strategies for both device-aware and staging-through-host communication techniques. Presented models suggest staging communicated data through host processes then using node-aware communication strategies for high inter-node message counts. Notably, the models also predict that node-aware communication utilizing all available CPU cores to communicate inter-node data leads to the most performant strategy when communicating with a high number of nodes. Furthermore, model validation is provided via a case study of irregular point-to-point communication patterns in distributed sparse matrix–vector products. Importantly, we include a discussion on the implications model predictions have on communication strategy design for emerging supercomputer architectures.

97 MATHEMATICS AND COMPUTING↗

Development and testing of coarse-grained models for ultrasonic simulations of cast austenitic stainless steel

Ultrasonic inspection of cast austenitic stainless steel (CASS) in the nuclear industry is particularly challenging because of sound field scatter and attenuation caused by the coarse-grained microstructure. Modeling and simulation are important tools in ultrasonic testing, as they can be used to help address key aspects of inspections, such as developing new probe designs, predicting inspection reliability, and testing phased-array focal laws. However, developing a useful and reliable CASS model is challenging due to the many grain interfaces and crystalline orientations that must be captured. We demonstrate a method of creating a realistic CASS model that is usable in CIVA, a commercially available modeling and simulation software platform. Using polished and chemically etched sections, we generate models of a coarse-grained equiaxed specimen and a columnar specimen. We also test an alternative method of generating a coarse-grained model using Voronoi regions. We qualitatively compare sound field scatter and quantitatively compare sound field attenuation and beam partitioning in simulated sound fields to those of laboratory-measured sound fields. Results show that the Voronoi models perform as well as or better than the models based on actual grain morphology. Here we also show that model-to-model randomness in Voronoi grain structure can impact the magnitude of a simulated echo response by a factor of two or more. Although CASS models are potentially a good depiction of reality for a given scenario, they should not be considered representative since CASS morphology can change significantly from specimen to specimen or within the same specimen.

36 MATERIALS SCIENCE↗

Deep Learning Estimation of Daily Ground–Level NO 2 Concentrations from Remote Sensing Data

The limited number of nitrogen dioxide (NO 2 ) surface measurements calls for the development of highly accurate approaches to estimating surface NO 2 concentrations. In this study, we leverage a new satellite instrument, the TROPOspheric Monitoring Instrument (TROPOMI), along with other predictor variables, to estimate daily surface NO 2 concentrations over Texas in 2019. We use the deep convolutional neural network (Deep-CNN), an advanced deep learning algorithm, to obtain estimates and achieve a correlation coefficient (R) of 0.91, an index of agreement (IOA) of 0.95, and a mean absolute bias (MAB) of 1.75 ppb in surface NO 2 estimation. Additionally, we leverage a novel approach, SHapley Additive exPlanations (SHAP), to describe how Deep-CNN understands each predictor variable. The SHAP results show that the Deep-CNN model has an advanced understanding of the dataset, revealing that TROPOMI closely captures levels of NO 2 . In addition, we show the superiority of our Deep-CNN model at estimating surface NO 2 over other well-known machine learning and regression models in the field, including the support vector machines (SVM), random forest (RF), and multiple linear regression (MLR). Although SVM and RF show strong capabilities at estimating surface NO 2 concentrations, their accuracy is inferior to that of the Deep-CNN model, ranking second and third in model accuracy in this study. The MLR, however, shows a poor ability at NO 2 estimation and ranks last among all models. Furthermore, testing the impact of sample size on model performance, we also show that, compared to other models, Deep-CNN needs more samples to trigger its strength at surface NO 2 estimation.

54 ENVIRONMENTAL SCIENCES↗

Use of Event-Time Embeddings via RNN to Discern Novel Event Sequences in EHRs

In highly configurable health information technology (HIT) systems, such as VistA of the Veterans Health Administration, the variations in how the system is used among different healthcare facilities and how the data are recorded can be significant. Despite the successful standardization of care efforts, some of these variations can be indicative of HIT hazards and demand further investigation. In this work, we implemented a recurrent neural network (RNN) architecture to learn clinical provider order sequences and their temporal dynamics while predicting the orders' terminal state. We demonstrate model performance and provide a use case for the model discerning novel event sequences. This model is proposed to find novel event sequences in an operational environment.

Ozmen, Ozgur↗

ChIMES: A Machine-Learned Interatomic Model Targeting Improved Description of Condensed Phase Chemistry in Energetic Materials

In this report we detail completion of a Physics and Engineering Model Level Two Milestone targeting improved reactive interatomic potentials (IAPs) for energetic materials (EM) through machine learning. The specific goals of this milestone were to develop, validate, and document a new reactive molecular dynamics method for EM, based on machine learning by (1) generating databases of first-principles-derived forces, stresses, and energies for HN3 and 3,4-bis(3-nitrofurazan- 4-yl)furoxan (DNTF) (2) generate atomistic force fields from these databases via ML, and (3) benchmark model performance against first principles calculations. These goals were achieved by (1) further developing a machine learned reactive IAP and generation approach (i.e. the Chebyshev Interaction Model for Efficient Simulation or “ChIMES”), for which resulting IAPs can approach the predictive power of quantum-mechanical approaches at a fraction of the computational expense, and (2) applying the ChIMES framework to develop models for HN3 and DNTF. We find that for simple energetic materials like HN3, high accuracy ChIMES models can be obtained through application of a fitting approach that does not use active machine learning. We demonstrate the suitability of ChIMES models for simulations involving EM by using the HN3 model in multiscale shock technique simulations to predict the HN3 Chapman-Jouguet detonation state and investigate chemical evolution out to 1 ns following shock compression. This model is then used in larger direct shock (DS) simulations for a preliminary investigation of how bubbles (i.e. voids) influence material response under shock compression. We find that more complex EM (i.e. DNTF) necessitate a more sophisticated fitting approach, and develop a new active learning method and python tool to meet this challenge. We demonstrate that this fitting approach yields ChIMES models that out-perform commonly used standard reactive IAPs as well as semi-empirical quantum methods, and discuss the systematic improvability of these actively learned ChIMES models. We also describe challenges related to model development for EM such as DNTF, for which few experimental or previous simulation data are available (e.g. which could otherwise inform generation of training data). To overcome this issue, we establish a semi-empirical quantum ChIMES capability which can be used to efficiently map out relevant thermodynamic and configurational space, and generate ChIMES-IAP training data in a multiscale manner. We also show that these semi-empirical quantum ChIMES models can be used to generate predictions for the shock Hugoniot (the Hugoniot is the locus of thermodynamic states found in a shocked material) equation of state, investigate related thermochemistry, and explore carbon condensation following shock compression. This work represents a substantial advance in our atomistic modeling capability for EM that will provide much needed information on the chemistry of detonation for continued development of continuum models based on the Cheetah thermochemical code.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Evaluation of Deep Learning Model Architectures for Point-of-Care Ultrasound Diagnostics

Point-of-care ultrasound imaging is a critical tool for patient triage during trauma for diagnosing injuries and prioritizing limited medical evacuation resources. Specifically, an eFAST exam evaluates if there are free fluids in the chest or abdomen but this is only possible if ultrasound scans can be accurately interpreted, a challenge in the pre-hospital setting. In this effort, we evaluated the use of artificial intelligent eFAST image interpretation models. Widely used deep learning model architectures were evaluated as well as Bayesian models optimized for six different diagnostic models: pneumothorax (i) B- or (ii) M-mode, hemothorax (iii) B- or (iv) M-mode, (v) pelvic or bladder abdominal hemorrhage and (vi) right upper quadrant abdominal hemorrhage. Models were trained using images captured in 27 swine. Using a leave-one-subject-out training approach, the MobileNetV2 and DarkNet53 models surpassed 85% accuracy for each M-mode scan site. The different B-mode models performed worse with accuracies between 68% and 74% except for the pelvic hemorrhage model, which only reached 62% accuracy for all model architectures. These results highlight which eFAST scan sites can be easily automated with image interpretation models, while other scan sites, such as the bladder hemorrhage model, will require more robust model development or data augmentation to improve performance. With these additional improvements, the skill threshold for ultrasound-based triage can be reduced, thus expanding its utility in the pre-hospital setting.

47 OTHER INSTRUMENTATION↗

Dynamic domain kinematic modelling for predicting interflow over leaky impeding layers

Traditional Boussinesq or kinematic simulations of interflow (i.e., lateral subsurface flow) assume no leakage through the impeding layer and require a no-flow boundary condition at the ridge top. However, recent analyses of many interflow-producing landscapes indicate that leaky impeding layers are common, that most interflow percolates well before reaching the toe slope, and therefore, the downslope contributing length is shorter than the hillslope length. In watersheds characterised by perched interflow over a low conductivity layer through permeable topsoil, interflow with percolation may be modelled with a kinematic wave model using a mobile upslope boundary condition defining the hillslope portion contributing interflow to valleys. Here, we developed and applied a dynamic interflow model to simulate interflow using a downslope travel distance concept such that only the active contributing length is modelled at any time. The model defines a variable active area based on the depth of the perched layer, the topographic slope and the ratio of the hydraulic conductivity of topsoil to that of the impeding layer. It incorporates a two-layer soil moisture accounting water balance analysis, a pedo-transfer function, and percolation and evaporation routines to predict interflow rates in continuous and event-based scenarios. We tested the modelling concept on two sets of data (2-year dataset of rainfall observations for the continuous simulation and a multi-day irrigation experiment for the event simulation) from a 121-m-long open interflow collection trench on an experimental hillslope at the Savannah River Site, South Carolina. The continuous model simulation partially represented the observed interflow hydrograph and perched water depth in the experimental hillslope with correlation coefficients of 0.85 and 0.35, respectively. Model performance improved significantly at event-scale analysis. The modelling approach realistically represents interflow dynamics in hillslopes with leaky impeding layers and can be integrated into catchment-scale hydrology models for more detailed hillslope process modelling.

54 ENVIRONMENTAL SCIENCES↗

Evaluation of AGR-3/4 In-pile Silver Release Predictions Against Post-Irradiation Examination Measurements

Fuel performance modeling codes that accurately predict the transport of radionuclides in high-temperature gas-cooled reactors that utilize tristructural isotopic (TRISO) fuel particles are an important aspect of reactor safety analyses. One objective of the Advanced Gas Reactor (AGR)-3/4 experiment was to assess the transport of fission products through fuel particles and their subsequent release into the compact matrix and structural graphite materials. This was accomplished by irradiating uranium oxycarbide (UCO) driver fuel particles and designed-to-fail (DTF) particles to serve as known sources of fission products. The fission product of particular interest when it comes to such transport is silver (Ag-110 m), as it has a 250-day half-life and has relatively high mobility in the TRISO coating layers. Furthermore, to assess the current modeling capabilities and diffusion parameters employed in the fuel performance codes PARFUME and BISON, the fractional release of silver release predicted by the two codes were compared against post-irradiation examination measurements from the AGR-3/4 experiment.

AGR-3/4 Experiment↗

Machine learning for reactor power monitoring with limited labeled data

Real-time reactor power monitoring is critical for a variety of nuclear applications, spanning safety, security, operations, and maintenance. While machine learning methods have shown promise in monitoring reactor power levels, there is limited research on their efficacy in label-starved environments. The goal of this work is to assess the feasibility of classifying nuclear reactor power level using multisource data in scenarios with limited labels. Data were collected using low-resolution multisensors at four nuclear reactor facilities: two large research reactors and two TRIGA reactors. Within each pair, one reactor dataset served as the source and the other as the target in a transfer learning paradigm. Twenty-three supervised models were trained on labeled sequences of magnetic field and acceleration data from each of the target sites. Self-learning and transfer learning methods were applied to the top performing models to assess their classification performance with increasing amounts of labeled data. While reactor power level classification was achieved with a Matthews Correlation Coefficient of up to 0.739 ± 0.003 and 0.622 ± 0.009 with only 400 sequences per power state for the large research reactor and TRIGA target sites, respectively, self-learning and transfer learning leveraging source site data did not improve target classification performance. These findings suggest that alternative methods, such as higher sensitivity sensors, digital twins, or the use of physics-informed models, are required to enable high-performance classification in machine learning approaches to reactor monitoring with a dearth of target ground truth.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Expanded analysis of machine learning models for nuclear transient identification using TPOT

Industries around the world are becoming more and more data driven. The nuclear field is no exception with several different applications being proposed. One popular area of research is the use of machine learning in transient detection. This paper seeks to build upon a previous study which made use of the AutoML package TPOT to train traditional machine learning models to classify transient events occurring with a reactor. Synthetic data was once again collected using a GPWR reactor simulator. Data on 12 different events was collected using 15 different initial conditions. Here, a dataset consisting of over 100,000 data points was compiled and used to train 7 different machine learning models using a pre-defined TPOT dictionary with 12 different preprocessing techniques. Three of the trained models were able to produce validation results in the 90s with the expanded dataset. Once the models were trained, it was possible to look into where during the simulation, misclassifications occurred. Using these three models, analysis was done to determine if TPOT could be used to train models that were effective if important features were missing. The results from this were positive with the newly trained models scoring close to the original models. Finally, to conclude this study, the three high performing models were retrained using different random states to see if there was any major variation when different states were used.

42 ENGINEERING↗

Turbulence modeling to aid tidal energy resource characterization in the Western Passage, Maine, USA

Numerical models combined with field measurements are regularly used to characterize tidal energy resources at potential energetic sites. However, most existing works only focus on the tidal hydrodynamic characteristics, and turbulence parameters are often not reported because of the lack of high-quality turbulence measurements and the limitations of numerical models in resolving turbulent eddies. In this study, we used FVCOM - a hydrostatic primitive equation (HPE) model - to characterize the tidal energy resource in the Western Passage, Maine, USA, by taking care of the essential macro-scale turbulence properties. We observed an excellent model performance using the Mellor-Yamada Level 2.5 Turbulence Model; estimating the spatial and vertical distribution of the turbulent kinetic energy and intensity added a new perspective to the site ranking for tidal energy converter (TEC) deployments. In addition, we also examined the role of channel geometry and bathymetry, such as headlands and underwater sills, in enhancing turbulent eddies around potential TEC siting locations. Ultimately, the detailed analysis of the turbulent flow characteristics has changed the site-ranking results and demonstrated that the regional-scale HPE models could be used for the relative understanding of more or less turbulent sites for a refined resource assessment.

16 TIDAL AND WAVE POWER↗

Semi-Dynamic Leach Testing of Densified Silicon-based Iodine Waste Forms

Iodine waste forms (IWF) require a conceptual corrosion release model (CCRM) to provide iodine (I) release rates for performance modeling nuclear waste disposal repositories. To develop a CCRM, an understanding of the corrosion mechanisms of the IWF are required along with data from consistent test methods to parameterize the model. The present study has advanced both areas by providing and assessing the corrosion resistance of IWF types based on their processing history in minor variations of semi-dynamic leach tests. The test included a series of semi-dynamic leach tests using monolithic IWFs in deionized water (leachant). Several experiments were conducted under alternate test conditions with changes to temperature, leachant replacement, leachant pH, leachant volume, masking, and surface finish to elucidate if varying these conditions impacted IWF corrosion behavior. Tests were conducted on two classes of IWFs: (1) I-bearing silver-mordenite (AgZ) materials processed by hot isostatic pressing (HIP) at different temperatures, pressures, sizes, and times; and (2) I-bearing silver-functionalized silica aerogels (SFA) processed by either HIP or spark plasma sintering (SPS). The corrosion susceptibility of AgZ samples was influenced by HIP temperature and pressure. The SPS SFAs retained I far better than HIP SFAs. Additional findings in this study include: (1) The iodine dissolution rate decreased with decreasing temperature, (2) a common ion effect may occur and slow dissolution of the host phase if the leachant is not regularly replaced, (3) pH controls the dissolution rate, and (4) the iodine dissolution rate slows with extended test time (up to 224 days). Based on this work, these parameters should thus be represented when developing a CCRM.

corrosion↗

Do Machine Learning Approaches Offer Skill Improvement for Short-Term Forecasting of Wind Gust Occurrence and Magnitude?

Abstract Wind gusts, and in particular intense gusts, are societally relevant but extremely challenging to forecast. This study systematically assesses the skill enhancement that can be achieved using artificial neural networks (ANNs) for forecasting of wind gust occurrence and magnitude. Geophysical predictors from the ERA5 reanalysis are used in conjunction with an autoregressive term in regression and ANN models with different predictors, and varying model complexity. Models are derived and assessed for the warm (April–September) and cold (October–March) seasons for three high passenger volume airports in the United States. Model uncertainty is assessed by deriving models for 1000 different randomly selected training (70%) and testing (30%) subsets. Gust prediction fidelity in independent test samples is critically dependent on inclusion of an autoregressive term. Gust occurrence probabilities derived using five-layer ANNs exhibit consistently higher fidelity than those from regression models and shallower ANNs. Inclusion of the autoregressive term and increasing the number of hidden layers in ANNs from 1 to 5 also improve the model performance for gust magnitudes (lower RMSE, increased correlation, and model standard deviations that more closely approximate observed values). Deeper ANNs (e.g., 20 hidden layers) exhibit higher skill in forecasting strong (17–25.7 m s −1 ) and damaging (≥25.7 m s −1 ) wind gusts. However, such deep networks exhibit evidence of overfitting and still substantially underestimate (by 50%) the frequency of strong and damaging wind gusts at the three airports considered herein. Significance Statement Improved short-term forecasting of wind gusts will enhance aviation safety and logistics and may offer other societal benefits. Here we present a rigorous investigation of the relative skill of models of wind gust occurrence and magnitude that employ different statistical methods. It is shown that artificial neural networks (ANNs) offer considerable skill enhancement over regression methods, particularly for strong and damaging wind gusts. For wind gust magnitudes in particular, application of deeper learning networks (e.g., five or more hidden layers) offers tangible improvements in forecast accuracy. However, deeper networks are vulnerable to overfitting and exhibit substantial variability with the specific training and testing data subset used. Also, even deep ANNs reproduce only half of strong and damaging wind gusts. These results indicate the need for future work to elucidate the dynamical mechanisms of intense wind gusts and advance solutions to their prediction.

54 ENVIRONMENTAL SCIENCES↗

Earth System Model Improvement Pipeline via Uncertainty Attribution and Active Learning

Primary focal area: 2 (Predictive Modeling via AI): We develop methods to formally quantify uncertainties in Earth System models for the land-atmosphere coupled system. Science Challenge: Earth system models still have significant biases in historical predictions of the intensity and frequency of water cycling extremes (e.g., droughts and flood events), leading to low confidence in future projections. Uncertainties arise from incomplete understanding of land and atmospheric processes, and insufficient observational constraints on model parameters. Many observations, including those from key DOE investments such as ARM and AmeriFlux, are used to evaluate model performance but have not been used to formally quantify model uncertainty because of the expense of running ESM simulations. An efficient pipeline engaging cutting-edge machine learning (ML) and uncertainty quantification (UQ) methods is needed to improve the predictive understanding of water cycle extremes in the Earth system.

54 ENVIRONMENTAL SCIENCES↗