Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model diagnostics and development”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Collaborative Research: Understanding air‐sea feedbacks to the MJO through process evaluation of observations and E3SM experiments (Final Technical Report)

This project explored the role of tropical oceans in regulating cloud populations within the Madden-Julian oscillation (MJO)–a large-scale tropical weather disturbance that influences extreme weather events across the globe by affecting the position of the jet stream and patterns of moisture transport. Our project sought to 1) document ocean feedback strength to the MJO in climate models, 2) understand how air-sea interactions affect the intensity, organization, and propagation of MJO convection, 3) utilize existing observations to identify sources of model bias for tropical air-sea interactions, and 4) better understand the effects of slow and fast ocean variability on MJO cloudiness. We found that transfers of heat and moisture across the air-sea interface (i.e., surface fluxes) in most climate models are over-supportive in maintaining MJO convection and under-supportive in propagating MJO convection. This can lead to misrepresentations in the frequency of extreme weather events across the globe through erroneous MJO feedbacks to jet stream position and moisture transport. Furthermore, using observations collected by ocean moorings across the tropical oceans, we showed that most models greatly overestimate surface evaporation in the subtropics, and that this bias is likely one contributor to a pervasive bias among climate models in their ability to simulate the mean state of rainfall over the tropical oceans (i.e., the “double ITCZ bias”). Replacing the default surface flux algorithm in two climate models with a state-of-the-art surface flux algorithm modestly reduced the double ITCZ bias in those models. Our work produced two model diagnostics packages that are now publicly available through DOE and NOAA model diagnostics archives. The first, the Analysis of Scales of Precipitation (ASoP) diagnoses scales of precipitation variability across space and time, with temporal resolution as fine as the model integration timestep. The second, the air-sea flux diagnostic diagnoses model surface fluxes and allows direct comparison of model fluxes to observations without having to recompute fluxes using model output and a state-of-the-art flux algorithm. These diagnostics, which were developed using climate models, can be readily applied to regional and global forecast model output to improve forecasts for the benefit of society.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Advancing the science of explosive fragmentation and afterburn fireballs though experiments and simulations at the benchtop scale

Detonation of explosive devices produces extremely hazardous fragments and hot, luminous fireballs. Prior experimental investigations of these post-detonation environments have primarily considered devices containing hundreds of grams of explosives. While relevant to many applications, such large- scale testing also significantly restricts experimental diagnostics and provides limited data for model validation. As an alternative, the current work proposes experiments and simulations of the fragmentation and fireballs from commercial detonators with less than a gram of high explosive. As demonstrated here, reduced experimental hazards and increased optical access significantly expand the viability of advanced imaging and laser diagnostics. Notable developments include the first known validation of MHz-rate optical fragment tracking and the first ever Coherent Anti-Stokes Raman Scattering (CARS) measures of post-detonation fireball temperatures. While certainly not replacing the need for full-scale verification testing, this work demonstrates new opportunities to accelerate developments of diagnostics and predictive models of post-detonation environments.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2020

The ARM Data-oriented Metrics and Diagnostics Package for Climate Models - A New Tool for Evaluating Climate Models with Field Data

The U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) program User Facility produces ground-based long-term continuous unique measurements for atmospheric state, precipitation, turbulent fluxes, radiation, aerosol, cloud and the land surface, which are collected at multiple sites. These comprehensive datasets have been widely used to calibrate climate models and are proven to be invaluable for climate model development and improvement. This article introduces an evaluation package to facilitate the use of ground-based ARM measurements in climate model evaluation. The ARM data-oriented metrics and diagnostics package (ARM-DIAGS) includes both ARM observational datasets and a Python-based analysis toolkit for computation and visualization. The observational datasets are compiled from multiple ARM data products and specifically tailored for use in climate model evaluation. In addition, ARM-DIAGS also includes simulation data from models participating the Coupled Model Inter-comparison Project (CMIP), which will allow climate-modeling groups to compare a new, candidate version of their model to existing CMIP models. The analysis toolkit is designed to make the metrics and diagnostics quickly available to the model developers.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Validating the simulation of beam-ion charge exchange in MAST Upgrade

Abstract Simulation of the impact of charge-exchange (CX) reactions on beam ions in the Mega Amp Spherical Tokamak (MAST) Upgrade was compared to measurements carried out with a fission chamber (neutron fluxes) and a fast ion deuterium-alpha (FIDA) diagnostic. A simple model was developed to reconstruct the outer-midplane neutral density based on measurements of deuterium-alpha emission from edge neutrals, and on Thomson scattering measurements of electron density and temperature. The main computational tools used were the ASCOT orbit-following code and the FIDASIM code for producing synthetic FIDA signals. The neutral density reconstruction agrees qualitatively with SOLPS-ITER modelling and yields a synthetic passive FIDA signal that is consistent with measurement. When CX losses of beam ions are accounted for, predicted neutron emission rates are quantitatively more consistent with measurement. It was necessary to account for CX losses of beam ions in simulations to reproduce the measured passive FIDA signal quantitatively and qualitatively. The results suggest that the neutral density reconstruction is a good approximation, that CX with edge neutrals causes significant beam-ion losses in MAST Upgrade, typically 20% of beam power, and that the ASCOT fast-ion CX model can be used to accurately predict the redistribution and loss of beam ions due to CX.

Physics↗
DOE OSTI2020

Improving the interface processes in the DOE/ACME model (Final Report)

This is the Final Report of our 4-year Energy Exascale Earth System Model (E3SM) project (3 years for the original project + 1-year no-cost extension). The overall objective of our project is to improve the interface processes in the E3SM. Two overarching questions have been addressed: 1) What are the major deficiencies of the (land-atmosphere, ocean-atmosphere, land-ocean, and snow-sea ice) interface processes in E3SM? 2) How can we improve the treatment of these deficiencies in E3SM? Four tasks have been carried out: to evaluate and improve the land–atmosphere coupling in E3SM; to evaluate and improve the ocean–atmosphere coupling in E3SM; to evaluate and improve the land–ocean coupling in E3SM; and to evaluate and improve the snow–sea ice coupling in E3SM.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Antarctic ice sheet model comparison with uncurated geological constraints shows that higher spatial resolution improves deglacial reconstructions

Accurately reconstructing past changes to the shape and volume of the Antarctic ice sheet relies on the use of physically based and thus internally consistent ice sheet modeling, benchmarked against spatially limited geologic data. The challenge in model benchmarking against geologic data is diagnosing whether model-data misfits are the result of an inadequate model, inherently noisy or biased geologic data, and/or incorrect association between modeled quantities and geologic observations. In this work we address this challenge by (i) the development and use of a new model-data evaluation framework applied to an uncurated data set of geologic constraints, and (ii) nested high-spatial-resolution modeling designed to test the hypothesis that model resolution is an important limitation in matching geologic data. While previous approaches to model benchmarking employed highly curated datasets, our approach applies an automated screening and quality control algorithm to an uncurated public dataset of geochronological observations (specifically, cosmogenic-nuclide exposure-age measurements from glacial deposits in ice-free areas). This optimizes data utilization by including more geological constraints, reduces potential interpretive bias, and allows unsupervised assimilation of new data as they are collected. We also incorporate a nested model framework in which high-resolution domains are downscaled from a continent-wide ice sheet model. We highlight the application of this framework by applying these methods to a small ensemble of deglacial ice-sheet model simulations, and demonstrate that the nested approach improves the ability of model simulations to match exposure age data collected from areas of complex topography and ice flow. We develop a range of diagnostic model-data comparison metrics to provide more insight into model performance than possible from a single-valued misfit statistic, showing that different metrics capture different aspects of ice sheet deflation.

Geosciences↗
DOE OSTI2021

Data-driven profile prediction for DIII-D

A new, fully data-driven algorithm has been developed that uses neural networks to predict plasma pro les on a scale of τ E into the future given actuators and the present plasma state. The model was trained and tested on DIII-D data from the 2013-2018 experimental campaigns. The model is accurate on average, with q predictions the worst and pressure predictions the best. The model can run in milliseconds and is very simple to use. This makes it a potentially useful tool for operators and physicists when planning plasma scenarios. It also is a candidate for doing phase-space exploration without going through the DIIID database or complicated and computationally expensive simulation codes. Here, a reduced model using only realtime diagnostics has also been developed and formed the basis for a model-predictive control algorithm implemented and successfully tested on DIII-D.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

Earth System Model Aerosol–Cloud Diagnostics (ESMAC Diags) package, version 1: assessing E3SM aerosol predictions using aircraft, ship, and surface measurements

Abstract. An Earth system model (ESM) aerosol–cloud diagnostics package is developed to facilitate the routine evaluation of aerosols, clouds, and aerosol–cloud interactions simulated by the Energy Exascale Earth System Model (E3SM) from the US Department of Energy (DOE). The first version focuses on comparing simulated aerosol properties with aircraft, ship, and surface measurements, which are mostly measured in situ. The diagnostics currently cover six field campaigns in four geographical regions: eastern North Atlantic (ENA), central US (CUS), northeastern Pacific (NEP), and Southern Ocean (SO). These regions produce frequent liquid- or mixed-phase clouds, with extensive measurements available from the Atmospheric Radiation Measurement (ARM) program and other agencies. Various types of diagnostics and metrics are performed for aerosol number, size distribution, chemical composition, cloud condensation nuclei (CCN) concentration, and various meteorological quantities to assess how well E3SM represents observed aerosol properties across spatial scales. Overall, E3SM qualitatively reproduces the observed aerosol number concentration, size distribution, and chemical composition reasonably well, but it overestimates Aitken-mode aerosols and underestimates accumulation-mode aerosols over the CUS and ENA regions, suggesting that processes related to particle growth or coagulation might be too weak in the model. The current version of E3SM struggles to reproduce the new particle formation events frequently observed over both the CUS and ENA regions, indicating missing processes in current parameterizations. The diagnostics package is coded and organized in a way that can be extended to other field campaign datasets and adapted to higher-resolution model simulations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Development of Short-Term Forecasting Models Using Plant Asset Data and Feature Selection

Nuclear power plants collect and store large volumes of heterogeneous data from various components and systems. With recent advances in machine learning (ML) techniques, these data can be leveraged to develop diagnostic and short-term forecasting models to better predict future equipment condition. Maintenance operations can then be planned in advance whenever degraded performance is predicted, thus resulting in fewer unplanned outages and the optimization of maintenance activities. This enables lower maintenance costs and improves the overall economics of nuclear power. This paper focuses on developing a short-term forecasting process that leverages a feature selection process to distill large volumes of heterogeneous data and predict specific equipment parameters. A variety of feature selection methods, including Shapley Additive Explanations (SHAP) and variance inflation factor (VIF), were used to select the optimal features as inputs for three ML methods: long short-term memory (LSTM) networks, support vector regression (SVR), and random forest (RF). Each combination of model and input features was used to predict a pump bearing temperature both 1 and 24 hours in advance, based on actual plant system data. The optimal inputs for the LSTM and SVR were selected using the SHAP values, while the optimal input for the RF consisted solely of the response variable itself. Each model produced similar 1-hour-ahead predictions, with root mean square errors (RMSEs) of roughly 0.006. For the 24-hour-ahead predictions, differences could be seen between LSTM, SVR, and RF, as reflected by model performances of 0.036 +- 0.014, 0.0026 +- 0, and 0.063 +- 0.004 RMSE, respectively. As big data and continuous online monitoring become more widely available, the proposed feature selection process can be used for many applications beyond the prediction of process parameters within nuclear infrastructure.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

Performance prediction applying different reduced turbulence models to the SMART tokamak

The SMall Aspect Ratio Tokamak (SMART) is currently being commissioned at the University of Seville and will be able to compare the performance of positive and negative triangularity plasmas at low aspect ratio. Predictive simulations have been performed for different machine scenarios and heating schemes using the TRANSP code. The objectives of these simulations are to predict the parameters expected in positive triangularity plasmas, to guide diagnostic development, and to validate transport models. Several reduced turbulence models have been used to predict electron and ion temperatures for the operational phase 2. All models provide similar results from approximately mid-radius to the separatrix but important discrepancies are found in the core region. These positive triangularity results are compared with experiments from a similar size machine like GLOBUS-M2. The multi-mode model (MMM) shows the best agreement. Simulations with different boundary conditions have been performed and no strong differences have been observed between them. The impact of neutral beam injection (NBI) on the predicted profiles has also been addressed. Rotation reduces turbulence levels so higher temperatures are achieved when included in the simulations. Studying the different contributions to the thermal diffusivities, it is observed that electron temperature gradient (ETG) turbulence dominates at the plasma core while micro-tearing modes (MTM) dominate at the edge in the electron channel. In the ion channel, the neoclassical contribution is dominant at the core and at the very edge while the Weiland component, which includes ion temperature gradient mode (ITG), trapped electron mode (TEM), kinetic ballooning mode (KBM), peeling mode (PM) and collisionless and collision dominated magnetohydrodynamic (MHD) modes governs the mid-radius region. For phase 3, two plasmas with different electron densities have been studied. The case with lower density matches well a specific discharge of GLOBUS-M2. The higher density plasma shows high performance with β N ≈ 3.8.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2026

ARM Data-Oriented Metrics and Diagnostics Package for Climate Model Evaluation

A Python-based metrics and diagnostics package is currently being developed by the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) Infrastructure Team at Lawrence Livermore National Laboratory (LLNL) to facilitate the use of long-term, high-frequency measurements from the ARM Facility in evaluating the regional climate simulation of clouds, radiation, and precipitation. This metrics and diagnostics package computes climatological means of targeted climate model simulation and generates tables and plots for comparing the model simulation with ARM observational data. The Coupled Model Intercomparison Project (CMIP) model data sets are also included in the package to enable model intercomparison as demonstrated in Zhang et al. (2017). The mean of the CMIP model can serve as a reference for individual models. Basic performance metrics are computed to measure the accuracy of mean state and variability of climate models. The evaluated physical quantities include cloud fraction, temperature, relative humidity, cloud liquid water path, total column water vapor, precipitation, sensible and latent heat fluxes, and radiative fluxes, with plan to extend to more fields, such as aerosol and microphysics properties. Process-oriented diagnostics focusing on individual cloud- and precipitation-related phenomena are also being developed for the evaluation and development of specific model physical parameterizations. The version 1.0 package is designed based on data collected at ARM’s Southern Great Plains (SGP) Research Facility, with the plan to extend to other ARM sites. The metrics and diagnostics package is currently built upon standard Python libraries and additional Python packages developed by DOE (such as CDMS and CDAT). The ARM metrics and diagnostic package is available publicly with the hope that it can serve as an easy entry point for climate modelers to compare their models with ARM data. In this report, we first present the input data, which constitutes the core content of the metrics and diagnostics package in section 2, and a user's guide documenting the workflow/structure of the version 1.0 codes, and including step-by-step instruction for running the package in section 3.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Earth System Model Aerosol–Cloud Diagnostics (ESMAC Diags) package, version 2: assessing aerosols, clouds, and aerosol–cloud interactions via field campaign and long-term observations

Abstract. Poor representations of aerosols, clouds, and aerosol–cloud interactions (ACIs) in Earth system models (ESMs) have long been the largest uncertainties in predicting global climate change. Huge efforts have been made to improve the representation of these processes in ESMs, and the key to these efforts is the evaluation of ESM simulations with observations. Most well-established ESM diagnostics packages focus on the climatological features; however, they lack process-level understanding and representations of aerosols, clouds, and ACIs. In this study, we developed the Earth System Model Aerosol–Cloud Diagnostics (ESMAC Diags) package to facilitate the routine evaluation of aerosols, clouds, and ACIs simulated the Energy Exascale Earth System Model (E3SM) from the US Department of Energy (DOE). This paper documents its version 2 functionality (ESMAC Diags v2), which has substantial updates compared with version 1 (Tang et al., 2022a). The simulated aerosol and cloud properties have been extensively compared with in situ and remote-sensing measurements from aircraft, ship, surface, and satellite platforms in ESMAC Diags v2. It currently includes six field campaigns and two permanent sites covering four geographical regions: the eastern North Atlantic, the central US, the northeastern Pacific, and the Southern Ocean. These regions produce frequent liquid- or mixed-phase clouds, with extensive measurements available from the DOE Atmospheric Radiation Measurement user facility and other agencies. ESMAC Diags v2 generates various types of single-variable and multivariable diagnostics, including percentiles, histograms, joint histograms, and heatmaps, to evaluate the model representation of aerosols, clouds, and ACIs. Select examples highlighting the capabilities of ESMAC Diags are shown using E3SM version 2 (E3SMv2). In general, E3SMv2 can reasonably reproduce many observed aerosol and cloud properties, with biases in some variables such as aerosol particle and cloud droplet sizes and number concentrations. The coupling of aerosol and cloud number concentrations may be too strong in E3SMv2, possibly indicating a bias in processes that control aerosol activation. Furthermore, the liquid water path response to a perturbed cloud droplet number concentration behaves differently in E3SMv2 and observations, which warrants further study to improve the cloud microphysics parameterizations in E3SMv2.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Modeling Profiles of Micrometeorological Variables in a Tropical Premontane Rainforest Using Multi-Layered CLM (CLM-ML)

This study updates the multi-layered Community Land Model (CLM-ml) for hillslopes and compares predictions from against observations collected in tropical montane rainforest, Costa Rica. Modifications are made in order to capture a wider array of vertical leaf area distributions, predict CO 2 profiles, account for soil respiration, and adjust wind forcings for difficult topographic settings. Test results indicate that the modified multi-layer CLM model can successfully replicate the shape of various micrometeorological profiles (humidity, CO 2 , temperature, and wind speed) under the canopy. In the single-layer models (CLM4.5 and CLM5), excessive day-to-night differences in leaf temperature and leaf wetness were originally noted, but CLM-ml significantly improved these issues, decreasing the amplitudes of diurnal cycles by 67% and 47%. Sub-canopy considerations, such as canopy shapes and turbulent transfer parameters, also played a significant role in model performance. More importantly, unlike single layer models, the results that CLM-ml produces can be compared to variables measured within the canopy to provide far more detailed diagnostic information. Further observations and model developments, aimed at reflecting surface heterogeneity, will be necessary to adequately capture the complexity and the features of the tropical montane rainforest.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Methods to determine the radiated power in SPI-mitigated disruptions in JET

Here we present techniques for evaluating the radiated power in JET disruptions. Disrupting plasmas are shown to have non-axisymmetric radiation profiles, motivating the re-evaluation of the standard techniques for calculating the total radiated power at JET using bolometry. Four single-channel bolometers at different toroidal locations are exploited to quantify the radiation asymmetry. Toroidal radiation peaking factors integrated over the entire disruption of up to 1.5 have been observed when varying the quantity of neon in pellets used in disruptions mitigated by shattered pellet injection. Using synthetic bolometer diagnostics developed with the Cherab spectroscopy modeling framework, we can estimate the systematic error on total power calculations for relevant radiation profiles and improve estimates of the total radiated power. We show that the component of the systematic error on the total power due to the poloidal radiation profile can be reduced from 70% to 10% with suitable assumptions about the structure of the poloidal profile.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

HIBP Applications to Advance Understanding of Plasma Transport Physics (2011-2017) (and subsequently titled) Development of Beam Measurements to Advance Understanding of Transients and Improve Validation (2017-2020) (Final Technical Report)

This is the Final Technical Report for the DoE Measurement Innovation (previously Diagnostic Development) grant DE-SC0006077 titled HIBP Applications to Advance Understanding of Plasma Transport Physics (2011-2017), and subsequently titled Development of Beam Measurements to Advance Understanding of Transients and Improve Validation (2017-2020). The grant was funded by the Office of Fusion Energy Sciences (FES) for the period 1 May 2011–17 July 2020. Work performed through the grant has resulted in diagnostic innovations and new measurement capabilities that will improve understanding of transport, magnetic equilibrium, and electric fields in magnetically confined plasmas. We have developed novel hardware and advanced techniques to expand beam-based diagnostic capabilities, and extend measurements to new operating regimes. Some have been realized using a Heavy Ion Beam Probe (HIBP) having traditional features, while other applications have joined our innovations with subsets of advantageous HIBP features. This work has established smaller, more economical detection systems and, in doing so, may enable substantial extension of scenarios in which beam-based diagnostics are deployed. Key Measurement Innovations include: Computer Models and Simulations of HIBP Applications-Computer modeling and simulating of HIBP applications is central to predicting interaction of beam particles with plasmas, designing diagnostic systems, and anticipating measurement characteristics. We have extended the capability and improved measurement fidelity of the HIBP diagnostic on the Madison Symmetric Torus (MST) reversed field pinch (RFP); simulated feasibility of HIBP operation in the Helically Symmetric eXperiment (HSX) optimized stellarator; and investigated the plausibility of HIBP measurements in the ASDEX Upgrade tokamak. We have also developed a new technique that uses ion optics to model a finite phase-space beam. It yields more realistic (than traditional method) estimates of sample volume characteristics, which influence measurement resolution and sensitivity. Extension of Diagnostic Capabilities and Measurements on the MST RFP-Capabilities have been extended using the first and only HIBP installation on an RFP. Challenges associated with operation of the diagnostic on MST include the three-dimensional nature of particle trajectories, temporal topology and amplitude changes in the plasma equilibrium, and strong particle and radiative emission from the plasma. We have addressed these challenges through development of detailed and higher precision diagnostic simulations, calibrated subtraction of noise to resolve secondary ion signals, and implementation of hardware that enables higher fidelity measurement of plasma fluctuations. Development of New Hardware and Measurement Techniques - We have advanced beam-based measurement capabilities via development of new detectors and techniques to determine the poloidal magnetic flux ψ in the plasma, and enable placement of detectors close to the plasma and thus allow a smaller and less expensive diagnostic. We have demonstrated measurement of ψ, an ability that was made possible by development of highly effective noise reduction techniques. We also modeled the effect of non-ideal and instrumentation effects by developing a virtual (simulated) diagnostic. Application of beam-based diagnostics on various devices and multiple magnetic configurations (e.g. stellarator, tokamak, and reversed field pinch) enables investigation of critical physics issues and measurements resulting in the broad parameter space data needed to test and validate theory & modeling.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2025

Analysis of streaked images of x-ray self-emission in laser-driven spherical implosions

Imaging of x-ray self-emission provides a powerful in situ measurement of the spatial and temporal evolution of high-energy-density plasmas. However, interpretation of these measurements requires detailed understanding of the data-generating process. This work presents a case study in the interpretation of x-ray self-emission data for the specific application of streaked one-dimensional slit imaging of spherical laser-driven implosions. A comprehensive generative model of the streaked slit-imaging diagnostic is developed including detailed treatments of the radiation transfer, photometrics, and photostatistics associated with the measurement. The model is used to generate realistic synthetic streaked images and to analyze experimental streaked images to extract important physical quantities of interest. An example analysis of streaked images from implosion experiments on the OMEGA laser is presented, where the model developed in this work is used to constrain the trajectory and peak velocity of the implosion using Bayesian inference.

Bayesian inference↗
DOE OSTI2022

Analytics-at-scale of Sensor Data for Digital Monitoring in Nuclear Plants (3 rd Annual Report)

Nuclear power plants collect and store large volumes of heterogeneous data from various components and systems. With recent advances in machine learning (ML) techniques, these data can be leveraged to develop diagnostic and short-term forecasting models to better predict future equipment condition. Maintenance operations can then be planned in advance whenever degraded performance is predicted, thus resulting in fewer unplanned outages and the optimization of maintenance activities. This enables lower maintenance costs and improves the overall economics of nuclear power. This report primarily focuses on developing a short-term forecasting process that leverages a feature selection process to distill large volumes of heterogeneous data and predict specific equipment parameters. A variety of feature selection methods, including Shapley Additive Explanations (SHAP) and variance inflation factor (VIF), were used to select the optimal features as inputs for three ML methods: long short-term memory (LSTM) networks, support vector regression (SVR), and random forest (RF). Each combination of model and input features was used to predict a pump bearing temperature both 1 and 24 hours in advance, based on actual plant system data. The optimal inputs for the LSTM and SVR were selected using the SHAP values, while the optimal input for the RF consisted solely of the response variable itself. Each model produced similar 1-hour-ahead predictions, with root mean square errors (RMSEs) of roughly 0.006. For the 24-hour-ahead predictions, differences could be seen between LSTM, SVR, and RF, as reflected by model performances of 0.036 ± 0.014, 0.0026 ± 0, and 0.063 ± 0.004 RMSE, respectively. As big data and continuous online monitoring become more widely available, the proposed feature selection process can be used for many applications beyond the prediction of process parameters within nuclear infrastructure. This report summarizes the Fiscal Year 2021 research progress encompassing the (1) data cleaning and feature selection necessary for ML applications; (2) development of short-term forecasting models to predict future plant process parameters for both single and multiple time steps ahead; and (3) validation of the feature selection methods and short-term forecasting models given new data from different systems.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2022

ARM data-oriented metrics and diagnostics package for climate model evaluation (ARM-DIAGS-V3) version 3

A Python-based metrics and diagnostics package is currently being developed by the ARM Infrastructure Team at Lawrence Livermore National Laboratory to facilitate the use of long-term high frequency measurements from the ARM program in evaluating the regional climate simulation of clouds, radiation, precipitation, and aerosols. This metrics and diagnostics package computes climatological means of targeted climate model simulation and generates tables and plots for comparing the model simulation with ARM observational data. The CMIP model data sets are also included in the package to enable model inter-comparison as demonstrated in Zhang et al. (2018) and Zhang et al. (2020). The mean of the CMIP model can be served as a reference for individual models. Basic performance metrics are computed to measure the accuracy of mean state and variability of climate models. The evaluated physical quantities include cloud fraction, temperature, relative humidity, cloud liquid water path, total column water vapor, precipitation, sensible and latent heat fluxes, aerosol optical depth, and radiative fluxes, with plan to extend to more fields, such as the evaluation of model simulated aerosol physicochemical properties and cloud microphysics properties. Process-oriented diagnostics focusing on aerosol, cloud, and precipitation-related phenomena are also being developed for the evaluation and development of specific model physical parameterizations. In addition to the Southern Great Plains (SGP), North Slope of Alaska (NSA) and Tropical Western Pacific (TWP) atmospheric observatories in the ARMDIAGS version 2.0, the version 3.0 package have extended to the data collected at the ARM Eastern North Atlantic (ENA) atmospheric observatory and the Observation and Modeling of the Green Ocean Amazon (GOAMAZON) field campaign. The metrics and diagnostics package are currently built upon standard Python libraries and additional Python packages developed by DOE (CDAT). The ARM metrics and diagnostic package is available publicly with the hope that it can serve as an easy entry point for climate modelers to compare their models with ARM data. In this report, we first provide an overview of major metrics in section 2. The input data, which constitutes the core content of the metrics and diagnostics package, is summarized in section 3. A user's guide documenting the workflow/structure of the version 3.0 codes and including step-by-step instruction for running the package is described in section 4.

54 ENVIRONMENTAL SCIENCES↗