Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model diagnostics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

LIGHT-bgcArgo-1.0: using synthetic float capabilities in E3SMv2 to assess spatiotemporal variability in ocean physics and biogeochemistry

Since their advent over 2 decades ago, autonomous Argo floats have revolutionized the field of oceanography, and, more recently, the addition of biogeochemical and biological sensors to these floats has greatly improved our understanding of carbon, nutrient, and oxygen cycling in the ocean. While Argo floats offer unprecedented horizontal, vertical, and temporal coverage of the global ocean, uncertainties remain about whether Argo sampling frequency and density capture the true spatiotemporal variability in physical, biogeochemical, and biological properties. As the true distributions of, e.g., temperature or oxygen are unknown, these uncertainties remain difficult to address with Argo floats alone. Numerical models with synthetic observing systems offer one potential avenue to address these uncertainties. Here, we implement synthetic biogeochemical Argo floats into the Energy Exascale Earth System Model version 2 (E3SMv2), which build on the Lagrangian In Situ Global High-Performance Particle Tracking (LIGHT) module in E3SMv2 (E3SMv2-LIGHT-bgcArgo-1.0). Since the synthetic floats sample the model fields at model run time, the end user defines the sampling protocol ahead of any model simulation, including the number and distribution of synthetic floats to be deployed, their sampling frequency, and the prognostic or diagnostic model fields to be sampled. Using a 6-year proof-of-concept simulation, we illustrate the utility of the synthetic floats in different case studies. In particular, we quantify the impact of (i) sampling density on the float-derived detection of deep-ocean change in temperature or oxygen and on float-derived estimates of phytoplankton phenology, (ii) sampling frequency and sea-ice cover on float trajectory lengths and hence float-derived estimates of current velocities, and (iii) short-term variability in ecosystem stressors on estimates of their seasonal variability.

54 ENVIRONMENTAL SCIENCES↗

Normal modes of the world's oceans: A numerical investigation using Proudman functions

The numerical modeling of the normal modes of the global oceans is addressed. The results of such modeling could be expected to serve as a guide in the analysis of observations and measurements intended to detect these modes. The numerical computation of normal modes of the global oceans is a field in which several investigations have obtained results during the past 15 years. The results seem to be model-dependent to an unsatisfactory extent. Some modeling areas, such as higher resolution of the bathymetry, inclusion of self-attraction and loading, the role of the Arctic Ocean, and systematic testing by means of diagnostic models are addressed. The results show that the present state of the art is such that a final solution to the normal mode problem still lies in the future. The numerical experiments show where some of the difficulties are and give some insight as to how to proceed in the future.

Sanchez, Braulio V.↗

A Genuine TEAM Player

Qualtech Systems, Inc. developed a complete software system with capabilities of multisignal modeling, diagnostic analysis, run-time diagnostic operations, and intelligent interactive reasoners. Commercially available as the TEAMS (Testability Engineering and Maintenance System) tool set, the software can be used to reveal unanticipated system failures. The TEAMS software package is broken down into four companion tools: TEAMS-RT, TEAMATE, TEAMS-KB, and TEAMS-RDS. TEAMS-RT identifies good, bad, and suspect components in the system in real-time. It reports system health results from onboard tests, and detects and isolates failures within the system, allowing for rapid fault isolation. TEAMATE takes over from where TEAMS-RT left off by intelligently guiding the maintenance technician through the troubleshooting procedure, repair actions, and operational checkout. TEAMS-KB serves as a model management and collection tool. TEAMS-RDS (TEAMS-Remote Diagnostic Server) has the ability to continuously assess a system and isolate any failure in that system or its components, in real time. RDS incorporates TEAMS-RT, TEAMATE, and TEAMS-KB in a large-scale server architecture capable of providing advanced diagnostic and maintenance functions over a network, such as the Internet, with a web browser user interface.

Source record↗

Coupling of the radiative, convective, and surface fluxes over the equatorial Pacific

An idealized energy-balance model for a closed tropical circulation is first presented to illustrate the coupling between the net tropospheric cooling, the surface fluxes, and the mean subsidence away from the precipitation zones. Then a one-dimensional diagnostic model and a radiation model with boundary layer clouds are combined to explore this coupling for a specific region, using mean sounding data over the tropical Pacific. The radiatively driven subsidence rate at the top of the convective boundary layer is approximately 35 mb/day and is largely independent of boundary layer cloud fraction. The sensitivity of the corresponding convective heat flux profiles to the mass divergence profile and cloud fraction within the boundary layer is explored. Reasonable assumptions give realistic surface sensible and latent heat fluxes for this region of approximately 10 and 130 W/sq m. The paper illustrates the important background climatic control of the radiation field on the tropical surface fluxes.

Ridgway, W.↗

Machine Learning and Economic Models to Enable Risk-Informed Condition Based Maintenance of a Nuclear Plant Asset

The primary objective of this research is to address challenges in the implementation of risk-informed, condition-based predictive maintenance (PdM), which reduces operating costs while still maintaining the safety and reliability of commercial nuclear power plants (NPPs). To achieve the objective, risk models are being developed by taking advantage of advancements in data analytics, deep learning, machine learning (ML), and artificial intelligence (AI). The notable outcomes presented in the report include ? Development of a ML models using heterogeneous plant process and vibration data collected at different spatial and temporal resolutions from the Salem?s CWS to diagnose a circulating water pump (CWP) failure based on salient fault signatures. The developed diagnostic models are extendable to other faults associated with CWPs and CWP motors given associated fault signatures. ? Development of a natural language processing (NLP) technique to automatically classify the WO data into different categories. The developed NLP technique was validated on independent WO data. This automates the tedious and time-consuming activity of mining and classifying WOs by subject matter experts. ? Estimation of mean time between downtime (i.e., time duration between time instances when 1 or more CWPs are not available) and developed an approach to establish reliability of CWS components using unstructured WO data along with CWS plant process data. ? Formulation of economic model based on Markov chain models. The parameters of associated with the transition rate between different states of Markov chain models were estimated using WO data. The economic model formulation and discussion captures both time-independent and time-dependent parameter variation, leading to risk-informed decision-making.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Observations of the Thermal Structure and Dynamics of the Martian Atmosphere

Information on the thermal structure of the Martian atmosphere has been obtained using several different techniques, including in situ sounding from decent probes, radio occultations and infrared thermal emission measurements from orbiters, and earth based full-disk microwave measurements. Knowledge of the 3- dimensional atmospheric temperature field and its temporal variation provides an important observational approach to the study of the dynamics of the atmosphere. Comparison of the observed thermal structure with results from a Mars General Circulation Model (MGCM) can be used to refine the model and provide greater insight into the physical processes controlling the dynamics of the atmosphere. Direct assimilation of the temperature observations into an MGCM can also be used to address similar goals. In addition, relatively simple diagnostic models can be applied to the data to directly obtain information on winds and other meteorological properties of the atmosphere. In this overview, we concentrate primarily on the structure retrieved from thermal emission measurements. Additional information is contained in the original extended abstract.

Conrath, B. J.↗

Snow in the Changing Sea-Ice Systems

Snow is the most reflective, and also the most insulative, natural material on Earth. Consequently, it is an integral part of the sea-ice and climate systems. However, the spatial and temporal heterogeneities of snow pose challenges for observing, understanding and modelling those systems under anthropogenic warming. Here, we survey the snow-ice system, then provide recommendations for overcoming present challenges. These include: collecting process-oriented observations for model diagnostics and understanding snow-ice feedbacks, and improving our remote sensing capabilities of snow for monitoring large-scale changes in snow on sea ice. These efforts could be achieved through stronger coordination between the observational, remote sensing and modelling communities, and would pay dividends through distinct improvements in predictions of polar environments.

Snow↗

Deepti: Deep-Learning-Based Tropical Cyclone Intensity Estimation System

Tropical cyclones are one of the costliest natural disasters globally because of the wide range of associated hazards. Thus, an accurate diagnostic model for tropical cyclone intensity can save lives and property. There are a number of existing techniques and approaches that diagnose tropical cyclone wind speed using satellite data at a given time with varying success. This paper presents a deep learning-based objective, diagnostic estimate of tropical cyclone intensity from infrared satellite imagery with 13.24 kt Root Mean Squared Error (RMSE). In addition, a visualization portal in a production system is presented that displays deep learning output and contextual information for end users, one of the first of its kind.

Manil Maskey↗

Helical core reconstruction of a DIII-D hybrid scenario tokamak discharge

Our paper presents the first fully 3-dimensional (3D) equilibrium reconstruction of a helical core in a tokamak device. Using a new parallel implementation of the Variational Moments Equilibrium Code (PARVMEC) coupled to V3FIT, 3D reconstructions can be performed at resolutions necessary to produce helical states in nominally axisymmetric tokamak equilibria. In a flux pumping experiment performed on DIII-D, an external n=1 field was applied while a 3/2 neoclassical tearing mode was suppressed using ECCD. The externally applied field was rotated past a set of fixed diagnostics at a 20 Hz frequency. Furthermore, the modulation, were found to be strongest in the core SXR and MSE channels, indicates a localized rotating 3D structure locked in phase with the applied field. Signals from multiple time slices are converted to a virtual rotation of modeled diagnostics adding 3D signal information. In starting from an axisymmetric equilibrium reconstruction solution, the reconstructed broader current profile flattens the q-profile, resulting in an m=1, n=1 perturbation of the magnetic axis that is $\sim 50\times $ larger than the applied n=1 deformation of the edge. Error propagation confirms that the displacement of the axis is much larger than the uncertainty in the axis position validating the helical equilibrium.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

New Diagnostic, Launch and Model Control Techniques in the NASA Ames HFFAF Ballistic Range

This report presents new diagnostic, launch and model control techniques used in the NASA Ames HFFAF ballistic range. High speed movies were used to view the sabot separation process and the passage of the model through the model splap paper. Cavities in the rear of the sabot, to catch the muzzle blast of the gun, were used to control sabot finger separation angles and distances. Inserts were installed in the powder chamber to greatly reduce the ullage volume (empty space) in the chamber. This resulted in much more complete and repeatable combustion of the powder and hence, in much more repeatable muzzle velocities. Sheets of paper or cardstock, impacting one half of the model, were used to control the amplitudes of the model pitch oscillations.

Bogdanoff, David W.↗

Soil Moisture Memory in Climate Models

Water balance considerations at the soil surface lead to an equation that relates the autocorrelation of soil moisture in climate models to (1) seasonality in the statistics of the atmospheric forcing, (2) the variation of evaporation with soil moisture, (3) the variation of runoff with soil moisture, and (4) persistence in the atmospheric forcing, as perhaps induced by land atmosphere feedback. Geographical variations in the relative strengths of these factors, which can be established through analysis of model diagnostics and which can be validated to a certain extent against observations, lead to geographical variations in simulated soil moisture memory and thus, in effect, to geographical variations in seasonal precipitation predictability associated with soil moisture. The use of the equation to characterize controls on soil moisture memory is demonstrated with data from the modeling system of the NASA Seasonal-to-Interannual Prediction Project.

Koster, Randal D.↗

A review of computing-based automated fault detection and diagnosis of heating, ventilation and air conditioning systems

We report faults in Heating, Ventilation, and Air Conditioning (HVAC) systems of buildings result in significant energy waste in building operation. With fast-growing sensing data availability and advancement in computing, computational modeling has demonstrated strong capability to detect and diagnose HVAC system faults, hence, ensuring efficient building operation. This paper comprehensively reviews the state-of-the-art computing-based fault detection and diagnosis (FDD) for HVAC systems. Overall, the reviewed computing-based FDD methods are classified as two major approaches: knowledge-based and data-driven approaches. We then identify multiple important topics, including data availability, training data size, data quality, approach generality, capability, interpretability, and required modeling efforts, along with corresponding metrics to summarize the most updated FDD development. Generally, the knowledge-based approaches are further divided as physics-based modeling, Diagnostic Bayesian Network, and performance indicator-based methods while data-driven approaches include supervised learning, unsupervised learning, and regression and statistics-based methods. State-of-the-art FDD development, remaining challenges, and future research directions are further discussed to push forward FDD in practice. Availability of fault data, capability of existing methods to deal with complex fault situations (such as simultaneous faults), modeling interpretability for data-driven methods, and required engineering efforts for physics-based methods are identified as remaining challenges in FDD development. Improving modeling fidelity and reducing modeling efforts are essential for applying physics-based methods in real buildings. Meanwhile, addressing fault data availability, increasing algorithm adaptability, and handling multiple faults are essential to further enhance the applicability of data-driven FDD approaches.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Analytics-at-scale of Sensor Data for Digital Monitoring in Nuclear Plants: 2nd Annual Report

For economic reasons, the nuclear industry is witnessing premature closure of nuclear power plants, despite excellent safety records. Operations and Maintenance (O&M) activities are some of the largest costs in operating legacy light-water plants. By reducing O&M costs, nuclear energy can become more economically competitive with other energy sources. This can be achieved by leveraging machine-learning and artificial intelligence technologies to develop data-driven algorithms to better diagnose potential faults within the system. Improved accuracy of the models can lead to a reduction in unnecessary maintenance, thus reducing costs associated with parts, labor, and unnecessary planned, forced, or extended outages. To address these challenges, the goal of this project is to perform research and development in the area of digital monitoring, i.e., the application of advanced sensor technologies (particularly wireless sensor technologies) and data science based analytic capabilities, to advance online monitoring and predictive maintenance in nuclear plants and improve plant performance (efficiency gain and economic competitiveness). This report summarizes the fiscal year 2020 research progress encompassing (1) different wireless vibration sensor and data indicators used to assess the health of a plant asset; (2) development of diagnostic models for fault detection; and (3) development of prognostic models for estimating the health of the system up to 7 days ahead.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

LossLens: Diagnostics for Machine Learning Through Loss Landscape Visual Analytics

Modern machine learning often relies on optimizing a neural network's parameters using a loss function to learn complex features. Beyond training, examining the loss function with respect to a network's parameters (i.e., as a loss landscape) can reveal insights into the architecture and learning process. While the local structure of the loss landscape surrounding an individual solution can be characterized using a variety of approaches, the global structure of a loss landscape, which includes potentially many local minima corresponding to different solutions, remains far more difficult to conceptualize and visualize. To address this difficulty, we introduce LossLens, a visual analytics framework that explores loss landscapes at multiple scales. LossLens integrates metrics from global and local scales into a comprehensive visual representation, enhancing model diagnostics. Here we demonstrate LossLens through two case studies: visualizing how residual connections influence a ResNet-20, and visualizing how physical parameters influence a physics-informed neural network (PINN) solving a simple convection problem.

97 MATHEMATICS AND COMPUTING↗

Nonnegative tensor factorization for contaminant source identification

Unsupervised Machine Learning (ML) is becoming increasingly popular for solving various types of data analytics problems including feature extraction, blind source separation, exploratory analyses, model diagnostics, etc. In this work, we have developed a new unsupervised ML method based on Nonnegative Tensor Factorization (NTF) for identification of the original groundwater types (including contaminant sources) present in geochemical mixtures observed in an aquifer. Frequently, groundwater types with different geochemical signatures are related to different background and/or contamination sources. The characterization of groundwater mixing processes is a challenging but very important task critical for any environmental management project aiming to characterize the fate and transport of contaminants in the subsurface and perform contaminant remediation. This task typically requires solving complex inverse models representing groundwater flow and geochemical transport in the aquifer, where the inverse analysis accounts for available site data. Usually, the model is calibrated against the available data characterizing the spatial and temporal distribution of the observed geochemical types. Numerous different geochemical constituents and processes may need to be simulated in these models which further complicates the analyses. Additionally, the application of inverse methods may introduce biases in the analyses through the assumptions made in the model development process. Here, we substitute the model inversion with unsupervised ML analysis. The ML analysis does not make any assumptions about underlying physical and geochemical processes occurring in the aquifer. Our ML methodology, called NTFk, is capable of identifying (1) the unknown number of groundwater types (contaminant sources) present in the aquifer, (2) the original geochemical concentrations (signatures) of these groundwater types and (3) spatial and temporal dynamics in the mixing of these groundwater types. These results are obtained only from the measured geochemical data without any additional site information. In general, the NTFk methodology allows for interpretation of large high-dimensional datasets representing diverse spatial and temporal components such as state variables and velocities. NTFk has been tested on synthetic and real-world site three-dimensional datasets. Finally, the NTFk algorithm is designed to work with geochemical data represented in the form of concentrations, ratios (of two constituents; for example, isotope ratios), and delta notations (standard normalized stable isotope ratios).

58 GEOSCIENCES↗

Foundations of machine learning for low-temperature plasmas: methods and case studies

Abstract Machine learning (ML) and artificial intelligence have proven to be an invaluable tool in tackling a vast array of scientific, engineering, and societal problems. The main drivers behind the recent proliferation of ML in practically all aspects of science and technology can be attributed to: (a) improved data acquisition and inexpensive data storage; (b) exponential growth in computing power; and (c) availability of open-source software and resources that have made the use of state-of-the-art ML algorithms widely accessible. The impact of ML on the field of low-temperature plasmas (LTPs) could be particularly significant in the emerging applications that involve plasma treatment of complex interfaces in areas ranging from the manufacture of microelectronics and processing of quantum materials, to the LTP-driven electrification of the chemical industry, and to medicine and biotechnology. This is primarily due to the complex and poorly-understood nature of the plasma-surface interactions in these applications that pose unique challenges to the modeling, diagnostics, and predictive control of LTPs. As the use of ML is becoming more prevalent, it is increasingly paramount for the LTP community to be able to critically analyze and assess the concepts and techniques behind data-driven approaches. To this end, the goal of this paper is to provide a tutorial overview of some of the widely-used ML methods that can be useful, amongst others, for discovering and correlating patterns in the data that may be otherwise impractical to decipher by human intuition alone, for learning multivariable nonlinear data-driven prediction models that are capable of describing the complex behavior of plasma interacting with interfaces, and for guiding the design of experiments to explore the parameter space of plasma-assisted processes in a systematic and resource-efficient manner. We illustrate the utility of various supervised, unsupervised and active learning methods using LTP datasets consisting of commonly-available, information-rich measurements (e.g. optical emission spectra, current–voltage characteristics, scanning electron microscope images, infrared surface temperature measurements, Fourier transform infrared spectra). All the ML demonstrations presented in this paper are carried out using open-source software; the datasets and codes are made publicly available. The FAIR guiding principles for scientific data management and stewardship can accelerate the adoption and development of ML in the LTP community.

Physics↗

Estimating soil wetness using satellite data

Improved estimates of soil wetness were obtained using observations from both the NIMBUS-7 Scanning Multichannel Microwave Radiometer (SMMR) and the NOAA-7 Advanced Very High Resolution Radiometer (AVHRR). SMMR 66 GHz frequency, horizontal polarization, brightness temperature T(BH) was first correlated with soil wetness, as computed using an Antecedent Precipitation Index (API) model, for a number of SMMR ground resolution areas involving a fairly wide range of vegetation densities. The API generally accounted for more than 70 percent of the observed temporal variability in T(BH), with linear correlations being significant at the 1 percent level. The regression slope of T(BH) versus API correlated well, at the 1 percent level, with a vegetation index derived from AVHRR visible and near-infrared observations. The regression intercept was found to correlate less satisfactorily, but was significant at the 5 percent level. These linear regression results were used to develop a diagnostic model for soil wetness using SMMR and AVHRR data only.

Choudhury, Bhaskar J.↗

Assessment of Precipitating Marine Stratocumulus Clouds in the E3SMv1 Atmosphere Model: A Case Study from the ARM MAGIC Field Campaign

This paper presents a process-oriented evaluation of precipitating stratocumulus and its transition to cumulus in version 1 of the Energy Exascale Earth System Model (E3SMv1) using comprehensive case-study observations from a field campaign of the Atmospheric Radiation Measurement program (ARM). The E3SMv1 single-column model (SCM) of the marine boundary layer and its low clouds and precipitation are compared to observations including subcloud drizzle retrievals from a combination of Doppler radar and lidar backscatter measurements. Additionally, the SCM is also compared to a large-eddy simulation (LES) of the same case. The combination of advanced remote sensing observations and LES is a powerful framework to evaluate the physical parameterizations of large-scale models. Given the observed large-scale environment, the E3SMv1 SCM realistically represents the evolution of clouds and boundary layer structure during the stratocumulus-to-cumulus transition. The model well simulates the liquid water path and its diurnal cycle in the stratocumulus period as well as the two-layer vertical thermodynamic structure and lower cloud fraction in the transition period. E3SMv1’s success in simulating the cloud in the stratocumulus period permitted examination of its precipitation processes. Here problems were identified with E3SMv1 producing an unrealistically small subcloud precipitation fraction, an unrealistic double peak in the vertical profiles of precipitation mass, and drizzle that evaporates too close to the surface. Further model diagnostics determined that these unrealistic characteristics resulted from an overly long microphysics time step and an unrealistic parameterization of the precipitation fraction. These results imply that careful consideration of these issues is needed in order to better simulate precipitation processes in marine stratocumulus.

54 ENVIRONMENTAL SCIENCES↗