Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model diagnostics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Inferring the temperature profile of the radiative shock in the COAX experiment with shock radiography, Dante, and spectral temperature diagnostics

Predicting and modeling the behavior of experiments with radiation waves propagating through low-density foams require a detailed quantification of the numerous uncertainties present. In regimes where a prominent radiative shock is produced, key dynamical features include the shock position, temperature, and curvature and the spatial distribution and temperature of the corresponding supersonic radiation wave. The COAX experimental platform is designed to constrain numerical models of such a radiative shock propagating through a low-density foam by employing radiography for spatial and shock information, Dante for characterizing the x-ray flux from the indirectly driven target, and a novel spectral diagnostic designed to probe the temperature profile of the wave. In this work, we model COAX with parameterized 2D simulations and a Hohlraum-laser modeling package to study uncertainties in diagnosing the experiment. The inferred temperature profile of the COAX radiation transport experiments has been shown to differ from simulations more than expected from drive uncertainties that have been constrained by simultaneous soft x-ray flux and radiography measurements.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

Tomographic imaging of atmospheric pressure plasma on complex surfaces

Many plasma types and behaviors such as streamer, arcs, cathode spots, anode spots, ionization waves, and magnetic field interactions create non-symmetric, fully 3D plasma structures. The plasma distribution in 3D space is heavily influenced by complex surfaces and the coupling interactions between plasma properties and the interfacing material properties. For example, ionization waves propagate in directions where ionization rates are highest, leading to complex configurations that are not fully understood or well characterized. Recent advances in laser diagnostics and models have been able to investigate well-controlled idealized plasmas in 2D fashion, but the complex structure in actual plasmas requires a technique than can provide a more complete 3D picture. However, 3D plasma diagnostics do not currently exist. To address this limitation, this activity will leverage available equipment to build a new tomographic optical imaging capability and advance the state-of-the-art in plasma diagnostics to investigate 3D phenomena on complex surfaces.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2026

New framework for benchmarking decadal predictions leveraging the PCMDI Metric Package with interactive visualization

Reliable climate predictions across multiple timescales are increasingly critical as climate-related risks continue to rise. With the growing number and diversity of climate prediction systems, systematic intercomparison has become essential. Here, we present a comprehensive evaluation framework based on the PCMDI Metric Package to assess the performance of multiple decadal climate prediction systems. Unlike uninitialized simulations, initialized predictions exhibit bias and predictive skill that evolve with forecast lead time. To address this, we introduce (1) model-by-lead-time portrait plots, which efficiently summarize metrics of global temperature, precipitation, and Arctic/Antarctic sea-ice extent, and (2) an HTML-based interactive visualization platform that provides detailed regional and seasonal diagnostics of model bias, skill scores, and ensemble spread for each model and lead time. Comparisons with uninitialized simulations further quantify the relative impacts of initialization and external forcing on prediction skill. The proposed framework provides a scalable and transparent approach for multi-model climate prediction assessments and can be readily extended to a wide range of operational and research forecasting systems.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1999

Observation and Modeling of the Solar Transition Region: Multi-Spectral Solar Telescope Array Observations - 1

We report on observations of the solar atmosphere in several extreme-ultraviolet and far-ultraviolet bandpasses obtained by the Multi-Spectral Solar Telescope Array, a rocket-borne spectroheliograph, on flights in 1987, 1991, and 1994, spanning the last solar maximum. Quiet-Sun emission observed in the 171-175 Angstrom bandpass, which includes lines of O v, O VI, Fe IX, and Fe X, has been analyzed to test models of the temperatures and geometries of the structures responsible for this emission. Analyses of intensity variations above the solar limb reveal scale heights consistent with a quiet-Sun plasma temperature of 500,000 less than or equal to T (sub e) less than or equal to 800,000 K. The structures responsible for the quiet-Sun EUV emission are modeled as small quasi-static loops. We submit our models to several tests. We compare the emission our models would produce in the bandpass of our telescope to the emission we have observed. We find that the emission predicted by loop models with maximum temperatures between 700,000 and 900,000 K are consistent with our observations. We also compare the absolute flux predicted by our models in a typical upper transition region line to the flux measured by previous observers. Finally, we present a preliminary comparison of the predictions of our models with diagnostic spectral line ratios from previous observers. Intensity modulations in the quiet Sun are observed to occur on a scale comparable to the supergranular scale. We discuss the implications that a distribution of loops of the type we model here would have for heating the local network at the loops' footpoints.

Oluseyi, Hakeem M.↗
NASA NTRS2011

Optimal Tuner Selection for Kalman-Filter-Based Aircraft Engine Performance Estimation

An emerging approach in the field of aircraft engine controls and system health management is the inclusion of real-time, onboard models for the inflight estimation of engine performance variations. This technology, typically based on Kalman-filter concepts, enables the estimation of unmeasured engine performance parameters that can be directly utilized by controls, prognostics, and health-management applications. A challenge that complicates this practice is the fact that an aircraft engine s performance is affected by its level of degradation, generally described in terms of unmeasurable health parameters such as efficiencies and flow capacities related to each major engine module. Through Kalman-filter-based estimation techniques, the level of engine performance degradation can be estimated, given that there are at least as many sensors as health parameters to be estimated. However, in an aircraft engine, the number of sensors available is typically less than the number of health parameters, presenting an under-determined estimation problem. A common approach to address this shortcoming is to estimate a subset of the health parameters, referred to as model tuning parameters. The problem/objective is to optimally select the model tuning parameters to minimize Kalman-filterbased estimation error. A tuner selection technique has been developed that specifically addresses the under-determined estimation problem, where there are more unknown parameters than available sensor measurements. A systematic approach is applied to produce a model tuning parameter vector of appropriate dimension to enable estimation by a Kalman filter, while minimizing the estimation error in the parameters of interest. Tuning parameter selection is performed using a multi-variable iterative search routine that seeks to minimize the theoretical mean-squared estimation error of the Kalman filter. This approach can significantly reduce the error in onboard aircraft engine parameter estimation applications such as model-based diagnostic, controls, and life usage calculations. The advantage of the innovation is the significant reduction in estimation errors that it can provide relative to the conventional approach of selecting a subset of health parameters to serve as the model tuning parameter vector. Because this technique needs only to be performed during the system design process, it places no additional computation burden on the onboard Kalman filter implementation. The technique has been developed for aircraft engine onboard estimation applications, as this application typically presents an under-determined estimation problem. However, this generic technique could be applied to other industries using gas turbine engine technology.

Simon, Donald L.↗
DOE OSTI2015

Model-based versus specific dosimetry in diagnostic context: Comparison of three dosimetric approaches

Purpose: The dosimetric assessment of novel radiotracers represents a legal requirement in most countries. While the techniques for the computation of internal absorbed dose in a therapeutic context have made huge progresses in recent years, in a diagnostic scenario the absorbed dose is usually extracted from model-based lookup tables, most often derived from International Commission on Radiological Protection (ICRP) or Medical Internal Radiation Dose (MIRD) Committee models. The level of approximation introduced by these models may impact the resulting dosimetry. The aim of this work is to establish whether a more refined approach to dosimetry can be implemented in nuclear medicine diagnostics, by analyzing a specific case. Methods: The authors calculated absorbed doses to various organs in six healthy volunteers administered with flutemetamol ({sup 18}F) injection. Each patient underwent from 8 to 10 whole body 3D PET/CT scans. This dataset was analyzed using a Monte Carlo (MC) application developed in-house using the toolkit GATE that is capable to take into account patient-specific anatomy and radiotracer distribution at the voxel level. They compared the absorbed doses obtained with GATE to those calculated with two commercially available software: OLINDA/EXM and STRATOS implementing a dose voxel kernel convolution approach. Results: Absorbed doses calculated with GATE were higher than those calculated with OLINDA. The average ratio between GATE absorbed doses and OLINDA’s was 1.38 ± 0.34 σ (from 0.93 to 2.23). The discrepancy was particularly high for the thyroid, with an average GATE/OLINDA ratio of 1.97 ± 0.83 σ for the six patients. Differences between STRATOS and GATE were found to be higher. The average ratio between GATE and STRATOS absorbed doses was 2.51 ± 1.21 σ (from 1.09 to 6.06). Conclusions: This study demonstrates how the choice of the absorbed dose calculation algorithm may introduce a bias when gamma radiations are of importance, as is the case in nuclear medicine diagnostics.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2026

Mitigating Algorithmic Bias in Cancer Site Classification Models

Purpose Integrating artificial intelligence in cancer diagnostics has improved tumor classification beyond rule-based systems. Despite these advancements, these models may still encode demographic biases. We conducted a large-scale, applied bias-probing study of a deep learning–based cancer site classifier to quantify race information encoded in document embeddings. We then evaluated how performance changes when race-correlated embedding dimensions are removed in a post-training sensitivity analysis. Methods The cancer site classifier was trained using 3.5 million electronic cancer pathology reports from six of the National Cancer Institute's SEER registries. We trained a hierarchical self-attention network to generate 400-dimensional document embeddings. These embeddings were used to train two downstream, gradient-boosted decision tree classifiers: one to classify the cancer sites and another to predict racial categories. We identified overlapping features by intersecting the top 50 feature-importance rankings from the site and race models and computed their cumulative feature importance in each model. As a post hoc sensitivity analysis, we progressively pruned these overlapping dimensions, retrained the site model, and compared overall macro-F1 and accuracy, race-stratified macro-F1, and group fairness metrics on the basis of demographic parity and equalized odds before and after pruning. Results The analysis revealed minimal feature overlap between the cancer site and race prediction models, and the cumulative importance scores indicated a negligible influence of racial information on clinical predictions. Post-training pruning of overlapping features did not compromise the models' diagnostic accuracy, with a 0.07% loss in accuracy. Conclusion Our findings demonstrate that HiSAN-generated embeddings from SEER data can be used effectively in cancer site classification without significant demographic bias influencing the outcomes. Post-training pruning therefore functions as a practical audit and sensitivity check.

Shivanna, Abhishek [ORNL] (ORCID:0009000665228593)↗
DOE OSTI2021

Classification and computation of extreme events in turbulent combustion

In the design of practical combustion systems, ensuring safety and reliability is an important requirement. For instance, reliably avoiding lean blowout, flame flashback or inlet unstart is critical for ensuring safe operation. Currently, the science of predicting such events is based on prior experience, limited modeling or diagnostic tools and purely statistical approaches. Even though computational and experimental tools for studying combustion devices have vastly advanced in the last three decades, the analysis of such failure events has not been pursued widely. While the use of data for model development and calibration is being widely accepted, the extension to failure events introduces numerous challenges. In particular, the focus here is on so-called data-poor problems, where the cost of generating data is extremely high and is not easily amenable to existing computational and experimental approaches. Data-poor problems are particularly relevant when related to extreme events (also called anomalous events) that can lead to catastrophic failure of the system. It is argued that transient events that describe such failure can have different causal mechanisms. To develop the scientific inference process, a classification of such problems is used to determine specific modeling paths as well as computational tools needed. Research opportunities in the emerging field of extreme event prediction are highlighted in order to identify critical and immediate needs.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

A systematic feature extraction and selection framework for data-driven whole-building automated fault detection and diagnostics in commercial buildings

In data-driven automated fault detection and diagnostics (AFDD) modeling for building energy systems, feature engineering is a critical process of extracting information from high-dimensional and noisy sensor measurement and turning it into informative and representative inputs or features for data-driven modeling. However, few studies specifically discuss the feature engineering, especially the interactions between feature extraction and feature selection in whole-building AFDD. We developed a systematic feature extraction and selection framework for whole-building AFDD. In this framework, features are aggressively extracted from raw sensor data using statistical feature extraction techniques with various window sizes and statistics. With many features extracted, a hybrid feature selection algorithm that combines the filter and wrapper method then selects the best feature set. The framework considers diversity in the duration of fault behavior among fault types in whole-building AFDD, thus achieving high model generalization. We implemented our developed framework in a virtual testbed calibrated with measured data from Oak Ridge National Laboratory's Flexible Research Platform designed to mimic the operation of a typical small commercial building. The AFDD model is trained by the simulation data generated from the virtual testbed. The results show that (1) the developed framework improves the generalization of the AFDD model by 10.7% compared with literature-reported feature extraction and selection methods and (2) features with diverse window sizes and statistics are selected, providing insight into physical systems beyond the current understanding of buildings and faults and improving the detection and diagnostics of multiple fault types.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Characterisation of ion temperature and toroidal rotation on the ST40 tokamak

ST40 is a high field low-aspect ratio spherical tokamak built and operated by Tokamak Energy Ltd. Recent plasma operations were aimed at exploring operational scenarios to maximise the central plasma temperature and have culminated in the achievement of thermal ion temperatures of over 9 keV. Here this paper presents ion temperature and toroidal rotation measurements performed on ST40 during the 2021–22 campaign for a range of different scenarios. Several independent diagnostic systems are used, analysing their correlation and interpreting their differences using new diagnostic forward models.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2018

Fluorescence and absorption spectroscopy for warm dense matter studies and ICF plasma diagnostics

The burning core of an inertial confinement fusion (ICF) plasma produces bright x-rays at stagnation that can directly diagnose core conditions essential for comparison to simulations and understanding fusion yields. These x-rays also backlight the surrounding shell of warm, dense matter, whose properties are critical to understanding the efficacy of the inertial confinement and global morphology. In this work, we show that the absorption and fluorescence spectra of mid-Z impurities or dopants in the warm dense shell can reveal the optical depth, temperature, and density of the shell and help constrain models of warm, dense matter. This is illustrated by the example of a high-resolution spectrum collected from an ICF plasma with a beryllium shell containing native iron impurities. Lastly, analysis of the iron K-edge provides model-independent diagnostics of the shell density (2.3 × 10 24 e/cm 3 ) and temperature (10 eV), while a 12-eV red shift in Kβ and 5-eV blue shift in the K-edge discriminate among models of warm dense matter: Both shifts are well described by a self-consistent field model based on density functional theory but are not fully consistent with isolated-atom models using ad-hoc density effects.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

Methods to Evaluate Subcolumn Profiles Based on Two-Point Diagnostics

In atmospheric models, stochastic generation of subgrid-scale profiles or “subcolumns” has been used for a variety of purposes. Such subcolumns can be generated from subgrid probability density functions (PDFs) at different vertical levels, when such PDFs are available. To do so, the generator needs to decide how strongly points should be correlated in the vertical, that is, how much the values should be overlapped. This is sometimes called “PDF overlap.” To assess vertical correlation in a simplified, observable setting, here the vertical correlation of vertical velocity in subcloud layers is examined. Doppler lidar is used to evaluate the vertical profiles of vertical velocity produced by a large-eddy simulation (LES) model and the Subgrid Importance Latin Hypercube Sampler (SILHS) subcolumn generator. In order to diagnose unrealistic features in subcolumn profiles, various statistical diagnostics are examined here, including the bivariate PDF of vertical velocity at two separated points (i.e., altitudes), the two-point velocity correlation, the integral correlation length, the PDF of two-point velocity differences, and the skewness and kurtosis of two-point velocity differences. The profiles produced by LES match lidar well, except that they are too smooth at small scales. The profiles produced by SILHS exhibit sharp jumps from updraft to downdraft that are not observed in the lidar data. To reduce the generation of these unrealistically sharp jumps, the SILHS sampling method is revised. The diagnostics confirm that the revised sampling method reduces the overprediction of sharp jumps.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1977

Flare heating by energetic nonthermal electrons

A model has been developed which includes, in a self-consistent fashion, the energy degradation and attendant bremsstrahlung emission of a high-energy electron beam, heating of a flare plasma by the beam, and subsequent cooling by thermal conduction and radiation. To assist in the interpretation of experimental diagnostics, the model also characterizes the radiative behavior of iron ions present in the flare plasma. Electron deposition is described by the Fokker-Planck equation for an initial power-law particle distribution. Results are presented for the bremsstrahlung radiation emitted by the incident beam as it impinges on the disturbed atmosphere. A comparison is made between direct beam heating and thermal-conduction heating of the flare plasma. The radiation emitted by several selected spectral lines of Fe ions is determined as a function of time during and after deposition

Davis, J.↗
NASA NTRS2018

Dynamic Adjustment of Simulation Parameters for Efficient Vehicle Prognostics

Model-based diagnostics and prognostics rely on state estimation and uncertainty management algorithms to produce useful information for system operators and maintainers. This information enables more informed operational decisions, condition-based maintenance, and overall mission safety assurance. Typically, uncertainty is associated with vehicle state-of-health estimation and prediction results because of modeling errors, internal or external sources of noise, and sensor inaccuracy. Probabilistic uncertainty management methods including Sequential Monte Carlo simulation are commonly used to reason about state-of-health estimates and predictions in the presence of these sources of uncertainty. However, such algorithms can be computationally expensive as they require a very large number of samples to obtain a sufficiently accurate quantification of the end of life probability distribution. As a result, highly mobile autonomous systems that leverage the prognostic results for mission-level replanning are often constrained in their processing capability because of these computationally expensive simulation approaches. Therefore, in this paper, we investigate algorithmic methods for dynamically adjusting simulation time step as well as number of samples to achieve highly efficient prognostic results while maintaining results accuracy. Results obtained from simulated flight experiments of an electric unmanned aerial vehicle are presented to verify the efficacy of such algorithms.

Prognostics↗
NASA NTRS2011

Diagnosing the Sensitivity of Local Land-Atmosphere Coupling via the Soil Moisture-Boundary Layer Interaction

The inherent coupled nature of earth s energy and water cycles places significant importance on the proper representation and diagnosis of land atmosphere (LA) interactions in hydrometeorological prediction models. However, the precise nature of the soil moisture precipitation relationship at the local scale is largely determined by a series of nonlinear processes and feedbacks that are difficult to quantify. To quantify the strength of the local LA coupling (LoCo), this process chain must be considered both in full and as individual components through their relationships and sensitivities. To address this, recent modeling and diagnostic studies have been extended to 1) quantify the processes governing LoCo utilizing the thermodynamic properties of mixing diagrams, and 2) diagnose the sensitivity of coupled systems, including clouds and moist processes, to perturbations in soil moisture. This work employs NASA s Land Information System (LIS) coupled to the Weather Research and Forecasting (WRF) mesoscale model and simulations performed over the U.S. Southern Great Plains. The behavior of different planetary boundary layers (PBL) and land surface scheme couplings in LIS WRF are examined in the context of the evolution of thermodynamic quantities that link the surface soil moisture condition to the PBL regime, clouds, and precipitation. Specifically, the tendency toward saturation in the PBL is quantified by the lifting condensation level (LCL) deficit and addressed as a function of time and space. The sensitivity of the LCL deficit to the soil moisture condition is indicative of the strength of LoCo, where both positive and negative feedbacks can be identified. Overall, this methodology can be applied to any model or observations and is a crucial step toward improved evaluation and quantification of LoCo within models, particularly given the advent of next-generation satellite measurements of PBL and land surface properties along with advances in data assimilation schemes.

Santanello, Joseph A., Jr.↗
NASA NTRS2015

Real-Time Model-Based Leak-Through Detection within Cryogenic Flow Systems

The timely detection of leaks within cryogenic fuel replenishment systems is of significant importance to operators on account of the safety and economic impacts associated with material loss and operational inefficiencies. Associated loss in control of pressure also effects the stability and ability to control the phase of cryogenic fluids during replenishment operations. Current research dedicated to providing Prognostics and Health Management (PHM) coverage of such cryogenic replenishment systems has focused on the detection of leaks to atmosphere involving relatively simple model-based diagnostic approaches that, while effective, are unable to isolate the fault to specific piping system components. The authors have extended this research to focus on the detection of leaks through closed valves that are intended to isolate sections of the piping system from the flow and pressurization of cryogenic fluids. The described approach employs model-based detection of leak-through conditions based on correlations of pressure changes across isolation valves and attempts to isolate the faults to specific valves. Implementation of this capability is enabled by knowledge and information embedded in the domain model of the system. The approach has been used effectively to detect such leak-through faults during cryogenic operational testing at the Cryogenic Testbed at NASA's Kennedy Space Center.

Walker, M.↗