Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “diagnostic modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Jacobian-based model diagnostics and application to equation oriented modeling of a carbon capture system

It can be difficult to identify the specific variables or equations responsible for convergence issues in large mathematical programming models. The Institute for the Design of Advanced Energy Systems Integrated Platform (IDAES-IP) contains a tool to identify poorly scaled constraints and variables by searching for rows and columns of the Jacobian matrix with small L2-norms. A singular value decomposition is then performed to identify degenerate sets of equations and remaining scaling issues. Here, this work presents a flowsheet developed for post-combustion carbon capture using a monoethanolamine (MEA) solvent system as a case study. This work takes the reader through the entire process of model diagnostics and reformulation, from a basic introduction to the mathematics behind these model diagnostics to the reformulations necessary to make the model numerically robust, including a significantly modified enhancement factor model.

IDAES↗
DOE OSTI2024

Model Diagnostics for Equation Oriented Models: Roadblocks and the Path Forward

This poster was presented at the Foundations of Computer Aided Process Design (FOCAPD) 2024 conference with a paper describing efforts to develop a unified workflow and toolbox for diagnosing issues in equation-oriented models as part of the IDAES modeling framework. The poster presents the work currently underway within the IDAES project to develop and integrate cutting edge model analysis techniques into a common toolbox and workflow for model developers to use.

Lee, Andrew↗
DOE OSTI2024

Model Diagnostics for Equation Oriented Models: Roadblocks and the Path Forward

Conference paper for FOCAPD24 describing efforts to develop a unified workflow and toolbox for diagnosing issues in equation-oriented models as part of the IDAES modeling framework. The paper presents the work currently underway within the IDAES project to develop and integrate cutting edge model analysis techniques into a common toolbox and workflow for model developers to use.

Lee, Andrew↗
DOE OSTI2024

Jacobian-based Model Diagnostics and Application to Equation Oriented Modeling of a Carbon Capture System

Equation-oriented (EO) modeling has the potential to enable the effective design and optimization of the operation of advanced energy systems. However, advanced modeling of energy systems results in a large number of variables and non-linear equations, and it can be difficult to search through these to identify the culprit(s) responsible for convergence issues. The Institute for the Design of Advanced Energy Systems Integrated Platform (IDAES-IP) contains a tool to identify poorly scaled constraints and variables by searching for rows and columns of the Jacobian matrix with small L2-norms so they can be rescaled. A further singular value decomposition can be per-formed to identify degenerate sets of equations and remaining scaling issues. This work presents an EO model of a flowsheet developed for post-combustion carbon capture using a monoethanolamine (MEA) solvent system as a case study. The IDAES diagnostics tools were successfully applied to this flowsheet to identify problems to improve model robustness and enable the optimization of process design and operating conditions of a carbon capture system.

Allan, Douglas↗
DOE OSTI2024

From minimum-viable-products to full models: a step-wise development of diagnostic forward models in support of design, analysis and modelling on the ST40 tokamak

Like most magnetic confined fusion experiments, the ST40 tokamak started off with a small subset of diagnostics and gradually increased the diagnostic set to include more complex and comprehensive systems. To make the most of each operational phase, forward models of various diagnostics are used and developed to aid design, provide consistency-checks during commissioning, test analysis methods, and build workflows to constrain high-level parameters to inform interpretation, theory and modelling. For new models and new analysis workflows, minimum-viable-products are released early, and their complexity is increased in a step-wise manner, facilitating the support of all programme phases on multiple parallel applications, while enabling learning opportunities and feedback loops. In this contribution we review the philosophy, scope and architecture of the framework under development. We discuss the details of some forward models, with examples on how they are used to aid diagnostic design, to investigate analysis methodologies through synthetic data, and how they are embedded in experimental analysis workflows. We compare previously published experimental results with new, more advanced analysis workflows employing more recent, detailed models and new diagnostic data, providing confirmation of the published material from the 2021–22 experimental campaign.

integrated data analysis↗
DOE OSTI2025

Dark Energy Survey Year 6 Results: Point-Spread Function Modeling

We present the point-spread function (PSF) modeling for weak lensing shear measurement using the full six years of the Dark Energy Survey (DES Y6) data. We review the PSF estimation procedure using the PIFF (PSFs In the Full FOV) software package and describe the key improvements made to PIFF and modeling diagnostics since the DES year three (Y3) analysis: (i) use of external Gaia and infrared photometry catalogs to ensure higher purity of the stellar sample used for model fitting, (ii) addition of color-dependent PSF modeling, the first for any weak lensing analysis, and (iii) inclusion of model diagnostics inspecting fourth-order moments, which can bias weak lensing measurements to a similar degree as second-order modeling errors. Through a comprehensive set of diagnostic tests, we demonstrate the improved accuracy of the Y6 models evident in significantly smaller systematic errors than those of the Y3 analysis, in which all g band data were excluded due to insufficiently accurate PSF models. For the Y6 weak lensing analysis, we include g band photometry data in addition to the riz bands, providing a fourth band for photometric redshift estimation. Looking forward to the next generation of wide-field surveys, we describe several ongoing improvements to PIFF, which will be the default PSF modeling software for weak lensing analyses for the Vera C. Rubin Observatory’s Legacy Survey of Space and Time.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

The vertical-velocity skewness in the atmospheric boundary layer without buoyancy and Coriolis effects

One of the main features of near-neutral atmospheric boundary layer (ABL) turbulence is the positive vertical velocity skewness $Sk_w$ above the roughness sublayer or the buffer region in smooth-walls. The $Sk_w$ variations are receiving renewed interest in many climate-related parameterizations of the ABL given their significance to cloud formation and to testing sub-grid schemes for Large Eddy Simulations (LES). The vertical variations of $Sk_w$ are explored here using wind tunnel and flume experiments collected above smooth, rough, and permeable-walls in the absence of buoyancy and Coriolis effects. These laboratory experiments form a necessary starting point to probe the canonical structure of $Sk_w$ as they deal with a key limiting case (i.e., near-neutral conditions). Diagnostic models based on cumulant expansions, realizability constraints, and constant mass flux approach routinely employed in the convective boundary layer as well as prognostic models based on third-order budgets are used to explain variations in $Sk_w$ for the idealized laboratory conditions. The failure of flux-gradient relations to model $Sk_w$ from the gradients of the vertical velocity variance σ$_w^2$ are explained and corrections based on models of energy transport offered. Novel links between the diagnostic and prognostic models are also featured, especially for the inertial term in the third-order budget of the vertical velocity fluctuation. The co-spectral properties of w′/σ w vs w′ 2 /σ$_w^2$ are also presented for the first time to assess the dominant scales governing $Sk_w$ in the inner and outer layers, where w′ is the fluctuating vertical velocity and σ w is the vertical velocity standard deviation.>

Boundary layer flow↗
DOE OSTI2024

LIGHT-bgcArgo-1.0: using synthetic float capabilities in E3SMv2 to assess spatiotemporal variability in ocean physics and biogeochemistry

Since their advent over 2 decades ago, autonomous Argo floats have revolutionized the field of oceanography, and, more recently, the addition of biogeochemical and biological sensors to these floats has greatly improved our understanding of carbon, nutrient, and oxygen cycling in the ocean. While Argo floats offer unprecedented horizontal, vertical, and temporal coverage of the global ocean, uncertainties remain about whether Argo sampling frequency and density capture the true spatiotemporal variability in physical, biogeochemical, and biological properties. As the true distributions of, e.g., temperature or oxygen are unknown, these uncertainties remain difficult to address with Argo floats alone. Numerical models with synthetic observing systems offer one potential avenue to address these uncertainties. Here, we implement synthetic biogeochemical Argo floats into the Energy Exascale Earth System Model version 2 (E3SMv2), which build on the Lagrangian In Situ Global High-Performance Particle Tracking (LIGHT) module in E3SMv2 (E3SMv2-LIGHT-bgcArgo-1.0). Since the synthetic floats sample the model fields at model run time, the end user defines the sampling protocol ahead of any model simulation, including the number and distribution of synthetic floats to be deployed, their sampling frequency, and the prognostic or diagnostic model fields to be sampled. Using a 6-year proof-of-concept simulation, we illustrate the utility of the synthetic floats in different case studies. In particular, we quantify the impact of (i) sampling density on the float-derived detection of deep-ocean change in temperature or oxygen and on float-derived estimates of phytoplankton phenology, (ii) sampling frequency and sea-ice cover on float trajectory lengths and hence float-derived estimates of current velocities, and (iii) short-term variability in ecosystem stressors on estimates of their seasonal variability.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

LossLens: Diagnostics for Machine Learning Through Loss Landscape Visual Analytics

Modern machine learning often relies on optimizing a neural network's parameters using a loss function to learn complex features. Beyond training, examining the loss function with respect to a network's parameters (i.e., as a loss landscape) can reveal insights into the architecture and learning process. While the local structure of the loss landscape surrounding an individual solution can be characterized using a variety of approaches, the global structure of a loss landscape, which includes potentially many local minima corresponding to different solutions, remains far more difficult to conceptualize and visualize. To address this difficulty, we introduce LossLens, a visual analytics framework that explores loss landscapes at multiple scales. LossLens integrates metrics from global and local scales into a comprehensive visual representation, enhancing model diagnostics. Here we demonstrate LossLens through two case studies: visualizing how residual connections influence a ResNet-20, and visualizing how physical parameters influence a physics-informed neural network (PINN) solving a simple convection problem.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Searching for a Pulse: Evaluating the Use of Rapid DC Pulses for Diagnosing Battery Health, State-of-Charge, and Safety

Rapid electrochemical diagnostics, like DC pulse sequences or electrochemical impedance spectroscopy, are known to be useful for capacity prediction. However, it is unclear how previous results will map to different cell types and use cases and whether rapid diagnostics are useful for remaining useful life prediction or for detecting potential safety issues. To that end, we have collected a data set with ∼50,000 DC pulse measurements from four types of commercial lithium-ion batteries to enable training of state-of-charge, health, and safety diagnostic models via machine-learning. We demonstrate that 120-second DC pulse sequences can be used to predict capacity with 2%–9% average error, which can separate high- from low-capacity cells with only a 0.3% false positive rate but is not accurate enough to estimate remaining useful life. We also find that no safety related targets can be accurately predicted, highlighting the critical need for other non-invasive methods to diagnose battery safety.

25 ENERGY STORAGE↗
DOE OSTI2025

Yield From Iowa's First Commercial Miscanthus Fields: Implications of Spatial Variability for Productivity and Sustainability Beyond Research Plots

The cultivation of sterile giant miscanthus (Miscanthus × giganteus, M × g) for bioenergy and bioproducts has expanded into grain-cropped land in the United States (US) as local markets developed for this high-yielding perennial grass (10–30 Mg DM ha −1 ). However, the magnitude of spatial and temporal variability in yield within US Corn Belt fields, along with impacts on economic return and sustainable land management, is poorly understood. This study established a diagnostic model relating remote sensing-derived vegetation indices to ground truth data from 105 hand-harvested stem biomass samples, which were strategically selected to represent the full range of vegetation index observations. The high-resolution satellite-sensed vegetation indices captured > 90% of the yield variation measured within fields. This model was then used to predict yield variability and assess economic performance across four of the first commercial M × g fields in the Corn Belt state of Iowa, US. Significant spatial variability in biomass dry matter (DM) yields (9.3–18.1 Mg DM ha −1 ) and net profits ($\$$83 to $\$$1211.5 ha −1 ) was observed. All fields were profitable in all site-years. When low profit occurred, it was explained by limited management experience of the crop in Iowa. The breakeven yield at a selling price of $\$$130 Mg −1 varied from 9.0–12.1 Mg ha −1 at 15% moisture content (7.6–10.3 Mg DM ha −1 ). Breakeven prices ranged from $\$$73 to $\$$122.4 Mg −1 , matching ranges used in the Department of Energy Billion Ton Report (US Department of Energy, 2023). Notably, M × g yield and profits were commensurate with grain crops particularly with favorable precipitation. This study provides insight on the M × g management “learning curve”, performance on marginal land and in drought conditions, and demonstrates that addressing yield gaps, reducing costs, and implementing precision agriculture strategies can enhance profitability. These findings emphasize the value of remote sensing technologies in guiding sustainable and competitive commercial-scale M × g production.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

Hot Droughts and Forest Tree Dynamics in the Amazon - Statistical Models, Scripts, Data, and Outputs

This package contains data, outputs, equations, and R scripts for analyses for manuscript entitled "Hot droughts in the Amazon: A window to a future hypertropical climate" by J. Chambers et al., in particular it contains statistical models and analyses for the INPA BIONTE tree mortality study. The Models folder contains details for all statistical models in PDF files. The Scripts folder contains the R scripts for Bayesian Hierarchical Models (two text files) and SEMs (one text file) are separate and reasonably annotated. All data associated with these scripts are in the data folder. The Data folder contains two of the three CSV files used for the analyses and are called by the R scripts. Two of them are part of published datasets (`BIONTE_mortality-rates.csv` from Lima et al. 2024, DOI:10.15486/ngt/1898910 and `SPEI.csv` from Pastorello et al. 2023 DOI:10.15486/ngt/1958257) and also provided in this package for convenience (please see the corresponding datasets for usage and citation terms). The third dataset (`BIONTE_gapfilled_wd.csv`) contains sensitive information and can be obtained by contacting the manuscript lead author. The Outputs folder contains the two output files that provide extra information about the analyses. The file `figuresFeb2025d.pdf` contains all the figures from the manuscript - captions are in the manuscript. The file `ChambersMS.pdf` contains primary results from Bayesian statistical models, regression analyses, and validation steps applied to the tree mortality data from the INPA experiments. The document includes visual summaries, model diagnostics, and leave-one-out (LOO) validation results. A breakdown of file contents can be found in the README file that is part of this package.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Toward model-free temperature diagnostics of warm dense matter from multiple scattering angles

Warm dense matter plays an important role in astrophysical objects and technological applications, but the rigorous diagnostics of corresponding experiments is notoriously difficult. In this work, we present a model-free analysis of x-ray Thomson scattering (XRTS) measurements on isochorically heated graphite obtained at the Linac Coherent Light Source at multiple scattering angles. We demonstrate that the recent imaginary-time thermometry technique works for scattering data that have been measured in both forward and backward scattering geometry. This opens up the way toward a rigorous quantification of nonequilibrium effects in future experiments, where XRTS measurements are being obtained from multiple scattering angles from the same sample.

Equations of state↗
DOE OSTI2024

Improving Reliability of Large Language Models for Nuclear Power Plant Diagnostics [Poster]

Large Language Models (LLMs) struggle out of the box when answering factually about detailed questions, especially in domains that are sparsely represented in their training data. This causes hallucinations and reduces reliability making it difficult for them to be used in practice. This work shows that using RAG techniques can improve factual accuracy and reliability, allowing for the application of LLMs in specialized areas, even when those areas that aren’t extensively covered in their initial training.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2026

ARM Data-Oriented Metrics and Diagnostics Package for Climate Model Evaluation

A Python-based metrics and diagnostics package is currently being developed by the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) Infrastructure Team at Lawrence Livermore National Laboratory (LLNL) to facilitate the use of long-term, high-frequency measurements from the ARM Facility in evaluating the regional climate simulation of clouds, radiation, and precipitation. This metrics and diagnostics package computes climatological means of targeted climate model simulation and generates tables and plots for comparing the model simulation with ARM observational data. The Coupled Model Intercomparison Project (CMIP) model data sets are also included in the package to enable model intercomparison as demonstrated in Zhang et al. (2017). The mean of the CMIP model can serve as a reference for individual models. Basic performance metrics are computed to measure the accuracy of mean state and variability of climate models. The evaluated physical quantities include cloud fraction, temperature, relative humidity, cloud liquid water path, total column water vapor, precipitation, sensible and latent heat fluxes, and radiative fluxes, with plan to extend to more fields, such as aerosol and microphysics properties. Process-oriented diagnostics focusing on individual cloud- and precipitation-related phenomena are also being developed for the evaluation and development of specific model physical parameterizations. The version 1.0 package is designed based on data collected at ARM’s Southern Great Plains (SGP) Research Facility, with the plan to extend to other ARM sites. The metrics and diagnostics package is currently built upon standard Python libraries and additional Python packages developed by DOE (such as CDMS and CDAT). The ARM metrics and diagnostic package is available publicly with the hope that it can serve as an easy entry point for climate modelers to compare their models with ARM data. In this report, we first present the input data, which constitutes the core content of the metrics and diagnostics package in section 2, and a user's guide documenting the workflow/structure of the version 1.0 codes, and including step-by-step instruction for running the package in section 3.

54 ENVIRONMENTAL SCIENCES↗