Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model diagnostics and development”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

ARM data-oriented metrics and diagnostics package for climate model evaluation (ARM-DIAGS-V3) version 3

A Python-based metrics and diagnostics package is currently being developed by the ARM Infrastructure Team at Lawrence Livermore National Laboratory to facilitate the use of long-term high frequency measurements from the ARM program in evaluating the regional climate simulation of clouds, radiation, precipitation, and aerosols. This metrics and diagnostics package computes climatological means of targeted climate model simulation and generates tables and plots for comparing the model simulation with ARM observational data. The CMIP model data sets are also included in the package to enable model inter-comparison as demonstrated in Zhang et al. (2018) and Zhang et al. (2020). The mean of the CMIP model can be served as a reference for individual models. Basic performance metrics are computed to measure the accuracy of mean state and variability of climate models. The evaluated physical quantities include cloud fraction, temperature, relative humidity, cloud liquid water path, total column water vapor, precipitation, sensible and latent heat fluxes, aerosol optical depth, and radiative fluxes, with plan to extend to more fields, such as the evaluation of model simulated aerosol physicochemical properties and cloud microphysics properties. Process-oriented diagnostics focusing on aerosol, cloud, and precipitation-related phenomena are also being developed for the evaluation and development of specific model physical parameterizations. In addition to the Southern Great Plains (SGP), North Slope of Alaska (NSA) and Tropical Western Pacific (TWP) atmospheric observatories in the ARMDIAGS version 2.0, the version 3.0 package have extended to the data collected at the ARM Eastern North Atlantic (ENA) atmospheric observatory and the Observation and Modeling of the Green Ocean Amazon (GOAMAZON) field campaign. The metrics and diagnostics package are currently built upon standard Python libraries and additional Python packages developed by DOE (CDAT). The ARM metrics and diagnostic package is available publicly with the hope that it can serve as an easy entry point for climate modelers to compare their models with ARM data. In this report, we first provide an overview of major metrics in section 2. The input data, which constitutes the core content of the metrics and diagnostics package, is summarized in section 3. A user's guide documenting the workflow/structure of the version 3.0 codes and including step-by-step instruction for running the package is described in section 4.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

A Comprehensive Chemistry Evaluation and Diagnostics Package for E3SM – ChemDyg Version 1.1.0

The Chemistry Evaluation and Diagnostics Package (ChemDyg) is an open-source tool designed for the Energy Exascale Earth System Model (E3SM) developed by the U.S. Department of Energy. ChemDyg facilitates routine evaluation, tailored development, and in-depth analysis of atmospheric chemistry through its modular architecture, allowing users to compare model outputs with observational data. Version 1.1.0 introduces a robust set of diagnostic capabilities, including climatology, time evolution of key tracers, diurnal and annual cycle analyses, and extensive budget diagnostics. These features help identify model discrepancies and enhance the representation of atmospheric chemistry in E3SM. Each self-contained diagnostic set includes dedicated scripts and documentation for ease of use. The interactive HTML output improves data accessibility, accelerating chemistry model development. Additionally, ChemDyg's flexible framework allows for customization, enabling users to create unique diagnostic sets for specific scientific contributions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Quality Assurance Project Plan for the Salish Sea Model – Continuing Development of New Capabilities and Applications: European Green Crab (EGC) Larval Transport, Coupling to VELMA and Atlantis, Performance Improvements and Diagnostic Applications

This quality assurance project plan (QAPP) is for proposed FY24-FY27 efforts to (a) develop/expand a predictive European Green Crab (EGC) larval dispersal model for the Salish Sea, (b) add linkage between VELMA (Visualizing Ecosystem Land Management Assessments) watershed model and Atlantis model (ecosystem dynamics and food web) through SSM, and (c) continue SSM capability development through the addition of metals, harmful algal blooms (HABs), and FVCOM-LTRANS (Lagrangian Larval Transport) modules.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Geomechanical and Hydrogeological Evaluation of a Shallow Hydraulic Fracture at the Devine Fracture Pilot Site, Medina County, Texas

UT-Austin’s Devine Fracture Pilot Site, 50 miles southwest of San Antonio, Texas, has been targeted for a comprehensive, multidisciplinary development of fracture diagnostic techniques that are cross-validated by ground-truth data acquisition near a recently created, 175-ft-deep, horizontal hydraulic fracture (Ahmadian et al. 2018 Demonstration of proof of concept of electromagnetic geophysical methods for high resolution illumination of induced fracture networks. In Proceedings of the SPE Hydraulic Fracturing Technology Conference and Exhibition, The Woodlands, Texas, USA, 23–25 January 2018. SPE-189858-MS.). To evaluate the fracture diagnostic methods at this site, we conducted injection tests with a predefined volumetric flow-rate profile, resembling a diagnostic fracture injection test on September 2020. Subsequently, we developed hydrogeological and geomechanical models based on flow-rate and bottomhole-pressure measurements. History-matching efforts using a simplified layer-cake hydrogeological model resulted in the field-scale formation permeability of 9.87 × 10 –15 m 2 (10 mD) and Darcy-scale fracture permeability. The analysis of the bottomhole pressure and injection-rate history showed that (1) the newly created horizontal fracture was closed adjacent to the injection well pre-injection and (2) the initial pump-pressure increase at a nominal volumetric injection rate led to near-well fracture reopening, fluid conductivity increase, and abrupt injection-rate increase. To overcome hydrogeological-model limitations of predicting fracture reopening throughout injection, we extended the modeling to a finite-element, poroelastic analysis of horizontal-fracture growth using a cohesive-zone model. Using this fracture-reopening model, we improved the history match of the transient-pressure response during the experiment by adjusting the hydromechanical properties. Furthermore, post-injection pressure transient analyses helped reduce uncertainty in the overburden-stress gradient, and the initial hydraulic-fracturing simulation verified the plausibility of achieving the surveyed propped fracture area.

02 PETROLEUM↗
DOE OSTI2024

Forward Modeling of Gamma Reaction History Signatures From Anticipated Deuterium-Tritium Filled MagLIF Implosions on Sandia’s Z-Machine

Nuclear reaction history measurements provide a bang time and burn width of Inertial Confinement Fusion (ICF) implosions and are essential for understanding implosion performance to constrain ICF capsule design. When fusion fuel contains Deuterium (D) and Tritium (T) gas, reaction history is informed by measuring the 16.75 MeV gamma rays generated from the D(T,γ) 5 He reaction. Such DT based reaction history measurements have not been made on the Magnetized Laser Inertial Fusion (MagLIF) platform on Sandia’s Z-Machine due to the lack of Tritium being used. The recent development of ICF implosions with tritiated fuel will open the possibility of measuring the gamma reaction history on the Z-Machine. A forward model of the Gamma Reaction History diagnostic on Z (GRH-Z) has been developed using the MCNP6.3 (Monte-Carlo N-Particle) radiation transport code. The model included the Z-Machine geometry of interest to characterize the impact of neutron induced gamma rays on the DT reaction history measurements. In addition, the impulse response functions of the GRH-Z diagnostic to understand the temporal response of the detector, and the minimum yields required to make a reaction history measurement were calculated. This approach also predicted that with T 2 gas doping of MagLIF implosions a reaction history may be made for high performance shots >8e12-2.4e13 depending on the chosen threshold for the detector, with a maximum signal to background ratio of 25%. It was found that for long duration ICF implosions that additional collimation will be needed to prevent the neutron induced gamma rays from modifying the shape of the measured DT reaction history curve.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2025

Machine Learning for LBNF Beam Diagnostics

This paper focuses on developing a machine learning model for predicting initial beam parameters for the Long Baseline Neutrino Facility (LBNF) beamline using downstream muon monitor data. Parameters such as proton beam position on target, sigma on target, focusing horn current, and focusing horn tilt are parameters we anticipate to be predictable based on the muon monitors. Uncertainty in initial beam condition measurements are a major contributor to uncertainty in downstream flux, and over operation time beam misalignment can occur [1]. A machine learning model has promise to detect anomalies along the beamline based on discrepancies between predicted configurations and measured configurations, and thus can expedite error detection and handling. A PyTorch neural network is defined, trained, and tested. The developed model currently does not provide reliable predictions, with the lowest loss being 0.09.. Further steps to improve the model’s accuracy are discussed, as well as future plans to detect anomalous beam conditions using a digital twin.

O'Brien, Bridget [Fermilab]↗
DOE OSTI2022

Toward More Actionable Flood‐Risk Information

Abstract The increasingly urgent need to develop knowledge and practices to manage flood risks drives innovative information design. However, experts often disagree about design practices. As a result, flood‐risk estimates can diverge, leading to different conclusions for decision‐making. Using examples of household‐scale fluvial (riverine) flood‐risk information in the United States, we assess design features and risk communication approaches that may lead to more actionable information for decision‐making. We argue that increased attention to uncertainty characterization and model diagnostics is a critical intermediate step for developing simpler approaches for designing flood‐risk information. Simpler frameworks are desirable because flood risks change over time, and simpler frameworks are less costly to update. Developing frameworks for large spatial domains require collaboration grounded in principles of open science. Finally, systematically evaluating how decision‐makers access and use information can provide new insights to guide risk communication and information design.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Neutron Induced Nuclear Reaction Cross Sections for Radiochemistry in the Region of Thallium, Lead, and Bismuth

We have developed a set of modeled nuclear reaction cross sections for use in radiochemical detector diagnostics. Systematics for the input parameters required by the Hauser-Feshbach statistical model developed in the TALYS code system are used to calculate neutron induced nuclear reaction cross sections for targets ranging from Thallium (Z = 81) to Bismuth (Z = 83).

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗
DOE OSTI2023

Real-time estimation of the electron temperature profile in DIII-D by leveraging neural-network surrogate models

Control of both the magnitude and the shape of tokamak profiles will be necessary to achieve stable, high-performance plasmas. In order to reject disturbances in real time, feedback-control algorithms rely on accurate real-time knowledge of the plasma state. When diagnostics alone are insufficient, either because they are limited in number or their measurements are too noisy, observers can be used to combine diagnostic data with a response model to provide a better estimation of different plasma properties. An observer has been developed to estimate the electron temperature profile in real time using both diagnostic data from the Thomson scattering system and a model based on the electron heat transport equation describing the evolution of the electron temperature profile. Here, neural network surrogate models are leveraged to help improve the overall model prediction while staying within computation time constraints for real-time use. The observer algorithm is shown in offline tests to produce smooth profiles that are consistent with both the diagnostic data and the electron heat transport equation. When implemented into the real-time plasma control system, this observer will provide valuable information on the electron temperature profile to many potential feedback-control applications.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2022

UrbanPop: A spatial microsimulation framework for exploring demographic influences on human dynamics

Ensuring the social equity of planning measures in social systems requires an understanding of human dynamics, particularly how individual relationships, activities, and interactions intersect with individual needs. Spatial microsimulation models (SMSMs) support planning for human security goals by representing human dynamics through realistic, georeferenced synthetic populations, that a) provide a complete representation of social systems while b) also protecting individual privacy. In this paper, we present UrbanPop, an open and reproducible SMSM framework for analysis of human dynamics with high spatial, temporal, and demographic resolution. UrbanPop creates synthetic populations of demographically detailed worker and student agents, positioning them first at probable nighttime locations (home), then moving them to probable daytime locations (work/school). Summary aggregations of these populations match the granular detail available at the census block group level in the American Community Survey Summary File (SF), providing realistic approximations of the actual population. UrbanPop users can select particular demographic traits important in their application, resulting in a highly tailored agent population. We first lay out UrbanPop's baseline methodology, including population synthesis, activity modeling, and diagnostics, then demonstrate these capabilities by developing case studies of shifting population distributions and high-risk populations in Knox County, TN during the global COVID-19 pandemic.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

Developing and applying quantifiable metrics for diagnostic and experiment design on Z

This project applies methods in Bayesian inference and modern statistical methods to quantify the value of new experimental data, in the form of new or modified diagnostic configurations and/or experiment designs. We demonstrate experiment design methods that can be used to identify the highest priority diagnostic improvements or experimental data to obtain in order to reduce uncertainties on critical inferred experimental quantities and select the best course of action to distinguish between competing physical models. Bayesian statistics and information theory provide the foundation for developing the necessary metrics, using two high impact experimental platforms on Z as exemplars to develop and illustrate the technique. We emphasize that the general methodology is extensible to new diagnostics (provided synthetic models are available), as well as additional platforms. We also discuss initial scoping of additional applications that began development in the last year of this LDRD.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Model-Based Diagnostics and Mitigation of Cyber Threats

The report summarizes key tasks performed to develop a toolkit for detecting cyber-attack events in instrumentation and control (I&C) systems of nuclear power plants. The toolkit connects the state-of-the-art GPWR Simulator with the RELAP5 code providing best-estimate nuclear steam supply system (NSSS) analyses, via the application programming interface (API), and allows users to introduce potential cyber-attack scenarios into power plant operational simulation. This summary for the project reflects topical reports submitted during the project as well as a journal paper published in 2022. The focus areas of the summary include: (1) modeling I&C systems for the AP1000 Generation III+ nuclear plant and GPWR simulator, (2) simulation and monitoring of plant response to cyber-attack events, (3) API structure for the toolkit interfacing the GPWR simulator and RELAP5 code, and (4) restructuring of the three-loop NSSS software of GPWR to model the two-loop AP1000 structure. Discussed in some details are (a) the attack tree analysis assessing the susceptibility of the AP1000 I&C system, resulting in reactor trips, in terms of the attack possibility and component sensitivity and (b) realistic estimation of the time to steam generator trip due to cyber-intrusions in the GPWR Simulator. Finally, sample demonstrations of the cyber-security tool kit, in the form of the GPWR-RELAP5 API, are summarized.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2024

Estimating Uncertainty in Simulated ENSO Statistics

Abstract Large ensembles of model simulations are frequently used to reduce the impact of internal variability when evaluating climate models and assessing climate change induced trends. However, the optimal number of ensemble members required to distinguish model biases and climate change signals from internal variability varies across models and metrics. Here we analyze the mean, variance and skewness of precipitation and sea surface temperature in the eastern equatorial Pacific region often used to describe the El Niño–Southern Oscillation (ENSO), obtained from large ensembles of Coupled model intercomparison project phase 6 climate simulations. Leveraging established statistical theory, we develop and assess equations to estimate, a priori, the ensemble size or simulation length required to limit sampling‐based uncertainties in ENSO statistics to within a desired tolerance. Our results confirm that the uncertainty of these statistics decreases with the square root of the time series length and/or ensemble size. Moreover, we demonstrate that uncertainties of these statistics are generally comparable when computed using either pre‐industrial control or historical runs. This suggests that pre‐industrial runs can sometimes be used to estimate the expected uncertainty of statistics computed from an existing historical member or ensemble, and the number of simulation years (run duration and/or ensemble size) required to adequately characterize the statistic. This advance allows us to use existing simulations (e.g., control runs that are performed during model development) to design ensembles that can sufficiently limit diagnostic uncertainties arising from simulated internal variability. These results may well be applicable to variables and regions beyond ENSO.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

ARM Data-Oriented Metrics and Diagnostics Package for Climate Model Evaluation

A Python-based metrics and diagnostics package is currently being developed by the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility Infrastructure Team at Lawrence Livermore National Laboratory to facilitate the use of long-term, high-frequency measurements from ARM in evaluating the regional climate simulation of clouds, radiation, and precipitation. This metrics and diagnostics package computes climatological means of targeted climate model simulation and generates tables and plots for comparing the model simulation with ARM observational data.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

A review of computing-based automated fault detection and diagnosis of heating, ventilation and air conditioning systems

We report faults in Heating, Ventilation, and Air Conditioning (HVAC) systems of buildings result in significant energy waste in building operation. With fast-growing sensing data availability and advancement in computing, computational modeling has demonstrated strong capability to detect and diagnose HVAC system faults, hence, ensuring efficient building operation. This paper comprehensively reviews the state-of-the-art computing-based fault detection and diagnosis (FDD) for HVAC systems. Overall, the reviewed computing-based FDD methods are classified as two major approaches: knowledge-based and data-driven approaches. We then identify multiple important topics, including data availability, training data size, data quality, approach generality, capability, interpretability, and required modeling efforts, along with corresponding metrics to summarize the most updated FDD development. Generally, the knowledge-based approaches are further divided as physics-based modeling, Diagnostic Bayesian Network, and performance indicator-based methods while data-driven approaches include supervised learning, unsupervised learning, and regression and statistics-based methods. State-of-the-art FDD development, remaining challenges, and future research directions are further discussed to push forward FDD in practice. Availability of fault data, capability of existing methods to deal with complex fault situations (such as simultaneous faults), modeling interpretability for data-driven methods, and required engineering efforts for physics-based methods are identified as remaining challenges in FDD development. Improving modeling fidelity and reducing modeling efforts are essential for applying physics-based methods in real buildings. Meanwhile, addressing fault data availability, increasing algorithm adaptability, and handling multiple faults are essential to further enhance the applicability of data-driven FDD approaches.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2020

Model Development for Multi-Component Fuel Vaporization and Flash Boiling

The objectives of this project are to improve the multi-component fuel droplet and film vaporization models used in internal combustion engine simulation, and to develop a comprehensive model to predict the characteristics of multi-component flash boiling spray. This work explores two approaches to fuel composition treatment for modeling multi-component fuel vaporization: one based on discretization and surrogates, and the other based on continuous thermodynamic distribution of fuel properties. The experimental data collected for model validation are done under three fuel form factors: droplet, spray, and thin film. The study on sprays also include experimentation under non-flash and flash boiling conditions, a phenomenon that enhances fuel vaporization. The main goals of this work are: Design and develop a multi-component fuel droplet and wall film vaporization model using both discrete and continuous thermodynamics methods. Design and develop an analytical model for multi-component flash boiling. Integrate the multi-component droplet and film model into multi-dimensional engine calculations to predict the fuel vaporization process under engine operation condition. Conduct multi-component droplet and fuel film vaporization experiments in a non-combusting chamber to verify the proposed vaporization models. Characterize flash boiling phenomena of multi-component fuel sprays by optical and laser diagnostic techniques. This report will detail the experimental setup and the numerical basis for developing a model to achieve the main goals listed above. Key features of observed multi-component fuel vaporization will be summarized at the end of each experimental sections, and corresponding model performance evaluation will be presented at the end of each model development section.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2023

Physically-based control-oriented modeling for turbocharged stoichiometric spark-ignited engine with cooled EGR and flexible VVT systems

Accurate estimation and prediction of engine gas exchange system and in-cylinder conditions are critical for spark-ignited engine control and diagnostic algorithm development. In this paper, a physically-based, control-oriented model for a 2.8 l turbocharged, variable valve timing (VVT) and low pressure (LP) exhaust gas recirculation (EGR)-utilizing SI engine was developed. The model includes the impact of modulation to any combination of 10 actuators, including the throttle valve, compressor bypass valve, fueling rate, waste-gate, LP EGR valve, number of deactivated cylinders, intake valve open (IVO) timing, intake valve close (IVC) timing, exhaust valve open (EVO) timing and exhaust valve close (EVC) timing. The accuracy of the model in capturing engine dynamics was demonstrated by validating it against high-fidelity engine GT-Power simulation results for various drive cycles, particularly emphasizing elevated loads. In comparison to the open literature, novel contributions of the effort described in this paper includes in-cylinder gas composition modeling and turbine-out pressure estimation.

Zhang, Xu↗