Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data base for model validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 883 records · Page 49

Scalable deep learning for watershed model calibration

Watershed models such as the Soil and Water Assessment Tool (SWAT) consist of high-dimensional physical and empirical parameters. These parameters often need to be estimated/calibrated through inverse modeling to produce reliable predictions on hydrological fluxes and states. Existing parameter estimation methods can be time consuming, inefficient, and computationally expensive for high-dimensional problems. In this paper, we present an accurate and robust method to calibrate the SWAT model (i.e., 20 parameters) using scalable deep learning (DL). We developed inverse models based on convolutional neural networks (CNN) to assimilate observed streamflow data and estimate the SWAT model parameters. Scalable hyperparameter tuning is performed using high-performance computing resources to identify the top 50 optimal neural network architectures. We used ensemble SWAT simulations to train, validate, and test the CNN models. We estimated the parameters of the SWAT model using observed streamflow data and assessed the impact of measurement errors on SWAT model calibration. We tested and validated the proposed scalable DL methodology on the American River Watershed, located in the Pacific Northwest-based Yakima River basin. Our results show that the CNN-based calibration is better than two popular parameter estimation methods (i.e., the generalized likelihood uncertainty estimation [GLUE] and the dynamically dimensioned search [DDS], which is a global optimization algorithm). For the set of parameters that are sensitive to the observations, our proposed method yields narrower ranges than the GLUE method but broader ranges than values produced using the DDS method within the sampling range even under high relative observational errors. The SWAT model calibration performance using the CNNs, GLUE, and DDS methods are compared using R 2 and a set of efficiency metrics, including Nash-Sutcliffe, logarithmic Nash-Sutcliffe, Kling-Gupta, modified Kling-Gupta, and non-parametric Kling-Gupta scores, computed on the observed and simulated watershed responses. The best CNN-based calibrated set has scores of 0.71, 0.75, 0.85, 0.85, 0.86, and 0.91. The best DDS-based calibrated set has scores of 0.62, 0.69, 0.8, 0.77, 0.79, and 0.82. The best GLUE-based calibrated set has scores of 0.56, 0.58, 0.71, 0.7, 0.71, and 0.8. The scores above show that the CNN-based calibration leads to more accurate low and high streamflow predictions than the GLUE and DDS sets. Our research demonstrates that the proposed method has high potential to improve our current practice in calibrating large-scale integrated hydrologic models.

54 ENVIRONMENTAL SCIENCES↗

A PPE Use Case on Configuration Management Approach for MBSE

Systems engineers worldwide have been working to implement Model-based Systems Engineering (MBSE) environments, tools, and methodologies. MBSE is a formalized application of modeling to support systems engineering, including requirements, design, analysis, verification, and validation activities over the project’s lifecycle[1]; MBSE captures the system data into a digital environment. Significant benefits of MBSE includes a reduction in the time in performing systems engineering activities and an improvement higher fidelity data production. As more Systems Engineers are using MBSE, the models it produces are becoming the source of truth for Systems Engineering artifacts. As we move towards using these models as the source of truth, a more rigorous Configuration Management (CM) infrastructure is needed. Many of the MBSE tools provide CM options but utilizing them efficiently and effectively can be challenging. More rigorous methods and tools are needed to assist with keeping track of changes in the model, making sure inadvertent changes to baseline data did not occur, visibility of changes in the different model versions, and the impacts of changes to the models. System engineers and configuration management personnel from the Power and Propulsion Element (PPE) project at NASA Glenn Research Center have been working to develop a modeling construct that allows models to be the source of truth and maintain a configuration managed baseline. This paper presents a process that leverages the existing CM tools and describes how PPE used this process to manage changes more rigorously. It will describe the process behind building the model architecture that utilizes the MBSE tool capabilities and the configuration management process. It will contain some of the advantages and disadvantages of the architecture that the PPE project had settled upon utilizing, as well as some enhanced capabilities that the PPE MBSE team has developed.

MBSE↗

SCALE capabilities for high temperature gas-cooled reactor analysis

The SCALE code system’s ability to address stochastic distributions of fuel particles within a graphite matrix has been revisited in both multigroup (MG) features and continuous-energy (CE) Monte Carlo methods. Furthermore, this paper describes current and emergent SCALE capabilities within the CSAS sequence to address double-heterogeneous systems and presents verification and validation studies of these methods and data. Good agreement was obtained for a high temperature gas-cooled reactor (HTGR) fuel pebble model between CSAS MG eigenvalue calculations and corresponding CE reference solutions. Code-to-code comparisons for this HTGR pebble model showed good agreement of CSAS-KENO and CSAS-Shift CE calculations and the Serpent and MCNP codes in terms of eigenvalues and reaction rate ratios. Validation studies based on two HTGR experiments resulted in good agreement between MG and CE results, as well as between experiment and calculation, although the level of agreement was significantly influenced by the applied ENDF/B nuclear data library.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Fine particulate concentrations over East Asia derived from aerosols measured by the Advanced Himawari Imager using machine learning

Fine particulate matter with a diameter below 2.5 μm (PM 2.5 ) is deleterious to the cardiovascular and respiratory systems. It is often difficult to assess the effects of PM 2.5 on human health over regions with limited ground monitoring sites, especially in East Asia. As an alternative, we estimated near-surface PM 2.5 concentrations by analyzing Advanced Himawari Imager (AHI) Yonsei Aerosol Retrieval (YAER) products. This study incorporates daytime data for East Asia covering the Korean Peninsula, China, Japan, Southeast Asia, and southern Mongolia. We collocated AHI YAER product pixels with meteorological, land-cover, and other ancillary data for the period from March 2018 to February 2019. To estimate PM 2.5 concentrations over wide areas spanning many countries displaying various relationships between aerosol optical depth and PM 2.5 , monthly models were developed by considering both the spatial and temporal characteristics of ground-based PM 2.5 measurements. Random forest machine learning model estimated ground-level mass concentrations of PM 2.5 ; subsequent 10-fold cross validation (CV) yielded a CV R 2 value of 0.81 and a CV root mean squared error (RMSE) of 12.3 μg m -3 . We investigated the spatial pattern of PM 2.5 concentrations over multiple countries and seasonal variation in PM 2.5 concentrations. Diurnal variation of a severe PM 2.5 event in the Korean Peninsula was investigated as a case study. The model captured the extremely heterogeneous spatial distribution of PM 2.5 concentrations peaked around local noon. To measure the capability of the developed model to estimate PM 2.5 concentrations in areas with few in-situ data, its predictive performance was evaluated using a dataset independent of the training process with an R 2 of 0.60 and RMSE of 8.18 μg m −3 . This study demonstrates the potential for satellite-based PM 2.5 estimation for areas with insufficient measuring stations.

Pm2.5↗

Comparison of temperature adaptive calibration methods for laser induced fluorescence based fuel-in-oil instrument

Fuel dilution of engine oil (or fuel-in-oil, FiO) is an important issue as multiple and late-cycle fuel injection, integral to many combustion efficiency and emissions improvements (e.g., downsized boosted gasoline engines and catalyst thermal management) increases FiO rate. In addition to causing general wear and corrosion in engine due to decreased oil viscosity and pH buffering, FiO is also believed to cause destructive low speed pre-ignition (or super knock) in boosted SI engines. To understand the effects of engine operating conditions on the FiO rate, an optical diagnostic capable of measuring transient FiO on minute timescales was recently developed and demonstrated on a modified GM Ecotech engine system (Neupane et al., Applied Spectroscopy 2021). The measurement is based on adding a dye to the fuel and monitoring for its presence in oil via laser-induced fluorescence (LIF). The measured LIF signal is related to FiO concentration via pre-determined calibration factors using a multivariate classical least square (CLS) method.Since fluorescence quantum yield is a function of temperature, measured LIF intensity not only depends on FiO concentration but also oil temperature. To expand the applicability of the FiO diagnostic to transient oil-temperature conditions (e.g., cold start in practical engines), this study develops a method to account for oil-temperature variations. The effect of oil temperature (20°C - 95°C) on the LIF spectra of eight FiO samples ranging from ~0.8-15% was investigated. LIF intensities of the FiO samples decreased linearly with increasing temperature; the reductions being more significant at dye peaks. We develop a new calibration model (T-adaptive CLS) incorporating the temperature (T) effects on LIF intensity that enables simultaneous calculation of FiO and oil temperature. The improved FiO diagnostic with T-adaptive calibration is more robust, and applicable to varying oil-temperature conditions. For example, when strategies such as multiple/late fuel injections are applied to overcome cold-start instability due to use of low vaporization bio-based fuels such as ethanol, FiO rate is expected to be very high; the improved T-adaptive FiO diagnostic is hence relevant for engine- and fuel-system calibration and optimization. The diagnostic could also provide validation data for flow-field and spray interaction CFD models, further broadening the diagnostic’s utility for advancing engine technology and efficiency.

Neupane, Sneha↗

Coupled CFD/CSD Analysis of an Active-Twist Rotor in a Wind Tunnel with Experimental Validation

An unsteady Reynolds averaged Navier-Stokes analysis loosely coupled with a comprehensive rotorcraft code is presented for a second-generation active-twist rotor. High fidelity Navier-Stokes results for three configurations: an isolated rotor, a rotor with fuselage, and a rotor with fuselage mounted in a wind tunnel, are compared to lifting-line theory based comprehensive rotorcraft code calculations and wind tunnel data. Results indicate that CFD/CSD predictions of flapwise bending moments are in good agreement with wind tunnel measurements for configurations with a fuselage, and that modeling the wind tunnel environment does not significantly enhance computed results. Actuated rotor results for the rotor with fuselage configuration are also validated for predictions of vibratory blade loads and fixed-system vibratory loads. Varying levels of agreement with wind tunnel measurements are observed for blade vibratory loads, depending on the load component (flap, lag, or torsion) and the harmonic being examined. Predicted trends in fixed-system vibratory loads are in good agreement with wind tunnel measurements.

Massey, Steven J.↗

The GEOS Ozone Data Assimilation System: Design and Validation

An ozone data assimilation system has been developed at the Data Assimilation Office of the NASA/Goddard Space Flight Center to provide global three-dimensional analyzed ozone mixing ratio and total column ozone. The Total Ozone Mapping Spectrometer (TOMS) total column ozone and the Solar Backscatter Ultraviolet (SBUV) or SBUV/2 partial ozone profile data are assimilated. The analyzed winds from the Goddard Earth Observing System Data Assimilation System (GEOS-DAS) drive the ozone transport. Following every transport model timestep, the model prediction is combined with the observations using a global, physical-space based, statistical analysis scheme. Due to the smaller size of the ozone system than that of a global meteorological data assimilation system, new statistical analysis methodology, including anisotropic and flow-dependent forecast error correlation models, can be implemented and tested in the ozone system more easily. Sample results from the winter 1992 validation period are presented. There is a close agreement between the analyzed fields and the independent observations from ozone sondes and the Halogen Occultation Experiment (HALOE).

Stajner, I.↗

Global Aerodynamic Modeling for Stall/Upset Recovery Training Using Efficient Piloted Flight Test Techniques

Flight test and modeling techniques were developed for efficiently identifying global aerodynamic models that can be used to accurately simulate stall, upset, and recovery on large transport airplanes. The techniques were developed and validated in a high-fidelity fixed-base flight simulator using a wind-tunnel aerodynamic database, realistic sensor characteristics, and a realistic flight deck representative of a large transport aircraft. Results demonstrated that aerodynamic models for stall, upset, and recovery can be identified rapidly and accurately using relatively simple piloted flight test maneuvers. Stall maneuver predictions and comparisons of identified aerodynamic models with data from the underlying simulation aerodynamic database were used to validate the techniques.

Morelli, Eugene A.↗

PyOECP: A flexible open-source software library for estimating and modeling the complex permittivity based on the open-ended coaxial probe (OECP) technique

Here, we present PyOECP, a Python-based flexible open-source software for estimating and modeling the complex permittivity obtained from the open-ended coaxial probe (OECP) technique. The transformation of the measured reflection coefficient to complex permittivity is performed based on three different methods. The software library contains the dielectric spectra of common reference liquids, which can be used to transform the reflection coefficient into the dielectric spectra. Several Python routines that are commonly employed (e.g., SciPy and NumPy) in the field of science and engineering are required only so that the users can alter the software structure depending on their needs. The modeling algorithm exploits the Markov Chain Monte Carlo method for the data regression. The discrete relaxation models can be built by a proper combination of well-known relaxation models. In addition to these models, electrode polarization, a typical measurement artifact for interpreting dielectric spectra, can be incorporated into the modeling algorithm. A continuous relaxation model, which solves the Fredholm integral equation of the first kind (a mathematically ill-posed problem), is also included. This open-source software enables users to freely adjust the physical parameters to obtain physical insight into their materials under test and will be consistently updated for more accurate measurement and interpretation of dielectric spectra in an automated manner. This work describes the theoretical and mathematical background of the software, lays out the workflow, and validates the software functionality based on both synthetic and empirical data included in the software.

97 MATHEMATICS AND COMPUTING↗

NASA-Langley Web-Based Operational Real-time Cloud Retrieval Products from Geostationary Satellites

At NASA Langley Research Center (LaRC), radiances from multiple satellites are analyzed in near real-time to produce cloud products over many regions on the globe. These data are valuable for many applications such as diagnosing aircraft icing conditions and model validation and assimilation. This paper presents an overview of the multiple products available, summarizes the content of the online database, and details web-based satellite browsers and tools to access satellite imagery and products.

Palikonda, Rabindra↗

Quantification of Residual Water in Spent Fuel Dry Storage Canisters Using Mass Spectrometry

The purpose of this report is to document updates on the apparatus to simulate commercial vacuum drying procedures at the Nuclear Energy Work Complex at Sandia National Laboratories. Validation of the extent of water removal in a dry spent nuclear fuel storage system based on drying procedures used at nuclear power plants is needed to close existing technical gaps. Operational conditions leading to incomplete drying may have potential impacts on the fuel, cladding, and other components in the system during subsequent storage and disposal, such as fuel degradation; cladding corrosion, embrittlement, or breaching; and the creation of a flammable environment via radiolysis of water. A general lack of data suitable for model validation of commercial nuclear canister drying processes necessitates well-designed investigations of drying process efficacy and water retention. Scaled tests that incorporate relevant physics and well-controlled boundary conditions are essential to provide insight and guidance to the simulation of prototypic systems undergoing drying processes. This report documents details on the quantification of residual water in the Advanced Drying Cycle Simulator (ADCS), an apparatus built to simulate commercial drying procedures and quantify the amount of residual water remaining in a pressurized water reactor (PWR) fuel assembly after drying. The ADCS was constructed with a prototypic 17×17 PWR fuel skeleton and waterproof heater rods to simulate decay heat. The ADCS is outfitted with thermocouples to measure the thermal response of the ADCS to simulated decay heats and internal helium fill pressures relevant to commercial drying procedures. The ADCS is also instrumented with pressure transducers to measure the pressures and vacuum levels observed during simulated commercial drying. The most unique instrumentation used for quantifying residual water in the ADCS is a Hiden Analytical HPR-30 mass spectrometer (MS), which measures gas compositions of the ADCS internal free volume, based on partial pressures calculated from relative proportions of gas molecules detected by the MS. This report details the methodology used to implement MS measurements in quantifying residual water in the ADCS. This methodology includes the calibration of the HPR-30 MS to a Buck Research Instruments CR-4 chilled mirror hygrometer, which itself is calibrated to a NIST-traceable standard. Data collected by both the MS and the chilled mirror hygrometer from water/helium mixtures ranging from 150 to 500,000 ppmv water in helium were used to generate calibration curves, establishing a source of verification of MS measured water contents. Details regarding water content measurement uncertainties are included in this report, defining the accuracy and verifiability of the HPR-30 MS in measuring residual water content in simulated dry storage canister environments.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Ground-based measurements of galactic cosmic ray fragmentation in shielding

The mean free path for nuclear interactions of galactic cosmic-rays is comparable to shielding and tissue thicknesses present in human interplanetary exploration, resulting in a significant fraction of nuclear reaction products at depth. In order to characterize the radiation field, the energy spectrum, the angular distribution, and the multiplicity of each type of secondary particles must also be known as a function of depth. Reactions can take place anywhere in a thick absorber; therefore, it is necessary to know these quantities as a function of particle energy for all particles produced. HZE transport methods are used to predict the radiation field; they are dependent on models of the interaction of man-made systems with the space environment to an even greater extent than methods used for other types of radiation. Hence, there is a major need to validate these transport codes by comparison with experimental data. The most cost-effective method of validation is a comparison with ground-based experimental measurements. A research program to provide such validation measurements using neon, iron and other accelerated heavy ion beams will be discussed and illustrated using results from ongoing experiments and their comparison with current transport codes. The extent to which physical measurements yield radiobiological predictions will be discussed.

NASA Discipline Radiation Health↗

Accuracy Assessment of Global Internal-Tide Models Using Satellite Altimetry Models Using Satellite Altimetry

Altimeter measurements are corrected for several geophysical parameters in order to access ocean signals of interest, like mesoscale or sub-mesoscale variability. The ocean tide is one of the most critical corrections due to the amplitude of the tidal elevations and to the aliasing phenomena of high-frequency signals into the lower-frequency band, but the internal-tide signatures at the ocean surface are not yet corrected globally. Internal tides can have a signature of several centimeters at the surface with wavelengths of about 50–250 km for the first mode and even smaller scales for higher-order modes. The goals of the upcoming Surface Water Ocean Topography (SWOT) mission and other high-resolution ocean measurements make the correction of these small-scale signals a challenge, as the correction of all tidal variability becomes mandatory to access accurate measurements of other oceanic signals. In this context, several scientific teams are working on the development of new internal-tide models, taking advantage of the very long altimeter time series now available, which represent an unprecedented and valuable global ocean database. The internal-tide models presented here focus on the coherent internal-tide signal and they are of three types: empirical models based upon analysis of existing altimeter missions, an assimilative model and a three-dimensional hydrodynamic model. A detailed comparison and validation of these internal-tide models is proposed using existing satellite altimeter databases. The analysis focuses on the four main tidal constituents: M2, K1, O1 and S2. The validation process is based on a statistical analysis of multi-mission altimetry including Jason-2 and Cryosphere Satellite-2 data. The results show a significant altimeter variance reduction when using internal-tide corrections in all ocean regions where internal tides are generating or propagating. A complementary spectral analysis also gives some estimation of the performance of each model as a function of wavelength and some insight into the residual non-stationary part of internal tides in the different regions of interest. This work led to the implementation of a new internal-tide correction (ZARON'one) in the next geophysical data records version-F (GDR-F) standards.

Loren Carrere↗

A 1 km soil moisture dataset over eastern CONUS generated by assimilating SMAP data into the Noah-MP land surface model

An improved fine-scale soil moisture (SM) dataset at 1 km grid spacing, covering much of the eastern continental US, was generated by assimilating 9 km Soil Moisture Active Passive (SMAP) SM data into the v4.0.1 Noah-MP land surface model. With 12 ensemble members, the assimilation was carried out using the ensemble Kalman filter algorithm within NASA's Land Information System. The SM analysis for 2016 was fully validated against in situ observations from four different networks and compared with four other existing datasets. Results indicate that this SM analysis surpasses other datasets in top-layer SM distribution, including a machine-learning-based product, despite all SM estimates being less heterogeneous than observed. The analysis of anomalous errors suggests that large similarity in intrinsic errors is likely due to overlapping data sources among the selected SM datasets. More detailed evaluations were performed over two geographic areas. The observations collected by the Atmospheric Radiation Measurement facility in Oklahoma suggest that soil temperature and surface heat fluxes are concurrently simulated with good accuracy. Investigation into the 2016 southeastern US drought response further indicates drier conditions and higher evapotranspiration estimates compared to GLEAMv4.1. Notably, large errors are associated with grids having clay soil textures, underscoring the need for refined model treatments for specific soil types to further improve SM estimates. The dataset is publicly available on Zenodo at https://doi.org/10.5281/zenodo.14370563 (Tai et al., 2024).

Tai, Sheng-Lun [Pacific Northwest National Laborat↗

Improving the Representation of Snow Crystal Properties with a Single-Moment Mircophysics Scheme

Single-moment microphysics schemes are utilized in an increasing number of applications and are widely available within numerical modeling packages, often executed in near real-time to aid in the issuance of weather forecasts and advisories. In order to simulate cloud microphysical and precipitation processes, a number of assumptions are made within these schemes. Snow crystals are often assumed to be spherical and of uniform density, and their size distribution intercept may be fixed to simplify calculation of the remaining parameters. Recently, the Canadian CloudSat/CALIPSO Validation Project (C3VP) provided aircraft observations of snow crystal size distributions and environmental state variables, sampling widespread snowfall associated with a passing extratropical cyclone on 22 January 2007. Aircraft instrumentation was supplemented by comparable surface estimations and sampling by two radars: the C-band, dual-polarimetric radar in King City, Ontario and the NASA CloudSat 94 GHz Cloud Profiling Radar. As radar systems respond to both hydrometeor mass and size distribution, they provide value when assessing the accuracy of cloud characteristics as simulated by a forecast model. However, simulation of the 94 GHz radar signal requires special attention, as radar backscatter is sensitive to the assumed crystal shape. Observations obtained during the 22 January 2007 event are used to validate assumptions of density and size distribution within the NASA Goddard six-class single-moment microphysics scheme. Two high resolution forecasts are performed on a 9-3-1 km grid, with C3VP-based alternative parameterizations incorporated and examined for improvement. In order to apply the CloudSat 94 GHz radar to model validation, the single scattering characteristics of various crystal types are used and demonstrate that the assumption of Mie spheres is insufficient for representing CloudSat reflectivity derived from winter precipitation. Furthermore, snow density and size distribution characteristics are allowed to vary with height, based upon direct aircraft estimates obtained from C3VP data. These combinations improve the representation of modeled clouds versus their radar-observed counterparts, based on profiles and vertical distributions of reflectivity. These meteorological events are commonplace within the mid-latitude cold season and present a challenge to operational forecasters. This study focuses on one event, likely representative of others during the winter season, and aims to improve the representation of snow for use in future operational forecasts.

Molthan, Andrew L.↗

Adaptive Reinforcement Learning (ARL) Control of a Multi-port Resonant Converter in UAV Systems

This study presents an adaptive reinforcement learning (ARL) control framework for a multi-port resonant converter used in hybrid unmanned aerial vehicle (UAV) power systems. The converter integrates high-frequency half-bridge input ports connected to a rectified engine–generator set and a battery energy storage system, along with a semi-bridgeless active rectifier supplying the propulsion load. A deep RL agent is trained to dynamically regulate inter-port phase-shift commands in real time based on flight conditions and load power demand. The ARL controller autonomously identifies phase-shift combinations that maximize conversion efficiency while maintaining stable and coordinated power flow, even under rapidly varying operating scenarios. This data-driven approach eliminates the need for explicit system modeling or extensive manual tuning and enables coordinated control among multiple power ports without inter-port communication. Experimental results validate that the ARL based strategy achieves reliable power sharing and consistently high-efficiency operation across diverse UAV operating conditions.

Asa, Erdem [ORNL] (ORCID:0000000190884812)↗

Comparison Between Numerically Simulated and Experimentally Measured Flowfield Quantities Behind a Pulsejet

Pulsed combustion is receiving renewed interest as a potential route to higher performance in air breathing propulsion systems. Pulsejets offer a simple experimental device with which to study unsteady combustion phenomena and validate simulations. Previous computational fluid dynamic (CFD) simulation work focused primarily on the pulsejet combustion and exhaust processes. This paper describes a new inlet sub-model which simulates the fluidic and mechanical operation of a valved pulsejet head. The governing equations for this sub-model are described. Sub-model validation is provided through comparisons of simulated and experimentally measured reed valve motion, and time averaged inlet mass flow rate. The updated pulsejet simulation, with the inlet sub-model implemented, is validated through comparison with experimentally measured combustion chamber pressure, inlet mass flow rate, operational frequency, and thrust. Additionally, the simulated pulsejet exhaust flowfield, which is dominated by a starting vortex ring, is compared with particle imaging velocimetry (PIV) measurements on the bases of velocity, vorticity, and vortex location. The results show good agreement between simulated and experimental data. The inlet sub-model is shown to be critical for the successful modeling of pulsejet operation. This sub-model correctly predicts both the inlet mass flow rate and its phase relationship with the combustion chamber pressure. As a result, the predicted pulsejet thrust agrees very well with experimental data.

Geng, Tao↗