Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model validation and calibration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 559 records · Page 31

High Accuracy Coronagraph Flight Model For WFIRST–CGI Raw Contrast Sensitivity Analysis

A high-accuracy high-fidelity flight wavefront control (WFC) model is developed for detailed raw contrast sensitivity analysis of WFIRST-CGI. Built upon features of recently testbed validated model, it is further refined to combine a full Fresnel propagation diffraction model for high accuracy contrast truth evaluation, and an economical compact model for WFC purposes. Extensive individual raw contrast error sensitivities are evaluated systematically, both as known imperfections and as unknown calibration errors, for both spectroscopy mode and wide field-of-view mode with shaped pupil coronagraph. More than 90 distinct error items were identified, including system aberrations, optical misalignment, component manufacturing error, telescope interface related errors, etc. The result forms the basis for raw contrast error budget flow down to a sub-system level, where detailed specifications needed to aid in component design and manufacturing, mechanical alignment and instrument integration, and verification and validation operations. Evaluations are mostly automated, making it relatively easy for repeat runs of revised design or at new desired error quantity. Top error sensitivities and contrast floor contributors are discussed and several observations are noted.

Poberezhskiy, Ilya↗

Comparing and contrasting In-Vial and full-scale systems for sparging volatile analytes

Here, in-vial sparging was demonstrated as an effective, practical alternative to a full-scale sparging system for supporting the analysis of volatile constituents. Using elemental mercury (Hg 0 ) and toluene as representative purgeable analytes, the mass removal for various sparge configurations was measured and a reduced order model was developed and validated. In the primary experiments, Hg 0 in the sparge gas was trapped on activated carbon or gold, thermally desorbed, and quantified using atomic absorption or atomic fluorescence spectroscopy. Toluene experiments using the same in-vial sparge apparatus and sparge parameters were performed to demonstrate the applicability of the reduced order model to a broad range of compounds. Toluene removal was tracked by measuring the remaining toluene in sparged aliquots using Ultraviolet-visible (UV–Vis) spectroscopy. For the sparging, flow rates varied from 25 to 75 mL/min for periods from 0 to 30 min. Sparge performance, mass removal as a function of time, and sparge gas volume were measured for both in-vial and full-scale systems. A model based on dimensionless Henry's Law coefficient, normalized sparge gas volume, and fractional extent of equilibrium matched the experimental data for both compounds and provides a practical tool for future applications. For the conditions tested in this study, the calibrated model indicated that the sparge gas in the in-vial system reached approximately 33% of its equilibrium value before exiting the water surface, while a full-scale system reached approximately 100%. The tests validated the quality, reproducibility, and predictability of sparging performance for both full scale and in-vial sparge systems. Related factors such as waste generation, worker risk, and labor were also assessed. Full scale sparge systems provide the advantage of lower detection levels due to larger sample volume, while the in-vial sparge systems provide advantages for most other factors; including automatability, reducing secondary wastes, lessening the need to clean and check the sparge apparatus, and lowering labor and costs. The data and associated reduced order model support continued development and deployment of in-vial sparge platforms as a practical option for analysis of purgeable analytes such as volatile organic compounds and volatile metals/organometallics.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Simulating High Energy Dynamic Impact of IM7/PEKK Continuous Fiber Laminated Thermoplastic Composite using Open Hole Coupon Experiments

The use of advanced thermoplastic composites (TPC) for structural applications in the aerospace and automotive industries has grown increasingly popular due to their high performance, high manufactured part output, and sustainability. Enhancing verification simulations of the progressive failure in TPCs at the coupon scale is needed to better validate advanced composite material models at larger length scales, such as element level panels. MAT_213, a tabulated composite material model, has been applied to simulate high velocity dynamic impact (HEDI) and is integrated in the LS-DYNA explicit finite element (FE) software. Previous efforts using MAT_213 have calibrated HEDI simulated failures with experimental data. Traditionally simulations have relied on a structured mesh to represent quasi-isotropic panels. For this study, a continuous fiber unidirectional tape, IM7/PEKK, was analyzed through a series of verification studies of notched laminate coupons, then validation analyses of quasi-isotropic panels under HEDI were compared with experimental data. Experiments using unidirectional TPC were performed to obtain tabulated stress vs strain curves using Digital Image Correlation (DIC) for input into MAT_213. Next, notched coupon experiments were used as an intermediate step to calibrate the damage and failure behavior in MAT_213. Lastly, investigations into differences between HEDI simulations using a fiber aligned mesh were compared with experimental failure patterns and damage sizes. The use of experimentally generated material behavior along with selective mesh layout improved HEDI predictions with minimal material parameter calibration.

Polymer matrix composites↗

Synthetic Scene Generation of the Stennis V and V Target Range for the Calibration of Remote Sensing Systems

The verification and validation (V&V) target range developed at Stennis Space Center is a useful test site for the calibration of remote sensing systems. In this paper, we present a simple algorithm for generating synthetic radiance scenes or digital models of this target range. The radiation propagation for the target in the solar reflective and thermal infrared spectral regions is modeled using the atmospheric radiative transfer code MODTRAN 4. The at-sensor, in-band radiance and spectral radiance for a given sensor at a given altitude is predicted. Software is developed to generate scenes with different spatial and spectral resolutions using the simulated at-sensor radiance values. The radiometric accuracy of the simulation is evaluated by comparing simulated with AVIRIS acquired radiance values. The results show that in general there is a good match between AVIRIS sensor measured and MODTRAN predicted radiance values for the target despite the fact that some anomalies exist. Synthetic scenes provide a cost-effective way for in-flight validation of the spatial and radiometric accuracy of the data. Other applications include mission planning, sensor simulation, and trade-off analysis in sensor design.

Cao, Chang-Yong↗

Development, validation, and verification of multi-pass thermo-mechanical welding simulations using the open-source MOOSE framework: NeT TG4 benchmark weldment

This study develops and validates a sequentially coupled thermo-mechanical welding simulation for the three-pass 316L stainless steel NeT TG4 benchmark weldment using the open-source Multiphysics Object-Oriented Simulation Environment (MOOSE) and the Nuclear Engineering Material model Library (NEML). A diffused ellipsoidal heat source was calibrated against thermocouple data and weld macrographs to accurately model the fusion zone geometry and transient thermal fields. Material hardening is represented using the Lemaitre-Chaboche mixed isotropic-kinematic hardening model, while four annealing models - no annealing, single-stage at 1050 °C and 1300 °C, and two-stage at 800 °C/1300 °C - were implemented to assess the impact of annealing models on the accuracy of the predicted welding-induced plasticity, distortions, and residual stresses. The predictions were validated against experimental measurements and benchmarked against results from commercial software, demonstrating that thermo-mechanical MOOSE welding simulations achieve comparable accuracy with enhanced computational efficiency. This work highlights the potential of using open-source finite element frameworks like MOOSE for advanced manufacturing simulations.

Ji, Wendy [Australian Nuclear Science and Technolo↗

Evaluation and calibration of MERRA-2 and CAMS reanalysis for PM 2.5 in a semi-urbanized area in the south of the Amazon

Air pollution has significant implications for the climate and poses irreversible risks to human health. The Amazon region of Brazil is severely affected by biomass burning (BB) emissions, yet air quality monitoring remains highly inadequate. Given the scarcity of surface-based observations, reanalysis models have become essential tools for assessing air pollution. Although MERRA-2 and CAMS PM 2.5 products are widely utilized, their validation and comprehensive evaluation for the Amazon Basin remain limited. Here, this study assesses the performance of these products in a semi-urbanized region in the southern Amazon. The calibrated time series was employed to analyze PM 2.5 concentrations from 2003 to 2023. Our results showed satisfactory performance of both products for the 24-h averages of PM 2.5 , with linear correlations above 0.76. However, it was found that both products overestimate surface concentrations. MERRA-2 performed better, with approximately 30% lower bias than CAMS. Time series analysis showed that the study area is strongly impacted by emissions BB in the dry period, mainly in August and September. Furthermore, our findings indicate a positive trend in increasing PM 2.5 concentrations, with a notable rise observed since 2014. The average PM 2.5 levels frequently exceed the daily air quality guidelines established by the WHO in 2021. It has been estimated that the population of this region is exposed to concentrations above 15 μg.m -3 , on average, more than 30 days per year. Our results contribute to the evaluation of MERRA-2 and CAMS products for Amazon and provide a corrected estimate for surface PM 2.5 . Recent concerns about air quality and the implementation of new surface monitoring networks may improve the evaluation of reanalysis products. In the short term, the need for this information makes our assessments indispensable.

54 ENVIRONMENTAL SCIENCES↗

Analysis of the GOES 6.7 micrometer channel observations during FIRE 2

Clouds form in moist environments. FIRE Phase II Cirrus Implementation Plan (August, 1990) noted the need for mesoscale measurements of upper tropospheric water vapor content. These measurements are needed for initializing and verifying numerical weather prediction models and for describing the environment in which cirrus clouds develop and dissipate. Various instruments where deployed to measure the water vapor amounts of the upper troposphere during FIRE II (e.g. Raman lidar, CLASS sonds and new cryogenic frost hygrometer on-board aircraft). The formation, maintenance and dissipation of cirrus clouds involve the time variation of the water budget of the upper troposphere. The GOES 6.7 mu m radiance observations are sensitive to the upper tropospheric relative humidity, and therefore proved extremely valuable in planning aircraft missions during the field phase of FIRE II. Warm 6.7 mu m equivalent black body temperatures indicate a relatively dry upper troposphere and were associated with regions generally free of cirrus clouds. Regions that were colder, implying more moisture was available may or may not have had cirrus clouds present. Animation of a time sequence of 6.7 mu m images was particularly useful in planning various FIRE missions. The 6.7 mu m observations can also be very valuable in the verification of model simulations and describing the upper tropospheric synoptic conditions. A quantitative analysis of the 6.7 mu m measurement is required to successfully incorporate these satellite observations into describing the upper tropospheric water vapor budget. Recently, Soden and Bretherton (1993) have proposed a method of deriving an upper tropospheric humidity based on observations from the GOES 6.7 mu m observations. The method is summarized in the next section. In their paper they compare their retrieval method to radiance simulations. Observations were also compared to ECMWF model output to assess the model performance. The FIRE experiment provides a unique opportunity to further verify the GOES upper tropospheric relative humidity retrieval scheme by providing (1) aircraft observations to cross-validate the calibration of the GOES 6.7 mu m channel, (2) accurate upper tropospheric water vapor concentrations for verification, and (3) veritical variability of upper tropospheric water vapor.

Soden, B. J.↗

Calibrating CERES and VIIRS using CLARREO Pathfinder: Adjustment for the Viewing Geometry Mismatch

The Climate Absolute Radiance and Refractivity Observatory Pathfinder (CPF) mission on the International Space Station (ISS) will provide, for the first-time, an SI-traceable on-orbit calibration reference with a reflectance uncertainty of 0.3% (1 sigma). One major mission objective is to demonstrate the capability of transferring CPF’s radiometric accuracy to other satellite-based instruments, such as Clouds and Earth's Radiant Energy System (CERES) and Visible Infrared Imaging Radiometer Suite (VIIRS) on NOAA-20. CPF inter-calibration measurements will be planned to obtain inter-calibration samples that closely match satellite-based target sensor observations in time, space, angle, and wavelength. The inter-calibration event observations cover a wide range of viewing geometry angles with potential angular mismatch between CPF and the target sensors which can introduce non-negligible errors against the mission’s inter-calibration uncertainty budget. We will introduce the CPF approach to adjust for angular mismatch differences, thereby reducing the incurred uncertainties to within the inter-calibration uncertainty budget. The angular adjustment algorithm has been developed and validated based on the high-fidelity simulations of the CPF spectra using the Principal Component based Radiative Transfer Model (PCRTM). The implementation of the algorithm on event simulation data and the characterization for the angular adjustment uncertainty will be presented.

Wan Wu↗

Vicarious Calibration of GOCI for the SeaDAS Ocean Color Retrieval

A key on-orbit calibration step for satellite remote sensing of ocean color is the vicarious calibration. This establishes the final gains for each spectral band on the sensor that minimize bias in the retrieved ocean color signal. The vicarious calibration is specific to the instrument and the atmospheric correction algorithm. The vicarious calibration gains for the Geostationary Ocean Color Imager (GOCI) are presented here, which were derived to optimize the performance ofNASA's standard atmospheric correction algorithm as implemented in the l2gen code and distributed through the SeaDAS open-source software package. Following NASA's protocols, the near-infrared(NIR) bands were calibrated first, and the visible bands were then calibrated relative to this fixed NIR calibration. The gain for the 745-nm NIR band was derived using a fixed aerosol model, which waschosen based on the Angstrom Coefficients derived from MODIS onAqua (MODISA). For the vicarious gains of the visible bands, twosources for the target water-leaving radiances were tested: matchupsfrom MODISA and climatological data from SeaWiFS. A validation analysis using AERONET-OC data shows an improvement in sensor performance when compared with results using the current vicarious gains and results using no vicarious calibration. Good agreement was found in vicarious gains derived using both concurrent MODISA and climatological SeaWiFS as vicarious calibration data sources. These results support the use of a concurrent sensor for the vicarious calibration when in situ data are not available and demonstrate that using climatology from a well-calibrated sensor like SeaWiFSfor the vicarious calibration is a valid alternative when it is not possible to use a concurrent sensor or in situ data. We recommend using the gains derived from concurrent GOCI matchups with MODISA for GOCI processing in SeaDAS/l2gen.

Concha, Javier↗

Dark Energy Survey Year 3 results: Cosmology from combined galaxy clustering and lensing validation on cosmological simulations

In this work, we present a validation of the Dark Energy Survey Year 3 (DES Y3) 3×2-point analysis choices by testing them on Buzzard2.0, a new suite of cosmological simulations that is tailored for the testing and validation of combined galaxy clustering and weak-lensing analyses. We show that the buzzard2.0 simulations accurately reproduce many important aspects of the DES Y3 data, including photometric redshift and magnitude distributions, and the relevant set of two-point clustering and weak-lensing statistics. We then show that our model for the 3×2-point data vector is accurate enough to recover the true cosmology in simulated surveys assuming the true redshift distributions for our source and lens samples, demonstrating robustness to uncertainties in the modeling of the nonlinear matter power spectrum, nonlinear galaxy bias, and higher-order lensing corrections. Additionally, we demonstrate for the first time that our photometric redshift calibration methodology, including information from photometry, spectroscopy, clustering cross-correlations, and galaxy–galaxy lensing ratios, is accurate enough to recover the true cosmology in simulated surveys in the presence of realistic photometric redshift uncertainties.

79 ASTRONOMY AND ASTROPHYSICS↗

Wavelet and Deep-Learning-Based Approach for Generation System Problematic Parameters Identification and Calibration

Accurate models of generation systems are critical for maintaining reliable and secure grid operations. In this paper, a novel and systematic approach is proposed to identify and calibrate the generation system problematic parameters using continuous wavelet transform (CWT) and advanced deep-learning technology. The phasor measurement unit (PMU) data are used through “event playback” to check whether the parameter calibration is required, and if yes, a group of suspicious parameters will be identified as the primary problematic parameter candidates (PPCs). These primary PPCs are randomly perturbed to generate the event playback simulation data, which are used by the CWT and convolutional neural networks (CNNs) to further narrow down the primary PPCs into a smaller set of candidates. Then, the identified candidates are perturbed again to generate massive event playback simulation data for training a parameter calibration neural network. Here, we designed a multi-output neural network structure to find the mappings between the perturbed parameters and the simulation data using both CNN and long short-term memory (LSTM) models. Finally, the well-trained and tested CNN-LSTM model is used to estimate the accurate value of the suspicious parameters with actual PMU measurements. The proposed CNN-LSTM network can accurately and reliably estimate the generation-system problematic parameters, and has better performance when compared to other machine-learning methods, such as the multilayer perceptron network and the conditional variational autoencoder method. The accuracy and effectiveness of the proposed approach have been validated through simulation and real-world data.

24 POWER TRANSMISSION AND DISTRIBUTION↗

The Simons Observatory: gain, bandpass and polarization-angle calibration requirements for B-mode searches

We quantify the calibration requirements for systematic uncertainties for next-generation ground-based observatories targeting the large-angle B-mode polarization of the Cosmic Microwave Background, with a focus on the Simons Observatory (SO). We explore uncertainties on gain calibration, bandpass center frequencies, and polarization angles, including the frequency variation of the latter across the bandpass. We find that gain calibration and bandpass center frequencies must be known to percent levels or less to avoid biases on the tensor-to-scalar ratio r on the order of Δ r∼10-3, in line with previous findings. Polarization angles must be calibrated to the level of a few tenths of a degree, while their frequency variation between the edges of the band must be known to O(10) degrees. Given the tightness of these calibration requirements, we explore the level to which residual uncertainties on these systematics would affect the final constraints on r if included in the data model and marginalized over. We find that the additional parameter freedom does not degrade the final constraints on r significantly, broadening the error bar by O(10%) at most. We validate these results by reanalyzing the latest publicly available data from the collaboration within an extended parameter space covering both cosmological, foreground and systematic parameters. Finally, our results are discussed in light of the instrument design and calibration studies carried out within SO.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Continuity of A Global, Satellite-Based Terrestrial Primary Productivity Dataset in the VIIRS Era Achieved With Model-Data Fusion

The NASA Terra and Aqua satellites have been successfully operating for over two decades and have far exceeded their original 5‐year design life. However, the era of NASA’s Earth Observing System (EOS) may be coming to a close as early as 2023. We conducted a comprehensive calibration and validation of the MODIS MOD17 product [1,2] and the potential for continuity of multi‐decadal ecosystem gross primary productivity (GPP) and annual net primary productivity (NPP), using data from the Visible Infrared Imaging Radiometer Suite (VIIRS) sensors aboard Suomi NPP and NOAA‐20. We combined an 18‐year record of eddy covariance flux tower measurements with hundreds of field measurements of NPP from the Oak Ridge National Laboratories Multi‐Biome collection to benchmark MODIS MOD17 Collection 6.1 (C61) and to develop the first terrestrial productivity estimates from VIIRS. Plant traits from the literature and the global TRY database [3,4] provide strong priors for identifying model parameters in a Bayesian model‐data fusion. As MODIS‐like observations are still needed for global environmental applications, the new VIIRS VNP17 product has the potential to extend these continuous estimates of global, terrestrial primary productivity beyond 2030.

K. Arthur Endsley↗

SENTRA: A Modular Computational Graph Framework for Critical Mineral and Materials Supply Chains: Part I: Network Construction Latent-Quantity Estimation, and Temporal Graph Forecasting

Global supply chains for critical minerals and materials are complex, evolving networks of countries, products, production stages, and trade relationships. Existing analytical approaches are limited by fragmented data and static network representations that do not capture the dynamic production dependencies linking raw materials, intermediate products, and final goods across multiple countries. Trade and production statistics provide only a partial view of domestic production, inventories, and material flows, making it difficult to identify indirect sourcing pathways, hidden dependencies, and embedded foreign exposures. This paper introduces the Supply Chain Exposure Network Tracking and Risk Assessment (SENTRA) framework, a modular graph-based computational framework for constructing, analyzing, and forecasting dynamic supply chain networks. As the first paper in a three-part methodological series, it establishes the computational foundation of SENTRA by constructing a temporal attributed multi-relational graph whose nodes represent product–country pairs and whose edges encode observed trade and within-country value-chain relationships. Statistical estimation and constrained optimization recover latent production, final demand, and product input dependency coefficients while enforcing economic accounting constraints. Graph-derived exposure measures quantify direct, transshipment, value-chain, and multi-hop supply chain dependencies independently of the forecasting model. A temporal graph forecasting architecture based on a relational graph neural network then forecasts the evolution of the graph under mass-balance constraints with distribution-free conformal uncertainty quantification. Validation on the global aluminum supply chain shows that the learned graph representations recover economically meaningful supply chain structure, accurately forecast out-of-sample trade relationships, and produce well-calibrated prediction intervals. Subsequent papers apply this computational foundation to exposure assessment, disruption analysis, and scenario-based policy analysis, and extend the framework to multimaterial supply chain modeling and decision support.

36 MATERIALS SCIENCE↗

Numerical Simulation of a Natural Convection–Driven Air-Cooled Reactor Cavity Cooling System Experiment

Ensuring the efficient removal of decay heat from the reactor vessel is essential for the safety of advanced reactor technologies. Several Generation-IV concepts incorporate variations in the reactor vessel cooling systems to achieve this objective. High-temperature gas-cooled reactors utilize a reactor cavity cooling system (RCCS), a passive ex-vessel system designed to operate without active components or external power during accident conditions. The RCCS removes decay heat primarily through radiative and convective heat transfer mechanisms. Here, this study presents a comprehensive validation of a computational fluid dynamics Reynolds-averaged Navier-Stokes model for the University of Wisconsin-Madison air-cooled RCCS facility. Validation was conducted for both high- and low-power natural convection cases under a uniform heating profile. Near-wall resolution was found to be critical for accurately modeling natural convection in the RCCS; employing an all-𝑦 + wall treatment resulted in wall temperature discrepancies exceeding 50 °⁢𝐶 compared to a wall-resolved mesh. Thermal-hydraulic behaviors under natural and forced convection conditions were compared within the heated cavity and RCCS. A turbulence model sensitivity analysis indicated that low-Reynolds number k-ɛ, k-ω shear stress transport (SST), and Reynolds stress transport models produce similar wall temperature predictions. A buoyancy modeling sensitivity study revealed that the Boussinesq approximation significantly underpredicted thermal-hydraulic behavior in the RCCS. Based on these findings, modeling recommendations are provided. The validated data set along with identified sensitivities refine the modeling of natural convection in the RCCS. The information produced by this study supports RCCS design, optimization, and safety evaluations, enabling the calibration and verification of reduced-order thermal-hydraulic models.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗

AVIRIS calibration and application in coastal oceanic environments

The Airborne Visible-Infrared Imaging Spectrometer (AVIRIS) is a test-bed for future spacecraft sensors such as the High-Resolution Imaging Spectrometer and the Moderate-Resolution Imaging Spectrometers planned for the Earth Observing System. To use this sensor for ocean applications, S/N was increased by spatial averaging of images. Post-flight recalibration was accomplished by measuring in situ the water-leaving radiance at flight time, modeling its transmission to the aircraft, and adding modeled atmospheric radiance to that value. The preflight calibration curve was then adjusted until aircraft and modeled total radiance values matched. Water-leaving radiance values from the recalibrated AVIRIS imagery were consistent with in situ data supporting the validity of the approach. Imagery of the absorption coefficient at 415 nm and backscattering coefficient at 671 nm were used to depict the dissolved and particulate constituents of the Tampa Bay plume during late, ebb-tidal conditions.

Carder, Kendall L.↗

AVIRIS calibration and application in coastal oceanic environments

The Airborne Visible-Infrared Imaging Spectrometer (AVIRIS) is a test-bed for future spacecraft sensors such as the High-Resolution Imaging Spectrometer and the Moderate-Resolution Imaging Spectrometers planned for the Earth Observing System. To use this sensor for ocean applications, S/N was increased by spatial averaging of images. Post-flight recalibration was accomplished using in situ the water-leaving radiance measured at flight time, modeling radiance transmission to the aircraft, and adding modeled atmospheric radiance to that value. The preflight calibration curve was then adjusted until aircraft and modeled total radiance values matched. Water-leaving radiance values from the recalibrated AVIRIS imagery were consistent with in situ data supporting the validity of the approach. Imagery of the absorption coefficient at 415 nm and backscattering coefficient at 671 nm were used to depict the dissolved and particulate constituents of an ebb-tidal esturance plume on the East coast of Florida.

Carder, Kendall L.↗

System results from FRECOPA

The work carried out over the past three years on FRECOPA and the LDEF has enabled a large quantity of information to be collected, part of which has already been exploited. As far as CNES is concerned, the major spin-offs of this mission mainly focus on the orbital environment and the behavior of materials in such an environment. With respect to the environment, the authors shall develop the lessons learned from expert appraisals on impacts by microparticles, which are the main feature observed in this area. As for the materials, the results show a variety of behavior when subjected to the space environment and even now constitute a wealth of information for the designing and validation of future mechanical systems. Apart from these direct spin-offs, there are repercussions on in-flight and ground testing, the calibration of test benches and improvements to simulation models.

Durin, Christian↗