Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model validation and calibration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32

Remote Americium Detection Using an Optical Sensor: A D-Optimal Strategy for Efficient PLS-Based Modeling

A fiber-optic visible–near-infrared absorption spectroscopy system in a glove box was demonstrated for remote quantification of Am(III) (0–500 µM) and HNO 3 (0.1–9 M) using partial least squares regression (PLSR) models. The sensor platform, featuring a simple plug-and-play spectrophotometer, can enable noninvasive, real-time monitoring of actinide process solutions. To establish a flexible PLSR model calibration strategy, a D-optimal design developed using Nd(III) in previous studies was successfully extended to an actinide system with Am(III) to effectively minimize sample set size while maintaining robust prediction performance. The results suggest strong spectral similarities between Nd(III) and Am(III) and validate Nd(III) as an effective optical surrogate for trivalent actinide species. This work also supports the generalizability of a D-optimal training set selection approach for two-factor systems. The PLS1 models for Am(III) and HNO 3 outperformed a PLS2 model and maintained reasonable performance in the presence of interfering U(VI). The resulting sensor system and multivariate approach provides a flexible and scalable solution for process monitoring, control, and safety in diverse nuclear applications.

actinide↗

Importance of Radiative Transfer Models in Atmospheric Remote Sensing

Radiative transfer models (RTMs) play a significant role in the development of satellite instruments for remote sensing applications. These models simulate electromagnetic radiation's propagation through the atmosphere, providing valuable insights into atmosphere-radiation interactions. RTMs facilitate the optimization of satellite instrument designs, ensuring their ability to measure targeted atmospheric and surface properties accurately. Moreover, they aid in simulating instrument’s measurements under various atmospheric conditions, enabling calibration and validation processes to enhance data quality and reliability. RTMs are extensively used in the Observing System Simulation Experiments (OSSE), to generate synthetic observations. By incorporating RTMs into OSSE, we can assess the potential impact of future satellite missions, sensor configurations, and data assimilation techniques. This approach allows for the optimization of satellite instruments and constellations and the evaluation of their influence on weather forecasting, climate monitoring, and other Earth science applications. Another crucial application area of RT models is data assimilation, where they play a fundamental role in combining satellite observations with numerical models to improve atmospheric and environmental predictions. RTMs provide the link between observed radiances and atmospheric parameters, enhancing the accuracy of numerical models and generating more reliable forecasts for weather events, air quality assessments, and climate projections. Moreover, adapting RT models to capture the intricate radiation interactions within the Planetary Boundary Layer will significantly contribute to improving weather forecasting and climate change projections. Current community radiative transfer (RT) models are primarily developed and optimized for operational data assimilation of satellite observations. These models excel at assimilating satellite data into numerical weather prediction models to improve forecast accuracy. However, their focus on data assimilation limits their suitability for other important applications, such as satellite instrument development, OSSE, and Planetary Boundary Layer (PBL) studies. Moreover, for PBL studies, RT models need to be adapted to capture the intricate radiation interactions within this crucial atmospheric layer. Developing RT models that can represent the PBL's unique characteristics, such as surface interactions, will contribute significantly to understanding and predicting weather phenomena, air quality, and climate dynamics. This abstract provides a comprehensive overview of the current status of RT models and highlights their limitations concerning satellite instrument development, OSSE, and PBL studies. Addressing these shortcomings requires concerted efforts to enhance RT models' capabilities and expand their applications beyond data assimilation. By investing in research and development to improve these

Isaac Moradi↗

Using Lunar Observations to Validate In-Flight Calibrations of Clouds and Earth Radiant Energy System Instruments

The validation of in-orbit instrument performance requires stability in both instrument and calibration source. This paper describes a method of validation using lunar observations scanning near full moon by the Clouds and Earth Radiant Energy System (CERES) instruments. Unlike internal calibrations, the Moon offers an external source whose signal variance is predictable and non-degrading. From 2006 to present, in-orbit observations have become standardized and compiled for the Flight Models-1 and -2 aboard the Terra satellite, for Flight Models-3 and -4 aboard the Aqua satellite, and beginning 2012, for Flight Model-5 aboard Suomi-NPP. Instrument performance parameters which can be gleaned are detector gain, pointing accuracy and static detector point response function validation. Lunar observations are used to examine the stability of all three detectors on each of these instruments from 2006 to present. This validation method has yielded results showing trends per CERES data channel of 1.2% per decade or less.

Daniels, Janet L.↗

Decoding Golden Eagle Movement Behavior from High-Resolution, Variable-Rate Telemetry Data Through Bayesian Filtering

The recent advances in animal tracking technology have enabled the collection of a vast amount of in situ data regarding the movement of wildlife at high spatiotemporal resolution. These data are usually available at variable time resolutions and contains noise (error) originating from GPS fixes. Decoding movement characteristics, particularly of flying animals, from telemetry data while handling these factors is a challenging yet important task for conservation purposes. Typically, this task is broken into two subtasks: resampling, and model calibration. The resampling subtask converts the variable rate positional data into a constant time interval data, while the model calibration subtask uses the resampled data to tune time-invariant parameters of the proposed models. For telemetry data at high temporal resolutions (order of 1 second), it is very challenging to decouple noise from actual movements using interpolation-based resampling techniques. Any errors introduced during resampling can significantly alter the the calibration and prediction attributes of the movement model. We address this problem through a unified Bayesian state-space framework that can handle both the resampling and calibration tasks in a single step. In addition, we use the speed and heading of the bird from telemetry data to regularize the position information of the bird. We use a Kalman filtering approach to include these nonlinearly related motion parameters within the state space framework. We cross-validated to quantify how this inclusion affects the model performance in estimating true bird movements. The relationship between the true state of the bird and environmental and topographical covariates is then represented parametrically. These parameters are then tuned using stochastic sampling strategies like Markov Chain Monte Carlo (MCMC). We use the telemetry data collected from golden eagles in the western USA to demonstrate the applicability of this approach to build a predictive, probabilistic movement model. Our preliminary results show that this approach provides improved predictive performance in terms of capturing higher-order motion parameters such as angular and horizontal accelerations, which may have simpler and more direct relationships with environmental covariates than corresponding speeds. In this talk, we will demonstrate how this state-space approach benefits the prediction capabilities of a movement model in simulating golden eagle paths through a wind power plant in Wyoming given certain atmospheric conditions. The model outcomes are aimed at informing mitigation strategies that can minimize the potential for collisions of golden eagles with wind turbines.

Bayesian methods↗

Investigating seasonal ENSO forecast amplitude calibration for GEOS-S2S-2

The GEOS-S2S-2 is a global coupled model and assimilation system, encompassing many aspects of the Earth climate system. This project looked at seasonal (nine-month) ensemble forecasts, over the period from 1982 through the present. We explored and validated a forecast amplitude correction technique used by the North American Multi-Model Ensemble (NMME), of which GEOS is a member, for Niño3.4 sea-surface temperature (SST) anomaly predictions. The method relies on deriving a set of correction factors based on the standard deviations of hindcast and observed SST anomalies. This algorithm was implemented at the Global Modeling and Assimilation Office (GMAO) and applied to the GEOS-S2S-2 Niño 3.4 hindcasts. In general, the correction reduced the forecast amplitude. This improved the quality of the forecasts when measured by the root mean square error (RMSE) of the ensemble mean forecast. RMSE decreased for most initialization months and forecast leads. The correction had a larger impact on seasons with strong El Niño-Southern Oscillation (ENSO) events than neutral seasons. The effects of the correction on the ensemble characteristics were also examined, and a variation of the algorithm was proposed that preserves the ensemble spread. The outcome of this project is a tool that can be used to calibrate GEOS-S2S-2 ENSO forecasts and potentially improve the precision of multi-model El Niño outlooks.

ENSO↗

Deformation Response and Life of Metallic Composites

The project was initially funded for one year (for $100,764) to investigate the potential of particulate reinforced metals for aeropropulsion applications and to generate fatigue results that quantify the mean stress effect for a titanium alloy matrix material (TIMETAL 21S). The project was continued for a second year (for $85,000) to more closely investigate cyclic deformation, especially ratcheting, of the titanium alloy matrix at elevated temperature. Equipment was purchased (for $19,000) to make the experimental program feasible; this equipment included an extensometer calibrator and a multi-channel signal conditioning amplifier. The project was continued for a third year ($50,000) to conduct cyclic relaxation experiments aimed at validating the elastic-viscoelastic-viscoplastic model that NASA GRC had developed for the titanium alloy. Finally, a one-year no cost extension was granted to enable continued analysis of the experimental results and model comparisons.

Lissenden, Cliff J.↗

Tests and Techniques for Characterizing and Modeling X-43A Electromechanical Actuators

A series of tests were conducted on the electromechanical actuators of the X-43A research vehicle in preparation for the Mach 7 and 10 hypersonic flights. The tests were required to help validate the actuator models in the simulation and acquire a better understanding of the installed system characteristics. Static and dynamic threshold, multichannel crosstalk, command-to-surface timing, free play, voltage regeneration, calibration, frequency response, compliance, hysteretic damping, and aircraft-in-the-loop tests were performed as part of this effort. This report describes the objectives, configurations, and methods for those tests, as well as the techniques used for developing second-order actuator models from the test results. When the first flight attempt failed because of actuator problems with the launch vehicle, further analysis and model enhancements were performed as part of the return-to-flight activities. High-fidelity models are described, along with the modifications that were required to match measurements taken from the research vehicle. Problems involving the implementation of these models into the X-43A simulation are also discussed. This report emphasizes lessons learned from the actuator testing, simulation modeling, and integration efforts for the X-43A hypersonic research vehicle.

Lin, Yohan↗

Infrared Cloud Imager Instrument Intercomparison Report

The Infrared Cloud Imager Instrument Intercomparison was a guest instrument deployment by NWB Sensors to the U.S. Department of Energy’s Atmospheric Radiation Measurement (ARM) User Facility observatory on the Southern Great Plains (SGP) between May 18 and December 12, 2023. NWB Sensors is a company that has developed a commercially available infrared cloud imager (ICI). The ICI provides radiometrically calibrated, full-sky images of the downwelling infrared radiance in the 7.3-14 µm band. In addition, it provides cloud radiance as the residual between the observed radiance and the modeled cloud-free radiance as well as derived cloud products. The instrument is used in applications that require consistent detection of clouds across day and night. For more information, consult the instrument's webpage. The primary goal of the deployment was to validate the radiometric accuracy of the ICI. The ICI uses a proprietary calibration method to convert the raw data from its infrared camera into downwelling radiance. Unlike similar instruments, the system does not have an onboard blackbody calibration standard. Instead, NWB Sensors characterizes each ICI camera individually in an environmental chamber while looking at a blackbody standard. The resulting (proprietary) calibration is used operationally in the instrument and has been demonstrated to be stable over long periods. To validate the radiometric products from the ICI, an intercomparison between the ICI data products and those from ARM’s atmospheric emitted radiance interferometer (AERI) was made. The AERI is a best-in-class instrument for measuring downwelling infrared radiance (Gero et al. 2025). A weighted integration of the AERI’s spectral radiances across the ICI’s camera response was performed. The resulting radiance (herein called the AERI radiance) was directly compared to the zenith radiance concurrently observed by the ICI. The results of these comparisons are reported in the next section of this report.

54 ENVIRONMENTAL SCIENCES↗

Data Processing for Atmospheric Phase Interferometers

This paper presents a detailed discussion of calibration procedures used to analyze data recorded from a two-element atmospheric phase interferometer (API) deployed at Goldstone, California. In addition, we describe the data products derived from those measurements that can be used for site intercomparison and atmospheric modeling. Simulated data is used to demonstrate the effectiveness of the proposed algorithm and as a means for validating our procedure. A study of the effect of block size filtering is presented to justify our process for isolating atmospheric fluctuation phenomena from other system-induced effects (e.g., satellite motion, thermal drift). A simulated 24 hr interferometer phase data time series is analyzed to illustrate the step-by-step calibration procedure and desired data products.

Acosta, Roberto J.↗

Practical Considerations using Weighted-Acceleration Compensation Techniques for Dynamic Force Measurements in Wind Tunnels

Most wind tunnel force measurement systems are designed and calibrated for high-accuracy static measurements, but may have limited ability to sense dynamic forces and moments. As a means to improve the measurement bandwidth of dynamic forces, researchers have proposed using a weighted-acceleration technique, which uses accelerometer data to compensate and correct for system dynamics. The sum of weighted-accelerations method is attractive as the acceleration data applies a correction to the traditional static measurements. The focus of this paper is on practical aspects of implementing a weighted-acceleration technique in an experimental arrangement. A formulation of the weighted-acceleration methodology is validated on a reduced-order model and demonstrated on a tabletop experiment that serves as a proxy to a wind tunnel force measurement system. As part of this system, a two component normal force and pitching moment balance was designed and fabricated. A static and dynamic calibration of the system was performed, and the weighted-acceleration technique was used to reconstruct impact forces acting on the system. Practical considerations of the experimental design that improve the success of the methodology are discussed.

Dynamic force measurement↗

Practical Considerations using Weighted-Acceleration Compensation Techniques for Dynamic Force Measurements in Wind Tunnels

Most wind tunnel force measurement systems are designed and calibrated for high-accuracy static measurements, but may have limited ability to sense dynamic forces and moments. As a means to improve the measurement bandwidth of dynamic forces, researchers have proposed using a weighted-acceleration technique, which uses accelerometer data to compensate and correct for system dynamics. The sum of weighted-accelerations method is attractive as the acceleration data applies a correction to the traditional static measurements. The focus of this paper is on practical aspects of implementing a weighted-acceleration technique in an experimental arrangement. A formulation of the weighted-acceleration methodology is validated on a reduced-order model and demonstrated on a tabletop experiment that serves as a proxy to a wind tunnel force measurement system. As part of this system, a two component normal force and pitching moment balance was designed and fabricated. A static and dynamic calibration of the system was performed, and the weighted-acceleration technique was used to reconstruct impact forces acting on the system. Practical considerations of the experimental design that improve the success of the methodology are discussed.

Dynamic force measurement↗

Sensor impact evaluation and verification for fault detection and diagnostics in building energy systems: A review

Sensors are the key information source for fault detection and diagnostics (FDD) in buildings. However, sensors are often not properly designed, installed, calibrated, located, and maintained, which negatively impacts FDD performance. Several sensor-related FDD topics have been widely studied, covering a wide range of fault types and applications. However, it is difficult to get a clear picture of the technical development of sensor-related topics in FDD. A systematic review of sensor topics is needed to summarize the existing research in a logical way, draw conclusions on the current development, and predict the future development of sensors in building FDD. To address this gap, we conducted a comprehensive literature review of more than 100 FDD-sensor-related papers. In this article, we subdivide the FDD tasks into building-level, system-level, and component-level FDD, and review sensor-related topics in each category. Our major conclusions are: (a) current data-driven FDD research focuses more on FDD algorithms than sensors, (b) sensor “hardware” research topics are less studied than sensor “software” topics, (c) very few papers focus on sensor engineering as an integral aspect of FDD development, and (d) some important sensor topics, such as sensor cost-effectiveness and sensor schema/layout/location, are not well studied. Finally, we discuss the need for a systematic framework of FDD sensors and models to integrate sensor design/selection, sensor data analysis/mining, feature selection, physics-based or data-driven algorithm development, sensor fault detection, sensor calibration, and sensor maintenance. Finally, expert interviews are conducted to validate the above findings and conclusions.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Studies on spectral analysis of randomly sampled signals: Application to laser velocimetry data

Spectral analysis is very useful in determining the frequency characteristics of many turbulent flows, for example, vortex flows, tail buffeting, and other pulsating flows. It is also used for obtaining turbulence spectra from which the time and length scales associated with the turbulence structure can be estimated. These estimates, in turn, can be helpful for validation of theoretical/numerical flow turbulence models. Laser velocimetry (LV) is being extensively used in the experimental investigation of different types of flows, because of its inherent advantages; nonintrusive probing, high frequency response, no calibration requirements, etc. Typically, the output of an individual realization laser velocimeter is a set of randomly sampled velocity data. Spectral analysis of such data requires special techniques to obtain reliable estimates of correlation and power spectral density functions that describe the flow characteristics. FORTRAN codes for obtaining the autocorrelation and power spectral density estimates using the correlation-based slotting technique were developed. Extensive studies have been conducted on simulated first-order spectrum and sine signals to improve the spectral estimates. A first-order spectrum was chosen because it represents the characteristics of a typical one-dimensional turbulence spectrum. Digital prefiltering techniques, to improve the spectral estimates from randomly sampled data were applied. Studies show that the spectral estimates can be increased up to about five times the mean sampling rate.

Sree, David↗

Calibration of a COTS Integration Cost Model Using Local Project Data

The software measures and estimation techniques appropriate to a Commercial Off the Shelf (COTS) integration project differ from those commonly used for custom software development. Labor and schedule estimation tools that model COTS integration are available. Like all estimation tools, they must be calibrated with the organization's local project data. This paper describes the calibration of a commercial model using data collected by the Flight Dynamics Division (FDD) of the NASA Goddard Spaceflight Center (GSFC). The model calibrated is SLIM Release 4.0 from Quantitative Software Management (QSM). By adopting the SLIM reuse model and by treating configuration parameters as lines of code, we were able to establish a consistent calibration for COTS integration projects. The paper summarizes the metrics, the calibration process and results, and the validation of the calibration.

Boland, Dillard↗

SIMBIOS Sun Photometer Program

Aerosol optical thickness (AOT) values determined from the satellite ocean color data provide useful information on the spatial and temporal distributions of aerosols and are by-products of the atmospheric corrections required to estimation of water-leaving radiances. The Sensor Intercomparison and Merger for Biological and Interdisciplinary Oceanic Studies (SIMBIOS) project is using in situ atmospheric data, primarily from sun photometers, for several purposes including: (1) validation the SeaWiFS and other ocean color mission aerosol optical products, e.g., AOT and Angstrom exponent; (2) evaluation of the aerosol models currently used for atmospheric corrections; and (3) development of vicarious sensor calibration methodologies, especially for the near-infrared bands where in situ water-leaving radiance data in the visible from sites like the Marine Optical Buoy cannot be used. The principal source of in situ aerosol observations was the Aerosol Robotic Network (AERONET).

McClain, Charles↗

Measurements of DSD Second Moment Based on Laser Extinction

Using a technique recently developed for estimating the density of surface dust dispersed during a rocket landing, measuring the extinction of a laser passing through rain (or dust in the rocket case) yields an estimate of the 2nd moment of the particle cloud, and rainfall drop size distribution (DSD) in the terrestrial meteorological case. With the exception of disdrometers, instruments that measure rainfall make in direct measurements of the DSD. Most common of these instruments are the rainfall rate gauge measuring the 1 1/3 th moment, (when using a D(exp 2/3) dependency on terminal velocity). Instruments that scatter microwaves off of hydrometeors, such as the WSR-880, vertical wind profilers, and microwave disdrometers, measure the 6th moment of the DSD. By projecting a laser onto a target, changes in brightness of the laser spot against the target background during rain, yield a measurement of the DSD 2nd moment, using the Beer-Lambert law. In order to detect the laser attenuation within the 8-bit resolution of most camera image arrays, a minimum path length is required, depending on the intensity of the rainfall rate. For moderate to heavy rainfall, a laser path length of 100 m is sufficient to measure variations in optical extinction using a digital camera. A photo-detector could replace the camera, for automated installations. In order to spatially correlate the 2nd moment measurements to a collocated disdrometer or tipping bucket, the laser's beam path can be reflected multiple times using mirrors to restrict the spatial extent of the measurement. In cases where a disdrometer is not available, complete DSD estimates can be produced by parametric fitting of DSD model to the 2nd moment data in conjunction with tipping bucket data. In cases where a disdrometer is collocated, the laser extinction technique may yield a significant improvement to insitu disdrometer validation and calibration strategies

Lane, John E.↗

X-57 Mod 2 Motor Thermal Analysis

This work covers the refinement of thermal models from design estimates to actual fabricated performance. Matching the experimental data of the first fully electrified version of the X-57 Maxwell experimental vehicle requires high fidelity thermal analysis to sufficiently capture the electric motor and inverter temperature profiles. Qualification test data of the motors and inverters is used to validate finite element analysis models used to simulate thermal performance over mission transients. An additional thermal-hydraulic models is used to estimate flow characteristics through the propulsor nacelle and component heat sinks. After calibration of the higher order models, overall component sizing and peak temperature constraints can be distilled to reduced order models, to improve modelflexibility and utility.

Chin, Jeffrey C.↗

Dark Energy Survey Year 3 Results: Multi-Probe Modeling Strategy and Validation

This paper details the modeling pipeline and validates the baseline analysis choices of the DES Year 3 joint analysis of galaxy clustering and weak lensing (a so-called "3$\times$2pt" analysis). These analysis choices include the specific combination of cosmological probes, priors on cosmological and systematics parameters, model parameterizations for systematic effects and related approximations, and angular scales where the model assumptions are validated. We run a large number of simulated likelihood analyses using synthetic data vectors to test the robustness of our baseline analysis. We demonstrate that the DES Year 3 modeling pipeline, including the calibrated scale cuts, is sufficiently accurate relative to the constraining power of the DES Year 3 analyses. Our systematics mitigation strategy accounts for astrophysical systematics, such as galaxy bias, intrinsic alignments, source and lens magnification, baryonic effects, and source clustering, as well as for uncertainties in modeling the matter power spectrum, reduced shear, and estimator effects. We further demonstrate excellent agreement between two independently-developed modeling pipelines, and thus rule out any residual uncertainties due to the numerical implementation.

79 ASTRONOMY AND ASTROPHYSICS↗