Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model validation and calibration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

In Situ Cloud Measurements at AMF3 Field Campaign Report

This campaign is a follow-up project to the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility field campaign entitled Cloud Droplet Measurement System for TBS that was focused on integration of the Mesa Photonics' cloud droplet measurement system (CDMS) into the DOE ARM tethered balloon system (TBS) and its initial field testing at ARM’s Southern Great Plains (SGP) atmospheric observatory in February–March 2020. The CDMS performs in situ measurement of droplet size distribution function and droplet number density in clouds. These characteristics are important cloud microphysical properties that are critical input parameters for atmospheric models and are also useful for proper calibration and validation of performance of other atmospheric measurement instrumentation. The overall goals of this campaign were to deploy the CDMS on the DOE ARM TBS, test its compatibility with the TBS under relevant conditions, and perform a series of in-cloud measurements at the third ARM Mobile Facility (AMF3) at Oliktok Point, Alaska. The TBS flights were conducted on November 12–19, 2020.

54 ENVIRONMENTAL SCIENCES↗

Cloud Droplet Measurement System for the ARM Tethered Balloon System (TBS) Field Campaign Report

The Mesa Photonics' cloud droplet measurement system (CDMS) performs in situ measurement of droplet size distribution and droplet number density in clouds. These characteristics are important cloud microphysical properties that are critical input parameters for atmospheric models and are also useful for proper calibration and validation of performance of other atmospheric measurement instrumentation. This small campaign was the first project (out of two) that involved integration of the CDMS into the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) user facility’s tethered balloon system (TBS) and its initial testing at the ARM Southern Great Plains (SGP) atmospheric observatory. The follow-up campaign (AFC07016) involved testing of the CDMS under relevant conditions at the third ARM Mobile Facility (AMF3) at Oliktok Point, Alaska and making in situ measurements in clouds. The goal of this small field campaign was to deploy the CDMS on the ARM TBS, demonstrate its integrity and compatibility with the TBS, and test the wireless telecommunication system in preparation for subsequent in-cloud measurements at ARM’s North Slope of Alaska (NSA) observatory at Utqiagvik (formerly Barrow). The specific technical objectives included: (1) Integration of the Mesa Photonics' CDMS into the ARM TBS, (2) testing of the wireless telecommunication system of the CDMS, (3) evaluating the data acquisition software and image processing algorithms especially under high-background-illumination conditions, and (4) testing the ruggedness of the instrument's optical alignment and other performance characteristics. All objectives have been successfully met. The mounting hardware was designed and built mostly at Sandia National Laboratories (SNL), which allowed reliable mounting of the CDMS on the TBS and co-locating the CDMS with other instruments. The field tests were performed by the principal investigator (PI) in collaboration with the TBS operational crew led by D. Dexheimer. The field testing demonstrated good compatibility of the CDMS with the TBS. During the TBS flights, the crew did not experience any operational issues with the CDMS. The instrument demonstrated reliable operational characteristics, including sufficient battery life and good thermal management. The wireless telecommunication system has been successfully tested at TBS flight altitudes of up to 1000 m. During all flights, the CDMS raw data were wirelessly transmitted to the ground station and processed in real time. The ruggedness of the instrument's optical alignment was evaluated by performing calibration of the CDMS (using Mesa Photonics' fixed-size monodisperse droplet generator) before and after the campaign. The calibration was stable within the instrument's measurement precision. In summary, the campaign demonstrated good compatibility of the Mesa Photonics' CDMS with the ARM TBS. The flight tests confirmed the mechanical integrity of the CDMS and stability of its optical layout, as well as reliability of the wireless telecommunication system. Successful completion of this campaign provided a solid basis for the next campaign (AFC07016, November 2020), that involved testing of the CDMS during in-cloud TBS flights at AMF3 at Oliktok Point.

54 ENVIRONMENTAL SCIENCES↗

Pre-Test CFD for the Design and Execution of the Enhanced Injection and Mixing Project at NASA Langley Research Center

With the increasing costs of physics experiments and simultaneous increase in availability and maturity of computational tools it is not surprising that computational fluid dynamics (CFD) is playing an increasingly important role, not only in post-test investigations, but also in the early stages of experimental planning. This paper describes a CFD-based effort executed in close collaboration between computational fluid dynamicists and experimentalists to develop a virtual experiment during the early planning stages of the Enhanced Injection and Mixing project at NASA Langley Research Center. This projects aims to investigate supersonic combustion ramjet (scramjet) fuel injection and mixing physics, improve the understanding of underlying physical processes, and develop enhancement strategies and functional relationships relevant to flight Mach numbers greater than 8. The purpose of the virtual experiment was to provide flow field data to aid in the design of the experimental apparatus and the in-stream rake probes, to verify the nonintrusive measurements based on NO-PLIF, and to perform pre-test analysis of quantities obtainable from the experiment and CFD. The approach also allowed for the joint team to develop common data processing and analysis tools, and to test research ideas. The virtual experiment consisted of a series of Reynolds-averaged simulations (RAS). These simulations included the facility nozzle, the experimental apparatus with a baseline strut injector, and the test cabin. Pure helium and helium-air mixtures were used to determine the efficacy of different inert gases to model hydrogen injection. The results of the simulations were analyzed by computing mixing efficiency, total pressure recovery, and stream thrust potential. As the experimental effort progresses, the simulation results will be compared with the experimental data to calibrate the modeling constants present in the CFD and validate simulation fidelity. CFD will also be used to investigate different injector concepts, improve understanding of the flow structure and flow physics, and develop functional relationships. Both RAS and large eddy simulations (LES) are planned for post-test analysis of the experimental data.

Drozda, Tomasz G.↗

Bayesian calibration of a physics-based crystal plasticity and damage model

In this work, we present a model parameter calibration procedure for a physics-based crystal plasticity model. The calibration process utilizes a powerful statistics-based Bayesian calibration method. Calibration of the crystal plasticity parameters makes use of experimentally-measured data, i.e. compressive stress–strain response, from $\langle$100$\rangle$ and $\langle$123$\rangle$ single crystal copper dynamically loaded via Kolsky bar tests. The calibration of damage parameters is achieved using experimentally-measured free-surface velocity history data from plate impact test on $\langle$100$\rangle$ and $\langle$110$\rangle$ single crystal copper, which generates shock compression followed by dynamic tensile failure. A validation assessment is then carried out by comparing the calibrated model predictions and experimental measurements of the dynamic tensile damage generated in an impacted bicrystal copper plate. Lastly, a model-informed rationale for the experimentally-observed dependence of the spatial distribution of ductile damage (porosity) on crystallography is provided.

42 ENGINEERING↗

Reaction Wheel Disturbance Modeling, Jitter Analysis, and Validation Tests for Solar Dynamics Observatory

The Solar Dynamics Observatory (SDO) aims to study the Sun's influence on the Earth by understanding the source, storage, and release of the solar energy, and the interior structure of the Sun. During science observations, the jitter stability at the instrument focal plane must be maintained to less than a fraction of an arcsecond for two of the SDO instruments. To meet these stringent requirements, a significant amount of analysis and test effort has been devoted to predicting the jitter induced from various disturbance sources. One of the largest disturbance sources onboard is the reaction wheel. This paper presents the SDO approach on reaction wheel disturbance modeling and jitter analysis. It describes the verification and calibration of the disturbance model, and ground tests performed for validating the reaction wheel jitter analysis. To mitigate the reaction wheel disturbance effects, the wheels will be limited to operate at low wheel speeds based on the current analysis. An on-orbit jitter test algorithm is also presented in the paper which will identify the true wheel speed limits in order to ensure that the wheel jitter requirements are met.

Liu,Kuo-Chia↗

The importance and attainment of accurate absolute radiometric calibration

The importance of accurate absolute radiometric calibration is discussed by reference to the needs of those wishing to validate or use models describing the interaction of electromagnetic radiation with the atmosphere and earth surface features. The in-flight calibration methods used for the Landsat Thematic Mapper (TM) and the Systeme Probatoire d'Observation de la Terre, Haute Resolution visible (SPOT/HRV) systems are described and their limitations discussed. The questionable stability of in-flight absolute calibration methods suggests the use of a radiative transfer program to predict the apparent radiance, at the entrance pupil of the sensor, of a ground site of measured reflectance imaged through a well characterized atmosphere. The uncertainties of such a method are discussed.

Slater, P. N.↗

Design of a Molten Salt Flow Cell for Combined Absorbance and Laser-Induced Breakdown Spectroscopy for Online Measurements

A novel flow cell allowing for multiple optical spectroscopy measurements on flowing molten salts was designed, and demonstrative calibrations of impurities in aqueous samples were performed. Online compositional measurements of molten salts are of high interest to monitor the state of relevant solar and nuclear systems. Here, the Spectroscopic Configuration for Optical Real-Time Characterization of High-Temperature (SCORCH) fluids cell was designed to meet this need by providing optical access to a high-temperature molten salt sample stream without physical contact between the sample and window materials. Laser-induced breakdown spectroscopy (LIBS) was utilized to quantify Li, Cr, Fe, Ni, Sr, and Pr at concentrations ranging nominally from 0 to 315 mmol L −1 . Laser power, frequency, and plasma position were optimized to mitigate challenges associated with sample splashing. Univariate calibration models were built with R 2 > 0.98, percent root mean square error of cross-validation (%RMSECV) as low as 2.7%, and limits of quantification (LOQs) down to 4.1 mmol L −1 . Simultaneously, absorbance calibrations were developed for the applicable analytes (Cr, Ni, and Pr) using Beer’s law with a pathlength of 4.41 ± 0.10 mm. These models provide excellent quantification performance with R 2 > 0.999, %RMSECV as low as 0.6%, and LODs down to 0.08 mmol L −1 . Although these calibrations were performed for each spectroscopic technique separately, the two methods may be combined in the future through multivariate modeling and sensor fusion to provide more robust models with the benefits of both techniques (e.g., absorbance: oxidation state concentrations, LIBS: elemental concentration). Additionally, optimized spectrometers may be deployed to enhance sensitivity.

absorbance spectroscopy↗

Probabilistic Machine Learning Estimation of Ocean Mixed Layer Depth from Dense Satellite and Sparse In-Situ Observations

The ocean mixed layer plays an important role in the coupling between the upper ocean and atmosphere across a wide range of time scales. Estimation of the variability of the ocean mixed layer is therefore important for atmosphere-ocean prediction and analysis. The increasing coverage of in situ Argo profile data allows for an increasingly accurate analysis of the mixed layer depth (MLD) variability associated with deviations from the seasonal climatology. However, sampling rates are not sufficient to fully resolve subseasonal (<90 day) MLD variability. Yet, many multivariate observations-based analyses include implicit modeled subseasonal MLD variability. One analysis method is optimal interpolation of in situ data, but the interior analysis can be improved by leveraging surface data with regression or variational approaches. Here, we demonstrate how machine learning methods and satellite sea surface temperature, salinity, and height facilitate MLD estimation in a pilot study of two regions: the mid-latitude southern Indian and the eastern equatorial Pacific Oceans. We construct multiple machine learning architectures to produce weekly 1/2° gridded MLD anomaly fields (relative to a monthly climatology) with uncertainty estimates. We test multiple traditional and probabilistic machine learning techniques to compare both accuracy and probabilistic calibration. We validate our methodology by applying it to ocean model simulations. We find that incorporating sea surface data through a machine learning model improves the performance of spatiotemporal MLD variability estimation compared to optimal interpolation of Argo observations alone. These preliminary results are a promising first step for the application of machine learning to MLD prediction.

Machine Learning↗

Comparison of Space Radiation GCR Models to AMS Heavy Ion Data

Galactic cosmic rays (GCR) are a constant source of radiation that constitutes one of the major hazards during deep space exploration missions for both astronauts and hardware. In this work, GCR models commonly used by the space radiation protection community are compared with recently published high-precision, high- resolution measurements of cosmic ray lithium, beryllium, boron, carbon, nitrogen, and oxygen fluxes along with their ratios (Li/B, Li/C, Li/O, Be/B, Be/C, Be/O, B/C, B/O, C/O, N/B, N/O) from the Alpha Magnetic Spectrometer (AMS). All of the models were developed and calibrated prior to the publication of this AMS data, therefore this is an opportunity to validate the models against an independent data set. This paper is a compliment to the previously published comparison of GCR models with AMS hydrogen, helium, and the boron-to-carbon ratio.

Whitman, Kathryn↗

Air freight demand models: An overview

A survey is presented of some of the approaches which have been considered in freight demand estimation. The few existing continuous time computer simulations of aviation systems are reviewed, with a view toward the assessment of this approach as a tool for structuring air freight studies and for relating the different components of the air freight system. The variety of available data types and sources, without which the calibration, validation and the testing of both modal split and simulation models would be impossible are also reviewed.

Dajani, J. S.↗

In silico trials predict that combination strategies for enhancing vesicular stomatitis oncolytic virus are determined by tumor aggressivity

Background Immunotherapies, driven by immune-mediated antitumorigenicity, offer the potential for significant improvements to the treatment of multiple cancer types. Identifying therapeutic strategies that bolster antitumor immunity while limiting immune suppression is critical to selecting treatment combinations and schedules that offer durable therapeutic benefits. Combination oncolytic virus (OV) therapy, wherein complementary OVs are administered in succession, offer such promise, yet their translation from preclinical studies to clinical implementation is a major challenge. Overcoming this obstacle requires answering fundamental questions about how to effectively design and tailor schedules to provide the most benefit to patients. Methods We developed a computational biology model of combined oncolytic vaccinia (an enhancer virus) and vesicular stomatitis virus (VSV) calibrated to and validated against multiple data sources. We then optimized protocols in a cohort of heterogeneous virtual individuals by leveraging this model and our previously established in silico clinical trial platform. Results Enhancer multiplicity was shown to have little to no impact on the average response to therapy. However, the duration of the VSV injection lag was found to be determinant for survival outcomes. Importantly, through treatment individualization, we found that optimal combination schedules are closely linked to tumor aggressivity. We predicted that patients with aggressively growing tumors required a single enhancer followed by a VSV injection 1 day later, whereas a small subset of patients with the slowest growing tumors needed multiple enhancers followed by a longer VSV delay of 15 days, suggesting that intrinsic tumor growth rates could inform the segregation of patients into clinical trials and ultimately determine patient survival. These results were validated in entirely new cohorts of virtual individuals with aggressive or non-aggressive subtypes. Conclusions Based on our results, improved therapeutic schedules for combinations with enhancer OVs can be studied and implemented. Our results further underline the impact of interdisciplinary approaches to preclinical planning and the importance of computational approaches to drug discovery and development.

60 APPLIED LIFE SCIENCES↗

The Status of the Tropical Rainfall Measuring Mission (TRMM) after 2 Years in Orbit

The Tropical Rainfall Measuring Mission (TRMM) satellite was launched on November 27, 1997, and data from all the instruments first became available approximately 30 days after launch. Since then, much progress has been made in the calibration of the sensors, the improvement of the rainfall algorithms, in related modeling applications and in new datasets tailored specifically for these applications. This paper reports the latest results regarding the calibration of the TRMM Microwave Imager, (TMI), Precipitation Radar (PR) and Visible and Infrared Sensor (VIRS). For the TMI, a new product is in place that corrects for a still unknown source of radiation leaking in to the TMI receiver. The PR calibration has been adjusted upward slightly (by 0.6 dBZ) to better match ground reference targets, while the VIRS calibration remains largely unchanged. In addition to the instrument calibration, great strides have been made with the rainfall algorithms as well, with the new rainfall products agreeing with each other to within less than 20% over monthly zonally averaged statistics. The TRMM Science Data and Information System (TSDIS) has responded equally well by making a number of new products, including real-time and fine resolution gridded rainfall fields available to the modeling community. The TRMM Ground Validation (GV) program is also responding with improved radar calibration techniques and rainfall algorithms to provide more accurate GV products which will be further enhanced with the new multiparameter 10 cm radar being developed for TRMM validation and precipitation studies. Progress in these various areas has, in turn, led to exciting new developments in the modeling area where Data Assimilation, and Weather Forecast models are showing dramatic improvements after the assimilation of observed rainfall fields.

Kummerow, C.↗

Inter-Calibrating the CERES SW Instrument Fluxes Using Deep Convective Clouds(DCC) Within the Same Sun-Synchronous Orbit

The NASA CERES EBAF product provides the scientific community observed TOA fluxes to monitor the Earth’s energy imbalance and to validate climate models. To provide a seamless EBAF 24-year record, the CERES instrument calibration must be stable and consistent across satellite records. Once the Terra and Aqua spacecraft are decommissioned at the end of 2025, the CERES project will rely on CERES instrument observations on the SNPP and NOAA-20 1:30 PM sun-synchronous orbits. The SNPP and NOAA-20 satellite orbit placement will prevent any time matched observations for inter-calibration efforts. The future Libera instrument, which will continue the CERES record and scheduled for launch in 2028 onboard the NOAA-22 satellite, will also need to be inter-calibrated without the aid of time-matched observations. Deep convective clouds (DCC) are the most Lambertian, brightest, tropical Earth invariant targets located at the tropopause making them ideal to radiometrically scale the CERES SW observed radiance to a common reference. The SNPP, NOAA-20 and future NOAA-22 satellites are in the same 16-day repeatable orbits, allowing the DCC targets to be observed with the same angular configuration. The empirically derived SNPP CERES SW channel Bidirectional Reflectance Distribution Function (BRDF) can be easily be applied to the NOAA-20 CERES SW channel radiances since they observe the nearly the same DCC systems. The DCC BRDF corrected radiances are analyzed collectively into radiance probability distribution functions (PDF). By comparing the PDF statistics, the SNPP and NOAA-20 CERES SW channel can be inter-calibrated. The inter-calibration coefficients are validated with the CERES instrument calibration team coefficients to optimize the methodology.

David Doelling↗

Flight Metal Plasma Thruster (MPT) Development, Qualification, and Thrust Measurement Campaign

A torsional thrust stand, calibrated for impulse bits in the range of 0.1mNs -0.5 mNs, was used to measure impulse bits during two campaigns at the NASA/GRC VF-3 Vacuum test Facility. Metal Plasma Thrusters (MPTs) with targets of Molybdenum, Copper and Stainless Steel (as used in upper stages of launch vehicles that are abandoned in LEO) were tested. This paper describes data from Mo targets (called pucks). The Cu and ss data will be presented elsewhere. Model predictions (based on a simple circuit model and published plasma parameters) were validated by data from the calibrated torsional thrust stand. The Metal Plasma Thruster uses solid metal propellant, hence requires no liquids, gases, flow valves or flow controls and has no moving parts. Total impulse ~5000Ns/U provides orbit raising and drag compensation capability.

Electric Propulsion↗

Flight MPT Development, Qualification and Thrust Measurement Campaign

A torsional thrust stand, calibrated for impulse bits in the range of 0.1mNs -0.5 mNs, was used to measure impulse bits during two campaigns at the NASA/GRC VF-3 Vacuum test Facility. Metal Plasma Thrusters (MPTs) with targets of Molybdenum, Copper and Stainless Steel (as used in upper stages of launch vehicles that are abandoned in LEO) were tested. This paper describes data from Mo targets (called pucks). The Cu and ss data will be presented elsewhere. Model predictions (based on a simple circuit model and published plasma parameters) were validated by data from the calibrated torsional thrust stand. The Metal Plasma Thruster uses solid metal propellant, hence requires no liquids, gases, flow valves or flow controls and has no moving parts. Total impulse ~5000Ns/U provides orbit raising and drag compensation capability.

Electric Propulsion↗

Calibrating Synchronous-Generator-Interfaced DG Models in Microgrids Using Multiple Event Data

Microgrids, consisting of distributed generators (DGs), loads, and energy storage systems, play an important role in future smart grids. In order to evaluate how microgrids operate and their dynamic response, it is necessary to develop accurate dynamic models of DGs in microgrids. This paper proposes a systematic method to calibrate synchronous-generator-interfaced DG models. Challenges associated with model validation in microgrids are analyzed. Underlying parameters are categorized into two groups, i.e., the steady-state parameters and time constants, which are estimated in two successive stages using multiple event data. This methodology ensures that the validated model with the estimated parameters are applicable for all events. A modified unscented Kalman filter (UKF) is proposed to deal with the cases in which measurement of power angle is unavailable. The effectiveness of the proposed method is validated using field test data of a 2.6 MVA diesel generator in a real microgrid.

Wang, Zhiwen↗

Improvement of two-phase closure models in CTF using Bayesian inference

Under the Consortium for Advanced Simulation of Light Water Reactors (CASL) program, extensive capabilities have been developed in CTF to analyze light-water reactors (LWRs) for normal operating conditions, departure from nucleate boiling (DNB), and system transients. However, further improvements are required in the modeling and simulation of boiling water reactors (BWRs), which is a focus of the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program. In this work, CTF validation results were used to optimize selected modeling coefficients by calibrating to experimental data using a Bayesian inference approach. Here, calibration studies were conducted to improve (vapor) void fraction prediction without worsening the two-phase pressure drop prediction, as well as to improve the two-phase pressure drop prediction. Calibration was performed for interfacial drag and wall shear models. Surrogates were developed to alleviate the computational expense required for sampling the parameter space using Markov chain Monte Carlo (MCMC). An assessment performed with calibrated models demonstrated an improvement of CTF in its prediction of key parameters such as void fraction and two-phase pressure drop.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Quantifying Variability and Controls of Riverine Dissolved Organic Carbon Exported to Arctic Coastal Margins of North America (Final Report)

This project involved implementation and application of a coupled permafrost hydrology and dissolved organic carbon process models to investigate how spatial and seasonal variations in terrestrial hydrology and soil freeze/thaw dynamics influence the mobilization, loading, and export of organic carbon to the stream network for selected arctic basins across northern Alaska and northwest Canada. The model simulations were constrained by detailed observations of in- stream chemistry, soil active layer profile moisture and temperature dynamics, streamflow, soil carbon inventories and satellite microwave remote sensing based assessments of surface soil freeze-thaw dynamics. We developed and applied the numerical modeling and data analysis, incorporating observed data for calibration and validation, in order to investigate the terrestrial hydrology, permafrost dynamics, and associated DOC production and loading to rivers across a region encompassing watersheds draining to the coast. The project produced six publications and three datasets archived in public repositories.

54 ENVIRONMENTAL SCIENCES↗