SEARCH · Engineering Papers

Results for “VALIDATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

All sources NASA NTRS DOE OSTI

NASA NTRS2018

Portable, Low-Cost, Column Carbon Dioxide and Methane Measurements for Validating Satellite Observations in Remote Locations

We present a low-cost (~$10K per instrument), portable solution to ground-based validation of satellite observations for difficult to reach locations with precisions of 1 ppm XCO2 and 10 ppb XCH4 for hourly data products. While Total Carbon Column Observing Network (TCCON) is the gold-standard for ground validation, there are locations where a ground column validation data point would be useful but conditions are not conducive to a permanent station. Examples include wetlands, thawing permafrost, the tropics, the Amazon, sub-Saharan Africa, as well as locations without a power grid or with geopolitical conflict. In addition, the low-cost and portability mean a geographical region can be studied in depth with multiple instruments. This passive, sun-pointing instrument is a miniaturized, laser heterodyne radiometer (mini-LHR) that has been under development by our team since 2009. It can be operated either in tandem with AERONET (a global network of 500 instruments that measure aerosol optical depth), or as a stand-alone instrument with a low-cost (~$3K), light-weight sun tracker. One of the main benefits of the mini-LHR is that it can quickly reach remote locations and provide a validation measurement even if there is limited or no infrastructure at the site. The instrument weighs ~10 lbs, fits into a backpack, and is powered by two folding solar panels and a battery pack. In clear conditions, the instrument can be set-up in under an hour. Portability means that mini-LHRs can be easily moved for side-by-side comparisons with other mini-LHRs and with TCCON which simplifies assessing instrument bias as well as accuracy. Like TCCON, the mini-LHR points directly at the sun with a narrow field-of-view and is its insensitivity to cloud and aerosol scattering that is common to nadir-pointing passive satellite approaches. Here we present a collection of sample data sets to demonstrate performance from locations that vary in climate, altitude, solar zenith angle, hours of sun per day, etc., as well as data from side-by-side TCCON comparisons. Retrievals of CO2 and CH4 were completed using the NASA/Goddard's Planetary Spectrum Generator (PSG) that incorporates meteorological inputs from Modern-Era Retrospective analysis for Research and Applications, Version 2 (MERRA-2) data set.

Wilson, Emily W.↗

NASA NTRS2019

Simplifying Satellite and Ground Data Validation with Level-2 Subsetting

We demonstrate that scientists can simplify their satellite data validation workflow with the use of NASA Godddard Earth Sciences Data and Information Services Center (GES DISC) subsetting services. We perform a sample validation of Aura ozone products collocated with ground-based ozone measurements using subsetting services to trim satellite data to only the relevant user-defined variables and spatio-temporal region. Because the subsetting service automatically returns only relevant data granules that adhere to a set of user-defined coincidence criteria, user workload is greatly reduced. Moreover, the resultant data files are substantially smaller than full data granules due to the subsetting service further culling the data to the relevant geospatio-temporal coincidence criteria, user-defined variables, and user-defined dimensions of variables. This decreases data download throughput and file storage requirements. The validation presented here quantifies the time and file size savings that can be achieved by utilizing subsetting services within the satellite data validation workflow.

Johnson, James↗

NASA NTRS2017

ExEP Yield Modeling Tool and Validation Test Results

EXOSIMS is an open-source simulation tool for parametric modeling of the detection yield and characterization of exoplanets. EXOSIMS has been adopted by the Exoplanet Exploration Programs Standards De nition and Evaluation Team (ExSDET) as a common mechanism for comparison of exoplanet mission concept studies. To ensure trustworthiness of the tool, we developed a validation test plan that leverages the Python-language unit-test framework, utilizes integration tests for selected module interactions, and performs end-to-end cross- validation with other yield tools. This paper presents the test methods and results, with the physics-based tests such as photometry and integration time calculation treated in detail and the functional tests treated summarily. The test case utilized a 4m unobscured telescope with an idealized coronagraph and an exoplanet population from the IPAC radial velocity (RV) exoplanet catalog. The known RV planets were set at quadrature to allow deterministic validation of the calculation of physical parameters, such as working angle, photon counts and integration time. The observing keepout region was tested by generating plots and movies of the targets and the keepout zone over a year. Although the keepout integration test required the interpretation of a user, the test revealed problems in the L2 halo orbit and the parameterization of keepout applied to some solar system bodies, which the development team was able to address. The validation testing of EXOSIMS was performed iteratively with the developers of EXOSIMS and resulted in a more robust, stable, and trustworthy tool that the exoplanet community can use to simulate exoplanet direct-detection missions from probe class, to WFIRST, up to large mission concepts such as HabEx and LUVOIR.

Nunez, Paul↗

NASA NTRS2021

Follow-up and Validation of K2 and TESS Planetary Systems with Keck NIRC2 Adaptive Optics Imaging

High resolution imaging (HRI) is a critical part of the transiting exoplanet follow-up and validation process. HRI allows previously unresolved stellar companions and background blends to be resolved, vetting false positive signals and improving the radii measurements of true planets. Through a multi-semester Keck NIRC2 adaptive optics imaging program, we have pursued HRI of K2 and TESS candidate planet host systems to provide the transiting exoplanet community with necessary data for system validation and characterization. Here we present a summary of our ongoing program that includes an up to date list of targets observed, a description of the observations and data reduction, and a discussion of planetary systems validated by the community using these data. This observing program has been key in NASA’s K2 and TESS missions reaching their goals of identifying new exoplanets ideal for continued follow-up observations to measure their masses and investigate their atmospheres. All observations presented here are available as calibrated images and resulting contrast curves through the Exoplanet Follow-up Observing Program (ExoFOP) website. We encourage members of the exoplanet community to use these data products in their ongoing planetary system validation and characterization efforts.

Adaptive optics↗

NASA NTRSDate not supplied

A Method for Validating Causal Diagrams of Human Health Risk in Space Flight

The complexity of cause-and-effect relationships between spaceflight hazards and resulting health conditions clouds understanding of the totality of human system risk in space. In response, NASA has introduced Directed Acyclic Graphs (causal diagrams) into the human systems risk management process. These diagrams allow for a common understanding of the mechanisms that lead from unique hazards of spaceflight to the health outcomes important to agencies and astronauts. However, the paucity of available biomedical data from spaceflight creates a need for methods of validating causal models that can accommodate data from spaceflight model analogs. Here we outline one approach utilizing open-access rodent bone datasets from the Ames Life Sciences Data Archive. The properties of directed acyclic graphs themselves can provide an epistemological and statistical framework for validation of a priori causal representations of human system risk in space flight. The assumed causal connections on the graph creates sets of logical implications: variables that – if the causal diagram is correct – should be correlated, as well as sets that should be conditionally independent. By testing these implied correlations and conditional independencies both statistically and heuristically, we can provide evidence for or against specific causal pathways on the causal diagram. In addition to validation of expert-generated causal diagrams, machine learning techniques can learn the most likely structure of a causal diagram from a given dataset. Comparison with and reconciliation between machine-learned causal diagrams and expert-generated diagrams is another technique for challenging assumptions and improving our understanding of causal mechanisms. Accurately representing complex causation is essential to systemic understanding of human health risks in space travel. Having a robust system of validating causal diagrams helps us arrive at more accurate representations of causal systems. This process will be integral to developing the countermeasures necessary for extended exploration of the moon and Mars.

Robert Reynolds↗

NASA NTRS2021

Validation of Small Satellite Dynamics Simulation Modules using ASTERIA Flight Data

ASTERIA (Arcsecond Space Telescope Enabling Research in Astrophysics) was a CubeSat space telescope that operated in low-Earth orbit, having been deployed from the International Space Station in 2017. The spacecraft has achieved sub-arcsecond pointing stability and millikelvin thermal stability over 20-minute observations. A key enabling feature of the ASTERIA mission is the low level of pointing error that has been demonstrated under ASTERIA’s fine pointing control mode. Prior to launch, the ASTERIA mission performed analysis and simulations to estimate the in-flight pointing performance. This analysis used reaction wheel models provided by JPL’s Small Satellite Dynamics Testbed (SSDT), which had performed Kistler table testing to characterize the jitter caused by the reaction wheels of the Blue Canyon Technologies XACT attitude control unit within ASTERIA. These models were subsequently incorporated into the SSDT simulation. The main source of jitter, the high-frequency attitude disturbance over the camera exposure time, on ASTERIA is the set of rotating reaction wheels that are used for maintaining fine pointing during observations. The reaction wheels impart disturbance forces and torques continuously that cause unwanted motion during imaging. Increased jitter consequently leads to blurring of the image. Therefore, to benefit all SmallSat missions devoted to photometric or spectroscopic astrophysics applications, an on-orbit flight data acquisition and jitter testing campaign was performed in an attempt to help validate the SSDT’s simulation models. This paper describes the process used to validate several simulation models and attempt to characterize the ASTERIA jitter by analyzing the size of the resulting spot size for the target stars as a function of wheel speed, having commanded four wheel speeds for each of three stars of known brightness. After summarizing the on-orbit observation and jitter level measurement process, this paper compares the results obtained from the flight operational environment to the corresponding set of simulation jitter levels. Though the flight data obtained during this experiment was not sufficient to validate the simulation’s jitter model, other models have been validated with flight data, including the magnetic field, orbit propagation, sun position, and long-duration orbit decay models, which may be used by all other projects that use the SSDT’s simulation to increase system capability knowledge.

Mohan, Swati↗

NASA NTRS2022

Aerosol Models from the AERONET Database: Application to Surface Reflectance Validation Satellite Data

Aerosols play a critical role in radiative transfer within the atmosphere, and they have a significant impact on climate change. In this paper, we propose and implement a framework for developing an aerosol model using their microphysical properties. Such microphysical properties as the size distribution, the complex refractive index, and the percentage of sphericity are derived from the global AERosol RObotic NETwork (AERONET). These measurements, however, are typically retrieved when almucantar measurement procedures are performed (i.e., early mornings and late afternoons with clear sky) and might not have a temporal correspondence to a satellite overpass time, so a valid validation of satellite-derived products cannot be carried out. To address this problem of temporal inconsistency of satellite and ground-based measurements, we developed an approach to retrieve these microphysical properties (and the corresponding aerosol model) using the optical thickness at 440 nm, τ440, and the Ångström coefficient between 440 and 870 nm, α440–870. Such aerosol models were developed for 851 AERONET sites within the last 28 years. Obtained results suggest that empirically microphysical properties can be retrieved with uncertainties of up to 23 %. An exception is the imaginary part of the refractive index ni, for which the derived uncertainties reach up to 38 %. These specific parametric models of aerosol can be used for the studies when retrieval of microphysical properties is required as well as validation of satellite-derived products over land. Specifically, we demonstrate the usefulness of the aerosol models to validate surface reflectance records over land derived from optical remote sensing sensors. We then quantify the propagation of uncertainties in the surface reflectance due to uncertainties with the aerosol model retrieval that is used as a reference from radiative transfer simulations. Results indicate that individual aerosol microphysical properties can impact uncertainties in surface reflectance retrievals between 3.5 × 10(exp -5) to 1 × 10(exp -3) (in reflectance units). The overall impact of microphysical properties combined yields an overall uncertainty in surface reflectance <0.004 (in reflectance units). That corresponds, for example, to 1 to 3 % of the retrieved surface reflectance in the red spectral band (620–670 nm) by the Moderate Resolution Imaging Spectroradiometer (MODIS) instrument. These uncertainty values are well below the specification (0.005 + 0.05ρ; ρ is the retrieved surface reflectance) used for the MODIS atmospheric correction.

Jean-Claude Roger↗

NASA NTRSDate not supplied

Validation of CrIS Ozone and Carbon Oxide Products from CrIS Single-Field-of-View Retrievals

Single Field-of-view Sounder Atmospheric Products (SiFSAP) from Cross-track Infrared Sounder (CrIS) on S-NPP have been developed at NASA Langley Research center, and recently a significant improvement in its trace gases products has been made. These products are derived based on the Principal Component (PC)-based Radiative Transfer Model (PCRTM) and an optimal estimation retrieval method (PCRTM-RA). Use of the PCRTM in this method allows for fast and accurate calculations for thousands of spectral channels under clear and cloudy sky conditions. The use of principal component to compress information from all spectral channels into the PC domain enables to reduce the observational noise and use the information from all hyperspectral infrared channels. The retrieval is made on PC-domain, and temperature, water vapor, trace gases, cloud and surface parameters are retrieved simultaneously. This presentation will present some validation to the SiFSAP ozone (O3) and carbon monoxide (CO) products. Since the SiFSAP has a spatial resolution of about 14 km at nadir, which is better than most global weather and climate models and enables to make process-oriented analysis of the transport of these gases, this study will focus on validation of CO and O3 products under some extreme weather and/or climate events, such as CO emission and transport from large biomass burning, and O3 variation impacted by fire emission, stratospheric intrusion, and tropical cyclones. Data used in our validation include CO and O3 from NASA aircraft campaigns, plus other satellite products such as CO and O3 from AIRS, IASI and TROPOMI, MOPPIT CO and OMPS O3. Some comparison of SiFSAP O3 with the O3 from the fifth-generation ECMWF reanalysis (ERA5) data the NASA Modern-Era Retrospective Analysis for Research and Applications, Version 2 (MERRA-2) will also present. Such a validation not only helps to quantify the performance of the retrievals in these extreme conditions, but also displays the capability of satellite observation to capture the fine-scale spatial pattern of CO and O3 variation.

Xiaozhen Xiong↗

NASA NTRSDate not supplied

Slosh-Induced Ullage Collapse Validation by Computational Fluid Dynamics and Application to In-space Propellant Dynamics

Ullage collapse predictions made using Computational Fluid Dynamics (CFD) were validated then made for an in-space cryogenic propellant unsettling application. Ullage collapse is the decrease in propellant tank pressure due to cooling of the ullage gas, which can be significant for cryogenic propulsion systems. Vehicles may be developed that are robust to temperature and pressure changes caused by heat leaks, e.g., propellant tanks with high maximum operation pressures, technologies yielding active thermal conditioning, and systems with ample pressurant for conditioning. These methods are robust because additional mass, cost, and complexity are used to address cryogenic fluid management (CFM). As vehicles are optimized for increased payload capacity, tracking of events such as ullage collapse and self-pressurization in tanks will become increasingly important for propellant inventory calculations. Some ullage collapse events can be studied through ground experimentation, but propellant unsettling in and around in-space coast mission phases must be studied in the absence of an acceleration field. Computational Fluid Dynamics is a powerful tool to address this need, enabling prediction of complex physics prior to flight. Validation of the chosen CFD tool and modeling methodology was done using data from a previously conducted subscale slosh-induced ullage collapse ground test performed in part by the Japan Aerospace Exploration Agency (JAXA). A small tank was partially filled with liquid nitrogen and pressurized with gaseous nitrogen at various temperatures. The tank was oscillated laterally to induce high amplitude slosh dynamics resulting in wave breakup. Successful qualitative validation of slosh wave dynamics and quantitative validation of ullage collapse promoted confidence in extending ullage collapse predictions to a flight application. Mechanisms of ullage collapse caused by main engine cutoff while in-space were identified. Both slosh dynamics leading to engine shutdown and body dynamics following shutdown were shown to contribute to propellant unsettling and ullage collapse.

J M Brodnick↗

NASA NTRS2022

Validations of Satellite Ozone Profiles in Austral Spring Using Ozonesonde Measurements in the Jang Bogo Station, Antarctica

Using ozonesonde measurements from 2015 to 2018 at the Jang Bogo station located in the southeastern Antarctic region, we evaluate ozone profiles retrieved from the three satellite measurements that are widely used: Ozone Monitoring Instrument (OMI), Microwave Limb Sounder (MLS), and Ozone Mapping Profiler Suite (OMPS) data. For the fair validation, ozonesonde profiles are smoothed using the weighting function of each satellite retrieval algorithm (i.e., convolution process). Compared with limb-viewing MLS and OMPS ozone profiles, the OMI ozone profiles are relatively less qualified: coarser vertical resolution and larger inter-annual variation. Nevertheless, our validation reveals that the quality of all three satellite ozone profiles looks comparable; In general, difference from ozonesonde profile is ∼1 ppm absolutely, and −20 to 30% relatively at maximum. This quantitative range well corresponds to previous work, meaning that our new validation confirms the reliability of satellite ozone profiles in the southeastern Antarctic region where the measurement data for the validation were not enough. Another interesting feature is the role of a priori ozone profile; Nadir-viewing OMI satellite can have qualified ozone profiles by a proper assumption of a priori ozone profile. Since the performance of limb-viewing ozone profiles is better, however, the careful usage of nadir-viewing ozone profile is still required. We think that the simultaneous usage of multiple satellite ozone profiles can contribute to better understanding of Antarctic ozone characteristics.

Antarctica↗

NASA NTRSDate not supplied

A Multi-Year Effort to Forward the Validation of Solar Energetic Particle Prediction Models

To enable a consistent and quantitative understanding of solar energetic particle (SEP) model performance, a generalized, automated validation infrastructure, called SPHINX, is being developed by the NASA Space Radiation Analysis Group (SRAG) in close collaboration with the NASA Community Coordinated Modeling Center (CCMC), NASA Moon to Mars Space Weather Analysis Office (M2M), NOAA Space Weather Prediction Center (SWPC), and the Royal Belgian Institute for Space Aeronomy (BIRA-IASB). SPHINX is being developed to evaluate the SEP Scoreboards (https://ccmc.gsfc.nasa.gov/scoreboards/sep/), which are being used by SRAG to support space radiation operations for Mission Control. SPHINX is also being developed through a series of community challenges, which have defined a list of challenge events and a prescribed set of rules of participation. The participation of the research community has enabled the generalization of the infrastructure to validate all the types of outputs being produced by SEP models and fully exercised the framework. The most recent challenge includes 30 SEP events and 33 non-event (quiet) periods and was supported by two dedicated SEPVAL working meetings, one in the US and one in Europe (https://ccmc.gsfc.nasa.gov/community-workshops/ccmc-sepval-2023/). Here, we describe SPHINX and its interactive user interface, SPHINX-VIVID, which will eventually be made available for public use. We present selected results, outcomes, and lessons learned from the SEPVAL working meetings and validation results of the SEP Scoreboards from 2019 to present. These efforts aim to define a set of community standards for SEP model validation and describe the current state-of-the-art of SEP model performance.

Kathryn Whitman↗

NASA NTRSDate not supplied

A CFD Validation Study using Artemis 1 Orbital Slosh Test Data

Advancements in liquid propellant management science and technologies are key to increasing safety, decreasing cost, and increasing payload mass of NASA space missions. Liquid propellant usually comprises a large portion of the total mass of launch vehicles and spacecraft, so predicting and controlling the motion of it are important. Computational fluid dynamics (CFD) programs are critical to predicting slosh dynamics, but CFD programs require experimental validation with physically relevant test data before the results can be trusted. Low-gravity slosh test data is lacking, and most of what exists is inadequate for CFD validation. A potential slosh risk for Orion, and the lack of validated low-gravity slosh models, led to performing on-orbit slosh tests during the Artemis 1 mission to assess the impacts of slosh on the guidance, navigation, and control of Orion. This work details the validation of a coupled slosh-motion CFD model using the Orion orbital slosh test data set.

CFD↗

NASA NTRSDate not supplied

A CFD Validation Study Using Artemis 1 Orbital Slosh Test Data

CFD↗

DOE OSTI2023

Advancements in Validation of TSLs through Inelastic Neutron Scattering and Transmission Measurements [Abstract]

Historically, the free gas approximation has been used to treat the thermal scattering of neutrons with energies below a few electron-volts (eV) in unevaluated materials. However, this method inadequately reproduces neutron scattering at these energies. Until recently, only a limited number of materials had available thermal scattering law (TSL) files/libraries in the ENDF nuclear data libraries in this energy range. With advancements in atomistic modeling techniques, such as molecular dynamics, ab-initio molecular dynamics, and density functional theory, TSL libraries have become available for many more materials. This is particularly relevant due to the rising interest in several advanced reactor systems that require novel moderator and reflector materials. While quasi-integral and integral benchmarks have been designed to validate historically important moderator materials (such as light water and polyethylene), there is currently a lack of standard validation methods for TSLs, especially when multiple conflicting TSLs exist. To address this issue, the Oak Ridge National Lab Nuclear Data group has been working on utilizing inelastic neutron scattering (INS) measurements combined with transmission (i.e., total cross section) measurements to evaluate and validate TSLs for different materials. We plan to demonstrate how this method has worked on materials such as polyethylene, lucite, and polystyrene. In addition, we will compare the newly created libraries to ENDF libraries for these materials and explain why integral benchmarks should not be used for validation when multiple TSLs exist.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2024

Results of an In-Field Validation Exercise in Support of Wide-Area Environmental Sampling

The National Nuclear Security Administration’s (NNSA) Office of Nonproliferation and Arms Control (NA-24) is evaluating Wide-Area Environmental Sampling (WAES) as an additional safeguards verification tool for the International Atomic Energy Agency to detect undeclared nuclear activities. The NNSA is evaluating strategies for conducting a generic WAES campaign, the cost of a WAES campaign, and the effect of technological advancements that have occurred since the last major WAES review in 1999. Until now, the NNSA effort has focused on tabletop exercises (TTXs) in which high-performance computing allows for advanced modeling and simulation efforts to be applied to the WAES question. Although the modeling and simulations used in the TTXs are extremely valuable, field campaigns are still needed to validate the assumptions that underpin the models and the modeling process itself. During a 7 week period beginning in May 2023 and ending in June 2023, which included 4 weeks of active field collections, a multilaboratory team conducted its first in-field validation exercise. Prior to the in-field exercise, abbreviated TTXs were conducted to estimate the performance of all collection systems to be used during the field test. These TTXs guided the selection of materials to be released and the placement of the collection system. Based on these determinations, materials were procured to use in the field test, and an injection/release system was designed, built, and installed at the test facility. Background samples were collected during weeks one and four, and environmental collections against active releases were conducted during weeks two and three. The goals of this validation exercise included a demonstration of (1) the ability to provide controlled releases of particulates of surrogate materials, (2) the fielding and operation of collection systems (including deposition and active air collectors), and (3) the flexibility to revise equipment and campaign plans in the field. This paper presents the results and preliminary conclusions for this initial validation test. Based on these results, subsequent field campaigns are anticipated and will include the addition of other released materials.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2026

Validation of the DESI DR2 Ly$α$ forest full-shape analysis

We present the validation of the Dark Energy Spectroscopic Instrument (DESI) Data Release 2 (DR2) Lyman-$α$ (Ly$α$) forest full-shape analysis. This analysis combines three-dimensional Ly$α$ forest auto-correlations and cross-correlations with quasars to extract information from both the baryon acoustic oscillation (BAO) feature and the broadband clustering signal, with primary emphasis on the Alcock-Paczynski (AP) measurement. Compared to the DESI DR1 analysis, the DR2 validation uses substantially larger and more realistic mock datasets, including CoLoRe 2LPT and AbacusSummit Ly$α$ forest simulations. The modeling framework is also improved through analytic marginalization over small scales ($<10$$h^{-1}$Mpc) and the impact of ultraviolet background fluctuations. The validation program was completed prior to unblinding and defines quantitative requirements for the cosmological parameters of interest, which are evaluated using hundreds of mock realizations. We further test the analysis through independent fits to the auto- and cross-correlations, multiple catalog splits, and a broad suite of analysis and modeling variations applied to both mocks and blinded observational data. We find that the BAO and AP parameters satisfy all validation requirements and remain stable across all tests. In contrast, mock studies reveal a significant bias in the inferred growth-rate parameter $fσ_8$, leading us to exclude this measurement from the final analysis. The consistency across mocks, data splits, and robustness tests demonstrates that the DR2 Ly$α$ full-shape analysis provides a reliable and substantially improved broadband AP measurement over previous Ly$α$ forest studies.

Herbold, M. [Chicago U., KICP; Ohio State U.] (ORC↗

DOE OSTI2023

Systematic Validation of Ensemble Cloud-Process Simulations using Polarimetric Radar Observations and Simulator over the NASA Wallops Flight Facility

The BiLateral Operational Storm-Scale Observation and Modeling (BLOSSOM) project was initiated to establish a long-term supersite to improve understanding of cloud physical states and processes as well as to support satellite and climate model programs over the WFF site via a bilateral approach of storm-scale observations and process modeling. This study highlights a noble systematic validation framework of the BLOSSOM ensemble cloud-process simulations through mixed-phase, light-rain, and deep-convective precipitation cases. The framework consists of creating a domain-shifted ensemble of large-scale forcing datasets, and configuring and performing cloud-process simulations with three different bulk microphysics schemes. Validation uses NASA S-band dual-POLarimetric radar (NPOL) observations in the form of statistical composites and skill scores via a polarimetric radar simulator and newly developed CfRad Data tool (CfRAD). While the simulations capture the overall structures of the reflectivity composites, polarimetric signals are still poorly simulated, mainly due to a lack of representation of ice microphysics diversity in shapes, orientation distributions, and their complex mixtures. Despite the limitation, this new ensemble-based validation framework demonstrates that 1) no particular forcing or microphysics scheme outperforms the rest and 2) the skill scores of coarse- and fine-resolution ensemble simulations with different domain-shifted forcing and microphysics schemes are highly correlated with each other with no clear improvement. On the other hand, this suggests that coarse-resolution ensemble simulations are relevant for selecting the best meteorological forcing and microphysics scheme before conducting computationally demanding large eddy simulations (LESs) in support of aircraft and satellite instrument development as well as cloud-precipitation-convection parameterizations.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

ORNL’s Continuing Efforts in Evaluating and Validating TSLs [Slides]

This presentation finds that INS measurements are not as variable based on sample composition, because phonon spectra is a properly of the bulk material. Additionally, INS and transmission measurements are and should be the most significant part of TSL validation, as they are the fundamental quantities used by Monte Carlo neutronics codes. This presentation reasons that relaying solely on theoretical atomistic calculations for TSL evaluation is not enough, they are highly dependent on inter-atomic potentials (which are not the most accurate depending on the quantity trying to be reproduced) and evaluators knowledge and understanding of the material being studied. Finally on Critical benchmarks, while extremely useful for validation of nuclear data at all energies, critical benchmarks are not the best tool to provide a definitive answer on conflicting TSLs. The presentation concludes that INS and transmission measurements need to be the basis of validation of TSLs.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗