Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “model evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 973 records · Page 54

Model Validation Database for Fires Involving Fuels at Liquefied Natural Gas Facilities (Version 2)

This document provides a description of the model evaluation protocol (MEP) database for fires involving liquefied natural gas (LNG) and processing fuels at LNG facilities. The purpose of the MEP is to provide procedures regarding the assessment of a model’s suitability to predict thermal exclusion zones resulting from a fire. The database includes measurements from pool fire, jet fire, and fireball experiments which are provided in a spreadsheet. Users are to enter model results into the spreadsheet which automatically generates statistical performance measures and graphical comparisons with the experimental data. The intent of this document is to provide a description of the experiments and of the procedure required to carry out the validation portion of the MEP. In addition, the statistical performance measures, measurements for comparisons, and parameter variation are provided.

03 NATURAL GAS↗

New Particle Formation Event Dataset at the Southern Great Plains (SGP) Observatory from 2018 to 2023

This data set contains observations of new particle formation (NPF) events collected at the U.S. Department of Energy’s Atmospheric Radiation Measurement (ARM) Southern Great Plains (SGP) observatory from 2018 to 2023. Measurements include particle number size distributions, radiance measurements, and associated meteorological variables from onsite instrumentation relevant for identifying and characterizing NPF events. Events were identified using standardized criteria and documented to support investigations of aerosol nucleation, growth dynamics, and their interactions with local atmospheric conditions. The data set provides a multi-year record that enables evaluation of seasonal and interannual variability in NPF occurrence and intensity at a mid-continental site. These data are intended to support studies of aerosol-cloud-climate interactions and model evaluation within both ARM and the broader atmospheric science community. More information can be found within the README_NPF_SGP_2018_2023.docx file.

event↗

Features of a SINDA/FLUINT model of a liquid oxygen supply line

The modeling features used in a steady-state heat transfer problem using SINDA/FLUINT are described. The problem modeled is a 125 feet long, 3 inch diameter pipe, filled with liquid oxygen flow driven by a given pressure gradient. The pipe is fully insulated in five sections. Three sections of 1 inch thick spray-on foam and two sections of vacuum jacket. The model evaluates friction, turns losses and convection heat transfer between the fluid and the pipe wall. There is conduction through the foam insulation with temperature dependent thermal conductivity. The vacuum space is modeled with radiation and gas molecular conduction, if present, in the annular gap. Heat is transferred between the outer surface and surrounding ambient by natural convection and radiation; and, by axial conduction along the pipe and through the vacuum jacket spacers and welded seal flanges. The model makes extensive use of SINDA/FLUINT basic capabilities such as the GEN option for nodes and conductors (to generate groups of nodes or conductors), the SIV option (to generate single, temperature varying conductors), the SIM option (for multiple, temperature varying conductors) and the M HX macros for fluids (to generate strings of lumps, paths, and ties representing a diabatic duct). It calls subroutine CONTRN (returns the relative location in the G-array of a network conductor, given an actual conductor number) enabling an extensive manipulation of conductor (calculates an assignment of their values) with DO loops. Models like this illustrate to the new and even to the old SINDA/FLUINT user, features of the program that are not so obvious or known, and that are extremely handy when trying to take advantage of both, the automation of the DATA headers and make surgical modifications to specific parameters of the thermal or fluid elements in the OPERATIONS portion of the model.

Simmonds, Boris G.↗

Business Case Analysis of the Towed Gilder Air Launched System (TGALS)

The Aerospace Corporation developed an integrated Business Case Analysis (BCA) model on behalf of the NASA Armstrong Flight Research Center (AFRC). This model evaluated the potential profitability of the Towed Glider Air Launched System (TGALS) concept, under development at AFRC, identifying potential technical, programmatic, and business decisions that could improve its business viability. The model addressed system performance metrics; development, production and operation cost estimates; market size and product service positioning; pricing alternatives; and market share.

TGALS↗

Evaluation of HEU-Beryllium Benchmark Experiments to Improve Computational Analysis of Space Reactors

An assessment was previously performed to evaluate modeling capabilities and quantify preliminary biases and uncertainties associated with the modeling methods and data utilized in designing a nuclear reactor such as a beryllium-reflected, highly-enriched-uranium (HEU)-O 2 fission surface power (FSP) system for space nuclear power. The conclusion of the previous study was that current capabilities could preclude the necessity of a cold critical test of the FSP; however, additional testing would reduce uncertainties in the beryllium and uranium cross-section data and the overall uncertainty in the computational models. A series of critical experiments using HEU metal were performed in the 1960s and 1970s in support of criticality safety operations at the Y-12 Plant. Of the hundreds of experiments, three were identified as fast-fission configurations reflected by beryllium metal. These experiments have been evaluated as benchmarks for inclusion in the International Handbook of Evaluated Criticality Safety Benchmark Experiments (IHECSBE). Further evaluation of the benchmark experiments was performed using the sensitivity and uncertainty analysis capabilities of SCALE 6. The data adjustment methods of SCALE 6 have been employed in the validation of an example FSP design model to reduce the uncertainty due to the beryllium cross section data.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Evaluating penalized logistic regression models to predict Heat-Related Electric grid stress days

Understanding the conditions associated with stress on the electricity grid is important in the development of contingency plans for maintaining reliability during periods when the grid is stressed. In this paper, heat-related grid stress and the relationship with weather conditions is examined using data from the eastern United States. Penalized logistic regression models were developed and applied to predict stress on the electric grid using weather data. The inclusion of other weather variables, such as precipitation, in addition to temperature improved model performance. Several candidate models and datasets were examined. A penalized logistic regression model fit at the operation-zone level was found to provide predictive value and interpretability. Additionally, the importance of different weather variables observed at different time scales were examined. Maximum temperature and precipitation were identified as important across all zones while the importance of other weather variables was zone specific. The methods presented in this work are extensible to other regions and can be used to aid in planning and development of the electrical grid.

Bramer, L. M.↗

Towards a flexible framework for community-wide ensemble forecasting tailored for major space environment impacts

To build continuously improving space weather predictive capabilities based on science and enable assessments and rapid implementations of advances in research into source-to-impact modelling systems we need: to assemble parts of the puzzle by solving problems focused on specific physical domains; to identify essential space environment quantities (ESEQs) passed between domains and linked to impacts; evaluate modeling capabilities for each ESEQ; connect all validated solutions from space weather origins on the sun to impacts on humans and critical infrastructure; to design displays for ensemble predictions tailored for major space weather user groups; to build a collaborative environment for efficient sharing of information and capabilities (models/data/expertise) and collaborative development. The presentation will overview existing community-wide space weather forecasting frameworks and research-to-operations pipelines and discuss opportunities to build a collaborative plug-and-play platform for interconnecting predictive capabilities developed under different space weather programs.

space weather↗

Towards A Flexible Framework for Community-Wide Ensemble Forecasting Tailored for Major Space Environment Impacts

To build continuously improving space weather predictive capabilities based on science and enable assessments and rapid implementations of advances in research into source-to-impact modelling systems we need: to assemble parts of the puzzle by solving problems focused on specific physical domains; to identify essential space environment quantities (ESEQs) passed between domains and linked to impacts; evaluate modeling capabilities for each ESEQ; connect all validated solutions from space weather origins on the sun to impacts on humans and critical infrastructure; to design displays for ensemble predictions tailored for major space weather user groups; to build a collaborative environment for efficient sharing of information and capabilities (models/data/expertise) and collaborative development. The presentation will overview existing community-wide space weather forecasting frameworks and research-to-operations pipelines and discuss opportunities to build a collaborative plug-and-play platform for interconnecting predictive capabilities developed under different space weather programs.

space weather↗

The impact of non-uniform thermal structure on the interpretation of exoplanet emission spectra

The determination of atmospheric structure and molecular abundances of planetary atmospheres via spectroscopy involves direct comparisons between models and data. While varying in sophistication, most model spectra comparisons fundamentally assume one-dimensional (1D) model physics. However, knowledge from general circulation models and of solar system planets suggests that planetary atmospheres are inherently three-dimensional in their structure and composition. We explore the potential biases resulting from standard “1D” assumptions within a Bayesian atmospheric retrieval framework. Specifically, we show how the assumption of a single 1D thermal profile can bias our interpretation of the thermal emission spectrum of a hot Jupiter atmosphere that is composed of two thermal profiles. We retrieve spectra of unresolved model planets as observed with a combination of the Hubble Space Telescope Wide Field Camera 3 (WFC3)+Spitzer Infrared Array Camera (IRAC) as well as the James Webb Space Telescope (JWST) under varying differences in the two thermal profiles. For WFC3+IRAC, there is a significantly biased estimate of CH{sub 4} abundance using a 1D model when the contrast is 80%. For JWST, two thermal profiles are required to adequately interpret the data and estimate the abundances when contrast is greater than 40%. We also apply this preliminary concept to the recent WFC3+IRAC phase curve data of the hot Jupiter WASP-43b. We see similar behavior as present in our simulated data: while the H{sub 2}O abundance determination is robust, CH{sub 4} is artificially well-constrained to incorrect values under the 1D assumption. Our work demonstrates the need to evaluate model assumptions in order to extract meaningful constraints from atmospheric spectra and motivates exploration of optimal observational setups.

79 ASTRONOMY AND ASTROPHYSICS↗

Recreating the California New Year's Flood Event of 1997 in a Regionally Refined Earth System Model

Abstract The 1997 New Year's flood event was the most costly in California's history. This compound extreme event was driven by a category 5 atmospheric river that led to widespread snowmelt. Extreme precipitation, snowmelt, and saturated soils produced heavy runoff causing widespread inundation in the Sacramento Valley. This study recreates the 1997 flood using the Regionally Refined Mesh capabilities of the Energy Exascale Earth System Model (RRM‐E3SM) under prescribed ocean conditions. Understanding the processes causing extreme events informs practical efforts to anticipate and prepare for such events in the future, and also provides a rich context to evaluate model skill in representing extremes. Three California‐focused RRM grids, with horizontal resolution refinement of 14 km down to 3.5 km, and six forecast lead times, 28 December 1996 at 00Z through 30 December 1996 at 12Z, are assessed for their ability to recreate the 1997 flood. Planetary to synoptic scale atmospheric circulations and integrated vapor transport are weakly influenced by horizontal resolution refinement over California. Topography and mesoscale circulations, such as the Sierra barrier jet, are better represented at finer horizontal resolutions resulting in better estimates of storm total precipitation and storm duration snowpack changes. Traditional time‐series and causal analysis frameworks are used to examine runoff sensitivities state‐wide and above major reservoirs. These frameworks show that horizontal resolution plays a more prominent role in shaping reservoir inflows, namely the magnitude and time‐series shape, than forecast lead time, 2‐to‐4 days prior to the 1997 flood onset.

54 ENVIRONMENTAL SCIENCES↗

Investigation of thermal-fluid mechanical characteristics of the capillary pump and the pumped two-phase loop

This first semi-annual report summarized progress made on NASA Goddard Space Flight Center (GSFC) Grant NAG 5-834 during the period September 1, 1986 to February 28, 1987. The goal of the project is to gain a better understanding of the transient behavior of the Capillary Pump Loop (CPL) developed and tested by the GSFC. The investigation is directed toward development of analytical models to represent the transient thermal-fluid mechanic processes occurring in different parts of the CPL engineering model. Evaluation of the available test data has been the starting point for the investigation. Based on results of this evaluation, supplementary tests will be conducted by using a CPL test system already operational in the Heat Transfer laboratory of the university. Of particular interest is the oscillatory behavior of the CPL engineering model exhibited during some of the earlier test runs conducted at NASA-GSFC and Johnson Space Center (JSC).

Kiper, Ali M.↗

Descent strategy comparisons for TNAV-equipped aircraft under airplane-preferred operating conditions

Three 4-D descent strategies were evaluated which were employed by TNAV-equipped aircraft in an advanced metering air traffic control environment. The Flow Management Evaluation Model (FMEM) was used to assess performance using three criteria when traffic enters the simulation under preferred cruise operating conditions (altitude and speed): throughput, fuel usage, and conflict probability. In comparison to an evaluation previously performed under NASA contract, the current analysis indicates that the optimal descent strategy is preferred over the clean-idle and constant descent angle (CFPA) strategies when all three criteria are considered.

Izumi, K. H.↗

Energy deposition and K-shell ionization of supernovae

We present explicit evaluation of K-shell ionization caused by photoelectric absorption, by Compton scattering, and by electron collisions in supernovae envelopes. Each process derives from the radioactivity that dominates the bolometric luminosity of the model supernovae. We include the ionization by bremsstrahlung. We find that electron-collision ionization with decelerating Compton electrons is the dominant process of K-shell ionization for light elements (lighter than Si) whereas photoelectric K-shell absorption of Comptonized gammas is the dominant process of K-shell ionization for heavy elements (like Fe). The relative importance of the ionization processes also depends upon composition and upon time, as well as upon supernova type. For Type Ia all four ionization sources are of importance. We present fitting formulas for the deposition of radioactive power in each class of models studied. The energy deposition of all mechanisms decreases with time, including the rate of K-shell ionizations of all elements throughout the supernovae model evaluated herein. We compare the relative contributions to the energy deposition and confirm with greater numerical detail results already established.

The, Lih-Sin↗

An Update on Global Satellite-Based Precipitation Products and Services at NASA GES DISC

The NASA Goddard Earth Sciences Data and Information Services Center (GES DISC) is home to major NASA satellite precipitation measurement missions including the Tropical Rainfall Measuring Mission (TRMM) and the Global Precipitation Measurement (GPM) as well as other NASA projects. Accurate and timely available global and regional precipitation products play an important role in research and applications around the world. The GES DISC provides near-real-time, near-global precipitation products (e.g.IMERG) to support a wide variety of interdisciplinary research and operational activities including flood modeling, landslides, crop monitoring and assessment, vector-borne diseases, etc. Climate data record products (e.g.GPCP3) are essential for climate research, assessment, model evaluation and applications. To facilitate data access and exploration, the GES DISC has developed data services such asGiovanni, an online visualization and analysis tool for easy access to over 2000 satellite- and model-based variables. Established in the mid 1980s, the GES DISC also distributes data in other disciplines including hydrology, atmospheric chemistry, atmospheric dynamics, etc. In this presentation, we will present an update on global precipitation products and data services including the new IMERG V06B suite, the latest version of GPCP (Version 3) and value-added data subsetting services (L34RS, L2S).

Liu, Zhong↗

Model of U3Si2 Fuel System using BISON Fuel Code

This research considers the proposed advanced fuel system: U3Si2 combined with an advanced cladding. U3Si2 has a number of advantageous thermophysical properties, which motivate its use as an accident tolerant fuel. This preliminary model evaluates the behavior of U3Si2 using available thermophysical data to predict the cladding-fuel pellet temperature and stress using the fuel performance code: BISON. The preliminary results obtained from the U3Si2 fuel model describe the mechanism of Pellet-Clad Mechanical Interaction for this system while more extensive testing including creep testing of U3Si2 is planned for improved understanding of thermophysical properties for predicting fuel performance.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Machine Learning in Nuclear Thermal Hydraulics, Part 2: Opportunities and Perspectives

This paper summarizes the issues in nuclear thermal hydraulics (NTH), mainly from the three named aspects, and illustrates potential opportunities of machine learning (ML) applications in dealing with these issues. These issues are problems in simultaneously realizing computational efficiency and accuracy of system thermal hydraulic (STH) modeling and simulation, uncertainty in the scaling analysis for the best-estimate calculations of transient and accident analysis, and difficulties in optimal data production and usage for the development and assessment of evaluation models. Due to ML uncertainty, data insufficiency, and lack of cognition about how to efficiently incorporate knowledge and data, challenges of adapting ML techniques still exist. Accordingly, several perspectives are proposed to provide insights for ML applications in solving these issues.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Simulation of Continental Shallow Cumulus Populations Using an Observation-Constrained Cloud-System Resolving Model

Continental shallow cumulus (ShCu) clouds observed on 30 August 2016 during the Holistic Interactions of Shallow Clouds, Aerosols, and Land-Ecosystems (HI-SCALE) field campaign are simulated by using an observation-constrained cloud-system resolving model. On this day, ShCu forms over Oklahoma and southern Kansas and some of these clouds transition to deeper, precipitating convection during the afternoon. We apply a four-dimensional ensemble-variational (4DEnVar) hybrid technique in the Community Gridpoint Statistical Interpolation (GSI) system to assimilate operational data sets and unique boundary layer measurements including a Raman lidar, radar wind profilers, radiosondes, and surface stations collected by the U.S. Department of Energy's (DOE) Atmospheric Radiation Measurement (ARM) Southern Great Plains (SGP) atmospheric observatory into the Weather Research and Forecasting (WRF) model to ascertain how improved environmental conditions can influence forecasts of ShCu populations and the transition to deeper convection. Independent observations from aircraft, satellite, as well as ARM's remote sensors are used to evaluate model performance in different aspects. Several model experiments are conducted to identify the impact of data assimilation (DA) on the prediction of clouds evolution. The analyses indicate that ShCu populations are more accurately reproduced after DA in terms of cloud initiation time and cloud base height, which can be attributed to an improved representation of the ambient meteorological conditions and the convective boundary layer. Extending the assimilation to 18 UTC (local noon) also improved the simulation of shallow-to-deep transitions of convective clouds.

54 ENVIRONMENTAL SCIENCES↗

Toward Improved Land Surface Initialization in Support of Regional WRF Forecasts at the Kenya Meteorological Department

Flooding and drought are two key forecasting challenges for the Kenya Meteorological Department (KMD). Atmospheric processes leading to excessive precipitation and/or prolonged drought can be quite sensitive to the state of the land surface, which interacts with the boundary layer of the atmosphere providing a source of heat and moisture. The development and evolution of precipitation systems are affected by heat and moisture fluxes from the land surface within weakly-sheared environments, such as in the tropics and sub-tropics. These heat and moisture fluxes during the day can be strongly influenced by land cover, vegetation, and soil moisture content. Therefore, it is important to represent the land surface state as accurately as possible in numerical weather prediction models. Enhanced regional modeling capabilities have the potential to improve forecast guidance in support of daily operations and high-end events over east Africa. KMD currently runs a configuration of the Weather Research and Forecasting (WRF) model in real time to support its daily forecasting operations, invoking the Nonhydrostatic Mesoscale Model (NMM) dynamical core. They make use of the National Oceanic and Atmospheric Administration / National Weather Service Science and Training Resource Center's Environmental Modeling System (EMS) to manage and produce the WRF-NMM model runs on a 7-km regional grid over eastern Africa. Two organizations at the National Aeronautics and Space Administration Marshall Space Flight Center in Huntsville, AL, SERVIR and the Short-term Prediction Research and Transition (SPoRT) Center, have established a working partnership with KMD for enhancing its regional modeling capabilities. To accomplish this goal, SPoRT and SERVIR will provide experimental land surface initialization datasets and model verification capabilities to KMD. To produce a land-surface initialization more consistent with the resolution of the KMD-WRF runs, the NASA Land Information System (LIS) will be run at a comparable resolution to provide real-time, daily soil initialization data in place of interpolated Global Forecast System soil moisture and temperature data. Additionally, real-time green vegetation fraction data from the Visible Infrared Imaging Radiometer Suite will be incorporated into the KMD-WRF runs, once it becomes publicly available from the National Environmental Satellite Data and Information Service. Finally, model verification capabilities will be transitioned to KMD using the Model Evaluation Tools (MET) package, in order to quantify possible improvements in simulated temperature, moisture and precipitation resulting from the experimental land surface initialization. The transition of these MET tools will enable KMD to monitor model forecast accuracy in near real time. This presentation will highlight preliminary verification results of WRF runs over east Africa using the LIS land surface initialization.

Case. Jonathan↗