Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “Evaluation Framework”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Calibration of Predictor Models Using Multiple Validation Experiments

This paper presents a framework for calibrating computational models using data from several and possibly dissimilar validation experiments. The offset between model predictions and observations, which might be caused by measurement noise, model-form uncertainty, and numerical error, drives the process by which uncertainty in the models parameters is characterized. The resulting description of uncertainty along with the computational model constitute a predictor model. Two types of predictor models are studied: Interval Predictor Models (IPMs) and Random Predictor Models (RPMs). IPMs use sets to characterize uncertainty, whereas RPMs use random vectors. The propagation of a set through a model makes the response an interval valued function of the state, whereas the propagation of a random vector yields a random process. Optimization-based strategies for calculating both types of predictor models are proposed. Whereas the formulations used to calculate IPMs target solutions leading to the interval value function of minimal spread containing all observations, those for RPMs seek to maximize the models' ability to reproduce the distribution of observations. Regarding RPMs, we choose a structure for the random vector (i.e., the assignment of probability to points in the parameter space) solely dependent on the prediction error. As such, the probabilistic description of uncertainty is not a subjective assignment of belief, nor is it expected to asymptotically converge to a fixed value, but instead it casts the model's ability to reproduce the experimental data. This framework enables evaluating the spread and distribution of the predicted response of target applications depending on the same parameters beyond the validation domain.

Crespo, Luis G.↗

Uncertainties in Isoprene Photochemistry and Emissions: Implications for the Oxidative Capacity of Past and Present Atmospheres and for Climate Forcing Agents

Current understanding of the factors controlling biogenic isoprene emissions and of the fate of isoprene oxidation products in the atmosphere has been evolving rapidly. We use a climate-biosphere-chemistry modeling framework to evaluate the sensitivity of estimates of the tropospheric oxidative capacity to uncertainties in isoprene emissions and photochemistry. Our work focuses on trends across two time horizons: from the Last Glacial Maximum (LGM, 21 000 years BP) to the preindustrial (1770s); and from the preindustrial to the present day (1990s). We find that different oxidants have different sensitivities to the uncertainties tested in this study, with OH being the most sensitive: changes in the global mean OH levels for the LGM-to-preindustrial transition range between -29 and +7, and those for the preindustrial-to-present day transition range between -8 and +17, across our simulations. Our results suggest that the observed glacial-interglacial variability in atmospheric methane concentrations is predominantly driven by changes in methane sources as opposed to changes in OH, the primary methane sink. However, the magnitudes of change are subject to uncertainties in the past isoprene global burdens, as are estimates of the change in the global burden of secondary organic aerosol (SOA) relative to the preindustrial. We show that the linear relationship between tropospheric mean OH and tropospheric mean ozone photolysis rates, water vapor, and total emissions of NOx and reactive carbon first reported in Murray et al. (2014) does not hold across all periods with the new isoprene photochemistry mechanism. Our results demonstrate that inadequacies in our understanding of present-day OH and its controlling factors must be addressed in order to improve model estimates of the oxidative capacity of past and present atmospheres.

methane↗

Comparison of Optimal Small Spacecraft Micro Electric Propulsion Technologies for Mission Opportunities

The goal of this paper is to explore the mission opportunities that are uniquely enabled by U-class Solar Electric Propulsion (SEP) technologies. Small SEP thrusters offers significant advantages relative to existing technologies and will revolutionize the class of mission architectures that small spacecraft can accomplish by enabling trajectory maneuvers with significant change in velocity requirements and reaction wheel-free attitude control. This paper aims to develop and apply a common system-level modeling framework to evaluate these thrusters for relevant upcoming mission scenarios, taking into account the mass, power, volume, and operational constraints of small highly-constrained missions. We will identify the optimal technology for broad classes of mission applications for different U-class spacecraft sizes and provide insights into what constrains the system performance to identify technology areas where improvements are needed.

Spangelo, Sara↗

A Geostationary Instrument Simulator for Aerosol Observing System Simulation Experiments

In the near future, there will be several new instruments measuring atmospheric composition from geostationary orbit over North America, East Asia, and Europe. This constellation of satellites will provide high resolution, time resolved measurements of trace gases and aerosols for monitoring air quality and tracking pollution sources. This paper describes a detailed, fast, and accurate (less than 1.0% uncertainty) method for calculating synthetic top of the atmosphere (TOA) radiances from a global simulation with a mesoscale free running model, the GEOS-5 Nature Run, for remote sensing instruments in geostationary orbit that measure in the ultraviolet-visible spectral range (UV-Vis). Generating these synthetic observations is the first step of an Observing System Simulation Experiment (OSSE), a framework for evaluating the impact of a new observation or algorithm. This paper provides details of the model sampling, aerosol and cloud optical properties, surface reflectance modeling, Rayleigh scattering calculations, and a discussion of the uncertainties of the simulated TOA radiance. An application for the simulated TOA radiance observations is demonstrated in the manuscript. Simulated TEMPO (Tropospheric Emissions: Monitoring of Pollution) and GOES-R (Geostationary Operational Environmental Satellites) observations were used to show how observations from the two instruments could be combined to facilitate aerosol type discrimination. The results demonstrate the viability of a detailed instrument simulator for radiance measurements in the UV-Vis that is capable of accurately simulating high resolution, time-resolved measurements with reasonable computational efficiency.

Castellanos, Patricia↗

Urban Area Unmanned Aerial Systems Sensor Capabilities for Ensuring Ground Hazards Safety

Unmanned aerial systems (UASs) in urban areas can pose significant safety risks to dynamic ground objects (DGOs) such as people, pets, and bikes; especially for off-nominal emergency traverses and landings. This paper will examine a framework for evaluating the UAS safety benefits which can be achieved by classifying DGO hazards, modeling their behavior, and assigning collision costs. DGOs are assumed to be any ground objects which are either moving or capable of moving. Safety benefits will be assessed by analyzing metrics computed from UAS and DGO trajectories which take into account intent and uncertainties. This paper will establish the theoretical relationships mapping these trajectories and DGO classifications to safety levels. Sensor capabilities will be mapped to DGO trajectory uncertainties, so that safety can be directly estimated from the sensor specifications for a given UAS trajectory.

Bouyssounouse, Xavier↗

Human Mars Entry, Descent and Landing Architecture Study: Deployable Decelerators

NASA’s Entry, Descent and Landing Architecture Study uses a trajectory simulation framework to evaluate various technologies and concepts of operations for human scale EDL at Mars. The study results inform agency technology investments. This paper summarizes the design assumptions and analysis of two deployable entry concepts performed in Phase 2 of the study. The entry concepts include a rigid deployable called the Adaptable Deployable Entry Placement Technology and an inflatable concept called the Hypersonic Inflatable Aerodynamic Decelerator. This paper describes the concept operations of these vehicles to deliver a 20-metric ton payload to the surface of Mars. Details of vehicle design and flight performance are summarized along with results of analysis on the aft body heating and its effect on the payload. Finally, recommended technology investments based on the results are presented.

Dwyer Cianciolo, Alicia↗

Mesh Effects on Flow Solutions for a 2-D Multi-Element Airfoil Using Structured Overset Methods

Current best-practices for mesh generation in a structured overset framework are evaluated to determine their effects on the accuracy and convergence of the flow solution on a two-dimensional sectional cut of the High-Lift Common Research Model (HLCRM) wing. Mesh parameters are varied independently and correlated with force and moment coefficients from the flow solutions to identify the trends and sensitivities of the parameter variations, and the characteristics of a best practice mesh. Grid convergence and mesh adaption studies are also performed to determine the minimum mesh quality needed in order for solution-based adaption to reach an accurate flow solution.

T^3↗

Development and Characterization of Lightweight Durable Composite Conductor for Cables

Sustainable aviation in the form of electrified propulsion is likely to lead to an increase in the electrical assets contained within a single aircraft. As a result, it is desirable to design light weight conductor materials, thus reducing the payload of components like motor windings, low voltage signal cables, and transmission cables for data and power. One approach involves replacing pure Cu wiring with metalized CNT composites. This paper evaluates a framework for modeling overall conductivity and current sharing within such composites. Processing methods and parameters were refined. Select electroplated samples outperformed pure Cu in conductivity and had comparable ultimate tensile strengths. Tensile strengths are expected to improve with an additional densification step during processing. Acoustic emission data was used to predict the failure mechanism of the composite. Theories explaining improved intrinsic conductivity are discussed, with a focus on chemical and mechanical interactions at the Cu-CNT interface. These include Cu infiltration of CNT crevices, CNT oxidation, activity at defects in CNT walls, and the release of carbide-forming metals from CNT walls. Validating any or all these theories will require further work replicating data, collecting electron micrographs and conducting chemical analyses.

Metalized CNT↗

Optical Performance Prediction of the Thirty Meter Telescope after Initial Alignment Using Optical Modeling

We present an estimate of the optical performance of the Thirty Meter Telescope (TMT) after execution of the full telescope alignment plan. The TMT alignment is performed by the Global Metrology System (GMS) and the Alignment and Phasing System (APS). The GMS first measures the locations of the telescope optics and instruments as a function of elevation angle. These initial measurements will be used to adjust the optics positions and build initial elevation look-up tables. Then the telescope is aligned using starlight as the input for the APS at multiple elevation angles. APS measurements are used to refine the telescope alignment to build elevation and temperature dependent look-up tables. Due to the number of degrees of freedom in the telescope (over 10,000), the ability of the primary mirror to correct aberrations on other optics, the tight optical performance requirements and the multiple instrument locations, it is challenging to develop, test and validate these alignment procedures. In this paper, we consider several GMS and APS operational scenarios. We apply the alignment procedures to the model-generated TMT, which consists of various quasi-static errors such as polishing errors, passive supports errors, thermal and gravity deformations and installation position errors. Using an integrated optical model and Monte-Carlo framework, we evaluate the TMT’s aligned states using optical performance metrics at multiple instrument and field of view locations. The optical performance metrics include the Normalized Point Source Sensitivity (PSSN), RMS wavefront error before and after Adaptive Optics (AO) correction, pupil position change, and plate scale distortion.

Rogers, John↗

Plant responses to rising vapor pressure deficit

Recent decades have been characterized by increasing temperatures worldwide, resulting in an exponential climb in vapor pressure deficit (VPD). VPD has been identified as an increasingly important driver of plant functioning in terrestrial biomes and has been established as a major contributor in recent drought‐induced plant mortality independent of other drivers associated with climate change. Despite this, few studies have isolated the physiological response of plant functioning to high VPD, thus limiting our understanding and ability to predict future impacts on terrestrial ecosystems. An abundance of evidence suggests that stomatal conductance declines under high VPD and transpiration increases in most species up until a given VPD threshold, leading to a cascade of subsequent impacts including reduced photosynthesis and growth, and higher risks of carbon starvation and hydraulic failure. Incorporation of photosynthetic and hydraulic traits in ‘next‐generation’ land‐surface models has the greatest potential for improved prediction of VPD responses at the plant‐ and global‐scale, and will yield more mechanistic simulations of plant responses to a changing climate. By providing a fully integrated framework and evaluation of the impacts of high VPD on plant function, improvements in forecasting and long‐term projections of climate impacts can be made.

mortality↗

Investigation of a Smooth Local Correlation-based Transition Model in a Discrete-Adjoint Aerodynamic Shape Optimization Algorithm

A smooth local correlation-based transition model is fully coupled to a RANS-based Newton-Krylov flow solver and discrete-adjoint gradient-based optimization algorithm. The free-transition optimization framework is evaluated using lift-constrained drag minimizations of airfoils at design conditions ranging from light to single-aisle aircraft and an infinite swept wing at design conditions representative of a transonic strut-braced wing aircraft. The impact of the streamwise grid resolution on the ability of the optimization algorithm to delay boundary-layer transition is investigated, with the results demonstrating that streamwise grid resolution requirements increase as the transition length decreases with increasing Reynolds number. The optimization problem at the light aircraft design conditions is demonstrated to be multi-modal, with the optimization algorithm producing two distinct designs: one with a thin, reflexed trailing edge and steep pressure recovery regions, the other with increased aft loading, with the latter design outperforming the former. A drag minimization of an airfoil at transonic design conditions demonstrates that the optimization algorithm successfully trades a decrease in viscous drag by delaying boundary-layer transition with an increase in wave drag, while the drag minimization of an infinite swept wing demonstrates the capability of the optimizational gorithm to delay both Tollmien-Schlichting and stationary crossflow instabilities.

AATT↗

Boulder County Disasters: Mapping Forest Carbon Stocks to Understand Carbon Implications of Treatment and Wildfire

In recent years, record-breaking wildfire activities in the western US illustrate the need for fire mitigation efforts, such as forest fuels reduction treatments. Forests serve as crucial carbon sinks that combat the increasing effects of climate change while fuels reduction treatments may remove carbon from forested systems. As a result, forest managers need to find a balance between fire mitigation and carbon preservation. This project partnered with Boulder County Parks and Open Space (BCPOS) and the University of Colorado, Denver to investigate the 2020 Cal-Wood fire in Boulder County, Colorado. Using remote sensing data from Landsat 8 OLI, SRTM, Sentinel-2 MSI, and LiDAR, we mapped post-fire forest carbon pools and compared these values with values derived from measurements from plots on the ground. Results indicate that the correlations are R2=0.76 for aboveground live carbon, R2=0.44 for standing carbon, and R2=0.43 for aboveground dead carbon (R2=0.43), and R2=0.35 for total carbon (R2=0.35). Additionally, 38.5% of total carbon was stored in dead carbon and 14.4% was stored in live carbon. We next compared the post-fire pools between treated and untreated areas. Our analysis suggests fuels reduction treatments did not reduce carbon loss in the presence of wildfire enough to clearly distinguish the post-fire carbon in the treated and untreated areas. However, our final carbon maps still provide BCPOS and researchers with an opportunity to explore carbon estimation models based on remotely sensed data as well as a framework to evaluate fuels reduction treatment effectiveness and impact on forest carbon stocks for future wildfire events.

Sarah Hettema↗

Photochemical Evolution of the 2013 California Rim Fire: Synergistic Impacts of Reactive Hydrocarbons and Enhanced Oxidants

Large wildfires markedly alter regional atmospheric composition, but chemical complexity challenges model predictions of downwind impacts. Here, we elucidate key facets of gas-phase photochemistry and assess novel chemical processes via a case study of the 2013 California Rim Fire plume. Airborne in situ observations, acquired during the NASA Studies of Emissions, Atmospheric Composition, Clouds and Climate Coupling by Regional Surveys (SEAC4RS) mission, illustrate the evolution of volatile organic compounds (VOC), oxidants, and reactive nitrogen over 12 hours of atmospheric aging. Measurements show rapid formation of ozone and peroxyacyl nitrates (PNs), sustained peroxide production, and prolonged enhancements in oxygenated VOC and nitrogen oxides (NOX). Measurements and Lagrangian trajectories constrain a 0-D puff model that approximates plume photochemical history and provides a framework for evaluating key processes. Simulations examine the effects of 1) previously-unmeasured reactive VOC identified in recent laboratory studies, and 2) emissions and secondary production of nitrous acid (HONO). Inclusion of estimated unmeasured VOC leads to a 250% increase in OH reactivity and a 70% increase in radical production via oxygenated VOC photolysis. HONO amplifies radical cycling and serves as a downwind NOX source, although two different HONO production mechanisms (particulate nitrate photolysis and heterogeneous NO2 conversion) exhibit markedly different effects on ozone, NOX, and PNs. Analysis of radical initiation rates suggests that oxygenated VOC photolysis is a major radical source, exceeding HONO photolysis when averaged over the first 2 hours of aging. Ozone production chemistry transitions from VOC-sensitive to NOX-sensitive within the first hour of plume aging, with both peroxide and organic nitrate formation contributing significantly to radical termination. To simulate smoke plume chemistry accurately, models should simultaneously account for the full reactive VOC pool and all relevant oxidant sources.

SEAC4RS↗

Mapping Forest Carbon Stocks to Understand Carbon Implications of Treatment on Wildfire for the Calwood Fire, Boulder County Colorado

Recent, record-breaking wildfire activity in the western U.S. illustrates the need for fire mitigation, such as forest fuels reduction treatments. Forests serve as crucial carbon sinks that combat the increasing effects of climate change, but fuels reduction treatments may remove carbon from forested systems. As a result, forest managers need to find a balance between fire mitigation and carbon preservation. This project partnered with Boulder County Parks and Open Space (BCPOS) and the University of Colorado, Denver to investigate the 2020 Cal-Wood fire in Boulder County, Colorado. Using remote sensing data from Landsat 8 Operational Land Imager, Shuttle Radar Topography Mission, Sentinel-2 MultiSpectral Imagery, and LiDAR, we mapped post-fire forest carbon pools and compared these values with values derived from field measurements. The analysis suggested that fuels reduction treatments did not reduce carbon loss in the presence of wildfire enough to clearly distinguish post-fire carbon between treated and untreated areas. However, the final carbon maps provide BCPOS and researchers with an opportunity to explore carbon estimation models based on remote sensing data as well as a framework to evaluate fuels reduction treatment effectiveness and impact on forest carbon stocks for future wildfire events.

Sarah Hettema↗

QuARC: Development of a Service to Enable FAIR-er Metadata

The ARC Project: The ARC Team located at NASA’s Marshall Space Flight Center conducts quality assessments of metadata records that catalog NASA’s collection of over 9,000 Earth observation data products, stored in a centralized database called the Common Metadata Repository (CMR). The ARC Team has developed a metadata quality assessment framework to evaluate metadata completeness, correctness, and consistency with the goal of making NASA’s data products more discoverable, accessible, and usable. ARC = Analysis and Review of the CMR

Earth Science Informatics↗

The Impact and Estimation of Uncertainty Correlation for Multi-Angle Polarimetric Remote Sensing of Aerosols and Ocean Color

Multi-angle polarimetric (MAP) measurements contain rich information for characterization of aerosol microphysical and optical properties that can be used to improve atmospheric correction in ocean color remote sensing. Advanced retrieval algorithms have been developed to obtain multiple geophysical parameters in the atmosphere-ocean system, although uncertainty correlation among measurements is generally ignored due to lack of knowledge on its strength and characterization. In this work, we provide a practical framework to evaluate the impact of the angular uncertainty correlation from retrieval results and a method to estimate correlation strength from retrieval fitting residuals. The Fast Multi-Angular Polarimetric Ocean coLor (FastMAPOL) retrieval algorithm, based on neural network forward models, is used to conduct the retrievals and uncertainty quantification. In addition, we also discuss a flexible approach to include a correlated uncertainty model in the retrieval algorithm. The impact of angular correlation on retrieval uncertainties is discussed based on synthetic AirHARP and HARP2 measurements using a Monte Carlo uncertainty estimation method. Correlation properties are estimated using auto-correlation functions based on the fitting residuals from both synthetic AirHARP and HARP2 data and real AirHARP measurement, with the resulting angular correlation parameters found to be larger than 0.9 and 0.8 for reflectance and DoLP, respectively, which correspond to correlation angles of 10° and 5°. Although this study focuses on angular correlation from HARP instruments, the methodology to study and quantify uncertainty correlation is also applicable to other instruments with angular, spectral, or spatial correlations, and can help inform laboratory calibration and characterization of the instrument uncertainty structure.

PACE↗

A Methodology for Estimating the Energy and Moisture Budget of the Convective Boundary Layer Using Continuous Ground-Based Infrared Spectrometer Observations

Land-atmosphere interactions play a critical role in both the atmospheric water and energy cycles. Changes in soil moisture and vegetation alter the partitioning of surface water and energy fluxes, influencing diurnal evolution of the planetary boundary layer (PBL). The mixing diagram framework has proven useful in understanding the evolution of the heat and moisture budget within the convective boundary layer (CBL). We demonstrate that observations from the Department of Energy Atmospheric Radiation Measurement (ARM) Southern Great Plains (SGP) site provide all of the needed inputs needed for the mixing diagram framework, allowing us to quantify the impact from the surface fluxes, advection, radiative heating, encroachment, and entrainment on the evolution of the CBL. Profiles of temperature and humidity retrieved from the ground-based infrared spectrometer (called the Atmospheric Emitted Radiance Interferometer, or AERI) are a critical component in this analysis. Large eddy simulation results demonstrate that mean mixed-layer values derived are shown to be critical to close the energy and moisture budgets. A novel approach demonstrated here is the use of network of AERIs and Doppler lidars to quantify the advective fluxes of heat and moisture. The framework enables the estimation of the entrainment fluxes as a residual, providing a way to observe the entrainment fluxes without using multiple lidar systems. Finally, the high temporal resolution of the AERI observations enable the morning, midday, and afternoon evolution of the CBL to be quantified. This work provides a new way to use observations in this framework to evaluate weather and climate models.

Boundary layer↗

Climate Scenarios and Reality

Progress on the important issue of climate change requires a framework for evaluating the likely consequences of different courses of action. Science can powerfully inform public decisions on energy systems, infrastructure, and economic policy when researchers explore, using the best available evidence, a range of possible futures using emissions scenarios. The process of constructing, describing, and using these scenarios is challenging for many reasons. The continued evolution and improvement of emissions scenarios is an important element of the future of climate-change research. But in “How Climate Scenarios Lost Touch With Reality” (Issues, Summer 2021), Roger Pielke Jr. and Justin Ritchie are wildly off base in declaring that the “misuse of scenarios in climate research has become pervasive and consequential—so much so that we view it as one of the most significant failures of scientific integrity in the twenty-first century thus far.”

climate change↗