Results for “sensitivity study” — Page 90

NASA NTRS2015

The Ocean Colour Climate Change Initiative: I. A Methodology for Assessing Atmospheric Correction Processors Based on In-Situ Measurements

The Ocean Colour Climate Change Initiative intends to provide a long-term time series of ocean colour data and investigate the detectable climate impact. A reliable and stable atmospheric correction procedure is the basis for ocean colour products of the necessary high quality. In order to guarantee an objective selection from a set of four atmospheric correction processors, the common validation strategy of comparisons between in-situ and satellite derived water leaving reflectance spectra, is extended by a ranking system. In principle, the statistical parameters such as root mean square error, bias, etc. and measures of goodness of fit, are transformed into relative scores, which evaluate the relationship of quality dependent on the algorithms under study. The sensitivity of these scores to the selected database has been assessed by a bootstrapping exercise, which allows identification of the uncertainty in the scoring results. Although the presented methodology is intended to be used in an algorithm selection process, this paper focusses on the scope of the methodology rather than the properties of the individual processors.

Climate Change↗

NASA NTRS2018

Entry, Descent, and Landing Performance for a Mid-Lift-to-Drag Ratio Vehicle at Mars

In an effort to mature the design of the Mid-Lift-to-Drag ratio Rigid Vehicle (MRV) candidate of the NASA Evolvable Mars Campaign (EMC) architecture study, end-to-end six-degree-of-freedom (6DOF) simulations are needed to ensure a successful entry, descent, and landing (EDL) design. The EMC study is assessing different vehicle and mission architectures to determine which candidate would be best to deliver a 20 metric ton payload to the surface of Mars. Due to the large mass payload and the relatively low atmospheric density of Mars, all candidates of the EMC study propose to use Supersonic Retro-Propulsion (SRP) throughout the descent and landing phase, as opposed to parachutes, in order to decelerate to a subsonic touchdown. This paper presents a 6DOF entry-to-landing performance and controllability study with sensitivities to dispersions, particularly in the powered descent and landing phases.

mars↗

NASA NTRS2019

Uncertainty in Soil Moisture Retrievals: an Ensemble Approach Using SMOS L-Band Microwave Data

The uncertainty of soil moisture (SM) retrievals from satellite brightness temperature (TB) observations depends primarily on the choice of radiative transfer model (RTM) parameters, prior SM information and TB inputs. This paper studies the sensitivity of several (quasi-)operational and experimental SM retrieval products from the Soil Moisture Ocean Salinity (SMOS) mission to these choices at 11 reference sites, located in 7 watersheds across the United States (US). Different literature-based RTM parameter sets cause large biases between retrievals. Whereas typical RTM parameter sets are calibrated for SM retrievals, it is shown that a parameter set carefully optimized for TB forward modeling can also be used for retrieving SM. It is also shown that the inclusion of dynamic prior SM estimates in a Bayesian retrieval scheme can strongly improve SM retrievals, regardless of the choice of RTM parameters, and that the use of multi-angular and multi-polarization TB does not necessarily lead to superior retrievals compared to retrievals based on TB data at a single incidence angle and polarization. The second part of this paper evaluates ensemble uncertainty metrics for SM retrievals obtained by propagating a wide range of RTM parameters through the RTM. As expected for bounded variables, the spread in the ensemble SM retrievals is smallest for wet and dry SM values and highest for intermediate SM values. After removal of the strong long-term mean bias associated with the RTM parameter values for individual ensemble members, the remaining anomaly ensemble SM spread of 0.037 cu m/cu m approximates the actual time series unbiased root-mean-square-difference of 0.042 cu m/cu m between ensemble mean retrievals and in situ reference data across the reference sites. However, the temporal variability in the anomaly ensemble spread reveals higher-order biases in the retrieval error, which should be accounted for when characterizing retrieval error.

Jan Quets↗

NASA NTRS2019

Accrued Delay Application in Trajectory-Based Operations

The air traffic management system lacks integration among its elements often due to using inconsistent information, models, and metrics about the traffic. Transitioning to trajectory-based operations, whereby flights are managed by full trajectories in space and time, will enable more integration, with the help of increased automation. Building on trajectory-based operations, an "accrued delay" metric is proposed, which continuously measures the amount of delay that a flight has accumulated up to the current time, including delays incurred during the current flight and inherited from previous flights through the turnaround process. Through a time-based metering and scheduling example, we show how using accrued delay as a metric can help integrate the decision-making across multiple decision horizons, leading to more efficient and balanced access to airspace services. We show that when prioritizing flights that have already accrued high delay because of a constrained runway resource, significant gains are achieved in terms of reducing total delay and its variance. We studied the sensitivity of these gains to numerous factors, such as time-based versus distance-based horizons, horizon size, and errors in conformance to scheduled times.

delay; trajectory-based operations; time-based flo↗

NASA NTRS2019

Accrued Delay Application in Trajectory-Based Operations

The air traffic management system lacks integration among its elements often due to using inconsistent information, models, and metrics about the traffic. Transitioning to trajectory-based operations, whereby flights are managed by full trajectories in space and time, will enable more integration, with the help of increased automation. Building on trajectory-based operations, an "accrued delay" metric is proposed, which continuously measures the amount of delay that a flight has accumulated up to the current time, including delays incurred during the current flight and inherited from previous flights through the turnaround process. Through a time-based metering and scheduling example, we show how using accrued delay as a metric can help integrate the decision-making across multiple decision horizons, leading to more efficient and balanced access to airspace services. We show that when prioritizing flights that have already accrued high delay because of a constrained runway resource, significant gains are achieved in terms of reducing total delay and its variance. We studied the sensitivity of these gains to numerous factors, such as time-based versus distance-based horizons, horizon size, and errors in conformance to scheduled times.

Idris, Husni↗

NASA NTRSDate not supplied

TPSAS-NF1676L-20735-DND

Higher than normal accuracy is required to rigorously observe decadal climate change. But what level is needed? How can this be quantified? This presentation will summarize a new more rigorous and quantitative approach to determining the required accuracy for climate change observations (Wielicki et al., 2013, BAMS). Most current global satellite observations cannot meet this accuracy level. A proposed new satellite mission to resolve this challenge is CLARREO (Climate Absolute Radiance and Refractivity Observatory). CLARREO is designed to achieve advances of a factor of 10 for reflected solar spectra and a factor of 3 to 5 for thermal infrared spectra (Wielicki et al., Oct. 2013 BAMS). The CLARREO spectrometers are designed to serve as SI traceable benchmarks for the Global Satellite Intercalibration System (GSICS) and to greatly improve the utility of a wide range of LEO and GEO infrared and reflected solar passive satellite sensors for climate change observations (e.g. CERES, MODIS, VIIIRS, CrIS, IASI, Landsat, SPOT, etc). Providing more accurate decadal change trends can in turn lead to more rapid narrowing of key climate science uncertainties such as cloud feedback and climate sensitivity. A study has been carried out to quantify the economic benefits of such an advance as part of a rigorous and complete climate observing system. The study concludes that the economic value is ~ $12 Trillion U.S. dollars in Net Present Value for a nominal discount rate of 3% (Cooke et al. 2013, J. Env. Sys. Dec.). A brief summary of these two studies and their implications for the future of climate science will be presented.

Bruce Wielicki↗

NASA NTRSDate not supplied

TPSAS-NF1676L-10726-DND

The principal component radiative transfer model PCRTM (Xu 2006) simulates spectral longwave radiance at a 0.5cm-1 resolution over the wavelengths (50-2760cm-1) using 280 principal components. The CERES product SSF containing CERES field-of-view (FOV) cloud properties based on MODIS pixel information are used as inputs. NASA GMAO(Global Modeling and Assimilation Office)Geos-4 temperature and humidity profiles, as well as SMOBA (Stratosphere Monitoring Ozone Blended Analysis) ozone profiles allow computations for five years (Jan 2001- Dec 2006) of FOV nadir spectral radiance. The approximately twice daily FOV PCRTM simulations along with CERES broadband measurements are time-space averaged to 10deg zonal monthly data. Analysis of monthly seasonal and deseasonalized interannual variability in terms of brightness temperature are presented. Comparison of interannual variability in the portions of the spectrum seen by the AIRS instrument are shown. Comparisons of spectral integrated PCRTM simulations to CERES broadband longwave radiance measurements are made. In order to study the sensitivity of the spatially and temporally averaged TOA spectrum to various atmospheric properties, we perturbed atmospheric and surface temperatures, humidity, cloud height, cloud fraction, and particle size. The sensitivity of the spectrum to these properties depends on region and seasons. Month to month variability of the longwave spectra to these perturbations is 10 to 20% of the global monthly mean perturbation response. In addition, it depends on time period and size of the area used for averaging spectra. In this poster, the magnitude of sensitivity variability and how the sensitivity changes depending on temporal and spatial scale of averaging will be discussed.

Fred G. Rose↗

NASA NTRSDate not supplied

Integrated Crewed Mars Mission Analysis, Part II: The Trajectory Strikes Back

Crewed missions to Mars present a challenging problem involving strong interactions between a variety of spacecraft systems. Design and architecture decisions made by one system can have powerful implications for another. Siloed subsystem development and optimization efforts are unlikely to generate optimal results for the integrated system and may lead to counterproductive investments at the mission and system level. Mismatched assumptions between different subsystems can also negatively impact the final result. Integrated systems analysis, trade studies, and sensitivity analysis are a critical element of successful Mars mission design. Previous work examined the linkages between Environmental Control and Life Support System (ECLSS) loop closure, food water content, spares Probability of Sufficiency (POS), and other factors by performing an integrated mass and cost assessment of a variety of Mars habitat and transportation system designs. This paper expands upon that work by evaluating the impact of mission duration, trajectory, and propulsion technology alongside key habitat variables. Transportation system and trajectory design decisions have enormous impacts on overall system mass, and the impacts of those decisions are themselves sensitive to the mass of the habitat that is being transported. This paper examines a variety of mission cases and evaluates total departure mass for each case. An estimate of relative costs for specific cases is also provided. The results are discussed, with an emphasis on the sensitivity of mass, cost, and other figures of merit to key parameters. Interactions and dependencies between various decisions, particularly those that relate to technology investments, are also highlighted. Overall, the various elements, systems, and subsystems required to support human spaceflight should not be optimized and evaluated in isolation, but instead should be analyzed as part of an integrated system. This paper demonstrates how integrated analysis can improve system understanding and lead to more optimal and effective crewed exploration systems.

Human Spaceflight↗

NASA NTRSDate not supplied

Integrated Crewed Mars Mission Analysis, Part II: The Trajectory Strikes Back

Crewed missions to Mars present a challenging problem involving strong interactions between a variety of spacecraft systems. Design and architecture decisions made by one system can have powerful implications for another. Siloed subsystem development and optimization efforts are unlikely to generate optimal results for the integrated system and may lead to counterproductive investments at the mission and system level. Mismatched assumptions between different subsystems can also negatively impact the final result. Integrated systems analysis, trade studies, and sensitivity analysis are a critical element of successful Mars mission design. Previous work examined the linkages between Environmental Control and Life Support System (ECLSS) loop closure, food water content, spares Probability of Sufficiency (POS), and other factors by performing an integrated mass and cost assessment of a variety of Mars habitat and transportation system designs. This paper expands upon that work by evaluating the impact of mission duration, trajectory, and propulsion technology alongside key habitat variables. Transportation system and trajectory design decisions have enormous impacts on overall system mass, and the impacts of those decisions are themselves sensitive to the mass of the habitat that is being transported. This paper examines a variety of mission cases and evaluates total departure mass for each case. An estimate of relative costs for specific cases is also provided. The results are discussed, with an emphasis on the sensitivity of mass, cost, and other figures of merit to key parameters. Interactions and dependencies between various decisions, particularly those that relate to technology investments, are also highlighted. Overall, the various elements, systems, and subsystems required to support human spaceflight should not be optimized and evaluated in isolation, but instead should be analyzed as part of an integrated system. This paper demonstrates how integrated analysis can improve system understanding and lead to more optimal and effective crewed exploration systems.

Human Spaceflight↗

NASA NTRS2022

Vicarious Calibration of the Long Near Infrared Band: Cross-Sensor Differences in Sensitivity

Numerous assumptions and approximations are employed when translating satellite-derived radiance to surface remote sensing reflectance (RRS) for ocean color applications. Among these is the vicarious calibration coefficient (g) of the “long” near infrared band (NIRL) used for atmospheric correction. For this band, the prelaunch calibration has always been deemed sufficient [thus g(NIRL) = 1.00] as long as other bands are vicariously calibrated. Recent research, however, suggests that Moderate Resolution Imaging Spectroradiometer (MODIS)/Aqua RRS time series is quite sensitive to g(NIRL) (and associated vicarious gains in other bands). In this work, we assessed the sensitivity of Visible Infrared Imaging Radiometer Suite onboard the Suomi National Polar-orbiting Partnership satellite (VIIRS/SNPP) RRS to NIRL calibration and compared our results to previous MODIS/Aqua and Sea-viewing Wide Field-of-View Sensor onboard OrbView2 (SeaWiFS)/OrbView2 analysis. In doing so, we note that g(NIRL) sensitivities of mission-averaged RRS time series are lower for VIIRS and Sea-WiFS, relative to MODIS. At the scale of monthly climatologies (MCs), however, all sensors show prominent g(NIRL) sensitivity with that of SeaWiFS being the most substantial. These findings informed simulation analyses, whereby we identified signal-tonoise ratio (SNR) and radiant path geometry, as well as their interaction, as having notable impacts on g(NIRL) sensitivity. As such, g(NIRL) sensitivity is a necessary consideration for reflectance uncertainty budgets, especially for sensors with higher NIR SNR or particular prevailing radiant path geometries. Given the geometry components embedded within g(NIRL) sensitivity, such studies should be coupled with cross-sensor intercalibrations [e.g., using simultaneous same view (SSV) measurements] toward minimizing NIRL errors between satellite instruments, but such efforts will not completely remediate remaining cross-sensor biases in RRS. Index Terms—Moderate Resolution Imaging Spectroradiometer (MODIS)/Aqua, ocean color, ocean gyres, Sea-viewing Wide Field-of-View Sensor onboard OrbView2 (SeaWiFS), system vicarious calibration (SVC), Visible Infrared Imaging Radiometer Suite onboard the Suomi National Polar-orbiting Partnership satellite (VIIRS/SNPP).

MODIS↗

NASA NTRS2022

Vicarious Calibration of the Long Near Infrared Band: Cross-Sensor Differences in Sensitivity

Numerous assumptions and approximations are employed when translating satellite-derived radiance to surface remote sensing reflectance (RRS) for ocean color applications. Among these is the vicarious calibration coefficient (g) of the ‘long’ near infrared band (NIRL) used for atmospheric correction. For this band, the pre-launch calibration has always been deemed sufficient [thus g(NIRL) = 1.00] as long as other bands are vicariously calibrated. Recent research, however, suggests that MODIS/Aqua RRS time series are quite sensitive to g(NIRL) (and associated vicarious gains in other bands). In this work, we assessed the sensitivity of VIIRS/SNPP RRS to NIRL calibration, and compared our results to previous MODIS/Aqua and SeaWiFS/OrbView2 analysis. In doing so, we note g(NIRL) sensitivities of mission-averaged RRS timeseries are lower for VIIRS and SeaWiFS, relative to MODIS. At the scale of monthly climatologies, however, all sensors show prominent g(NIRL) sensitivity, with that of SeaWiFS being the most substantial. These findings informed simulation analyses, whereby we identified signal-to-noise ratio (SNR) and radiant path geometry, as well as their interaction, as having notable impacts on g(NIRL) sensitivity. As such, g(NIRL) sensitivity is a necessary consideration for reflectance uncertainty budgets, especially for sensors with higher NIR SNR or particular prevailing radiant path geometries. Given the geometry components embedded within g(NIRL) sensitivity, such studies should be coupled with cross-sensor intercalibrations (e.g., using simultaneous same view measurements) toward minimizing NIRL errors between satellite instruments, but such efforts will not completely remediate remaining cross-sensor biases in RRS.

Brian B Barnes↗

NASA NTRS2022

An Analysis of the Impact of Extreme Attitude Operation on a Turbofan Engine in a Regional Jet Aircraft

The objective of this work is to characterize the variability in engine performance at extreme attitudes, resulting from the use of different standard control variables, evaluated at different points in the engine’s lifecycle. This paper describes the procedure used to create a dynamic model of an aft-mounted jet engine on a T-tail regional jet aircraft. This model enables simulation of engine operation at extreme attitudes. The model was subsequently evaluated at various altitudes, Mach numbers, and power settings over a range of angles of attack and sideslip, and deterioration levels. Each case was simulated using both fan speed and engine pressure ratio as the engine control variable. The results show that the wing has a very large impact on the engine operation, overwhelming other sources of variation.

loss of control - inflight↗

NASA NTRSDate not supplied

The Porous Microstructure Analysis (PuMA) software

The open-source Porous Microstructure Analysis (PuMA) software was implemented to offer an efficient framework for determining material characteristics from 3D microstructures. Its development was inspired by progress in X-ray microtomography, an imaging technology that captures the internal structure of materials in 3D, and even in a 4D temporal context. Over recent years, this method has transformed the domain of materials science due to its capability to non-destructively examine material microstructures while presenting digital data about their geometrical details. It has provided insights into materials relevant to several NASA missions, including heatshields, parachute fabrics, meteorites, and other advanced composites. PuMA, in its current version 3, delivers an array of features, spanning from basic geometric insights of a microstructure to intricate anisotropic thermo-elastic and chemical behavior. Specifically, the software evaluates morphological attributes (specific surface area, volume fractions, mean intercept lengths, orientation) and physical characteristics (conductivity, elasticity, permeability, and tortuosity). Additionally, it can model material degradation processes, such as oxidation and surface chemistry interactions. The software can generate synthetic microstructures, from straightforward geometrical designs to intricate woven and non-woven geometries. Coupling material generation and characterization enable parametric studies and sensitivity analysis to optimize the microstructural performance and inform design decisions and reliability assessment based on uncertainty quantification. A recent addition to PuMA includes the TomoSAM plugin, devised to incorporate the cutting-edge Segment Anything Model (SAM). SAM is a promptable deep learning model that can identify objects and create image masks in a zero-shot manner, based only on a few user clicks. The synergy between these tools aids in the segmentation of complex 3D datasets from tomography or other imaging techniques, which would otherwise require a laborious manual segmentation process.

Tomography↗

NASA NTRSDate not supplied

The Porous Microstructure Analysis (PuMA) software

The open-source Porous Microstructure Analysis (PuMA) software was created to offer an efficient framework for determining material properties from 3D microstructures. Its development was inspired by progress in X-ray microtomography, an imaging technology that captures the internal structure of materials in 3D, and even in a 4D temporal context. Over recent years, this method has transformed the domain of materials science due to its capability to non-destructively examine material microstructures while presenting digital data about their geometrical details. It has provided insights into materials relevant to several NASA missions, including heatshields, parachute fabrics, meteorites, and other advanced composites. PuMA, in its current version 3, delivers an array of features, spanning from basic geometric insights of a microstructure to intricate anisotropic thermo-elastic and chemical behavior. Specifically, the software evaluates morphological attributes (specific surface area, volume fractions, mean intercept lengths, orientation) and physical characteristics (conductivity, elasticity, permeability, and tortuosity). Additionally, it can model material degradation processes, such as oxidation and surface chemistry interactions. The software can generate synthetic microstructures, from straightforward geometrical designs to intricate woven and non-woven geometries. Coupling material generation and characterization enables parametric studies and sensitivity analysis to optimize the microstructural performance and inform design decisions and reliability assessment based on uncertainty quantification. A recent addition to PuMA includes the TomoSAM plugin, devised to incorporate the cutting-edge Segment Anything Model (SAM) into our image segmentation workflow. SAM is a promptable deep learning model that can identify objects and create image masks in a zero-shot manner, based only on a few user clicks. The synergy between these tools aids in the segmentation of complex 3D datasets from tomography and other imaging techniques, which would otherwise require a laborious manual segmentation process.

Tomography↗

NASA NTRSDate not supplied

Mission Planning and Trajectory Design of Roundtrip Mars Transfers

NASA’s Exploration Systems Development Mission Directorate has been evaluating architecture concepts that can deliver crew and cargo to Mars vicinity and return the crew safely back to Earth. A series of trade studies and sensitivity analyses are performed to explore the trade space in an effort to inform the decision of the transportation architecture for future human missions to Mars. This paper documents the tools and methods used to perform mission scans for systems that use high-thrust propulsion and provides discussion on some interesting challenges for the roundtrip transportation architecture. Results for the reference trajectories from the current analysis cycle are presented.

Mars↗

NASA NTRSDate not supplied

Mission Planning and Trajectory Design of Roundtrip Mars Transfers

NASA’s Exploration Systems Development Mission Directorate has been evaluating architecture concepts that can deliver crew and cargo to Mars vicinity and return the crew safely back to Earth. A series of trade studies and sensitivity analyses are performed to explore the trade space in an effort to inform the decision of the transportation architecture for future human missions to Mars. This paper documents the tools and methods used to perform mission scans for systems that use high-thrust propulsion and provides discussion on some interesting challenges for the roundtrip transportation architecture. Results for the reference trajectories from the current analysis cycle are presented.

Mars↗

NASA NTRSDate not supplied

Considerations for Optimal Sensor Placement for Higher Accuracy Object Localization for Urban Air Mobility

Previous research into object localization has shown that sensor placement and alignment plays an important role in achieving higher accuracy levels of the estimated location of a tracked Urban Air Mobility Vehicle. In general, a near-orthogonal intersection between the ground node observation vectors results in the highest accuracy due to a smaller overlapping uncertainty region between both. This applies to triangulation by means of ground node camera angle observations as well as trilateration by means of ground node distance measurements. However, this simple concept is not easily fulfilled with a network of a limited number of static ground nodes and a moving object to be localized. This case study performs sensitivity analyses and explores practical ways on how to achieve higher estimate accuracy levels in this context.

sensor placement↗

NASA NTRS2025

Considerations for Optimal Sensor Placement for Higher Accuracy Object Localization for Urban Air Mobility

Previous research into object localization has shown that sensor placement and alignment plays an important role in achieving higher accuracy levels of the estimated location of a tracked Urban Air Mobility Vehicle. In general, a near-orthogonal intersection between the ground node observation vectors results in the highest accuracy due to a smaller overlapping uncertainty region between both. This applies to triangulation by means of ground node camera angle observations as well as trilateration by means of ground node distance measurements. However, this simple concept is not easily fulfilled with a network of a limited number of static ground nodes and a moving object to be localized. This case study performs sensitivity analyses and explores practical ways on how to achieve higher estimate accuracy levels in this context.

sensor placement↗