SEARCH · Engineering Papers

Results for “Validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 721 records · Page 40

All sources NASA NTRS DOE OSTI

NASA NTRS2007

Thermal Design Validation of the Mars Scout Phoenix Payload

This slide presentation reviews the validation of the thermal design for the Mars Scout Phoenix Payload. It includes a description of the Phoenix Mission, the science objectives, the timeline, and the flight system and payloads that were on the lander. The initial responsibility for the development and validation the thermal design was with the developers. This process lacked overall system engineering, there was a difference of thermal expertise, and the number of institutions involved complicated the interactions. The revised approach for payload thermal design validation is described.

thermal design validation↗

NASA NTRS2014

Retrieval, Inter-Comparison, and Validation of Above-Cloud Aerosol Optical Depth from A-train Sensors

Absorbing aerosols produced from biomass burning and dust outbreaks are often found to overlay lower level cloud decks and pose greater potentials of exerting positive radiative effects (warming) whose magnitude directly depends on the aerosol loading above cloud, optical properties of clouds and aerosols, and cloud fraction. Recent development of a 'color ratio' (CR) algorithm applied to observations made by the Aura/OMI and Aqua/MODIS constitutes a major breakthrough and has provided unprecedented maps of above-cloud aerosol optical depth (ACAOD). The CR technique employs reflectance measurements at TOA in two channels (354 and 388 nm for OMI; 470 and 860 nm for MODIS) to retrieve ACAOD in near-UV and visible regions and aerosol-corrected cloud optical depth, simultaneously. An inter-satellite comparison of ACAOD retrieved from NASA's A-train sensors reveals a good level of agreement between the passive sensors over the homogeneous cloud fields. Direct measurements of ACA such as carried out by the NASA Ames Airborne Tracking Sunphotometer (AATS) and Spectrometer for Sky-Scanning, Sun-Tracking Atmospheric Research (4STAR) can be of immense help in validating ACA retrievals. We validate the ACA optical depth retrieved using the CR method applied to the MODIS cloudy-sky reflectance against the airborne AATS and 4STAR measurements. A thorough search of the historic AATS-4STAR database collected during different field campaigns revealed five events where biomass burning, dust, and wildfire-emitted aerosols were found to overlay lower level cloud decks observed during SAFARI-2000, ACE-ASIA 2001, and SEAC4RS- 2013, respectively. The co-located satellite-airborne measurements revealed a good agreement (RMSE less than 0.1 for AOD at 500 nm) with most matchups falling within the estimated uncertainties in the MODIS retrievals. An extensive validation of satellite-based ACA retrievals requires equivalent field measurements particularly over the regions where ACA are often observed from satellites, i.e., south-eastern Atlantic Ocean, tropical Atlantic Ocean, northern Arabian Sea, South-East and North-East Asia.

validation↗

NASA NTRS2014

Integrated Medical Model Verification, Validation, and Credibility

The Integrated Medical Model (IMM) was designed to forecast relative changes for a specified set of crew health and mission success risk metrics by using a probabilistic (stochastic process) model based on historical data, cohort data, and subject matter expert opinion. A probabilistic approach is taken since exact (deterministic) results would not appropriately reflect the uncertainty in the IMM inputs. Once the IMM was conceptualized, a plan was needed to rigorously assess input information, framework and code, and output results of the IMM, and ensure that end user requests and requirements were considered during all stages of model development and implementation. METHODS: In 2008, the IMM team developed a comprehensive verification and validation (VV) plan, which specified internal and external review criteria encompassing 1) verification of data and IMM structure to ensure proper implementation of the IMM, 2) several validation techniques to confirm that the simulation capability of the IMM appropriately represents occurrences and consequences of medical conditions during space missions, and 3) credibility processes to develop user confidence in the information derived from the IMM. When the NASA-STD-7009 (7009) was published, the IMM team updated their verification, validation, and credibility (VVC) project plan to meet 7009 requirements and include 7009 tools in reporting VVC status of the IMM. RESULTS: IMM VVC updates are compiled recurrently and include 7009 Compliance and Credibility matrices, IMM VV Plan status, and a synopsis of any changes or updates to the IMM during the reporting period. Reporting tools have evolved over the lifetime of the IMM project to better communicate VVC status. This has included refining original 7009 methodology with augmentation from the NASA-STD-7009 Guidance Document. End user requests and requirements are being satisfied as evidenced by ISS Program acceptance of IMM risk forecasts, transition to an operational model and simulation tool, and completion of service requests from a broad end user consortium including Operations, Science and Technology Planning, and Exploration Planning. CONCLUSIONS: The VVC approach established by the IMM project of combining the IMM VV Plan with 7009 requirements is comprehensive and includes the involvement of end users at every stage in IMM evolution. Methods and techniques used to quantify the VVC status of the IMM have not only received approval from the local NASA community but have also garnered recognition by other federal agencies seeking to develop similar guidelines in the medical modeling community.

Validation↗

NASA NTRS2016

Qualitative Validation of the IMM Model for ISS and STS Programs

To validate and further improve the Integrated Medical Model (IMM), medical event data were obtained from 32 ISS and 122 STS person-missions. Using the crew characteristics from these observed missions, IMM v4.0 was used to forecast medical events and medical resource utilization. The IMM medical condition incidence values were compared to the actual observed medical event incidence values, and the IMM forecasted medical resource utilization was compared to actual observed medical resource utilization. Qualitative comparisons of these parameters were conducted for both the ISS and STS programs. The results of these analyses will provide validation of IMM v4.0 and reveal areas of the model requiring adjustments to improve the overall accuracy of IMM outputs. This validation effort should result in enhanced credibility of the IMM and improved confidence in the use of IMM as a decision support tool for human space flight.

risk assessment↗

NASA NTRS2017

Recalibration and Validation of the SMAP L-Band Radiometer

SMAP mission was launched on 31st January 2015 in a 6 AM 6 PM sun-synchronous orbit at 685 km altitude to measure soil moisture and freethaw globally. The passive instrument of SMAP is a fully polarimetric L-band radiometer (1.4GHz) operating with a bandwidth of 24MHz. The radiometer L1B data product version 3 has been released for public science activities. Post-launch calibration and validation activities are described in [4,5]. Validation results show that SMAP antenna temperature (TA) is 2.6 K warmer over galactic Cold Sky (CS), and land TB is 2.6 K colder comparing to SMOS land TB (compared at the top of the atmosphere) after the update of the reflectors thermal model. Due to the biases, the SMAP radiometer is under re-calibration for next data release in 2018.We present the updated calibration approaches for the SMAP radiometer product. We will discuss the various radiometer calibration parameters and part of the validation process and result.

SMAP↗

NASA NTRS2016

Quantitative Validation of the Integrated Medical Model (IMM) for ISS Missions

Lifetime Surveillance of Astronaut Health (LSAH) provided observed medical event data on 33 ISS and 111 STS person-missions for use in further improving and validating the Integrated Medical Model (IMM). Using only the crew characteristics from these observed missions, the newest development version, IMM v4.0, will simulate these missions to predict medical events and outcomes. Comparing IMM predictions to the actual observed medical event counts will provide external validation and identify areas of possible improvement. In an effort to improve the power of detecting differences in this validation study, the total over each program ISS and STS will serve as the main quantitative comparison objective, specifically the following parameters: total medical events (TME), probability of loss of crew life (LOCL), and probability of evacuation (EVAC). Scatter plots of observed versus median predicted TMEs (with error bars reflecting the simulation intervals) will graphically display comparisons while linear regression will serve as the statistical test of agreement. Two scatter plots will be analyzed 1) where each point reflects a mission and 2) where each point reflects a condition-specific total number of occurrences. The coefficient of determination (R2) resulting from a linear regression with no intercept bias (intercept fixed at zero) will serve as an overall metric of agreement between IMM and the real world system (RWS). In an effort to identify as many possible discrepancies as possible for further inspection, the -level for all statistical tests comparing IMM predictions to observed data will be set to 0.1. This less stringent criterion, along with the multiple testing being conducted, should detect all perceived differences including many false positive signals resulting from random variation. The results of these analyses will reveal areas of the model requiring adjustment to improve overall IMM output, which will thereby provide better decision support for mission critical applications.

validation↗

NASA NTRS2018

Validation of the Nasa Integrated Medical Model: a Space Flight Medical Risk Prediction Tool

The Human Research Program funded the development of the Integrated Medical Model (IMM) to quantify the medical component of overall mission risk. The IMM uses Monte Carlo simulation methodology, incorporating space flight and ground medical data, to estimate the probability of mission medical outcomes and resource utilization. To determine the credibility of IMM output, the IMM project team completed two validation studies that compared IMM predicted output to observed medical events from a selection of Shuttle Transportation System (STS) and International Space Station (ISS) missions. The validation study results showed that the IMM underpredicted the occurrence of ~10% of the modeled medical conditions for the STS missions and overpredicted ~20% of the modeled medical conditions for the ISS missions. These findings imply that the strength of IMM predictions to inform decisions depends on simulated mission specifications including length. This discrepancy could result from medical recording differences between ISS and STS that possibly influence observed incidence rates, IMM combining all "mission type" data as constant occurrence rate or fixed proportion across both mission types, misspecification of symptoms to conditions, and gaps in the literature informing the model. Some of these issues will be alleviated by updating the IMM source data through incorporation of the observed validation data.

medical equipment↗

NASA NTRS2018

Validation of the NASA Integrated Medical Model: a Space Flight Medical Risk Prediction Tool

risk assessment↗

NASA NTRS2019

A Terrestrial Validation of ICESat Elevation Measurements and Implications for Global Reanalyses

The primary goal of NASA's Ice, Cloud, and land Elevation Satellite (ICESat) mission was to detect centimeter-level changes in global ice sheet elevations at the spatial scale of individual ice streams. Confidence in detecting these small signals requires careful validation over time to characterize the uncertainty and stability of measured elevations. A common validation approach compares altimeter elevations to an independently characterized and stable reference surface. Using a digital elevation model (DEM) from geodetic surveys of one such surface, the salar de Uyuni in Bolivia, we show that ICESat elevations at this location have a 0.0-centimeter bias relative to the WGS84 ellipsoid, 4.0-centimeter (1-sigma) uncertainty overall, and 1.8-centimeter uncertainty under ideal conditions over short (50 kilometer) profiles. We observe no elevation bias between ascending and descending orbits, but we do find that elevations measured immediately after transitions from low to high surface albedo may be negatively biased. Previous studies have reported intercampaign biases (ICBs) between various ICESat observation campaigns, but we find no statistically significant ICBs or ICB trends in our data. We do find a previously unreported 3.1-centimeter bias between ICESat's Laser 2 and Laser 3, and we find even larger interlaser biases in reanalyzed data from other studies. For an altimeter with an exact repeat orbit like ICESat, we also demonstrate that validation results with respect to averaged elevation profiles along a single ground track are comparable to results obtained using reference elevations from an in situ survey.

Laser Ranging↗

NASA NTRS2020

Analytical Redundancy Using Kalman Filters for Rocket Engine Sensor Validation

The use of sensor redundancy is crucial in aerospace systems to maintain safe, reliable operation. While hardware redundancy is more common in application, analytical redundancy can provide a viable alternative in systems where the installation of multiple redundant sensors is not viable. To this end, the use of Kalman filters to analytically validate sensor measurements within rocket engines was explored. First, a dynamic model of the RS 25 engine, a derivative of the Space Shuttle Main Engine (SSME), was reduced to a subset of relations, focused around the main combustion chamber pressure. These relations were used within the Kalman filter algorithm to generate an estimate of sensor measurements to be compared with true measurements for data validation purposes. By using a bank of Kalman filters, the residuals between the estimated and true measurements were used to detect and isolate sensor faults. Through fault simulations, the sensor validation performance of this Kalman filter bank design was compared to a hardware redundancy check. Sensor bias and drift faults of various magnitudes were injected into nominal RS 25 engine test data. Results for both approaches show comparable fault detection with most bias faults found nearly instantaneously by both algorithms. Drift fault detection results show certain cases where one algorithm is faster than the other. The key advantage of the Kalman filter algorithm is shown in fault isolation performance where it can isolate faults between two redundant sensors while the hardware redundancy comparisons cannot.

sensors↗

NASA NTRSDate not supplied

CFD Validation Experiments: Toward a Broader Perspective

The current literature considers a CFD validation experiment synonymously with a particular type of wind tunnel test. By drawing on the experience of the authors, this paper makes a case for broadening the definition to include a more balanced and synergistic exploitation of computational and physical testing techniques. The concept of validation dialog is introduced which, together with technique verification, is considered a key enabler in the pursuit of an improved CFD predictive capability. An outline of a lifecycle for a CFD validation experiment is also proposed to consolidate the thinking. The result, it is reasoned, will encourage improved engagement with a broader range of stakeholders and wider recognition of the value of the outcomes of what might otherwise be considered studies of lesser importance. In turn, this is expected to encourage the adoption of more systematic approaches to complex problems, such that they are more readily broken down into smaller, more focused endeavors, while at the same time making such activities easier to fund.

CFD↗

NASA NTRS2022

Verification and Validation of Hybridspectral Radiometry Obtained from an Unmanned Surface Vessel (USV) in the Open and Coastal Oceans

The hardware and software capabilities of the compact-profiling hybrid instrumentation for radiometry and ecology (C-PHIRE) instruments on an unmanned surface vessel (USV) are evaluated. Both the radiometers and USV are commercial-off-the-shelf (COTS) products, with the latter being only minimally modified to deploy the C-PHIRE instruments. The hybridspectral C-PHIRE instruments consist of an array of 18 multispectral microradiometers with 10 nm wavebands spanning 320–875 nm plus a hyperspectral compact grating spectrometer (CGS) with 2048 pixels spanning 190–1000 nm. The C-PHIRE data were acquired and processed using two architecturally linked software packages, thereby allowing lessons learned in one to be applied to the other. Using standard data products and unbiased statistics, the C-PHIRE data were validated with those from the well-established compact-optical profiling system (C-OPS) and verified with the marine optical buoy (MOBY). Agreement between algorithm variables used to estimate colored dissolved organic matter (CDOM) absorption and chlorophyll a concentration were also validated. Developing and operating novel technologies, such as the C-PHIRE series of instruments, deployed on a USV increase the frequency and coverage of optical observations, which are required to fully support the present and next-generation validation exercises in radiometric remote sensing of aquatic ecosystems.

Hybridspectral↗

NASA NTRS2022

Unifying the Validation of Ambient Solar Wind Models

Progress in space weather research and awareness needs community-wide strategies and procedures to evaluate our modeling assets. Here we present the activities of the Ambient Solar Wind Validation Team embedded in the COSPAR ISWAT initiative. We aim to bridge the gap between model developers and end-users to provide the community with an assessment of the state-of-the-art in solar wind forecasting. To this end, we develop an open online platform for validating solar wind models by comparing their solutions with in situ spacecraft measurements. The online platform will allow the space weather community to test the quality of state-of-the-art solar wind models with unified metrics providing an unbiased assessment of progress over time. In this study, we propose a metadata architecture and recommend community-wide forecasting goals and validation metrics. We conclude with a status update of the online platform and outline future perspectives.

Space weather↗

NASA NTRSDate not supplied

Validation of Gas-Liquid Sharp Interface Model in Loci-Stream for Propellant Tank Self-pressurization under Normal Gravity

Deep space missions require advances in cryogenic fluid management (CFM) for long term storage of propellants. One of the important phenomena is self-pressurization due to heat leakages into the tank. Managing self-pressurization is one of the key technologies for deep space exploration and long-term space missions. The complex interactions involving natural convection, thermal gradients, turbulence, and phase change near the gas-liquid interface cannot be modeled using reduced order or nodal analysis models, and 3-D CFD analyses are necessary to fully characterize the dynamics. CFD analyses pose their own difficulties. The requisite CFD tool to tackle this problem need to be modular with the ability to incorporate various physics models, efficient, and computationally scalable for simulating flight size tanks. In this paper, we discuss modeling approach for self-pressurization in situations where the liquid interface is static and validate NASA MSFC’s Loci-Stream CFD solver for predicting self-pressurization in a test tank in normal gravity. This tank was designed to capture quantifiable and accurate data for understanding various two-phase fluid phenomena and to validate modeling tools. Specifically, we demonstrate the capability of the Loci-Stream solver with a two-phase sharp-interface treatment to predict self-pressurization of a tank with an unperturbed gas-liquid interface. This validation highlights the reliability of our modeling approach and our solver to serve as a design and analysis tool for NASA’s CFM application needs.

cryogenic fluid management↗

NASA NTRSDate not supplied

Validation of Gas-Liquid Sharp Interface Model in Loci-Stream for Propellant Tank Self-pressurization under Normal Gravity

Deep space missions require advances in cryogenic fluid management (CFM) for long term storage of propellants. One of the important phenomena is self-pressurization due to heat leakages into the tank. Managing self-pressurization is one of the key technologies for deep space exploration and long-term space missions. The complex interactions involving natural convection, thermal gradients, turbulence, and phase change near the gas-liquid interface cannot be modeled using reduced order or nodal analysis models, and 3-D CFD analyses are necessary to fully characterize the dynamics. CFD analyses pose their own difficulties. The requisite CFD tool to tackle this problem need to be modular with the ability to incorporate various physics models, efficient, and computationally scalable for simulating flight size tanks. In this paper, we discuss modeling approach for self-pressurization in situations where the liquid interface is static and validate NASA MSFC's Loci-Stream CFD solver for predicting self-pressurization in a test tank in normal gravity. This tank was designed to capture quantifiable and accurate data for understanding various two-phase fluid phenomena and to validate modeling tools. Specifically, we demonstrate the capability of the Loci-Stream solver with a two-phase sharp-interface treatment to predict self-pressurization of a tank with an unperturbed gas-liquid interface. This validation highlights the reliability of our modeling approach and our solver to serve as a design and analysis tool for NASA's CFM application needs.

cryogenic fluid management↗

NASA NTRSDate not supplied

Validation of Two-phase Flow Modeling Techniques in Loci-Stream using Axial Jet Pressure Control and Autogenous Pressurization Experiment

Improvements to computational fluid dynamics modeling of cryogenic fluid management operations are presented with experimental validations. Modeling improvements includes utilizing improved delayed detaches eddy simulation to more effectively model turbulence compared to the Reynolds-averaged Navier Stokes modeling, modeling temperature dependent tank solid properties to capture large variation in thermodynamic properties at cryogenic conditions, modeling real gas equation of state for hydrogen instead of ideal gas behavior, and an on-going effort to improve interface turbulence transport for the volume of fluid method. Two flight-scale ground tests, five K-site tank axial jet pressure control experiments and an Engineering Design Unit tank autogenous pressurization experiment are validated and show the effectiveness of the improved modeling techniques. The successful validation establishes further trust in these models for flight project support and provides a pathway for maturation of in-development interface turbulence damping model for the volume of fluid method for more generalized applications.

CFD↗

NASA NTRSDate not supplied

Validation of Two-Phase Flow Modeling Techniques in Loci-Stream Using Axial Jet Pressure Control and Autogenous Pressurization Experiments

CFD↗

DOE OSTI2015

Validation Study for Crediting Chlorine in Criticality Analyses for Spent Nuclear Fuel Disposition

Spent nuclear fuel (SNF) management practices in the United States rely on dry storage systems that include both canister- and cask-based systems. The United States Department of Energy Used Fuel Disposition Campaign is examining the feasibility of direct disposal of dual-purpose (storage and transportation) canisters (DPCs) in a geological repository. One of the major technical challenges for direct disposal is the ability to demonstrate the subcriticality of the DPCs loaded with SNF for the repository performance period (e.g., 10,000 years or more) as the DPCs may undergo degradation over time. Specifically, groundwater ingress into the DPC (i.e., flooding) could allow the system to achieve criticality in scenarios where the neutron absorber plates in the DPC basket have degraded. However, as was shown by Banerjee et al., some aqueous species in the groundwater provide noticeable reactivity reduction for these systems. For certain amounts of particular aqueous species (e.g., chlorine, lithium) in the groundwater, subcriticality can be demonstrated even for DPCs with complete degradation of the neutron absorber plates or a degraded fuel basket configuration. It has been demonstrated that chlorine is the leading impurity, as indicated by significant neutron absorption in the water that is available in reasonable quantities for the deep geological repository media under consideration. This paper presents the results of an investigation of the available integral experiments worldwide that could be used to validate DPC disposal criticality evaluations, including credit for chlorine. Due to the small number of applicable critical configurations, validation through traditional trending analysis was not possible. The bias in the eigenvalue of the application systems due only to the chlorine was calculated using TSURFER analysis and found to be on the order of 100 percent mille (1 pcm = 10 -5 k eff ). This study investigated the design of a series of critical configurations with varying amounts of chlorine to address validation gaps. Such integral experiments would support the crediting of the chlorine neutron-absorption properties in groundwater and the demonstration of subcriticality for DPCs in deep geologic repositories with sufficient chlorine availability.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗