SEARCH · Engineering Papers

Results for “VALIDATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

All sources NASA NTRS DOE OSTI

NASA NTRS2016

Quantitative Validation of the Integrated Medical Model (IMM) for ISS Missions

Lifetime Surveillance of Astronaut Health (LSAH) provided observed medical event data on 33 ISS and 111 STS person-missions for use in further improving and validating the Integrated Medical Model (IMM). Using only the crew characteristics from these observed missions, the newest development version, IMM v4.0, will simulate these missions to predict medical events and outcomes. Comparing IMM predictions to the actual observed medical event counts will provide external validation and identify areas of possible improvement. In an effort to improve the power of detecting differences in this validation study, the total over each program ISS and STS will serve as the main quantitative comparison objective, specifically the following parameters: total medical events (TME), probability of loss of crew life (LOCL), and probability of evacuation (EVAC). Scatter plots of observed versus median predicted TMEs (with error bars reflecting the simulation intervals) will graphically display comparisons while linear regression will serve as the statistical test of agreement. Two scatter plots will be analyzed 1) where each point reflects a mission and 2) where each point reflects a condition-specific total number of occurrences. The coefficient of determination (R2) resulting from a linear regression with no intercept bias (intercept fixed at zero) will serve as an overall metric of agreement between IMM and the real world system (RWS). In an effort to identify as many possible discrepancies as possible for further inspection, the -level for all statistical tests comparing IMM predictions to observed data will be set to 0.1. This less stringent criterion, along with the multiple testing being conducted, should detect all perceived differences including many false positive signals resulting from random variation. The results of these analyses will reveal areas of the model requiring adjustment to improve overall IMM output, which will thereby provide better decision support for mission critical applications.

validation↗

NASA NTRS2018

Validation of the Nasa Integrated Medical Model: a Space Flight Medical Risk Prediction Tool

The Human Research Program funded the development of the Integrated Medical Model (IMM) to quantify the medical component of overall mission risk. The IMM uses Monte Carlo simulation methodology, incorporating space flight and ground medical data, to estimate the probability of mission medical outcomes and resource utilization. To determine the credibility of IMM output, the IMM project team completed two validation studies that compared IMM predicted output to observed medical events from a selection of Shuttle Transportation System (STS) and International Space Station (ISS) missions. The validation study results showed that the IMM underpredicted the occurrence of ~10% of the modeled medical conditions for the STS missions and overpredicted ~20% of the modeled medical conditions for the ISS missions. These findings imply that the strength of IMM predictions to inform decisions depends on simulated mission specifications including length. This discrepancy could result from medical recording differences between ISS and STS that possibly influence observed incidence rates, IMM combining all "mission type" data as constant occurrence rate or fixed proportion across both mission types, misspecification of symptoms to conditions, and gaps in the literature informing the model. Some of these issues will be alleviated by updating the IMM source data through incorporation of the observed validation data.

medical equipment↗

NASA NTRS2018

Validation of the NASA Integrated Medical Model: a Space Flight Medical Risk Prediction Tool

risk assessment↗

NASA NTRS2019

A Terrestrial Validation of ICESat Elevation Measurements and Implications for Global Reanalyses

The primary goal of NASA's Ice, Cloud, and land Elevation Satellite (ICESat) mission was to detect centimeter-level changes in global ice sheet elevations at the spatial scale of individual ice streams. Confidence in detecting these small signals requires careful validation over time to characterize the uncertainty and stability of measured elevations. A common validation approach compares altimeter elevations to an independently characterized and stable reference surface. Using a digital elevation model (DEM) from geodetic surveys of one such surface, the salar de Uyuni in Bolivia, we show that ICESat elevations at this location have a 0.0-centimeter bias relative to the WGS84 ellipsoid, 4.0-centimeter (1-sigma) uncertainty overall, and 1.8-centimeter uncertainty under ideal conditions over short (50 kilometer) profiles. We observe no elevation bias between ascending and descending orbits, but we do find that elevations measured immediately after transitions from low to high surface albedo may be negatively biased. Previous studies have reported intercampaign biases (ICBs) between various ICESat observation campaigns, but we find no statistically significant ICBs or ICB trends in our data. We do find a previously unreported 3.1-centimeter bias between ICESat's Laser 2 and Laser 3, and we find even larger interlaser biases in reanalyzed data from other studies. For an altimeter with an exact repeat orbit like ICESat, we also demonstrate that validation results with respect to averaged elevation profiles along a single ground track are comparable to results obtained using reference elevations from an in situ survey.

Laser Ranging↗

NASA NTRS2020

Analytical Redundancy Using Kalman Filters for Rocket Engine Sensor Validation

The use of sensor redundancy is crucial in aerospace systems to maintain safe, reliable operation. While hardware redundancy is more common in application, analytical redundancy can provide a viable alternative in systems where the installation of multiple redundant sensors is not viable. To this end, the use of Kalman filters to analytically validate sensor measurements within rocket engines was explored. First, a dynamic model of the RS 25 engine, a derivative of the Space Shuttle Main Engine (SSME), was reduced to a subset of relations, focused around the main combustion chamber pressure. These relations were used within the Kalman filter algorithm to generate an estimate of sensor measurements to be compared with true measurements for data validation purposes. By using a bank of Kalman filters, the residuals between the estimated and true measurements were used to detect and isolate sensor faults. Through fault simulations, the sensor validation performance of this Kalman filter bank design was compared to a hardware redundancy check. Sensor bias and drift faults of various magnitudes were injected into nominal RS 25 engine test data. Results for both approaches show comparable fault detection with most bias faults found nearly instantaneously by both algorithms. Drift fault detection results show certain cases where one algorithm is faster than the other. The key advantage of the Kalman filter algorithm is shown in fault isolation performance where it can isolate faults between two redundant sensors while the hardware redundancy comparisons cannot.

sensors↗

NASA NTRSDate not supplied

CFD Validation Experiments: Toward a Broader Perspective

The current literature considers a CFD validation experiment synonymously with a particular type of wind tunnel test. By drawing on the experience of the authors, this paper makes a case for broadening the definition to include a more balanced and synergistic exploitation of computational and physical testing techniques. The concept of validation dialog is introduced which, together with technique verification, is considered a key enabler in the pursuit of an improved CFD predictive capability. An outline of a lifecycle for a CFD validation experiment is also proposed to consolidate the thinking. The result, it is reasoned, will encourage improved engagement with a broader range of stakeholders and wider recognition of the value of the outcomes of what might otherwise be considered studies of lesser importance. In turn, this is expected to encourage the adoption of more systematic approaches to complex problems, such that they are more readily broken down into smaller, more focused endeavors, while at the same time making such activities easier to fund.

CFD↗

NASA NTRS2022

Verification and Validation of Hybridspectral Radiometry Obtained from an Unmanned Surface Vessel (USV) in the Open and Coastal Oceans

The hardware and software capabilities of the compact-profiling hybrid instrumentation for radiometry and ecology (C-PHIRE) instruments on an unmanned surface vessel (USV) are evaluated. Both the radiometers and USV are commercial-off-the-shelf (COTS) products, with the latter being only minimally modified to deploy the C-PHIRE instruments. The hybridspectral C-PHIRE instruments consist of an array of 18 multispectral microradiometers with 10 nm wavebands spanning 320–875 nm plus a hyperspectral compact grating spectrometer (CGS) with 2048 pixels spanning 190–1000 nm. The C-PHIRE data were acquired and processed using two architecturally linked software packages, thereby allowing lessons learned in one to be applied to the other. Using standard data products and unbiased statistics, the C-PHIRE data were validated with those from the well-established compact-optical profiling system (C-OPS) and verified with the marine optical buoy (MOBY). Agreement between algorithm variables used to estimate colored dissolved organic matter (CDOM) absorption and chlorophyll a concentration were also validated. Developing and operating novel technologies, such as the C-PHIRE series of instruments, deployed on a USV increase the frequency and coverage of optical observations, which are required to fully support the present and next-generation validation exercises in radiometric remote sensing of aquatic ecosystems.

Hybridspectral↗

NASA NTRS2022

Unifying the Validation of Ambient Solar Wind Models

Progress in space weather research and awareness needs community-wide strategies and procedures to evaluate our modeling assets. Here we present the activities of the Ambient Solar Wind Validation Team embedded in the COSPAR ISWAT initiative. We aim to bridge the gap between model developers and end-users to provide the community with an assessment of the state-of-the-art in solar wind forecasting. To this end, we develop an open online platform for validating solar wind models by comparing their solutions with in situ spacecraft measurements. The online platform will allow the space weather community to test the quality of state-of-the-art solar wind models with unified metrics providing an unbiased assessment of progress over time. In this study, we propose a metadata architecture and recommend community-wide forecasting goals and validation metrics. We conclude with a status update of the online platform and outline future perspectives.

Space weather↗

NASA NTRSDate not supplied

Validation of Gas-Liquid Sharp Interface Model in Loci-Stream for Propellant Tank Self-pressurization under Normal Gravity

Deep space missions require advances in cryogenic fluid management (CFM) for long term storage of propellants. One of the important phenomena is self-pressurization due to heat leakages into the tank. Managing self-pressurization is one of the key technologies for deep space exploration and long-term space missions. The complex interactions involving natural convection, thermal gradients, turbulence, and phase change near the gas-liquid interface cannot be modeled using reduced order or nodal analysis models, and 3-D CFD analyses are necessary to fully characterize the dynamics. CFD analyses pose their own difficulties. The requisite CFD tool to tackle this problem need to be modular with the ability to incorporate various physics models, efficient, and computationally scalable for simulating flight size tanks. In this paper, we discuss modeling approach for self-pressurization in situations where the liquid interface is static and validate NASA MSFC’s Loci-Stream CFD solver for predicting self-pressurization in a test tank in normal gravity. This tank was designed to capture quantifiable and accurate data for understanding various two-phase fluid phenomena and to validate modeling tools. Specifically, we demonstrate the capability of the Loci-Stream solver with a two-phase sharp-interface treatment to predict self-pressurization of a tank with an unperturbed gas-liquid interface. This validation highlights the reliability of our modeling approach and our solver to serve as a design and analysis tool for NASA’s CFM application needs.

cryogenic fluid management↗

NASA NTRSDate not supplied

Validation of Gas-Liquid Sharp Interface Model in Loci-Stream for Propellant Tank Self-pressurization under Normal Gravity

Deep space missions require advances in cryogenic fluid management (CFM) for long term storage of propellants. One of the important phenomena is self-pressurization due to heat leakages into the tank. Managing self-pressurization is one of the key technologies for deep space exploration and long-term space missions. The complex interactions involving natural convection, thermal gradients, turbulence, and phase change near the gas-liquid interface cannot be modeled using reduced order or nodal analysis models, and 3-D CFD analyses are necessary to fully characterize the dynamics. CFD analyses pose their own difficulties. The requisite CFD tool to tackle this problem need to be modular with the ability to incorporate various physics models, efficient, and computationally scalable for simulating flight size tanks. In this paper, we discuss modeling approach for self-pressurization in situations where the liquid interface is static and validate NASA MSFC's Loci-Stream CFD solver for predicting self-pressurization in a test tank in normal gravity. This tank was designed to capture quantifiable and accurate data for understanding various two-phase fluid phenomena and to validate modeling tools. Specifically, we demonstrate the capability of the Loci-Stream solver with a two-phase sharp-interface treatment to predict self-pressurization of a tank with an unperturbed gas-liquid interface. This validation highlights the reliability of our modeling approach and our solver to serve as a design and analysis tool for NASA's CFM application needs.

cryogenic fluid management↗

NASA NTRSDate not supplied

Validation of Two-phase Flow Modeling Techniques in Loci-Stream using Axial Jet Pressure Control and Autogenous Pressurization Experiment

Improvements to computational fluid dynamics modeling of cryogenic fluid management operations are presented with experimental validations. Modeling improvements includes utilizing improved delayed detaches eddy simulation to more effectively model turbulence compared to the Reynolds-averaged Navier Stokes modeling, modeling temperature dependent tank solid properties to capture large variation in thermodynamic properties at cryogenic conditions, modeling real gas equation of state for hydrogen instead of ideal gas behavior, and an on-going effort to improve interface turbulence transport for the volume of fluid method. Two flight-scale ground tests, five K-site tank axial jet pressure control experiments and an Engineering Design Unit tank autogenous pressurization experiment are validated and show the effectiveness of the improved modeling techniques. The successful validation establishes further trust in these models for flight project support and provides a pathway for maturation of in-development interface turbulence damping model for the volume of fluid method for more generalized applications.

CFD↗

NASA NTRSDate not supplied

Validation of Two-Phase Flow Modeling Techniques in Loci-Stream Using Axial Jet Pressure Control and Autogenous Pressurization Experiments

CFD↗

NASA NTRS1975

Simulation verification techniques study: Simulation performance validation techniques document

Techniques and support software for the efficient performance of simulation validation are discussed. Overall validation software structure, the performance of validation at various levels of simulation integration, guidelines for check case formulation, methods for real time acquisition and formatting of data from an all up operational simulator, and methods and criteria for comparison and evaluation of simulation data are included. Vehicle subsystems modules, module integration, special test requirements, and reference data formats are also described.

Duncan, L. M.↗

NASA NTRS1979

Development and validation of a piloted simulation of a helicopter and external sling load

A generalized, real time, piloted, visual simulation of a single rotor helicopter, suspension system, and external load is described and validated for the full flight envelope of the U.S. Army CH-54 helicopter and cargo container as an example. The mathematical model described uses modified nonlinear classical rotor theory for both the main rotor and tail rotor, nonlinear fuselage aerodynamics, an elastic suspension system, nonlinear load aerodynamics, and a loadground contact model. The implementation of the mathematical model on a large digital computing system is described, and validation of the simulation is discussed. The mathematical model is validated by comparing measured flight data with simulated data, by comparing linearized system matrices, eigenvalues, and eigenvectors with manufacturers' data, and by the subjective comparison of handling characteristics by experienced pilots. A visual landing display system for use in simulation which generates the pilot's forward looking real world display was examined and a special head up, down looking load/landing zone display is described.

Shaughnessy, J. D.↗

NASA NTRS1979

Wind-tunnel investigation of the validity of a sonic-boom-minimization concept

The Langley unitary plan unitary plan wind tunnel was used to determine the validity of a sonic-boom-minimization theory. Five models - two reference and three low-boom constrained - were tested at design Mach numbers of 1.5 and 2.7. Results show that the pressure signatures generated by the low-boom models had significantly lower overpressure levels than those produced by the reference models and that small changes in the Mach number and/or the lift caused relatively small changes in the signature shape and overpressure level. Boundary-layer effects were found in the signature shape and overpressure level. Boundary-layer effects were found to be sizable on the low-boom models, and when viscous corrections were included in the analysis, improved agreement between the predicted and the measured signatures was noted. Since this agreement was better at Mach 1.5 than at Mach 2.7, it was concluded that the minimization method was definitely valid at Mach 1.5 and was probably valid at Mach 2.7, with further work needed to resolve the uncertainty.

Mack, R. J.↗

NASA NTRS1982

Helicopter simulation validation using flight data

A joint NASA/Army effort to perform a systematic ground-based piloted simulation validation assessment is described. The best available mathematical model for the subject helicopter (UH-60A Black Hawk) was programmed for real-time operation. Flight data were obtained to validate the math model, and to develop models for the pilot control strategy while performing mission-type tasks. The validated math model is to be combined with motion and visual systems to perform ground based simulation. Comparisons of the control strategy obtained in flight with that obtained on the simulator are to be used as the basis for assessing the fidelity of the results obtained in the simulator.

Key, D. L.↗

NASA NTRS1982

Cross-validation for densities and regressions

Virtually all nonparametric (infinite dimensional) problems require the choice of a smoothing parameter. It is natural to attempt to use the data to guide the choice of this parameter. The most widely applicable data driven technique is cross validation. The method of cross validation is introduced and results are presented which establish consistency for certain cross validated density estimators and consistency as well as asymptotic normality for rigid regression.

Geman, S.↗

NASA NTRS1982

Validation of Nimbus-7 temperature-humidity infrared radiometer estimates of cloud type and amount

Estimates of clear and low, middle and high cloud amount in fixed geographical regions approximately (160 km) squared are being made routinely from 11.5 micron radiance measurements of the Nimbus-7 Temperature-Humidity Infrared Radiometer (THIR). The purpose of validation is to determine the accuracy of the THIR cloud estimates. Validation requires that a comparison be made between the THIR estimates of cloudiness and the 'true' cloudiness. The validation results reported in this paper use human analysis of concurrent but independent satellite images with surface meteorological and radiosonde observations to approximate the 'true' cloudiness. Regression and error analyses are used to estimate the systematic and random errors of THIR derived clear amount.

Stowe, L. L.↗