Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,189 records · Page 66

Evaluation of CLARA-A2 and ISCCP-H Cloud Cover Climate Data Records over Europe with ECA&D Ground-Based Measurements

Clouds are of high importance for the climate system but they still remain one of its principal uncertainties. Remote sensing techniques applied to satellite observations have assisted tremendously in the creation of long-term and homogeneous data records; however, satellite data sets need to be validated and compared with other data records, especially ground measurements. In the present study, the spatiotemporal distribution and variability of Total Cloud Cover (TCC) from the Satellite Application Facility on Climate Monitoring (CM SAF) Cloud, Albedo And Surface Radiation dataset from AVHRR data—edition 2 (CLARA-A2) and the International Satellite Cloud Climatology Project H-series (ISCCP-H) is analyzed over Europe. The CLARA-A2 data record has been created using measurements of the Advanced Very High Resolution Radiometer (AVHRR) instrument onboard the polar orbiting NOAA and the EUMETSAT MetOp satellites, whereas the ISCCP-H data were produced by a combination of measurements from geostationary meteorological satellites and the AVHRR instrument on the polar orbiting satellites. An intercomparison of the two data records is performed over their common period, 1984 to 2012. In addition, a comparison of the two satellite data records is made against TCC observations at 22 meteorological stations in Europe, from the European Climate Assessment & Dataset (ECA&D). The results indicate generally larger ISCCP-H TCC with respect to the corresponding CLARA-A2 data, in particular in the Mediterranean. Compared to ECA&D data, both satellite datasets reveal a reasonable performance, with overall mean TCC biases of 2.1 and 5.2% for CLARA-A2 and ISCCP-H, respectively. This, along with the higher correlation coefficients between CLARA-A2 and ECA&D TCC, indicates the better performance of CLARA-A2 TCC data.

Tzallas, Vasileios↗

Simulated Ice Shapes on the High Lift Common Research Model Using LEWICE3D

Computational icing tools consist of predicting two distinct problems, the dry air aerodynamics around the iced or uniced vehicle and the accretion of ice due to inclement weather. A desire exists to advance these tools such that they can be reliably used earlier in the design process to limit the need for more costly flight and wind tunnel testing. To achieve these goals the computational tools need to be benchmarked and validated against high quality experimental data sets to raise the software’s Technology Readiness Level. An ongoing collaborative effort between NASA and Boeing Commercial Airplanes is focused on obtaining this required experimental data and subsequently benchmarking and/or validating the tools that predict the aerodynamics around the iced and uniced vehicle. Currently the scope of this effort is focused on the usage of simulated ice shapes to be representative of the iced vehicle. This presentation discusses the generation of those simulated ice shapes.

Icing↗

On the Application of an Actuator Line Model for Rotorcraft Outwash Predictions

As the next generation of Vertical Take-Off and Landing (VTOL) vehicles develops and the VTOL industry makes significant progress in utilizing them for public transportation, it is crucial to have validated and cost-effective computational models accessible to both industry professionals and academics in the rotorcraft community. This study investigates the implementation of a new actuator line model within NASA’s OVERFLOW computational fluid dynamics (CFD) solver, with a focus on predicting rotorcraft outwash. This reduced-order rotor model was developed to provide reasonably accurate outwash predictions while reducing computational costs compared to traditional blade-resolved CFD simulations. To validate the actuator line model for outwash predictions, the model was compared against existing experimental data across three validation cases: single rotor Out-of-Ground Effect (OGE), single rotor In-Ground Effect (IGE), and tandem rotor IGE. All three cases were based on the rotor geometry and configuration of the CH-47D. To evaluate the feasibility and advantages of using an actuator line model for outwash predictions the results were compared to a series of high-fidelity blade-resolved CFD simulations as well as comprehensive analyses simulations based on CHARM predictions. The results of this study demonstrate the feasibility of leveraging this new actuator line model for reasonably accurate outwash predictions. The outwash results obtained from the actuator line model closely matched those from high-fidelity blade-resolved simulations while significantly reducing the overall computational costs of the simulations. Results from this study further demonstrated the feasibility of using CHARM for efficient, and reasonably accurate time-averaged outwash predictions for multi-rotor configurations.

CFD↗

Validation of Satellite Retrieved Land Surface Variables

The effective use of satellite observations of the land surface is limited by the lack of high spatial resolution ground data sets for validation of satellite products. Recent large scale field experiments include FIFE, HAPEX-Sahel and BOREAS which provide us with data sets that have large spatial coverage and long time coverage. It is the objective of this paper to characterize the difference between the satellite estimates and the ground observations. This study and others along similar lines will help us in utilization of satellite retrieved data in large scale modeling studies.

Lakshmi, Venkataraman↗

Validation of Satellite Retrieved Land Surface Variables

The effective use of satellite observations of the land surface is limited by the lack of high spatial resolution ground data sets for validation of satellite products. Recent large scale field experiments include FIFE, HAPEX-Sahel and BOREAS which provide us with data sets that have large spatial coverage and long time coverage. It is the objective of this paper to characterize the difference between the satellite estimates and the ground observations. This study and others along similar lines will help us in utilization of satellite retrieved data in large scale modeling studies.

Lakshmi, Venkataraman↗

Investigation of Boundary Conditions for Flexible Multibody Spacecraft Dynamics

In support of both the Space Shuttle and International Space Station programs, a set of generic multibody dynamics algorithms integrated within the Trick simulation environment have addressed the variety of on-orbit manipulator simulation requirements for engineering analysis, procedures development and crew familiarization/training at the NASA Johnson Space Center (JSC). Enhancements to these dynamics algorithms are now being driven by a new set of Constellation program requirements for flexible multibody spacecraft simulation. One particular issue that has been discussed within the NASA community is the assumption of cantilever-type flexible body boundary conditions. This assumption has been commonly utilized within manipulator multibody dynamics formulations as it simplifies the computation of relative motion for articulated flexible topologies. Moreover, its use for modeling of space-based manipulators such as the Shuttle Remote Manipulator System (SRMS) and Space Station Remote Manipulator System (SSRMS) has been extensively validated against flight data. For more general flexible spacecraft applications, however, the assumption of cantilever-type boundary conditions may not be sufficient. This paper describes the boundary condition assumptions that were used in the original formulation, demonstrates that this formulation can be augmented to accommodate systems in which the assumption of cantilever boundary conditions no longer applies, and verifies the approach through comparison with an independent model previously validated against experimental hardware test data from a spacecraft flexible dynamics emulator.

Boundary-value problems↗

Satellite Sensed Skin Sea Surface Temperature

Quantitative predictions of spatial and temporal changes the global climate rely heavily on the use of computer models. Unfortunately, such models cannot provide the basis for climate prediction because key physical processes are inadequately treated. Consequently, fine tuning procedures are often used to optimize the fit between model output and observational data and the validation of climate models using observations is essential if model based predictions of climate change are to be treated with any degree of confidence. Satellite Sea Surface Temperature (SST) observations provide high spatial and temporal resolution data which is extremely well suited to the initialization, definition of boundary conditions and, validation of climate models. In the case of coupled ocean-atmosphere models, the SST (or more correctly the 'Skin' SST (SSST)) is a fundamental diagnostic variable to consider in the validation process. Daily global SST maps derived from satellite sensors also provide adequate data for the detection of global patterns of change which, unlike any other SST data set, repeatedly extend into the southern hemisphere extra-tropical regions. Such data are essential to the success of the spatial 'fingerprint' technique, which seeks to establish a north-south asymmetry where warming is suppressed in the high latitude Southern Ocean. Some estimates suggest that there is a greater than 80% chance of directly detecting significant change (97.5 % confidence level) after 10-12 years of consistent global observations of mean sea surface temperature. However, these latter statements should be qualified with the assumption that a negligible drift in the observing system exists and that biases between individual instruments required to derive a long term data set are small. Given that current estimates for the magnitude of global warming of 0.015 K yr(sup -1) - 0.025 K yr(sup -1), satellite SST data sets need to be both accurate and stable if such a warming trend is to be confidently detected. Some of these activities are focussed to develop and deploy instrumentation suitable for the collection of precise in situ measurements of the SSST which can be used to improve the accuracy of satellite measurements, while others develop techniques to generate improved global analyses of sea surface temperature using historical data.

Donlon, Craig↗

Retrieval with Infrared Atmospheric Sounding Interferometer and Validation during JAIVEx

A state-of-the-art IR-only retrieval algorithm has been developed with an all-season-global EOF Physical Regression and followed by 1-D Var. Physical Iterative Retrieval for IASI, AIRS, and NAST-I. The benefits of this retrieval are to produce atmospheric structure with a single FOV horizontal resolution (approx. 15 km for IASI and AIRS), accurate profiles above the cloud (at least) or down to the surface, surface parameters, and/or cloud microphysical parameters. Initial case study and validation indicates that surface, cloud, and atmospheric structure (include TBL) are well captured by IASI and AIRS measurements. Coincident dropsondes during the IASI and AIRS overpasses are used to validate atmospheric conditions, and accurate retrievals are obtained with an expected vertical resolution. JAIVEx has provided the data needed to validate the retrieval algorithm and its products which allows us to assess the instrument ability and/or performance. Retrievals with global coverage are under investigation for detailed retrieval assessment. It is greatly desired that these products be used for testing the impact on Atmospheric Data Assimilation and/or Numerical Weather Prediction.

Zhou, Daniel K.↗

Wormhole Formation in RSRM Nozzle Joint Backfill

The RSRM nozzle uses a barrier of RTV rubber upstream of the nozzle O-ring seals. Post flight inspection of the RSRM nozzle continues to reveal occurrence of "wormholes" into the RTV backfill. The term "wormholes", sometimes called "gas paths", indicates a gas flow path not caused by pre-existing voids, but by a little-understood internal failure mode of the material during motor operation. Fundamental understanding of the mechanics of the RSRM nozzle joints during motor operation, nonlinear viscoelastic characterization of the RTV backfill material, identification of the conditions that predispose the RTV to form wormholes, and screening of candidate replacement materials is being pursued by a joint effort between Thiokol Propulsion, NASA, and the Army Propulsion & Structures Directorate at Redstone Arsenal. The performance of the RTV backfill in the joint is controlled by the joint environment. Joint movement, which applies a tension and shear load on the material, coupled with the introduction of high pressure gas in combination create an environment that exceeds the capability of the material to withstand the wormhole effect. Little data exists to evaluate why the material fails under the modeled joint conditions, so an effort to characterize and evaluate the material under these conditions was undertaken. Viscoelastic property data from characterization testing will anchor structural analysis models. Data over a range of temperatures, environmental pressures, and strain rates was used to develop a nonlinear viscoelastic model to predict material performance, develop criteria for replacement materials, and quantify material properties influencing wormhole growth. Three joint simulation analogs were developed to analyze and validate joint thermal barrier (backfill) material performance. Two exploratory tests focus on detection of wormhole failure under specific motor operating conditions. A "validation" test system provides data to "validate" computer models and predictions. Finally, two candidate replacement materials are being screened and "validated" using the developed test systems.

Stevens, J.↗

Diverse Applications of Occultation Data in Ozone Assimilation

Ozone profiles from solar occultation instruments provide invaluable information that can be used to evaluate the quality of assimilated ozone fields, from case studies to long-term phenomena. Occultation data can also be applied to include physical constraints while developing components of an assimilation system. Conversely, assimilation of occultation data can help in their validation, and it provides a framework for evaluation of the impact of occultation data on constraining global ozone fields within models. We illustrate these diverse applications by a series of examples using the ozone assimilation system at NASA/Goddard. In a case study, low ozone in the lower stratosphere due to transport of air from the Tropics to northern high latitudes that was captured by assimilation of Aura Microwave Limb Sounder (MLS) and Solar Backscatter Ultraviolet (SBUV) data, was found to agree with SAGE III data. For long-term monitoring, the quality of a multi-year SBUV-only assimilation was evaluated using monthly-mean time series of POAM, HALOE, and SAGE I1 data. We found realism in the representation of the annual cycle in ozone and in some aspects of interannual variability. Assimilation of POAM data was shown to improve the representation of lower stratospheric ozone, especially over Antarctica. More recently, we assimilated ILAS II ozone data in order to help in their validation. Solar occultation data are used to estimate parameters in a new model for forecast error variances that is being developed. These examples demonstrate the importance of occultation data for ozone assimilation, and potential of assimilation to increase the impact and the value of occultation data.

Markowitz, A.↗

Validity of a heart rate monitor during work in the laboratory and on the Space Shuttle

Accurate heart rate measurement during work is required for many industrial hygiene and ergonomics situations. The purpose of this investigation was to determine the validity of heart rate measurements obtained by a simple, lightweight, commercially available wrist-worn heart rate monitor (HRM) during work (cycle exercise) sessions conducted in the laboratory and also during the particularly challenging work environment of space flight. Three different comparisons were made. The first compared HRM data to simultaneous electrocardiogram (ECG) recordings of varying heart rates that were generated by an ECG simulator. The second compared HRM data to ECG recordings collected during work sessions of 14 subjects in the laboratory. Finally, ECG downlink and HRM data were compared in four astronauts who performed cycle exercise during space flight. The data were analyzed using regression techniques. The results were that the HRM recorded virtually identical heart rates compared with ECG recordings for the data set generated by an ECG simulator. The regression equation for the relationship between ECG versus HRM heart rate data during work in the laboratory was: ECG HR = 0.99 x (HRM) + 0.82 (r2 = 0.99). Finally, the agreement between ECG downlink data and HRM data during space flight was also very high, with the regression equation being: Downlink ECG HR = 1.05 x (HRM) -5.71 (r2 = 0.99). The results of this study indicate that the HRM provides accurate data and may be used to reliably obtain valid data regarding heart rate responses during work.

STS Shuttle Project↗

Cold-End Subsystem Testing for the Fission Power System Technology Demonstration Unit

The Fission Power System (FPS) Technology Demonstration Unit (TDU) consists of a pumped sodiumpotassium (NaK) loop that provides heat to a Stirling Power Conversion Unit (PCU), which converts some of that heat into electricity and rejects the waste heat to a pumped water loop. Each of the TDU subsystems is being tested independently prior to full system testing at the NASA Glenn Research Center. The pumped NaK loop is being tested at NASA Marshall Space Flight Center; the Stirling PCU and electrical controller are being tested by Sunpower Inc.; and the pumped water loop is being tested at Glenn. This paper describes cold-end subsystem setup and testing at Glenn. The TDU cold end has been assembled in Vacuum Facility 6 (VF 6) at Glenn, the same chamber that will be used for TDU testing. Cold-end testing in VF 6 will demonstrate functionality; validated coldend fill, drain, and emergency backup systems; and generated pump performance and system pressure drop data used to validate models. In addition, a low-cost proof-of concept radiator has been built and tested at Glenn, validating the design and demonstrating the feasibility of using low-cost metal radiators as an alternative to highcost composite radiators in an end-to-end TDU test.

Briggs, Mazwell↗

TPSAS-NF1676L-32668-DND

The Stratospheric Aerosol and Gas Experiment (SAGE) III is a solar occultation instrument installed on the International Space Station (ISS) that has been providing vertically resolved measurements of aerosol extinction, ozone concentrations, and other trace gases. With a legacy going back to the late 1970s, SAGE ozone measurements have been a vital contributor to international ozone assessments and analyses on stratospheric ozone trends. As the newest SAGE instrument, SAGE III/ISS will continue to provide high precision profiles of ozone that will help determine if the Montreal Protocol has been successful in enabling the recovery of the ozone layer. However, as is a necessary step for all new instruments, a rigorous validation of the data quality is required to determine if the data is sufficient for incorporation into trend analyses. Herein we discuss an initial evaluation of the data quality of vertical profiles of ozone with a focus on internal consistency for the first validation version (v5.1) derived from SAGE III/ISS measurements.

R Damadeo↗

Design of a Subscale, Inert Gas Test for Plume-Surface Interactions in a Reduced Pressure Environment

Rocket plume-surface interaction is a multi-phase, complex discipline characterized by plume flow physics, erosion physics, and ejecta dynamics. To provide critical data for the validation of predictive modeling capabilities, an inert-gas, subscale ground test has been designed, with one test phase focused on cratering and ejecta and another test phase focused on plume structure and behavior. Using a supersonic, heated N2 jet impinging onto six different mechanical regolith simulants, visual data on the temporal evolution of cratering and ejecta are collected in a vacuum chamber at ambient pressures ranging from 600 Pa down to approximately 7 Pa. Using the same N2 jet impinging onto an instrumented plate, NO planar laser-induced fluorescence data are obtained at lower ambient pressures for the validation of both continuum and rarefied gas-phase physics. This paper discusses the design of this test and data products, with emphasis on the cratering and ejecta experiments, along with the physical scaling, challenges, and relevance of these data to the maturation of the plume-surface interaction discipline.

Ashley M Korzun↗

Validation of Small Satellite Dynamics Simulation Modules using ASTERIA Flight Data

ASTERIA (Arcsecond Space Telescope Enabling Research in Astrophysics) was a CubeSat space telescope that operated in low-Earth orbit, having been deployed from the International Space Station in 2017. The spacecraft has achieved sub-arcsecond pointing stability and millikelvin thermal stability over 20-minute observations. A key enabling feature of the ASTERIA mission is the low level of pointing error that has been demonstrated under ASTERIA’s fine pointing control mode. Prior to launch, the ASTERIA mission performed analysis and simulations to estimate the in-flight pointing performance. This analysis used reaction wheel models provided by JPL’s Small Satellite Dynamics Testbed (SSDT), which had performed Kistler table testing to characterize the jitter caused by the reaction wheels of the Blue Canyon Technologies XACT attitude control unit within ASTERIA. These models were subsequently incorporated into the SSDT simulation. The main source of jitter, the high-frequency attitude disturbance over the camera exposure time, on ASTERIA is the set of rotating reaction wheels that are used for maintaining fine pointing during observations. The reaction wheels impart disturbance forces and torques continuously that cause unwanted motion during imaging. Increased jitter consequently leads to blurring of the image. Therefore, to benefit all SmallSat missions devoted to photometric or spectroscopic astrophysics applications, an on-orbit flight data acquisition and jitter testing campaign was performed in an attempt to help validate the SSDT’s simulation models. This paper describes the process used to validate several simulation models and attempt to characterize the ASTERIA jitter by analyzing the size of the resulting spot size for the target stars as a function of wheel speed, having commanded four wheel speeds for each of three stars of known brightness. After summarizing the on-orbit observation and jitter level measurement process, this paper compares the results obtained from the flight operational environment to the corresponding set of simulation jitter levels. Though the flight data obtained during this experiment was not sufficient to validate the simulation’s jitter model, other models have been validated with flight data, including the magnetic field, orbit propagation, sun position, and long-duration orbit decay models, which may be used by all other projects that use the SSDT’s simulation to increase system capability knowledge.

Mohan, Swati↗

The development and validation of a simple snow model for the GISS GCM

Five years of meteorological and hydrological data from a typical New England watershed where winter snow cover is significant were used to drive and validate two off-line land surface schemes suitable for use in the Goddard Institute for Space Studies (GISS) general circulation model (GCM): a baseline scheme that does not model the physics of a snowpack and therefore, neglects the insulating properties of snow cover; and a modified scheme in which a three-layer snowpack is modeled. Comparing baseline model results with validation data reveals several model deficiencies. Surface radiation temperatures could not adequately be modeled and the ground froze to unreasonable depths. Furthermore, because of ground cooling resulting from large surface heat fluxes to the atmosphere from the uninsulated surface, deeper model layers did not unfreeze until midsummer. As such, the normal hydrologic processes of runoff, ground water infiltration, and movement, etc., are compromised for a good part of the year. With the inclusion of a simple three-layer snow model into the baseline model, not only are the ground and surface radiation temperatures adequately modeled but all the features of snowpack ripening that characterize pack growth/ablation are simulated.

Lynch-Stieglitz, Marc↗

Calibration and Validation of a Finite ELement Model of THor-K Anthropomorphic Test Device for Aerospace Safety Applications

The THOR anthropomorphic test device (ATD) has been developed and continuously improved by the National Highway Traffic Safety Administration to provide automotive manufacturers an advanced tool that can be used to assess the injury risk of vehicle occupants in crash tests. Recently, a series of modifications were completed to improve the biofidelity of THOR ATD [1]. The updated THOR Modification Kit (THOR-K) ATD was employed at Wright-Patterson Air Base in 22 impact tests in three configurations: vertical, lateral, and spinal [2]. Although a computational finite element (FE) model of the THOR had been previously developed [3], updates to the model were needed to incorporate the recent changes in the modification kit. The main goal of this study was to develop and validate a FE model of the THOR-K ATD. The CAD drawings of the THOR-K ATD were reviewed and FE models were developed for the updated parts. For example, the head-skin geometry was found to change significantly, so its model was re-meshed (Fig. 1a). A protocol was developed to calibrate each component identified as key to the kinematic and kinetic response of the THOR-K head/neck ATD FE model (Fig. 1b). The available ATD tests were divided in two groups: a) calibration tests where the unknown material parameters of deformable parts (e.g., head skin, pelvis foam) were optimized to match the data and b) validation tests where the model response was only compared with test data by calculating their score using CORrelation and Analysis (CORA) rating system. Finally, the whole ATD model was validated under horizontal-, vertical-, and lateral-loading conditions against data recorded in the Wright Patterson tests [2]. Overall, the final THOR-K ATD model developed in this study is shown to respond similarly to the ATD in all validation tests. This good performance indicates that the optimization performed during calibration by using the CORA score as objective function is not test specific. Therefore confidence is provided in the ATD model for uses in predicting response in test conditions not performed in this study such those observed in the spacecraft landing. Comparison studies with ATD and human models may also be performed to contribute to future changes in THOR ATD design in an effort to improve its biofidelity, which has been traditionally based on post-mortem human subject testing and designer experience.

Putnam, J. B.↗