Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

A comprehensive two-way Doppler noise model for near-real-time validation of Doppler data

Doppler noise generated within the tracking system is modeled as a function of the dominant variable-Doppler sample interval. Additionally, the relationship between media noise and Doppler samples interval is empirically determined, and the ratio of media noise for S- and X-band downlinks is solved for. These functional relationships are incorporated into the previous media noise modeling to obtain a comprehensive two-way Doppler noise model.

Berman, A. L.↗

A methodology for collecting valid software engineering data

An effective data collection method for evaluating software development methodologies and for studying the software development process is described. The method uses goal-directed data collection to evaluate methodologies with respect to the claims made for them. Such claims are used as a basis for defining the goals of the data collection, establishing a list of questions of interest to be answered by data analysis, defining a set of data categorization schemes, and designing a data collection form. Feasibility of the data collection methodology was demonstrated by applying it to five different projects in two different environments (other NRL Reports). The application showed that the methodology was both feasible and useful.

Basili, V. R.↗

Development of UMARC (University of Maryland Advanced Rotorcraft Code)

The University of Maryland Advanced Rotorcraft Code (UMARC) is a user-friendly, FEM-based comprehensive helicopter rotor simulation code of high numerical robustness and computational efficiency. UMARC formulates the rotor-fuselage equations using Hamilton's principle, and are discretized using finite elements in space and time. The FEM formulation allows the code to analyze a wide variety of rotor designs. Dynamic inflow modeling is used for unsteady wake inflow computations. Predicted stability, response, and blade-load data are validated with experimental data for several configurations, including representative articulated, hingeless, and bearingless rotors.

Bir, Gunjit↗

Radiation model predictions and validation using LDEF data

Radiation dosimetry aboard LDEF, as well as post-flight measurements of the radioactivity induced in numerous LDEF spacecraft components, provide unique data for evaluating the accuracy of current models for predicting both the space radiation environments (trapped proton intensity, spectra, and directionality; cosmic ray fluence) and the radiation environments induced in spacecraft components (fluence, energy spectra, secondary particle, linear energy transfer, etc.). By determining the accuracy of such models using LDEF data, and with model updates where required, improved radiation environment predictions can be made for future missions, which in turn allows improved predictions for specific radiation effects for future spacecraft components (single event upsets of microelectronics, radiation damage to focal plane arrays, noise in sensitive instrumentation, etc.). Herein, the status and results from radiation model predictions and comparisons with LDEF data is given. The calculations are made using radiation transport codes coupled with a 3-D geometry/mass model of LDEF, together with current models of the space radiation environment.

Armstrong, T. W.↗

Ultra-Wideband Radar Measurements of Thickness of Snow Over Sea Ice

An accurate knowledge of snow thickness and its variability over sea ice is crucial for determining the overall polar heat and freshwater budget, which influences the global climate. Recently, algorithms have been developed to extract snow thicknesses from passive microwave satellite data. However, validation of these data over the large footprint of the passive microwave sensor has been a challenge. The only method used thus far has been with meter sticks during ship cruises. To address this problem, we developed an ultra wideband frequency-modulated continuous-wave (FM-CW) radar to measure snow thickness over sea ice. We made snow-thickness measurements over Antarctic sea ice by operating the radar from a sled during September and October, 2003. We performed radar measurements over 11 stations with varying snow thickness between 4 and 85 cm. We observed excellent agreement between radar estimates of snow thickness with physical measurements, achieving a correlation coefficient of 0.95 and a vertical resolution of about 3 cm.

Kanagaratnam, P.↗

The Normalization of Surface Anisotropy Effects Present in SEVIRI Reflectances by Using the MODIS BRDF Method

A modified version of the MODerate resolution Imaging Spectroradiometer (MODIS) bidirectional reflectance distribution function (BRDF) algorithm is presented for use in the angular normalization of surface reflectance data gathered by the Spinning Enhanced Visible and InfraRed Imager (SEVIRI) aboard the geostationary Meteosat Second Generation (MSG) satellites. We present early and provisional daily nadir BRDFadjusted reflectance (NBAR) data in the visible and near-infrared MSG channels. These utilize the high temporal resolution of MSG to produce BRDF retrievals with a greatly reduced acquisition period than the comparable MODIS products while, at the same time, removing many of the angular perturbations present within the original MSG data. The NBAR data are validated against reflectance data from the MODIS instrument and in situ data gathered at a field location in Africa throughout 2008. It is found that the MSG retrievals are stable and are of high-quality across much of the SEVIRI disk while maintaining a higher temporal resolution than the MODIS BRDF products. However, a number of circumstances are discovered whereby the BRDF model is unable to function correctly with the SEVIRI observations-primarily because of an insufficient spread of angular data due to the fixed sensor location or localized cloud contamination.

SEVIRI↗

ST7 Disturbance Reduction System (DRS) Colloid Micronewton Thruster Performance and Control Algorithm Model Simulation Validation in Flight

Colloid Micronewton Thrusters (CMNT) were flight demonstrated for the first time on the ST7Disturbance Reduction System (DRS) payload on the European Space Agency (ESA) Laser Interferometer Space Antenna (LISA) Pathfinder spacecraft for attitude and drag-free spacecraft control. LISA Pathfinder was a technology demonstration mission for ESA’s LISA gravitational wave observatory, currently in Phase A with a launch date of 2034. The DRS included the Integrated Avionics Unit (IAU), eight Colloid Micronewton Thrusters (CMNT), Dynamic Control Software (DCS) and Flight Software (FSW). The CMNT technology met performance requirements operating at 5-30 µN of thrust with ≤0.1 µN resolution and ≤0.1 µN/Hz thrust noise to deliver the required nanometer-level precision spacecraft control measured by the gravitational reference sensor (GRS) in the ESA LISA Technology Package (LTP). The performance of seven of the CMNT in flight was consistent with ground test results. The colloid thruster performance model of thrust and thrust noise as a function of operational parameters (i.e. beam current, voltage, temperature, etc.) was validated in flight over a wide range of conditions. A model and simulation of the thruster control algorithm was developed and validated with flight data to predict thrust noise. This capability is important because it is considered to be a significant source of position noise on the spacecraft and, therefore, the acceleration noise on the test masses, which provide the gravity wave measurements. The CMNT thruster model data and validation with LISA Pathfinder/ST7-DRS flight experiments are discussed in this paper.

Hruby, Vlad↗

In-Flight Verification and Validation of Colloid Microthruster Performance

Colloid Micronewton Thrusters (CMNTs) use an electrospray to provide precision spacecraft position and pointing control. They were demonstrated in space for the first time as part of NASA’s Space Technology 7 (ST7) payload hosted by the European Space Agency’s (ESA’s) LISA Pathfinder (LPF) technology demonstration mission in January, 2016. CMNTs were the actuator in the disturbance reduction system (DRS) that provided drag-free operation of the LPF spacecraft, which will be necessary for future gravity wave observatories such as ESA’s Laser Interferometer Space Antenna (LISA) mission, currently in Phase A and scheduled for launch in 2034. The CMNT technology met performance requirements operating at 5-30 µN of thrust with 0.1 µN resolution and ≤0.1 µN/ÖHz thrust noise to deliver the required nanometer-level precision spacecraft control measured by the gravitational reference sensor (GRS) in the ESA LISA Technology Package (LTP). The performance of seven of the eight CMNTs in flight was consistent with ground test results, and as a system, all eight thrusters met mission-level performance requirements. The colloid microthruster performance model of thrust and thrust noise as a function of operational parameters (i.e. beam current, voltage, temperature, etc.) was validated in flight over a wide range of conditions. A model and simulation of the thruster control algorithm was developed and validated with flight data to predict thrust noise. This capability is important for future missions because it relates directly to the acceleration noise on the test masses, which provide the gravity wave measurements. The CMNT thruster model data and validation with LISA Pathfinder/ST7-DRS flight experiments are presented in this paper.

"O'Donnell, James"↗

Preservation of Provenance and Context to Ensure Future Understandability of Airborne Earth Observations and Derived Data Products

Open-source science goes beyond making data from scientific projects (e.g., on-orbit/satellite missions, airborne and field investigations, and other data producing activities) openly available after they are generated, but involves and open sharing of information throughout the project lifecycle. Preservation of the data and associated information required for understanding and reusing the data well after the scientific projects is a contributor to open-source science as well. Considering the high investment in the on-orbit/satellite missions, we had developed a document titled “NASA Earth Science Data Preservation Content Specification (PCS)” in 2011. This document has been used as a requirement for recent on-orbit/satellite missions by NASA. Recently it became clear that the specifications should be applied to other scientific projects as well. Therefore, the document was revised to cover other types of projects, and a Preservation Content Implementation Guidance (PCIG) document was also developed. The revised PCS, and the PCIG, were published in 2022. The purpose of this presentation is to highlight the contents of these documents as they apply to suborbital/airborne investigations. The PCS calls for content preservation in eight general categories - Measuring Instrument/Platform Description, Instrument and Science Data Products and Metadata, Science Raw Data, Product and Algorithm Documentation, Instrument Calibration, Science Algorithm Software, Science Data Product Algorithm Inputs, Science Data Product Validation, and Science Data Access and Analysis Tools. While all these categories apply to various types of projects, a few clarifying sentences have been added to the descriptions of contents in each of the categories to show which categories are especially important to airborne and field investigations and where some contents are not applicable (or difficult to obtain). The PCIG document provides some general guidance applicable to all types of projects and specific guidance in a separate section for airborne and field investigations. This section calls out typical artifacts produced during such investigations that can meet the spirit of the various PCS categories.

remote sensing↗

Validation of Envisat Ozone Data Products using Satellite and Ground Based Data

The Envisat chemistry instruments provide an opportunity to continue the ozone data sets produced by TOMS, SBUV, HALOE, and SAGE. These data sets have already been extensively validated and are assured to be of high accuracy. Continuity and consistency of data sets among the various satellite instruments as well as ground networks is essential for detecting an ozone recovery and climate change. Our objective, as part of the Envisat CaWal program, is to validate SCIAMACHY, MIPAS, and GOMOS ozone products using these heritage instruments. In addition we plan to validate SCIAMACHY Level 1 radiance using heritage satellite data and ground observations using a radiative transfer model. Ground based data included US ozonesonde profiles and a double monochromator Brewer instrument located at Goddard Space Flight Center. To date we have tested our intercomparisons algorithms using available Envisat data compared with SBW/2 and the ground based observations. We analyzed the comparisons with respect to ozone amounts and latitude and found the differences that were expected based on the initial release of Envisat data, which had known deficiencies. We will present our latest results based on the most current release of Envisat ozone data products.

Hilsenrath, E.↗

Machine Learning Approaches to Increasing Value of Spaceflight Omics Databases

The number of spaceflight bioscience mission opportunities is too small to allow all relevant biological and environmental parameters to be experimentally identified. Simulated spaceflight experiments in ground-based facilities (GBFs), such as clinostats, are each suitable only for particular investigations -- a rotating-wall vessel may be 'simulated microgravity' for cell differentiation (hours), but not DNA repair (seconds) -- and introduce confounding stimuli, such as motor vibration and fluid shear effects. This uncertainty over which biological mechanisms respond to a given form of simulated space radiation or gravity, as well as its side effects, limits our ability to baseline spaceflight data and validate mission science. Machine learning techniques autonomously identify relevant and interdependent factors in a data set given the set of desired metrics to be evaluated: to automatically identify related studies, compare data from related studies, or determine linkages between types of data in the same study. System-of-systems (SoS) machine learning models have the ability to deal with both sparse and heterogeneous data, such as that provided by the small and diverse number of space biosciences flight missions; however, they require appropriate user-defined metrics for any given data set. Although machine learning in bioinformatics is rapidly expanding, the need to combine spaceflight/GBF mission parameters with omics data is unique. This work characterizes the basic requirements for implementing the SoS approach through the System Map (SM) technique, a composite of a dynamic Bayesian network and Gaussian mixture model, in real-world repositories such as the GeneLab Data System and Life Sciences Data Archive. The three primary steps are metadata management for experimental description using open-source ontologies, defining similarity and consistency metrics, and generating testing and validation data sets. Such approaches to spaceflight and GBF omics data may soon enable unique insight into which measured phenomena correlate to biological mechanisms that are truly affected by spaceflight conditions; which are most likely to be confounded by other variables; and which are insufficiently characterized, significantly increasing existing and future science return from ISS and spaceflight missions.

Gentry, Diana↗

Validating a large geophysical data set - Experiences with satellite-derived cloud parameters

The goal of this study is to validate the global cloud parameters derived from the satellite-borne HIRS2 and MSU atmospheric sounding instrument measurements, and to use the analysis of these data as one prototype for studying large geophysical data sets in general. The HIRS2/MSU data set contains a total of 40 physical parameters, filling 25 MB/day; raw HIRS2/MSU data are available for a period exceeding 10 years. Validation involves developing a quantitative sense for the physical meaning of the derived parameters over the range of environmental conditions sampled. This is accomplished by comparing the spatial and temporal distributions of the derived quantities with similar measurements made using other techniques, and with model results. The need to work with Level 2 (point) data, rather than Level 3 (gridded) data for validation purposes is discussed, and some techniques developed for charting the assumptions made in deriving an algorithm and generating a code to produce geophysical quantities from measured radiances are presented.

Kahn, Ralph↗

A Comprehensive Validation Methodology for Sparse Experimental Data

A comprehensive program of verification and validation has been undertaken to assess the applicability of models to space radiation shielding applications and to track progress as models are developed over time. The models are placed under configuration control, and automated validation tests are used so that comparisons can readily be made as models are improved. Though direct comparisons between theoretical results and experimental data are desired for validation purposes, such comparisons are not always possible due to lack of data. In this work, two uncertainty metrics are introduced that are suitable for validating theoretical models against sparse experimental databases. The nuclear physics models, NUCFRG2 and QMSFRG, are compared to an experimental database consisting of over 3600 experimental cross sections to demonstrate the applicability of the metrics. A cumulative uncertainty metric is applied to the question of overall model accuracy, while a metric based on the median uncertainty is used to analyze the models from the perspective of model development by analyzing subsets of the model parameter space.

Norman, Ryan B.↗

Development and Validation of High Performance Unshrouded Centrifugal Impeller

The feasibility of using a two-stage unshrouded impeller turbopump to replace the current three-stage reusable launch vehicle engine shrouded impeller hydrogen pump has been evaluated from the standpoint of turbopump weight reduction and overall payload improvement. These advantages are a by-product of the higher tip speeds that an unshrouded impeller can sustain. The issues associated with the effect of unshrouded impeller tip clearance on pump efficiency and head have been evaluated with one-dimensional tools and full three-dimensional rotordynamic fluid reaction forces and coefficients have been established through time dependent computational fluid dynamics (CFD) simulation of the whole 360 degree impeller with different rotor eccentricities and whirling ratios. Unlike the shrouded impeller, the unshrouded impeller forces are evaluated as the sum of the pressure forces on the blade and the pressure forces on the hub using the CFD results. The turbopump axial thrust control has been optimized by adjusting the first stage impeller backend wear ring seal diameter and diverting the second stage backend balance piston flow to the proper location. The structural integrity associated with the high tip speed has been checked by analyzing a 3D-Finite Element Model at maximum design conditions (6% higher than the design speed). This impeller was fabricated and tested in the NASA Marshall Space Flight Center water-test rig. The experimental data will be compared with the analytical predictions and presented in another paper. The experimental data provides validation data for the numerical design and analysis methodology. The validated numerical methodology can be used to help design different unshrouded impeller configurations.

Chen, Wei-Chung↗