Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “VALIDATION”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,027 records · Page 57

Mission Opportunities for the Flight Validation of the Kinetic Impactor Concept for Asteroid Deflection

The kinetic impactor technique for deflecting near-Earth objects (NEOs), whereby a spacecraft is directed to collide with a NEO to alter its orbit via momentum transfer, is one of several proposed methods for defendingEarth against hazardous NEOs (asteroids and comets). In this paper we present detailed mission design concepts for a notionally feasible and aff ordable kinetic impactor flight validation mission deployed to a currently known near-Earth asteroid (NEA). Several filter steps are devised that utilize relevant criteria to optimally balance keyparameters, such as approach phase angle, estimated NEA diameter, relative velocity at intercept, and current NEA orbit knowledge, and produce refined lists of the most promising candidate target NEAs.

mission design↗

Model-Based Verification and Validation of the SMAP Uplink Processes

This case study stands as an example of how a project can validate a system-level design earlier in the project life cycle than traditional V&V processes by using simulation on a system model. Specifically, this paper describes how simulation was added to a system model of the Soil Moisture Active-Passive (SMAP) mission's uplink process.Also discussed are the advantages and disadvantages of the methods employed and the lessons learned; which are intended to benefit future model-based and simulation-based V&V development efforts.

verification and validation (V&V)↗

Experimental Validation of Pulse Phase Tracking for X-Ray Pulsar Based

Pulsars are a form of variable celestial source that have shown to be usable as aids for autonomous, deep space navigation. Particularly those sources emitting in the X-ray band are ideal for navigation due to smaller detector sizes. In this paper X-ray photons arriving from a pulsar are modeled as a non-homogeneous Poisson process. The method of pulse phase tracking is then investigated as a technique to measure the radial distance traveled by a spacecraft over an observation interval. A maximum-likelihood phase estimator (MLE) is used for the case where the observed frequency signal is constant. For the varying signal frequency case, an algorithm is used in which the observation window is broken up into smaller blocks over which an MLE is used. The outputs of this phase estimation process were then looped through a digital phase-locked loop (DPLL) in order to reduce the errors and produce estimates of the doppler frequency. These phase tracking algorithms were tested both in a computer simulation environment and using the NASA Goddard Space flight Center X-ray Navigation Laboratory Testbed (GXLT). This provided an experimental validation with photons being emitted by a modulated X-ray source and detected by a silicon-drift detector. Models of the Crab pulsar and the pulsar B1821-24 were used in order to generate test scenarios. Three different simulated detector trajectories were used to be tracked by the phase tracking algorithm: a stationary case, one with constant velocity, and one with constant acceleration. All three were performed in one-dimension along the line of sight to the pulsar. The first two had a constant signal frequency and the third had a time varying frequency. All of the constant frequency cases were processed using the MLE, and it was shown that they tracked the initial phase within 0.15% for the simulations and 2.5% in the experiments, based on an average of ten runs. The MLE-DPLL cascade version of the phase tracking algorithm was used in the varying frequency case. This resulted in tracking of the phase and frequency by the DPLL outputs in both the simulation and experimental environments. The crab pulsar was experimentally tested with a trajectory with a higher acceleration. In this case the phase error tended toward zero as the observation extended to 250 seconds and the doppler frequency error tended to zero in under 100 seconds.

Experimental↗

Simulation Credibility: Advances in Verification, Validation, and Uncertainty Quantification

Decision makers and other users of simulations need to know quantified simulation credibility to make simulation-based critical decisions and effectively use simulations, respectively. The credibility of a simulation is quantified by its accuracy in terms of uncertainty, and the responsibility of establishing credibility lies with the creator of the simulation. In this volume, we present some state-of-the-art philosophies, principles, and frameworks. The contributing authors involved in this publication have been dedicated to advancing simulation credibility. They detail and provide examples of key advances over the last 10 years in the processes used to quantify simulation credibility: verification, validation, and uncertainty quantification. The philosophies and assessment methods presented here are anticipated to be useful to other technical communities conducting continuum physics-based simulations; for example, issues related to the establishment of simulation credibility in the discipline of propulsion are discussed. We envision that simulation creators will find this volume very useful to guide and assist them in quantitatively conveying the credibility of their simulations.

Simulation Credibility↗

A Generic Approach for Inversion of Surface Reflectance over Land: Overview, Application and Validation Using MODIS and LANDSAT8 Data

This paper presents a generic approach developed to derive surface reflectance over land from a variety of sensors. This technique builds on the extensive dataset acquired by the Terra platform by combining MODIS and MISR to derive an explicit and dynamic map of band ratio's between blue and red channels and is a refinement of the operational approach used for MODIS and LANDSAT over the past 15 years. We will present the generic approach and the application to MODIS and LANDSAT data and its validation using the AERONET data.

validation↗

NASA Operational Simulator for Small Satellites: Tools for Software Based Validation and Verification of Small Satellites

The NASA Operational Simulator for Small Satellites (NOS3) is a suite of tools to aid in areas such as software development, integration test (IT), mission operations training, verification and validation (VV), and software systems check-out. NOS3 provides a software development environment, a multi-target build system, an operator interface-ground station, dynamics and environment simulations, and software-based hardware models. NOS3 enables the development of flight software (FSW) early in the project life cycle, when access to hardware is typically not available. For small satellites there are extensive lead times on many of the commercial-off-the-shelf (COTS) components as well as limited funding for engineering test units (ETU). Considering the difficulty of providing a hardware test-bed to each developer tester, hardware models are modeled based upon characteristic data or manufacturers data sheets for each individual component. The fidelity of each hardware models is such that FSW executes unaware that physical hardware is not present. This allows binaries to be compiled for both the simulation environment, and the flight computer, without changing the FSW source code. For hardware models that provide data dependent on the environment, such as a GPS receiver or magnetometer, an open-source tool from NASA GSFC (42 Spacecraft Simulation) is used to provide the necessary data. The underlying infrastructure used to transfer messages between FSW and the hardware models can also be used to monitor, intercept, and inject messages, which has proven to be beneficial for VV of larger missions such as James Webb Space Telescope (JWST). As hardware is procured, drivers can be added to the environment to enable hardware-in-the-loop (HWIL) testing. When strict time synchronization is not vital, any number of combinations of hardware components and software-based models can be tested. The open-source operator interface used in NOS3 is COSMOS from Ball Aerospace. For testing, plug-ins are implemented in COSMOS to control the NOS3 simulations, while the command and telemetry tools available in COSMOS are used to communicate with FSW. NOS3 is actively being used for FSW development and component testing of the Simulation-to-Flight 1 (STF-1) CubeSat. As NOS3 matures, hardware models have been added for common CubeSat components such as Novatel GPS receivers, ClydeSpace electrical power systems and batteries, ISISpace antenna systems, etc. In the future, NASA IVV plans to distribute NOS3 to other CubeSat developers and release the suite to the open-source community.

Verification↗

Dual Rotating Rake Measurements of Higher-Order Duct Modes: Validation Using Experimental and Numerical Data

A rotating rake mode measurement system was designed to measure acoustic duct modes generated by a fan stage. After analysis of the measured data, the mode coefficient amplitudes and phases were quantified. Early studies using this system found that mode power levels computed from rotating rake measured data would agree with the far-field power levels. However, this agreement required that the sound from the noise sources within the duct propagated outward from the duct exit without reflection and previous studies suggested conditions could exist where significant reflections could occur. This paper shows that mounting a second rake to the rotating system, with an offset in both the axial and the azimuthal directions, measures the data necessary to determine the modes propagating in both directions within a duct. The rotating rake data analysis technique was extended to include the data measured by the second rake. The analysis resulted in a set of circumferential mode coefficients at each of the two rake microphone locations. Radial basis functions were then least-squares fit to this data to obtain the radial mode coefficients for the modes propagating in both directions within the duct while accounting for the presence of evanescent modes. The validation of the dual-rotating-rake measurements was conducted using data from a combination of experiments and numerical calculations to compute reflection coefficients and other mode coefficient ratios. Compared to results from analytical and numerical computations, the results from dual-rotating-rake measured data followed the expected trends when frequency, mode number, and duct termination geometry were changed.

Validation↗

A Generic Approach for Inversion of Surface Reflectance over Land: Overview, Application and Validation Using MODIS and LANDSAT8 Data

This paper presents a generic approach developed to derive surface reflectance over land from a variety of sensors. This technique builds on the extensive dataset acquired by the Terra platform by combining MODIS and MISR to derive an explicit and dynamic map of band ratio's between blue and red channels and is a refinement of the operational approach used for MODIS and LANDSAT over the past 15 years. We will present the generic approach and the application to MODIS and LANDSAT data and its validation using the AERONET data.

validation↗

Analysis of Large Civil Tilt Rotor Wind Tunnel Blockage and Validation Using RotCFD

Ground based experiments are often used to understand and measure rotor and airframe aerodynamic performance; however, these experiments have certain limitations. The effects of these limitations are evaluated here using computational fluid dynamic (CFD) modeling techniques. Through this study, data from the 7- by 10-Foot Wind Tunnel experiments of the Large Civil Tilt Rotor (LCTR) at NASA Ames Research Center is validated using CFD. The Reynolds Averages Navier-Stokes solver, RotCFD, is used for the computations. In particular, the effect of the blockage generated by the test hardware on the walls is investigated. To study this problem, simplified geometries such as a flat plate, cube and cylinder are also investigated for blockage effects. This is done to explore if these different geometries can represent the LCTR as a simplified case to reduce computational time and get a quick first understanding of tunnel blockage effects. The focus of this research is to understand the limitations and accuracy of the recent small-scale Large Civil Tilt Rotor wind tunnel test campaigns.

Validation↗

LaSRC (Land Surface Reflectance Code): Overview, Application and Validation Using MODIS, VIIRS, LANDSAT and Sentinel 2 Data's

This paper presents a generic approach developed to derive surface reflectance over land from a variety of sensors. This technique builds on the extensive dataset acquired by the Terra platform by combining MODIS and MISR to derivean explicit and dynamic map of band ratio's between blue and red channels and is a refinement of the operational approach used for MODIS and LANDSAT over the past 15 years. We will present the generic approach and the application to MODIS VIIRS, LANDSAT and Sentinel 2 data's and its validation using the AERONET data.

validation↗

SMAP Instrument Antenna, on Orbit Performance Validation and Verification

NASA’s Soil Moisture Active Passive (SMAP) Mission is currently flying in a 685 km orbit. Featuring a Synthetic Aperture Radar (SAR) and a radiometer sharing the same antenna, SMAP was developed in collaboration between Jet Propulsion Laboratory (JPL) and Goddard Space Flight Center (GSFC). While the radar requirements on the instrument antenna were more benign from an RF point of view, the radiometer requirement were more difficult to meet because of the stability required by the radiometer to operate to its full potential. The instrument antenna performance was predicted by a very detailed RF model and verified by measuring a 1/10th scale model with great accuracy before launch. Once in orbit, we had the opportunity to measure the antenna performance for both the radiometer and the radar and compare it with the predicted performance given by our RF model. This paper discusses the work done both at JPL and GSFC in order to verify and validate the on orbit performance of the SMAP instrument antenna.

reflector antenna↗

On Orbit Performance Validation and Verification of the SMAP Instrument Antenna

NASA’s Soil Moisture Active Passive (SMAP) Mission is currently flying in a 685 km orbit. Featuring a Synthetic Aperture Radar (SAR) and a radiometer sharing the same antenna, SMAP was developed in collaboration between Jet Propulsion Laboratory (JPL) and Goddard Space Flight Center (GSFC). While the radar requirements on the instrument antenna were more benign from an RF point of view, the radiometer requirement were more difficult to meet because of the stability required by the radiometer to operate to its full potential. The instrument antenna performance was predicted by a very detailed RF model and verified by measuring a 1/10th scale model with great accuracy before launch. Once in orbit, we had the opportunity to measure the antenna performance for both the radiometer and the radar and compare it with the predicted performance given by our RF model. This paper discusses the work done both at JPL and GSFC in order to verify and validate the on orbit performance of the SMAP instrument antenna.

offset reflector↗

Seasonal Dependence of SMAP Radiometer-Based Soil Moisture Performance as Observed over Core Validation Sites

The NASA SMAP (Soil Moisture Active Passive) mission provides a global coverage of soil moisture measurements based on its L-band microwave radiometer every 2-3 days at about 40 km resolution. The soil moisture retrieval algorithms model the brightness temperature as a function of soil moisture, surface conditions and vegetation. External data sources inform the algorithms about the surface conditions and vegetation, which enable the retrieval of soil moisture. The inversion process contains uncertainties related to radiometer measurements, forward model assumptions and ancillary data sources. This study focuses on the uncertainties that depend on the seasonal evolution of the surface conditions and vegetation. This study compares the SMAP and core validation site (CVS) soil moisture values over a period of three years to extract the evolution of performance metrics over time. The analysis showed that most CVS that include managed agriculture exhibit significant time-dependent seasonal bias. This bias was linked to seasonal temperature cycle, which is a proxy to several features that can cause seasonally dependent errors in the SMAP product.

core validation site↗

Validation of GOES-17 ABI Reflective Channels Performance: Salar De Uyuni 2018 Field Campaign Results

Validation results from a reflectance-based field campaign at the Salar de Uyuni in Bolivia (September 2018) are presented for GOES-17 and GOES-16 Advanced Baseline Imagers (ABI) reflective channels. The in situ measurements were used to characterize the surface reflectance and the atmosphere in order to constrain a radiative transfer model and predict the reflectance at the top of the atmosphere (TOA), which was then compared to the ABI measurements. The field campaign provides TOA reflectance estimates over several days, allowing assessment of the calibration accuracy and stability of channels 1, 2, 3, 5 and 6 for GOES-17 andGOES-16 ABI. Channel 1 of GOES-17 ABI shows -5.5% bias in comparison to the ground-based predicted TOA. Over 6% bias in GOES-17 B2 was confirmed. A comparison to NOAA-20 VIIRS was also carried on during a near nadir overpass.

validation↗

Stratospheric Aerosol and Gas Experiment III on the International Space Station(SAGE III/ISS) Validation of Three Years of Ozone and Water Vapor Data

The Stratospheric Aerosol and Gas Experiment III (SAGE III) instrument installed on the International Space Station (ISS) has completed three years of data collection and production of science data products. The SAGE III/ISS is a solar and lunar occultation instrument that scans the light from the Sun and Moon through the limb of the Earth’s atmosphere to produce vertical profiles of aerosol, ozone, water vapor, and other trace gases. It continues the legacy of previous SAGE instruments dating back to the 1970s to provide data continuity of stratospheric constituents critical for assessing trends in the ozone layer. This presentation shows the validation results of comparing SAGE III/ISS ozone and water vapor vertical profiles with those of in situ and satellite data.

SAGE III ISS ozone water vapor validation↗

Validation of the ASTER Thermal Infrared Surface Radiance Data Product

The Advanced Spaceborne Thermal Emission and reflection Radiometer (ASTER) is a 14 channel high spatial resolution instrument selected for flight on the EOS AM-1 platform...To provide an objective assessment of the validity of the atmospheric correction, in situ measurements of water surfaces under a variety of atmospheric conditions will be used to estimate the surface leaving radiance at the scale of an ASTER pixel... These measurements and the spectral emissivity of the water will be combined with the relative system spectral response to provide and estimater of thermal infrared surface leaving radiance for each ASTER thermal channel. An example of this approach using a multichannel thermal aircraft scanner as a stand in for ASTER will be described.

ASTER↗