Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32

Serial Network Flow Monitor

Using a commercial software CD and minimal up-mass, SNFM monitors the Payload local area network (LAN) to analyze and troubleshoot LAN data traffic. Validating LAN traffic models may allow for faster and more reliable computer networks to sustain systems and science on future space missions. Research Summary: This experiment studies the function of the computer network onboard the ISS. On-orbit packet statistics are captured and used to validate ground based medium rate data link models and enhance the way that the local area network (LAN) is monitored. This information will allow monitoring and improvement in the data transfer capabilities of on-orbit computer networks. The Serial Network Flow Monitor (SNFM) experiment attempts to characterize the network equivalent of traffic jams on board ISS. The SNFM team is able to specifically target historical problem areas including the SAMS (Space Acceleration Measurement System) communication issues, data transmissions from the ISS to the ground teams, and multiple users on the network at the same time. By looking at how various users interact with each other on the network, conflicts can be identified and work can begin on solutions. SNFM is comprised of a commercial off the shelf software package that monitors packet traffic through the payload Ethernet LANs (local area networks) on board ISS.

Robinson, Julie A.↗

Simulation for Prediction of Entry Article Demise (SPEAD): An Analysis Tool for Spacecraft Safety Analysis and Ascent/Reentry Risk Assessment

For the purpose of performing safety analysis and risk assessment for a potential off-nominal atmospheric reentry resulting in vehicle breakup, a synthesis of trajectory propagation coupled with thermal analysis and the evaluation of node failure is required to predict the sequence of events, the timeline, and the progressive demise of spacecraft components. To provide this capability, the Simulation for Prediction of Entry Article Demise (SPEAD) analysis tool was developed. The software and methodology have been validated against actual flights, telemetry data, and validated software, and safety/risk analyses were performed for various programs using SPEAD. This report discusses the capabilities, modeling, validation, and application of the SPEAD analysis tool.

Ling, Lisa↗

An Enriched Shell Finite Element for Progressive Damage Simulation in Composite Laminates

A formulation is presented for an enriched shell nite element capable of progressive damage simulation in composite laminates. The element uses a discrete adaptive splitting approach for damage representation that allows for a straightforward model creation procedure based on an initially low delity mesh. The enriched element is veri ed for Mode I, Mode II, and mixed Mode I/II delamination simulation using numerical benchmark data. Experimental validation is performed using test data from a delamination-migration experiment. Good correlation was found between the enriched shell element model results and the numerical and experimental data sets. The work presented in this paper is meant to serve as a rst milestone in the enriched element's development with an ultimate goal of simulating three-dimensional progressive damage processes in multidirectional laminates.

McElroy, Mark W.↗

Magnetospheric Multiscale Instrument Suite Operations and Data System

The four Magnetospheric Multiscale (MMS) spacecraft will collect a combined volume of approximately 100 gigabits per day of particle and field data. On average, only 4 gigabits of that volume can be transmitted to the ground. To maximize the scientific value of each transmitted data segment, MMS has developed the Science Operations Center (SOC) to manage science operations, instrument operations, and selection, downlink, distribution, and archiving of MMS science data sets. The SOC is managed by the Laboratory for Atmospheric and Space Physics (LASP) in Boulder, Colorado and serves as the primary point of contact for community participation in the mission. MMS instrument teams conduct their operations through the SOC, and utilize the SOC's Science Data Center (SOC) for data management and distribution. The SOC provides a single mission data archive for the housekeeping and science data, calibration data, ephemerides, attitude and other ancillary data needed to support the scientific use and interpretation. All levels of data products will reside at and be publicly disseminated from the SDC. Documentation and metadata describing data products, algorithms, instrument calibrations, validation, and data quality will be provided. Arguably, the most important innovation developed by the SOC is the MMS burst data management and selection system. With nested automation and 'Scientist-in-the-Loop' (SITL) processes, these systems are designed to maximize the value of the burst data by prioritizing the data segments selected for transmission to the ground. This paper describes the MMS science operations approach, processes and data systems, including the burst system and the SITL concept.

Baker, D. N.↗

Storm severity detection (RF)

Atmospheric electrical emissions occurring in association with Hurricane Alicia were observed by two crossed baseline phase linear interferometers. The sensors were located in San Antonio, Texas, and at Marshall Space Flight Center (MSFC), Huntsville, Alabama. An analysis of the data has indicated that the direction finding (DF) performance of the San Antonio site was extremely good while the DF performance at the MSFC site evidenced erratic behavior. A check of the data acquisition hardware revealed an intermitted problem in one of the radio receiver channels. Since the system has experienced several lightning strikes during the early spring of 1984, it was necessary to ship the entire rack of equipment back to SwRI for refurbishment. Analysis of the DF data from the interferometer site at San Antonio is being done. A limited subset of the MSFC data acquired during Hurricane Alicia has been found to be valid. These were data which satisfied the phase linearity criteria. Approximately 2,000 location estimates have been produced on the valid data. The results of the DF analysis and the location data are being correlated with the McIDAS data base at Marshall Space Flight Center, and with the radar summary data provided by the Hurricane Research Division using the National weather Service radar Facility at Galveston, Texas.

Johnson, R. L.↗

A Comprehensive Plan for the Long-Term Calibration and Validation of Oceanic Biogeochemical Satellite Data

The primary objective of this planning document is to establish a long-term capability and validating oceanic biogeochemical satellite data. It is a pragmatic solution to a practical problem based primarily o the lessons learned from prior satellite missions. All of the plan's elements are seen to be interdependent, so a horizontal organizational scheme is anticipated wherein the overall leadership comes from the NASA Ocean Biology and Biogeochemistry (OBB) Program Manager and the entire enterprise is split into two components of equal sature: calibration and validation plus satellite data processing. The detailed elements of the activity are based on the basic tasks of the two main components plus the current objectives of the Carbon Cycle and Ecosystems Roadmap. The former is distinguished by an internal core set of responsibilities and the latter is facilitated through an external connecting-core ring of competed or contracted activities. The core elements for the calibration and validation component include a) publish protocols and performance metrics; b) verify uncertainty budgets; c) manage the development and evaluation of instrumentation; and d) coordinate international partnerships. The core elements for the satellite data processing component are e) process and reprocess multisensor data; f) acquire, distribute, and archive data products; and g) implement new data products. Both components have shared responsibilities for initializing and temporally monitoring satellite calibration. Connecting-core elements include (but are not restricted to) atmospheric correction and characterization, standards and traceability, instrument and analysis round robins, field campaigns and vicarious calibration sites, in situ database, bio-optical algorithm (and product) validation, satellite characterization and vicarious calibration, and image processing software. The plan also includes an accountability process, creating a Calibration and Validation Team (to help manage the activity), and a discussion of issues associated with the plan's scientific focus.

Hooker, Stanford B.↗

Soil Moisture Active Passive Mission L4_SM Data Product Assessment (Version 2 Validated Release)

During the post-launch SMAP calibration and validation (Cal/Val) phase there are two objectives for each science data product team: 1) calibrate, verify, and improve the performance of the science algorithm, and 2) validate the accuracy of the science data product as specified in the science requirements and according to the Cal/Val schedule. This report provides an assessment of the SMAP Level 4 Surface and Root Zone Soil Moisture Passive (L4_SM) product specifically for the product's public Version 2 validated release scheduled for 29 April 2016. The assessment of the Version 2 L4_SM data product includes comparisons of SMAP L4_SM soil moisture estimates with in situ soil moisture observations from core validation sites and sparse networks. The assessment further includes a global evaluation of the internal diagnostics from the ensemble-based data assimilation system that is used to generate the L4_SM product. This evaluation focuses on the statistics of the observation-minus-forecast (O-F) residuals and the analysis increments. Together, the core validation site comparisons and the statistics of the assimilation diagnostics are considered primary validation methodologies for the L4_SM product. Comparisons against in situ measurements from regional-scale sparse networks are considered a secondary validation methodology because such in situ measurements are subject to up-scaling errors from the point-scale to the grid cell scale of the data product. Based on the limited set of core validation sites, the wide geographic range of the sparse network sites, and the global assessment of the assimilation diagnostics, the assessment presented here meets the criteria established by the Committee on Earth Observing Satellites for Stage 2 validation and supports the validated release of the data. An analysis of the time average surface and root zone soil moisture shows that the global pattern of arid and humid regions are captured by the L4_SM estimates. Results from the core validation site comparisons indicate that "Version 2" of the L4_SM data product meets the self-imposed L4_SM accuracy requirement, which is formulated in terms of the ubRMSE: the RMSE (Root Mean Square Error) after removal of the long-term mean difference. The overall ubRMSE of the 3-hourly L4_SM surface soil moisture at the 9 km scale is 0.035 cubic meters per cubic meter requirement. The corresponding ubRMSE for L4_SM root zone soil moisture is 0.024 cubic meters per cubic meter requirement. Both of these metrics are comfortably below the 0.04 cubic meters per cubic meter requirement. The L4_SM estimates are an improvement over estimates from a model-only SMAP Nature Run version 4 (NRv4), which demonstrates the beneficial impact of the SMAP brightness temperature data. L4_SM surface soil moisture estimates are consistently more skillful than NRv4 estimates, although not by a statistically significant margin. The lack of statistical significance is not surprising given the limited data record available to date. Root zone soil moisture estimates from L4_SM and NRv4 have similar skill. Results from comparisons of the L4_SM product to in situ measurements from nearly 400 sparse network sites corroborate the core validation site results. The instantaneous soil moisture and soil temperature analysis increments are within a reasonable range and result in spatially smooth soil moisture analyses. The O-F residuals exhibit only small biases on the order of 1-3 degrees Kelvin between the (re-scaled) SMAP brightness temperature observations and the L4_SM model forecast, which indicates that the assimilation system is largely unbiased. The spatially averaged time series standard deviation of the O-F residuals is 5.9 degrees Kelvin, which reduces to 4.0 degrees Kelvin for the observation-minus-analysis (O-A) residuals, reflecting the impact of the SMAP observations on the L4_SM system. Averaged globally, the time series standard deviation of the normalized O-F residuals is close to unity, which would suggest that the magnitude of the modeled errors approximately reflects that of the actual errors. The assessment report also notes several limitations of the "Version 2" L4_SM data product and science algorithm calibration that will be addressed in future releases. Regionally, the time series standard deviation of the normalized O-F residuals deviates considerably from unity, which indicates that the L4_SM assimilation algorithm either over- or under-estimates the actual errors that are present in the system. Planned improvements include revised land model parameters, revised error parameters for the land model and the assimilated SMAP observations, and revised surface meteorological forcing data for the operational period and underlying climatological data. Moreover, a refined analysis of the impact of SMAP observations will be facilitated by the construction of additional variants of the model-only reference data. Nevertheless, the “Version 2” validated release of the L4_SM product is sufficiently mature and of adequate quality for distribution to and use by the larger science and application communities.

SMAP L4_SM↗

PACE Technical Report Series, Volume 11: The PACE Postlaunch Airborne eXperiment (PACE-PAX)

The Plankton, Aerosol, Cloud, ocean Ecosystem (PACE; https://pace.gsfc.nasa.gov) mission is NASA's latest and greatest effort to study the ocean-atmosphere system and build upon the legacy of previous satellite missions that have revolutionized our understanding of our home planet. By using advanced radiometric and polarimetric instruments to measure ocean color and key atmospheric variables, PACE aims to provide new insights into the complex interactions between the ocean, atmosphere, and biosphere. This information will be critical for improving our ability to model and predict changes in the Earth's climate, as well as to manage and conserve our planet's valuable natural resources. Performance assessments and science data product validation is a critical process for any Earth Science space-borne mission, as it involves assessing and verifying the quality of the data products generated by the mission while it is in orbit, as well as assigning uncertainties to these retrievals. More specifically, validation efforts are essential for assessing the accuracy of instrument data and the derived science products across varied spatial and temporal scales and ensuring their reliability and consistency with the mission's scientific goals and objectives. The overall plan for validation of PACE data is described in “PACE Science Data Product Validation Plan” (see, e.g., https://pace.gsfc.nasa.gov), and among range of post-launch activities, it describes the need and requirements for a post-launch airborne field campaign in support of PACE validation. This volume outlines the plans and requirements of the PACE Postlaunch Airborne eXperiment (PACE-PAX). The main goal of PACE-PAX is to gather validation and assessment data for the PACE mission, using a variety of airborne and ground-based assets. These assets will be coordinated to obtain complementary measurements of key ocean and atmospheric variables, such as ocean color, aerosols, and clouds. By collecting data from multiple sources, PACE-PAX will help to validate and refine the data products generated by the PACE mission, as well as to identify any potential errors or biases in the measurements. This will be essential for ensuring the accuracy and reliability of the PACE data products, and for maximizing the scientific value of the mission.

Kirk D Knobelspiesse↗

Validated environmental and physiological data from the CELSS Breadboard Projects Biomass Production Chamber. BWT931 (Wheat cv. Yecora Rojo)

This KSC database is being made available to the scientific research community to facilitate the development of crop development models, to test monitoring and control strategies, and to identify environmental limitations in crop production systems. The KSC validated dataset consists of 17 parameters necessary to maintain bioregenerative life support functions: water purification, CO2 removal, O2 production, and biomass production. The data are available on disk as either a DATABASE SUBSET (one week of 5-minute data) or DATABASE SUMMARY (daily averages of parameters). Online access to the VALIDATED DATABASE will be made available to institutions with specific programmatic requirements. Availability and access to the KSC validated database are subject to approval and limitations implicit in KSC computer security policies.

Stutte, G. W.↗

An RL10A-3-3A rocket engine model using the rocket engine transient simulator (ROCETS) software

Steady-state and transient computer models of the RL10A-3-3A rocket engine have been created using the Rocket Engine Transient Simulation (ROCETS) code. These models were created for several purposes. The RL10 engine is a critical component of past, present, and future space missions; the model will give NASA an in-house capability to simulate the performance of the engine under various operating conditions and mission profiles. The RL10 simulation activity is also an opportunity to further validate the ROCETS program. The ROCETS code is an important tool for modeling rocket engine systems at NASA Lewis. ROCETS provides a modular and general framework for simulating the steady-state and transient behavior of any desired propulsion system. Although the ROCETS code is being used in a number of different analysis and design projects within NASA, it has not been extensively validated for any system using actual test data. The RL10A-3-3A has a ten year history of test and flight applications; it should provide sufficient data to validate the ROCETS program capability. The ROCETS models of the RL10 system were created using design information provided by Pratt & Whitney, the engine manufacturer. These models are in the process of being validated using test-stand and flight data. This paper includes a brief description of the models and comparison of preliminary simulation output against flight and test-stand data.

Binder, Michael↗

NASA HECC Geometry and Performance Review Part 2: Geometric Differences Between the as-Manufactured and Design-Intent Impeller Geometry and Their Effects on the Vaneless Diffuser Configuration Performance

An investigation of the NASA High Efficiency Centrifugal Compressor (HECC) vaneless diffuser configuration was performed. This multipart investigation focused on validating the computational model against experimental data. The validated model was then used to explore the effects of observed geometric differences between the as-manufactured and design-intent impellers. Lastly, the validated model was used for comparison against an experimental tip clearance study. Details regarding each of the parts are detailed below: This second part of a multipart investigation of the NASA HECC vaneless diffuser configuration focused on the comparison of the as-manufactured HECC vaneless computational model validated in Part I against a new model that used the same grid and solver settings but replaced the impeller section data with the design-intent sections from NASA/CR-2014-218114/Rev1. The 1D performance values showed that the as-manufactured impeller underperformed compared to the design-intent for all four speedlines that were simulated. Further investigation of radial profiles, loading and contours showed consistent underperformance of the as-manufactured. An investigation into the source of the difference led to the discovery of several geometric differences in the two impellers of magnitudes that could not be explained outside of manufacturing. The differences that were observed can be summarized into four categories: fillets, TE exit radius differences, splitter LE differences and main blade thickness differences. The investigation then shifted to attempting to isolate the geometric differences as best as possible and to understand their contribution to the observed underperformance. The investigation showed that out of the four geometric differences that were explored, the differences in the splitter blade had the largest effect.

centrifugal compressor↗

Tropospheric Airborne Meteorological Data Reporting (TAMDAR) Sensor Validation and Verification on National Oceanographic and Atmospheric Administration (NOAA) Lockheed WP-3D Aircraft

As part of the National Aeronautics and Space Administration's Aviation Safety and Security Program, the Tropospheric Airborne Meteorological Data Reporting project (TAMDAR) developed a low-cost sensor for aircraft flying in the lower troposphere. This activity was a joint effort with support from Federal Aviation Administration, National Oceanic and Atmospheric Administration, and industry. This paper reports the TAMDAR sensor performance validation and verification, as flown on board NOAA Lockheed WP-3D aircraft. These flight tests were conducted to assess the performance of the TAMDAR sensor for measurements of temperature, relative humidity, and wind parameters. The ultimate goal was to develop a small low-cost sensor, collect useful meteorological data, downlink the data in near real time, and use the data to improve weather forecasts. The envisioned system will initially be used on regional and package carrier aircraft. The ultimate users of the data are National Centers for Environmental Prediction forecast modelers. Other users include air traffic controllers, flight service stations, and airline weather centers. NASA worked with an industry partner to develop the sensor. Prototype sensors were subjected to numerous tests in ground and flight facilities. As a result of these earlier tests, many design improvements were made to the sensor. The results of tests on a final version of the sensor are the subject of this report. The sensor is capable of measuring temperature, relative humidity, pressure, and icing. It can compute pressure altitude, indicated air speed, true air speed, ice presence, wind speed and direction, and eddy dissipation rate. Summary results from the flight test are presented along with corroborative data from aircraft instruments.

Tsoucalas, George↗

Validation of Real-Time Data Processing for the Ground and Air-MSPI Systems

JPL is currently developing the multi-angle spectro-polarimetric imager (MSPI), targeted for the Aerosol-Cloud-Ecosystems (ACE) mission, as defined in the National Academies 2007 Decadal Survey. In preparation for the space instrument, the MSPI team has built two incremental camera systems (Ground- and Air-MSPI) to improve understanding of the proposed architecture. Ground-MSPI is a gimballed instrument used primarily for stationary observation and characterization of the imager and optics. The ER-2 based Air-MSPI operates in a step-and-stare mode, providing multi-angle imaging of a static target. This mode-of-operation simulates the observation scenario of the space instrument. Physically, MSPI is a pushbroom camera with a specialized frontend. Before imaging, light entering the camera passes through a pair of photoelastic modulators and a set of pattern polarizers. These optical elements act on the light to make polarimetric extraction computationally feasible. Calculating polarimetric parameters from the imager's data stream requires a real-time least-squares computation that produces coefficients of a truncated time-series expansion of the image. As reported in, the data processing algorithm can operate in real-time on a Xilinx Virtex-5 FPGA. Moving beyond verification with an onboard data source, the algorithm has been validated on a commercial development board interfaced with the ground camera. In addition, the algorithm has been instantiated within the Air-MSPI electronics board's FPGA, and in situ first-light has been achieved.

real-time data processing↗

Utilizing Chamber Data for Developing and Validating Climate Change Models

Controlled environment chambers (e.g. growth chambers, SPAR chambers, or open-top chambers) are useful for measuring plant ecosystem responses to climatic variables and CO2 that affect plant water relations. However, data from chambers was found to overestimate responses of C fluxes to CO2 enrichment. Chamber data may be confounded by numerous artifacts (e.g. sidelighting, edge effects, increased temperature and VPD, etc) and this limits what can be measured accurately. Chambers can be used to measure canopy level energy balance under controlled conditions and plant transpiration responses to CO2 concentration can be elucidated. However, these measurements cannot be used directly in model development or validation. The response of stomatal conductance to CO2 will be the same as in the field, but the measured response must be recalculated in such a manner to account for differences in aerodynamic conductance, temperature and VPD between the chamber and the field.

Monje, Oscar↗

Structured Uncertainty Bound Determination From Data for Control and Performance Validation

This report attempts to document the broad scope of issues that must be satisfactorily resolved before one can expect to methodically obtain, with a reasonable confidence, a near-optimal robust closed loop performance in physical applications. These include elements of signal processing, noise identification, system identification, model validation, and uncertainty modeling. Based on a recently developed methodology involving a parameterization of all model validating uncertainty sets for a given linear fractional transformation (LFT) structure and noise allowance, a new software, Uncertainty Bound Identification (UBID) toolbox, which conveniently executes model validation tests and determine uncertainty bounds from data, has been designed and is currently available. This toolbox also serves to benchmark the current state-of-the-art in uncertainty bound determination and in turn facilitate benchmarking of robust control technology. To help clarify the methodology and use of the new software, two tutorial examples are provided. The first involves the uncertainty characterization of a flexible structure dynamics, and the second example involves a closed loop performance validation of a ducted fan based on an uncertainty bound from data. These examples, along with other simulation and experimental results, also help describe the many factors and assumptions that determine the degree of success in applying robust control theory to practical problems.

Lim, Kyong B.↗

Saildrone Baja Field Campaign: A Comparison of Surface Meteorology with GEOS Products

The Saildrone Baja field campaign was an international effort to collect measurements across the air-sea interface for a 62-day period between April 11-June 11, 2018. The field campaign was executed using a saildrone, an unmanned surface vehicle (USV) carrying a comprehensive suite of instruments to measure meteorological, ocean surface, and subsurface data. We use these data to validate near-surface meteorology and ocean surface temperature fields in theGlobal Earth Observing System (GEOS). This is the first study using Saildrone data to validate GEOS products. As these USV platforms become more prevalent, they could be used to improve model representation of the air-sea interface variables.

Akella, Santha↗

NASA's AVE/VAS program

A discussion is presented concerning the Atmospheric Variability Experiment (AVE) which was conducted during the spring of 1982 as part of NASA's Visible and Infrared Spin-Scan Radiometer (VISSR) Atmospheric Sounder (VAS) demonstration. The AVE/VAS Ground Truth Field Experiment is examined in detail, which comprised the obtaining of rawinsonde observations during various meteorological conditions on four different days when VAS data were obtained. These experiments were performed over 24 hr periods in a mesoscale network of 24 National Weather Service rawinsonde sites and 13 NASA and NOAA special sites. The VAS, operating as a part of the GOES satellite system, was employed to provide two-dimensional cloud mapping capability during each of the AVE/VAS experiment periods. Among the goals of this AVE/VAS program, in addition to management of the acquisition and processing of the data, were to perform the research and development needed to produce data products from VAS radiances, to validate the data, and to assess the impact of the data on mesoscale meteorological forecasting and research requirements.

Hill, C. K.↗

TDRSS tracking data and orbit determination evaluation

TDRS-1 was launched on April 4, 1983. This paper presents preliminary results of TDRSS tracking data evaluation through September 1983. TDRSS tracking data evaluation is a summary of valid tracking data that characterizes data quality. TDRS-1 orbit accuracy is evaluated by using orbit consistency measured by comparing overlaps of TDRS-1 ephemerides produced from consecutive data arcs. TDRS-1 and user orbit accuracies and consistencies are also estimated. Orbit accuracy is estimated by comparing user orbits based on tracking data obtained both through the TDRSS and from ground-based tracking.

Campion, R. E.↗