Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Development of Algorithms and Error Analyses for the Short Baseline Lightning Detection and Ranging System

NASA, at the John F. Kennedy Space Center (KSC), developed and operates a unique high-precision lightning location system to provide lightning-related weather warnings. These warnings are used to stop lightning- sensitive operations such as space vehicle launches and ground operations where equipment and personnel are at risk. The data is provided to the Range Weather Operations (45th Weather Squadron, U.S. Air Force) where it is used with other meteorological data to issue weather advisories and warnings for Cape Canaveral Air Station and KSC operations. This system, called Lightning Detection and Ranging (LDAR), provides users with a graphical display in three dimensions of 66 megahertz radio frequency events generated by lightning processes. The locations of these events provide a sound basis for the prediction of lightning hazards. This document provides the basis for the design approach and data analysis for a system of radio frequency receivers to provide azimuth and elevation data for lightning pulses detected simultaneously by the LDAR system. The intent is for this direction-finding system to correct and augment the data provided by LDAR and, thereby, increase the rate of valid data and to correct or discard any invalid data. This document develops the necessary equations and algorithms, identifies sources of systematic errors and means to correct them, and analyzes the algorithms for random error. This data analysis approach is not found in the existing literature and was developed to facilitate the operation of this Short Baseline LDAR (SBLDAR). These algorithms may also be useful for other direction-finding systems using radio pulses or ultrasonic pulse data.

Starr, Stanley O.↗

EPA requirements and programs

The proposed ERTS-DCS system is designed to allow EPA the capability to evaluate, through demonstrable hardware, the effectiveness of automated data collection techniques. The total effectiveness of any system is dependent upon many factors which include equipment cost, installation, maintainability, logistic support, growth potential, flexibility and failure rate. This can best be accomplished by installing the system at an operational environmental control agency (CAMP station) to insure that valid data is being obtained and processed. Consequently, it is imperative that the equipment interface must not compromise the validity of the sensor data nor should the experimental system effect the present operations of the CAMP station. Since both the system which is presently in use and the automatic system would be in operation in parallel, conformation and comparison are readily obtained.

Koutsandreas, J. D.↗

Can MODIS Data Calibrate and Validate Coastal Sediment Transport Models? Rapid Prototyping Using 250 m Data and the ECOMSED Model for Lake Pontchartrain, LA USA

Field measurements from small boats and sparse arrays of instrumented buoys often do not provide sufficient data to capture the dynamic nature of biogeophysical parameters in may coastal aquatic environments. Several investigators have shown the MODIS 250 m images can provide daily synoptic views of suspended sediment concentration in coastal waters to determine sediment transport and fate. However, the use of MODIS for coastal environments can be limited due to a lack of cloud-free images. Sediment transport models are not constrained by sky conditions but often suffer from a lack of in situ observations for model calibration or validation. We demonstrate here the utility of MODIS 250 m to calibrate (set model parameters), validate output, and set or reset initial conditions of a hydrodynamic and sediment transport model (ECOMSED) developed for Lake Pontchartrain, LA USA. We present our approach in the context of how to quickly assess of 'prototype' an application of NASA data to support environmental managers and decision makers. The combination of daily MODIS imagery and model simulations offer a more robust monitoring and prediction system of suspended sediments than available from either system alone.

Miller, Richard L.↗

Statistical analysis of general aviation VG-VGH data

To represent the loads spectra of general aviation aircraft operating in the Continental United States, VG and VGH data collected since 1963 in eight operational categories were processed and analyzed. Adequacy of data sample and current operational categories, and parameter distributions required for valid data extrapolation were studied along with envelopes of equal probability of exceeding the normal load factor (n sub z) versus airspeed for gust and maneuver loads and the probability of exceeding current design maneuver, gust, and landing impact n sub z limits. The significant findings are included.

Clay, L. E.↗

A verification library for multibody simulation software

A multibody dynamics verification library, that maintains and manages test and validation data is proposed, based on RRC Robot arm and CASE backhoe validation and a comparitive study of DADS, DISCOS, and CONTOPS that are existing public domain and commercial multibody dynamic simulation programs. Using simple representative problems, simulation results from each program are cross checked, and the validation results are presented. Functionalities of the verification library are defined, in order to automate validation procedure.

Kim, Sung-Soo↗

Snow Depth from AMSR-2 Using Multispectral Satellite Data in an Artificial Neural Network

By using diffusion theory and Monte Carlo lidar radiative transfer simulations, Hu et al. (2022b) has derived snow depth from the first-, second- and third-order moments of the lidar backscattering pathlength distribution. Lu et al. (2022) calculated the snow depth by applying the methods to the satellite ICESat-2 lidar measurements over the Arctic sea ice, as well as land surfaces of Northern Hemisphere. In this paper, an artificial neural network (ANN) algorithm, employing several channels from Advanced Microwave Scanning Radiometer 2 (AMSR-2) and the humidity vertical profiles from Global Modeling and Assimilation Office (GMAO) Goddard Earth Observing System for Instrument Teams (GEOS-IT) product, is trained to determine snow depth identified by time and geolocation matched 2019 ICESat-2 snow-depth data during winter months over the Arctic sea ice. The trained ANN snow-depth was applied to 2018 AMSR-2 clear pixel data, although the algorithms perform reasonably well in thinner clouds. The validation data (different from the training set) of ANN snow depth from AMSR-2 showed a good agreement with time matched and co-located snow-depth values from ICESat-2. The bias was near zero, with mean absolute error (MAE) 0.05 cm and a root-mean-square-error (RMSE) 0.08 cm. Prior applying the trained ANN snow depth to AMSR-2 data, a cloud screening algorithm was developed with a similar approach. A separate ANN cloud mask was trained to determine an AMSR-2 pixel is clear or cloudy with time and geolocation matched 2015 CALIOP Vertical Feature Mask (VFM) over Arctic sea ice. The ANN cloud mask from AMSR-2 under-estimated cloud fraction by 3-6% compared to CALIOP . The additional research is needed to conclusively evaluate the ANN cloud mask accuracy. Finally, this paper will lay the foundation for a sustained long-term snowfall and snow-storm monitoring system. The future Cloud Aerosol LIdar for Global scale Observations of the ocean-Land Atmosphere system (CALIGOLA) mission will provide a means to calculate snow depth from the lidar backscattering pathlength distribution, benefiting from the UV, visible and infrared pulses. With the calculated snow depth as the truth one could develop a machine learning algorithm, as it was done in this paper, using a passive microwave instrument available at that time to generate a wide range of snow depth data, covering extensive spatial areas in the cross-orbit direction.

Neural Network↗

SAGE III/ISS Validation Methods

Spatiotemporal collocation of measurements between instruments is an essential yet challenging component of the data validation process. Traditional methods of collocation may simply consider length of time and physical distance between measurements. However, the distribution of atmospheric constituents may change rapidly over time and space, so care must be taken to ensure that matched measurements represent the same environment and will not introduce unnecessary bias. More advanced collocation methods may consider additional physical parameters to minimize inappropriate matches with large differences caused by local circulation. We report results of SAGE III/ISS validation with ground-based measurements using advanced collocation methods, and assessments are performed on the quality and presence of trends in both datasets.

Mary Cate McKee↗

Range validation using Kalman filter techniques

Range pseudo-residuals may be improved to the level required for data validation by a measurement updating process which utilizes Bierman's adaptation of the Kalman filter measurement updating algorithms together with process noise compensation to account for model errors. This algorithm involves combining the currently available range predictions and measurements to produce an updated range residual measurement whose accuracy is constrained by the range data quality and by the estimated error in the prediction. The algorithm is compact and fast, and is thus suitable for on-line applications in network control or at the station.

Madrid, G. A.↗

Aeroservoelastic Model Validation and Test Data Analysis of the F/A-18 Active Aeroelastic Wing

Model validation and flight test data analysis require careful consideration of the effects of uncertainty, noise, and nonlinearity. Uncertainty prevails in the data analysis techniques and results in a composite model uncertainty from unmodeled dynamics, assumptions and mechanics of the estimation procedures, noise, and nonlinearity. A fundamental requirement for reliable and robust model development is an attempt to account for each of these sources of error, in particular, for model validation, robust stability prediction, and flight control system development. This paper is concerned with data processing procedures for uncertainty reduction in model validation for stability estimation and nonlinear identification. F/A-18 Active Aeroelastic Wing (AAW) aircraft data is used to demonstrate signal representation effects on uncertain model development, stability estimation, and nonlinear identification. Data is decomposed using adaptive orthonormal best-basis and wavelet-basis signal decompositions for signal denoising into linear and nonlinear identification algorithms. Nonlinear identification from a wavelet-based Volterra kernel procedure is used to extract nonlinear dynamics from aeroelastic responses, and to assist model development and uncertainty reduction for model validation and stability prediction by removing a class of nonlinearity from the uncertainty.

Brenner, Martin J.↗

Comparison of Organ Dose and Dose Equivalent Using Ray Tracing of Male and Female Voxel Phantoms to Space Flight Phantom Torso Data

Phantom torso experiments have been flown on the space shuttle and International Space Station (ISS) providing validation data for radiation transport models of organ dose and dose equivalents. We describe results for space radiation organ doses using a new human geometry model based on detailed Voxel phantoms models denoted for males and females as MAX (Male Adult voXel) and Fax (Female Adult voXel), respectively. These models represent the human body with much higher fidelity than the CAMERA model currently used at NASA. The MAX and FAX models were implemented for the evaluation of directional body shielding mass for over 1500 target points of major organs. Radiation exposure to solar particle events (SPE), trapped protons, and galactic cosmic rays (GCR) were assessed at each specific site in the human body by coupling space radiation transport models with the detailed body shielding mass of MAX/FAX phantom. The development of multiple-point body-shielding distributions at each organ site made it possible to estimate the mean and variance of space dose equivalents at the specific organ. For the estimate of doses to the blood forming organs (BFOs), active marrow distributions in adult were accounted at bone marrow sites over the human body. We compared the current model results to space shuttle and ISS phantom torso experiments and to calculations using the CAMERA model.

Kim, Myung-Hee Y.↗

Computational simulation of liquid fuel rocket injectors

A major component of any liquid propellant rocket is the propellant injection system. Issues of interest include the degree of liquid vaporization and its impact on the combustion process, the pressure and temperature fields in the combustion chamber, and the cooling of the injector face and chamber walls. The Finite Difference Navier-Stokes (FDNS) code is a primary computational tool used in the MSFC Computational Fluid Dynamics Branch. The branch has dedicated a significant amount of resources to development of this code for prediction of both liquid and solid fuel rocket performance. The FDNS code is currently being upgraded to include the capability to model liquid/gas multi-phase flows for fuel injection simulation. An important aspect of this effort is benchmarking the code capabilities to predict existing experimental injection data. The objective of this MSFC/ASEE Summer Faculty Fellowship term was to evaluate the capabilities of the modified FDNS code to predict flow fields with liquid injection. Comparisons were made between code predictions and existing experimental data. A significant portion of the effort included a search for appropriate validation data. Also, code simulation deficiencies were identified.

Landrum, D. Brian↗

A Whale of a Tale: Creating Spacecraft Telemetry Data Analysis Products for the Deep Impact Mission

A description of the Whale product generation utility and its means of analyzing project data for Deep Impact Missions is presented. The topics include: 1) Whale Definition; 2) Whale Overview; 3) Whale Challenges; 4) Network Configuration; 5) Network Diagram; 6) Whale Data Flow: Design Decisions; 7) Whale Data Flow Diagram; 8) Whale Data Flow; 9) Whale Team and Users; 10) Creeping Requirements; 11) Whale Competition; 12) Statistics: Processing Time; 13) CPU and Disk Usage; 14) The Ripple Effect of More Data; and 15) Data Validation and the Automation Challenge.

ground data systems↗

3D Material Response of the MSL Heatshield Using NuSil-Coated PICA

The Mars Science Laboratory (MSL) was protected during its atmospheric entry by an instrumented heatshield that used NASA's Phenolic Impregnated Carbon Ablator (PICA) material [1]. PICA is a lightweight carbon fiber/polymeric resin material that offers outstanding performance for protecting probes during planetary entry. Data from the Mars Entry Descent and Landing Instrument (MEDLI) suite on MSL offers unique in-flight validation data for models of material response and atmospheric entry. MEDLI recorded, among other things, time-resolved in-depth temperature data of PICA using thermocouple sensors assembled in the MEDLI Integrated Sensor Plugs (MISP) [2]. A space-grade silicone-based coating commercially known as NuSil CV-1144-0 [3] was applied to the entire MSL heatshield, including the MEDLI plugs, to mitigate the spread of dust from PICA. Modeling the thermal response of PICA-NuSil (PICA-N) system is still an open challenge. Ground testing of PICA-N models exhibited surface temperature jumps of the order of 150 K due to oxide scale formation and sub-sequent NuSil burn-off. It is therefore critical to include a validated model for the material response of the coating in engineering codes. A test campaign has been conducted at the NASA’s Langley HyMETS [4] facility to screen the response of PICA-N and gather detailed data on its behavior [5]. A first model of PICA-N thermal response has been developed using the Hy-METS experiments [6]. The objective of this work is to analyze the material response of the latest PICA-N model compared to the engineering model used to simulate the entry of MSL. The environment and material response around the MSL aeroshell during Mars atmospheric entry is simulated using a collection of tools. The Direct Simulation Monte Carlo SPARTA code [7] is used in the rarefied regime, the Data Parallel Line Relaxation (DPLR) code [8] is used in the continuum regime and radiative heating conditions are provided by the Nonequilibrium air radiation (NEQAIR) code [9] to estimate the environmental conditions. The thermal response inside the material is computed using the Porous material Analysis Toolbox based on Open-FOAM (PATO) [10,11,12]. Thermodynamic and chemistry properties are estimated using the Mutation++ library [13]. The approach implemented in PATO as a first cut PICA-N thermal response model is outlined in Figure 1. While the recession is less than the coating thickness, the Surface mass and energy balance Boundary Condition (SBC) uses the NuSil B’ tables. Once the recession removes the coating, the usual PICA B’ tables are used for the SBC. The B’ tables are computed using an equilibrium solver implemented in Mutation++, given the temperature, pressure, blowing rate, composition of the pyrolysis and environment gases, and the condensed species at the surface. Preliminary results of the 3D material response of the MSL heat-shield at the peak heating (80 sec after Entry Interface) are shown in Figure 2. Current NASA’s mission to Mars, Mars 2020, used the spare heatshield of MSL for thermal protection during entry, descent, and landing. In preparation for Mars 2020 post-flight analysis, the PATO high-fidelity material response capability was benchmarked against flight data from MEDLI. This effort represents an important milestone toward the development of validated predictive capabilities for designing thermal protection systems for planetary probes. This bench-marking is awaiting the final release of the MEDLI-2 data.

Aerospace↗

A Machine Learning Approach to Jet-Surface Interaction Noise Modeling

This paper investigates using machine learning to rapidly develop empirical models suitable for system-level aircraft noise studies. In particular, machine learning is used to train a neural network to predict the noise spectra produced by a round jet near a surface over a range of surface lengths, surface standoff distances, jet Mach numbers, and observer angles. These spectra include two sources, jet-mixing noise and jet-surface interaction (JSI) noise, with different scale factors as well as surface shielding and reflection effects to create a multi- dimensional problem. A second model is then trained using data from three rectangular nozzles to include nozzle aspect ratio in the spectral prediction. The training and validation data are from an extensive jet-surface interaction noise database acquired at the NASA Glenn Research Center's Aero-Acoustic Propulsion Laboratory. Although the number of training and validation points is small compared a typical machine learning application, the results of this investigation show that this approach is viable if the underlying data are well behaved.

Brown, Cliff↗

Mars Sample Return Earth Entry System Woven Roughness Mach 6 Aeroheating Test

The Mars Sample Return Earth Entry System is the first entry vehicle designed for a NASA flagship mission to utilize a woven thermal protection system as well as a 52.5 degree sphere cone forebody geometry. As a result, no heritage aeroheating experimental data set exists to compare with computational predictions. In order to obtain a set of validation data for computational models, an extensive wind tunnel test campaign was funded by the Mars Sample Return Earth Entry System project. The first entry in the test campaign was completed in April of 2023, which was an investigation of turbulent heating augmentation due to woven thermal protection system roughness on the 52.5 degree Mars Sample Return - Earth Entry System vehicle forebody geometry. This test entry produced the first ever experimental aeroheating data on a 52.5 degree sphere-cone geometry as well as the first NASA experimental aeroheating data on a woven surface roughness pattern. Data obtained from this test campaign is being directly leveraged to support the NASA flight program, as experimental results are being utilized to validate the computational models which characterize the aeroheating environment that the vehicle experiences and predict turbulent surface heating levels and margins across the woven surface.

Jonathan S Cheatwood↗

Mars Sample Return Earth Entry System Woven Roughness Mach 6 Aeroheating Test

The Mars Sample Return Earth Entry System is the first entry vehicle designed for a NASA flagship mission to utilize a woven thermal protection system as well as a 52.5 degree sphere cone forebody geometry. As a result, no heritage aeroheating experimental data set exists to compare with computational predictions. In order to obtain a set of validation data for computational models, an extensive wind tunnel test campaign was funded by the Mars Sample Return Earth Entry System project. The first entry in the test campaign was completed in April of 2023, which was an investigation of turbulent heating augmentation due to woven thermal protection system roughness on the 52.5 degree Mars Sample Return - Earth Entry System vehicle forebody geometry. This test entry produced the first ever experimental aeroheating data on a 52.5 deg sphere-cone geometry as well as the first NASA experimental aeroheating data on a woven surface roughness pattern. Data obtained from this test campaign is being directly leveraged to support the NASA flight program, as experimental results are being utilized to validate the computational models which characterize the aeroheating environment that the vehicle experiences and predict turbulent surface heating levels and margins across the woven surface.

Jonathan Cheatwood↗

Nitric Oxide and Oxygen Air-Contamination Effects on Extinction Limits of Non-Premixed Hydrocarbon-Air Flames for a HIFiRE Scramjet

Unique nitric oxide (NO) and oxygen air-contamination effects on the extinction Flame Strength (FS) of non-premixed hydrocarbon (HC) vs. air flames are characterized for 7 gaseous HCs, using a new idealized 9.3 mm straight-tube Opposed Jet Burner (OJB) at 1 atm. FS represents a laminar strain-induced extinction limit based on cross-section-average air jet velocity, Uair, that sustains combustion of a counter jet of gaseous fuel just before extinction. Besides ethane, propane, butane, and propylene, the HCs include ethylene, methane, and a 64 mole-% ethylene / 36 % methane mixture, the writer s previously recommended gaseous surrogate fuel for HIFiRE scramjet tests. The HC vs. clean air part of the work is an extension of a May 2008 JANNAF paper that characterized surrogates for the HIFiRE project that should mimic the flameholding of reformed (thermally- or catalytically-cracked) endothermic JP-like fuels. The new FS data for 7 HCs vs. clean air are thus consolidated with the previously validated data, normalized to absolute (local) axial-input strain rates, and co-plotted on a dual kinetically dominated reactivity scale. Excellent agreement with the prior data is obtained for all 7 fuels. Detailed comparisons are also made with recently published (Univ. Va) numerical results for ethylene extinction. A 2009-revised ethylene kinetic model (Univ. Southern Cal) led to predicted limits within approx. 5 % (compared to 45 %, earlier) of this writer s 2008 (and present) ethylene FSs, and also with recent independent data (Univ. Va) obtained on a new OJB system. These +/- 5 % agreements, and a hoped-for "near-identically-performing" reduced kinetics model, would greatly enhance the capability for accurate numerical simulations of surrogate HC flameholding in scramjets. The measured air-contamination effects on normalized FS extinction limits are projected to assess ongoing Arc-Heater-induced "facility test effects" of NO production (e.g., 3 mole-%) and resultant oxygen depletion (from 21 to 19.5 %), for testing the "64/36" surrogate fuel in Langley s Arc-Heated Scramjet Test Facility for HIFiRE engine designs. The FS results show a generally small (< 4 %) "nitric oxide enhancement" effect, relative to clean air, for up to 3 % NO (freestream Mach number up to 7 in Arc Jet testing). However, a progressively large "oxygendeficiency weakening" effect develops. For 3 % NO, a net weakening of 26 % in FS is derived for the "64/36" fuel vs. air. The corresponding net weakening for pure ethylene is 20 %. A number of practical recommendations regarding facility test effects are offered.

Pellett, Gerald L.↗

Advanced Optical Diagnostics for Ice Crystal Cloud Measurements in the NASA Glenn Propulsion Systems Laboratory

A light extinction tomography technique has been developed to monitor ice water clouds upstream of a direct connected engine in the Propulsion Systems Laboratory (PSL) at NASA Glenn Research Center (GRC). The system consists of 60 laser diodes with sheet generating optics and 120 detectors mounted around a 36-inch diameter ring. The sources are pulsed sequentially while the detectors acquire line-of-sight extinction data for each laser pulse. Using computed tomography algorithms, the extinction data are analyzed to produce a plot of the relative water content in the measurement plane. To target the low-spatial-frequency nature of ice water clouds, unique tomography algorithms were developed using filtered back-projection methods and direct inversion methods that use Gaussian basis functions. With the availability of a priori knowledge of the mean droplet size and the total water content at some point in the measurement plane, the tomography system can provide near real-time in-situ quantitative full-field total water content data at a measurement plane approximately 5 feet upstream of the engine inlet. Results from ice crystal clouds in the PSL are presented. In addition to the optical tomography technique, laser sheet imaging has also been applied in the PSL to provide planar ice cloud uniformity and relative water content data during facility calibration before the tomography system was available and also as validation data for the tomography system. A comparison between the laser sheet system and light extinction tomography resulting data are also presented. Very good agreement of imaged intensity and water content is demonstrated for both techniques. Also, comparative studies between the two techniques show excellent agreement in calculation of bulk total water content averaged over the center of the pipe.

Bencic, Timothy J.↗