Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “validation data sets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

An Efficient Ray-Tracing Method for Determining Terrain Intercepts in EDL Simulations

The calculation of a ray's intercept from an arbitrary point in space to a prescribed surface is a common task in computer simulations. The arbitrary point often represents an object that is moving according to the simulation, while the prescribed surface is fixed in a defined frame. For detailed simulations, this surface becomes complex, taking the form of real-world objects such as mountains, craters or valleys which require more advanced methods to accurately calculate a ray's intercept location. Incorporation of these complex surfaces has commonly been implemented in graphics systems that utilize highly optimized graphics processing units to analyze such features. This paper proposes a simplified method that does not require computationally intensive graphics solutions, but rather an optimized ray-tracing method for an assumed terrain dataset. This approach was developed for the Mars Science Laboratory mission which landed on the complex terrain of Gale Crater. First, this paper begins with a discussion of the simulation used to implement the model and the applicability of finding surface intercepts with respect to atmosphere modeling, altitude determination, radar modeling, and contact forces influencing vehicle dynamics. Next, the derivation and assumptions of the intercept finding method are presented. Key assumptions are noted making the routines specific to only certain types of surface data sets that are equidistantly spaced in longitude and latitude. The derivation of the method relies on ray-tracing, requiring discussion on the formulation of the ray with respect to the terrain datasets. Further discussion includes techniques for ray initialization in order to optimize the intercept search. Then, the model implementation for various new applications in the simulation are demonstrated. Finally, a validation of the accuracy is presented along with the corresponding data sets used in the validation. A performance summary of the method will be shown using the analysis from the Mars Science Laboratory's terminal descent sensing model. Alternate uses will also be shown for determining horizon maps and orbiter set times.

Shidner, Jeremy D.↗

Identification of Distorted Gamma-Ray Signature Patterns Using Digital Filtering and Auto-Associative Memory Implemented with a Hopfield Neural Network

The detection and identification of radioactive sources in search applications involve analyzing passive gamma-ray emissions from high-level radioactive materials. This process uses a mobile detector-spectrometer in a complex field test environment. Recently, the use of artificial intelligence for gamma-ray spectrum analysis has shown promising results. However, challenges persist in identifying isotopic signatures from spectral measurements that may be distorted due to source shielding, random variations in natural radioactive background, or insufficient measurement time to obtain clear spectral lines. Here, this paper presents a novel intelligent signature recognition method that combines digital filtering techniques with an artificial Hopfield Neural Network (HNN). The HNN leverages auto-associative memory to store training sample patterns and match them with incoming gamma spectra from distorted sources. It restores the testing sources’ measurements by finding the closest matching signature patterns in the spectral library. Before HNN recognition, the measured spectrum undergoes preprocessing with a digital image filter to reduce fluctuations. Performance of the proposed method is evaluated using a set of gamma-ray spectra measured with a sodium iodide detector. The data collected include measurements from six pure samples: 241 Am, 60 Co, 137 Cs, 192 Ir, 239 Pu, and 235 U, which are used for training and validation (i.e. six cases). Additionally, the data set contains 24 distorted synthesized sources with various fluctuating backgrounds. Test results demonstrate the potential of the proposed method to accurately recognize the correct isotope with high precision, achieving an accuracy rate exceeding 85%. Furthermore, the proposed method exhibits superior performance compared to the conventional multiple regression fitting and simple feedforward neural network methods.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Improvements to TOVS retrievals over sea ice and applications to estimating Arctic energy fluxes

Modeling studies suggest that polar regions play a major role in modulating the Earth's climate and that they may be more sensitive than lower latitudes to climate change. Until recently, however, data from meteorological stations poleward of 70 degs have been sparse, and consequently, our understanding of air-sea-ice interaction processes is relatively poor. Satellite-borne sensors now offer a promising opportunity to observe polar regions and ultimately to improve parameterizations of energy transfer processes in climate models. This study focuses on the application of the TIROS-N operational vertical sounder (TOVS) to sea-ice-covered regions in the nonmelt season. TOVS radiances are processed with the improved initialization inversion ('3I') algorithm, providng estimates of layer-average temperature and moisture, cloud conditions, and surface characteristics at a horizontal resolution of approximately 100 km x 100 km. Although TOVS has flown continuously on polar-orbiting satellites since 1978, its potential has not been realized in high latitudes because the quality of retrievals is often significantly lower over sea ice and snow than over the surfaces. The recent availability of three Arctic data sets has provided an opportunity to validate TOVS retrievals: the first from the Coordinated Eastern Arctic Experiment (CEAREX) in winter 1988/1989, the second from the LeadEx field program in spring 1992, and the third from Russian drifting ice stations. Comparisons with these data reveal deficiencies in TOVS retrievals over sea ice during the cold season; e.g., ice surface temperature is often 5 to 15 K too warm, microwave emissivity is approximately 15% too low at large view angles, clear/cloudy scenes are sometimes misidentified, and low-level inversions are often not captured. In this study, methods to reduce these errors are investigated. Improvements to the ice surface temperature retrieval have reduced rms errors from approximately 7 K to 3 K; correction of microwaves (50 GHz) brightness temperatures for view angle dependence now allows the surface type (open water versus sea ice) to be determined; modifications to the clear/cloud tests have improved cloud detection over sea ice, especially where it is inhomogeneous; and improved surface temperature estimates have resulted in more successful diagnoses of low-level stratification. Applications of improved retrievals to studies of the Arctic energy budget are encouraging. Preliminary calculations of air-ice stress vectors, 10-m wind speed, and horizontal advection of heat and moisture are presented.

Francis, Jennifer A.↗

Radiative Transfer Modeling

Our research efforts addressed theoretical work in radiative transfer which focused the following five major items: (1) Development of three dimensional radiative transfer methods; (2) Improvement to and maintenance of radiative transfer codes; (3) Creating new data-sets to define absorption by atmos.gases; (4) Model tests and validations with data from field experiments; and (5) Model application to study climatic impact of, aerosol/clouds.

Source record↗

A review of NEST models for liquid xenon and an exhaustive comparison with other approaches

This paper discusses the microphysical simulation of interactions in liquid xenon, the active detector medium in many leading rare-event searches for new physics, and describes experimental observables useful for understanding detector performance. The scintillation and ionization yield distributions for signal and background are presented using the Noble Element Simulation Technique (NEST), a toolkit based on experimental data and simple empirical formulas, which mimic previous microphysics modeling but are guided by data. The NEST models for light and charge production as a function of the particle type, energy, and electric field are reviewed, along with models for energy resolution and final pulse areas. NEST is compared with other models or sets of models and validated against real data, with several specific examples drawn from XENON, ZEPLIN, LUX, LZ, PandaX, and table-top experiments used for calibrations.

WIMPs↗

A Spatio-Temporal Approach for Global Validation and Analysis of MODIS Aerosol Products

With the launch of the MODIS sensor on the Terra spacecraft, new data sets of the global distribution and properties of aerosol are being retrieved, and need to be validated and analyzed. A system has been put in place to generate spatial statistics (mean, standard deviation, direction and rate of spatial variation, and spatial correlation coefficient) of the MODIS aerosol parameters over more than 100 validation sites spread around the globe. Corresponding statistics are also computed from temporal subsets of AERONET-derived aerosol data. The means and standard deviations of identical parameters from MOMS and AERONET are compared. Although, their means compare favorably, their standard deviations reveal some influence of surface effects on the MODIS aerosol retrievals over land, especially at low aerosol loading. The direction and rate of spatial variation from MODIS are used to study the spatial distribution of aerosols at various locations either individually or comparatively. This paper introduces the methodology for generating and analyzing the data sets used by the two MODIS aerosol validation papers in this issue.

Ichoku, Charles↗

Computation and use of the reflectivity at 3.75 micrometers from AVHRR thermal channels

Global study of land surface properties uses AVHRR channels 1 and 2, but channel 3 may be of interest, although its use requires preprocessing. It consists of both a reflective part and an emissive part, the former can be derived from T3, T4 and T5. Since the water vapor affects channel 3, its content is retrieved from the channel 4 and 5 using the split window technique. A formula of reflective part retrieval at 3.75 micrometers is tested in the case of sunglint observations where the emissivities of channels 4 and 5 can be set to the unity. The formula is adapted and validated to land surface using the FIFE-87 data set. Preliminary applications of the reflectance at 3.75 micrometers to the studies of surface properties retrieval, aerosol retrieval over land, and desertic aerosol retrieval, are addressed.

Roger, J. C.↗

Generation of Level 3 SMMR and SSM/I Brightness Temperatures for the Period 1978-1999

The NOAA/NASA Pathfinder Program was initially designed to assure that certain key remote sensing data sets of particular significance to global change research were scientifically validated, consistently processed and made readily available to the research community at minimal cost. Through this Program the National Snow and Ice Data Center (NSIDC), University of Colorado has successfully processed, archived and distributed the Scanning Multichannel Microwave Radiometer (SMMR) and Special Sensor Microwave/Imager (SSM/I) Level 3 (EASE-Grid format) Pathfinder data sets for the period 1978 to 1999. These data are routinely distributed to approximately 150 researchers through various media including CD-ROM, 8 mm tape, ftp and the EOS Information Management System (IMS). At NSIDC these data are currently being applied in the development and validation of algorithms to derive snow water equivalent (NASA NAG5-6636), the mapping of frozen ground and the detection of the onset of melt over ice sheets, sea ice and snow cover. The EASE-Grid format, developed at NSIDC in conjunction with the SMMR-SSM/I Pathfinder project has also been applied to Advanced Very High Resolution Radiometer (AVHRR) and TOVS Pathfinder data, as well as ancillary data such as digital elevation, land cover classification and several in situ data sets. EASE-Grid will also be used for all land products derived from the NASA EOS AMSR-E instrument.

Partington, Kim↗

Collaboration on Development and Validation of the AMSR-E Snow Water Equivalent Algorithm

The National Snow and Ice Data Center (NSIDC) has produced a global SMMR and SSM/I Level 3 Brightness Temperature data set in the Equal Area Scalable Earth (EASE) Grid for the period 1978 to 2000. Processing of current data is-ongoing. The EASE-Grid passive microwave data sets are appropriate for algorithm development and validation prior to the launch of AMSR-E. Having the lower frequency channels of SMMR (6.6 and 10.7 GHz) and the higher frequency channels of SSM/I (85.5 GHz) in the same format will facilitate the preliminary development of applications which could potentially make use of similar frequencies from AMSR-E (6.9, 10.7, 89.0 GHz).

Armstrong, Richard L.↗

Predicting RNA structure and dynamics with deep learning and solution scattering

Advanced deep learning and statistical methods can predict structural models for RNA molecules. However, RNAs are flexible, and it remains difficult to describe their macromolecular conformations in solutions where varying conditions can induce conformational changes. Small-angle x-ray scattering (SAXS) in solution is an efficient technique to validate structural predictions by comparing the experimental SAXS profile with those calculated from predicted structures. There are two main challenges in comparing SAXS profiles to RNA structures: the absence of cations essential for stability and charge neutralization in predicted structures and the inadequacy of a single structure to represent RNA’s conformational plasticity. We introduce a solution conformation predictor for RNA (SCOPER) to address these challenges. This pipeline integrates kinematics-based conformational sampling with the innovative deep learning model, IonNet, designed for predicting Mg 2+ ion binding sites. Validated through benchmarking against 14 experimental data sets, SCOPER significantly improved the quality of SAXS profile fits by including Mg 2+ ions and sampling of conformational plasticity. We observe that an increased content of monovalent and bivalent ions leads to decreased RNA plasticity. Therefore, carefully adjusting the plasticity and ion density is crucial to avoid overfitting experimental SAXS data. SCOPER is an efficient tool for accurately validating the solution state of RNAs given an initial, sufficiently accurate structure and provides the corrected atomistic model, including ions.

59 BASIC BIOLOGICAL SCIENCES↗

Soil Moisture Active Passive Mission L4_SM Data Product Assessment (Version 2 Validated Release)

During the post-launch SMAP calibration and validation (Cal/Val) phase there are two objectives for each science data product team: 1) calibrate, verify, and improve the performance of the science algorithm, and 2) validate the accuracy of the science data product as specified in the science requirements and according to the Cal/Val schedule. This report provides an assessment of the SMAP Level 4 Surface and Root Zone Soil Moisture Passive (L4_SM) product specifically for the product's public Version 2 validated release scheduled for 29 April 2016. The assessment of the Version 2 L4_SM data product includes comparisons of SMAP L4_SM soil moisture estimates with in situ soil moisture observations from core validation sites and sparse networks. The assessment further includes a global evaluation of the internal diagnostics from the ensemble-based data assimilation system that is used to generate the L4_SM product. This evaluation focuses on the statistics of the observation-minus-forecast (O-F) residuals and the analysis increments. Together, the core validation site comparisons and the statistics of the assimilation diagnostics are considered primary validation methodologies for the L4_SM product. Comparisons against in situ measurements from regional-scale sparse networks are considered a secondary validation methodology because such in situ measurements are subject to up-scaling errors from the point-scale to the grid cell scale of the data product. Based on the limited set of core validation sites, the wide geographic range of the sparse network sites, and the global assessment of the assimilation diagnostics, the assessment presented here meets the criteria established by the Committee on Earth Observing Satellites for Stage 2 validation and supports the validated release of the data. An analysis of the time average surface and root zone soil moisture shows that the global pattern of arid and humid regions are captured by the L4_SM estimates. Results from the core validation site comparisons indicate that "Version 2" of the L4_SM data product meets the self-imposed L4_SM accuracy requirement, which is formulated in terms of the ubRMSE: the RMSE (Root Mean Square Error) after removal of the long-term mean difference. The overall ubRMSE of the 3-hourly L4_SM surface soil moisture at the 9 km scale is 0.035 cubic meters per cubic meter requirement. The corresponding ubRMSE for L4_SM root zone soil moisture is 0.024 cubic meters per cubic meter requirement. Both of these metrics are comfortably below the 0.04 cubic meters per cubic meter requirement. The L4_SM estimates are an improvement over estimates from a model-only SMAP Nature Run version 4 (NRv4), which demonstrates the beneficial impact of the SMAP brightness temperature data. L4_SM surface soil moisture estimates are consistently more skillful than NRv4 estimates, although not by a statistically significant margin. The lack of statistical significance is not surprising given the limited data record available to date. Root zone soil moisture estimates from L4_SM and NRv4 have similar skill. Results from comparisons of the L4_SM product to in situ measurements from nearly 400 sparse network sites corroborate the core validation site results. The instantaneous soil moisture and soil temperature analysis increments are within a reasonable range and result in spatially smooth soil moisture analyses. The O-F residuals exhibit only small biases on the order of 1-3 degrees Kelvin between the (re-scaled) SMAP brightness temperature observations and the L4_SM model forecast, which indicates that the assimilation system is largely unbiased. The spatially averaged time series standard deviation of the O-F residuals is 5.9 degrees Kelvin, which reduces to 4.0 degrees Kelvin for the observation-minus-analysis (O-A) residuals, reflecting the impact of the SMAP observations on the L4_SM system. Averaged globally, the time series standard deviation of the normalized O-F residuals is close to unity, which would suggest that the magnitude of the modeled errors approximately reflects that of the actual errors. The assessment report also notes several limitations of the "Version 2" L4_SM data product and science algorithm calibration that will be addressed in future releases. Regionally, the time series standard deviation of the normalized O-F residuals deviates considerably from unity, which indicates that the L4_SM assimilation algorithm either over- or under-estimates the actual errors that are present in the system. Planned improvements include revised land model parameters, revised error parameters for the land model and the assimilated SMAP observations, and revised surface meteorological forcing data for the operational period and underlying climatological data. Moreover, a refined analysis of the impact of SMAP observations will be facilitated by the construction of additional variants of the model-only reference data. Nevertheless, the “Version 2” validated release of the L4_SM product is sufficiently mature and of adequate quality for distribution to and use by the larger science and application communities.

SMAP L4_SM↗

The variability of atmospheric equivalent temperature for radar altimeter range correction

Two sets of data were used to test the validity of the presently used approximation for radar altimeter range correction due to atmospheric water vapor. The approximation includes an assumption of constant atmospheric equivalent temperature. The first data set includes monthly, three-dimensional, gridded temperature and humidity fields over global oceans for a 10-year period, and the second is comprised of daily or semidaily rawinsonde data at 17 island stations for a 7-year period. It is found that the standard method underestimates the variability of the equivalent temperature, and the approximation could introduce errors of 2 cm for monthly means. The equivalent temperature is found to have a strong meridional gradient, and the highest temporal variabilities are found over western boundary currents. The study affirms that the atmospheric water vapor is a good predictor for both the equivalent temperature and the range correction. A relation is proposed to reduce the error.

Liu, W. Timothy↗

Validation of US3D for Capsule Aerodynamics using 05-CA Wind Tunnel Test Data

Several comparisons of computational fluid dynamics to wind tunnel test data are shown for the purpose of code validation. The wind tunnel test, 05-CA, uses a 7.66% model of NASA's Multi-Purpose Crew Vehicle in the 11-foot test section of the Ames Unitary Plan Wind tunnel. A variety of freestream conditions over four Mach numbers and three angles of attack are considered. Test data comparisons include time-averaged integrated forces and moments, time-averaged static pressure ports on the surface, and Strouhal Number. The applicability of the US3D code to subsonic and transonic flow over a bluff body is assessed on a comprehensive data set. With close comparison, this work validates US3D for highly separated flows similar to those examined here.

Schwing, Alan↗

Simultaneous Development and Robust Optimization of a Microstructure Dependent Material

Recent microstructure characterization techniques combined with Symbolic Regression(SR)analysis has been proven to generate white box plasticity models well suited for incorporation into FEA software.The current work builds upon those efforts and demonstrates the applicability of Sequential Monte-Carlo (SMC) methods within SR analysis to condense model development and robust optimization into a single, co-dependent process. In this project, SMC methods provide a mechanism through which the observed microstructure features and associated variability can be incorporated into the discovery phase of model development and simultaneously recover approximate parameter distributions through SR analysis. The demonstration utilized a data set consisting of tensile test results from a limited number of sample specimens with corresponding EBSD data from which microstructure features were characterized.The maximum threshold stress model in the Visco-Plastic Self-Consistent (VPSC) code developed by Los Alamos National Laboratories was calibrated using mechanical test data.Synthetic volume elements with statistically equivalent microstructure were generated with DREAM3Dbased on the observed EBSD data. VPSC was used to simulate the corresponding tensile test response for each of the synthetic volume elements. The simulated microstructure and tensile test data was used astraining datafor SMC-SR algorithm and the resulting model was validated with data from the original empirical data set.

Karl Garbrecht↗

Microstructure Modeling of 3rd Generation Disk Alloys

The objective of this program is to model, validate, and predict the precipitation microstructure evolution, using PrecipiCalc (QuesTek Innovations LLC) software, for 3rd generation Ni-based gas turbine disc superalloys during processing and service, with a set of logical and consistent experiments and characterizations. Furthermore, within this program, the originally research-oriented microstructure simulation tool will be further improved and implemented to be a useful and user-friendly engineering tool. In this report, the key accomplishment achieved during the second year (2008) of the program is summarized. The activities of this year include final selection of multicomponent thermodynamics and mobility databases, precipitate surface energy determination from nucleation experiment, multiscale comparison of predicted versus measured intragrain precipitation microstructure in quench samples showing good agreement, isothermal coarsening experiment and interaction of grain boundary and intergrain precipitates, primary microstructure of subsolvus treatment, and finally the software implementation plan for the third year of the project. In the following year, the calibrated models and simulation tools will be validated against an independently developed experimental data set, with actual disc heat treatment process conditions. Furthermore, software integration and implementation will be developed to provide material engineers valuable information in order to optimize the processing of the 3rd generation gas turbine disc alloys.

Jou, Herng-Jeng↗

Single-Shot Scalar-Triplet Measurements in High-Pressure Swirl-Stabilized Flames for Combustion Code Validation

In support of NASA ARMD's code validation project, we have made significant progress by providing the first quantitative single-shot multi-scalar data from a turbulent elevated-pressure (5 atm), swirl-stabilized, lean direct injection (LDI) type research burner operating on CH4-air using a spatially-resolved pulsed-laser spontaneous Raman diagnostic technique. The Raman diagnostics apparatus and data analysis that we present here were developed over the past 6 years at Glenn Research Center. From the Raman scattering data, we produce spatially-mapped probability density functions (PDFs) of the instantaneous temperature, determined using a newly developed low-resolution effective rotational bandwidth (ERB) technique. The measured 3-scalar (triplet) correlations, between temperature, CH4, and O2 concentrations, as well as their PDF s, also provide a high-level of detail into the nature and extent of the turbulent mixing process and its impact on chemical reactions in a realistic gas turbine injector flame at elevated pressures. The multi-scalar triplet data set presented here provides a good validation case for CFD combustion codes to simulate by providing both average and statistical values for the 3 measured scalars.

Kojima, Jun↗

The New 20-Year Global Precipitation Climatology Project (GPCP) Merged Satellite and Rainguage Monthly Analysis

A new 20-year, monthly, globally complete precipitation analysis has been completed as part of the World Climate Research Program's (WCRP/GEWEX) Global Precipitation Climatology Project (GPCP). This Version 2 of the community generated data set is a result of combining the procedures and data sets as described. The global, monthly, 2.5x 2.5 degree latitude-longitude product utilizes precipitation estimates from low-orbit microwave sensors (SSM/1) and geosynchronous IR sensors and raingauge information over land. The low-orbit microwave estimates are used to adjust or correct the geosynchronous IR estimates, thereby maximizing the utility of the more physically-based microwave estimates and the finer time sampling of the geosynchronous observations. Information from raingauges is blended into the analyses over land. In the 1986-present period TOVS-based precipitation estimates are adjusted to GPCP fields and used in polar regions to produce globally-complete results. The extension back to 1979 utilizes the procedures of Xie and Arkin and their OLR Precipitation Index (OPI). The 20-year climatology of the Version 2 GPCP analysis indicates the expected features of a very strong Pacific Ocean ITCZ and SPCZ with maximum 20-year means approaching 10 mm/day. A similar strength maximum over land is evident over Borneo. Weaker maxima in the tropics occur in the Atlantic ITCZ and over South America and Africa. In mid-latitudes of the Northern Hemisphere the Western Pacific and Western Atlantic maxima have values of approximately 7 mm/day, while in the Southern Hemisphere the mid-latitude maxima are located southeast of Africa, in mid-Pacific as an extension of the SPCZ and southeast of South America. In terms of global totals the GPCP analysis shows 2.7 mm/day (3.0 mm/day over ocean; 2.1 mm/day over land), similar to the Jaeger climatology, but not other climatologies. Zonal averages peak at 6 mm/day at 7*N with mid-latitude peaks of about 3 mm/day at 40-45* latitude. Poleward of 45* the GPCP analysis shows larger zonally-averaged values than most previous satellite-based estimates, although the values are similar to tl,ie Jaeger climatology. Over both ocean areas and at high latitudes the analysis requires additional validation and comparison with special, independent data sets from field experiments and from the Tropical Rain Measuring Mission (TRMM) to confirm the absolute magnitude and variations of precipitation seen in the analysis. Interannual and other variations of the global fields will be shown focusing on the recent ('97-'99) ENSO event compared with previous events, including teleconnections at mid and high latitudes. An ENSO Precipitation Index (ESPI) calculated using the new data set will be described and related to the evolution of the ENSO events during the 20-year period.

Adler, Robert↗

Validation of MODIS Dust Aerosol Retrieval and Development Ambient Dust Phase Function using PRIDE Data

The PRIDE data set of MODIS aerosol retrievals co-located with sunphotometer measurements provides the basis of MODIS validation in a dust environment. The sunphotometer measurements include AERONET automatic instruments, land-based Microtops instruments, ship-board Microtops instruments and the AATS-6 aboard the Navajo aircraft. Analysis of these data indicate that the MODIS retrieval is within pre-launch estimates of uncertainty within the spectral range of 600-900 nm. However, the MODIS algorithm consistently retrieves smaller particles than reality thus leading to incorrect spectral response outside of the 600-900 nm range and improper size information. Further analysis of MODIS retrievals in other dust environments shows the inconsistencies are due to nonspherical effects in the phase function. These data are used to develop an ambient phase function for dust aerosol to be used for remote sensing purposes.

Remer, Lorraine A.↗