Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,099 records · Page 61

Creation of the VADER Code in SCALE [Slides]

This presentation details the creation of Validation Analysis Data Evaluation Resource (VADER) code in SCALE. This lecture highlights the USLSTATS program written in JAVA and its history. Additionally, it covers the integration of VADER with SCALE along with features and background information.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

ARISE (Antarctic Remote Ice Sensing Experiment) in the East 2003: Validation of Satellite-derived Sea-ice Data Product

Preliminary results are presented from the first validation of geophysical data products (ice concentration, snow thickness on sea ice (h(sub s) and ice temperature (T(sub i))fr om the NASA EOS Aqua AMSR-E sensor, in East Antarctica (in September-October 2003). The challenge of collecting sufficient measurements with which to validate the coarse-resolution AMSR-E data products adequately was addressed by means of a hierarchical approach, using detailed in situ measurements, digital aerial photography and other satellite data. Initial results from a circumnavigation of the experimental site indicate that, at least under cold conditions with a dry snow cover, there is a reasonably close agreement between satellite- and aerial-photo-derived ice concentrations, i.e. 97.2+/-.6% for NT2 and 96.5+/-2.5% for BBA algorithms vs 94.3% for the aerial photos. In general, the AMSR-E concentration represents a slight overestimate of the actual concentration, with the largest discrepancies occurring in regions containing a relatively high proportion of thin ice. The AMSR-E concentrations from the NT2 and BBA algorithms are similar on average, although differences of up to 5% occur in places, again related to thin-ice distribution. The AMSR-E ice temperature (T(sub i)) product agrees with coincident surface measurements to approximately 0.5 C in the limited dataset analyzed. Regarding snow thickness, the AMSR h(sub s) retrieval is a significant underestimate compared to in situ measurements weighted by the percentage of thin ice (and open water) present. For the case study analyzed, the underestimate was 46% for the overall average, but 23% compared to smooth-ice measurements. The spatial distribution of the AMSR-E h(sub s) product follows an expected and consistent spatial pattern, suggesting that the observed difference may be an offset (at least under freezing conditions). Areas of discrepancy are identified, and the need for future work using the more extensive dataset is highlighted.

Massom, Robert A.↗

Updated Gadolinium Validation in SCALE 6.3.0 using ENDF/B-VIII.0 Data [Slides]

This presentation provides a brief recap of the ANS Summer meeting in 2018 with a discussion of the results. The presentation also provides an overview of new models and states that all new models have been checked but have not yet been added to the VALID library. It also states that the models were originally created as part of a master's thesis or summer internships. Additionally, all models have been rerun in SCALE 6.3.0 using CE ENDF/B-VIII.0 library. In conclusion, this project has facilitated a significant expansion of validation set containing gadolinium, including 13 cases previously in VALID plus 99 new cases. The completion of IPPE HST experiments confirm no clear trend as a function of concentration or spectrum. Solid absorber cases also show no clear trends and LANL HMT experiments have significant discrepancies in Gd alloy cases. While almost half of the total gadolinium-bearing cases from the ICSBEP Handbook are considered here, the presentation recognizes that there is more work to be done.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Analysis and prediction of Doppler noise during solar conjunctions

The results of a study of Doppler data noise during solar conjunctions were presented. During the first half of 1975, a sizeable data base of Doppler data noise (estimates) for the Pioneer 10, Pioneer 11, and Helios 1 solar conjunctions was accumulated. To analyze this data, certain physical assumptions are made, leading to the development of a geometric parameter ("ISI") which correlates strongly with Doppler data noise under varying sun-earth-spacecraft geometries. Doppler noise models are then constructed from this parameter, resulting in the newfound ability to predict Doppler data noise during solar conjunctions, and hence to additionally be in a position to validate Doppler data acquired during solar conjunctions.

Berman, A. L.↗

Objective assessment of Advanced Very High Resolution Radiometer data for land cover mapping

The validity of using data from the Advanced Very High Resolution Radiometer (AVHRR) of the satellites NOAA-6 and NOAA-7 for land cover mapping is assessed by making comparisons with much higher resolution LANDSAT multi-spectral scanner (MSS) data. Near synchronous data for both systems are analysed for test sites in the Imperial Valley, California, the Nile Delta, and southern Italy. The results strongly indicate that despite the very coarse resolution of the AVHRR data compared with conventional MSS data they are sufficiently strongly correlated to suggest that the former have significant potential for land cover mapping, especially at small scales and for large areas. Hence the outstanding benefits of AVHRR data, namely their high temporal frequency, relative cheapness and low data volumes for image processing, may readily be taken advantage of for such tasks.

Townshend, J. R. G.↗

Weathering the Storm: Unmanned Aircraft Systems in the Maritime, Atmospheric and Polar Environments

Remotely piloted aircraft (RPA) have the potential to revolutionize local to regional data collection for geophysicists as platform and payload size decrease while aircraft capabilities increase. In particular, data from RPAs combine high-resolution imagery available from low flight elevations with comprehensive areal coverage, unattainable from ground investigations and difficult to acquire from manned aircraft due to budgetary and logistical costs. Low flight elevations are particularly important for detecting signals that decay exponentially with distance, such as electromagnetic fields. Onboard data processing coupled with high-bandwidth telemetry open up opportunities for real-time and near real-time data processing, producing more efficient flight plans through the use of payload-directed flight, machine learning and autonomous systems. Such applications not only strive to enhance data collection, but also enable novel sensing modalities and temporal resolution. NASAs Airborne Science Program has been refining the capabilities and applications of RPA in support of satellite calibration and data product validation for several decades. In this paper, we describe current platforms, payloads, and onboard data systems available to the research community. Case studies include Fluid Lensing for littoral zone 3D mapping, structure from motion for terrestrial 3D multispectral imaging, and airborne magnetometry on medium and small RPAs.

data collection↗

Using Remotely Piloted Aircraft and Onboard Processing to Optimize and Expand Data Collection

Remotely piloted aircraft (RPA) have the potential to revolutionize local to regional data collection for geophysicists as platform and payload size decrease while aircraft capabilities increase. In particular, data from RPAs combine high-resolution imagery available from low flight elevations with comprehensive areal coverage, unattainable from ground investigations and difficult to acquire from manned aircraft due to budgetary and logistical costs. Low flight elevations are particularly important for detecting signals that decay exponentially with distance, such as electromagnetic fields. Onboard data processing coupled with high-bandwidth telemetry open up opportunities for real-time and near real-time data processing, producing more efficient flight plans through the use of payload-directed flight, machine learning and autonomous systems. Such applications not only strive to enhance data collection, but also enable novel sensing modalities and temporal resolution. NASA’s Airborne Science Program has been refining the capabilities and applications of RPA in support of satellite calibration and data product validation for several decades. In this paper, we describe current platforms, payloads, and onboard data systems available to the research community. Case studies include Fluid Lensing for littoral zone 3D mapping, structure from motion for terrestrial 3D multispectral imaging, and airborne magnetometry on medium and small RPAs.

Fladeland, Matthew M.↗

Simultaneous Development and Robust Optimization of a Microstructure Dependent Material

Recent microstructure characterization techniques combined with Symbolic Regression(SR)analysis has been proven to generate white box plasticity models well suited for incorporation into FEA software.The current work builds upon those efforts and demonstrates the applicability of Sequential Monte-Carlo (SMC) methods within SR analysis to condense model development and robust optimization into a single, co-dependent process. In this project, SMC methods provide a mechanism through which the observed microstructure features and associated variability can be incorporated into the discovery phase of model development and simultaneously recover approximate parameter distributions through SR analysis. The demonstration utilized a data set consisting of tensile test results from a limited number of sample specimens with corresponding EBSD data from which microstructure features were characterized.The maximum threshold stress model in the Visco-Plastic Self-Consistent (VPSC) code developed by Los Alamos National Laboratories was calibrated using mechanical test data.Synthetic volume elements with statistically equivalent microstructure were generated with DREAM3Dbased on the observed EBSD data. VPSC was used to simulate the corresponding tensile test response for each of the synthetic volume elements. The simulated microstructure and tensile test data was used astraining datafor SMC-SR algorithm and the resulting model was validated with data from the original empirical data set.

Karl Garbrecht↗

Design of Quasi-Integral Experiments at the Flexible Neutron Source at the University of Tennessee

Nuclear reaction data libraries make use of experimental data that are differential in reaction and neutron energy for evaluation and data that are integral in reaction and energy for validation. In many cases, integral measurements can provide lower experimental uncertainties than differential measurements, but the impact of individual reactions and energies cannot generally be determined from the single experimental observable. “Quasi-integral” or “quasi-differential” measurements, which are integral in one characteristic (energy or reaction) and differential in the other, can often provide a middle ground of lower experimental uncertainties combined with some ability to unpack the impact of individual reactions or energies. Furthermore, the Flexible Neutron Source (FNS) at the University of Tennessee, Knoxville, is a new experimental facility that can perform integral and quasi-integral measurements by removing components of the integral configuration to determine the impact of specific reactions. Possible flux-averaged cross-section measurements, flux perturbation measurements, and neutron downscattering measurements are simulated here to show the value of the FNS to evaluation and validation of nuclear data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Preliminary NoMAD Results of the MUSIC Experiment

The Measurement of Uranium Subcritical and Critical (MUSiC) experiment was carried out from December 2020 through April 2021 at the National Criticality Experiments Research Center (NCERC). This measurement campaign featured bare configurations of the Rocky Flats highly-enriched uranium (HEU) shells, with each configuration having different numbers of these shells. The goal of the experiment was to test multiple neutron multiplicity detectors and measurement methods for a large range of neutron multiplication values, to see when the combination of detectors and methods break down as the configurations reach the delayed supercritical window. Adding subcritical integral benchmarks gives additional validation to nuclear data. These benchmarks provide additional parameters against which to validate the data. While critical benchmarks have just a single value, $K_{eff}$ , subcritical benchmarks can be used to infer multiple parameters. As an example, recent subcritical benchmarks utilizing the Hage-Cifarelli formalism have three quantities of interest ($R_{1}$, $R_{2}$, and $M_{L}$). This gives nuclear data evaluators additional data to use when performing their evaluations, and allows for these benchmarks to be useful for additional types of nuclear data.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Global and Regional Evaluation of Over-Land Spectral Aerosol Optical Depth Retrievals from SeaWiFS

This study evaluates a new spectral aerosol optical depth (AOD) dataset derived from Sea-viewing Wide Field-of-view Sensor (Sea WiFS) measurements over land. First, the data are validated against Aerosol Robotic Network (AERONET) direct-sun AOD measurements, and found to compare well on a global basis. If only data with the highest quality flag are used, the correlation is 0.86 and 72% of matchups fall within an expected absolute uncertainty of 0.05 + 20% (for the wavelength of 550 nm). The quality is similar at other wavelengths and stable over the 13-year (1997-2010) mission length. Performance tends to be better over vegetated, low-lying terrain with typical AOD of 0.3 or less, such as found over much of North America and Eurasia. Performance tends to be poorer for low-AOD conditions near backscattering geometries, where Sea WiFS overestimates AOD, or optically-thick cases of absorbing aerosol, where SeaWiFS tends to underestimate AOD. Second, the SeaWiFS data are compared with midvisible AOD derived from the Moderate Resolution Imaging Spectrometer (MODIS) and Multiangle Imaging Spectroradiometer (MISR). All instruments show similar spatial and seasonal distributions of AOD, although there are regional and seasonal offsets between them. At locations where AERONET data are available, these offsets are largely consistent with the known validation characteristics of each dataset. With the results of this study in mind, the SeaWiFS over-land AOD record should be suitable for quantitative scientific use.

Sayer, A. M.↗

Dual Rotating Rake Measurements of Higher-Order Duct Modes: Validation Using Experimental and Numerical Data

A rotating rake mode measurement system was designed to measure acoustic duct modes generated by a fan stage. After analysis of the measured data, the mode coefficient amplitudes and phases were quantified. Early studies using this system found that mode power levels computed from rotating rake measured data would agree with the far-field power levels. However, this agreement required that the sound from the noise sources within the duct propagated outward from the duct exit without reflection and previous studies suggested conditions could exist where significant reflections could occur. This paper shows that mounting a second rake to the rotating system, with an offset in both the axial and the azimuthal directions, measures the data necessary to determine the modes propagating in both directions within a duct. The rotating rake data analysis technique was extended to include the data measured by the second rake. The analysis resulted in a set of circumferential mode coefficients at each of the two rake microphone locations. Radial basis functions were then least-squares fit to this data to obtain the radial mode coefficients for the modes propagating in both directions within the duct while accounting for the presence of evanescent modes. The validation of the dual-rotating-rake measurements was conducted using data from a combination of experiments and numerical calculations to compute reflection coefficients and other mode coefficient ratios. Compared to results from analytical and numerical computations, the results from dual-rotating-rake measured data followed the expected trends when frequency, mode number, and duct termination geometry were changed.

Validation↗

Creation of the VADER Code in SCALE [Abstract]

The VADER (Validation Analysis Data Evaluation Resource) is a new module in SCALE 6.3 that has been derived from the legacy USLSTATS program. VADER is a tool that allows the determination of bias and bias uncertainty for criticality safety computational methods. The older USLSTATS program, written in Java, existed outside of SCALE and provided tools to calculate only the confidence band with administrative margin (sometimes called USL-1) and the single-sided uniform width closed interval (USL-2). For normality testing it only offered a crude chi- squared normality test that had no user-configurable options and presented a simple pass/no-pass functionality.

97 MATHEMATICS AND COMPUTING↗

Tidal Stream Energy Resource Characterization in the Salish Sea

Tidal stream energy holds great potential as a renewable energy source in regions of the world where tidal currents are strong and predictable. The tidal stream energy resource of a region is strongly controlled by its tidal wave characteristics, the local bathymetry, and coastal geometric features. The Salish Sea, a large estuary on the Pacific Northwest coast, represents a great tidal stream resource because of its strong tidal currents in many tidal channels. However, the tidal resource in the Salish Sea has not been systematically characterized, primarily because of its large area and complex bathymetry and coastlines. This paper presents a modeling study conducted to characterize the tidal energy resource of the Salish Sea based on a high-resolution three-dimensional tidal hydrodynamic model of the Salish Sea, which was extensively validated using data derived from 10 tidal gauge stations and 132 Acoustic Doppler Current Profiler stations. Model validation results indicated the Salish Sea hydrodynamic model is skillful in simulating tidal wave propagation and velocity distributions in the Salish Sea. Based on model results, a total of 16 tidal channels with strong tidal currents, 9 in the San Juan Islands and Rosario Strait regions and 7 in the Puget Sound, were identified as hotspots for potential tidal energy development. Velocity probability distributions and exceedance curves of cross-channel average velocity magnitudes were calculated at all 16 channels based on the recommendations of the International Electrotechnical Commission Technical Specifications for tidal energy resource characterization. The tidal energy resource at the 16 hotspots was also characterized using power density distributions and kinetic energy fluxes. The ranking of the kinetic energy fluxes suggested that Admiralty Inlet, Rosario Strait, and Middle Channel are the top three hotspot sites in the Salish Sea for tidal stream energy development. The study demonstrated the need for a high-resolution 3-D modeling framework for accurate simulation of tidal currents in large complex estuarine systems, in the context of tidal energy resource characterization.

tidal stream energy, resource characterization, Sa↗

Deep-learning-guided high-resolution subsurface reflectivity imaging with application to ground-penetrating radar data

Subsurface reflectivity imaging is one of the most important geophysical characterization methods for revealing subsurface structures. In many cases, accurate subsurface reflectivity imaging is challenging because of, for example, random or coherent noise in the data and sparse source-receiver observation geometry. Here, we develop a deep-learning-guided iterative imaging method to improve subsurface structure imaging. Specifically, we train a supervised neural network to infer a noise-free, high-resolution image from a noisy, low-resolution image and use this estimated image as guidance to regularize least-squares imaging. We develop a systematic method to generate high-quality synthetic training data (data-label pairs) to train the guidance neural network. The trained neural network can provide high-fidelity predictions even for field-data images that are not in the training data. We validate our new imaging method using one synthetic and two field ground-penetrating radar data examples, and find that our method can produce clean, high-resolution subsurface reflectivity images where existing single-pass and least-squares imaging methods fail due to noise and insufficient data coverage.

58 GEOSCIENCES↗

An experimental and theoretical investigation of deposition patterns from an agricultural airplane

A flight test program has been conducted with a representative agricultural airplane to provide data for validating a computer program model which predicts aerially applied particle deposition. Test procedures and the data from this test are presented and discussed. The computer program features are summarized, and comparisons of predicted and measured particle deposition are presented. Applications of the computer program for spray pattern improvement are illustrated.

Morris, D. J.↗

DSN Data Visualization Suite

The DSN Data Visualization Suite is a set of computer programs and reusable Application Programming Interfaces (APIs) that assist in the visualization and analysis of Deep Space Network (DSN) spacecraft-tracking data, which can include predicted and actual values of downlink frequencies, uplink frequencies, and antenna-pointing angles in various formats that can include tables of values and polynomial coefficients. The data can also include lists of antenna-pointing events, lists of antenna- limit events, and schedules of tracking activities. To date, analysis and correlation of these intricately related data before and after tracking have been difficult and time-consuming. The DSN Data Visualization Suite enables operators to quickly diagnose tracking-data problems before, during, and after tracking. The Suite provides interpolation on demand and plotting of DSN tracking data, correlation of all data on a given temporal point, and display of data with color coding configurable by users. The suite thereby enables rapid analysis of the data prior to transmission of the data to DSN control centers. At the control centers, the same suite enables operators to validate the data before committing the data to DSN subsystems. This software is also Web-enabled to afford its capabilities to international space agencies.

Bui, Bach X.↗

Discrepancy Reporting Management System

Discrepancy Reporting Management System (DRMS) is a computer program designed for use in the stations of NASA's Deep Space Network (DSN) to help establish the operational history of equipment items; acquire data on the quality of service provided to DSN customers; enable measurement of service performance; provide early insight into the need to improve processes, procedures, and interfaces; and enable the tracing of a data outage to a change in software or hardware. DRMS is a Web-based software system designed to include a distributed database and replication feature to achieve location-specific autonomy while maintaining a consistent high quality of data. DRMS incorporates commercial Web and database software. DRMS collects, processes, replicates, communicates, and manages information on spacecraft data discrepancies, equipment resets, and physical equipment status, and maintains an internal station log. All discrepancy reports (DRs), Master discrepancy reports (MDRs), and Reset data are replicated to a master server at NASA's Jet Propulsion Laboratory; Master DR data are replicated to all the DSN sites; and Station Logs are internal to each of the DSN sites and are not replicated. Data are validated according to several logical mathematical criteria. Queries can be performed on any combination of data.

Cooper, Tonja M.↗