Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRS2010

Data Validation in the Kepler Science Operations Center Pipeline

We present an overview of the Data Validation (DV) software component and its context within the Kepler ScienceOperations Center (SOC) pipeline and overall Kepler Science mission. The SOC pipeline performs a transiting planetsearch on the corrected light curves for over 150,000 targets across the focal plane array. We discuss the DV strategy forautomated validation of Threshold Crossing Events (TCEs) generated in the transiting planet search. For each TCE, atransiting planet model is fitted to the target light curve. A multiple planet search is conducted by repeating the transitingplanet search on the residual light curve after the model flux has been removed; if an additional detection occurs, aplanet model is fitted to the new TCE. A suite of automated tests are performed after all planet candidates have beenidentified. We describe a centroid motion test to determine the significance of the motion of the target photocenterduring transit and to estimate the coordinates of the transit source within the photometric aperture; a series of eclipsingbinary discrimination tests on the parameters of the planet model fits to all transits and the sequences of odd and eventransits; and a statistical bootstrap to assess the likelihood that the TCE would have been generated purely by chancegiven the target light curve with all transits removed.

photometry↗
DOE OSTI2024

Verified, Archived, Library of Inputs and Data (VALID) Supporting Files

This dataset contains input, output, and sensitivity data files for computational simulations with the SCALE code system as part of the Verified, Archived Library of Inputs and Data (VALID). The simulations cover critical benchmark experiments from the International Criticality Safety Benchmark Evaluation Project. The files are to be housed in a public directory for distribution. The information contained in the files have been approved for release by the Organisation for Economic Co-operation and Development Nuclear Energy Agency (NEA). Users wanting to reproduce results from this dataset are required to obtain a license to the SCALE code system for which details on the distribution can be found here: https://www.ornl.gov/scale/releases.

keff↗
DOE OSTI2024

SCALE Procedure for Verified, Archived, Library of Inputs and Data (VALID)

This procedure provides a framework for preparing, reviewing, and storing model inputs and derived data so that individuals with authorized access to the Verified, Archived, Library of Inputs and Data (VALID) repository can use the inputs and data with confidence in their analyses. This procedure uses documented checks and reviews to ensure that the inputs and data were correctly generated using appropriate references. Configuration management is implemented to prevent inadvertent modification of the inputs and data or inclusion of models that have not been reviewed. This procedure also provides guidance to be followed if errors are identified or if input or data revisions are needed.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS2008

Sensor Selection and Data Validation for Reliable Integrated System Health Management

For new access to space systems with challenging mission requirements, effective implementation of integrated system health management (ISHM) must be available early in the program to support the design of systems that are safe, reliable, highly autonomous. Early ISHM availability is also needed to promote design for affordable operations; increased knowledge of functional health provided by ISHM supports construction of more efficient operations infrastructure. Lack of early ISHM inclusion in the system design process could result in retrofitting health management systems to augment and expand operational and safety requirements; thereby increasing program cost and risk due to increased instrumentation and computational complexity. Having the right sensors generating the required data to perform condition assessment, such as fault detection and isolation, with a high degree of confidence is critical to reliable operation of ISHM. Also, the data being generated by the sensors needs to be qualified to ensure that the assessments made by the ISHM is not based on faulty data. NASA Glenn Research Center has been developing technologies for sensor selection and data validation as part of the FDDR (Fault Detection, Diagnosis, and Response) element of the Upper Stage project of the Ares 1 launch vehicle development. This presentation will provide an overview of the GRC approach to sensor selection and data quality validation and will present recent results from applications that are representative of the complexity of propulsion systems for access to space vehicles. A brief overview of the sensor selection and data quality validation approaches is provided below. The NASA GRC developed Systematic Sensor Selection Strategy (S4) is a model-based procedure for systematically and quantitatively selecting an optimal sensor suite to provide overall health assessment of a host system. S4 can be logically partitioned into three major subdivisions: the knowledge base, the down-select iteration, and the final selection analysis. The knowledge base required for productive use of S4 consists of system design information and heritage experience together with a focus on components with health implications. The sensor suite down-selection is an iterative process for identifying a group of sensors that provide good fault detection and isolation for targeted fault scenarios. In the final selection analysis, a statistical evaluation algorithm provides the final robustness test for each down-selected sensor suite. NASA GRC has developed an approach to sensor data qualification that applies empirical relationships, threshold detection techniques, and Bayesian belief theory to a network of sensors related by physics (i.e., analytical redundancy) in order to identify the failure of a given sensor within the network. This data quality validation approach extends the state-of-the-art, from red-lines and reasonableness checks that flag a sensor after it fails, to include analytical redundancy-based methods that can identify a sensor in the process of failing. The focus of this effort is on understanding the proper application of analytical redundancy-based data qualification methods for onboard use in monitoring Upper Stage sensors.

Garg, Sanjay↗
DOE OSTI2026

Benchmark of the Chlorine Worth Study Experiments in Support of Chlorine Nuclear Data Validation for Nuclear Criticality Safety

The Chlorine Worth Study (CWS) was a critical experiment to address an urgent need for thermal chlorine nuclear data validation in plutonium systems. This urgent need is tied directly to plutonium recycle and recovery operations in the plutonium facility at Los Alamos National Laboratory, where exceptionally conservative criticality safety limits are used because no credit is taken for the neutron capture by chlorine. The experiment used weapons-grade plutonium metal plates clad in stainless steel, known as the PANN (plutonium aluminum no nickel) ZPPR (zero power physics reactor) plates. The plutonium was reflected and moderated by high-density polyethylene and included combinations of polyvinyl chloride (PVC) and chlorinated polyvinyl chloride (CPVC) as absorbers. The experiment and benchmark included three configurations mimicking 30 g 239 Pu/L plutonium, 300 g 239 Pu/L plutonium, and 600 g 239 Pu/L plutonium in an aqueous chloride solution. Uncertainties in the benchmark included five broad categories: (1) criticality measurement, (2) mass and density, (3) dimensions, (4) material compositions, and (5) positioning. The largest contribution to the overall uncertainties for all three cases came from the material compositions, in particular the PVC and CPVC absorber compositions. A detailed model was created to be a near match (that is within expectations of transport code users) and a simplified model was created to minimize offset dimensions and expedite modeling for code validation. Sample calculations were completed in MCNP6.3 with ENDF/B-VIII.0 and ENDF/B-VII.1 nuclear data. For the detailed and simplified models, the average difference between the computed and experimental k eff was 951 pcm. CWS will serve as the key validation experiment for nuclear criticality safety in support of aqueous chloride operations. The sensitivity to the chlorine capture cross section is orders of magnitude greater than other existing benchmarks. The current limits, as defined by nuclear criticality safety, are 520 g Pu per batch, i.e. the minimum critical mass of the Pu solution infinitely reflected by water [Criticality Handbook: Volume II, (1969)]. This extremely conservative critical mass limit does not credit any neutron capture by chlorine (in particular neutron capture by 35 Cl) and greatly impedes the throughput required for current and future operations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS1980

NASA TLA workload analysis support. Volume 3: FFD autopilot scenario validation data

The data used to validate a seven time line analysis of forward flight deck autopilot mode for the pilot and copilot for NASA B737 terminal configured vehicle are presented. Demand workloads are given in two forms: workload histograms and workload summaries (bar graphs). A report showing task length and task interaction is also presented.

Sundstrom, J. L.↗
DOE OSTI2022

NUMERICAL PREDICTIONS OF MEAN PERFORMANCE AND DYNAMIC BEHAVIOR OF A 10 MWe SCO2 COMPRESSOR WITH TEST DATA VALIDATION

High-fidelity aerodynamic analysis has been demonstrated for mean performance and unsteady dynamics in a sCO2 compressor designed by Hanwha Power Systems Americas for a 10 MWe Concentrating Solar Power plant. Simulations were performed with CRUNCH CFD® software tool that was matured to accurately model near critical real fluid effects in sCO2. Pre-test predictions for mean performance were validated with test data collected later. Performance predictions were accurate and captured sensitivity of the efficiency to inlet temperature of CO2 as well as steep drop-off at high flow rates due to condensation in the inlet throat. Detailed analysis was performed to understand the source of these performance losses at near critical conditions. Unsteady dynamic effects in the compressor at off-design conditions were also identified and quantified. In particular a system wide “condensation surge” condition was detected at high flow coefficients that results in large amplitude pulsations with accompanying mass flow fluctuations at low frequencies and has potential to cause damage in closed loop systems.

hosangadi, ashvin↗
NASA NTRS2016

Kepler Data Validation Time Series File: Description of File Format and Content

The Kepler space mission searches its time series data for periodic, transit-like signatures. The ephemerides of these events, called Threshold Crossing Events (TCEs), are reported in the TCE tables at the NASA Exoplanet Archive (NExScI). Those TCEs are then further evaluated to create planet candidates and populate the Kepler Objects of Interest (KOI) table, also hosted at the Exoplanet Archive. The search, evaluation and export of TCEs is performed by two pipeline modules, TPS (Transit Planet Search) and DV (Data Validation). TPS searches for the strongest, believable signal and then sends that information to DV to fit a transit model, compute various statistics, and remove the transit events so that the light curve can be searched for other TCEs. More on how this search is done and on the creation of the TCE table can be found in Tenenbaum et al. (2012), Seader et al. (2015), Jenkins (2002). For each star with at least one TCE, the pipeline exports a file that contains the light curves used by TPS and DV to find and evaluate the TCE(s). This document describes the content of these DV time series files, and this introduction provides a bit of context for how the data in these files are used by the pipeline.

DV Time Series↗
NASA NTRS2019

Kepler Data Validation II–Transit Model Fitting and Multiple-Planet Search

This paper discusses the transit model-fitting and multiple-planet search algorithms and performance of the Kepler Science Data Processing Pipeline, developed by the Kepler Science Operations Center (SOC). Threshold crossing events (TCEs), which are transit candidate events, are generated by the Transiting Planet Search (TPS) component of the pipeline and subsequently processed in the data validation (DV) component. The transit model is used in DV to fit TCEs to characterize planetary candidates and to derive parameters that are used in various diagnostic tests to classify them. After the signature associated with the TCE is removed from the light curve of the target star, the residual light curve goes through TPS again to search for additional TCEs. The iterative process of transit model fitting and multiple-planet search continues until no TCE is generated from the residual light curve or an upper limit is reached. The transit model-fitting and multiple-planet search performance of the final release (9.3, 2016January) of the pipeline is demonstrated with the results of the processing of four years (17 quarters) of flight data from the primary Kepler Mission. The transit model-fitting results are accessible from the NASA Exoplanet Archive. The final version of the SOC codebase is available through GitHub.

Threshold crossing events (TCEs↗
DOE OSTI2023

DESI Survey Validation Data in the COSMOS/Hyper Suprime-Cam Field: Cool Gas Trace Main-sequence Star-forming Galaxies at the Cosmic Noon

We present the first result in exploring the gaseous halo and galaxy correlation using the Dark Energy Spectroscopic Instrument survey validation data in the Cosmic Evolution Survey (COSMOS) and Hyper Suprime-Cam field. We obtain multiphase gaseous halo properties in the circumgalactic medium by using 115 quasar spectra (signal-to-noise ratio > 3). We detect Mg ii absorption at redshift 0.6 < z < 2.5, C iv absorption at 1.6 < z < 3.6, and H i absorption associated with the Mg ii and C iv. By crossmatching the COSMOS2020 catalog, we identify the Mg ii and C iv host galaxies in 10 quasar fields at 0.9< z < 3.1. We find that within the impact parameter of 250 kpc, a tight correlation is seen between the strong Mg ii equivalent width and the host galaxy star formation rate. The covering fraction f c of the strong Mg ii selected galaxies, which is the ratio of the absorbing galaxy in a certain galaxy population, shows significant evolution in the main-sequence galaxies and marginal evolution in all the galaxy populations within 250 kpc at 0.9 < z < 2.2. The f c increase in the main-sequence galaxies likely suggests the coevolution of strong Mg ii absorbing gas and the main-sequence galaxies at the cosmic noon. Furthermore, Mg ii and C iv absorbing gas is detected out of the galaxy virial radius, tentatively indicating the feedback produced by the star formation and/or the environmental effects.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2023

Data Validation Experiments with a Computer-Generated Imagery Dataset for International Nuclear Safeguards

Computer vision models have great potential as tools for international nuclear safeguards verification activities, but off-the-shelf models require fine-tuning through transfer learning to detect relevant objects. Because open-source examples of safeguards-relevant objects are rare, and to evaluate the potential of synthetic training data for computer vision, we present the Limbo dataset. Limbo includes both real and computer-generated images of uranium hexafluoride containers for training computer vision models. Here, we generated these images iteratively based on results from data validation experiments that are detailed here. The findings from these experiments are applicable both for the safeguards community and the broader community of computer vision research using synthetic data.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
NASA NTRS1989

SAGE II aerosol data validation - Comparative studies of SAGE II and SAM II data sets

Data from the Stratospheric Aerosol and Gas Experiment (SAGE II) satellite are compared with data from the Stratospheric Aerosol Measurement (SAM II) satellite. Both experiments produce aerosol extinction profiles by measuring the attenuation of solar radiation during each sunrise and sunset observed by the satelltie. The SAGE II obtains profiles at 1.02 microns and three smaller wavelengths, whereas the SAM II measures at only one radiometric channel at 1.0 microns. It is found that the differences between the two sets of data are generally within the error bars associated with each measurement. In addition, the sunrise and sunset data from SAGE II are analyzed.

Yue, G. K.↗
DOE OSTI2023

Expansion of the Verified, Archived, Library of Inputs and Data (VALID) [Slides]

This project dialogue provides an update on the Expansion of Verified, Archived, Library of Inputs and Data or VALID. VALID is a QA-Like (Quality Assurance) process to generate high quality models from reliable reference descriptions and make those models available to users. This presentation provides a brief project overview, a reminder of cases added in FY2021, cases currently in progress, and future plans for VALID.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
NASA NTRS1980

NASA TLA workload analysis support. Volume 2: Metering and spacing studies validation data

Four sets of graphic reports--one for each of the metering and spacing scenarios--are presented. The complete data file from which the reports were generated is also given. The data was used to validate the detail task of both the pilot and copilot for four metering and spacing scenarios. The output presents two measures of demand workload and a report showing task length and task interaction.

Sundstrom, J. L.↗
DOE OSTI2022

Data Validation for Hosting Capacity Analyses [Slides]

The National Renewable Energy Laboratory (NREL), in partnership with the Interstate Renewable Energy Council (IREC), has recently released a report which identifies a suite of best practices for producing trusted, validated hosting capacity analysis results reflecting real-world grid conditions.

24 POWER TRANSMISSION AND DISTRIBUTION↗
NASA NTRS2008

Assessing the Relative Performance of Microwave-based Satellite Rain Rate Retrievals using TRMM Ground Validation Data

Space-borne microwave sensors provide critical rain information used in several global multi-satellite rain products, which in turn are used for a variety of important studies, including landslide forecasting, flash flood warning, data assimilation, climate studies, and validation of model forecast of precipitation. This study employs four years (2003-2006) of satellite data to assess the relative performance and skill of SSM/I (F13, F14 and F15), AMSU-B (N15, N16 and N17), AMSR-E (AQUA) and the TRMM Microwave Imager (TMI) in estimating surface rainfall based on direct instantaneous comparison with ground-based rain estimates from Tropical Rainfall Measuring Mission (TRMM) Ground Validation (GV) sites at Kwajalein, Republic of the Marshall Islands (KWAJ) and Melbourne, Florida (MELB). The relative performance of each of these satellites is examined via comparisons with GV radar-based rain rate estimates. Because underlying surface terrain is known to affect the relative performance of the satellite algorithms, the data for MELB was further stratified into ocean, land and coast categories using a 0.25 terrain mask. Of all the satellite estimates compared in this study, TMI and AMSR-E exhibited considerably higher correlations and skills in estimating/observing surface precipitation. While SSM/I and AMSU-B exhibited lower correlations and skills for each of the different terrain categories, the SSM/I absolute biases trended slightly lower than AMSRE over ocean, where the observations from both emission and scattering channels were used in the retrievals. AMSU-B exhibited the least skill relative to GV in all of the relevant statistical categories, and an anomalous spike was observed in the probability distribution functions near 1.0 mm hr-1. This statistical artifact appears to be related to attempts by algorithm developers to include some lighter rain rates, not easily detectable by its scatter-only frequencies. AMSU-B, however, agreed well with GV when the matching data was analyzed on monthly scales. These results signal developers of global rainfall products, such as the TRMM Multi-Satellite Precipitation Analysis (TMPA), and the Climate Data Center s Morphing (CMORPH) technique, that care must be taken when incorporating data from these input satellite estimates in order to provide the highest quality estimates in their products.

Wolff, David B.↗