Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “data validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
NASA NTRS1994

Low aspect ratio wing experiment

This test was initiated to provide validation data on low aspect ratio wings at transonic speeds. The test was conducted so that the data obtained would be useful in the validation of codes, and all boundary condition data required would be measured as part of the test. During the conduct of the test, the measured quantities were checked for repeatability, and when the data would not repeat, the cause was tracked down and either eliminated or included in the measurement uncertainty. The accuracy of the data was in the end limited by wall imperfections of the wind tunnel in which the test was run.

Olsen, Mike↗
NASA NTRS2015

Validation of GOSAT Data Products; Interim Report on the GOSAT/TANSO Project

The Orbiting Carbon Observatory-2 (OCO-2) Team has continued working closely with the Greenhouse Gases Observing Satellite (GOSAT) team to (i) conduct vicarious calibration experiments in Railroad Valley, NV, U.S.A., (ii) retrieve estimates of X CO2 from OCO-2 and GOSAT TANSO-FTS data, and (iii) validate these products using internationally recognized standards. The OCO-/GOSAT relationship was reinforced in March 2015 with the signing a new Memorandum of Understanding between NASA and the GOSAT and GOSAT-2 partners. Over the past year, while the GOSAT team has been finalizing the V201 product, the OCO-2 team has focused primarily on the delivery of the OCO-2 product, providing new opportunities for cross calibration of the OCO-2 and GOSAT instruments and cross validation of their products. These efforts are just now producing results. Members of the OCO-2 team have also continued the analysis of the GOSAT V161.161 data and the ACOS B3.5 products. Those efforts have produced 2 new refereed publications and several others in review. The OCO-2 now preparing to reprocess the entire GOSAT TANSO-FTS data record using the GOSAT V201 product and OCO-2 B7 algorithm to produce a 7-year, multi-satellite climate data record for X(sub CO2).

Wennberg, Paul↗
DOE OSTI2021

Sensitivity-based Similarity Metrics for New Experiment Design Optimization

The nuclear data used in advanced reactor simulations requires validation. Data from nuclear criticality experiments can provide this validation. New nuclear criticality experiment design requires extensive knowledge and expert judgement such that the experimental design parameters are selected in such a way to keep the experiment subcritical. To aide in this experimental design process, professionals can utilize sensitivity and uncertainty analysis. Sensitivity and uncertainty analysis relies on matching new application experiments with currently existing benchmark experiments. Currently, there is functionality in the Whisper 1.1 software package to calculate a similarity metric based on neutron multiplication factor sensitivity coefficients between a new application designed by the user and existing International Criticality Safety Benchmark Experiment Project (ICSBEP) benchmarks. The Whisper 1.1 software package is included in Monte Carlo N-Particle ® Code Version 6.21 (MCNP ® 6.2). This work is geared toward expanding this capability to new similarity metrics based on beta-effective sensitivity coefficients and reactivity coefficient sensitivity coefficients. While the investigation of these sensitivity coefficients is presented in detail in separate works at this same conference, this work will be primarily focused on studying the similarity metrics in more detail. These similarity metrics will then be incorporated into the optimization algorithms used for experiment design in EUCLID (Experiments Underpinned by Computational Learning for Improvements in nuclear Data), which is a Los Alamos National Laboratory (LANL) project designed to constrain nuclear data of interest, such that adjustments can be made to possible inaccuracies. A more detailed optimization can be subsequently performed by breaking down these similarity metrics by isotope, reaction, and energy.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS1995

Estimating the urban bias of surface shelter temperatures using upper-air and satellite data. Part 1: Development of models predicting surface shelter temperatures

Multiple regression techniques were used to predict surface shelter temperatures based on the time period 1986-89 using upper-air data from the European Centre for Medium-Range Weather Forecasts (ECMWF) to represent the background climate and site-specific data to represent the local landscape. Global monthly mean temperature models were developed using data from over 5000 stations available in the Global Historical Climate Network (GHCN). Monthly maximum, mean, and minimum temperature models for the United States were also developed using data from over 1000 stations available in the U.S. Cooperative (COOP) Network and comparative monthly mean temperature models were developed using over 1150 U.S. stations in the GHCN. Three-, six-, and full-variable models were developed for comparative purposes. Inferences about the variables selected for the various models were easier for the GHCN models, which displayed month-to-month consistency in which variables were selected, than for the COOP models, which were assigned a different list of variables for nearly every month. These and other results suggest that global calibration is preferred because data from the global spectrum of physical processes that control surface temperatures are incorporated in a global model. All of the models that were developed in this study validated relatively well, especially the global models. Recalibration of the models with validation data resulted in only slightly poorer regression statistics, indicating that the calibration list of variables was valid. Predictions using data from the validation dataset in the calibrated equation were better for the GHCN models, and the globally calibrated GHCN models generally provided better U.S. predictions than the U.S.-calibrated COOP models. Overall, the GHCN and COOP models explained approximately 64%-95% of the total variance of surface shelter temperatures, depending on the month and the number of model variables. In addition, root-mean-square errors (rmse's) were over 3 C for GHCN models and over 2 C for COOP models for winter months, and near 2 C for GHCN models and near 1.5 C for COOP models for summer months.

Epperson, David L.↗
DOE OSTI2022

Horizontal Split Table Conceptual Design for Validation of Nuclear Data used in Advanced Reactors [Slides]

This presentation discusses a methodology that was developed to create conceptual designs of benchmark critical experiments for advanced reactors and nuclear data testing. A first concept that was explored was a pebble-bed high-temperature gas cooled reactor, based on the HTR-10 reactor. The very high correlation is a proof of concept that the design is similar to the application, and performing such critical experiments would help nuclear data testing and validation. Other concepts could be explored if needed, such as a molten-salt reactor, a sodium-cooled fast reactor, or heat pipe reactors/microreactor.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2021

A review of modelling techniques for floating offshore wind turbines

Modelling floating offshore wind turbines (FOWTs) is challenging due to the strong coupling between the aerodynamics of the turbine and the hydrodynamics of the floating platform. Physical testing at scale is faced with the additional challenge of the scaling mismatch between Froude number and Reynolds number due to working in the two fluid domains, air and water. In the drive for cost-reduction of floating wind energy, designers may be seeking to move towards high-fidelity numerical modelling as a substitute for physical testing. However, the numerical engineering tools typically used for FOWT modelling are considered as mid-fidelity to low-fidelity tools, and currently lack the level of accuracy required to do so. Furthermore, there is a lack of operational FOWT data available for further development and validation. High-fidelity tools, such as CFD, have greater accuracy but are cumbersome tools and still require validation. Physical scale model testing therefore continues to play an essential role in the development of FOWTs both as a source of validation data for numerical models and as an important development step along the path to commercialization of all platform concepts. The aim of this paper is to provide an overview of both numerical modelling and physical FOWT scale model testing approaches and to provide guidance on the selection of the most appropriate approach (or combination of approaches). The current state-of-the-art will be discussed along with current research trends and areas for further investigation.

17 WIND ENERGY↗
DOE OSTI2022

Use of machine learning for a helium line intensity ratio method in Magnum-PSI

Optical emission spectroscopy (OES) of helium (He) line intensities has been used to measure the electron density, ne, and temperature, Te, in various plasma devices. In this study, a neural network with five hidden layers is introduced to model the relation between the OES data and ne/Te from laser Thomson scattering in the linear plasma device Magnum-PSI and compared to multiple regression analysis. It is shown that the neural network reduces the residual errors of prediction values (ne and Te) less than half those of the multiple regression analysis. We checked two different data splitting methods for training and validation data, i.e., with and without considering the unit of discharge. A comparison of the splitting methods suggests that the residual error will decrease to ~10% even for a new discharge data when accumulating a sufficient data set.

Kajita, Shin↗
NASA NTRS1978

NASA and the U.S. climate program - A problem in data management

NASA's contribution to the total data base for the National Climate Plan will be to produce climate data sets from its experimental space observing systems and to maximize the value of these data for climate analysis and prediction. Validated data sets will be provided to NOAA for inclusion into their overall diagnostic data base. NASA data management for the Climate Plan will involve: (1) cataloging and retrieval of large integrated and distributed data sets upon user demand, and (2) the storage equivalent of 100,000 digital data tapes. It will be the largest, most complex data system ever developed by NASA

Quann, J. J.↗
NASA NTRS1988

MODIS information, data and control system (MIDACS) operations concepts

The MODIS Information, Data, and Control System (MIDACS) Operations Concepts Document provides a basis for the mutual understanding between the users and the designers of the MIDACS, including the requirements, operating environment, external interfaces, and development plan. In defining the concepts and scope of the system, how the MIDACS will operate as an element of the Earth Observing System (EOS) within the EosDIS environment is described. This version follows an earlier release of a preliminary draft version. The individual operations concepts for planning and scheduling, control and monitoring, data acquisition and processing, calibration and validation, data archive and distribution, and user access do not yet fully represent the requirements of the data system needed to achieve the scientific objectives of the MODIS instruments and science teams. The teams are not yet formed; however, it is possible to develop the operations concepts based on the present concept of EosDIS, the level 1 and level 2 Functional Requirements Documents, and through interviews and meetings with key members of the scientific community. The operations concepts were exercised through the application of representative scenarios.

Han, D.↗
NASA NTRS1995

Radio-science performance analysis software

The Radio Science Systems Group (RSSG) provides various support functions for several flight project radio-science teams. Among these support functions are uplink and sequence planning, real-time operations monitoring and support, data validation, archiving and distribution functions, and data processing and analysis. This article describes the support functions that encompass radio-science data performance analysis. The primary tool used by the RSSG to fulfill this support function is the STBLTY program set. STBLTY is used to reconstruct observable frequencies and calculate model frequencies, frequency residuals, frequency stability in terms of Allan deviation, reconstructed phase, frequency and phase power spectral density, and frequency drift rates. In the case of one-way data, using an ultrastable oscillator (USO) as a frequency reference, the program set computes the spacecraft transmitted frequency and maintains a database containing the in-flight history of the USO measurements. The program set also produces graphical displays. Some examples and discussions on operating the program set on Galileo and Ulysses data will be presented.

Morabito, D. D.↗
NASA NTRS2005

Critical Technologies for Hypersonic Vehicle Development

The objective of the present RTO/VKI Lecture Series is to focus attention on the technologies that play a critical role in hypersonic vehicle development. Owing to the demanding flight environment, successful development of hypersonic vehicles will require progress in understanding and surmounting specific technical problems in ground test, numerical simulation and flight test. Following the introductory remarks stating the objectives of the Lecture Series, a historical perspective on hypersonic vehicle development was given to establish the context and to highlight the emerging role of numerical simulation in vehicle design. A thorough review of ongoing vehicle development and flight-test programs completed the introductory portion. To provide sufficient background information, lectures were presented on compressible flows of perfect and imperfect gases, with special attention given to shock-wave boundary-layer interactions, laminar to turbulent transition, and high temperature gas properties. Advancements in computational modeling capabilities for hypersonic vehicle design were addressed, and the ongoing need for validation data, as well as a consistent validation methodology, where highlighted. Specific critical technology areas, including trajectory aerothermal environment definition, system trade studies, propulsion systems, aerodynamic control laws, flight instrumentation, thermal protection systems and flight experiments were all addressed in separate lectures given by international experts. Finally, the potential of plasma devices to ameliorate or avoid critical aerothermal phenomena was presented, providing a good example of the type of creative effort required for achieving progress. In all of the presentations the needs of future hypersonic flight vehicle development programs were addressed.

Research and Technology Organisation (RTO)↗
NASA NTRS2010

MISR Global Aerosol Product Assessment by Comparison with AERONET

A statistical approach is used to assess the quality of the MISR Version 22 (V22) aerosol products. Aerosol Optical Depth (AOD) retrieval results are improved relative to the early post- launch values reported by Kahn et al. [2005a], varying with particle type category. Overall, about 70% to 75% of MISR AOD retrievals fall within 0.05 or 20% AOD of the paired validation data, and about 50% to 55% are within 0.03 or 10% AOD, except at sites where dust, or mixed dust and smoke, are commonly found. Retrieved particle microphysical properties amount to categorical values, such as three groupings in size: "small," "medium," and "large." For particle size, ground-based AERONET sun photometer Angstrom Exponents are used to assess statistically the corresponding MISR values, which are interpreted in terms of retrieved size categories. Coincident Single-Scattering Albedo (SSA) and fraction AOD spherical data are too limited for statistical validation. V22 distinguishes two or three size bins, depending on aerosol type, and about two bins in SSA (absorbing vs. non-absorbing), as well as spherical vs. non-spherical particles, under good retrieval conditions. Particle type sensitivity varies considerably with conditions, and is diminished for mid-visible AOD below about 0.15 or 0.2. Based on these results, specific algorithm upgrades are proposed, and are being investigated by the MISR team for possible implementation in future versions of the product.

Kahn, Ralph A.↗
DOE OSTI2020

Robust Method to Identify Groundwater Affected By Redox Conditions at Los Alamos National Laboratory Legacy Cleanup Site - 20497

To facilitate the mission of the Department of Energy's (DoE's) Environmental Management Program at Los Alamos National Laboratory (LANL), a significant number of groundwater monitoring wells with depths ranging from 152-396 meter were completed for characterization and monitoring. Groundwater at Los Alamos tends to be oxygen saturated with very low concentrations of organic matter. Drilling fluids can introduce residual carbon causing an increase in microbial activity and local reducing conditions around the well, potentially impacting representativeness of groundwater data quality for redox sensitive constituents. We assert that the redox state of the wells can robustly be identified by aqueous solution concentrations of iron and manganese. An automated review process has been built into a computer-based data management system enabling an efficient screening process for identifying reducing conditions that are not caught using standard data-validation protocol, and ensures that important data quality issues are thoroughly identified and addressed in an efficient and timely manner. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2021

Validation of Jezebel Reactivity Coefficients and Sensitivity Analysis

Nuclear data validation is often performed today using criticality measurements. The gold standard for criticality measurements is the International Criticality Safety Benchmark Experiment Project (ICSBEP). The validation specifically focuses on the effective multiplication factor ($k_{eff}$). $K_{eff}$ is a relatively easy parameter to infer and has reduced uncertainty due to being at or above critical. However, while $k_{eff}$ is the most documented parameter and its uncertainties and sensitivities have been evaluated in great detail, it cannot be used as a standalone metric to determine inaccuracies in nuclear data (e.g., cross section data, PFNS, nu), which is based on theory, physics, and differential measurements. The Experiments Underpinned by Computational Learning for Improvements in nuclear Data (EUCLID) project aims to identify compensating errors in specific isotope nuclear data by optimally designing experiments that are, or are not sensitive to a suite of measurement parameters beyond $k_{eff}$. By identifying parameters that are sensitive to each other, oppositely sensitive, or have substantial magnitude differences in sensitivity, experiments can be designed to constrain questionable nuclear data. One sensitivity that is of particular interest to this project includes the sensitivity of reactivity coefficients. Reactivity coefficients compare reactivity, which is related to $k_{eff}$ at two different states therefore being sensitive to small changes in the system. The most common type of reactivity coefficient measurements is comparison to void for a small sample within the assembly. It is key that the sample sizes are small enough to not affect the flux of the full system. Reactivity coefficients were evaluated for many early experiments to better understand transport corrected cross sections. In fact, ICSBEP includes reactivity coefficient results as “Supplemental Measurements” in appendices for a handful of older benchmarks. One of those benchmarks is Jezebel, the bare Pu critical assembly. This paper compares new simulations of reactivity coefficients for Jezebel, and explores the sensitivity of reactivity coefficients to small changes in nuclear data.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2025

Design of a High-Assay Low-Enriched Uranium Tri-Structural Isotropic Critical Experiment for Advanced Reactor Validation

High-assay low-enriched uranium (HALEU) fuel is a key component of many small modular reactor designs. Critical experiments are an important way to understand the neutronic performance of systems by obtaining nuclear data validations through measurements. Data reduce uncertainty and risk by showing that systems respond as predicted to changes such as temperature, subsequently advancing the overall technology readiness level of the materials within. Numerous critical experiments have been performed at the National Criticality Experiments Research Center (NCERC) operated by Los Alamos National Laboratory at the Nevada National Security Site since it became operational in 2011. However, the first experiment with HALEU fuel did not occur until 2024. Through extensive engineering, the experiment described in this paper was successfully designed and executed for the Comet vertical lift assembly at NCERC to perform measurements with HALEU tri-structural isotropic fuel that will assist in validation of nuclear data and computational modeling of small modular reactors for years to come.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
NASA NTRS2002

The MODIS Aerosol Algorithm: From First Light to Maturity

The MODerate resolution Imaging Spectroradiometer (MODIS) currently aboard both the Terra and Aqua satellites produces a suite of products designed to characterize global aerosol distribution, optical thickness and particle size. Terra with MODIS aboard was launched at the end of 1999 and began transmitting data at the end of February 2000. Algorithms were in place, designed to use the observed radiances to derive many important aerosol products. Early comparisons of the retrieved aerosol parameters with ground-based validation data, showed remarkable agreement between the two types of data, but also showed us situations in which the algorithms could be improved. Almost immediately, the algorithms were modified to reflect a better understanding of the instrument's capabilities and the nature of aerosols and clouds. We describe the MODIS aerosol algorithms, highlighting the changes that were implemented post-launch. We describe the wealth of aerosol products derived from MODIS data and available to any user. Lastly, we compare over a year of MODIS data to co-located ground-based data as validation, and analyze the validation as to geographic location and temporal changes. This presentation is meant as an overview of the mature MODIS aerosol algorithm.

Remer, L. A.↗
NASA NTRS2006

NASA Software Estimating Tool (N-SET)

The goals of this project are to: Develop an early lifecycle software cost estimation tool leveraging existing data and capabilities Collect additional software data from: a) Jet Propulsion Laboratory; b) Goddard Space Flight Center; and c) Marshall Space Flight Center. Analyze, normalize, evaluate, stratify, and validate data. Create a calibrated, validated, and documented tool initially using available data and subsequently using newly collected data.

cost estimating tools↗
DOE OSTI2020

Random Forest Optimization for Radionuclide Identification

Radionuclide identification through gamma-ray spectroscopy is an indispensable tool in combatting the illicit smuggling of nuclear material. The radionuclide identification devices used in the field need to provide ready-made answers to non-experts, and therefore require sophisticated algorithms that can interpret the underlying data. We investigated the Random Forest classifier as a tool for identifying the radionuclide that is consistent with the data. We were provided with training and validations data sets and used them to optimize the two hyperparameters of the classifiers: maximum features required, and minimum samples used to split each node. The F1 score, a harmonic mean of precision and recall, was used to evaluate the performance of each built classifier. We found the optimal performance with minimum samples of 5 and maximum features of 50, with the F1 score of 0.95.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗