Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “validation dataset”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

High-Resolution PM2.5 Concentrations Estimation Based on Stacked Ensemble Learning Model Using Multi-Source Satellite TOA Data

Nepal has experienced severe fine particulate matter (PM2.5) pollution in recent years. However, few studies have focused on the distribution of PM2.5 and its variations in Nepal. Although many researchers have developed PM2.5 estimation models, these models have mainly focused on the kilometer scale, which cannot provide accurate spatial distribution of PM2.5 pollution. Based on Gaofen-1/6 and Landsat-8/9 satellite data, we developed a stacked ensemble learning model (named XGBLL) combined with meteorological data, ground PM2.5 concentrations, ground elevation, and population data. The model includes two layers: a XGBoost and Light GBM model in the first layer, and a linear regression model in the second layer. The accuracy of XGBLL model is better than that of a single model, and the fusion of multi-source satellite remote sensing data effectively improves the spatial coverage of PM2.5 concentrations. Besides, the spatial distribution of the daily mean PM2.5 concentrations in the Kathmandu region under different air conditions was analyzed. The validation results showed that the monthly averaged dataset was accurate (R2 = 0.80 and root mean square error = 7.07). In addition, compared to previous satellite PM2.5 datasets in Nepal, the dataset produced in this study achieved superior accuracy and spatial resolution.

Environmental Sciences & Ecology↗

Demonstration of VOC Fenceline Sensors and Canister Grab Sampling near Chemical Facilities in Louisville, Kentucky

Experimental fenceline sensor pods (SPods) fitted with 30 s duration canister grab sampling (CGS) systems were deployed at a site near chemical facilities in Louisville, KY, from 4 June 2018 to 5 January 2020. The objective of the study was to better understand lower cost 10.6 eV photoionization detector (PID)-based volatile organic compound (VOC) sensors and investigate their utility for near-source emissions detection applications. Prototype SPods containing PID sensor elements from two different manufacturers yielded between 78% and 86% valid data over the study, producing a dataset of over 120,000 collocated pair fenceline measurements averaged into 5-min datapoints. Ten-second time-resolved SPod data from an elevated fenceline sensor signal day are presented, illustrating source emission detections from the direction of a facility 500 m west of the monitoring site. An SPod-triggered CGS acquired in the emission plume on this day contained elevated concentrations of 1,3-butadiene and cyclohexane (36 parts per billion by volume (ppbv) and 637 ppbv, respectively), compounds known to be emitted by this facility. Elevated concentrations of these compounds were observed in a subset of the 61 manual and triggered CGS grab samples acquired during the study, with winds from the west. Using novel wind-resolved visualization and normalization approaches described herein, the collocated pair SPod datasets exhibited similarity in emission source signature. With winds from the west, approximately 50% of SPod readings were above our defined theoretical detection limit indicating persistent measurable VOC signal at this site. Overall, this 19-month study demonstrated reasonable prototype SPod operational performance indicating that improved commercial forms of lower cost PID sensors could be useful for select VOC fenceline monitoring applications.

1,3-butadiene↗

First global WCRP shortwave surface radiation budget dataset

Shortwave radiative fluxes that reach the earth's surface are key factors that influence atmospheric and oceanic circulations as well as surface climate. Yet, information on these fluxes is meager. Surface site data are generally available from only a limited number of observing stations over land. Much less is known about the large-scale variability of the shortwave radiative fluxes over the oceans, which cover most of the globe. Recognizing the need to produce global-scale fields of such fluxes for use in climate research, the World Climate Research Program has initiated activities that led to the establishment of the Surface Radiation Budget Climatology Project with the ultimate goal to determine various components of the surface radiation budget from satellite data. In this paper, the first global products that resulted from this activity are described. Monthly and daily data on a 280-km grid scale are available. Samples of climate parameters obtainable from the dataset are presented. Emphasis is given to validation and limitations of the results. For most of the globe, satellite estimates have bias values between +/- 20 W/sq m and root mean square (rms) values are around 25 W/sq m. There are specific regions with much larger uncertainties however.

Whitlock, C. H.↗

First global WCRP shortwave surface radiation budget dataset

Shortwave radiative fluxes that reach the Earth's surface are key factors that influence atmospheric and oceanic circulations as well as surface climate. Yet, information on these fluxes is meager. Surface site data are generally available from only a limited number of observing stations over land. Much less is known about the large-scale variability of the shortwave radiative fluxes over the oceans, which cover most of the globe. Recognizing the need to produce global-scale fields of such fluxes for use in climate research, the World Climate Research Program has initiated activities that led to the establishment of the Surface Radiation Budget Climatology Project with the ultimate goal to determine various components of the surface radiation budget from satellite data. In this paper, the first global products that resulted from this activity are described. Monthly and daily data on a 280-km grid scale are available. Samples of climate parameters obtainable from the dataset are presented. Emphasis is given to validation and limitations of the results. For most of the globe, satellite estimates have bias values between +/- 20 W/sq m and rms values are around 25 W/sq m. There are specific regions with much larger uncertainties however.

Whitlock, C. H.↗

Blade Displacement Measurement Technique Applied to a Full-Scale Rotor Test

Blade displacement measurements using multi-camera photogrammetry were acquired during the full-scale wind tunnel test of the UH-60A Airloads rotor, conducted in the National Full-Scale Aerodynamics Complex 40- by 80-Foot Wind Tunnel. The objectives were to measure the blade displacement and deformation of the four rotor blades as they rotated through the entire rotor azimuth. These measurements are expected to provide a unique dataset to aid in the development and validation of rotorcraft prediction techniques. They are used to resolve the blade shape and position, including pitch, flap, lag and elastic deformation. Photogrammetric data encompass advance ratios from 0.15 to slowed rotor simulations of 1.0, thrust coefficient to rotor solidity ratios from 0.01 to 0.13, and rotor shaft angles from -10.0 to 8.0 degrees. An overview of the blade displacement measurement methodology and system development, descriptions of image processing, uncertainty considerations, preliminary results covering static and moderate advance ratio test conditions and future considerations are presented. Comparisons of experimental and computational results for a moderate advance ratio forward flight condition show good trend agreements, but also indicate significant mean discrepancies in lag and elastic twist. Blade displacement pitch measurements agree well with both the wind tunnel commanded and measured values.

Abrego, Anita I.↗

Retrospective Observations of the Solar System Planets with Interstellar Probe

Retrospective Observations of the Solar System Planets with Interstellar Probe The Interstellar Probe (ISP) mission concept could simultaneously explore a number of long-standing solar system and exoplanetary science objectives. ISP’s long mission lifetime, in combination with the large separations from the solar system objects it could observe (Fig. 1), affords a truly unique dataset. This data could be leveraged to validate models of solar system and extrasolar planets and would be directly analogous to observations we can expect to make for exoplanets. Taken together, these opportunities suggest that ISP’s mission is a critical and necessary component for future planetary science endeavors. This abstract aims to address some of the clear synergies between ISP’s mission profile and the gaps in solar system science that are necessarily gaps in our ability to wholly bound our expectations for exoplanet observations (partly discussed in several white papers, including Zemcov et al., 2019; Harman et al., 2020). Notably, no single platform has yet returned near-complete phase curves for the majority of solar system planets. This is partly due to observational constraints (e.g., ground-based observatories can observe a maximum phase angle of Jupiter, Saturn, Uranus, and Neptune of 12º, 6º, 3º, and 2º, respectively; Mallama and Hilton, 2018), but also because of the sparse nature of observations captured by spacecraft over the last 40 years (e.g., Pollack et al., 1986). Additionally, these observations come from disparate instruments that have their own biases and limitations, whereas observations by ISP’s instrumentation would provide almost uniform measurements of nearly every solar system object, removing much of the uncertainty when it comes to data intercomparisons. The biggest hurdles for making these measurements from ISP are likely to be the tight mass and energy limitations, as well as the technical challenge of looking as close as possible to the Sun without peering directly at it. This is potentially complicated by the nature of the larger astrophysical mission requirements, including whether the spacecraft is spinning, but integrating observations on board before returning them to Earth serves to both partly mitigate both the possibility of a spinning spacecraft and the downlink volumes for lookback data (although it may make data disaggregation more technically challenging). Ultimately, ISP could return truly innovative observational data of our solar system, in furtherance of a number of planetary and solar system science goals.

Sonny Harman↗

Parametric Analysis of the Charge-Hold-Vent Method for Cryogenic Propellant Tank Chill Down

In the absence of external heat exchangers, the on-orbit transfer of cryogenic propellants requires the receiver tank to first be quenched to a sufficiently low energy state to allow for a continuous no-vent fill to avoid unnecessary venting of liquid. One proposed method for tank chilldown that minimizes the potential for venting liquid is the charge hold vent (CHV) method. CHV follows a cyclic process that gradually removes thermal energy from the receiver tank by injecting liquid with the vent valve closed and allowing the fluid and wall to reach near-thermal equilibrium before venting the superheated vapor. However, the CHV method must be optimized to minimize complexity, mass, and time. This paper presents a modular CHV analytical model used to quantify the number of cycles and propellant mass consumed based on first principles. The model is used to examine the effect of eight parameters: receiver tank material, volume, mass, maximum expected operating pressure, and initial pressure, liquid injection pressure and temperature, and the target temperature. The model is validated against the only two available CHV datasets. Based on results, the tank mass-to-volume ratio is the most important factor in determining the number of CHV cycles and thus degree of difficulty in tank chilldown. The model can easily be used for early-stage design, sizing, and analysis of cryogenic propellant transfer systems.

Tank Chilldown↗

Parametric Analysis of the Charge-Hold-Vent Method for Cryogenic Propellant Tank Chill Down

Abstract. In the absence of external heat exchangers, the on-orbit transfer of cryogenic propellants requires the receiver tank to first be quenched to a sufficiently low energy state to allow for a continuous no-vent fill to avoid unnecessary venting of liquid. One proposed method for tank chilldown that minimizes the potential for venting liquid is the charge hold vent (CHV) method. CHV follows a cyclic process that gradually removes thermal energy from the receiver tank by injecting liquid with the vent valve closed and allowing the fluid and wall to reach near-thermal equilibrium before venting the superheated vapor. However, the CHV method must be optimized to minimize complexity, mass, and time. This paper presents a modular CHV analytical model used to quantify the number of cycles and propellant mass consumed based on first principles. The model is used to examine the effect of eight parameters: receiver tank material, volume, mass, maximum expected operating pressure, and initial pressure, liquid injection pressure and temperature, and the target temperature. The model is validated against the only two available CHV datasets. Based on results, the tank mass-to-volume ratio is the most important factor in determining the number of CHV cycles and thus degree of difficulty in tank chilldown. The model can easily be used for early-stage design, sizing, and analysis of cryogenic propellant transfer systems. Keywords: tank chilldown, charge-hold-vent, no-vent fill

Tank Chilldown↗

Unsupervised Change Detection for Space Habitats Using 3D Point Clouds

This work presents an algorithm for scene change detection from point clouds to enable autonomous robotic caretaking in future space habitats. Autonomous robotic systems will help maintain future deep-space habitats, such as the Gateway space station, which will be uncrewed for extended periods. Existing scene analysis software used on the International Space Station (ISS) relies on manually-labeled images for detecting changes. In contrast, the algorithm presented in this work uses raw, unlabeled point clouds as inputs. The algorithm first applies modified Expectation-Maximization Gaussian Mixture Model (GMM) clustering to two input point clouds. It then performs change detection by comparing the GMMs using the Earth Mover’s Distance. The algorithm is validated quantitatively and qualitatively using a test dataset collected by an Astrobee robot in the NASA Ames Granite Lab comprising single frame depth images taken directly by Astrobee and full-scene reconstructed maps built with RGB-D and pose data from Astrobee. The runtimes of the approach are also analyzed in depth. The source code is publicly released to promote further development.

robotics↗

Experimental Investigation of a Boundary Layer Ingesting Tailcone Thruster Configuration at the National Transonic Facility

A transonic, high Reynolds number wind tunnel test of a Boundary Layer Ingesting Tailcone System (BLITS) was conducted in the National Transonic Facility (NTF) at the NASA Langley Research Center during the spring of 2023. The test was sponsored by the NASA Advanced Air Transport Technology Project and produced a large dataset to help in the development and validation of an integrated airframe-turbomachinery computational simulation capability. The Common Research Model with Tail Cone Thruster (CRM-TCT) configuration was tested at Mach numbers from 0.75 to 0.85 and Reynolds number based on mean aerodynamic chord from 5 to 15 million, with the objective of characterizing the tailcone nacelle inlet pressure and flow angle profile, characterizing the aftbody boundary layer (BL), and evaluating the overall airframe configuration performance. The test article included multiple tailcone nacelle assemblies with different measurement objectives, and each assembly was able to be controlled remotely and rotate in small increments, allowing for an increased measurement density for characterizing the nacelle inlet distortion. Additionally, the use of cryogenic-rated miniature BL rakes was successful in measuring boundary layer heights on the aftbody. Sensitivities of the measured quantities of interest to Mach number, Reynolds number, angle of attack, and nacelle weight flow rate are also presented.

boundary layer ingestion (BLI)↗

Experimental Investigation of a Boundary Layer Ingesting Tailcone Thruster Configuration at the National Transonic Facility

A transonic, high Reynolds number wind tunnel test of a Boundary Layer Ingesting Tailcone System (BLITS) was conducted in the National Transonic Facility (NTF) at the NASA Langley Research Center during the spring of 2023. The test was sponsored by the NASA Advanced Air Transport Technology Project and produced a large dataset to help in the development and validation of an integrated airframe-turbomachinery computational simulation capability. The Common Research Model with Tail Cone Thruster (CRM-TCT) configuration was tested at Mach numbers from 0.75 to 0.85 and Reynolds number based on mean aerodynamic chord from 5 to 15 million, with the objective of characterizing the tailcone nacelle inlet pressure and flow angle profile, characterizing the aftbody boundary layer (BL), and evaluating the overall airframe configuration performance. The test article included multiple tailcone nacelle assemblies with different measurement objectives, and each assembly was able to be controlled remotely and rotate in small increments, allowing for an increased measurement density for characterizing the nacelle inlet distortion. Additionally, the use of cryogenic-rated miniature BL rakes was successful in measuring boundary layer heights on the aftbody. Sensitivities of the measured quantities of interest to Mach number, Reynolds number, angle of attack, and nacelle weight flow rate are also presented.

boundary layer ingestion (BLI)↗

Computational Fluid Dynamics Simulation of Methane Slosh and Drain Experiments

NASA possesses a wealth of historical cryogenic experiments that provide valuable insights into the design, troubleshooting, and understanding involved in the complex fluid and thermodynamics of managing cryogenic propellants. One approach to leveraging these historical datasets is by simulating these experiments to validate the accuracy of simulation environments and constituent models. This study focused on simulating a selection of the K site test series for both static and sloshing pressurized liquid methane draining experiments conducted at NASA in the 1970’s, utilizing computational fluid dynamics. The simulations were performed in the ANSYS FLUENT environment using the Volume of Fluid (VOF) numerical approach. A k-omega turbulence model was used with interfacial turbulence damping, and accurately predicted the amount of pressurant needed to maintain the required tank pressure throughout the static drain. The static simulation predicted the temperature stratification in the ullage observed at the end of the drain. During the methane expulsion with sloshing test, many features were successfully captured using the k-omega turbulence model with interfacial turbulence damping included. The rate of phase change and liquid temperature was overpredicted compared to the experimental measurements. The overprediction may be attributed to uncertainties in the vessel geometry, methane pressurant temperature and composition, and methodological differences in how the sloshing frequency was adjusted during the expulsion.

Cryogenic Propellants↗

VERIFICATION OF TRISO FUEL BURNUP USING MACHINE LEARNING ALGORITHMS

Pebble Bed Reactors are fueled with fuel pebbles that are circulated multiple times through the reactor vessel before discharge. During the normal operation of a PBR, ejected pebbles are returned to the reactor or discharged depending on the fuel burnup and physical condition of the pebbles. The burnup measurement is usually based on detected radiation signatures of fission products accumulated in the pebble fuel over burnup. Previous research has shown that height of photopeaks of fission products, such as 134Cs, 137Cs, 154Eu, etc., can be used independently or in combination to infer or predict the level of burnup in the fuel. However, it remains challenging to measure such complex sources due to self-shielding effects, strong radiation background and intervening materials. Another operational challenge is the required high throughput of burnup measurement, which necessitates limited measurement time and thus impacts quality of measured gamma-ray spectra. Hence, advanced spectral analysis methods are needed to analyze the noisy gamma spectra and predict the burnup values. We propose to use machine learning (ML) method to interpret gamma-ray spectra and predict the burnup values of the pebbles. ML has achieved widespread success and adoption across a few domains that require pattern recognition and analysis in varied data types. In this work, we apply three proven ML approaches - multilayer perceptrons, convolutional neural networks, and transformers - to the task of predicting fuel burnup from measured gamma spectra, and compile a dataset of simulated spectra for training and validation of the ML models. In this paper, we will discuss the network architecture of these three ML approaches and compare the performance of the simplest of these (MLP) to a standard linear regression.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

DECADE+DES Y3 Weak Lensing Mass Map: A 13,000 deg$^2$ View of Cosmic Structure from 270 Million Galaxies

We present the largest galaxy weak lensing mass map of the late-time Universe, reconstructed from 270 million galaxies in the DECADE and DES Year 3 datasets, covering 13,000 square degrees. We validate the map through systematic tests against observational conditions (depth, seeing, etc.), finding the map is statistically consistent with no contamination. The large area covered by the mass map makes it a well-suited tool for cosmological analyses, cross-correlation studies and the identification of large-scale structure features. We demonstrate its potential by detecting cosmic filaments directly from the mass map for the first time and validating them through their association with galaxy clusters selected using the Sunyaev-Zeldovich effect from Planck and ACT DR6.

Gatti, M. [Chicago U., KICP] (ORCID:00000001613487↗

A Measurement of the Pion-Energy Dependence of Muon Neutrino Charged-Current Scattering to Final States With One Charged Pion in NOvA

The study of neutrino oscillations is a main priority for particle physics as the most immediately tractable lever on physics beyond the Standard Model. In particular, more insight into violation of the combined symmetry of charge-conjugation plus parity could yield clues to the origin of matter-antimatter asymmetry, and in some theoretical frameworks the neutrino mass could give insights into dark matter. NOvA is a long-baseline accelerator neutrino experiment with both a near and far detector that seeks to measure several of the parameters of the neutrino mixing matrix, as well as carry out a broad program of additional physics. NOvA has innovated and developed a variety of techniques in the space of neutrino physics, including expanding the use of machine learning techniques in reconstruction. NOvA has also set the stage for the next generation US-based long baseline experiment, DUNE. This dissertation details the creation of a new neutrino interaction vertex reconstruction package for NOvA, which offers enormous improvements in accuracy above the previous vertexer it replaces. This is accomplished using a Convolutional Visual Network trained on large datasets of simulated events. The vertexer is validated thoroughly against data. This dissertation also presents a cross-section measurement for $\nu_\mu + N \rightarrow \mu^- + 1\pi^\pm + X$ (where X does not include additional charged pions) binned in pion kinetic energy, a challenging measurement in general and for NOvA in particular. Measurements like this provide crucial inputs for neutrino interaction models utilized by neutrino oscillation experiments. This measurement in particular is important to the energy ranges relevant for DUNE in a band not well-covered by any other experiment.

Ewart, Erin [Indiana U., Bloomington (main)]↗

Challenges in predicting protein-protein interactions of understudied viruses: Arenavirus-human interactions

Understanding protein-protein interactions (PPIs) between viruses and host organisms is crucial for uncovering infection mechanisms and identifying potential therapeutic targets. The ability to generalize PPI predictive models across understudied viruses presents a significant challenge. In this work, we use arenavirus-human PPIs to illustrate the difficulties associated with model generalization, which are compounded by a lack of both positive and negative data. We employ a Transfer Learning approach to investigate arenavirus-human PPIs by utilizing models trained on better-studied virus-human and human-human PPIs. Additionally, we curate and assess four types of negative sampling datasets to evaluate their impact on model performance. Despite the overall high accuracies (93–99 %) and AUPRC scores (0.8–0.9) appearing promising, further analysis indicates that these performance metrics can be misleading due to data leakage, data bias, and overfitting, especially concerning under-represented viral proteins. We reveal these gaps and assess the impact of data imbalance using standard k-fold cross-validation and Independent Blind Testing with a Balanced Dataset, resulting in a drop in accuracy below 50 %. We propose a viral protein-specific evaluation framework that categorizes viral proteins into majority and minority classes based on their representation in the dataset, enabling comparison of model performance across these groups using balanced accuracies. This framework offers a more robust evaluation of model generalizability, addressing biases inherent in standard evaluation techniques and paving the way for more reliable PPI prediction models for understudied viruses.

59 BASIC BIOLOGICAL SCIENCES↗

A Summary of Validation Studies for the Integrated TIGER Series Performed on ACORN Plus-up 218468/99

The Integrated TIGER Series (ITS) transport code is a valuable tool for photon-electron transport. A seven-problem validation suite exists to make sure that the ITS transport code works as intended. It is important to ensure that data from benchmark problems is correctly compared to simulated data. Additionally, the validation suite did not previously make use of a consistent quantitative metric for comparing experimental and simulated datasets. To this end, the goal of this long-term project was to expand the validation suite both in problem type and in the quality of the error assessment. To accomplish that, the seven validation problems in the suite were examined for potential drawbacks. When a drawback was identified, the problems were ranked based on severity of the drawback and approachability of a solution. We determined that meaningful improvements could be made to the validation suite by improving the analysis for the Lockwood Albedo problem and by introducing the Ross dataset as an eighth problem to the suite. The Lockwood error analysis has been completed and will be integrated in the future. The Ross data is unfinished, but significant progress has been made towards analysis.

97 MATHEMATICS AND COMPUTING↗

Experimental Validation of Exact Burst Pressure Solutions for Thick-Walled Cylindrical Pressure Vessels

Burst pressure is one of the critical strength parameters used in the design and operation of pressure vessels because it represents the maximum pressure that a vessel can withstand before failing. Historically, the Barlow formula was used as a design base for estimating burst pressure. However, it does not consider the plastic flow response for ductile steels and is applicable only to thin-walled cylinders (i.e., the diameter to thickness ratio D/t ≥ 20). A new multiaxial plastic yield theory was developed to consider the plastic flow response, and the associated theoretical (i.e., Zhu–Leis) solution of burst pressure was obtained and has gained extensive applications in the pipeline industry because it was validated by different full-scale burst test datasets for large-diameter, thin-walled pipelines in a variety of steel grades from Grade B to X120. The Zhu–Leis flow theory of plasticity was recently extended to thick-walled pressure vessels, and the associated exact flow solution of burst pressure was obtained and is applicable to both thin and thick-walled cylindrical shells. Many full-scale burst tests are available for thin-walled line pipes in the pipeline industry, but limited pressure burst tests exist for thick-walled vessels. To validate the newly developed exact solutions of burst pressure for thick-walled cylinders, this paper conducts a series of burst pressure tests on small-diameter, thick-walled pipes. In particular, six burst tests are carried out for three thick-walled pipes in Grade B carbon steel. These pipes have a nominal diameter of 2.375 inches (60.33 mm) and three nominal wall thicknesses of 0.154, 0.218, and 0.344 inches (3.91, 5.54, and 8.74 mm), leading to D/t = 15.4, 10.9, and 6.9, respectively. With the burst test data, comparisons show that the Zhu–Leis flow solution of burst pressure matches well the burst test data for thick-walled pipes. Thus, these burst tests validate the accuracy of the Zhu–Leis flow solution of burst pressure for thick-walled cylindrical vessels.

42 ENGINEERING↗