Engineering Papers⌕ Search

SEARCH · Engineering Papers

Results for “training data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,675 records · Page 93
All sourcesNASA NTRSDOE OSTI
NASA NTRS2019

Reinforcement Learning Applied to Cognitive Space Communications

The future of space exploration depends on robust, reliable communication systems. As the number of such communication systems increase, automation is fast becoming a requirement to achieve this goal. A reinforcement learning solution can be employed as a possible automation method for such systems. The goal of this study is to build a reinforcement learning algorithm which optimizes data throughput of a single actor. A training environment was created to simulate a link within the NASA Space Communication and Navigation (SCaN) infrastructure, using state of the art simulation tools developed by the SCaN Center for Engineering, Networks, Integration, and Communications (SCENIC) laboratory at NASA Glenn Research Center to obtain the closest possible representation of the real operating environment. Reinforcement learning was then used to train an agent inside this environment to maximize data throughput. The simulation environment contained a single actor in low earth orbit capable of communicating with twenty-five ground stations that compose the Near-Earth Network (NEN). Initial experiments showed promising training results, so additional complexity was added by augmenting simulation data with link fading profiles obtained from real communication events with the International Space Station. A grid search was performed to find the optimal hyperparameters and model architecture for the agent. Using the results of the grid search, an agent was trained on the augmented training data. Testing shows that the agent performs well inside the training environment and can be used as a foundation for future studies with added complexity and eventually tested in the real space environment.

Schubert, Carson D.↗
NASA NTRS2023

Probabilistic Forecasting of Ground Magnetic Perturbation Spikes at Mid-Latitude Stations

The prediction of large fluctuations in the ground magnetic field (dB/dt) is essential for preventing damage from Geomagnetically Induced Currents. Directly forecasting these fluctuations has proven difficult, but accurately determining the risk of extreme events can allow for the worst of the damage to be prevented. Here we trained Convolutional Neural Network models for eight mid-latitude magnetometers to predict the probability that dB/dt will exceed the 99th percentile threshold 30–60 min in the future. Two model frameworks were compared, a model trained using solar wind data from the Advanced Composition Explorer (ACE) satellite, and another model trained on both ACE and SuperMAG ground magnetometer data. The models were compared to examine if the addition of current ground magnetometer data significantly improved the forecasts of dB/dt in the future prediction window. A bootstrapping method was employed using a random split of the training and validation data to provide a measure of uncertainty in model predictions. The models were evaluated on the ground truth data during eight geomagnetic storms and a suite of evaluation metrics are presented. The models were also compared to a persistence model to ensure that the model using both datasets did not over-rely on dB/dt values in making its predictions. Overall, we find that the models using both the solar wind and ground magnetometer data had better metric scores than the solar wind only and persistence models, and was able to capture more spatially localized variations in the dB/dt threshold crossings.

Michael Coughlan↗
DOE OSTI2026

Neural Network‐Based Methods for Ocean Surface Wave Measurement Using Submarine Distributed Acoustic Sensing (DAS)

Two new data-driven models for estimating ocean surface waves from distributed acoustic sensing (DAS) submarine cable strain rate are developed using supervised machine learning on a 10-day data set collected offshore of Oliktok Point, Alaska. The new models were trained on target data from seafloor pressure moorings at three sites spaced evenly along 27.1 km of cable and were benchmarked against an empirical transfer function method previously used to estimate waves from DAS. A model which uses convolutional neural networks to transform 2-km frequency-wavenumber strain spectra to seafloor pressure spectra outperforms the benchmark in wave height prediction (RMSE of 0.15 vs. 0.41 m) and period prediction (0.29 vs. 0.37 s) when evaluated on a held-out test data set. When applied to a DAS data set collected on the same cable 2 years prior, the CNN-based model maintained similar significant wave height performance (RMSE = 0.23 m) relative to available satellite altimetry data. A two-hidden-layer, fully connected neural network which transforms 1-D strain spectra to seafloor pressure spectra also outperforms the benchmark in wave height prediction (RMSE of 0.19 vs. 0.41 m), but does not generalize as well to the prior data. Regression-based machine learning is useful for estimating waves from DAS data when the pressure-strain relationship varies temporally and spatially across different wave conditions. Models can be applied to DAS data to measure waves with higher spatial resolution and longer temporal coverage than traditional methods, which often measure waves only at a single point.

Davis, Jacob R. [Univ. of Washington, Seattle, WA ↗
DOE OSTI2024

Comparative Assessment of U-Net-Based Deep Learning Models for Segmenting Microfractures and Pore Spaces in Digital Rocks

Segmentation of high-resolution X-ray microcomputed tomography (µCT) images is crucial in digital rock physics (DRP), affecting the characterization and analysis of microscale phenomena in the porous media. The complexity of geological structures and nonideal scanning conditions pose significant challenges to conventional image segmentation approaches. Motivated by the recent increasing popularity of deep learning (DL) techniques in image processing, this work undertakes a comparative study of DL models, specifically U-Net and its variants, for segmenting multiple targets with distinguished features in digital rocks, including discrete fracture networks (DFNs), pore spaces, and solid rock. Particularly, DFNs have a smaller volumetric fraction over others, bringing in a substantial challenge of imbalanced segmentation. The primary focus is to evaluate the architecture and feature enhancement strategies of various DL models, including U-Net, attention U-Net, residual U-Net, U-Net++, and residual U-Net++. The models were designed as 2.5D, utilizing a central 2D image and its two adjacent upper and lower 2D images as input to provide a pseudo-3D context. In addition, because the ground truth of segmentation was unknown for real-world digital rocks, we created a benchmark data set following the inverse operations of segmentation. The data synthesis started from the label images (i.e., solid rock, pore spaces, and DFNs), followed by simulating partial volume blurring, adding random background noise, and introducing ring artifacts to mimic real raw X-ray µCT images. The data set, which included various rock types (i.e., sandstone and artificial data), scanning resolution, and magnitudes of noise and artifacts, was divided into training and testing data sets with a 90% and 10% ratio, respectively. Moreover, in addition to the conventional pixel-wise evaluation metrics, the physics-based metric of the lattice-Boltzmann method (LBM) simulated permeability provided more comprehensive assessments. The results demonstrated that the residual connections, nested architectures, and redesigned skip connections contribute to the model performance and give the residual U-Net++ the highest accuracy. The improvements were mainly on the boundaries and small targets, especially the DFNs, which dominate the interconnectivity and therefore affect the permeability greatly. This study also rigorously evaluated the efficiency and generalization of each model, demonstrating that the sophisticated architectures achieved excellent practicability and maintained robust performance on completely unseen data, ensuring their suitability for diverse and challenging DRP applications.

58 GEOSCIENCES↗
DOE OSTI2023

Rapid AI-based Dissection of Ashes using Raman and XRF Spectroscopy (RADAR-X)

Waste-to-energy (WTE) facilities incinerate ~35 million tons of municipal solid waste annually in the United States. The incineration process reduces the mass and the volume of the waste fraction by over 75 and 95%, respectively. The fraction left after incineration remains as ash residues and is referred to as WTE ash, compromising of bottom and fly ash. In the United States, ~10 million tons of WTE ashes are generated annually and predominantly landfilled because of the lack of secondary end-use pathways. This incurs a significant financial burden (landfilling costs) on U.S. WTE facilities and also results in the loss of materials to the landfill. The primary objective of this research is to understand better the elemental and mineralogical composition of WTE ashes from diverse origins and find composition dependent upcycling pathways for diverting these ashes from landfills. This primary objective was addressed through three research tasks –(Task I) An AI-led Multi-Modal Approach for Compositional Analysis, (Task II) Developing a Dissolution-Based Test for Real Time Analysis, and (Task III) Establishing composition-dependent end uses. The chemical composition of WTE ash is dependent on two factors, i.e., the input waste composition and the operational parameters of a WTE facility (combustion conditions). Amongst these two factors, the input waste composition will likely show spatial and temporal variation. As a result, the chemical composition of WTE ash will also fluctuate. To understand the spatial and temporal variation in WTE ash composition, in Task I, we collected 128 ash samples (62 bottom ash and 66 fly ash samples) from 11 WTE facilities located in 11 U.S. states and characterized them via X-ray Fluorescence, powder X-ray Diffraction, and Raman Spectroscopy. The findings from this extensive characterization work indicated that the key elements in WTE fly ashes are Ca, Cl (greater than 10 wt. %), Si, S, K, Zn ( between 1 and 10 wt. %), Mg, Al, P, Ti, Fe, Cu, Br, and Pb (between 0.1 and 1 wt. %). Similarly, the key elements in WTE bottom ash fraction finer than 45μm are Ca (greater than 10 wt. %), Mg, Al, Si, S, Cl, K, Ti, Fe, Zn (between 1 and 10 wt. %), P, V, Cr, Mn, Cu, Br, and Pb (between 0.1 and 1 wt. %). Here, we note that the dominant fraction of WTE bottom ash is the coarse fraction. The coarse WTE bottom ash fraction (rich in silicon) was not characterized in this study because of excessive grinding requirements and their unsuitability as a supplementary cementitious material due to their coarse nature. The elements in WTE bottom ashes are present as calcite, anhydrite, vaterite, hydroxyapatite, quartz, bassanite, gehlenite, akermanite, hydrocalumite, and portlandite. Similarly, the mineralogical species present in WTE fly ashes are calcium chloride hydroxide, halite, calcite, anhydrite, sylvite, hydrocalumite, vaterite, hannebachite, quartz, and bassanite. Temporal variation in ash composition may also result in significant fluctuations in chemical compositions. Therefore, a WTE facility may need to monitor the ash composition (elemental and mineralogical composition) in real time. In Task I, we evaluated the possibility of using a portable X-ray fluorescence (XRF) spectrometer to monitor the elemental composition in real-time. Specifically, we collected XRF data on identical specimens via a portable XRF spectrometer (low-end) and a lab-based benchtop XRF spectrometer (high-end). The collected data was used to train an A.I. algorithm (portable XRF data as an input and benchtop XRF data as an output) to predict accurate elemental composition using portable XRF data. Finally, we developed a 2-minute photobleaching protocol to monitor the mineralogical characteristics of WTE ashes via Raman spectroscopy. Overall, the activities in Task I improved our understanding of ash composition and developed techniques to monitor elemental and mineralogical composition in near real-time. Based on the findings of Task I, we find that WTE ashes exhibit wide variability in mineralogy. For ICP-based elemental analysis, all the mineralogical species in WTE ashes must be brought into solution. This is traditionally accomplished with acid digestion using a combination of multiple acids. However, acid digestion with multiple acids is time-consuming and often fails to ensure complete digestion of the ash matrix. To address this limitation, in Task II, we developed an alkali-fusion-based digestion protocol using a combination of lithium tetraborate, lithium metaborate, and their combinations as possible alkali fluxes for digesting WTE ashes entirely and rapidly. The validity of the developed method was evaluated on two standard ash specimens, i.e., SRM 1633c coal fly ash and BCR-176R incineration fly ash specimen. The findings suggest that the developed protocol can ensure complete digestion of elements such as Al, Ba, Ca, Cr, Cu, Mg, Mn, P, Sr, V, Zn, Be, K, and rare earth elements. The recent changes in the energy market towards renewables and increased metal recycling have resulted in reduced supplies of supplementary cementitious materials (coal fly ash and slag). Therefore, in Task III, we evaluated the possibility of employing WTE ashes as SCMs. As the chemical composition of WTE ashes varies temporally (on an hourly basis), there was also a need to develop tests that can evaluate the suitability of material to act as supplementary cementitious material rapidly, i.e., in a few minutes. Therefore, in Task II, we also developed a rapid test to assess the suitability of a material to act as an SCM in 5 minutes. This represents a significant advance over the state-of-the-art R 3 test, which takes ~144 hours. This test was initially validated on amorphous aluminosilicates, such as calcined clays, and could be extended to evaluate other industrial by-products, such as WTE ashes. In Task III, we evaluated the possibility of employing WTE ashes for two applications, i.e., as an SCM and a lime substitute for clay stabilization. The findings from Task I indicated that WTE ashes are enriched in chlorine and, therefore, cannot be used directly as an SCM due to corrosion-related risks and altered hydration kinetics. Accordingly, we developed an ash treatment protocol to reduce the solubility of chlorine-containing species in WTE ashes. The developed treatment protocol also immobilized lead in certain mineral forms. As a result of the treatment, WTE ashes can be used as SCMs without any corrosion or heavy metal leaching concerns. The second application examined in this study was clay stabilization. WTE ashes are calcium-rich and can be an adequate lime replacement for clay stabilization. Our findings reveal that the sum of the concentrations of Ca(OH) 2 and CaClOH controls the clay stabilization capability of WTE ashes. In summary, in this work, we evaluated the elemental and mineralogical characteristics of U.S. WTE ashes from diverse origins and developed tests to evaluate the chemical characteristics of these ashes in real time through a portable XRF and a benchtop Raman spectrometer. Based on the chemical characteristics of these ashes, we developed an ash treatment process to enable the use of WTE ashes as an SCM and also evaluated the possibility of employing these ashes for clay stabilization. Overall, the findings from this work enables the diversion of WTE ashes from landfills for multiple end-uses, i.e., as an SCM or a lime substitute for clay stabilization.

36 MATERIALS SCIENCE↗
NASA NTRS2008

Venus Quadrangle Geological Mapping: Use of Geoscience Data Visualization Systems in Mapping and Training

We are currently investigating new technological developments in computer visualization and analysis in order to assess their importance and utility in planetary geological analysis and mapping [1,2]. Last year we reported on the range of technologies available and on our application of these to various problems in planetary mapping [3]. In this contribution we focus on the application of these techniques and tools to Venus geological mapping at the 1:5M quadrangle scale. In our current Venus mapping projects we have utilized and tested the various platforms to understand their capabilities and assess their usefulness in defining units, establishing stratigraphic relationships, mapping structures, reaching consensus on interpretations and producing map products. We are specifically assessing how computer visualization display qualities (e.g., level of immersion, stereoscopic vs. monoscopic viewing, field of view, large vs. small display size, etc.) influence performance on scientific analysis and geological mapping. We have been exploring four different environments: 1) conventional desktops (DT), 2) semi-immersive Fishtank VR (FT) (i.e., a conventional desktop with head-tracked stereo and 6DOF input), 3) tiled wall displays (TW), and 4) fully immersive virtual reality (IVR) (e.g., "Cave Automatic Virtual Environment," or Cave system). Formal studies demonstrate that fully immersive Cave environments are superior to desktop systems for many tasks [e.g., 4].

Head, James W.↗
NASA NTRS2019

TPSAS-NF1676L-32235-DND

This presentation will provide a summary of the Open Data Cube initiative. In addition, a training manual will be provided to support Open Data Cube training for GEO and the Senegal government.

Brian Killough↗
NASA NTRS2019

TPSAS-NF1676L-32249-DND

This presentation will provide a summary of the Open Data Cube initiative. In addition, a training manual will be provided to support Open Data Cube training for the GEO Secretariat.

Brian Killough↗
NASA NTRS2021

Aerosol and Cloud Detection Using Machine Learning Algorithms and Space-Based Lidar Data

Clouds and aerosols play a significant role in determining the overall atmospheric radiation budget, yet remain a key uncertainty in understanding and predicting the future climate system. In addition to their impact on the Earth’s climate system, aerosols from volcanic eruptions, wildfires, man-made pollution events, and dust storms are hazardous to aviation safety and human health. Space-based lidar systems provide critical information about the vertical distributions of clouds and aerosols that greatly improve our understanding of the climate system. However, daytime data from backscatter lidars, such as the Cloud-Aerosol Transport System (CATS) on the International Space Station (ISS), must be averaged during science processing at the expense of spatial resolution to obtain sufficient signal-to-noise ratio (SNR) for accurately detecting atmospheric features. For example, 50% of all atmospheric features reported in daytime operational CATS data products require averaging to 60 km for detection. Furthermore, the single-wavelength nature of the CATS primary operation mode makes accurately typing these features challenging in complex scenes. This paper presents machine learning (ML) techniques that, when applied to CATS data, enable detection of atmospheric features during daytime operations with a horizontal resolution of 5 km compared to the 60 km horizontal resolution often required for daytime CATS data. A Convolutional Neural Network (CNN) trained using CATS standard data products also demonstrated the potential for improved cloud-aerosol discrimination compared to the operational CATS algorithms for cloud edges and complex near-surface scenes during daytime.

lidar↗
NASA NTRSDate not supplied

Machine Learning Algorithms for Aerosol and Cloud Detection Using CATS on the ISS

Clouds and aerosols are one of the largest uncertainties in understanding and forecasting the Earth’s changing climate system. The type and height of aerosols are important factors in determining the top-of-atmosphere (TOA) radiation budget, either direct reflection of solar radiation back to space and/or absorption of solar radiation. In addition to their impact on the Earth’s climate system, aerosols near the surface from wildfires, man-made pollution events, and dust storms are hazardous to human health. The phase and height of clouds also play a critical role in determining the role of clouds in the Earth’s climate system. Cirrus clouds in the upper troposphere can induce a significant daytime TOA warming effect, while liquid water clouds near the surface cause a large corresponding cooling effect. Lidar measurements provide accurate vertically resolved information about clouds and aerosols, including complex multi-layer scenes where passive sensors are challenged and at night, when passive sensors are unable to measure cloud and aerosol properties. The Cloud-Aerosol Transport System (CATS) is a lidar instrument that operated for 33 months on the International Space Station (ISS) at the 1064 nm wavelength to measure attenuated total backscatter and depolarization ratio. These fundamental measurements are used to derive “vertical feature mask” cloud and aerosol products, including layer top/base heights, layer geometrical thickness, aerosol type, and cloud phase. While space-based lidar systems like CATS provide cloud and aerosol vertical distributions that improve our understanding of the climate system, averaging of the daytime data from these sensors is required, at the expense of spatial resolution, to improve the daytime signal-to noise (SNR) and thus atmospheric layer detection. This presentation shows results from machine learning (ML) techniques that, when applied to CATS data: 1. improve the 1064 nm SNR 2. enable detection of atmospheric features during daytime with a horizontal resolution of 350 m or 5 km (compared to the 60 km required for standard CATS data products) 3. increase the number of atmospheric layers detected in the CATS data. A Convolutional Neural Network (CNN) trained using CATS standard data products also demonstrated the potential for improved cloud-aerosol discrimination, cloud phase, and aerosol typing compared to the operational CATS algorithms for cloud edges and complex near-surface scenes during daytime. The ML tools described in this paper can facilitate the development of smaller, low-cost lidar systems in the future and enable real-time accessibility of lidar data products from future lidar systems for monitoring and forecasting of hazardous events.

John Yorks↗
DOE OSTI2018

Bayesian Calibration of Inertial Confinement Fusion Models with Very Expensive Data

Calibrating computer simulations against experimental data is a ubiquitous problem in science and is particularly difficult when experimental data are expensive or diffi- cult to collect. In inertial confinement fusion experiments, where a single data point can cost 10 5 –10 6 USD, calibration of large-scale design calculations is particularly challenging. We present a framework that aims to provide calibrated predictions far from the available data that can be trained using a small number of data points. The approach aims to retain as much of the physics (summarized by the simulation code) as possible and is based on a truncated polynomial chaos expansion in the space of simulation inputs, augmented with a non-parametric correction for higher distribution modes. Due to the difficulty of the problem, understanding the sources of uncertainty in the model is essential; we demonstrate this through an application of our approach to a series of 6 experimental laser shots. As a result, we validate our approach, show that the uncertainties in our predictions of experimental performance are dominated by shot-shot fluctuations and regression uncertainties, and discuss paths towards an improved prediction model.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Domain adaptation techniques for improved cross-domain study of galaxy mergers

In astronomy, neural networks are often trained on simulated data with the prospect of being applied to real observations. Unfortunately, simply training a deep neural network on images from one domain does not guarantee satisfactory performance on new images from a different domain. The ability to share cross-domain knowledge is the main advantage of modern deep domain adaptation techniques. Here we demonstrate the use of two techniques - Maximum Mean Discrepancy (MMD) and adversarial training with Domain Adversarial Neural Networks (DANN) - for the classification of distant galaxy mergers from the Illustris-1 simulation, where the two domains presented differ only due to inclusion of observational noise. We show how the addition of either MMD or adversarial training greatly improves the performance of the classifier on the target domain when compared to conventional machine learning algorithms, thereby demonstrating great promise for their use in astronomy.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2021

A novel implicit hybrid machine learning model and its application for reinforcement learning

A novel methodology to develop implicit hybrid models is presented. PyTorch is used to integrate physics-based equations with machine learning models. Automatic differentiation of the hybrid model is leveraged to solve the implicit equations. Iterative solving enables gradient based updates to the machine learning model. The novel methodology is compared to an explicit hybrid approach on a continuously stirred tank reactor (CSTR). The novel method results in a lower modelling error. Both hybrid models effectively train with noisy data. To test the implicit hybrid model, it is employed as a reinforcement learning (RL) training model. The RL algorithm trained on the hybrid model outperforms real time optimization of the CSTR and performs nearly as well as RL trained directly on the CSTR and a traditional gradient based approach. Training RL directly on the CSTR requires over 60,000 system interactions compared to 6000 historical data points for hybrid model development.

42 ENGINEERING↗